André Kelpe fs111

Organizations

@iRail @ConcurrentCore @Cascading
fs111 commented on commit Cascading/pattern@7d14c1db56
@fs111

Hi @liammooney thanks for brining that up. We will have to investigate what our options are. Stay tuned for feedback.

@fs111
@fs111
@fs111
@fs111
@fs111
  • @fs111 a0594c8
    update to tez 0.7.0 and hadoo 2.6.0
@fs111
  • @fs111 bb49129
    create rpm and debian packages during build
@fs111
fs111 commented on pull request Netflix/PigPen#163
@fs111

You have to add this to the config: jobConf.set( "mapreduce.framework.name", "local" ); In the cascading case, it would even be easier to use our T…

fs111 commented on issue Netflix/PigPen#160
@fs111

It makes sense to do it that way only if you only use cascading APIs. While most platforms have Hadoop ties, it is perfectly possible to have a pla…

@fs111
  • @fs111 7b3932d
    use more conservative DAG scheduling for Tez platform
fs111 commented on pull request Cascading/cascading-hive#17
@fs111

This is the build with your changes in it: http://conjars.org/cascading/cascading-hive/versions/2.0.0-wip-9

fs111 closed pull request Cascading/cascading-hive#17
@fs111
Add ability to read ORC+ACID tables
fs111 commented on pull request Cascading/cascading-hive#17
@fs111

I have squashed your commits into one, applied our formatting and removed the usage of guava. Guava is a huge pain in the hadoop world, so in order…

@fs111
  • @teabot e23d27d
    Added feature to read ORC+ACID tables
fs111 commented on pull request Cascading/cascading-hive#17
@fs111

just add a second commit. We are not using merge commits, so I have to do some manual git, before it becomes public.

fs111 commented on issue Netflix/PigPen#160
@fs111

the thing is a little bit more complicated: Cascading has a notion of platforms, on which it can run. Each platform is the abstraction of a runtime…

fs111 commented on pull request Cascading/cascading-hive#17
@fs111

I am seeing one test failure, even before touching anything: cascading.tap.hive.LockManagerTest > testAcquireLockCheckLocks FAILED org.junit.Compar…

fs111 commented on issue Netflix/PigPen#160
@fs111

Cascading should be in the jar you submit, hadoop is meant to be set to provided.

fs111 commented on issue Netflix/PigPen#161
@fs111

The overloaded variant feels more natural to a Cascading user, I'd say

fs111 commented on pull request Netflix/PigPen#162
@fs111

That looks great. I was not sure how to get to the runtime version myself. This is def. better than my try.

fs111 commented on pull request Cascading/cascading-hive#17
@fs111

I am going to remove it from the commit. I will have to reformat it anyway. The attribution will stay intact.

fs111 commented on pull request Cascading/cascading-hive#17
@fs111

This is awesome! Huge thanks for that. Could you send me signed copy of our contributor agreement, so that I can integrate it? http://files.concurr…

@fs111
@fs111
  • @fs111 d4d991f
    use official 2.7 SDK releases
fs111 created branch 2.7 at Cascading/CascadingSDK
@fs111
  • @fs111 137ee3a
    update to scalding 0.14.0