Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP

Loading…

Fixes Wonderdog Pig 0.10 compatability issues and issues 5, 6, 7 and PIG-2792 #11

Merged
merged 1 commit into from

3 participants

@rjurney

Fixed Wonderdog for Pig 0.10 and Pig local mode by checking the conf object if the call to the hadoop cache misses

@kornypoet kornypoet merged commit c679a25 into from
@alexmc6

Can anyone confirm this has actually fixed the problem and that it works fine in Pig 0.10? I am getting a versioning error which suggests it isn't

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Commits on Jul 9, 2012
  1. @rjurney

    Fixed Wonderdog for Pig 0.10 by checking the conf object if the call …

    rjurney authored
    …to the hadoop cache misses
This page is out of date. Refresh to see the latest.
View
6 src/main/java/com/infochimps/elasticsearch/ElasticSearchOutputFormat.java
@@ -120,7 +120,8 @@ public ElasticSearchRecordWriter(TaskAttemptContext context) {
this.objType = conf.get(ES_OBJECT_TYPE);
//
- // Fetches elasticsearch.yml and the plugins directory from the distributed cache
+ // Fetches elasticsearch.yml and the plugins directory from the distributed cache, or
+ // from the local config.
//
try {
String taskConfigPath = HadoopUtils.fetchFileFromCache(ES_CONFIG_NAME, conf);
@@ -130,7 +131,8 @@ public ElasticSearchRecordWriter(TaskAttemptContext context) {
System.setProperty(ES_CONFIG, taskConfigPath);
System.setProperty(ES_PLUGINS, taskPluginsPath+SLASH+ES_PLUGINS_NAME);
} catch (Exception e) {
- throw new RuntimeException(e);
+ System.setProperty(ES_CONFIG,conf.get(ES_CONFIG));
+ System.setProperty(ES_PLUGINS,conf.get(ES_PLUGINS));
}
start_embedded_client();
Something went wrong with that request. Please try again.