Upgrade dependencies #1669

xvrl · 2015-08-25T23:22:10Z

Lots of shiny new things

fjy · 2015-08-26T00:48:09Z

👍

nishantmonu51 · 2015-08-26T04:23:48Z

+1

Upgrade dependencies

gianm · 2015-08-26T22:54:18Z

Getting some hadoop problems now, I think they're due to the jackson upgrade. Looks like hadoop pulls in an older version of the basic jackson jars, but not jackson-datatype-guava, so the newer jackson-datatype-guava of druid blows up when it tries to call into the core jackson stuff.

15/08/26 22:40:49 ERROR cli.CliHadoopIndexer: failure!!!!
java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at io.druid.cli.CliHadoopIndexer.run(CliHadoopIndexer.java:120)
    at io.druid.cli.Main.main(Main.java:91)
Caused by: java.lang.NoSuchMethodError: com.fasterxml.jackson.databind.type.TypeFactory.constructReferenceType(Ljava/lang/Class;Lcom/fasterxml/jackson/databind/JavaType;)Lcom/fasterxml/jackson/databind/JavaType;
    at com.fasterxml.jackson.datatype.guava.GuavaTypeModifier.modifyType(GuavaTypeModifier.java:104)
    at com.fasterxml.jackson.databind.type.TypeFactory._constructType(TypeFactory.java:414)
    at com.fasterxml.jackson.databind.type.TypeFactory.constructType(TypeFactory.java:358)
    at com.fasterxml.jackson.databind.cfg.MapperConfig.constructType(MapperConfig.java:268)
    at com.fasterxml.jackson.databind.cfg.MapperConfig.introspectClassAnnotations(MapperConfig.java:298)
    at com.fasterxml.jackson.databind.ser.BeanSerializerFactory.removeIgnorableTypes(BeanSerializerFactory.java:651)
    at com.fasterxml.jackson.databind.ser.BeanSerializerFactory.findBeanProperties(BeanSerializerFactory.java:522)
    at com.fasterxml.jackson.databind.ser.BeanSerializerFactory.constructBeanSerializer(BeanSerializerFactory.java:344)
    at com.fasterxml.jackson.databind.ser.BeanSerializerFactory.findBeanSerializer(BeanSerializerFactory.java:263)
    at com.fasterxml.jackson.databind.ser.BeanSerializerFactory._createSerializer2(BeanSerializerFactory.java:222)
    at com.fasterxml.jackson.databind.ser.BeanSerializerFactory.createSerializer(BeanSerializerFactory.java:152)
    at com.fasterxml.jackson.databind.SerializerProvider._createUntypedSerializer(SerializerProvider.java:1108)
    at com.fasterxml.jackson.databind.SerializerProvider._createAndCacheUntypedSerializer(SerializerProvider.java:1068)
    at com.fasterxml.jackson.databind.SerializerProvider.findPrimaryPropertySerializer(SerializerProvider.java:585)
    at com.fasterxml.jackson.databind.ser.impl.PropertySerializerMap.findAndAddPrimarySerializer(PropertySerializerMap.java:69)
    at com.fasterxml.jackson.databind.ser.BeanPropertyWriter._findAndAddDynamic(BeanPropertyWriter.java:668)
    at com.fasterxml.jackson.databind.ser.BeanPropertyWriter.serializeAsField(BeanPropertyWriter.java:483)
    at com.fasterxml.jackson.databind.ser.std.BeanSerializerBase.serializeFields(BeanSerializerBase.java:639)
    at com.fasterxml.jackson.databind.ser.BeanSerializer.serialize(BeanSerializer.java:152)
    at com.fasterxml.jackson.databind.ser.BeanPropertyWriter.serializeAsField(BeanPropertyWriter.java:505)
    at com.fasterxml.jackson.databind.ser.std.BeanSerializerBase.serializeFields(BeanSerializerBase.java:639)
    at com.fasterxml.jackson.databind.ser.BeanSerializer.serialize(BeanSerializer.java:152)
    at com.fasterxml.jackson.databind.ser.BeanPropertyWriter.serializeAsField(BeanPropertyWriter.java:505)
    at com.fasterxml.jackson.databind.ser.std.BeanSerializerBase.serializeFields(BeanSerializerBase.java:639)
    at com.fasterxml.jackson.databind.ser.BeanSerializer.serialize(BeanSerializer.java:152)
    at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:128)
    at com.fasterxml.jackson.databind.ObjectWriter._configAndWriteValue(ObjectWriter.java:800)
    at com.fasterxml.jackson.databind.ObjectWriter.writeValueAsString(ObjectWriter.java:676)
    at io.druid.indexer.HadoopDruidIndexerConfig.verify(HadoopDruidIndexerConfig.java:548)
    at io.druid.indexer.HadoopDruidIndexerJob.<init>(HadoopDruidIndexerJob.java:44)
    at io.druid.cli.CliInternalHadoopIndexer.run(CliInternalHadoopIndexer.java:131)
    at io.druid.cli.Main.main(Main.java:91)
    ... 6 more

xvrl · 2015-08-26T23:35:06Z

@gianm I'm ok downgrading to the latest version of jackson that doesn't exhibit the problem, let's try the latest 2.5.x see if that works, since that method was introduced in 2.6.

Long term we need a better way of isolating the hadoop-only parts to they don't hold up the rest of the stack on older versions.

drcrallen · 2015-08-26T23:38:11Z

...we need a better way of isolating the hadoop-only parts to they don't hold up the rest of the stack on older versions
@xvrl Says everyone everywhere

gianm · 2015-08-27T00:33:23Z

2.5.4 doesn't work either. The method in the exception was added in 2.5 according to http://fasterxml.github.io/jackson-databind/javadoc/2.5/com/fasterxml/jackson/databind/type/TypeFactory.html#constructParametrizedType(java.lang.Class, java.lang.Class, com.fasterxml.jackson.databind.JavaType...)

So I think we are stuck on 2.4.x…

java.lang.NoSuchMethodError: com.fasterxml.jackson.databind.type.TypeFactory.constructParametrizedType(Ljava/lang/Class;Ljava/lang/Class;[Lcom/fasterxml/jackson/databind/JavaType;)Lcom/fasterxml/jackson/databind/JavaType;
    at com.fasterxml.jackson.datatype.guava.GuavaTypeModifier.modifyType(GuavaTypeModifier.java:102)
    at com.fasterxml.jackson.databind.type.TypeFactory._constructType(TypeFactory.java:414)
    at com.fasterxml.jackson.databind.type.TypeFactory.constructType(TypeFactory.java:358)
    at com.fasterxml.jackson.databind.cfg.MapperConfig.constructType(MapperConfig.java:268)
    at com.fasterxml.jackson.databind.cfg.MapperConfig.introspectClassAnnotations(MapperConfig.java:298)
    at com.fasterxml.jackson.databind.ser.BeanSerializerFactory.removeIgnorableTypes(BeanSerializerFactory.java:651)
    at com.fasterxml.jackson.databind.ser.BeanSerializerFactory.findBeanProperties(BeanSerializerFactory.java:522)
    at com.fasterxml.jackson.databind.ser.BeanSerializerFactory.constructBeanSerializer(BeanSerializerFactory.java:344)
    at com.fasterxml.jackson.databind.ser.BeanSerializerFactory.findBeanSerializer(BeanSerializerFactory.java:263)
    at com.fasterxml.jackson.databind.ser.BeanSerializerFactory._createSerializer2(BeanSerializerFactory.java:222)
    at com.fasterxml.jackson.databind.ser.BeanSerializerFactory.createSerializer(BeanSerializerFactory.java:152)
    at com.fasterxml.jackson.databind.SerializerProvider._createUntypedSerializer(SerializerProvider.java:1108)
    at com.fasterxml.jackson.databind.SerializerProvider._createAndCacheUntypedSerializer(SerializerProvider.java:1068)
    at com.fasterxml.jackson.databind.SerializerProvider.findPrimaryPropertySerializer(SerializerProvider.java:585)
    at com.fasterxml.jackson.databind.ser.impl.PropertySerializerMap.findAndAddPrimarySerializer(PropertySerializerMap.java:69)
    at com.fasterxml.jackson.databind.ser.BeanPropertyWriter._findAndAddDynamic(BeanPropertyWriter.java:668)
    at com.fasterxml.jackson.databind.ser.BeanPropertyWriter.serializeAsField(BeanPropertyWriter.java:483)
    at com.fasterxml.jackson.databind.ser.std.BeanSerializerBase.serializeFields(BeanSerializerBase.java:639)
    at com.fasterxml.jackson.databind.ser.BeanSerializer.serialize(BeanSerializer.java:152)
    at com.fasterxml.jackson.databind.ser.BeanPropertyWriter.serializeAsField(BeanPropertyWriter.java:505)
    at com.fasterxml.jackson.databind.ser.std.BeanSerializerBase.serializeFields(BeanSerializerBase.java:639)
    at com.fasterxml.jackson.databind.ser.BeanSerializer.serialize(BeanSerializer.java:152)
    at com.fasterxml.jackson.databind.ser.BeanPropertyWriter.serializeAsField(BeanPropertyWriter.java:505)
    at com.fasterxml.jackson.databind.ser.std.BeanSerializerBase.serializeFields(BeanSerializerBase.java:639)
    at com.fasterxml.jackson.databind.ser.BeanSerializer.serialize(BeanSerializer.java:152)
    at com.fasterxml.jackson.databind.ser.DefaultSerializerProvider.serializeValue(DefaultSerializerProvider.java:128)
    at com.fasterxml.jackson.databind.ObjectWriter._configAndWriteValue(ObjectWriter.java:800)
    at com.fasterxml.jackson.databind.ObjectWriter.writeValueAsString(ObjectWriter.java:676)
    at io.druid.indexer.HadoopDruidIndexerConfig.verify(HadoopDruidIndexerConfig.java:548)
    at io.druid.indexer.HadoopDruidIndexerJob.<init>(HadoopDruidIndexerJob.java:44)
    at io.druid.cli.CliInternalHadoopIndexer.run(CliInternalHadoopIndexer.java:131)
    at io.druid.cli.Main.main(Main.java:91)
    ... 6 more

xvrl added 16 commits August 25, 2015 16:07

update druid-api to 0.3.11

d601038

update airline to 0.7

9a0c15c

update jets3t to 0.9.4

edaaf52

update mapdb to 1.0.8

8b294d4

update jetty to 9.2.13.v20150730 (latest Java 7 compatible version)

ac4a856

update jackson to 2.6.1

51f6a9a

update log4j to 2.3

172a44b

update slf4j to 1.7.12

8be5fe0

update aws-sdk to 1.10.12

f681b20

update joda-time to 2.8

2fa87c4

update irc library to 1.0-0014

3a83a0f

update coveralls plugin to 3.2.0

123f634

update jdbi to 2.63.1

dc11f90

update joda to 2.8.2

21aadb8

update java-util to 0.27.2

d5143c0

remove unnecessary pom verbiage

c4d0e8d

xvrl added a commit that referenced this pull request Aug 26, 2015

Merge pull request #1669 from metamx/upgrade-dependencies

fdb6a66

Upgrade dependencies

xvrl merged commit fdb6a66 into apache:master Aug 26, 2015

xvrl deleted the upgrade-dependencies branch August 26, 2015 04:30

gianm mentioned this pull request Aug 27, 2015

Downgrade Jackson to 2.4.6. #1674

Merged

kupferk mentioned this pull request Dec 14, 2015

Version conflict in jackson with Cloudera Hadoop #2087

Closed

gianm mentioned this pull request Jan 8, 2016

Downgrade Jackson to match the version in Druid. druid-io/tranquility#81

Merged

drcrallen mentioned this pull request Jun 6, 2017

Update Jackson to >= 2.6 #4372

Closed

Suryansh-Bhadouria-007 mentioned this pull request Jun 20, 2019

Not able to compile tranquility-core source code with jdk 11 & scala 2.12.1 & sbt 1.2.8 druid-io/tranquility#302

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Upgrade dependencies #1669

Upgrade dependencies #1669

xvrl commented Aug 25, 2015

fjy commented Aug 26, 2015

nishantmonu51 commented Aug 26, 2015

gianm commented Aug 26, 2015

xvrl commented Aug 26, 2015

drcrallen commented Aug 26, 2015

gianm commented Aug 27, 2015

Upgrade dependencies #1669

Upgrade dependencies #1669

Conversation

xvrl commented Aug 25, 2015

fjy commented Aug 26, 2015

nishantmonu51 commented Aug 26, 2015

gianm commented Aug 26, 2015

xvrl commented Aug 26, 2015

drcrallen commented Aug 26, 2015

gianm commented Aug 27, 2015