Permalink
Commits on Jun 7, 2013
  1. Feature nested JSON support

    Add JsonParser from original HEAD.
    Add test for JsonParser from original HEAD.
    committed with Knut O. Hellan Jun 7, 2013
Commits on Feb 14, 2012
  1. Fix robustly handle unexpected type

    Loader and Utility both handle Array in input
    Utility return empty Object rather than null
    Knut O. Hellan committed Feb 14, 2012
Commits on Dec 5, 2011
  1. Bugfix: Not barfing on parse errors

    Handle NullPointerEception from JSONParser
    Return an empty Tuple on error
    Knut O. Hellan committed Dec 5, 2011
Commits on Mar 15, 2011
  1. General JSON utilitity

    Nested JSON was not handled by the JSON loader. This little utility does.
    
    Not that Pig did not like nested JSON in this one either so any internal complex objects are still returned as JSON encoded strings.
    Knut O. Hellan committed Mar 15, 2011
  2. Added changes information

    Updated Changes.md with information about the stripping and purification of the orginal Elephant Bird down to a single purpose json loader
    Knut O. Hellan committed Mar 15, 2011
  3. Adapted Readme.md

    The original Readme.md was not completely accurate anymore to say the least. Changed it to reflect that this is just a modified little snippet of the original elephant bird.
    Knut O. Hellan committed Mar 15, 2011
  4. Google collect is needed

    Brought back google collect after removing it in the previous commit. It turns out that this one can come in handy
    Knut O. Hellan committed Mar 15, 2011
  5. Lightening the package

    Removed all unused jars from the package. This includes everything related to thrift and protobuffer. Sadly, it also includes junit, but there are no longer any relevant tests anyway. Might be useful to add some though.
    Knut O. Hellan committed Mar 15, 2011
  6. Stripped down to the JSON loader

    Removed all source code, test code, examples and build stuff not needed for the JsonLoader.
    Replaced the pig library with the 0.8.0 pig
    Replaced the JsonLoader with  Kim Vogt's PigJsonLoader found here: https://gist.github.com/601331
    Knut O. Hellan committed Mar 15, 2011
  7. Added those pesky VI swp-files to .gitignore

    Knut O. Hellan committed Mar 15, 2011
Commits on Mar 14, 2011
  1. Version bump to 1.2.2

    dvryaboy committed Mar 14, 2011
Commits on Mar 10, 2011
  1. Merge remote branch 'origin/eb1.2.2-dev' into eb1.2.2-dev

    Raghu Angadi committed Mar 10, 2011
  2. Protobuf Pig storage : don't reuse builder object.

    Raghu Angadi committed Mar 7, 2011
Commits on Mar 8, 2011
  1. Merge branch '121-dev' into eb1.2.2-dev

    Raghu Angadi committed Mar 8, 2011
Commits on Mar 7, 2011
  1. minor

    Raghu Angadi committed Mar 7, 2011
  2. Version update to 1.2.1

    dvryaboy committed Mar 7, 2011
  3. update docs

    dvryaboy committed Mar 7, 2011
  4. Add a plain JsonLoader.

    Squashed commit of the following:
    
    commit ecf8356
    Author: dvryaboy <dvryaboy@gmail.com>
    Date:   Mon Mar 7 13:38:40 2011 -0800
    
        Fix up minor leftover bits in JsonLoader
    
    commit 9d9c229
    Author: dvryaboy <dvryaboy@gmail.com>
    Date:   Mon Feb 21 14:34:28 2011 -0800
    
        trying to make JsonLoader inherit better from PigStorage.
    
    commit c269a39
    Author: dvryaboy <dvryaboy@gmail.com>
    Date:   Sun Feb 20 22:06:37 2011 -0800
    
        add test for TestJsonStringToMap
    
    commit f364701
    Author: dvryaboy <dvryaboy@gmail.com>
    Date:   Sun Feb 20 22:03:15 2011 -0800
    
        add jsonStringToMap udf
    
    commit 9be0414
    Author: dvryaboy <dvryaboy@gmail.com>
    Date:   Sun Feb 20 20:59:42 2011 -0800
    
        added nonothing ant target to allow building without thrift and protoc
    
    commit 6c4a0f3
    Author: dvryaboy <dvryaboy@gmail.com>
    Date:   Sun Feb 20 20:49:09 2011 -0800
    
        add a slap-dash non-lzo json loader.
    dvryaboy committed Mar 7, 2011
  5. PigToProtobuf :

      - handle BOOL and BYTES correctly.
      - added test in TestPigToProto.
    LzoProtobuf[B64Line|Block]Storage are made concrete classes.
    Raghu Angadi committed Mar 7, 2011
Commits on Mar 4, 2011
  1. ThriftToPig schema :

      - DOUBLE was missing
      - hack to get around the fact that Thrift does not have TType.BINARY.
    Raghu Angadi committed Mar 4, 2011
Commits on Mar 2, 2011
  1. add Deprecated input format for json.

    DeprecatedLzoJsonRecordReader is a wrapper over Text counterpart.
    Raghu Angadi committed Mar 2, 2011
  2. - add ThriftBytesToTuple UDF.

       - ThriftToPig test is updated to test the UDF
     - ProtobufBytesToTuple is made a concrete class so
       that we use it without codegen.
    Raghu Angadi committed Mar 2, 2011
Commits on Feb 23, 2011
  1. Another update to BinaryWritables : at any time we should have

    serialized buffer or the actual object, but not both. since
    user could modify the object (in the case of Thrift).
    Raghu Angadi committed Feb 23, 2011
Commits on Feb 20, 2011
  1. Make ProtobufWritable have stable hashCode() across intances of JVM

    Rework some of the lazy serialization/deserialization logic
    Add a gnarly test that spins up a separate JVM
    dvryaboy committed Feb 20, 2011
Commits on Feb 15, 2011
  1. Regenerate javadocs for 1.2

    dvryaboy committed Feb 15, 2011
  2. Make HBaseLoader compile. Oops.

    dvryaboy committed Feb 15, 2011
  3. Bump version.

    dvryaboy committed Feb 15, 2011
  4. Upgrade Thrift to 0.5

    Squashed commit of the following:
    
    commit 00ebf95
    Author: Raghu Angadi <raghu@twitter.com>
    Date:   Mon Feb 14 09:45:34 2011 -0800
    
        minor
    
    commit 0e65a35
    Author: Raghu Angadi <raghu@twitter.com>
    Date:   Fri Feb 11 14:24:18 2011 -0800
    
        remove optimization to avoid copy in writeBinary() since we can copy
        more efficiently than DataByteArray() currently does.
    
    commit 16f8f44
    Author: Raghu Angadi <raghu@twitter.com>
    Date:   Fri Feb 11 10:42:44 2011 -0800
    
        switch to thrift 0.5.0. Replacing TBase<?> with TBase<?, ?> accounts
        for most of the patch. Another notable change is that Thrift stores
        'binary' variables as ByteBuffer rather than as a byte[].
    
    commit 1696521
    Author: Raghu Angadi <raghu@twitter.com>
    Date:   Fri Feb 11 10:11:25 2011 -0800
    
        Update exmaples directory.
    
    commit 8b9d040
    Author: Raghu Angadi <raghu@twitter.com>
    Date:   Fri Feb 11 10:07:37 2011 -0800
    
        Switch thrift libraries to thrift 0.5.0.
        to generate thrift-test-0.5.0.jar:
          run 'ant test' in lib/java
          cd build/test there.
          jar -cf thrift-test-0.5.0.jar -C . org thrift
    dvryaboy committed Feb 15, 2011
Commits on Feb 14, 2011