Permalink
Commits on Mar 24, 2017
  1. Merge pull request #1655 from alambert/alambert/vertica

    Improve Vertica support in scalding-db
    benpence committed on GitHub Mar 24, 2017
  2. Add andThen to Mappable (#1656)

    Mappable.andThen is defined in TypedSource and when invoked it
    returns a TypedSource. In this patch I'm overriding that method
    so that when you invoke a Mappable.andThen it returns a Mappable
    object. This can be useful when the user of Mappable wants to do
    toIeratable after applying a transformation using andThen
    lclementi committed with johnynek Mar 24, 2017
Commits on Mar 23, 2017
  1. Scalding updates for Scala 2.12 (#1646)

    * start upgrade to 2.12
    
    * Bump bijection, chill
    
    * Add Scala 2.12 related repl code
    
    * Scala 2.12 version bumps + _equals fix
    
    * Suppress Option[Partial] warnings
    
    * Add fallback for scrooge-serializer on Scala 2.10
    
    * Add scala 2.12 build targets
    
    * Fix parquet-scrooge and parquet tests on 2.12
    
    * Drop support for 2.10
    
    * Fix scalding-serialization tests
    
    * Get thrift macros to compile with latest Scalacheck
    
    * Fix scalding-db tests
    
    * Exclude guava from scrooge imports
    
    * Use mima 0.1.14
    
    * Update scalding-thrift-macros jdk version to java8
    
    * Fix OrderedSerialization test failures
    
    * Break boxed lambdas into 2 lists to get around Scala 2.12 bug
    
    * Try catching CNF in LineNumber
    
    * Drop line numbers from hashJoin scalding hadoop test
    
    * Switch default to jdk8 as scrooge deps have been built with that
    
    * Update scald.rb to pick up 2.12
    
    * Try latest jline version
    
    * Try and fix merge issues
    
    * Wrap Execution line better
    
    * Remove scrooge method
    
    * Drop _equals method
    
    * Try private[ser] for Boxed issues
    
    * Reorder hashCode and equals
    piyushnarang committed on GitHub Mar 23, 2017
Commits on Mar 22, 2017
  1. remove unnecessary condition

    alambert committed Mar 22, 2017
  2. reset version

    alambert committed Mar 22, 2017
Commits on Mar 9, 2017
  1. Merge pull request #1651 from jbalogh/repl-expand-libjars

    Expand libjars globs in ScaldingShell to match the behavior of Tool.
    ianoc committed on GitHub Mar 9, 2017
Commits on Mar 8, 2017
Commits on Mar 2, 2017
  1. Merge pull request #1650 from dieu/apanasenko/fix_reduce_estimator

    Fixed reduce estimator for paths with a glob pattern
    dieu committed on GitHub Mar 2, 2017
Commits on Feb 28, 2017
  1. Use Batched in Sketch production (#1648)

    johnynek committed on GitHub Feb 28, 2017
Commits on Feb 24, 2017
  1. Merge pull request #1645 from dieu/apanasenko/1510

    Using MAP_OUTPUT_BYTES instead of FILE_BYTES_READ in RatioBasedEstimator
    dieu committed on GitHub Feb 24, 2017
Commits on Feb 23, 2017
  1. Merge pull request #1644 from dieu/apanasenko/reduce_estimator_vkvs

    Use JobConf input files list for input size computation used by ReducersEstimators
    dieu committed on GitHub Feb 23, 2017
Commits on Feb 14, 2017
  1. Merge pull request #1640 from piyushnarang/bump-algebird

    Pick up Algebird 0.13.0
    piyushnarang committed on GitHub Feb 14, 2017
Commits on Feb 13, 2017
  1. Pick up Algebird 0.13.0

    piyushnarang committed Feb 13, 2017
Commits on Feb 6, 2017
  1. Merge pull request #1635 from twitter/apanasenko/distributed_cache_ex…

    …ecution
    
    Added API for Execution/Config to work with DistributedCache
    dieu committed on GitHub Feb 6, 2017
  2. Added Execution API for work with distributed cache files

    dieu committed Feb 2, 2017
Commits on Jan 18, 2017
  1. Bump chill version to 0.8.3 (#1634)

    Bump chill version to 0.8.3 and fix started to fail `ConfigTest` because `void` is serializable by default in Kryo now.
    ttim committed on GitHub Jan 18, 2017
Commits on Jan 13, 2017
Commits on Dec 10, 2016
  1. Allow supplying better error messages in InvaidSourceTap/Exception (#…

    …1626)
    
    * Allow supplying better error messages and chained exceptions in InvalidSourceTap / InvalidSourceException
    
    * Add 2ndary constructor to InvalidSourceException
    isnotinvain committed with johnynek Dec 10, 2016
  2. Upgrade build to sbt 0.13.13 (#1629)

    * upgrade sbt
    
    * fix repl
    sritchie committed with johnynek Dec 10, 2016
Commits on Dec 5, 2016
  1. TypedText - Added versions of dailyPrefixSuffix for TSV and CSV sourc…

    …es. (#1627)
    
    * TypedText - Added versions of dailyPrefixSuffix for TSV and CSV sources.
    
    * TypedText - Refactored functions for loading files with different types of delimiters.
    cavorite committed with johnynek Dec 5, 2016
Commits on Nov 19, 2016
Commits on Nov 17, 2016
  1. Merge pull request #1622 from isnotinvain/alexlevenson/revert-empty-dir

    Revert FileSource support for empty directories
    isnotinvain committed on GitHub Nov 17, 2016
  2. Clean up temporary files created by forceToDiskExecution (#1621)

    * Clean up temporary files created by forceToDiskExecution
    
    * Try disabling travis caching
    
    * Revert "Try disabling travis caching"
    
    This reverts commit b9a04b6.
    
    * Forward filesToCleanup to parent in cleanCache
    
    * consistency
    
    * synchronize in addFilesToCleanup
    ajohnson-stripe committed with johnynek Nov 17, 2016
Commits on Nov 15, 2016
  1. Moving the repl in wonderland to a dedicated md file (#1614)

    * Set up repl tutorial
    
    * Move wonderland tutorial under tutorial/
    piyushnarang committed with johnynek Nov 15, 2016
Commits on Nov 7, 2016
  1. Use correct fields when returning an empty tap in FileSource (#1618)

    * Use correct fields when returning an empty tap in FileSource
    
    * Split into two separate sources
    
    * Move test jobs that are used for line number tests to separate file
    
    * use correct file name
    
    * use correct line number
    isnotinvain committed with johnynek Nov 7, 2016
Commits on Oct 28, 2016
  1. Merge pull request #1613 from isnotinvain/alexlevenson/filesource-deb…

    …ug-logging
    
    Add options for verbose logging in FileSource
    isnotinvain committed on GitHub Oct 28, 2016
Commits on Oct 27, 2016
  1. Address review comments

    isnotinvain committed Oct 27, 2016
Commits on Oct 26, 2016
Commits on Oct 19, 2016
  1. Merge pull request #1611 from piyushnarang/add-fields-all

    Add all fields while constructing empty iterable source
    piyushnarang committed on GitHub Oct 19, 2016