Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Change BloomFilter implementation for Sparse Joins #1806

Merged
merged 46 commits into from May 3, 2019
Merged

Change BloomFilter implementation for Sparse Joins #1806

merged 46 commits into from May 3, 2019

Commits on Mar 22, 2019

  1. update docs

    @nevillelyh
    nevillelyh committed Mar 22, 2019
    Configuration menu
    Copy the full SHA
    d70edee View commit details
    Browse the repository at this point in the history

  2. fix maven-metadata.xml URL in scripts/bump_scio.sh

    @nevillelyh
    nevillelyh committed Mar 22, 2019
    Configuration menu
    Copy the full SHA
    8181a11 View commit details
    Browse the repository at this point in the history

Commits on Mar 25, 2019

  1. Move scio-contrib back to scio-extra (spotify#1776)

    @nevillelyh @regadas
    nevillelyh authored and regadas committed Mar 25, 2019
    Configuration menu
    Copy the full SHA
    b4c2a0c View commit details
    Browse the repository at this point in the history

Commits on Mar 26, 2019

  1. Add a hand written Coder for pairs (spotify#1775) 

    * Add groupBy benchmark
* Add hand made impl of Tuple2 Coder
    @jto
    jto committed Mar 26, 2019
    Configuration menu
    Copy the full SHA
    9584792 View commit details
    Browse the repository at this point in the history

  2. Make BQ annotations serializable (spotify#1773)

    @anish749 @regadas
    anish749 authored and regadas committed Mar 26, 2019
    Configuration menu
    Copy the full SHA
    b75aaa1 View commit details
    Browse the repository at this point in the history

  3. use golang image for CircleCI deploy, fix spotify#1772 (spotify#1779)

    @nevillelyh
    nevillelyh committed Mar 26, 2019
    Configuration menu
    Copy the full SHA
    d3a41b5 View commit details
    Browse the repository at this point in the history

  4. Remove the usage of Future around ScioContext and Tap's (spotify#1666)

    @regadas
    regadas committed Mar 26, 2019
    Configuration menu
    Copy the full SHA
    01dd7bc View commit details
    Browse the repository at this point in the history

  5. Fix benchmark rebase

    @regadas
    regadas committed Mar 26, 2019
    Configuration menu
    Copy the full SHA
    e5675b9 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2019

  1. Add schema and row coders (spotify#1698) 

    - SchemaCoder
- BeamSQL support
    @jto @regadas
    jto authored and regadas committed Mar 27, 2019
    Configuration menu
    Copy the full SHA
    62bbd20 View commit details
    Browse the repository at this point in the history

  2. Simplify query row transform (spotify#1767) 

    * Simplify query row transform
    @regadas
    regadas committed Mar 27, 2019
    Configuration menu
    Copy the full SHA
    dc6f4a4 View commit details
    Browse the repository at this point in the history

  3. Fix typos

    @jto @regadas
    jto authored and regadas committed Mar 27, 2019
    Configuration menu
    Copy the full SHA
    f48c2cd View commit details
    Browse the repository at this point in the history

  4. use camelCase for typed arguments, fix spotify#1770 (spotify#1780)

    @nevillelyh @regadas
    nevillelyh authored and regadas committed Mar 27, 2019
    Configuration menu
    Copy the full SHA
    4a8496c View commit details
    Browse the repository at this point in the history

  5. Rework sql syntax (spotify#1778)

    @regadas
    regadas committed Mar 27, 2019
    Configuration menu
    Copy the full SHA
    ddf1f09 View commit details
    Browse the repository at this point in the history

  6. Fix: use same protoc (spotify#1781)

    @regadas
    regadas committed Mar 27, 2019
    Configuration menu
    Copy the full SHA
    ac346dc View commit details
    Browse the repository at this point in the history

  7. Bump coursier version (spotify#1782)

    @regadas
    regadas committed Mar 27, 2019
    Configuration menu
    Copy the full SHA
    65f0f43 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2019

  1. Merge remote-tracking branch 'origin/master'

    @anish749
    anish749 committed Mar 31, 2019
    Configuration menu
    Copy the full SHA
    6bb54ed View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2019

  1. update pair scollection functions to use mutable bloom filters.

    @anish749
    anish749 committed Apr 2, 2019
    Configuration menu
    Copy the full SHA
    a8fba4f View commit details
    Browse the repository at this point in the history

  2. turn off scalastyle for use of return

    @anish749
    anish749 committed Apr 2, 2019
    Configuration menu
    Copy the full SHA
    96b9088 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2019

  1. Merge branch 'master' of github.com:spotify/scio

    @anish749
    anish749 committed Apr 4, 2019
    Configuration menu
    Copy the full SHA
    80ab0b5 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2019

  1. Merge branch 'master' of github.com:spotify/scio

    @anish749
    anish749 committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    def347f View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into mutableBloomFilters

    @anish749
    anish749 committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    244210a View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2019

  1. add sparse bloom filter implementation to save memory

    @anish749
    anish749 committed Apr 10, 2019
    Configuration menu
    Copy the full SHA
    5ebb747 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2019

  1. delayed mutable bf

    Anish committed Apr 24, 2019
    Configuration menu
    Copy the full SHA
    4d63959 View commit details
    Browse the repository at this point in the history

  2. fix bf set init condition, delayed init tests.

    Anish committed Apr 24, 2019
    Configuration menu
    Copy the full SHA
    756d6f4 View commit details
    Browse the repository at this point in the history

Commits on Apr 25, 2019

  1. clean up sparse mutable bf

    Anish committed Apr 25, 2019
    Configuration menu
    Copy the full SHA
    5780fae View commit details
    Browse the repository at this point in the history

  2. less values

    Anish committed Apr 25, 2019
    Configuration menu
    Copy the full SHA
    32348f5 View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2019

  1. add gens for sparse mutable bf

    Anish committed Apr 26, 2019
    Configuration menu
    Copy the full SHA
    1a59d10 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2019

  1. Merge branch 'master2k19' into mutableBloomFilters 

    # Conflicts:
#	scio-core/src/main/scala/com/spotify/scio/values/PairSCollectionFunctions.scala
    @anish749
    anish749 committed Apr 29, 2019
    Configuration menu
    Copy the full SHA
    c3e0fbd View commit details
    Browse the repository at this point in the history

  2. new scala fmt

    @anish749
    anish749 committed Apr 29, 2019
    Configuration menu
    Copy the full SHA
    3f05ce6 View commit details
    Browse the repository at this point in the history

  3. fix imports and ret type

    @anish749
    anish749 committed Apr 29, 2019
    Configuration menu
    Copy the full SHA
    dcb8056 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2019

  1. Update scio-core/src/main/scala/com/spotify/scio/util/BloomFilter.scala 

    Co-Authored-By: anish749 <anish749@users.noreply.github.com>
    @nevillelyh @anish749
    nevillelyh and anish749 committed May 1, 2019
    Configuration menu
    Copy the full SHA
    0f251dd View commit details
    Browse the repository at this point in the history

  2. Update scio-core/src/main/scala/com/spotify/scio/util/BloomFilter.scala 

    Co-Authored-By: anish749 <anish749@users.noreply.github.com>
    @nevillelyh @anish749
    nevillelyh and anish749 committed May 1, 2019
    Configuration menu
    Copy the full SHA
    d416e6a View commit details
    Browse the repository at this point in the history

  3. Update scio-core/src/main/scala/com/spotify/scio/util/BloomFilter.scala 

    Co-Authored-By: anish749 <anish749@users.noreply.github.com>
    @nevillelyh @anish749
    nevillelyh and anish749 committed May 1, 2019
    Configuration menu
    Copy the full SHA
    d346d61 View commit details
    Browse the repository at this point in the history

  4. Update scio-core/src/main/scala/com/spotify/scio/util/BloomFilter.scala 

    Co-Authored-By: anish749 <anish749@users.noreply.github.com>
    @nevillelyh @anish749
    nevillelyh and anish749 committed May 1, 2019
    Configuration menu
    Copy the full SHA
    070bb8b View commit details
    Browse the repository at this point in the history

  5. Update scio-core/src/main/scala/com/spotify/scio/util/BloomFilter.scala 

    Co-Authored-By: anish749 <anish749@users.noreply.github.com>
    @nevillelyh @anish749
    nevillelyh and anish749 committed May 1, 2019
    Configuration menu
    Copy the full SHA
    a5fed50 View commit details
    Browse the repository at this point in the history

  6. Update scio-core/src/main/scala/com/spotify/scio/util/BloomFilter.scala 

    Co-Authored-By: anish749 <anish749@users.noreply.github.com>
    @nevillelyh @anish749
    nevillelyh and anish749 committed May 1, 2019
    Configuration menu
    Copy the full SHA
    1b719c3 View commit details
    Browse the repository at this point in the history

  7. Update scio-core/src/main/scala/com/spotify/scio/util/BloomFilter.scala 

    Co-Authored-By: anish749 <anish749@users.noreply.github.com>
    @nevillelyh @anish749
    nevillelyh and anish749 committed May 1, 2019
    Configuration menu
    Copy the full SHA
    cdfe002 View commit details
    Browse the repository at this point in the history

  8. add mutation detection tests

    @anish749
    anish749 committed May 1, 2019
    Configuration menu
    Copy the full SHA
    699fe13 View commit details
    Browse the repository at this point in the history

Commits on May 2, 2019

  1. Merge branch 'master' into mutableBloomFilters 

    # Conflicts:
#	scio-core/src/main/scala/com/spotify/scio/values/PairSCollectionFunctions.scala
    Anish committed May 2, 2019
    Configuration menu
    Copy the full SHA
    4f1a3d7 View commit details
    Browse the repository at this point in the history

  2. Update scio-core/src/main/scala/com/spotify/scio/util/BloomFilter.scala 

    Co-Authored-By: anish749 <anish749@users.noreply.github.com>
    @regadas @anish749
    regadas and anish749 committed May 2, 2019
    Configuration menu
    Copy the full SHA
    52f6313 View commit details
    Browse the repository at this point in the history

  3. Apply suggestions from code review 

    Co-Authored-By: anish749 <anish749@users.noreply.github.com>
    @regadas @anish749
    regadas and anish749 committed May 2, 2019
    Configuration menu
    Copy the full SHA
    ae146cf View commit details
    Browse the repository at this point in the history

  4. address review comments

    @anish749
    anish749 committed May 2, 2019
    Configuration menu
    Copy the full SHA
    9ff97a7 View commit details
    Browse the repository at this point in the history

  5. more restricted access

    @anish749
    anish749 committed May 2, 2019
    Configuration menu
    Copy the full SHA
    e6bab9f View commit details
    Browse the repository at this point in the history

  6. foreach -> while

    @anish749
    anish749 committed May 2, 2019
    Configuration menu
    Copy the full SHA
    66bd624 View commit details
    Browse the repository at this point in the history

  7. add warning

    @anish749
    anish749 committed May 2, 2019
    Configuration menu
    Copy the full SHA
    5ed4707 View commit details
    Browse the repository at this point in the history

  8. remove return

    @anish749
    anish749 committed May 2, 2019
    Configuration menu
    Copy the full SHA
    2ff5176 View commit details
    Browse the repository at this point in the history