Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

optimize ZStream's mapZIOPar and mapZIOParUnordered #8819

Merged
merged 36 commits into from
May 15, 2024
Merged

optimize ZStream's mapZIOPar and mapZIOParUnordered #8819

merged 36 commits into from
May 15, 2024

Commits on Apr 26, 2024

  1. strm_mapZioPar_opt: introduce mapZioPar and mapZioParUnordered 'direc… 

    …t' impls
    @eyalfa
    eyalfa committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    411f287 View commit details
    Browse the repository at this point in the history

  2. strm_mapZioPar_opt: stream.mapZIOParUnordered

    @eyalfa
    eyalfa committed Apr 26, 2024
    Configuration menu
    Copy the full SHA
    6efc2d7 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2024

  1. strm_mapZioPar_opt: avoid mapZIOPar atm, add tests for mapZIOParUnord… 

    …ered, stabilize mapZIOParUnordered2
    @eyalfa
    eyalfa committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    d911350 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'series/2.x' into strm_mapZioPar_opt

    @eyalfa
    eyalfa committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    59533ad View commit details
    Browse the repository at this point in the history

  3. strm_mapZioPar_opt: mapZIOPar2

    @eyalfa
    eyalfa committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    277bf35 View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. strm_mapZioPar_opt: use queue of Exit rather than a queue of Take

    @eyalfa
    eyalfa committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    58cabb4 View commit details
    Browse the repository at this point in the history

Commits on May 1, 2024

  1. strm_mapZioPar_opt: strm.mapZIOParUnordered, run upstream in a scoped… 

    … executor so we can guarantee child fibers are not interrupted too soon.
    @eyalfa
    eyalfa committed May 1, 2024
    Configuration menu
    Copy the full SHA
    0c31b9d View commit details
    Browse the repository at this point in the history

  2. strm_mapZioPar_opt__fiberChildren: make fiber's children collection f… 

    …iber-accessed only, this allows lifting the synchronized layer on top of it
    @eyalfa
    eyalfa committed May 1, 2024
    Configuration menu
    Copy the full SHA
    b7cb92e View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. strm_mapZioPar_opt: mapZIOParUnordered2, record counting impl

    @eyalfa
    eyalfa committed May 3, 2024
    Configuration menu
    Copy the full SHA
    6596142 View commit details
    Browse the repository at this point in the history

  2. strm_mapZioPar_opt: strm.mapZIOParUnordered, ditch counting, rely on … 

    …withPermits(n) and a simple Left(()) message to signal EOF
    @eyalfa
    eyalfa committed May 3, 2024
    Configuration menu
    Copy the full SHA
    560ebcd View commit details
    Browse the repository at this point in the history

  3. strm_mapZioPar_opt: make sure strm.mapZIOParUnordered doesn't break w… 

    …hen A2 is an Either.
    @eyalfa
    eyalfa committed May 3, 2024
    Configuration menu
    Copy the full SHA
    b9eb3ac View commit details
    Browse the repository at this point in the history

  4. Merge branch 'strm_mapZioPar_opt' into strm_mapZioPar_opt__fiberChildren

    @eyalfa
    eyalfa committed May 3, 2024
    Configuration menu
    Copy the full SHA
    42dfe12 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2024

  1. strm_mapZioPar_opt__fiberChildren: strm.mapZIOPar, use queue of fiber… 

    …s (drop the Take wrappers).
    @eyalfa
    eyalfa committed May 5, 2024
    Configuration menu
    Copy the full SHA
    6ad59d8 View commit details
    Browse the repository at this point in the history

  2. strm_mapZioPar_opt__fiberChildren: fix issues in mapZIOPar

    @eyalfa
    eyalfa committed May 5, 2024
    Configuration menu
    Copy the full SHA
    7ad415b View commit details
    Browse the repository at this point in the history

  3. strm_mapZioPar_opt__chhannel: introduce a channel.mapZIOPar implement… 

    …ation, this falls 8-9% short of the direct stream.mapZIOPar impl.
    @eyalfa
    eyalfa committed May 5, 2024
    Configuration menu
    Copy the full SHA
    fe66a4d View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. strm_mapZioPar_opt__chhannel: duplicate the impls to the channel level

    @eyalfa
    eyalfa committed May 6, 2024
    Configuration menu
    Copy the full SHA
    1e2bfd8 View commit details
    Browse the repository at this point in the history

  2. strm_mapZioPar_opt__chhannel: add stream+pl methods for mapZIOPar and… 

    … mapZIOParUnordered with bufferSize parameter
    @eyalfa
    eyalfa committed May 6, 2024
    Configuration menu
    Copy the full SHA
    8118984 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'series/2.x' into strm_mapZioPar_opt

    @eyalfa
    eyalfa committed May 6, 2024
    Configuration menu
    Copy the full SHA
    077898f View commit details
    Browse the repository at this point in the history

  4. strm_mapZioPar_opt: fmt

    @eyalfa
    eyalfa committed May 6, 2024
    Configuration menu
    Copy the full SHA
    5bbfe03 View commit details
    Browse the repository at this point in the history

  5. strm_mapZioPar_opt: remove ead code, add default prm

    @eyalfa
    eyalfa committed May 6, 2024
    Configuration menu
    Copy the full SHA
    b228693 View commit details
    Browse the repository at this point in the history

  6. strm_mapZioPar_opt: fix CI issues

    @eyalfa
    eyalfa committed May 6, 2024
    Configuration menu
    Copy the full SHA
    e8cc44f View commit details
    Browse the repository at this point in the history

  7. strm_mapZioPar_opt: fix scala3 compilation issue

    @eyalfa
    eyalfa committed May 6, 2024
    Configuration menu
    Copy the full SHA
    d6c9793 View commit details
    Browse the repository at this point in the history

Commits on May 7, 2024

  1. strm_mapZioPar_opt: address reviw comments

    @eyalfa
    eyalfa committed May 7, 2024
    Configuration menu
    Copy the full SHA
    6cf8265 View commit details
    Browse the repository at this point in the history

  2. strm_mapZioPar_opt: address one more review comment

    @eyalfa
    eyalfa committed May 7, 2024
    Configuration menu
    Copy the full SHA
    918aa6c View commit details
    Browse the repository at this point in the history

  3. Update core/shared/src/main/scala/zio/internal/FiberRuntime.scala 

    reduce ObjectRef updates

Co-authored-by: kyri-petrou <67301607+kyri-petrou@users.noreply.github.com>
    @eyalfa @kyri-petrou
    eyalfa and kyri-petrou committed May 7, 2024
    Configuration menu
    Copy the full SHA
    11e09e1 View commit details
    Browse the repository at this point in the history

  4. strm_mapZioPar_opt: slight compilation fix

    @eyalfa
    eyalfa committed May 7, 2024
    Configuration menu
    Copy the full SHA
    08d6510 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2024

  1. strm_mapZioPar_opt: make QRes an AnyVal

    @eyalfa
    eyalfa committed May 8, 2024
    Configuration menu
    Copy the full SHA
    a7246ad View commit details
    Browse the repository at this point in the history

  2. Merge branch 'series/2.x' into strm_mapZioPar_opt

    @eyalfa
    eyalfa committed May 8, 2024
    Configuration menu
    Copy the full SHA
    552a6b4 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2024

  1. strm_mapZioPar_opt__childrenSet: directly expose the children set to … 

    …other fibers, but use the observaton it is only mutated by the fiber itself in order to grnaularily control the required synchronization
    @eyalfa
    eyalfa committed May 10, 2024
    Configuration menu
    Copy the full SHA
    6f81f82 View commit details
    Browse the repository at this point in the history

  2. strm_mapZioPar_opt__childrenSet: optimize transferChildren by batchin… 

    …g it
    @eyalfa
    eyalfa committed May 10, 2024
    Configuration menu
    Copy the full SHA
    9fd7ff3 View commit details
    Browse the repository at this point in the history

  3. strm_mapZioPar_opt__childrenSet: fmt

    @eyalfa
    eyalfa committed May 10, 2024
    Configuration menu
    Copy the full SHA
    3bdea62 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'series/2.x' into strm_mapZioPar_opt

    @eyalfa
    eyalfa committed May 10, 2024
    Configuration menu
    Copy the full SHA
    d921095 View commit details
    Browse the repository at this point in the history

  5. strm_mapZioPar_opt: FiberRuntime.children, extra safety measure to pr… 

    …otect from race with transferChildren
    @eyalfa
    eyalfa committed May 10, 2024
    Configuration menu
    Copy the full SHA
    eb1ef45 View commit details
    Browse the repository at this point in the history

Commits on May 12, 2024

  1. Merge branch 'series/2.x' into strm_mapZioPar_opt

    @eyalfa
    eyalfa committed May 12, 2024
    Configuration menu
    Copy the full SHA
    ba2e2ef View commit details
    Browse the repository at this point in the history

  2. strm_mapZioPar_opt: fiber runtime, back to synchronized child fibers set

    @eyalfa
    eyalfa committed May 12, 2024
    Configuration menu
    Copy the full SHA
    b8d2dbd View commit details
    Browse the repository at this point in the history

  3. Merge branch 'series/2.x' into strm_mapZioPar_opt

    @eyalfa
    eyalfa committed May 12, 2024
    Configuration menu
    Copy the full SHA
    6edd498 View commit details
    Browse the repository at this point in the history