Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Adding batch_size support for (almost) all pipelines #13724

Merged
merged 31 commits into from
Oct 29, 2021
Merged

Adding batch_size support for (almost) all pipelines #13724

merged 31 commits into from
Oct 29, 2021

Commits on Oct 29, 2021

  1. Tentative enabling of batch_size for pipelines.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    bfe2e50 View commit details
    Browse the repository at this point in the history

  2. Add systematic test for pipeline batching.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    125bb7a View commit details
    Browse the repository at this point in the history

  3. Enabling batch_size on almost all pipelines 

    - Not `zero-shot` (it's already passing stuff as batched so trickier)
- Not `QA` (preprocess uses squad features, we need to switch to real
tensors at this boundary.
    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    94298d4 View commit details
    Browse the repository at this point in the history

  4. Adding min_length_for_response for conversational.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    fe75e50 View commit details
    Browse the repository at this point in the history

  5. Making CTC, speech mappings avaiable regardless of framework.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    2a53ecd View commit details
    Browse the repository at this point in the history

  6. Attempt at fixing automatic tests (ffmpeg not enabled for fast tests)

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    9d224b9 View commit details
    Browse the repository at this point in the history

  7. Removing ffmpeg dependency in tests.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    7925696 View commit details
    Browse the repository at this point in the history

  8. Small fixes.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    ff55351 View commit details
    Browse the repository at this point in the history

  9. Slight cleanup.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    3dc2e94 View commit details
    Browse the repository at this point in the history

  10. Adding docs 

    and adressing comments.
    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    5f158a0 View commit details
    Browse the repository at this point in the history

  11. Quality.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    0985328 View commit details
    Browse the repository at this point in the history

  12. Update docs/source/main_classes/pipelines.rst 

    Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
    @Narsil @sgugger
    Narsil and sgugger committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    7512777 View commit details
    Browse the repository at this point in the history

  13. Update src/transformers/pipelines/question_answering.py 

    Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
    @Narsil @sgugger
    Narsil and sgugger committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    e788d1a View commit details
    Browse the repository at this point in the history

  14. Update src/transformers/pipelines/zero_shot_classification.py 

    Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
    @Narsil @sgugger
    Narsil and sgugger committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    19c11b1 View commit details
    Browse the repository at this point in the history

  15. Improving docs.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    aa9cbf3 View commit details
    Browse the repository at this point in the history

  16. Update docs/source/main_classes/pipelines.rst 

    Co-authored-by: Philipp Schmid <32632186+philschmid@users.noreply.github.com>
    @Narsil @philschmid
    Narsil and philschmid committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    28a366f View commit details
    Browse the repository at this point in the history

  17. N -> oberved_batch_size 

    softmax trick.
    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    086ba6a View commit details
    Browse the repository at this point in the history

  18. Follow padding_side.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    d674a1a View commit details
    Browse the repository at this point in the history

  19. Supporting image pipeline batching (and padding).

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    9188dc1 View commit details
    Browse the repository at this point in the history

  20. Rename unbatch -> loader_batch.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    ad857de View commit details
    Browse the repository at this point in the history

  21. unbatch_size forgot.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    67e3d15 View commit details
    Browse the repository at this point in the history

  22. Custom padding for offset mappings.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    f9c5ef7 View commit details
    Browse the repository at this point in the history

  23. Attempt to remove librosa.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    3d539be View commit details
    Browse the repository at this point in the history

  24. Adding require_audio.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    646dc54 View commit details
    Browse the repository at this point in the history

  25. torchaudio.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    d66cf36 View commit details
    Browse the repository at this point in the history

  26. Back to using datasets librosa.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    a36bfec View commit details
    Browse the repository at this point in the history

  27. Adding help to set a pad_token on the tokenizer.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    15e2011 View commit details
    Browse the repository at this point in the history

  28. Update src/transformers/pipelines/base.py 

    Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
    @Narsil @sgugger
    Narsil and sgugger committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    6877c7b View commit details
    Browse the repository at this point in the history

  29. Update src/transformers/pipelines/base.py 

    Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
    @Narsil @sgugger
    Narsil and sgugger committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    cf5d40c View commit details
    Browse the repository at this point in the history

  30. Update src/transformers/pipelines/base.py 

    Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
    @Narsil @sgugger
    Narsil and sgugger committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    5cd831c View commit details
    Browse the repository at this point in the history

  31. Quality.

    @Narsil
    Narsil committed Oct 29, 2021
    Configuration menu
    Copy the full SHA
    a08ccfe View commit details
    Browse the repository at this point in the history