Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SigLIP] Add fast tokenizer #29969

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
Open

[SigLIP] Add fast tokenizer #29969

wants to merge 7 commits into from

Commits on Mar 30, 2024

  1. First draft

    @NielsRogge
    NielsRogge committed Mar 30, 2024
    Configuration menu
    Copy the full SHA
    d5d67b7 View commit details
    Browse the repository at this point in the history

Commits on Mar 31, 2024

  1. Fix more tests

    @NielsRogge
    NielsRogge committed Mar 31, 2024
    Configuration menu
    Copy the full SHA
    cbde88a View commit details
    Browse the repository at this point in the history

  2. Add test

    @NielsRogge
    NielsRogge committed Mar 31, 2024
    Configuration menu
    Copy the full SHA
    de444e9 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. Remove print statements

    @NielsRogge
    NielsRogge committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    009fdc6 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2024

  1. Merge remote-tracking branch 'upstream/main' into add_siglip_fast_tok… 

    …enizer_bis
    @NielsRogge
    NielsRogge committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    f714af0 View commit details
    Browse the repository at this point in the history

  2. Address comments

    @NielsRogge
    NielsRogge committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    6cd05c2 View commit details
    Browse the repository at this point in the history

  3. Use regex

    @NielsRogge
    NielsRogge committed Apr 22, 2024
    Configuration menu
    Copy the full SHA
    d67e40f View commit details
    Browse the repository at this point in the history