-
Notifications
You must be signed in to change notification settings - Fork 1.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add Florence 2 support #1296
Add Florence 2 support #1296
Conversation
a73678e
to
bb513f8
Compare
I found there's some tasks I overlooked. In addition to examples on their Hugging Face page, they have 5-6 more on their colab. At the end of today I'm leaving this in a working-but-incomplete state:
Planning to dig deeper, simplify and add unit tests tomorrow. |
Hi @SkalskiP, This now has:
Where it's lacking is:
I invite to look at the Colab and play around with the results. |
Description
This PR adds Florence 2 support for supervision.
Run it with
transfomers
and parse withfrom_lmm(sv.LMM.FLORENCE_2, result)
.No extra documentation was added to
from_lmm
at this point.Type of change
How has this change been tested, please provide a testcase or example of how you tested the change?
Usage and testing in Colab: https://colab.research.google.com/drive/19XoQZ6LRdTUysAHUp-3JsfT_67T0rffE#scrollTo=CwPzmI9wOSQ6
Any specific deployment considerations
Run the Colab in High-RAM mode.
Docs