Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(back): Add new GroundingDINO model #184

Merged
merged 7 commits into from
Mar 19, 2024
Merged

Conversation

cpvannier
Copy link
Member

@cpvannier cpvannier commented Feb 23, 2024

Issue

Fixes #183

Description

New GroundingDINO model introduced in Pixano Inference (pixano/pixano-inference#6)

  • Update backend as needed:
    • New path property in Image
    • New prompt argument in InferenceModel.process_dataset()
  • Update notebooks as needed:
    • Documentation and links to configs and weights

Add property to get the same filepath as complete_uri, but as a Pathlib path instead of as a string URI
Currently used by GroundingDINO in pixano-inference, and could be useful for other methods
Add text prompt argument for pre-annotation models like GroundingDINO
In annotation notebook, change default process type from "Pre-annotation" to "Model run".
A user unaware of what "Pre-annotation" does could be surprised to see nothing when opening their dataset as pre-annotations are hidden behind a toggle, while model run are displayed by default.
Add information on GroundingDINO
Update imports as segment_anything module has been renamed to github to contain models like GroundingDINO
@cpvannier cpvannier self-assigned this Feb 23, 2024
cpvannier and others added 3 commits February 23, 2024 15:01
With the addition of the prompt arg in InferenceModel, the number of local variables is over the limit set with Pylint
@cpvannier cpvannier changed the title feat(back): Add foundation models feat(back): Add new GroundingDINO model Mar 18, 2024
@cpvannier cpvannier marked this pull request as ready for review March 18, 2024 09:56
@cpvannier cpvannier merged commit 2c4a2d3 into develop Mar 19, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add foundation models to Pixano Inference
3 participants