Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Set model as prelabeler #5695

Closed
wants to merge 4 commits into from
Closed

Conversation

deppp
Copy link
Collaborator

@deppp deppp commented Apr 9, 2024

This code sets a model as a default prelabeler in case no other option was selected. This is done to keep it consistent with how offline predictions are used when uploaded (they get selected).

PR fulfills these requirements

  • Commit message(s) and PR title follows the format [fix|feat|ci|chore|doc]: TICKET-ID: Short description of change made ex. fix: DEV-XXXX: Removed inconsistent code usage causing intermittent errors
  • Tests for the changes have been added/updated (for bug fixes/features)
  • Docs have been added/updated (for bug fixes/features)
  • Best efforts were made to ensure docs/code are concise and coherent (checked for spelling/grammatical errors, commented out code, debug logs etc.)
  • Self-reviewed and ran all changes on a local instance (for bug fixes/features)

Change has impacts in these area(s)

(check all that apply)

  • Product design
  • Backend (Database)
  • Backend (API)
  • Frontend

Describe the reason for change

(link to issue, supportive screenshots etc.)

What does this fix?

(if this is a bug fix)

What is the new behavior?

(if this is a breaking or feature change)

What is the current behavior?

(if this is a breaking or feature change)

What libraries were added/updated?

(list all with version changes)

Does this change affect performance?

(if so describe the impacts positive or negative)

Does this change affect security?

(if so describe the impacts positive or negative)

What alternative approaches were there?

(briefly list any if applicable)

What feature flags were used to cover this change?

(briefly list any if applicable)

Does this PR introduce a breaking change?

(check only one)

  • Yes, and covered entirely by feature flag(s)
  • Yes, and covered partially by feature flag(s)
  • No
  • Not sure (briefly explain the situation below)

What level of testing was included in the change?

(check all that apply)

  • e2e
  • integration
  • unit

Which logical domain(s) does this change affect?

(for bug fixes/features, be as precise as possible. ex. Authentication, Annotation History, Review Stream etc.)

state (i.e. no predictions were selected).

Fixing a bug with model version getting reset on patch request

Adding tests
Copy link

netlify bot commented Apr 9, 2024

Deploy Preview for label-studio-docs-new-theme ready!

Name Link
🔨 Latest commit c5b3bce
🔍 Latest deploy log https://app.netlify.com/sites/label-studio-docs-new-theme/deploys/66156bdf730cbb0007b93e99
😎 Deploy Preview https://deploy-preview-5695--label-studio-docs-new-theme.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

Copy link

netlify bot commented Apr 9, 2024

Deploy Preview for heartex-docs ready!

Name Link
🔨 Latest commit c5b3bce
🔍 Latest deploy log https://app.netlify.com/sites/heartex-docs/deploys/66156bdfcc276700087f9790
😎 Deploy Preview https://deploy-preview-5695--heartex-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@deppp deppp changed the title Set model as prelabeler fix: Set model as prelabeler Apr 9, 2024
Copy link

codecov bot commented Apr 9, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 75.96%. Comparing base (aa7908a) to head (c5b3bce).
Report is 4 commits behind head on develop.

Additional details and impacted files
@@           Coverage Diff            @@
##           develop    #5695   +/-   ##
========================================
  Coverage    75.95%   75.96%           
========================================
  Files          158      158           
  Lines        13327    13331    +4     
========================================
+ Hits         10123    10127    +4     
  Misses        3204     3204           
Flag Coverage Δ
pytests 75.96% <100.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@hlomzik
Copy link
Collaborator

hlomzik commented Apr 11, 2024

Closed in favor of #5709

@hlomzik hlomzik closed this Apr 11, 2024
@hlomzik hlomzik deleted the dev/select-model-for-prelabel branch April 11, 2024 12:59
hlomzik added a commit that referenced this pull request Apr 18, 2024
This code sets a model as a default prelabeler in case no other option
was selected. This is done to keep it consistent with how offline
predictions are used when uploaded (they get selected).

That's basically a #5695 fixed for Follow Merge


### PR fulfills these requirements
- [x] Tests for the changes have been added/updated (for bug
fixes/features)
- [ ] Docs have been added/updated (for bug fixes/features)
- [x] Best efforts were made to ensure docs/code are concise and
coherent (checked for spelling/grammatical errors, commented out code,
debug logs etc.)
- [x] Self-reviewed and ran all changes on a local instance (for bug
fixes/features)


#### Change has impacts in these area(s)
- [ ] Product design
- [x] Backend (Database)
- [x] Backend (API)
- [ ] Frontend


### Describe the reason for change
Label Stream and other flows have some issues when model is added but
not selected because of discrepancies in logic.


#### What alternative approaches were there?
We could change the way model is added and handled in settings, but
autoselect is small and precise fix.


### Does this PR introduce a breaking change?
- [ ] Yes, and covered entirely by feature flag(s)
- [ ] Yes, and covered partially by feature flag(s)
- [x] No
- [ ] Not sure (briefly explain the situation below)


### What level of testing was included in the change?
- [ ] e2e
- [x] integration
- [ ] unit

---------

Co-authored-by: Michael Malyuk <michael.malyuk@icloud.com>
Co-authored-by: Jo Booth <jo.m.booth@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants