Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: LEAP-930: Set model as prelabeler #5709

Merged
merged 6 commits into from
Apr 18, 2024

Conversation

hlomzik
Copy link
Collaborator

@hlomzik hlomzik commented Apr 10, 2024

This code sets a model as a default prelabeler in case no other option was selected. This is done to keep it consistent with how offline predictions are used when uploaded (they get selected).

That's basically a #5695 fixed for Follow Merge

PR fulfills these requirements

  • Tests for the changes have been added/updated (for bug fixes/features)
  • Docs have been added/updated (for bug fixes/features)
  • Best efforts were made to ensure docs/code are concise and coherent (checked for spelling/grammatical errors, commented out code, debug logs etc.)
  • Self-reviewed and ran all changes on a local instance (for bug fixes/features)

Change has impacts in these area(s)

  • Product design
  • Backend (Database)
  • Backend (API)
  • Frontend

Describe the reason for change

Label Stream and other flows have some issues when model is added but not selected because of discrepancies in logic.

What alternative approaches were there?

We could change the way model is added and handled in settings, but autoselect is small and precise fix.

Does this PR introduce a breaking change?

  • Yes, and covered entirely by feature flag(s)
  • Yes, and covered partially by feature flag(s)
  • No
  • Not sure (briefly explain the situation below)

What level of testing was included in the change?

  • e2e
  • integration
  • unit

Michael Malyuk and others added 5 commits April 9, 2024 00:05
state (i.e. no predictions were selected).

Fixing a bug with model version getting reset on patch request

Adding tests
@github-actions github-actions bot added the fix label Apr 10, 2024
Copy link

netlify bot commented Apr 10, 2024

Deploy Preview for heartex-docs canceled.

Name Link
🔨 Latest commit 1c4ae19
🔍 Latest deploy log https://app.netlify.com/sites/heartex-docs/deploys/661fe96daefbd100088a8644

Copy link

netlify bot commented Apr 10, 2024

Deploy Preview for label-studio-docs-new-theme canceled.

Name Link
🔨 Latest commit 1c4ae19
🔍 Latest deploy log https://app.netlify.com/sites/label-studio-docs-new-theme/deploys/661fe96d13bd5300081bb79e

Copy link

codecov bot commented Apr 10, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 75.96%. Comparing base (aa7908a) to head (1c4ae19).
Report is 21 commits behind head on develop.

Additional details and impacted files
@@           Coverage Diff            @@
##           develop    #5709   +/-   ##
========================================
  Coverage    75.95%   75.96%           
========================================
  Files          158      158           
  Lines        13327    13331    +4     
========================================
+ Hits         10123    10127    +4     
  Misses        3204     3204           
Flag Coverage Δ
pytests 75.96% <100.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

label_studio/ml/api.py Outdated Show resolved Hide resolved
@jombooth
Copy link
Contributor

A few small requests here

Copy link
Contributor

@jombooth jombooth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Going to approve because no blocking feedback. I'm not sure what happened with that script having formatting changes.

Co-authored-by: Jo Booth <jo.m.booth@gmail.com>
@hlomzik hlomzik merged commit 9f1cba7 into develop Apr 18, 2024
38 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants