Skip to content

Mongo 3: Utilize new endpoints in celery#1068

Merged
subdavis merged 4 commits into
develop-mongo-tracksfrom
mongo/celery-updates
Jan 3, 2022
Merged

Mongo 3: Utilize new endpoints in celery#1068
subdavis merged 4 commits into
develop-mongo-tracksfrom
mongo/celery-updates

Conversation

@subdavis
Copy link
Copy Markdown
Contributor

@subdavis subdavis commented Nov 22, 2021

Reviewer notes

I think this one is pretty straightforward.

  • Switches to TypedDict params for training so that pipelines and training jobs match.
  • Generates exports using input revision ID and urllib.urlretrieve

Copy link
Copy Markdown
Collaborator

@BryonLewis BryonLewis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I still need to do a more thorough review, but wanted to log these things right now.

Comment thread server/dive_utils/models.py
Comment thread server/dive_tasks/tasks.py Outdated
Comment thread server/dive_tasks/tasks.py
Base automatically changed from mongo/rollback to develop-mongo-tracks December 28, 2021 16:25
@subdavis subdavis force-pushed the mongo/celery-updates branch from ca38811 to 33d80d7 Compare December 28, 2021 16:31
@subdavis subdavis force-pushed the develop-mongo-tracks branch from 06cd9de to 9e390c9 Compare December 28, 2021 22:22
@subdavis subdavis force-pushed the mongo/celery-updates branch from 33d80d7 to 507f990 Compare December 29, 2021 14:40
@subdavis
Copy link
Copy Markdown
Contributor Author

Combined this and test/formatting updates into one PR because the rebase was tedious.

Copy link
Copy Markdown
Collaborator

@BryonLewis BryonLewis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

besides the one test it looks like integration tests now fully work. I also did some training and applying the trained data to another dataset and that seems to now work properly as well.

assert len(new_tracks.keys()) == 1, "Should have a single track"
client.delete(f'item/{newfile["itemId"]}') # Remove the uploaded detections
assert len(new_tracks_list) == 1, "Should have a single track"
client.delete(f'dive_annotation?folderId={dataset["_id"]}&revision={old_revision}')
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The rollback endpoint needs an empty argument to prevent the route dividing /r/o/l/l/b/a/c/k:
https://github.com/Kitware/dive/blob/develop-mongo-tracks/server/dive_server/views_annotation.py#L33
self.route("POST", ("rollback",), self.rollback)

I think the client.delete should be swapped to: client.post(f'dive_annotation/rollback?folderId={dataset["_id"]}&revision={old_revision}')

@subdavis subdavis requested a review from BryonLewis January 3, 2022 18:11
Copy link
Copy Markdown
Collaborator

@BryonLewis BryonLewis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good, pulled/built and did some more local testing and ran integration tests successfully.

@subdavis subdavis merged commit 4baea43 into develop-mongo-tracks Jan 3, 2022
@subdavis subdavis deleted the mongo/celery-updates branch January 3, 2022 18:41
subdavis added a commit that referenced this pull request Jan 3, 2022
* Utilize new endpoints in celery

* Respond to comments

* Linting, formatting, and unit tests

* respond to comments
subdavis added a commit that referenced this pull request Jan 20, 2022
* Mongo 1: Server side implementation (#1066)

* Poetry fix (#1087)

* Poetry fix

* Add check for app root

* Desktop/sealion multicam (#1024)

* init

* Allowing multicam to write tracks

* inut name change

* lint fixes

* Updates to multicam

* fixing import loading

* removing multicamImageFiles change

* Fixing various issues

* mend

* mend

* switching to every

* Example without fetching metadata (#1088)

Co-authored-by: Brandon Davis <brandon.davis@kitware.com>

* Server-side implementation

* Include description and timestamp

* Respond to comments

* Switch to checking mongo results

* select sub-element

* Unmangle indices

Co-authored-by: BryonLewis <61746913+BryonLewis@users.noreply.github.com>

* Mongo 2: Rollback API (#1067)

* Implement rollback

* Switch to POST /dive_annotation/rollback

* Mongo 3: Utilize new endpoints in celery (#1068)

* Utilize new endpoints in celery

* Respond to comments

* Linting, formatting, and unit tests

* respond to comments

* Import shutil

* Client changes to support revisions (#1070)

* Remove broken summary and report generation (#1071)

* Add simple sharing test and new indices

* Migraction script updates

* Add loading state to clone button

* label fetch

Co-authored-by: BryonLewis <61746913+BryonLewis@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants