Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request] Enable cloud-based Model Optimization #10

Closed
larsll opened this issue Dec 11, 2023 · 2 comments
Closed

[Feature Request] Enable cloud-based Model Optimization #10

larsll opened this issue Dec 11, 2023 · 2 comments
Labels
question Further information is requested

Comments

@larsll
Copy link
Contributor

larsll commented Dec 11, 2023

To improve the speed of loading models on the car it would be an idea to perform the Tensorflow -> OpenVINO model optimization in a lambda function, rather than on the car. This should save 15-20 seconds when loading a model on the car.

Initial concept (Docker file + conversion code) is here: #9

Design decisions needed:

  • Where in the upload-pipeline should it happen? Two options
    • Instead of clamscan_post; trigger on virus scan complete, then optimize and upload to target location
    • After clamscan_post; when the model is Available (maybe trigger on the change in DynamoDB?)
  • Is another status in the DynamoDB desired (Available -> Optimized?)
  • If processing after clamscan_post: shall initial file be kept and new file in a new location, or shall it be edited in place?
@davidfsmith davidfsmith added the question Further information is requested label Dec 11, 2023
@davidfsmith
Copy link
Contributor

  • Optmisation should happen after clamscan_post
  • Yes, another status of Optimised
  • Keep both files and then we can decide which version of the files to load to the car (depending on the software on the target car)

@davidfsmith
Copy link
Contributor

This change has now been merged in as part of PR #9

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants