Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Deliver Models and Large Files as Artifacts #46

Open
AmitMY opened this issue Jun 26, 2022 · 3 comments
Open

[Feature] Deliver Models and Large Files as Artifacts #46

AmitMY opened this issue Jun 26, 2022 · 3 comments
Assignees
Labels
enhancement New feature or request
Projects

Comments

@AmitMY
Copy link
Contributor

AmitMY commented Jun 26, 2022

Problem

At the moment, models are included in the build distribution.
This makes the build quite heavy, and native files too large and unappealing.

Description

Make an "artifacts management" system that can download artifacts like necessary models, and store them in the app's documents folder.

When a new artifact is available, it should prompt to download.

When a user tries to use a feature requiring a missing artifact, it should prompt the user to download and wait until finishes.


For the web, and maybe Android, can store .tflite models on firebase ML

For iOS, can use Core ML Model Deployment https://developer.apple.com/icloud/core-ml/

@AmitMY AmitMY added the enhancement New feature or request label Jun 26, 2022
@AmitMY
Copy link
Contributor Author

AmitMY commented Jul 2, 2022

Firebase ML has two issues:

  1. Does not allow large files
  2. Not available for the web

image

Alternative solution: Cloud storage, upload h5 file, auto converts to coreml and tflite

@AmitMY
Copy link
Contributor Author

AmitMY commented Jul 2, 2022

For CoreML, the convolutions might be too much:

2022-07-02 22:57:13.178238+0200 benchmark[20833:399499] Error: Convolution configuration cannot fit in KMEM (Given: 73728b, Max: 65536b)

@AmitMY
Copy link
Contributor Author

AmitMY commented Jul 30, 2022

Proposal:

  • upload model files to storage.
  • automatically convert to tflite and coreml files
  • create a assets module, that can download and store models in navigator.storage / Capacitor Filesystem
  • create a assets page, that can:
    • delete
    • download
    • update
    • show when update is available
  • store all models and large files here:
    • pose-to-person/generator
    • pose-to-person/upscaler
    • bergamot model files
    • avatar glb and usdz files
    • holistic pose estimation (50+ mb)

@AmitMY AmitMY added this to To do in Development via automation Aug 9, 2022
@AmitMY AmitMY self-assigned this Aug 9, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Development

No branches or pull requests

1 participant