Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

support upload/download model to/from hubble #147

Open
jemmyshin opened this issue Aug 25, 2022 · 1 comment
Open

support upload/download model to/from hubble #147

jemmyshin opened this issue Aug 25, 2022 · 1 comment
Assignees

Comments

@jemmyshin
Copy link
Member

Since we move to jcloud deployment, it's necessary to support uploading/downloading PCA/PQ model to/from Hubble.

Thus, we need to implement these APIs:

self._projector_codec.upload(artifact='...')
self._projector_codec.download(artifact='...')

The artifact is determined by users and should be consistency throughout the whole pipeline. And also should be passed to jcloud.yaml.

@jemmyshin jemmyshin self-assigned this Aug 25, 2022
@numb3r3
Copy link
Member

numb3r3 commented Aug 26, 2022

What's the API design in annlite? Is this what we are expected:

def save_model(self, name: Union[str, PathLike]):
    if isinstance(name, str):
        # save to hubble with the given name `name`
    else:
        # save to local path
    

The user journal looks like:



index = Annlite(...)

index.train(...)

# upload the model parameters 
index.save_model('pca128_pq64')

# load the model  parameters 
index = Annlite(..., model_path='pca128_pq64')
index.index(...)
index.search(...)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants