Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Manual register model does not upload a model file to upload_uri (output_model) or output_uri (task) #740

Open
chorus12 opened this issue Aug 4, 2022 · 4 comments

Comments

@chorus12
Copy link

chorus12 commented Aug 4, 2022

Hi. I need to manually register a model and use the following lines of code:

task = Task.init(project_name=args['cml_project_name'], 
                     task_name=args['cml_task_name'], 
                     output_uri = args['cml_output_uri'],  # this points to a valid S3 path
                     auto_connect_frameworks=False)

Then I create an instance of output model and invoke update weigths.

    output_model = OutputModel(task=cml.Task.current_task(), 
                                   label_enumeration=labels, 
                                   framework='tensorflow')
    
    output_model.update_weights(register_uri=output_filename)  # upload_uri=args['cml_output_uri'])

I still have a link to local file in model in WebUI.
Even in clearml.conf sdk.development.default_output_uri points to s3 location.

$ pip freeze|grep clearml
clearml==1.5.0

@chorus12
Copy link
Author

chorus12 commented Aug 4, 2022

with clearml==1.6.2 the same stuff

@Shm013
Copy link

Shm013 commented Aug 5, 2022

Hi @chorus12 ! I had the same problem with selfhosted S3.

Try to specify port in output uri.

For example chunk of my clearml.conf in clearml-agent:

     sdk {
      aws {
        s3 {
          host: "s3.mystorage.org:443"
          key: "S3_USERNAME"
          region: "myregion"
          secret: "S3_PASSWORD"
          use_credentials_chain: false
          credentials: [{
            bucket: "S3_BUCKET"
            secure: true
          }]
        }
      }
      development {
        default_output_uri: "s3://s3.mystorage.org:443/S3_BUCKET/clearml"
      }
    }

@chorus12
Copy link
Author

Thanks. I do have a port in s3 since it's not native AWS but the problem is that uploading to S3 works not with manual model register - with automatic - it's all fine.

@jkhenning
Copy link
Member

Hi @chorus12 ,

Sorry for the late reply - can you show this output URI's contents?

output_uri = args['cml_output_uri'], # this points to a valid S3 path

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants