Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[possible bug] clearml-task cwd #423

Closed
valeriano-manassero opened this issue Aug 14, 2021 · 3 comments
Closed

[possible bug] clearml-task cwd #423

valeriano-manassero opened this issue Aug 14, 2021 · 3 comments

Comments

@valeriano-manassero
Copy link

I'm trying to create a task that is not in repository root folder.

Let's say the directory is called test_folder ; the following command works:

clearml-task --project test_project --name remote_test --script test_folder/test_artifact.py --repo git@github.com:testest/test --branch main --requirements test_folder/requirements.txt  --skip-task-init --task-type data_processing

but we know it's better so set WORKING DIRECTORY in the task itself so:

clearml-task --project test_project --name remote_test --script test_artifact.py --repo git@github.com:testest/test --branch main --requirements requirements.txt  --skip-task-init --task-type data_processing --cwd test_folder

Error: Script entrypoint file '/Users/test-user/clearml-pipelines/git@github.com:testest/test/step1_dataset_artifact.py' could not be found.

Basically it's not possible to set WORKING DIRECTORY using clearml-task while it's obviously possible using ClearML UI on already existing task to customise it.

@valeriano-manassero
Copy link
Author

After @bmartinn comments on Slack I think the error message is misleading a bit; using https in front of --repo enabled me to set also the working directory with this command:

clearml-task --project test_project --name remote_test --script test_artifact.py --repo https://github.com/testest/test --branch main --requirements requirements.txt  --skip-task-init --task-type data_processing --cwd test_folder

Not sure if we need to keep this issue open.

@bmartinn
Copy link
Member

Thanks @valeriano-manassero
The detection of the remote SSH repository failed, thus it assumed this is a local repository, raising an error when the folder was not found.
It should be fixed now on the main branch, let me know if it worked.

git install git+https://github.com/allegroai/clearml.git

@valeriano-manassero
Copy link
Author

Tested and it works! Ty!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants