Skip to content
This repository has been archived by the owner on May 1, 2023. It is now read-only.

symlink operation not supported on 'latest_log_dir' #157

Closed
barrh opened this issue Feb 17, 2019 · 3 comments
Closed

symlink operation not supported on 'latest_log_dir' #157

barrh opened this issue Feb 17, 2019 · 3 comments

Comments

@barrh
Copy link
Contributor

barrh commented Feb 17, 2019

python3 distiller/examples/classifier_compression/compress_classifier.py --arch=[...] --workers=[...] --compress=examples/agp-pruning/[...].yaml --batch-size=[...] --epochs=[..] --lr [...] --num-best-scores=[..] imagenet -o=[...]

Log file for this run: [...]/2019.02.17-120315/2019.02.17-120315.log
Traceback (most recent call last):
File "distiller/examples/classifier_compression/compress_classifier.py", line 748, in
main()
File "distiller/examples/classifier_compression/compress_classifier.py", line 97, in main
msglogger = apputils.config_pylogger(os.path.join(script_dir, 'logging.conf'), args.name, args.output_dir)
File "distiller/apputils/execution_env.py", line 134, in config_pylogger
os.symlink(logdir, "latest_log_dir")
OSError: [Errno 95] Operation not supported: '[...]/2019.02.17-120315' -> 'latest_log_dir'

Commenting out that part seems to avoid that issue completely: https://github.com/NervanaSystems/distiller/blame/master/apputils/execution_env.py#L126-L135

@barrh
Copy link
Contributor Author

barrh commented Feb 17, 2019

Probably not an issue by itself, but I didn't expect that the directory will get named that way:
When specified the experiment name (read, --name=NAME), the result is something like this: NAME___2019.02.17-120734

@barrh
Copy link
Contributor Author

barrh commented Feb 17, 2019

I found the rootcause: symlinks aren't always possible to generate.
I had tried to call compress_classifier.py from a mounted nfs drive, and sent the logs to a local drive.

nzmora added a commit that referenced this issue Feb 17, 2019
Sometime Symlinks can't be created, so we fail queitly.
@nzmora
Copy link
Contributor

nzmora commented Feb 17, 2019

Re: #157 (comment)
This has been the intended behavior since the introduction of this feature.

Cheers
Neta

@nzmora nzmora closed this as completed Feb 21, 2019
michaelbeale-IL pushed a commit that referenced this issue Apr 24, 2023
Sometime Symlinks can't be created, so we fail queitly.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants