logging breaks in PowerShell

[LarryThermo]

DVC version: 0.61.2 as installed by dvc-0.61.2.exe on Windows 10.

When I type dvc add "Training Set" in a Powershell Window I get the error report below.

The Training Set directory is very large (8.22GB, 14186 files). Is this too large for the 0.61.2 version? Suggestions?

Thanks,

Larry

PS C:\Projects-Git\MasuTraining\AutoFocusTraining> dvc add "Training Set"
Computing md5 for a large number of files. This is only done once.
--- Logging error ---
Traceback (most recent call last):
File "dvc\logger.py", line 158, in emit
File "site-packages\tqdm\std.py", line 569, in write
File "contextlib.py", line 119, in exit
File "site-packages\tqdm\std.py", line 597, in external_write_mode
File "site-packages\tqdm\std.py", line 94, in release
AssertionError: attempt to release recursive lock not owned by thread
Call stack:
File "dvc_main_.py", line 10, in
File "dvc\main.py", line 42, in main
File "dvc\command\add.py", line 24, in run
File "dvc\repo_init_.py", line 33, in wrapper
File "dvc\repo\scm_context.py", line 4, in run
File "dvc\repo\add.py", line 45, in add
File "dvc\stage.py", line 711, in save
File "dvc\output\base.py", line 243, in save
File "dvc\output\base.py", line 199, in changed
File "dvc\output\base.py", line 190, in status
File "dvc\output\base.py", line 172, in changed_checksum
File "dvc\remote\base.py", line 329, in save_info
File "dvc\remote\base.py", line 318, in get_checksum
File "dvc\remote\base.py", line 234, in get_dir_checksum
File "dvc\remote\base.py", line 210, in collect_dir
File "dvc\remote\base.py", line 187, in calculate_checksums
File "logging_init.py", line 1378, in info
File "logging_init.py", line 1514, in log
File "logging_init.py", line 1524, in handle
File "logging_init_.py", line 1586, in callHandlers
File "logging_init_.py", line 894, in handle
File "dvc\logger.py", line 164, in emit
Message: 'Computing md5 for a large number of files. This is only done once.'
Arguments: ()
ERROR: unexpected error - failed to log <LogRecord: dvc.remote.base, 20, dvc\remote\base.py, 187, "Computing md5 for a large number of files. This is only done once.">

Having any troubles? Hit us up at https://dvc.org/support, we are always happy to help!

[efiop]

Hi @LarryThermo !

Looks like a bug in our progress/logging subsystem. We'll take a look and will try to reproduce it soon.

In the meantime, could you try running that command from a regular cmd terminal, just to check if that one is also affected? Also, have you considered using terminal that comes with git? Or are you usually using PowerShell?

[LarryThermo]

@efiop,

Thanks for the quick response. Its working from a cmd terminal, yea.

I also tried it from git bash as brought up from a Windows explorer context menu. Unfortunately git bash gives a "bash: dvc: command not found" error, so it is apparently not honoring my path variable which does have "C:\Program Files (x86)\Data Version Control" as its last entry.

I don't normally use Powershell but instead prefer TortoiseGit.

[efiop]

@LarryThermo Sorry for the delay. Let me clarify, so it doesn't work from Powershell but works fine from a regular windows cmd terminal, right?

I also tried it from git bash as brought up from a Windows explorer context menu. Unfortunately git bash gives a "bash: dvc: command not found" error, so it is apparently not honoring my path variable which does have "C:\Program Files (x86)\Data Version Control" as its last entry.

That is right. You could try calling it directly, though, to see if it works and then adjust PATH in it, if you decide to use it in the meantime.

I don't normally use Powershell but instead prefer TortoiseGit.

I'm not familiar with TortoiseGit, is it a GUI wrapper? Are you using it with some IDE?

[LarryThermo]

Hi @efiop,

Yes, it did not work from powershell due to the logging error. But it did work with no logging error from the cmd prompt. It also did not work initially in either Git Bash or WSL linux due to pathing problems with finding dvc.exe when "dvc" is typed at the prompt.

I did discover that if I created a symbolic link inside C:/Program Files (x86)/Data Version Control both Git Bash and WSL linux started working. Precisely I typed "mklink dvc dvc.exe" inside a Powershell window with administrative permission. This also enabled the "dvs install" extension to start working.

TortoiseGit is a GUI wrapper. Many on our team use it, some prefer the command line. Others use the AtlAssian SourceTree product.

@LarryThermo

[efiop]

@LarryThermo Thanks for clarifying! 🙂 As a workaround, consider using git bash or wsl, if you are used to *nix workflow. We'll try to reproduce this issue in powershell.

[efiop]

For the record: Looks like cmd is affected too: https://discordapp.com/channels/485586884165107732/485596304961962003/633745228179832842