Option to disable progress spinner

[kent-at-multiscale]

I am using gsutil in a scripting environment to move large files. I need to have progress logged so we can monitor jobs and get status updates. However, the progress indicator for gsutil cp includes a spinner that assumes it is working in a terminal. This produces an incredible amount of garbage in a log file.

This is related to #429 and #265 but is not the same request. I still need to see the progress, it just needs to omit the special control characters that assume the output is a terminal window. In other words, I want an option to remove the spinner and instead just write a new line.

[houglum]

Thanks for submitting the request -- I've seen a few mentions of this since we did the UI overhaul and added the spinner-based progress printing. I agree that it would be much nicer to provide a way for gsutil to do progress printing that doesn't look like a mess when not directed to a terminal, either by providing an explicit option for this or (probably better) to have gsutil automatically do this if stdout refers to something besides a terminal.

[supersteves]

I second a need for this. We're running gsutil through Ant, and don't see any progress updates until the command finishes, whereupon all updates are concatenated. Can't see any workaround for this using Ant options. Ideally we'd see a newline per progress update, every minute perhaps. Some option not to be clever with the terminal? Rather than disabling altogether via -q.

[keeth]

Plus one. Having to choose between reams of garbage directed to log file or complete silence is not ideal. Thanks!

[berlincount]

Plus one! :)

[dantheperson]

+1

[jeremyvisser]

We already have a helper function IsRunningInteractively() which tests whether stdin/out isatty():

gsutil/gslib/utils/system_util.py

Lines 233 to 235 in e2f02ab

	def IsRunningInteractively():
	"""Returns True if currently running interactively on a TTY."""
	return sys.stdout.isatty() and sys.stderr.isatty() and sys.stdin.isatty()

The StatusMessageManager should call IsRunningInteractively() at some point to decide whether to actually show the spinner:

gsutil/gslib/ui_controller.py

Lines 114 to 117 in e2f02ab

	def __init__(self, update_message_period=1, update_spinner_period=0.6,
	sliding_throughput_period=5, first_throughput_latency=10,
	quiet_mode=False, custom_time=None, verbose=False,
	console_width=80):

[hero2017]

+1
Not sure if we're talking about the same thing here but when I run my PS script from Task Scheduler I see this kind of garbage in my log when using gsutil cp ... :

Uploading gs://temp/db1.zip: 0 B/1.20 GiB
Uploading gs://temp/db1.zip: 98.75 MiB/1.20
Uploading gs://temp/db1.zip: 98.81 MiB/1.20
...and keeps repeating this until it uploads the entire 1.20 GB.

This can be tens or hundreds of lines depending on the file size. When I run the same script from a PS command prompt the progress is displayed on line.

Source: https://stackoverflow.com/questions/55654436/running-powershell-script-with-gsutil-cp-to-gcp-shows-upload-progress-on-multipl/55669118#55669118

[ashatrov-realforce]

Our Jenkins output has a few extra thousands of lines with:

/ [274/418 files][454.8 MiB/  1.2 GiB]  35% Done                                
/ [275/418 files][455.9 MiB/  1.2 GiB]  35% Done                                
/ [276/418 files][456.6 MiB/  1.2 GiB]  36% Done                                
/ [277/418 files][457.9 MiB/  1.2 GiB]  36% Done                                
/ [278/418 files][457.9 MiB/  1.2 GiB]  36% Done                                
/ [279/418 files][457.9 MiB/  1.2 GiB]  36% Done                                

-q - option will hide progress and filenames too. It is more convenient to have file names and status of the downloading in output but disable printing of the progress bar.

[ej2catz]

Plus One! How can this not yet be a thing?

[NotNANtoN]

I would actually like to have the reserve for my terminal. I have a load of small files that I do not care about and that spam my terminal but I do care about the general progress. So I only want the progress bar and not printing each single file.

[gabrielboehme]

+1

[aycaecemgul]

This probably won't be implemented at this point but here i go: +1