Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

tdupdatesheet tdsheet not working ? #256

Closed
lefoimpeur opened this issue Mar 18, 2022 · 22 comments
Closed

tdupdatesheet tdsheet not working ? #256

lefoimpeur opened this issue Mar 18, 2022 · 22 comments

Comments

@lefoimpeur
Copy link

Hi,

The "tdupdatesheet" attribute of the "todrive" parameter seems does not work with the "tdsheet" attribute.
It never finds the sheet either with the name or the id.

Always the same error whether the name of the sheet is correct or fake :
ERROR: Invalid User, Config File: C:\Users\zzz.gam\gam.cfg, Item: todrive_user, Value: zzz@yyy, Not Found

Command line :
gam user xxxx@yyy print teamdrives role organizer | gam csv - gam user ~User print filelist select teamdriveid ~id query "visibility = 'domainWithLink'" todrive tduploadnodata false tdfileid xxxx tdsheet id:0 tdupdatesheet

Other similar commands work perfectly, so the user is not invalid :
gam user xxxx@yyy print teamdrives role organizer | gam csv - gam user ~User print filelist select teamdriveid ~id query "visibility = 'domainWithLink'" todrive tduploadnodata false tdparent id:xxxx
gam user xxxx@yyy print teamdrives role organizer | gam csv - gam user ~User print filelist select teamdriveid ~id query "visibility = 'domainWithLink'" todrive tduploadnodata false tdfileid xxxx tdcopysheet id:0

Is this a bug or syntax error on mine ?

(I'm usign 6.16.18 version)

Thanks in advance
@taers232c
Copy link
Owner

Send me a Meet/Zoom invitation and I'll help you get the data you want.

ross.scroggs @ gmail.com

@taers232c
Copy link
Owner

This is going to overwrite the sheet for each team drive:

gam user xxxx@yyy print teamdrives role organizer | gam csv - gam user ~User print filelist select teamdriveid ~id query "visibility = 'domainWithLink'" todrive tduploadnodata false tdfileid xxxx tdsheet id:0 tdupdatesheet

To get a single sheet:

gam user xxxx@yyy print teamdrives role organizer | gam redirect csv - todrive tduploadnodata false tdfileid xxxx tdsheet id:0 tdupdatesheet csv - gam user ~User print filelist select teamdriveid ~id query "visibility = 'domainWithLink'"

Open Sheets file xxxx, select the tab of interest, look at the URL, the id is here: gid=12345, put that value in the command

@lefoimpeur
Copy link
Author

Thank you, I will test that next week.

@taers232c
Copy link
Owner

This error implies that the todrive_user value in gam.cfg is incorrect.
'ERROR: Invalid User, Config File: C:\Users\zzz.gam\gam.cfg, Item: todrive_user, Value: zzz@yyy, Not Found'

Do: gam config verify
Verify that the value zzz@yyy is a valid email address.

@lefoimpeur
Copy link
Author

the value is good because with another command todrive it's ok

@taers232c
Copy link
Owner

taers232c commented Mar 18, 2022 via email

@lefoimpeur
Copy link
Author

Hi,

In my gam config file --> todrive_user = ''
So by default it must use my account.

Configuration is good because with another command todrive it's ok, example :
gam user xxxx@yyy print teamdrives role organizer | gam csv - gam user ~User print filelist select teamdriveid ~id query "visibility = 'domainWithLink'" todrive tduploadnodata false tdparent id:xxxx

Capture d’écran 2022-03-21 à 09 09 21

Capture d’écran 2022-03-21 à 09 10 53

And if I put my email --> todrive_user = zzz@yyy
I've got same error

@taers232c
Copy link
Owner

taers232c commented Mar 21, 2022 via email

@lefoimpeur
Copy link
Author

lefoimpeur commented Mar 23, 2022 •
edited
Loading

Hi, I can't do that, it's for my company :-(

@taers232c
Copy link
Owner

taers232c commented Mar 23, 2022 via email

@lefoimpeur
Copy link
Author

Hi,

  1. todrive_user is blank
  2. admin_email is blank
  3. Google Workspace Admin = my adm email = zzz@yyy in my example

@taers232c
Copy link
Owner

taers232c commented Mar 25, 2022 via email

@lefoimpeur
Copy link
Author

GAMADV 6.16.18

@taers232c
Copy link
Owner

Show a command that works and one that doesn't, the screen shots with the redactions are hard to read, copy the output into a file. Replace actual addresses with admin@domain.com for your workspace admin and user@domain.com for any other address.

@lefoimpeur
Copy link
Author

Command NOK :

c:\outils\gam-xtd>gam user user@domain.com print teamdrives role organizer | gam redirect csv - todrive tduploadnodata false tdfileid xxx tdsheet id:yyy tdupdatesheet csv - gam user ~User print filelist select teamdriveid ~id query "visibility = 'domainWithLink'"
Getting all Shared Drives for user@domain.com
Got 8 Shared Drives...
User: admin@domain.com, Service not applicable/Does not exist
Command: gam redirect csv - >>>todrive<<< tduploadnodata false tdfileid xxx tdsheet id:yyy tdupdatesheet csv - gam user ~User print filelist select teamdriveid ~id query "visibility = 'domainWithLink'"

ERROR: Invalid User, Config File: C:\Users\admin\.gam\gam.cfg, Item: todrive_user, Value: admin@domain.com, Not Found
Help: Syntax in file c:\outils\gam-xtd\GamCommands.txt
Help: Documentation is at https://github.com/taers232c/GAMADV-XTD3/wiki

Command OK :

c:\outils\gam-xtd>gam user user@domain.com print teamdrives role organizer | gam csv - gam user ~User print filelist select teamdriveid ~id query "visibility = 'domainWithLink'" todrive tduploadnodata false tdparent id:yyy
Getting all Shared Drives for user@domain.com
Got 8 Shared Drives...
2022-03-25T15:47:18.008+00:00,0/5,Using 5 processes...
Getting all Drive Files/Folders that match query ((visibility = 'domainWithLink')) for user@domain.com
Getting all Drive Files/Folders that match query ((visibility = 'domainWithLink')) for user@domain.com
Getting all Drive Files/Folders that match query ((visibility = 'domainWithLink')) for user@domain.com
Getting all Drive Files/Folders that match query ((visibility = 'domainWithLink')) for user@domain.com
Getting all Drive Files/Folders that match query ((visibility = 'domainWithLink')) for user@domain.com
Got 1 Drive File/Folder that matched query ((visibility = 'domainWithLink')) for user@domain.com...
Got 1 Drive File/Folder that matched query ((visibility = 'domainWithLink')) for user@domain.com...
Got 0 Drive Files/Folders that matched query ((visibility = 'domainWithLink')) for user@domain.com...
No CSV data to upload
Got 0 Drive Files/Folders that matched query ((visibility = 'domainWithLink')) for user@domain.com...
No CSV data to upload
Got 40 Drive Files/Folders that matched query ((visibility = 'domainWithLink')) for user@domain.com...
Data uploaded to Drive File:
https://docs.google.com/spreadsheets/d/xxx/edit?usp=drivesdk
Data uploaded to Drive File:
https://docs.google.com/spreadsheets/d/xxx/edit?usp=drivesdk
Data uploaded to Drive File:
https://docs.google.com/spreadsheets/d/xxx/edit?usp=drivesdk

gam config :

c:\outils\gam-xtd>gam config verify
Section: DEFAULT
  activity_max_results = 100
  admin_email = ''
  api_calls_rate_check = false
  api_calls_rate_limit = 100
  auto_batch_min = 0
  batch_size = 50
  cacerts_pem = ''
  cache_dir = C:\Users\admin\.gam\gamcache
  cache_discovery_only = true
  charset = mbcs
  classroom_max_results = 0
  client_secrets_json = client_secrets.json ; C:\Users\admin\.gam\client_secrets.json
  cmdlog = ''
  cmdlog_max_backups = 5
  cmdlog_max_kilo_bytes = 1000
  config_dir = C:\Users\admin\.gam
  contact_max_results = 100
  csv_input_column_delimiter = ,
  csv_input_quote_char = '"'
  csv_input_row_drop_filter = ''
  csv_input_row_filter = ''
  csv_output_column_delimiter = ,
  csv_output_convert_cr_nl = false
  csv_output_field_delimiter = ' '
  csv_output_header_drop_filter = ''
  csv_output_header_filter = ''
  csv_output_line_terminator = lf
  csv_output_quote_char = '"'
  csv_output_row_drop_filter = ''
  csv_output_row_filter = ''
  csv_output_subfield_delimiter = .
  csv_output_timestamp_column = ''
  csv_output_users_audit = false
  customer_id = my_customer
  debug_level = 0
  device_max_results = 200
  domain = ''
  drive_dir = C:\Users\admin\Downloads
  drive_max_results = 1000
  drive_v3_native_names = true
  email_batch_size = 50
  enable_dasa = false
  event_max_results = 250
  extra_args = ''
  inter_batch_wait = 0
  member_max_results = 200
  message_batch_size = 50
  message_max_results = 500
  mobile_max_results = 100
  multiprocess_pool_limit = 0
  never_time = Never
  no_browser = true
  no_cache = false
  no_update_check = true
  no_verify_ssl = true
  num_tbatch_threads = 2
  num_threads = 5
  oauth2_txt = oauth2.txt ; C:\Users\admin\.gam\oauth2.txt
  oauth2service_json = oauth2service.json ; C:\Users\admin\.gam\oauth2service.json
  people_max_results = 100
  quick_info_user = false
  section = ''
  show_api_calls_retry_data = false
  show_commands = false
  show_convert_cr_nl = false
  show_counts_min = 1
  show_gettings = true
  show_gettings_got_nl = false
  show_multiprocess_info = false
  smtp_fqdn = ''
  smtp_host = ''
  smtp_password =
  smtp_username = ''
  timezone = utc
  tls_max_version = ''
  tls_min_version = ''
  todrive_clearfilter = false
  todrive_clientaccess = false
  todrive_conversion = true
  todrive_localcopy = false
  todrive_locale = ''
  todrive_nobrowser = true
  todrive_noemail = true
  todrive_parent = root
  todrive_sheet_timeformat = ''
  todrive_sheet_timestamp = false
  todrive_timeformat = ''
  todrive_timestamp = false
  todrive_timezone = ''
  todrive_upload_nodata = true
  todrive_user = ''
  update_cros_ou_with_id = false
  user_max_results = 500
  user_service_account_access_only = false

gam oauth info :

c:\outils\gam-xtd>gam oauth info
Client OAuth2 File: C:\Users\admin\.gam\oauth2.txt
Client ID: xxx.apps.googleusercontent.com
Scopes: 45
  https://apps-apis.google.com/a/feeds/compliance/audit/
  https://sites.google.com/feeds
  https://www.google.com/m8/feeds
  https://www.googleapis.com/auth/admin.chrome.printers
  https://www.googleapis.com/auth/admin.contact.delegation
  https://www.googleapis.com/auth/admin.datatransfer
  https://www.googleapis.com/auth/admin.directory.customer
  https://www.googleapis.com/auth/admin.directory.device.chromebrowsers
  https://www.googleapis.com/auth/admin.directory.device.chromeos
  https://www.googleapis.com/auth/admin.directory.device.mobile
  https://www.googleapis.com/auth/admin.directory.domain
  https://www.googleapis.com/auth/admin.directory.group
  https://www.googleapis.com/auth/admin.directory.orgunit
  https://www.googleapis.com/auth/admin.directory.resource.calendar
  https://www.googleapis.com/auth/admin.directory.rolemanagement
  https://www.googleapis.com/auth/admin.directory.user
  https://www.googleapis.com/auth/admin.directory.user.security
  https://www.googleapis.com/auth/admin.directory.userschema
  https://www.googleapis.com/auth/admin.reports.audit.readonly
  https://www.googleapis.com/auth/admin.reports.usage.readonly
  https://www.googleapis.com/auth/apps.groups.migration
  https://www.googleapis.com/auth/apps.groups.settings
  https://www.googleapis.com/auth/apps.licensing
  https://www.googleapis.com/auth/calendar
  https://www.googleapis.com/auth/chrome.management.policy
  https://www.googleapis.com/auth/chrome.management.reports.readonly
  https://www.googleapis.com/auth/chrome.management.telemetry.readonly
  https://www.googleapis.com/auth/classroom.announcements
  https://www.googleapis.com/auth/classroom.courses
  https://www.googleapis.com/auth/classroom.coursework.students
  https://www.googleapis.com/auth/classroom.courseworkmaterials
  https://www.googleapis.com/auth/classroom.guardianlinks.students
  https://www.googleapis.com/auth/classroom.profile.emails
  https://www.googleapis.com/auth/classroom.profile.photos
  https://www.googleapis.com/auth/classroom.rosters
  https://www.googleapis.com/auth/classroom.topics
  https://www.googleapis.com/auth/cloud-identity.groups
  https://www.googleapis.com/auth/contacts
  https://www.googleapis.com/auth/devstorage.read_only
  https://www.googleapis.com/auth/directory.readonly
  https://www.googleapis.com/auth/ediscovery
  https://www.googleapis.com/auth/siteverification
  https://www.googleapis.com/auth/userinfo.email
  https://www.googleapis.com/auth/userinfo.profile
  openid
Google Workspace Admin: admin@domain.com
Expires: 2022-03-25T17:40:26+00:00

@taers232c
Copy link
Owner

In the first command you have: tdfileid xxx tdsheet id:yyy tdupdatesheet
In the second command you have: tdparent id:yyy

Both commands work for me.

Test the second command with tdfileid xxx tdsheet id:yyy tdupdatesheet
Is there any change?

@taers232c
Copy link
Owner

In the first command, each teamdrive processed is updating the same file, you should add the multiprocess keyword as show below to get all of the data in the file:

gam user user@domain.com print teamdrives role organizer | gam redirect csv - multiprocess todrive tduploadnodata false tdfileid xxx tdsheet id:yyy tdupdatesheet csv - gam user ~User print filelist select teamdriveid ~id query "visibility = 'domainWithLink'"```

@taers232c
Copy link
Owner

From the first command: tdfileid xxx

Do: gam user admin@domain.com show fileinfo xxx

@taers232c
Copy link
Owner

Split the first command into two parts; does this make any difference?

gam redirect csv ./teamsdrive.csv user user@domain.com print teamdrives role organizer 

gam redirect csv - multiprocess todrive tduploadnodata false tdfileid xxx tdsheet id:yyy tdupdatesheet csv ./teamdrives.csv gam user ~User print filelist select teamdriveid ~id query "visibility = 'domainWithLink'"

@taers232c
Copy link
Owner

Do:

gam user admin@domain.com check serviceaccount

What do you get for:

  https://www.googleapis.com/auth/spreadsheets                              ???? (25/26)

@taers232c
Copy link
Owner

Has your issue been resolved?

@lefoimpeur
Copy link
Author

Hi,

No and I didn't test your suggestions.
Furthermore, this topic is currently on break.
I'll be sure to inform you of my actions as soon as possible.
Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@lefoimpeur @taers232c