file.FetchMetadata() is not working

[abubelinha]

I want to get many metadata from each file (title, mimetype, size, date last modified, ...) in just one call.

I followed this example in documentation.

file1 = drive.CreateFile({'id': '<some file ID here>'})
print('title: %s, mimeType: %s' % (file1['title'], file1['mimeType']))

#### THE ABOVE CODE WORKS PERFECTLY

#### BUT CODE BELOW FAILS:

# (1) Fetches all basic metadata fields, including file size, last modified etc.
file1.FetchMetadata()

# (2) Fetches all metadata available.
file1.FetchMetadata(fetch_all=True)

# (3) Fetches the 'permissions' metadata field.
file1.FetchMetadata(fields='permissions')
# (4) You can update a list of specific fields like this:
file1.FetchMetadata(fields='permissions,labels,mimeType')

But in fact, none of the above FetchMetadata() example calls is working for me (under Windows 7, Python 3.8).
1, 3 & 4 return NoneType.

And the example 2, FetchMetadata(fetch_all=True), raises this error:

  File "c:\python38\lib\site-packages\pydrive2\auth.py", line 84, in _decorated
    return decoratee(self, *args, **kwargs)
  File "c:\python38\lib\site-packages\pydrive2\files.py", line 467, in FetchMetadata
    raise ApiRequestError(error)
pydrive2.files.ApiRequestError: <HttpError 400 when requesting https://www.googleapis.com/drive/v2/files/1ckwZ4cwqDdjdcyB_GDvNc-T8zD4qrpKmIy2lTMQdfSU?fields=alternateLink%2CappDataContents%2CcanComment%2CcanReadRevisions%2Ccapabilitiescopyable%2CcreatedDate%2CdefaultOpenWithLink%2Cdescription%2CdownloadUrl%2Ceditable%2CembedLink%2Cetag%2CexplicitlyTrashed%2CexportLinks%2CfileExtension%2CfileSize%2CfolderColorRgb%2CfullFileExtension%2ChasAugmentedPermissions%2CheadRevisionId%2CiconLink%2Cid%2CimageMediaMetadata%2CindexableText%2CisAppAuthorized%2Ckind%2Clabels%2ClastModifyingUser%2ClastModifyingUserName%2ClastViewedByMeDate%2CmarkedViewedByMeDate%2Cmd5Checksum%2CmimeType%2CmodifiedByMeDate%2CmodifiedDate%2CopenWithLinks%2CoriginalFilename%2CownedByMe%2CownerNames%2Cowners%2Cparents%2Cpermissions%2Cproperties%2CquotaBytesUsed%2CselfLink%2Cshareable%2Cshared%2CsharedWithMeDate%2CsharingUser%2Cspaces%2CteamDriveId%2Cthumbnail%2CthumbnailLink%2Ctitle%2CtrashedDate%2CtrashingUseruserPermission%2Cversion%2CvideoMediaMetadata%2CwebContentLink%2CwebViewLink%2CwritersCanShare&supportsAllDrives=true&alt=json returned "Invalid field selection capabilitiescopyable". Details: "Invalid field selection capabilitiescopyable">

... and if I check that url in a browser, it is a json reply which suggests PyDrive is trying a non authenticated connection??
But of course, I have authenticated because my previous file1['title'] and file1['mimeType'] calls worked perfectly.

{
  "error": {
    "errors": [
      {
        "domain": "usageLimits",
        "reason": "dailyLimitExceededUnreg",
        "message": "Daily Limit for Unauthenticated Use Exceeded. Continued use requires signup.",
        "extendedHelp": "https://code.google.com/apis/console"
      }
    ],
    "code": 403,
    "message": "Daily Limit for Unauthenticated Use Exceeded. Continued use requires signup."
  }
}

I wonder if this is related to #91

But in my case, I am NOT trying to update metadata.
I just want to read them.

[shcheklein]

Invalid field selection capabilitiescopyable

Good catch. I've fixed and released the new version 1.8.2 -please give it a try. file1.FetchMetadata(fetch_all=True) should not be throwing an error. Fix is in #104

But in fact, none of the above FetchMetadata() example calls is working for me (under Windows 7, Python 3.8).
1, 3 & 4 return NoneType.

this is something different and most likely means that either you are using wrong credentials, trying to access a file that is public and reached its global limits, or something else is happening. I would try to use this form to execute the query and check the result:

https://developers.google.com/drive/api/v2/reference/files/get?apix_params=%7B%22fileId%22%3A%22123%22%2C%22fields%22%3A%22*%22%7D

I wonder if this is related to #91

no, it's not . That one is about updating metadata, here is something else.

[abubelinha]

Thanks @shcheklein , I upgraded to 1.8.2, so no error when calling file1.FetchMetadata(fecht_all=True)

But I don't understand why you say I might be using wrong credentials.
In that case, why does file1['title'] work a few lines above?
Both use the same credentials (same file1 object)

So my account has access to the file, and so does the PyDrive2 file1 object.
I still think the problem is just inside .FetchMetadata() function

Actually, I am trying this also with public files, but .FetchMetadata() keeps returning NoneType (no matter if I give READ or EDIT public access).

BTW, I tried the Google Explorer API form you suggested to execute the query, and it worked perfectly (same user credentials).

I could see full Metadata, so I think you should not close the issue yet.

[shcheklein]

Thanks @shcheklein , I upgraded to 1.8.2, so no error when calling file1.FetchMetadata(fecht_all=True)

good to hear that!

and so does the PyDrive2 file1 object

could you clarify what do you mean, please?

I still think the problem is just inside .FetchMetadata() function

it might be. I just don't see the reason for it to fail. There are tests for this function in the repo, and it returns actual objects in those tests. We need a script to reproduce this, something that I can try to run and see that it fails.

[abubelinha]

Thanks @shcheklein
For the script, I thought the example in my first post should be enough.
I reproduce here a full script (and a real public file id):

THIS IS THE SCRIPT:

from pydrive2.auth import GoogleAuth
from pydrive2.drive import GoogleDrive
gauth = GoogleAuth()
credsFile = "mycreds.txt"
gauth.LoadCredentialsFile(credsFile)
drive = GoogleDrive(gauth)

file1 = drive.CreateFile({'id': '1X97rMxfiK8aCrUpTb0cD8hZBKWSECxJL'})

# after the lines above, I should be able to grab file metadata ('title', 'mimeType' ... whatever) in 2 ways:

print('\nWAY 1: file1[...] \n title: %s' % (file1['title'])) 
print('\nWAY 2: file1.FetchMetadata(...) \n title: %s' % (file1.FetchMetadata(fields='title'))) 

THIS IS THE OUTPUT:

WAY 1: file1[...]
 title: Tulips.jpg

WAY 2: file1.FetchMetadata(...)
 title: None

What I mean is that this is not a credentials issue, because both ways of getting metadata use the same credentials (same drive and file1 objects). If file1 can access 'title' metadata in one way, it should has access to 'title' the other way too.

Moreover, the file is public. Even if I pass a wrong credentials .txt file name, the script raises a warning but the output is identical (WAY 1 still works: it shows file name; WAY 2 still fails: it shows None).

So it doesn't make sense to me that the second way fails due to a credentials issue.

[shcheklein]

Hmm, I see where confusion might have come from. FetchMetadata call doesn't itself return anything. It populates the file object with the information so that you can access it wither by doing file1['title'] after that (w/o incurring additional API calls this time), or by file1.metadata.

[abubelinha]

OMG ... so I completely misunderstood it.
So, you mean something like this?

file1 = drive.CreateFile({'id': '<some file ID here>'})

# this would imply 3 API calls:

print(file1['title'], file1['mimeType'], file1['modifiedDate'])

# this would imply just 1 API call:

file1.FetchMetadata(fields='title,mimeType,modifiedDate,description,md5Checksum,fileSize')
print(file1['title'], file1['mimeType'], file1['modifiedDate'])
print(file1['description'], file1['md5Checksum'], file1['fileSize'])

[shcheklein]

@abubelinha kinda, I think that file1['title'] will be enough to fetch all basic fields (default one if you don't provide fetchAll). So it might happen that mimeType and modifiedDate will be part of the first call.

file1.FetchMetadata(fields='title,mimeType,modifiedDate,description,md5Checksum,fileSize')

this should do one API call indeed