ServiceUnavailable: 503 DNS resolution failed for service: firestore.googleapis.com

[eugenevk]

I am trying to access the Google's Firestore in my project with Python code (in Jupyter Notebook) and for some reason the Python program never finishes. Also tried to create a document in Firestore but then I get this error:

ServiceUnavailable: 503 DNS resolution failed for service: firestore.googleapis.com

I created a service account in Firestore (ServiceAccount.json contains the settings). This is my code:

import firebase_admin

from firebase_admin import credentials
from firebase_admin import firestore

cred = credentials.Certificate('ServiceAccount.json')
firebase_admin.initialize_app(cred)
db = firestore.client()
db.collection('company').add({'name': 'Test'})

Only the last statement fails. This is also returned:

C:\ProgramData\Anaconda3\lib\site-packages\google\api_core\grpc_helpers.py in error_remapped_callable(*args, **kwargs)
     65         try:
---> 66             return callable_(*args, **kwargs)
     67         except grpc.RpcError as exc:

C:\ProgramData\Anaconda3\lib\site-packages\grpc\_channel.py in __call__(self, request, timeout, metadata, credentials, wait_for_ready, compression)
    945                                       wait_for_ready, compression)
--> 946         return _end_unary_response_blocking(state, call, False, None)
    947 

C:\ProgramData\Anaconda3\lib\site-packages\grpc\_channel.py in _end_unary_response_blocking(state, call, with_call, deadline)
    848     else:
--> 849         raise _InactiveRpcError(state)
    850 

_InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
    status = StatusCode.UNAVAILABLE
    details = "DNS resolution failed for service: firestore.googleapis.com"
    debug_error_string = "{"created":"@1632831473.221000000","description":"Resolver transient failure","file":"src/core/ext/filters/client_channel/client_channel.cc","file_line":1356,"referenced_errors":[{"created":"@1632831473.221000000","description":"DNS resolution failed for service: firestore.googleapis.com","file":"src/core/ext/filters/client_channel/resolver/dns/native/dns_resolver.cc","file_line":202,"grpc_status":14,"referenced_errors":[{"created":"@1632831473.221000000","description":"OS Error","file":"src/core/lib/iomgr/resolve_address_windows.cc","file_line":93,"os_error":"The specified class was not found.\r\n","syscall":"getaddrinfo","wsa_error":10109}]}]}"
>

The above exception was the direct cause of the following exception:

ServiceUnavailable                        Traceback (most recent call last)
C:\ProgramData\Anaconda3\lib\site-packages\google\api_core\retry.py in retry_target(target, predicate, sleep_generator, deadline, on_error)
    189         try:
--> 190             return target()
    191
...

Please advise. I am out of ideas.

[busunkim96]

Hi,

Is it possible you are sitting behind a proxy or firewall that blocks access to certain endpoints?

Could you try this code snippet? This fetches the discovery document for firestore which is public but sits at the same endpoint "firestore.googleapis.com".

import requests

response = requests.get("https://firestore.googleapis.com/\$discovery/rest?version=v1")
response.raise_for_status()

print(response.json())

[eugenevk]

Hi @busunkim96, when I test my code on another (personal Mac) computer, it works all fine. However, on Windows it doesn't. The result of your code is:

---------------------------------------------------------------------------
HTTPError                                 Traceback (most recent call last)
<ipython-input-1-70d460a2f5fe> in <module>
      2 
      3 response = requests.get("https://firestore.googleapis.com/\$discovery/rest?version=v1")
----> 4 response.raise_for_status()
      5 
      6 print(response.json())

C:\ProgramData\Anaconda3\lib\site-packages\requests\models.py in raise_for_status(self)
    941 
    942         if http_error_msg:
--> 943             raise HTTPError(http_error_msg, response=self)
    944 
    945     def close(self):

HTTPError: 404 Client Error: Not Found for url: https://firestore.googleapis.com/%5C$discovery/rest?version=v1

[eugenevk]

Additional note @busunkim96: since on my Windows computer it still isn't working, do you have any other suggestions, because I need to migrate data from a MS Access database.
I tried this suggestion from another user on Stackoverflow.com https://github.com/grpc/grpc/issues/18691 but to no success.

[busunkim96]

Whoops I think I had a stray \in the URL from when I was testing with curl - could you try this instead in your Windows environment?

import requests

response = requests.get("https://firestore.googleapis.com/$discovery/rest?version=v1")
response.raise_for_status()

print(response.json())

[eugenevk]

Now your code runs fine @busunkim96. Long output. It start with the below. What do you suggest next?

{
	'version_module': True,
	'mtlsRootUrl': 'https: //firestore.mtls.googleapis.com/',
	'icons': {
		'x32': 'http: //www.google.com/images/icons/product/search-32.gif',
		'x16': 'http: //www.google.com/images/icons/product/search-16.gif'
	},
	'documentationLink': 'https: //cloud.google.com/firestore',
	'id': 'firestore: v1',
	'auth': {
		'oauth2': {
			'scopes': {
				'https: //www.googleapis.com/auth/datastore': {
					'description': 'ViewandmanageyourGoogleCloudDatastoredata'
				},
				'https: //www.googleapis.com/auth/cloud-platform': {
					'description': 'See,
					edit,
					configure,
					anddeleteyourGoogleClouddataandseetheemailaddressforyourGoogleAccount.'
				}
			}
		}
	},
	'schemas': {
		'GoogleFirestoreAdminV1LocationMetadata': {
			'type': 'object',
			'properties': {
				
			},
			'description': 'Themetadatamessageforgoogle.cloud.location.Location.metadata.',
			'id': 'GoogleFirestoreAdminV1LocationMetadata'
		},
		'GoogleFirestoreAdminV1Database': {
			'properties': {
				'name': {
					'description': 'TheresourcenameoftheDatabase.Format: `projects/{
						project
					}/databases/{
						database
					}`',
					'type': 'string'
				},
				'etag': {
					'type': 'string',
					'description': 'Thischecksumiscomputedbytheserverbasedonthevalueofotherfields,
					andmaybesentonupdateanddeleterequeststoensuretheclienthasanup-to-datevaluebeforeproceeding.'
				},
				'concurrencyMode': {
					'type': 'string',
					'enum': ['CONCURRENCY_MODE_UNSPECIFIED',
					'OPTIMISTIC',
					'PESSIMISTIC',
					'OPTIMISTIC_WITH_ENTITY_GROUPS'],
					'enumDescriptions': ['Notused.',
					'Useoptimisticconcurrencycontrolbydefault.ThisisthesettingforCloudFirestorecustomers.',
					'Usepessimisticconcurrencycontrolbydefault.ThisisthesettingforCloudFirestorecustomers.',
					'Useoptimisticconcurrencycontrolwithentitygroupsbydefault.ThisisthesettingforCloudDatastorecustomers.'],
					'description': 'Theconcurrencycontrolmodetouseforthisdatabase.'
				},
				'type': {
					'description': 'Thetypeofthedatabase.Seehttps: //cloud.google.com/datastore/docs/firestore-or-datastoreforinformationabouthowtochoose.',
					'enumDescriptions': ['Thedefaultvalue.Thisvalueisusedifthedatabasetypeisomitted.',
					'FirestoreNativeMode',
					'FirestoreinDatastoreMode.'],
					'enum': ['DATABASE_TYPE_UNSPECIFIED',
					'FIRESTORE_NATIVE',
					'DATASTORE_MODE'],
					'type': 'string'
				},
				'locationId': {
					'description': 'Thelocationofthedatabase.Availabledatabasesarelistedathttps: //cloud.google.com/firestore/docs/locations.',
					'type': 'string'
				}
			},
			'type': 'object',
			'description': "A Cloud Firestore Database in Native Mode. Currently one database is allowed per cloud project. It is named '(default)'",
			'id': 'GoogleFirestoreAdminV1Database'
		},
		'Write': {
			...

[busunkim96]

Since you're able to get to the endpoint through the REST API that rules out the endpoint itself being blocked.

I believe you've tried this already, but if you have not, please please try switching to GRPC_DNS_RESOLVER=native (per comments in https://stackoverflow.com/questions/9361854/serviceunavailable-503-dns-resolution-failed-for-service-firestore-googleapis and grpc/grpc#1869)

If that doesn't work, please set the following environment variables, run your program, and share the log.

GRPC_VERBOSITY=debug
GRPC_TRACE=cares_resolver,cares_address_sorting

Some additional questions:

1. Have you used any other Google Cloud APIs successfully with Python or any other language in the Windows environment?
2. What version of grpcio is installed?

(env) busunkim-macbookpro% python3           
Python 3.7.9 (v3.7.9:13c94747c7, Aug 15 2020, 01:31:08) 
[Clang 6.0 (clang-600.0.57)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import grpc
>>> grpc.__version__
'1.41.0'

[eugenevk]

First of all know that I really appreciate your help @busunkim96. Thanks!

I have set the GRPC settings like this, but my program still runs forever. Apols, but I don't know where I can find the log.

And to your questions:

1. I am able to access Google Firestore (and Angolia index e.g.) in my VueJS project that I design with VS Code on my Windows 10 laptop.
2. This is the grpc version: