New API base method based on repository model with mix-ins. (#562)

* New API base method based on repository model with mix-ins. * Convert all API clients to use the new base method and model. * Changed admin directory API rate limiter from daily to per 100 seconds and fixed configuration names and default values. * Add get_iam_policy to iam.projects.serviceaccounts repository. * Add getIamPolicy for buckets and objects. * Fix get_buckets to handle multiple pages of results. * Add forseti to user agent to credentials instead of request object. * Remove the old _base_client and add tests for _base_respository. * Update cloud resource manager get_projects and get_folders to optionally specify a parent. * Improve test coverage across all API clients. * Make inventory pipelines load data through new safe_api_call method. This method handles API errors and returns None for requests that raise exceptions. * Enable thread local http object caching when default credentials are used.
forseti-security · Aug 29, 2017 · 69710f2 · 69710f2
1 parent afd5047
commit 69710f2
Show file tree

Hide file tree

Showing 91 changed files with 6,145 additions and 2,251 deletions.
diff --git a/configs/forseti_conf.yaml.in b/configs/forseti_conf.yaml.in
@@ -38,7 +38,7 @@ global:
 
     # quota
     # The pre-populated values are the defaults from GCP.
-    max_admin_api_calls_per_day: 150000
+    max_admin_api_calls_per_100_seconds: 1500
     max_appengine_api_calls_per_second: 20
     max_bigquery_api_calls_per_100_seconds: 17000
     max_compute_api_calls_per_second: 20

diff --git a/configs/forseti_conf.yaml.sample b/configs/forseti_conf.yaml.sample
@@ -33,7 +33,7 @@ global:
 
     # quota
     # The pre-populated values are the defaults from GCP.
-    max_admin_api_calls_per_day: 150000
+    max_admin_api_calls_per_100_seconds: 1500
     max_appengine_api_calls_per_second: 20
     max_bigquery_api_calls_per_100_seconds: 17000
     max_compute_api_calls_per_second: 20

diff --git a/google/cloud/security/common/gcp_api/_base_client.py b/google/cloud/security/common/gcp_api/_base_client.py