Feat: gcloud integration, fixes #18

[abhishek818]

Added support for BigQuery, BigQuery Data Transfer, Logging, Storage, and Compute cloud services.
Add Tests.

Fixes: #18
/claim #18

[abhishek818]

@HugoCasa Up for review.

[abhishek818]

/claim #18

[HugoCasa]

Works great!
Few comments:

• run prettier on the scripts
• when creating objects you should use the api to check that they are really created
• delete buckets/schedules/any objects you created after running main
• no need to handle errors like you do, you can just let them throw
• for Upload_an_object you need to use Base64 as type for the file

type Base64 = string

export async function main(file: Base64) {
   // upload the file
}

• the credentials have to come from the resource, gcloud clients can accept credentials instead of keyFilename

here's the resource type def:

{
    "type": "object",
    "$schema": "https://json-schema.org/draft/2020-12/schema",
    "required": [
        "type",
        "auth_uri",
        "client_id",
        "token_uri",
        "project_id",
        "private_key",
        "client_email",
        "private_key_id",
        "client_x509_cert_url",
        "auth_provider_x509_cert_url"
    ],
    "properties": {
        "type": {
            "type": "string"
        },
        "auth_uri": {
            "type": "string",
            "format": "url"
        },
        "client_id": {
            "type": "string"
        },
        "token_uri": {
            "type": "string",
            "format": "url"
        },
        "project_id": {
            "type": "string"
        },
        "private_key": {
            "type": "string"
        },
        "client_email": {
            "type": "string",
            "format": "email"
        },
        "private_key_id": {
            "type": "string"
        },
        "client_x509_cert_url": {
            "type": "string",
            "format": "url"
        },
        "auth_provider_x509_cert_url": {
            "type": "string",
            "format": "url"
        }
    }
}

[abhishek818]

@HugoCasa
Reg, for Upload_an_object you need to use Base64 as type for the file
Not sure about this, it seems any file type is supported, have referred their official sample code - link

Anyways, have incorporated your ask.

[abhishek818]

@HugoCasa Up for review again, have addressed your comments.

[HugoCasa]

Thanks for the update.

• You should remove all the try catch wrapping (it's equivalent to throwing the caught error)
• For Upload_an_object, you need to take the file directly which is encoded as a base64 string. It's not a file path. Maybe that might help: https://stackoverflow.com/questions/42879012/how-do-i-upload-a-base64-encoded-image-string-directly-to-a-google-cloud-stora

[abhishek818]

@HugoCasa done.

[HugoCasa]

• you need to use prettier with the config specified in the .prettierrc file
• i get an error with Create_Scheduled_Query (5 NOT_FOUND: Requested entity was not found.)
• can you update the resource type def to include universe domain

[HugoCasa]

@abhishek818 still on it?

[abhishek818]

@HugoCasa yep, will just get back to this.

[abhishek818]

@HugoCasa

i get an error with Create_Scheduled_Query (5 NOT_FOUND: Requested entity was not found.)

Tried everything like creating a new destination table under a new dataset for storing scheduled query results, varying request params, checking out stackoverflow/github repos (very limited references), nothing works.
Have followed the official docs and their github repo
i give up..

Have run prettier and added that resource type missing field.

[HugoCasa]

please check the in-code reviews and remove the Create_Scheduled_Query script