Vector DB Support: download automatically the AstraDB secure bundle

[eolivelli]

Summary:

• now that we can use the Astra DevOps API it is easy to download the Secure bundle automatically
• the user must provide the "token" and the "database" in the DataSource configuration
• this works for the query-vector-db, vector-db-sink and the astra-keyspace and cassandra-table assets

configuration.yaml

configuration:
  resources:
    - type: "vector-database"
      name: "AstraDatasource"
      configuration:
        service: "astra"
        clientId: "{{{ secrets.astra.clientId }}}"
        secret: "{{{ secrets.astra.secret }}}"
        token: "{{{ secrets.astra.token }}}"
        database: "{{{ secrets.astra.database }}}"
        environment: "{{{ secrets.astra.environment }}}"

"environment" is by default PROD and it can be PROD, STAGING, DEV, this is a Datastax only thing, because we use the DEV databases.
I would keep it because all DataStax developers are using DEV databases and so it is easier for us to change the value to DEV in our secrets.yaml files and we can set PROD by default in the examples

[NadirJ]

This is Awesome!