-
Notifications
You must be signed in to change notification settings - Fork 4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
🎉 Source Looker: Migrate Looker source to CDK structure, add SAT testing #7284
🎉 Source Looker: Migrate Looker source to CDK structure, add SAT testing #7284
Conversation
/test connector=connectors/source-looker
|
[ | ||
"homepages", | ||
"looks", | ||
"run_looks", | ||
"scheduled_plans", | ||
"user_attribute_group_values", | ||
"user_login_lockouts", | ||
"user_sessions", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we have an issue to fill those streams?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Several of these streams are dynamic. But in the scope of this task, I did not fill the account with data.
dependencies { | ||
implementation files(project(':airbyte-integrations:bases:base-standard-source-test-file').airbyteDocker.outputs) | ||
implementation files(project(':airbyte-integrations:bases:base-python').airbyteDocker.outputs) | ||
implementation files(project(':airbyte-integrations:bases:source-acceptance-test').airbyteDocker.outputs) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We don't really need this dependency cause we are using SAT image from dockerhub
@@ -22,7 +22,7 @@ | |||
} | |||
}, | |||
"type": ["null", "object"], | |||
"additionalProperties": false | |||
"additionalProperties": true |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
just remove additionalProperties, its true by default.
}, | ||
"type": ["null", "array"] | ||
}, | ||
"external_id": { | ||
"type": ["null", "string"] | ||
}, | ||
"id": { | ||
"type": ["null", "string"] | ||
"type": ["null", "string", "integer"] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we leave it as string and enbale default schema type transformation ? It looks like primary key and its better to have one type here.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This connector is custom written and did not use the Stream class from the Airbyte CDK, so unfortunately we cannot apply this approach to it.
/test connector=connectors/source-looker
|
…urochkin/source-looker-refactor-to-use-cdk
/test connector=connectors/source-looker
|
/publish connector=connectors/source-looker
|
…ing (airbytehq#7284) * Migrate Looker source to CDK structure, add SAT testing
What
resolves #7246 .
How
Describe the solution
Recommended reading order
x.java
y.python
Pre-merge Checklist
Expand the relevant checklist and delete the others.
Community member or Airbyter
airbyte_secret
./gradlew :airbyte-integrations:connectors:<name>:integrationTest
.README.md
bootstrap.md
. See description and examplesdocs/integrations/<source or destination>/<name>.md
including changelog. See changelog exampleAirbyter
If this is a community PR, the Airbyte engineer reviewing this PR is responsible for the below items.
/test connector=connectors/<name>
command is passing./publish
command described here