Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Snowflake Avro sync method #123

Merged
merged 12 commits into from Jun 12, 2023
Merged

Snowflake Avro sync method #123

merged 12 commits into from Jun 12, 2023

Conversation

iskakaushik
Copy link
Contributor

No description provided.

}

// write this file to snowflake using COPY INTO statement
copyCmd := fmt.Sprintf("COPY INTO %s FROM @%%%s/%s FILE_FORMAT = (TYPE = AVRO)",

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [golangci] reported by reviewdog 🐶
G201: SQL string formatting (gosec)

return 0, fmt.Errorf("failed to define Avro schema: %w", err)
}

fmt.Printf("Avro schema: %s\n", avroSchema)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [golangci] reported by reviewdog 🐶
printf: fmt.Printf format %s has arg avroSchema of wrong type *github.com/PeerDB-io/peer-flow/connectors/snowflake.AvroSchemaDefinition (govet)

// separately based on the specific structure of the data.
// If it's a simple nested structure, you can consider mapping them to "record" types in Avro, similar to
// the bigquery.RecordFieldType case.
return nil, fmt.Errorf("Snowflake semi-structured type %s not supported yet", databaseType)

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚫 [golangci] reported by reviewdog 🐶
ST1005: error strings should not be capitalized (stylecheck)

@iskakaushik iskakaushik marked this pull request as ready for review June 12, 2023 17:39
flow/model/qvalue.go Outdated Show resolved Hide resolved
@iskakaushik iskakaushik changed the title Draft for snowflake Avro sync method Snowflake Avro sync method Jun 12, 2023
@iskakaushik iskakaushik merged commit eb8f8fe into main Jun 12, 2023
6 checks passed
@iskakaushik iskakaushik deleted the qrep-snowflake-init branch June 12, 2023 18:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant