Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(warehouse): encoding package with readers, loaders, writers #3077

Merged
merged 29 commits into from
Mar 13, 2023

Conversation

achettyiitr
Copy link
Member

@achettyiitr achettyiitr commented Mar 8, 2023

Description

  • Added separate package for encoding with readers, loaders, and writers for CSV, JSON, PARQUET
  • Added test cases for encoding package.

Notion Ticket

https://www.notion.so/rudderstacks/encoding-with-readers-loaders-writers-5c4e2c63bf49411ebe403a8fdc07ba14?pvs=4

Security

  • The code changed/added as part of this pull request won't create any security issues with how the software is being used.

@achettyiitr achettyiitr changed the base branch from master to chore.schema-1 March 8, 2023 08:08
@achettyiitr achettyiitr changed the title chore(warehouse): encoding with readers, loaders, writers chore(warehouse): encoding package with readers, loaders, writers Mar 8, 2023
@achettyiitr achettyiitr requested a review from cisse21 March 8, 2023 21:24
@codecov
Copy link

codecov bot commented Mar 9, 2023

Codecov Report

Patch coverage: 37.59% and project coverage change: +0.22 🎉

Comparison is base (d3320fa) 53.60% compared to head (d875f2b) 53.82%.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #3077      +/-   ##
==========================================
+ Coverage   53.60%   53.82%   +0.22%     
==========================================
  Files         346      348       +2     
  Lines       53805    53819      +14     
==========================================
+ Hits        28840    28968     +128     
+ Misses      23328    23213     -115     
- Partials     1637     1638       +1     
Impacted Files Coverage Δ
services/pgnotifier/pgnotifier.go 2.83% <0.00%> (ø)
warehouse/admin.go 3.17% <0.00%> (ø)
warehouse/identities.go 1.04% <0.00%> (ø)
warehouse/identity/identity.go 0.51% <0.00%> (ø)
...ehouse/integrations/azure-synapse/azure-synapse.go 0.31% <0.00%> (ø)
warehouse/integrations/datalake/datalake.go 6.77% <0.00%> (ø)
warehouse/integrations/manager/manager.go 51.19% <ø> (ø)
warehouse/integrations/mssql/mssql.go 1.62% <0.00%> (ø)
warehouse/integrations/postgres/diagnostic.go 88.46% <ø> (ø)
warehouse/integrations/postgres/postgres.go 0.53% <0.00%> (ø)
... and 43 more

... and 8 files with indirect coverage changes

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

)

const (
UuidTsColumn = "uuid_ts"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
UuidTsColumn = "uuid_ts"
UUIDTsColumn = "uuid_ts"

@achettyiitr achettyiitr marked this pull request as draft March 10, 2023 07:31
Base automatically changed from chore.schema-1 to master March 13, 2023 08:12
@achettyiitr achettyiitr marked this pull request as ready for review March 13, 2023 08:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants