Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(gateway): support new event type extract #2999

Merged
merged 20 commits into from
Mar 9, 2023
Merged

Conversation

debanjan97
Copy link
Member

@debanjan97 debanjan97 commented Feb 20, 2023

Description

As part of supporting a new event type, extract, we are adding
a new endpoint /internal/extract for ingesting the event.
We are not enforcing the event payload to have either userId or anonymousId.
The same is reflected in the test case modification.

Notion Ticket

https://www.notion.so/rudderstacks/Development-New-event-for-extract-b9e4d7abef294bd7a690acc0332a18ea?pvs=4

Security

  • The code changed/added as part of this pull request won't create any security issues with how the software is being used.

@codecov
Copy link

codecov bot commented Feb 20, 2023

Codecov Report

Patch coverage: 46.16% and project coverage change: +0.17 🎉

Comparison is base (1d9f63b) 53.43% compared to head (120c5c9) 53.60%.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #2999      +/-   ##
==========================================
+ Coverage   53.43%   53.60%   +0.17%     
==========================================
  Files         342      346       +4     
  Lines       52747    53627     +880     
==========================================
+ Hits        28185    28747     +562     
- Misses      22947    23248     +301     
- Partials     1615     1632      +17     
Impacted Files Coverage Δ
utils/misc/misc.go 51.37% <ø> (-0.49%) ⬇️
warehouse/identity/identity.go 0.51% <0.00%> (+0.06%) ⬆️
...ehouse/integrations/azure-synapse/azure-synapse.go 0.31% <0.00%> (+0.02%) ⬆️
warehouse/integrations/postgres/postgres.go 0.53% <0.00%> (-28.10%) ⬇️
warehouse/internal/service/recovery.go 100.00% <ø> (ø)
warehouse/upload.go 23.58% <0.00%> (-0.02%) ⬇️
warehouse/integrations/mssql/mssql.go 1.62% <6.20%> (+0.66%) ⬆️
warehouse/integrations/postgres-legacy/postgres.go 28.62% <28.62%> (ø)
warehouse/integrations/manager/manager.go 51.19% <54.16%> (-3.10%) ⬇️
...nternal/service/loadfiles/downloader/downloader.go 82.55% <82.55%> (ø)
... and 17 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

gateway/gateway.go Outdated Show resolved Hide resolved
gateway/gateway.go Outdated Show resolved Hide resolved
gateway/gateway.go Outdated Show resolved Hide resolved
gateway/gateway.go Outdated Show resolved Hide resolved
Copy link
Contributor

@am6010 am6010 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice !!

@debanjan97 debanjan97 merged commit 63dc940 into master Mar 9, 2023
@debanjan97 debanjan97 deleted the feat/extractevent branch March 9, 2023 12:08
@@ -1256,6 +1269,9 @@ func (gateway *HandleT) StartWebHandler(ctx context.Context) error {
srvMux.HandleFunc("/version", WithContentType("application/json; charset=utf-8", gateway.versionHandler)).Methods("GET")
srvMux.HandleFunc("/robots.txt", gateway.robots).Methods("GET")

// internal endpoints
internalMux.HandleFunc("/v1/extract", gateway.webExtractHandler).Methods("POST")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@cisse21 doesn't this require proxy adaptations too so that not a random node is picked?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants