Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Beam Enrich: support enrichments relying on local files #3736

Closed
BenFradet opened this issue Apr 19, 2018 · 2 comments
Closed

Beam Enrich: support enrichments relying on local files #3736

BenFradet opened this issue Apr 19, 2018 · 2 comments
Assignees
@BenFradet
Labels
3. Enrich
Milestone
R110 Valle dei Te...

Comments

@BenFradet
Copy link
Contributor

This is the trickiest enrichment since it relies on local files and so is treated separately.

Beam has a distributed cache similar to hadoop: http://spotify.github.io/scio/examples/DistCacheExample.scala.html
@BenFradet BenFradet added this to the R10x Vallei dei Templi (Apache Beam enrich) milestone Apr 19, 2018
@BenFradet BenFradet self-assigned this Apr 19, 2018
@BenFradet BenFradet changed the title Beam Enrich: support the IP lookups enrichment Beam Enrich: support the enrichments relying on local files May 11, 2018
@BenFradet
Copy link
Contributor Author

renamed since we now have other enrichments relying on local files, c.f. #3750

@BenFradet BenFradet changed the title Beam Enrich: support the enrichments relying on local files Beam Enrich: support enrichments relying on local files May 11, 2018
BenFradet added a commit that referenced this issue May 11, 2018
@BenFradet
Dist cache #3736
d04e830
@alexanderdean
Copy link
Member

We will have a third soon (referer-parser).

BenFradet added a commit that referenced this issue May 22, 2018
@BenFradet
test #3736
c81478d
BenFradet added a commit that referenced this issue May 25, 2018
@BenFradet
test #3736
3d87f34
BenFradet added a commit that referenced this issue May 28, 2018
@BenFradet
Dist cache #3736
71c961e
BenFradet added a commit that referenced this issue May 28, 2018
@BenFradet
test #3736
a2e434d
@BenFradet BenFradet mentioned this issue Jun 5, 2018
Closed
BenFradet added a commit that referenced this issue Jul 9, 2018
@BenFradet
Dist cache #3736
0c34063
BenFradet added a commit that referenced this issue Jul 9, 2018
@BenFradet
test #3736
26bda48
BenFradet added a commit that referenced this issue Jul 9, 2018
@BenFradet
Beam Enrich: support enrichments relying on local files (closes #3736)
76c0e51
BenFradet added a commit that referenced this issue Jul 9, 2018
@BenFradet
Beam Enrich: support enrichments relying on local files (closes #3736)
dd5f269
BenFradet added a commit that referenced this issue Jul 20, 2018
@BenFradet
Beam Enrich: support enrichments relying on local files (closes #3736)
5779cc1
BenFradet added a commit that referenced this issue Jul 20, 2018
@BenFradet
Beam Enrich: support enrichments relying on local files (closes #3736)
3c96c8a
BenFradet added a commit that referenced this issue Jul 20, 2018
@BenFradet
Beam Enrich: support enrichments relying on local files (closes #3736)
cf89586
BenFradet added a commit that referenced this issue Jul 23, 2018
@BenFradet
Beam Enrich: support enrichments relying on local files (closes #3736)
cd29361
BenFradet added a commit that referenced this issue Aug 23, 2018
@BenFradet
Beam Enrich: support enrichments relying on local files (closes #3736)
514debc
BenFradet added a commit that referenced this issue Aug 28, 2018
@BenFradet
Beam Enrich: support enrichments relying on local files (closes #3736)
f7213d1
@benjben benjben mentioned this issue Oct 18, 2019
Closed
peel pushed a commit to snowplow/beam-enrich that referenced this issue Feb 7, 2020
@BenFradet @peel
Support enrichments relying on local files (closes snowplow/snowplow#…
6a15feb 
…3736)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@BenFradet BenFradet

Labels
3. Enrich
Projects
None yet
Milestone
R110 Valle dei Templi (Beam Enrich)
Development

No branches or pull requests
2 participants
@alexanderdean @BenFradet