Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Export lakeFS branch to S3 continuously #534

Closed
arielshaqed opened this issue Aug 26, 2020 · 1 comment
Closed

Export lakeFS branch to S3 continuously #534

arielshaqed opened this issue Aug 26, 2020 · 1 comment
Assignees
@arielshaqed @guy-har
Projects
lakeFS

Comments

@arielshaqed
Copy link
Contributor

Cover issue for visibility.
@arielshaqed arielshaqed added this to Backlog in lakeFS via automation Aug 26, 2020
@arielshaqed arielshaqed moved this from Backlog to In progress in lakeFS Aug 26, 2020
@arielshaqed arielshaqed mentioned this issue Aug 27, 2020
Merged
nopcoder pushed a commit that referenced this issue Aug 27, 2020
@arielshaqed
Document the export operation
ad428d3 
Documentation for intended operation of #534.
@arielshaqed arielshaqed mentioned this issue Sep 14, 2020
Merged
This was referenced Oct 12, 2020
Merged
Merged
Merged
@arielshaqed arielshaqed mentioned this issue Oct 21, 2020
Merged
arielshaqed added a commit that referenced this issue Oct 22, 2020
@arielshaqed
Add post-{commit,merge}
1963648 
Part of #534 but will be useful elsewhere.  Allows loosely-coupled components, will be used to
support export.
@arielshaqed arielshaqed mentioned this issue Nov 4, 2020
Merged
arielshaqed added a commit that referenced this issue Dec 30, 2020
@arielshaqed
Document the export operation
d5e0d49 
Documentation for intended operation of #534.
arielshaqed added a commit that referenced this issue Dec 30, 2020
@arielshaqed @guy-har
Document the export operation (#542)
de8ab3d 
* Document the export operation

Documentation for intended operation of #534.

* Update docs/reference/continuous-export.md

* [CR]: add some extra useful fields

Not sure if we should/can add them, so question marks for reviewers.

* [CR] Fix tpyo

* CR: export is per-branch; separate files: _STATUS, optional detailed

* [CR] add FAQs

* [CR] Replace CLI with REST; triggers for Airflow-like workflows

* [CR] Fix review comments, match committed code, and document repair

* [CR] Fix JSON, S3 read-after-write guarantees, some old filenames

* [CR] Double the backslashes!

JSON is fun.

Co-authored-by: guy-har <60321938+guy-har@users.noreply.github.com>
@arielshaqed
Copy link
Contributor Author

Was done waaay back but also being removed today.

lakeFS automation moved this from In progress to Done Feb 1, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@arielshaqed arielshaqed

@guy-har guy-har

Labels
None yet
Projects
No open projects
lakeFS
  
Done
Milestone
No milestone
Development

No branches or pull requests
3 participants
@tzahij @arielshaqed @guy-har