Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

8. Data can be consumed by the scheduled job #7

Closed
3 tasks done
aronchick opened this issue Jan 25, 2022 · 0 comments
Closed
3 tasks done

8. Data can be consumed by the scheduled job #7

aronchick opened this issue Jan 25, 2022 · 0 comments

Comments

@aronchick
Copy link
Collaborator

aronchick commented Jan 25, 2022 •
edited by lukemarsden

  • Presenting the required data to the process execution environment
  • Investigate ipfs fuse mounts in order to efficiently mount a dataset inside a firecracker vm running the docker container with the job in it (avoiding any copying)
  • Deliverable: one of the two job execution environments can mount data into the user code (e.g. sed can run on data in ipfs!)
@aronchick aronchick added this to the Phase 0 milestone Jan 25, 2022
@lukemarsden lukemarsden changed the title Data can be consumed by the scheduled job 8. Data can be consumed by the scheduled job Jan 31, 2022
@aronchick aronchick mentioned this issue Apr 19, 2022
Closed
simonwo pushed a commit that referenced this issue Dec 6, 2023
@wesfloyd
Merge pull request #7 from bacalhau-project/arch-updates
7ef4184 
Updates to the Architecture page and "bacalhau docker run"
simonwo pushed a commit that referenced this issue Dec 6, 2023
@lukemarsden
bot(examples): fix: update all examples to newest version of bacalhau (…
3dc5851 
…#7)

* Fix by adding --id-only flag for examples that expect to return the job ID on stdout
* Fix by removing --download flag from examples that want the stdout of the job
* Fix molecular dynamics example by including bacalhau install in notebook

Co-authored-by: Luke Marsden <me@lukemarsden.net>
Co-authored-by: Phil Winder <phil@winder.ai> via bacalhau-project/examples@a49b79e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@aronchick @lukemarsden