Skip to content

Commit

Permalink
Feature: Added volume persistence for models
Browse files Browse the repository at this point in the history
Changes:
- Volume for model caching
  • Loading branch information
DennisJensen95 committed Aug 9, 2023
1 parent a446657 commit 3eba517
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 1 deletion.
2 changes: 1 addition & 1 deletion Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ COPY --from=BUILD /app/build-app /app/build-app

EXPOSE 8080

ENV RUSTBERT_CACHE=/data/rustbert_cache
ENV RUST_LOG=info
ENV LIBTORCH=/usr/local/lib/python3.7/dist-packages/torch

ENTRYPOINT [ "./backend-server" ]
4 changes: 4 additions & 0 deletions fly.toml
Original file line number Diff line number Diff line change
Expand Up @@ -15,3 +15,7 @@ auto_stop_machines = true
auto_start_machines = true
min_machines_running = 0
processes = ["app"]

[mount]
source = "model_cache"
destination = "/data"

0 comments on commit 3eba517

Please sign in to comment.