Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cron-jobs service stuck in restart loop #4707

Closed
cdrini opened this issue Mar 1, 2021 · 4 comments · Fixed by #4717
Closed

cron-jobs service stuck in restart loop #4707

cdrini opened this issue Mar 1, 2021 · 4 comments · Fixed by #4717
Assignees
Labels
Affects: Admin/Maintenance Issues relating to support scripts, bots, cron jobs and admin web pages. [managed] Lead: @cclauss Issues overseen by Chris (Python3 & Dev-ops lead 2019-2021) [managed] Module: Docker Issues related to the configuration or use of Docker. [managed] Priority: 1 Do this week, receiving emails, time sensitive, . [managed]
Projects

Comments

@cdrini
Copy link
Collaborator

cdrini commented Mar 1, 2021

Running docker container ls on ol-home0 reveals that the cron-jobs service is stuck in a restart loop. Note docker containers need their command to be long-running, so maybe the cron docker service is only starting the cron service, but not "hanging" on it?

@cdrini cdrini added Affects: Admin/Maintenance Issues relating to support scripts, bots, cron jobs and admin web pages. [managed] Priority: 1 Do this week, receiving emails, time sensitive, . [managed] Lead: @cclauss Issues overseen by Chris (Python3 & Dev-ops lead 2019-2021) [managed] labels Mar 1, 2021
@cdrini cdrini modified the milestones: Active Sprint, Sprint 2021-02 Mar 1, 2021
@cdrini
Copy link
Collaborator Author

cdrini commented Mar 1, 2021

Hmm :/ Do the logs reveal anything useful?

@cclauss cclauss added the Module: Docker Issues related to the configuration or use of Docker. [managed] label Mar 2, 2021
@cclauss cclauss added this to To do in Python3 Mar 2, 2021
@cclauss
Copy link
Collaborator

cclauss commented Mar 2, 2021

docker logs --tail=10 openlibrary_cron-jobs_1
cron: can't open or create /var/run/crond.pid: Permission denied
cron: can't open or create /var/run/crond.pid: Permission denied
...

@cclauss
Copy link
Collaborator

cclauss commented Mar 2, 2021

  1. Try user: root in docker-compose.production.yml https://github.com/internetarchive/openlibrary/compare/cron-hack
COMPOSE_FILE="docker-compose.yml:docker-compose.production.yml" docker-compose up -d --no-deps cron-jobs
docker logs --tail=10 openlibrary_cron-jobs_1  # no output...

@cclauss cclauss moved this from To do to Done in Python3 Mar 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Affects: Admin/Maintenance Issues relating to support scripts, bots, cron jobs and admin web pages. [managed] Lead: @cclauss Issues overseen by Chris (Python3 & Dev-ops lead 2019-2021) [managed] Module: Docker Issues related to the configuration or use of Docker. [managed] Priority: 1 Do this week, receiving emails, time sensitive, . [managed]
Projects
No open projects
Python3
  
Done
Development

Successfully merging a pull request may close this issue.

2 participants