Add additional celery configuration

[lewisjared]

Description

Add additional celery configuration aimed at improving the reliability of the celery workers.
The goal is to have robust delivery, execution and clean up of tasks in the event of failure.

This should now better handle failing jobs. As a catch-all a periodic clean up of any pending jobs which are >> older than the expected timeout would be useful, but I'll have to think a bit about that.

Checklist

Please confirm that this pull request has done the following:

• Tests added
• Documentation added (where applicable)
• Changelog item added to changelog/

[codecov]

Codecov Report

❌ Patch coverage is 94.28571% with 2 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
...f-celery/src/climate_ref_celery/celeryconf/base.py	90.47%	1 Missing and 1 partial ⚠️

Flag	Coverage Δ
core	92.46% <94.28%> (+<0.01%)	⬆️
providers	89.65% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
...mate-ref-celery/src/climate_ref_celery/executor.py	97.56% <100.00%> (ø)
...-ref-celery/src/climate_ref_celery/worker_tasks.py	100.00% <100.00%> (ø)
...f-celery/src/climate_ref_celery/celeryconf/base.py	93.33% <90.47%> (-6.67%)	⬇️

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.