Release 5.0

[thedrow]

Version: 5.0
Release PR: #5686

Description

Celery 5.0 is the first major version to drop support for Python 2. It supports Python 3.6+.
This version also drops support for the Riak Result Backend since Riak is unmaintained and does not support modern Python versions.

This version also refactors our CLI to use click as we prepare to make Celery fully async since it allows us
to invoke async functions in response to commands using asyncclick.

Checklist

• Release PR drafted

• Kombu Merge Freeze

• Release Kombu 5.0.0

• Release Vine 5.0.0

• Release py-amqp 5.0.0

• Milestone is 100% done

• Merge Freeze

• Release PR reviewed

• The master branch build passes

  

• Release Notes

• What's New

Process

Alphas

• Alpha 1
• Alpha 2

Betas

• Beta 1

Release Candidates

• RC 1
• RC 2
• RC3

Release Blockers

• Refactor CLI to use Click instead of our custom argparse based framework #5718
• calling eventlib/gevent patching #6322
• Remove configuration compatibility shims from 3.x #6327
• Remove the AMQP result backend #6356

Potential Release Blockers

• Update couchbase API to 3.0.0 #6321
• [WIP] - Towards Billiard 5.0 billiard#292

[auvipy]

no Alpha release?

[thedrow]

🗣️ 📢
Hello everyone.
My name is Omer and I'll be your release manager for this evening.
Please keep both hands and feet inside the ride at all times.
Enjoy:exclamation: :smile:

[thedrow]

no Alpha release?

We can do one Alpha as well if you'd like.

[thedrow]

We'll also have to merge freeze Kombu.

[auvipy]

i will take care of that open PR in kombu. having an alpha will let everyone know that the API is still unstable and might change little bit before beta.

[thedrow]

I'm going to release an alpha from the v5-dev branch today.
We're not in the merge freeze stage yet.

[thedrow]

Getting ready to release the first alpha version of Celery 5.0.

[thedrow]

Celery 5.0.0a1 was released.
Please test it out and see if you find any functional changes other than the fact that Python 2 support was dropped.

[yuan6785]

async/await is support?

[thedrow]

async/await is support?

Not yet. That's in 6.
We'd like to reduce our maintenance burden as much as possible first.

[thedrow]

Everyone ready for a merge freeze of Kombu? celery/kombu#1232 is ready for merge.

[auvipy]

If we create a new maintenance branch for 4.x series, feature freeze in master is ok. Carry-on v5 cycle sir 😁

[yuan6785]

async/await is support?

Not yet. That's in 6.
We'd like to reduce our maintenance burden as much as possible first.

Great, come on, look forward to the new version

[thedrow]

Second Alpha coming today.

[thedrow]

Second alpha released.

I need to get #5718's build to pass and we've got a first beta.
In the meantime, please test the alpha and see if you find anything wrong.

[dduraipandian]

Is this version support asyncio pool? Or moved to version 6 as in the comment?

Thanks,
Durai Pandian

[thedrow]

Is this version support asyncio pool? Or moved to version 6 as in the comment?

Thanks,
Durai Pandian

It was moved to version 6.
We decided to reduce scope and advance in small increments to ensure we don't break too many things at once.

[thedrow]

Right now #5718 is blocking us because we need to figure out how to automatically generate the documentation for the CLI as it was before.
I'm using click-sphinx and I'm nearly there.

[dduraipandian]

Is this version support asyncio pool? Or moved to version 6 as in the comment?
Thanks,
Durai Pandian

It was moved to version 6.
We decided to reduce scope and advance in small increments to ensure we don't break too many things at once.

Thanks for the reply and thank you for the contribution. Is anyway I can pick that issue and contribute to the project?

[thedrow]

Of course!

You can always check existing PRs and provide test coverage for them since that's usually missing.
You can also try to debug an issue and provide a bugfix for it.

[thedrow]

I separated the CLI documentation from the rest of the reference into a dedicated page.
It makes more sense and click-sphinx works better that way.

[tecsunw]

Will couchbase sdk 3.0.0 backend be supported in Celery 5.0?

[auvipy]

that should be! gonna milestone that PR #6094

[auvipy]

we should check all the necessary driver updates for v5. we should follow Django style release versioning. 5.0, 5.1, 5.2, 5.x each will contain new features and behavioral improvements with no major API removal.

[auvipy]

For your kind info, I want to release billiard 4.0a1 before celery 5 rc1 celery/billiard#292 we should wait this month for all the other dependencies got python 3.6+ based new releases IMHO.

[auvipy]

will re-evaluate the celery 5 milestones and related dependencies and codes needed to e updated. this weekend.

[thedrow]

Will couchbase sdk 3.0.0 backend be supported in Celery 5.0?

That's a wonderful idea!

[thedrow]

RC2 has just been released:exclamation: :tada: :partying_face:
Please try it out and report any problems.

There's going to be at least one more RC before we hit GA.

[clokep]

Would 5.0 be a good time to drop the alternative configuration setting names (see https://docs.celeryproject.org/en/latest/userguide/configuration.html#new-lowercase-settings), they seem to be a source of continual confusion.

[thedrow]

Would 5.0 be a good time to drop the alternative configuration setting names (see https://docs.celeryproject.org/en/latest/userguide/configuration.html#new-lowercase-settings), they seem to be a source of continual confusion.

I completely agree. Would you mind creating an issue about this and we'll mark it as a blocker.

[clokep]

Would 5.0 be a good time to drop the alternative configuration setting names (see docs.celeryproject.org/en/latest/userguide/configuration.html#new-lowercase-settings), they seem to be a source of continual confusion.

I completely agree. Would you mind creating an issue about this and we'll mark it as a blocker.

See #6327.

[thedrow]

Please reinstall the latest RC with pip install --update-strategy=eager -U celery.

We've released both amqp 5.0 and vine 5.0.

[maybe-sybr]

Please reinstall the latest RC with pip install --update-strategy=eager -U celery.

We've released both amqp 5.0 and vine 5.0.

@thedrow - the vine dependency at https://github.com/celery/celery/blob/master/requirements/default.txt#L4 needs to be updated to not conflict with the updated one in amqp. Breakage currently happens on master if you do things with pkg_resources at runtime (I'm installing using a git+https requirement spec).

Edit: Bumping that dependency would also require that we lose celery.five - I'll get a PR together for this since it's causing me some pain at the moment.

[thedrow]

I've completed the What's New document.
Please review it.

I'm going to hit the release button for GA tomorrow.

[thedrow]

Hi @celery/core-developers,

We're in merge freeze until 5.0 hits GA.
Thank you.

[thedrow]

I'm waiting for final confirmation from our CI before the final release.

[thedrow]

Released! 🎉

[Dihfahsih1]

what is the work around of using celery 5.0 on windows

[thedrow]

It should work on Windows but we don't actively support that platform.