Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

asyncio eventloop support #879

Open
Roger opened this issue May 27, 2018 · 14 comments
Open

asyncio eventloop support #879

Roger opened this issue May 27, 2018 · 14 comments
Assignees
Milestone

Comments

@Roger
Copy link

Roger commented May 27, 2018

I know that there's this example that use Hub, that it's a partial implementation of tulip https://github.com/celery/kombu/blob/master/examples/experimental/async_consume.py but, is there any support to run consumers using the asyncio event loop?

@auvipy auvipy added this to the 5.0 milestone May 27, 2018
@thedrow
Copy link
Member

thedrow commented May 29, 2018

Yes, in 6.0 everything will be async by default.

@pembeci
Copy link

pembeci commented Aug 31, 2018

@thedrow that's good to hear. Any idea, when 5.0 will arrive? I checked 5.0dev branch and latest commit was 18 months ago. Is it in active development? Thanks.

@pembeci
Copy link

pembeci commented Aug 31, 2018

@Roger did you try that experimental Hub approach in a real project? I wonder if it is good enough for using in production.

@auvipy
Copy link
Member

auvipy commented Aug 31, 2018

no not in active development. we have the plan to focus on this after releasing celery 4.3, maybe after October 30.

@andreyrusanov
Copy link

@auvipy any updates on this? Did you, guys. have a chance to start work on it?

@auvipy
Copy link
Member

auvipy commented Dec 29, 2018

i'm planning to start working on this in new year

@thogar-computer
Copy link

@auvipy has there been any progress on 5.0?

@auvipy
Copy link
Member

auvipy commented Feb 26, 2020

yes

@auvipy auvipy self-assigned this Aug 12, 2020
@auvipy auvipy modified the milestones: 5.0, 5.1 Aug 12, 2020
@whg517
Copy link

whg517 commented Jul 30, 2021

Hello, @auvipy . I would like to ask how far support for asynchrony is going.

At the current time node, Python support for asynchrony is very common. As things stand:

The release of ASGI has spurred the rapid development of asynchronous Web frameworks.

For example:

  • Django has already enabled async by default in 3.0
  • The power of the Fastapi has attracted many developers who are using Flask.
  • SqlAlchemy 1.4 also redesigned the kernel and began to support asynchronous calls.
  • Scrapy is written in Twisted, and although both are asynchronous, async/await writing is also being supported to make it easier for developers to write functions.

Mainstream frameworks are already adapting to async/await, which shows that async/await is a trend.

I see this issue being raised a long time ago and the corresponding PR is still in draft stage. I would like to know if there are any new development plans for work that supports asynchrony, or if there are specific development tasks. I would like to consider whether asynchrony is supported in the process of technology selection in the future. Because my new projects are written based on asynchrony.

@auvipy auvipy modified the milestones: 5.1.0, 6.0 Sep 12, 2021
@auvipy
Copy link
Member

auvipy commented Sep 12, 2021

Hello, @auvipy . I would like to ask how far support for asynchrony is going.

At the current time node, Python support for asynchrony is very common. As things stand:

The release of ASGI has spurred the rapid development of asynchronous Web frameworks.

For example:

* Django has already enabled async by default in [3.0](https://docs.djangoproject.com/en/3.2/releases/3.0/#asgi-support)

* The power of the [Fastapi](https://fastapi.tiangolo.com/) has attracted many developers who are using Flask.

* [SqlAlchemy 1.4](https://docs.sqlalchemy.org/en/14/orm/extensions/asyncio.html) also redesigned the kernel and began to support asynchronous calls.

* Scrapy is written in Twisted, and although both are asynchronous, [async/await](https://docs.scrapy.org/en/latest/topics/asyncio.html) writing is also being supported to make it easier for developers to write functions.

Mainstream frameworks are already adapting to async/await, which shows that async/await is a trend.

I see this issue being raised a long time ago and the corresponding PR is still in draft stage. I would like to know if there are any new development plans for work that supports asynchrony, or if there are specific development tasks. I would like to consider whether asynchrony is supported in the process of technology selection in the future. Because my new projects are written based on asynchrony.

I got married after I start that. now after one years of different ups and downs I am planning to start working on that soon. initially basic async work on py-amqp and kombu and also probably a 3rd party async driver like redis to start the PoC. and a related implementation design docs. I was also follwing the approach taken by django and sqlalchemy. so keep me asking questions on this regard. I would be happy with that. I have some rough ideas right now, you could tell those, half backed. when we will try to create PoC, we can figure out some more detail. thanks for raising this again

@ZoranPavlovic
Copy link

Is there any update perhaps on the state of async support in Kombu? Which issue should I monitor for its progress?

@auvipy
Copy link
Member

auvipy commented Aug 16, 2022

follow this issue, also if possible fund the effort

@GregoirePelegrin
Copy link

GregoirePelegrin commented Jul 18, 2023

Hi! No particular update on this matter? Thanks a lot for the hard work!

@omer9564
Copy link

omer9564 commented May 2, 2024

Any update on this ? Is there any branch / draft PR that one could help contribute to ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

10 participants