Skip to content

Conversation

@chenmoneygithub
Copy link
Collaborator

Two options: 1) FastAPI 2) Mlflow.

@CyrusNuevoDia CyrusNuevoDia changed the base branch from main to async-inference November 15, 2024 23:21
@CyrusNuevoDia CyrusNuevoDia merged commit d9c92a5 into stanfordnlp:async-inference Nov 15, 2024
6 checks passed
chenmoneygithub added a commit that referenced this pull request Nov 16, 2024
* dspy.asyncify

* Address some comments

* Remove types from asyncify

* Fix typo

* Relax anyio version req

* Remove unnecessary imports

* Fix test

* Simplify limiter

* Add deployment guide (#1804)

* Add deployment guide

* move files

* add sync

* Update doc to use asyncify

---------

Co-authored-by: Cyrus Nouroozi <cyrus@zenbase.ai>

* deflake

* remove the deployment guide for clarity

---------

Co-authored-by: Cyrus Nouroozi <cyrus@zenbase.ai>
Co-authored-by: Chen Qian <chen.qian@databricks.com>
chenmoneygithub added a commit that referenced this pull request Nov 16, 2024
* dspy.asyncify

* Address some comments

* Remove types from asyncify

* Fix typo

* Relax anyio version req

* Remove unnecessary imports

* Fix test

* Simplify limiter

* Add deployment guide (#1804)

* Add deployment guide

* move files

* add sync

* Update doc to use asyncify

---------

Co-authored-by: Cyrus Nouroozi <cyrus@zenbase.ai>

* deflake

* include async description

---------

Co-authored-by: Cyrus Nouroozi <cyrus@zenbase.ai>
isaacbmiller pushed a commit that referenced this pull request Dec 11, 2024
* dspy.asyncify

* Address some comments

* Remove types from asyncify

* Fix typo

* Relax anyio version req

* Remove unnecessary imports

* Fix test

* Simplify limiter

* Add deployment guide (#1804)

* Add deployment guide

* move files

* add sync

* Update doc to use asyncify

---------

Co-authored-by: Cyrus Nouroozi <cyrus@zenbase.ai>

* deflake

* remove the deployment guide for clarity

---------

Co-authored-by: Cyrus Nouroozi <cyrus@zenbase.ai>
Co-authored-by: Chen Qian <chen.qian@databricks.com>
isaacbmiller pushed a commit that referenced this pull request Dec 11, 2024
* dspy.asyncify

* Address some comments

* Remove types from asyncify

* Fix typo

* Relax anyio version req

* Remove unnecessary imports

* Fix test

* Simplify limiter

* Add deployment guide (#1804)

* Add deployment guide

* move files

* add sync

* Update doc to use asyncify

---------

Co-authored-by: Cyrus Nouroozi <cyrus@zenbase.ai>

* deflake

* include async description

---------

Co-authored-by: Cyrus Nouroozi <cyrus@zenbase.ai>
@chenmoneygithub chenmoneygithub deleted the guide-on-deployment branch December 27, 2024 22:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants