Skip to content

Pull requests: scaleapi/llm-engine

New pull request New
22 Open 529 Closed
22 Open 529 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Replace instead of patch PDB
#603 opened Aug 21, 2024 by yunfeng-scale Loading…
Batch completions V2 job
#602 opened Aug 20, 2024 by dmchoiboi Loading…
14
Docs for qwen2 72b instruct
#601 opened Aug 16, 2024 by yunfeng-scale Loading…
Get v2 batch inference working
#597 opened Aug 15, 2024 by seanshi-scale • Draft
@seanshi-scale
Use maxUnavailale for endpoint PDB
#596 opened Aug 14, 2024 by yunfeng-scale Loading…
Multinode batch inference
#589 opened Aug 7, 2024 by seanshi-scale • Draft
Multinode serving
#574 opened Jul 23, 2024 by seanshi-scale • Draft
@seanshi-scale
2
Bump setuptools from 69.0.3 to 70.0.0 in /model-engine dependencies Pull requests that update a dependency file
#565 opened Jul 15, 2024 by dependabot bot Loading…
Bump zipp from 3.16.0 to 3.19.1 in /model-engine dependencies Pull requests that update a dependency file
#559 opened Jul 9, 2024 by dependabot bot Loading…
Bump certifi from 2023.7.22 to 2024.7.4 in /model-engine dependencies Pull requests that update a dependency file
#557 opened Jul 6, 2024 by dependabot bot Loading…
Bump requests from 2.31.0 to 2.32.2 in /model-engine dependencies Pull requests that update a dependency file
#549 opened Jun 24, 2024 by dependabot bot Loading…
Bump urllib3 from 1.26.16 to 1.26.19 in /model-engine dependencies Pull requests that update a dependency file
#542 opened Jun 18, 2024 by dependabot bot Loading…
Bump msal from 1.26.0 to 1.28.0 in /model-engine dependencies Pull requests that update a dependency file
#538 opened Jun 11, 2024 by dependabot bot Loading…
Bump azure-identity from 1.15.0 to 1.16.1 in /model-engine dependencies Pull requests that update a dependency file
#537 opened Jun 11, 2024 by dependabot bot Loading…
Remove Gunicorn and use Uvicorn only for gateway
#530 opened May 31, 2024 by yunfeng-scale Loading…
7
Bump werkzeug from 2.3.6 to 3.0.3 in /model-engine dependencies Pull requests that update a dependency file
#512 opened May 6, 2024 by dependabot bot Loading…
Bump jinja2 from 3.0.3 to 3.1.4 in /model-engine dependencies Pull requests that update a dependency file
#511 opened May 6, 2024 by dependabot bot Loading…
Bump tqdm from 4.65.0 to 4.66.3 in /model-engine dependencies Pull requests that update a dependency file
#508 opened May 3, 2024 by dependabot bot Loading…
Bump pydantic from 1.10.11 to 1.10.13 in /clients/python dependencies Pull requests that update a dependency file
#502 opened Apr 25, 2024 by dependabot bot Loading…
Bump aiohttp from 3.9.2 to 3.9.4 in /model-engine dependencies Pull requests that update a dependency file
#496 opened Apr 18, 2024 by dependabot bot Loading…
Bump gunicorn from 20.1.0 to 22.0.0 in /model-engine dependencies Pull requests that update a dependency file
#494 opened Apr 17, 2024 by dependabot bot Loading…
Bump transformers from 4.36.0 to 4.38.0 in /scripts dependencies Pull requests that update a dependency file
#489 opened Apr 10, 2024 by dependabot bot Loading…
ProTip! Exclude everything labeled bug with -label:bug.