Skip to content

Activity

Update to vllm 0.7.3

arvindsunpushed 1 commit to main • fc28b69…d77503b • 
15 days ago

Update sglang and flashinfer

arvindsunpushed 1 commit to main • d6e20d9…fc28b69 • 
20 days ago

Fix flashinfer

arvindsunpushed 1 commit to main • c60064d…d6e20d9 • 
22 days ago

Update sglang

arvindsunpushed 1 commit to main • a7b0eed…c60064d • 
22 days ago

Fix up wheel

arvindsunpushed 1 commit to main • 49beaf2…a7b0eed • 
25 days ago

Update README.md

arvindsunpushed 1 commit to main • ff393eb…49beaf2 • 
26 days ago

Include sglang

arvindsunpushed 1 commit to main • b809df3…ff393eb • 
26 days ago

Update to vllm 0.7.2

arvindsunpushed 1 commit to main • fdc4911…b809df3 • 
on Feb 6

Update README.md

arvindsunpushed 1 commit to main • 193ff9e…fdc4911 • 
on Feb 3

Update to vllm 0.7.1 for serving Deepseek on a 10xGH200 cluster

arvindsunpushed 1 commit to main • fe3ed10…193ff9e • 
on Feb 2

Update to vllm 0.7.0

arvindsunpushed 1 commit to main • e5ddd9a…fe3ed10 • 
on Jan 28

Update README.md

arvindsunpushed 1 commit to main • 5932fde…e5ddd9a • 
on Jan 23

New script + readme updates

arvindsunpushed 1 commit to main • 342581f…5932fde • 
on Jan 23

Update README.md

arvindsunpushed 1 commit to main • 81f2961…342581f • 
on Jan 3

Add missing package

arvindsunpushed 1 commit to main • 1ec3aa2…81f2961 • 
on Jan 3

Latest package upgrades

arvindsunpushed 1 commit to main • 90574bf…1ec3aa2 • 
on Jan 3

Add an example file of training input

siddartha-REpushed 1 commit to main • d46560d…90574bf • 
on Sep 19, 2024

Merge pull request #6 from abacusai/users/arvind/add_train

Pull request merge
arvindsunpushed 2 commits to main • ea7e619…d46560d • 
on Sep 19, 2024

New training scripts which for Lllama 3.1 405B training

arvindsuncreated users/arvind/add_train • 3f4de81 • 
on Sep 19, 2024

Bump typer==0.12.3 to support fastapi version

siddartha-REpushed 1 commit to main • 9f413e0…ea7e619 • 
on Sep 17, 2024

Pin fastapi==0.111.0 for vllm compat

siddartha-REpushed 1 commit to main • 6de7580…9f413e0 • 
on Sep 17, 2024

Update ray for vllm; deepspeed

arvindsunpushed 1 commit to main • 075add2…6de7580 • 
on Sep 7, 2024

Reflect landed PR

arvindsunpushed 1 commit to main • 983dd0e…075add2 • 
on Aug 31, 2024

Pin deepspeed

arvindsunpushed 1 commit to main • 6b5e220…983dd0e • 
on Aug 26, 2024

Fix deepspeed triton, xformers update

arvindsunpushed 1 commit to main • bd0f384…6b5e220 • 
on Aug 26, 2024

Cleanup links

arvindsunpushed 1 commit to main • 73f5b49…bd0f384 • 
on Aug 25, 2024

Update to vllm 0.5.5 and rebuild correctly

arvindsunpushed 1 commit to main • 9aed9df…73f5b49 • 
on Aug 24, 2024

Latest docker with new pytorch; vllm and xformers

arvindsunpushed 1 commit to main • daae6fc…9aed9df • 
on Aug 23, 2024

More LLama3.1 405b compatibility changes

arvindsunpushed 1 commit to main • 37465e9…daae6fc • 
on Jul 23, 2024

vllm 0.5.3

arvindsunpushed 1 commit to main • e6f9856…37465e9 • 
on Jul 23, 2024