Skip to content

Actions: ModelTC/lightllm

Actions

Docker

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
docker-publish.yml
209 workflow runs
209 workflow runs

Filter by Event

Loading

Filter by Status

Loading

Filter by Branch

Loading

Filter by Actor

Loading
fix openai api (#471) Docker #209: Commit 08b5e08 pushed by shihaobai
July 19, 2024 08:28 4m 25s main
main
July 19, 2024 08:28 4m 25s
remove sliding windows of qwen2 (#469) Docker #208: Commit ff366f8 pushed by hiworldwzj
July 18, 2024 09:21 13m 40s main
main
July 18, 2024 09:21 13m 40s
refactor diverse mode to accelerate post process & fix dynamic_prompt… Docker #207: Commit cc5d1ca pushed by hiworldwzj
July 18, 2024 08:02 3m 36s main
main
July 18, 2024 08:02 3m 36s
remove @mark_cost_time (#468) Docker #206: Commit d40f730 pushed by hiworldwzj
July 17, 2024 06:25 1m 57s main
main
July 17, 2024 06:25 1m 57s
make monitor client to sync in a thread (#464) Docker #205: Commit ea64286 pushed by shihaobai
July 15, 2024 10:30 8m 28s main
main
July 15, 2024 10:30 8m 28s
return prompt_tokens for generate/generate_stream of api_lightllm (#463) Docker #204: Commit 904d6b1 pushed by hiworldwzj
July 11, 2024 10:30 1m 48s main
main
July 11, 2024 10:30 1m 48s
fix odd vocab size for qwen2 tp>1 (#460) Docker #203: Commit c600d14 pushed by shihaobai
July 9, 2024 07:25 2m 23s main
main
July 9, 2024 07:25 2m 23s
Set the default timeout of rpyc connect to 30s and add pushgateway a… Docker #202: Commit 50f0e2e pushed by hiworldwzj
July 9, 2024 06:02 1m 47s main
main
July 9, 2024 06:02 1m 47s
fix: control the metric set frequency (#458) Docker #201: Commit b8155f0 pushed by hiworldwzj
July 8, 2024 11:49 1m 51s main
main
July 8, 2024 11:49 1m 51s
Refactor prometheus monitoring and add push gataway (#454) Docker #200: Commit e7e9490 pushed by hiworldwzj
July 8, 2024 11:20 2m 21s main
main
July 8, 2024 11:20 2m 21s
fix a small bug in README.md (#455) Docker #199: Commit 31a4adb pushed by hiworldwzj
July 5, 2024 02:06 2m 7s main
main
July 5, 2024 02:06 2m 7s
feat: Add weight-only quantization inference support for Qwen2 series… Docker #198: Commit 0807a9b pushed by hiworldwzj
July 4, 2024 02:56 3m 46s main
main
July 4, 2024 02:56 3m 46s
Add Projects using lightllm in README.md and add LazyLLM (#453) Docker #197: Commit 45d12ba pushed by hiworldwzj
July 4, 2024 01:26 3m 11s main
main
July 4, 2024 01:26 3m 11s
Llama wa quant support down_proj mix bits (#451) Docker #196: Commit b8501a9 pushed by hiworldwzj
July 1, 2024 04:34 2m 10s main
main
July 1, 2024 04:34 2m 10s
refactor a little for --mode and start args logs. (#450) Docker #195: Commit c91d734 pushed by hiworldwzj
June 26, 2024 02:43 3m 36s main
main
June 26, 2024 02:43 3m 36s
Create __init__.py (#448) Docker #194: Commit b35405c pushed by WANDY666
June 18, 2024 12:12 6m 18s main
main
June 18, 2024 12:12 6m 18s
remove return_logics params (#446) Docker #193: Commit 34aef65 pushed by hiworldwzj
June 17, 2024 06:57 2m 3s main
main
June 17, 2024 06:57 2m 3s
fix bug of mulit eos_id (#442) Docker #192: Commit c1a228d pushed by hiworldwzj
June 17, 2024 06:46 2m 2s main
main
June 17, 2024 06:46 2m 2s
fix mem manger get nccl_port way (#440) Docker #191: Commit 7a06643 pushed by hiworldwzj
June 17, 2024 03:40 2m 6s main
main
June 17, 2024 03:40 2m 6s
fix log for mean_per_token_cost_time (#438) Docker #190: Commit 5218569 pushed by hiworldwzj
June 14, 2024 03:24 1m 45s main
main
June 14, 2024 03:24 1m 45s
ppl w8a8 support splitfuse mode. (#437) Docker #189: Commit a47942e pushed by hiworldwzj
June 13, 2024 04:06 30m 46s main
main
June 13, 2024 04:06 30m 46s
add support for phi3-mini (#433) Docker #188: Commit 7609618 pushed by hiworldwzj
June 13, 2024 03:09 1m 50s main
main
June 13, 2024 03:09 1m 50s
add high performance layernorm triton kernels. (#432) Docker #187: Commit c8160a4 pushed by hiworldwzj
June 13, 2024 02:10 1m 55s main
main
June 13, 2024 02:10 1m 55s
update tokenizer_mode help info. (#431) Docker #186: Commit 62c006c pushed by hiworldwzj
June 12, 2024 03:13 3m 36s main
main
June 12, 2024 03:13 3m 36s
use triton to init window info (#420) Docker #185: Commit 0bf7ec9 pushed by hiworldwzj
June 12, 2024 02:42 3m 28s main
main
June 12, 2024 02:42 3m 28s