Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merge 1126 #7

Merged
merged 146 commits into from
Nov 27, 2023
Merged

Merge 1126 #7

merged 146 commits into from
Nov 27, 2023

Conversation

renning22
Copy link

Why are these changes needed?

Related issue number (if applicable)

Checks

  • I've run format.sh to lint the changes in this PR.
  • I've included any doc changes needed.
  • I've made sure the relevant tests are passing (if applicable).

Trangle and others added 30 commits August 31, 2023 18:34
Remove hardcode flash-attn disable setting (lm-sys#2342)
2264580
@nathanstitt
Document turning off proxy_buffering when api is streaming (lm-sys#2337)
24a8755
@merrymercy
Simplify huggingface api example (lm-sys#2355)
b039a66
@merrymercy
Update sponsor logos (lm-sys#2367)
ea045e6
@leiwen83 @wenlei03
if LOGDIR is empty, then don't try output log to local file (lm-sys#2357
85bec47 
)

Signed-off-by: Lei Wen <wenlei03@qiyi.com>
Co-authored-by: Lei Wen <wenlei03@qiyi.com>
@leiwen83 @wenlei03
add best_of and use_beam_search for completions interface (lm-sys#2348)
f99663c 
Signed-off-by: Lei Wen <wenlei03@qiyi.com>
Co-authored-by: Lei Wen <wenlei03@qiyi.com>
@merrymercy
Extract upvote/downvote from log files (lm-sys#2369)
3cf04c2
@merrymercy
Revert "add best_of and use_beam_search for completions interface" (l…
94f4dd6 
…m-sys#2370)
@merrymercy
Improve doc (lm-sys#2371)
dc3dd12
@leiwen83 @wenlei03
add best_of and use_beam_search for completions interface (lm-sys#2372)
a5e6abf 
Signed-off-by: Lei Wen <wenlei03@qiyi.com>
Co-authored-by: Lei Wen <wenlei03@qiyi.com>
@merrymercy
update monkey patch for llama2 (lm-sys#2379)
1d703b2
@merrymercy
Make E5 adapter more restrict to reduce mismatch (lm-sys#2381)
56744d1
@merrymercy
Update UI and sponsers (lm-sys#2387)
6af0a7c
@merrymercy
Use fsdp api for save save (lm-sys#2390)
9b3147e
@merrymercy
Release v0.2.27
a6167db
@jondurbin @j-durbin
Spicyboros + airoboros 2.2 template update. (lm-sys#2392)
7dcdafe 
Co-authored-by: Jon Durbin <jon.durbin@onna.com>
@Rayrtfr
bugfix of openai_api_server for fastchat.serve.vllm_worker (lm-sys#2398)
b921f16 
Co-authored-by: wuyongyu <wuyongyu@atomecho.xyz>
@merrymercy
Revert "bugfix of openai_api_server for fastchat.serve.vllm_worker" (l…
13f40b3 
…m-sys#2400)
@merrymercy
Revert "add best_of and use_beam_search for completions interface" (l…
77aa4df 
…m-sys#2401)
@merrymercy
Release a v0.2.28 with bug fixes and more test cases
11b05bb
@wangxiyuan
Fix model_worker error (lm-sys#2404)
a8088ba
@wangzhen263
Added google/flan models and fixed AutoModelForSeq2SeqLM when loading…
b49d789 
… T5 compression model (lm-sys#2402)
@karshPrime
Rename twitter to X (lm-sys#2406)
7dfcf1a
@merrymercy
Update huggingface_api.py (lm-sys#2409)
aa153d5
@obitoquilt
Add support for baichuan2 models (lm-sys#2408)
3149253
@Somezak1
Fixed character overlap issue when api streaming output (lm-sys#2431)
2e0e60b
@hi-jin
Support custom conversation template in multi_model_worker (lm-sys#2434)
c7e3e67
@zhangsibo1129
Add Ascend NPU support (lm-sys#2422)
c685951
@tobiabir
Add raw conversation template (lm-sys#2417) (lm-sys#2418)
54a8353
@merrymercy
Improve docs & UI (lm-sys#2436)
1119c51
ZeyuTeng96 and others added 29 commits November 10, 2023 10:19
@ZeyuTeng96
add chatglm3 conv template support in conversation.py (lm-sys#2622)
e46d97a
@infwinston @merrymercy
UI and model change (lm-sys#2672)
e0b351a 
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
@Force1ess
train_flant5: fix typo (lm-sys#2673)
1901125
@infwinston
Fix gpt template (lm-sys#2674)
a19866b
@merrymercy
Update README.md (lm-sys#2679)
a333a55
@congchan
feat: support template's stop_str as list (lm-sys#2678)
aeec0e0
@jm23jeffmorgan
Update exllama_v2.md (lm-sys#2680)
9cfeb15
@MrZhengXin
save model under deepspeed (lm-sys#2689)
a1324de
@lnguyen
Adding SSL support for model workers and huggingface worker (lm-sys#2687
fdf7b2c 
)
@zeyugao
Check the max_new_tokens <= 0 in openai api server (lm-sys#2688)
e53c73f
@BabyChouSr
Add Microsoft/Orca-2-7b and update model support docs (lm-sys#2714)
8bd422b
@wangshuai09
fix tokenizer of chatglm2 (lm-sys#2711)
849a815
@AmaleshV
Template for using Deepseek code models (lm-sys#2705)
af8d877
@zollty
add support for Chinese-LLaMA-Alpaca (lm-sys#2700)
85c797e
@xuguodong1999
Make --load-8bit flag work with weights in safetensors format (lm-sys…
99d19ac 
…#2698)
@merrymercy
Format code and minor bug fix (lm-sys#2716)
0bbeddc
@merrymercy
Bump version to v0.2.33 (lm-sys#2717)
0a5ad3e
@wangshuai09
fix tokenizer.pad_token attribute error (lm-sys#2710)
3389cc3
@hi-jin
support stable-vicuna model (lm-sys#2696)
ff25295
@mjkaye
Exllama cache 8bit (lm-sys#2719)
6ac7d76
@infwinston
Add Yi support (lm-sys#2723)
1f21efb
@152334H
Add Hermes 2.5 [fixed] (lm-sys#2725)
a754c48
@lewtun
Fix Hermes2Adapter (lm-sys#2727)
c199c8d
@Jingsong-Yan
Fix YiAdapter (lm-sys#2730)
cfba5f4
@wangshuai09
add trust_remote_code argument (lm-sys#2715)
96aed4c
@lewtun
Add revision arg to MT Bench answer generation (lm-sys#2728)
3352306
@suquark
Fix MPS backend 'index out of range' error (lm-sys#2737)
76fbdef
@infwinston
add starling support (lm-sys#2738)
686ab04
@renning22
Merge remote-tracking branch 'upstream/main' into merge_1126
a7ed47f
@renning22 renning22 merged commit 94421ea into main Nov 27, 2023
0 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone