Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sym false lm head #1

Merged
merged 69 commits into from
Jun 15, 2024
Merged

Sym false lm head #1

merged 69 commits into from
Jun 15, 2024

Conversation

Qubitium
Copy link
Owner

  1. sym-false
  2. lm-head
  3. glm support

qwopqwop200 and others added 30 commits February 21, 2024 21:53
@qwopqwop200
remove (zeors -= 1)
b33e1d0
@qwopqwop200
add warning
6419a2d
@qwopqwop200
support backwards compatibility
5ea98bb
@qwopqwop200
support and fix bug
0b07292
@qwopqwop200
remove not necessary parm
b015ae9
@qwopqwop200
fix test_q4 bug
b7d9ade
@qwopqwop200
fix test_q4 bug
83e510e
@qwopqwop200
fix bug double converting
a89cb77
@qwopqwop200
Update _utils.py
639e66a
@qwopqwop200
Merge branch 'main' into main
15ecb0f
@Qubitium
merge main #1
0759aea
@LRL-ModelCloud
FIX type error
101647d
@LRL-ModelCloud
module is nn.Module
28a2541
@Qubitium
sync name
3899d5b
@LRL-ModelCloud
need return module
9f25c21
@LRL-ModelCloud
modify default format to gptq_v2
4159474
@LRL-ModelCloud
fix need return model
c853143
@Qubitium
remove fixme and default to gptq_v2 for quantize_config
047dd97
@Qubitium
save _qlinear_kernel and allow save to older format
869a162
@Qubitium
fix name
365d961
@Qubitium
pass quantize
e363d85
@Qubitium
Merge remote-tracking branch 'origin/main' into sym-false
6af41db
@Qubitium
update
bd12bde
@Qubitium
store quant log/stats in dict slice and return to user in quantize()
cd916fe
@Qubitium
accept saved quant_log in quantize() and calculate diff
d35e57d
@Qubitium
tqdm the layer loop
b0d2ad5
@Qubitium
log awq vs autogptq outputs in awq compat test
45cbc6b
@Qubitium
fix cached models is not compatible with new pr. add v2 to cache file…
23b4b65 
… name
@Qubitium
add deprecation warning for loading .bin/.pt weights
dc5d3dd
@Qubitium
add missing termcolor req
fec3f1c
Qubitium and others added 28 commits April 16, 2024 07:54
@Qubitium
layer # sync with visual tqdm
7b89b89
@Qubitium
use thread limit 1: as good as 4 and 1 beats 16 threads in testing
ed0fe60
@Qubitium
fix saving of gptq (v1)
37ed02e
@Qubitium
deep copy
5d66558
@Qubitium
remove todo: verified
9d88639
@Qubitium
TEST/DEBUG underflow protection and output underflow stats
0b84da7 
fix underflow cond reversed
@Qubitium
force underflow math (testing shows this is better than skipping math)
9e3fea0
@Qubitium
1) disable serialization of sym=False to v1 by default. 2) disable lo…
005a942 
…ading of v1 sym=False by default.
@Qubitium
revert adding underflow check/stats
365618d
@Qubitium
pass test_quant and test both v1 and v2 save/load
31d4027
@Qubitium
performance fix for convert_v1/v2().
ac63033
@Qubitium
need to ++ version so can delimit models make pre/post pr
e8eabe2
@Qubitium
add meta and meta.quantizer to quantized_config.json
e4936f5
@Qubitium
fix json save and add meta check to test_quantization. distutils is d…
c822d63 
…eprecated by python. add packaging. depend
@Qubitium
fix failed test
35cc701
@Qubitium
fix awq unpack/repacking thread regression
cddbe23
@Qubitium
remove highly flaky mistral tiny test with input/output that is nonse…
811ca39 
…nsical
@Qubitium
now we can detect quant producer, we don't need use_unsafe_math for l…
2104cae 
…oading
@Qubitium
updat tests
bc2bf5b
@Qubitium
default to gptq v1 for max compat and remove use_unsafe_math check in…
528a8fc 
… save_quantized
@Qubitium
misc
464fc7e
@Qubitium
separate the concept of meta.quantizer and meta.packer (intel/auto-ro…
59be4b3 
…und as example)
@Qubitium
clean
79050ea
@Qubitium
test allow loading quantized lm_head
4450702
@Qubitium
rename
d85f3f2
@Qubitium
fix quantized lm_head loading
55336b5
@Qubitium
sync with main
d086437
@LRL-ModelCloud
ADD GLM model support
fe191f5
@Qubitium Qubitium merged commit 847b27e into main Jun 15, 2024
@Qubitium Qubitium deleted the sym-false-lm-head branch June 17, 2024 02:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
4 participants
@Qubitium @qwopqwop200 @LRL-ModelCloud @fxmarty