Repository navigation
PLI 4.1.1
Pre-release
Pre-release
- Name of A1's map. 4.1.0 named the file to download
qwen38_27b.pt; the file of LSA's release
d-lsa-weights-v1isqwen38_27b__long-16k-1M-heavy-key-and-query-d2048.pt(SHA-25624cee934f969756db228a8df7f2bc7613979b63ac3b1d5ac3d9aa42e4339bb9b). README,
docs/switches.mdandtools/convert_lsa_map.pygive that name and the download command. tools/convert_lsa_map.pychecked: run on that file (torch 2.13.0, NumPy 2.4.6), it writes the 32 arrays (16
layers,W_Q_idxandW_K_idx, [768, 64] float32) equal to the map served in production since 4.1.0's A1.
No code change.