v0.4

What's Changed

• Make entrypoint executable by @city-unit in #83
• Correct Conda Env Creation in Dockerfile by @city-unit in #82
• feat: prompt logprobs and batched samplers by @AlpinDale in #77
• feat: add mistral support for GPTQ by @AlpinDale in #86
• feat: finish up tests and workflows by @AlpinDale in #87
• feat: flattened 1D tensor -> 2D tensor by @AlpinDale in #85
• chore: reformats by @AlpinDale in #90
• fix: pylint complaints by @AlpinDale in #91
• fix: remove unnecessary lines by @g4rg in #81
• fix: sync CPU delay in sampler by @AlpinDale in #93
• New Mirostatv2 implementation by @50h100a in #96
• feat: spaces between special tokens by @AlpinDale in #94
• chore: clean up endpoints by @AlpinDale in #98
• feat: add exllamav2 for GPTQ by @AlpinDale in #99
• fix: force v2 for ctxlen larger than 8192 by @AlpinDale in #100

New Contributors

• @city-unit made their first contribution in #83

Full Changelog: v0.3.7...v0.4