issues Search Results · repo:VectorInstitute/vector-inference language:Python

Filter by

• • Code... (...)results
  • Issues7 (7)results
  • Pull requests64 (64)results
  • Discussions0 (0)results
  • Commits0 (0)results
  • Packages0 (0)results
  • Wikis0 (0)results

• State

  • Open
  • Closed

• Advanced

  • Owner
  • State
  • Close reason
  • Has linked pull request
  • Author
  • Assignee
  • Mentioned user
  • Mentioned team
  • Commenter
  • Involved user
  • Label
  • Milestone
  • Number of comments
  • Number of interactions
• Advanced search

Issues7 (7)

7 results

 (81 ms)

7 results

inVectorInstitute/vector-inference (press backspace or delete to remove)

Sort by: Best match

Filter

VectorInstitute/vector-inference

New feature requests

New features we d like to support: - [ ] Tool Calling - [ ] Structured Outputs - [ ] Reasoning Outputs - [ ] Automatic Prefix Caching - [ ] Speculative Decoding - [ ] Quantization For any ...

• XkunW
·
• Opened 
  9 days ago
·
• #74

VectorInstitute/vector-inference

Add documentation about breaking changes

Is your feature request related to a problem? Please describe. Add documentation about breaking changes, examples include: - Customized yaml only supported after 0.4.1 - Models and there supported ...

• XkunW
·
• Opened 
  13 days ago
·
• #65

VectorInstitute/vector-inference

Add testing against all supported python versions

Is your feature request related to a problem? Please describe. Add testing against all supported python versions for robustness

• XkunW
·
• Opened 
  13 days ago
·
• #64

VectorInstitute/vector-inference

Bug: Publish workflow still using poetry

Describe the bug Publish workflow still uses poetry for building the package, but we ve migrated to using uv Version - 0.4.1

• XkunW
·
• Opened 
  13 days ago
·
• #63

VectorInstitute/vector-inference

Bug in Qwen2.5-Math-7B-Instruct's config file

Describe the bug There seems to be a bug in Qwen2.5-Math-7B-Instruct s configuration file. Launching Qwen2.5-Math-7B-Instruct fails with the following error: ValueError: User-specified max_model_len ...

bug

• tristancinquin
·
• 2
·
• Opened 
  14 days ago
·
• #61

VectorInstitute/vector-inference

Improvements for maintainability

vector-inference is starting to expand to more models and has onboarded users. I m looking to contribute by helping improve its maintainability. Concretely, I have 4 tasks in mind: - [x] Reduce maintenance ...

• amrit110
·
• 13
·
• Opened 
  on Jan 29
·
• #24

VectorInstitute/vector-inference

Docs stating hard-coded assumptions

Thanks for the resource! The docs make some assumptions about the user s compute environment, but do not warn the user about these assumptions: - venv.sh - module is installed and python/3.10.12 ...

• nick-youngblut
·
• 5
·
• Opened 
  on Jun 19, 2024
·
• #4

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues

ProTip! 

Restrict your search to the title by using the in:title qualifier.

Learn how you can use GitHub Issues to plan and track your work.

Save views for sprints, backlogs, teams, or releases. Rank, sort, and filter issues to suit the occasion. The possibilities are endless.Learn more about GitHub Issues

ProTip! 

Restrict your search to the title by using the in:title qualifier.