Feature Request & Feedback: Enhancing User Experience via Dedicated Hosting for Open-Source Models

[GulajavaMinistudio]

🏷️ Discussion Type

Product Feedback

💬 Feature/Topic Area

Copilot in GitHub

Body

Feature Request & Feedback: Enhancing User Experience via Dedicated Hosting for Open-Source Models

Dear GitHub Copilot Team,

I hope this message finds you well. First of all, I would like to express my appreciation for the continuous innovation and support that GitHub Copilot brings to the developer community. It has truly transformed our daily workflows.

However, I would like to share some feedback regarding a recent shift in user experience. Since June 1st, the tool has felt somewhat less seamless to use. This is primarily due to the current token limitations imposed by the transition to usage-based billing, as well as the discontinuation of the "premium request" framework.

To mitigate these limitations and provide a more flexible environment for developers, I would like to propose a feature suggestion:

The Proposal: Native, Microsoft-Hosted Open-Source Models
Would it be possible for GitHub Copilot to offer built-in open-source models that are hosted directly on Microsoft’s own server infrastructure?

We have seen successful implementations of this approach across the industry. For instance, CLI agent services like OpenCode Go plan and CommandCode Go plan, as well as Composer 2.5 in Cursor, leverage models hosted on their respective infrastructures. This setup grants users the freedom to code without constant friction, as open-source models often provide a highly efficient balance between performance and cost-per-million-tokens.

Why This Matters
While it is excellent that GitHub Copilot currently supports integrations with external providers like OpenRouter and Ollama, relying on third-party API keys or local machine resources adds layers of configuration and overhead for the end user.

Integrating these open-source models natively as built-in options within the Copilot agent selection menu would offer several key benefits:

Seamless Onboarding: Users can leverage cost-effective models instantly without leaving the ecosystem or configuring external APIs.

Cost Efficiency: Utilizing optimized, hosted open-source models could allow for higher token limits or more relaxed usage caps under the new billing system.

Enhanced Choice: Developers could easily switch between heavy-duty proprietary models and lightweight, fast open-source models depending on the task at hand.

I believe that providing native access to first-party hosted open-source models would significantly alleviate the current constraints and greatly improve user satisfaction.

Thank you for your time, consideration, and dedication to making GitHub Copilot the best developer tool on the market. I look forward to seeing how the platform continues to evolve.

Warm regards,

Gulajava Ministudio Team

[github-actions[bot]]

💬 Your Product Feedback Has Been Submitted 🎉

Thank you for taking the time to share your insights with us! Your feedback is invaluable as we build a better GitHub experience for all our users.

Here's what you can expect moving forward ⏩

• Your input will be carefully reviewed and cataloged by members of our product teams. 
  • Due to the high volume of submissions, we may not always be able to provide individual responses.
  • Rest assured, your feedback will help chart our course for product improvements.
• Other users may engage with your post, sharing their own perspectives or experiences. 
• GitHub staff may reach out for further clarification or insight. 
  • We may 'Answer' your discussion if there is a current solution, workaround, or roadmap/changelog post related to the feedback.

Where to look to see what's shipping 👀

• Read the Changelog for real-time updates on the latest GitHub features, enhancements, and calls for feedback.
• Explore our Product Roadmap, which details upcoming major releases and initiatives.

What you can do in the meantime 💻

• Upvote and comment on other user feedback Discussions that resonate with you.
• Add more information at any point! Useful details include: use cases, relevant labels, desired outcomes, and any accompanying screenshots.

As a member of the GitHub community, your participation is essential. While we can't promise that every suggestion will be implemented, we want to emphasize that your feedback is instrumental in guiding our decisions and priorities.

Thank you once again for your contribution to making GitHub even better! We're grateful for your ongoing support and collaboration in shaping the future of our platform. ⭐