Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Language model access API #206265

Open
jrieken opened this issue Feb 26, 2024 · 2 comments
Open

Language model access API #206265

jrieken opened this issue Feb 26, 2024 · 2 comments
Assignees
@jrieken @lramos15
Labels
api-finalization feature-request Request for new features or functionality lm-access
Milestone
May 2024

Comments

@jrieken
Copy link
Member

jrieken commented Feb 26, 2024

This issue is about allowing extensions to use language model that are contributed by other extensions. The API proposal is https://github.com/microsoft/vscode/blob/main/src/vscode-dts/vscode.proposed.languageModels.d.ts and its scope is to allow to use the chat feature of language models.
@jrieken jrieken self-assigned this Feb 26, 2024
@jrieken jrieken added api-finalization lm-access feature-request Request for new features or functionality labels Feb 26, 2024
@jrieken jrieken added this to the March 2024 milestone Feb 26, 2024
@isidorn
Copy link
Contributor

isidorn commented Feb 26, 2024

Docs: https://code.visualstudio.com/api/extension-guides/language-model

This was referenced Feb 27, 2024
Merged
Open
@jrieken
Copy link
Member Author

jrieken commented Feb 27, 2024

With #206358 there will be no more language model access object. Instead all requests are made directly via vscode.lm.sendChatRequest(model, messages, options, token)

jrieken added a commit that referenced this issue Feb 27, 2024
@jrieken
add LanguageModelError-type
5144414 
#206265
@jrieken jrieken mentioned this issue Feb 27, 2024
Merged
jrieken added a commit that referenced this issue Feb 27, 2024
@jrieken
add LanguageModelError-type (#206361)
8fd15a8 
#206265
jrieken added a commit that referenced this issue Feb 28, 2024
@jrieken
add ExtensionContent#languageModelAccessInformation
f54a572 
* makes ExtHostAuth and ExtHostLM injectable
* (hack) makes silents auth requests for all extension upon LM registration

#206265
@jrieken jrieken mentioned this issue Feb 28, 2024
Merged
hbons pushed a commit that referenced this issue Feb 28, 2024
@jrieken @hbons
add LanguageModelError-type (#206361)
2b16c8c 
#206265
jrieken added a commit that referenced this issue Feb 28, 2024
@jrieken
add ExtensionContent#languageModelAccessInformation (#206420)
763df0e 
* makes ExtHostAuth and ExtHostLM injectable
* (hack) makes silents auth requests for all extension upon LM registration

#206265
@jrieken jrieken modified the milestones: March 2024, April 2024 Mar 22, 2024
jrieken added a commit that referenced this issue Apr 11, 2024
@jrieken
first version of token counting API
12a0a60 
#206265
@jrieken jrieken mentioned this issue Apr 11, 2024
Merged
jrieken added a commit that referenced this issue Apr 11, 2024
@jrieken
first version of token counting API (#210177)
a808279 
#206265
@jrieken jrieken modified the milestones: April 2024, May 2024 Apr 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jrieken jrieken

@lramos15 lramos15

Labels
api-finalization feature-request Request for new features or functionality lm-access
Projects
None yet
Milestone
May 2024
Development

No branches or pull requests
3 participants
@jrieken @isidorn @lramos15