Skip to content

[GenAI] Add Mistral 7B Instruction V0.3#7231

Merged
LittleLittleCloud merged 19 commits intodotnet:mainfrom
LittleLittleCloud:u/mistral
Sep 26, 2024
Merged

[GenAI] Add Mistral 7B Instruction V0.3#7231
LittleLittleCloud merged 19 commits intodotnet:mainfrom
LittleLittleCloud:u/mistral

Conversation

@LittleLittleCloud
Copy link
Copy Markdown
Member

@LittleLittleCloud LittleLittleCloud commented Sep 3, 2024

We are excited to review your PR.

So we can do the best job, please check:

  • There's a descriptive title that will make sense to other developers some time from now.
  • There's associated issues. All PR's should have issue(s) associated - unless a trivial self-evident change such as fixing a typo. You can use the format Fixes #nnnn in your description to cause GitHub to automatically close the issue(s) when your PR is merged.
  • Your change description explains what the change does, why you chose your approach, and anything else that reviewers should know.
  • You have included any necessary tests in the same PR.

#7169

await agent.SendAsync(task);
}

public static void Embedding()
Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@luisquintanilla This will be how bge-en-icl embedding model consumed.

@codecov
Copy link
Copy Markdown

codecov Bot commented Sep 6, 2024

Codecov Report

Attention: Patch coverage is 47.61905% with 363 lines in your changes missing coverage. Please review.

Project coverage is 68.78%. Comparing base (87a41fa) to head (7eb9f58).
Report is 2 commits behind head on main.

Files with missing lines Patch % Lines
...Microsoft.ML.GenAI.Mistral/MistralCausalLMAgent.cs 0.00% 98 Missing ⚠️
src/Microsoft.ML.GenAI.Mistral/MistralModel.cs 18.75% 76 Missing and 2 partials ⚠️
.../Microsoft.ML.GenAI.Mistral/MistralDecoderLayer.cs 28.57% 65 Missing ⚠️
...c/Microsoft.ML.GenAI.Mistral/MistralForCausalLM.cs 12.30% 57 Missing ⚠️
...GenAI.Mistral/Mistral_7B_0_3ChatTemplateBuilder.cs 76.19% 15 Missing and 15 partials ⚠️
...crosoft.ML.GenAI.Core/Pipeline/CausalLMPipeline.cs 0.00% 14 Missing ⚠️
...crosoft.ML.GenAI.Mistral/MistralTokenizerHelper.cs 80.00% 6 Missing and 1 partial ⚠️
src/Microsoft.ML.GenAI.Mistral/MistralMLP.cs 64.70% 6 Missing ⚠️
...nAI.Mistral.Tests/Mistral_7B_Instruct_V0_3Tests.cs 95.45% 3 Missing and 1 partial ⚠️
src/Microsoft.ML.GenAI.Core/Utils.cs 66.66% 2 Missing and 1 partial ⚠️
... and 1 more
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #7231      +/-   ##
==========================================
- Coverage   68.83%   68.78%   -0.05%     
==========================================
  Files        1453     1461       +8     
  Lines      271562   272208     +646     
  Branches    28094    28168      +74     
==========================================
+ Hits       186933   187250     +317     
- Misses      77410    77718     +308     
- Partials     7219     7240      +21     
Flag Coverage Δ
Debug 68.78% <47.61%> (-0.05%) ⬇️
production 63.29% <40.66%> (-0.06%) ⬇️
test 89.04% <95.45%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines Coverage Δ
...soft.ML.GenAI.LLaMA/Llama3_1ChatTemplateBuilder.cs 68.62% <ø> (ø)
src/Microsoft.ML.GenAI.LLaMA/LlamaCausalLMAgent.cs 0.00% <ø> (ø)
src/Microsoft.ML.GenAI.LLaMA/Module/LlamaModel.cs 18.75% <ø> (ø)
src/Microsoft.ML.GenAI.Phi/Phi2/Config.cs 98.00% <100.00%> (ø)
src/Microsoft.ML.GenAI.Phi/Phi3/Config.cs 93.84% <100.00%> (ø)
...c/Microsoft.ML.GenAI.Phi/Phi3/Phi3CausalLMAgent.cs 56.71% <ø> (ø)
src/Microsoft.ML.GenAI.Phi/Utils.cs 0.00% <ø> (-8.11%) ⬇️
src/Microsoft.ML.GenAI.Mistral/MistralConfig.cs 97.95% <97.95%> (ø)
src/Microsoft.ML.GenAI.Core/Utils.cs 12.94% <66.66%> (+6.36%) ⬆️
...nAI.Mistral.Tests/Mistral_7B_Instruct_V0_3Tests.cs 95.45% <95.45%> (ø)
... and 8 more

... and 9 files with indirect coverage changes

Comment thread docs/samples/Microsoft.ML.GenAI.Samples/Mistral/Mistral_7B_Instruct.cs Outdated
@LittleLittleCloud LittleLittleCloud merged commit 817a77f into dotnet:main Sep 26, 2024
@github-actions github-actions Bot locked and limited conversation to collaborators Oct 26, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants