Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Genai integration #2522

Merged
merged 67 commits into from
Feb 2, 2024
Merged

Genai integration #2522

merged 67 commits into from
Feb 2, 2024

Conversation

kartik727
Copy link
Contributor

Adding support for the generative text task type

kartik727 and others added 30 commits October 15, 2023 18:53
@kartik727
Added info about required packages
2899dea
@kartik727
Update responsibleaidashboard-question-answering-model-debugging.ipynb
80b0c34
@kartik727
show example prediction
af00993
@kartik727
Update responsibleaidashboard-question-answering-model-debugging.ipynb
6c19f0f
@kartik727
Merge branch 'main' into main
6278234
@kartik727
Merge branch 'microsoft:main' into main
88fe881
@kartik727
Merge branch 'microsoft:main' into main
b9fae62
@kartik727
Merge branch 'main' of https://github.com/kartik727/responsible-ai-to…
85b6a70 
…olbox
@kartik727
Merge branch 'microsoft:main' into kartikch/add-genai-metrics
42cbcbe
@kartik727
add genai metrics
6db3b1b 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
Add genai task type
0b1c571 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
add genai task type (#2494)
727b708 
* Added info about required packages

* Update responsibleaidashboard-question-answering-model-debugging.ipynb

* show example prediction

* Update responsibleaidashboard-question-answering-model-debugging.ipynb

* add genai metrics

Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>

* Add genai task type

Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>

---------

Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
Merge branch 'genai-integration' of https://github.com/microsoft/resp…
e866f46 
…onsible-ai-toolbox into kartikch/add-genai-metrics
@kartik727
remove target_column requirement for genai tasks
ef3f354 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
genai dev demo notebook
0cb3b4d 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727 @imatiach-msft
Added info about required packages
f459346
@kartik727 @imatiach-msft
Update responsibleaidashboard-question-answering-model-debugging.ipynb
db46fa9
@kartik727 @imatiach-msft
add genai metrics
6f14f90 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727 @imatiach-msft
Add genai task type
99cc0fe 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727 @imatiach-msft
remove target_column requirement for genai tasks (#2501)
33dc0f6 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727 @imatiach-msft
add demo notebook (#2502)
1694830 
* remove target_column requirement for genai tasks

Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>

* genai dev demo notebook

Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>

---------

Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
Merge branch 'microsoft:main' into kartikch/add-genai-metrics
a62ab03
@mohsinposts
added generative text explainer for OpenAI models
1769539 
Signed-off-by: Mohsin Shah <websitemohsinshah@gmail.com>
@imatiach-msft
update UI to support genai task for RAI text dashboard (#2504)
a5e49aa
@kartik727
Merge branch 'kartikch/add-genai-metrics' into genai-integration
1450e0f
@kartik727
Merge pull request #1 from microsoft/genai-integration
98a44ac 
Genai integration
@mohsinposts
generative ai explanations for all rows of dataset
f3d326f 
Signed-off-by: Mohsin Shah <websitemohsinshah@gmail.com>
@mohsinposts
Merge branch 'microsoft:main' into genai-integration-progress
1ef65b8
@kartik727
move metrics to utils submodule
65ce749 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
error analysis support for genai text
535f719 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@codecov-commenter
Copy link

codecov-commenter commented Jan 31, 2024 •
edited
Loading

Codecov Report

Attention: 2 lines in your changes are missing coverage. Please review.

Comparison is base (c8ff9a2) 87.86% compared to head (b7d8611) 92.30%.

Files Patch % Lines
...i/responsibleai/managers/error_analysis_manager.py 60.00% 2 Missing ⚠️
Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #2522      +/-   ##
==========================================
+ Coverage   87.86%   92.30%   +4.43%     
==========================================
  Files         144      108      -36     
  Lines        8028     5433    -2595     
==========================================
- Hits         7054     5015    -2039     
+ Misses        974      418     -556
Flag Coverage Δ
unittests 92.30% <60.00%> (+4.43%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@kartik727
Merge branch 'main' of https://github.com/microsoft/responsible-ai-to…
d21d496 
…olbox
@kartik727
Merge branch 'main' into genai-integration
86c9323
@kartik727
merge new changes
4508445 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
fix merge errors
c67144a 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727 kartik727 closed this Feb 1, 2024
@kartik727 kartik727 reopened this Feb 1, 2024
@kartik727
add methods and constants for genai task type
90b05cc 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
add missing files for genai metrics
31dfdc6 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
update copyright information
874857a 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
merge main
7bb79c7 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
Fix target_column assignment in ErrorAnalysisManager
a5c4c72 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
Remove duplicate import and refactor if condition in RAITextInsights …
307d7c9 
…class

Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
Refactor rating examples in genai_metrics scripts
2f6aefa 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
Refactor debug_ml method to handle missing text_cols attribute
cf2ac91 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
Merge branch 'main' into genai-integration
7bc46d0
@kartik727
Remove unnecessary code for generative text models
bae760e 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@kartik727
Merge branch 'genai-integration' of https://github.com/microsoft/resp…
3a13d6d 
…onsible-ai-toolbox into genai-integration
@kartik727
Rearranged import statements in _compute.py
b7d8611 
Signed-off-by: Kartik Choudhary <kartikchoudh@umass.edu>
@imatiach-msft imatiach-msft merged commit 5eed28f into main Feb 2, 2024
144 of 146 checks passed
@imatiach-msft imatiach-msft deleted the genai-integration branch February 2, 2024 19:39
@jamesbchao jamesbchao mentioned this pull request Feb 8, 2024
Merged
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@imatiach-msft imatiach-msft imatiach-msft approved these changes

@tongyu-microsoft tongyu-microsoft Awaiting requested review from tongyu-microsoft tongyu-microsoft is a code owner

@xuke444 xuke444 Awaiting requested review from xuke444 xuke444 is a code owner

@RubyZ10 RubyZ10 Awaiting requested review from RubyZ10 RubyZ10 is a code owner

@vinuthakaranth vinuthakaranth Awaiting requested review from vinuthakaranth vinuthakaranth is a code owner

@gaugup gaugup Awaiting requested review from gaugup gaugup is a code owner

@kicha0 kicha0 Awaiting requested review from kicha0 kicha0 is a code owner

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
4 participants
@kartik727 @codecov-commenter @imatiach-msft @mohsinposts