Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release/1.3.0 #457

Merged
merged 194 commits into from
May 25, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
194 commits
Select commit Hold shift + click to select a range
df536f3
common_OCR_mistakes_correction
Prikshit7766 May 15, 2023
705a7c6
common_OCR_mistakes_correction
Prikshit7766 May 15, 2023
615acec
Update replace_to_asian_firstnames.md
RakshitKhajuria May 16, 2023
a9bb9a4
Update replace_to_asian_firstnames.md
RakshitKhajuria May 16, 2023
abf347e
Update replace_to_asian_lastnames.md
RakshitKhajuria May 16, 2023
e536408
Update replace_to_black_firstnames.md
RakshitKhajuria May 16, 2023
5e336aa
Update replace_to_black_lastnames.md
RakshitKhajuria May 16, 2023
4c649e6
Update replace_to_buddhist_names.md
RakshitKhajuria May 16, 2023
8e67518
Update replace_to_christian_names.md
RakshitKhajuria May 16, 2023
db0fa62
Update replace_to_female_pronouns.md
RakshitKhajuria May 16, 2023
f02d818
Update replace_to_high_income_country.md
RakshitKhajuria May 16, 2023
715f1ab
Update replace_to_hindu_names.md
RakshitKhajuria May 16, 2023
9e14e70
Update replace_to_hispanic_firstnames.md
RakshitKhajuria May 16, 2023
1e4ef59
Update replace_to_hispanic_lastnames.md
RakshitKhajuria May 16, 2023
b022b34
Update replace_to_inter_racial_lastnames.md
RakshitKhajuria May 16, 2023
5346c47
Update replace_to_jain_names.md
RakshitKhajuria May 16, 2023
90509cf
Update replace_to_low_income_country.md
RakshitKhajuria May 16, 2023
9e871ff
Update replace_to_lower_middle_income_country.md
RakshitKhajuria May 16, 2023
414a1a2
Update replace_to_male_pronouns.md
RakshitKhajuria May 16, 2023
b722f11
Update replace_to_muslim_names.md
RakshitKhajuria May 16, 2023
841b986
Update replace_to_native_american_lastnames.md
RakshitKhajuria May 16, 2023
09e17c3
Update replace_to_neutral_pronouns.md
RakshitKhajuria May 16, 2023
db610af
Update replace_to_parsi_names.md
RakshitKhajuria May 16, 2023
aea637a
Update replace_to_sikh_names.md
RakshitKhajuria May 16, 2023
f78a5f0
Update replace_to_upper_middle_income_country.md
RakshitKhajuria May 16, 2023
7887c9e
Update replace_to_white_firstnames.md
RakshitKhajuria May 16, 2023
0346f2b
Update replace_to_white_lastnames.md
RakshitKhajuria May 16, 2023
e7ca49a
Update add_context.md
RakshitKhajuria May 16, 2023
0e6bce3
Update add_contraction.md
RakshitKhajuria May 16, 2023
78189f2
Update add_punctuation.md
RakshitKhajuria May 16, 2023
f424c6b
Update add_typo.md
RakshitKhajuria May 16, 2023
bd04070
Update american_to_british.md
RakshitKhajuria May 16, 2023
d34c036
Update american_to_british.md
RakshitKhajuria May 16, 2023
292298b
Update british_to_american.md
RakshitKhajuria May 16, 2023
f822776
Update lowercase.md
RakshitKhajuria May 16, 2023
5583042
Update number_to_word.md
RakshitKhajuria May 16, 2023
2c587ba
Update strip_punctuation.md
RakshitKhajuria May 16, 2023
ada6d52
Update swap_entities.md
RakshitKhajuria May 16, 2023
3b00e63
Update titlecase.md
RakshitKhajuria May 16, 2023
43fd510
Update uppercase.md
RakshitKhajuria May 16, 2023
1c51969
add summarization to supported tasks
ArshaanNazir May 16, 2023
725f7a2
Update replace_to_asian_firstnames.md
RakshitKhajuria May 16, 2023
40837eb
Update replace_to_asian_lastnames.md
RakshitKhajuria May 16, 2023
e3af6cf
Update replace_to_black_firstnames.md
RakshitKhajuria May 16, 2023
a765c3a
Update replace_to_black_lastnames.md
RakshitKhajuria May 16, 2023
96c2f92
Update replace_to_buddhist_names.md
RakshitKhajuria May 16, 2023
7f5ff29
Update replace_to_christian_names.md
RakshitKhajuria May 16, 2023
e1565d2
Update replace_to_female_pronouns.md
RakshitKhajuria May 16, 2023
3c160a4
Update replace_to_high_income_country.md
RakshitKhajuria May 16, 2023
de37ed3
Update replace_to_hindu_names.md
RakshitKhajuria May 16, 2023
eda1617
Update replace_to_hispanic_firstnames.md
RakshitKhajuria May 16, 2023
816a8c9
Update replace_to_hispanic_lastnames.md
RakshitKhajuria May 16, 2023
20d0352
Update replace_to_inter_racial_lastnames.md
RakshitKhajuria May 16, 2023
3cbe2eb
Update replace_to_jain_names.md
RakshitKhajuria May 16, 2023
65cfdfa
Update replace_to_low_income_country.md
RakshitKhajuria May 16, 2023
39215eb
Update replace_to_lower_middle_income_country.md
RakshitKhajuria May 16, 2023
002d807
Update replace_to_male_pronouns.md
RakshitKhajuria May 16, 2023
ab620f7
Update replace_to_muslim_names.md
RakshitKhajuria May 16, 2023
608ea08
Update replace_to_native_american_lastnames.md
RakshitKhajuria May 16, 2023
2fdbb4c
Update replace_to_neutral_pronouns.md
RakshitKhajuria May 16, 2023
11655df
Update replace_to_parsi_names.md
RakshitKhajuria May 16, 2023
d88ee21
Update replace_to_sikh_names.md
RakshitKhajuria May 16, 2023
d0bb8b9
Update replace_to_upper_middle_income_country.md
RakshitKhajuria May 16, 2023
1097c4d
Update replace_to_white_firstnames.md
RakshitKhajuria May 16, 2023
de7577d
Update replace_to_white_lastnames.md
RakshitKhajuria May 16, 2023
56ddeb3
Xsum Dataset available
chakravarthik27 May 16, 2023
f99e2c8
update SummarizationSample
ArshaanNazir May 16, 2023
e398c22
updated test_robustness.py and robustness.py for ocr
Prikshit7766 May 16, 2023
c0079f4
updated test_robustness.py and robustness.py for ocr
Prikshit7766 May 16, 2023
2a738f1
updated test_robustness.py for ocr
Prikshit7766 May 16, 2023
8c42c56
update Summarization sample and add data paths
ArshaanNazir May 16, 2023
49685e9
add dataset_name and category to summarization sample
ArshaanNazir May 16, 2023
86d2465
summarization support in model_handler
ArshaanNazir May 16, 2023
0495d97
update summarization sample
ArshaanNazir May 16, 2023
0378bba
add category and test_type to result
ArshaanNazir May 16, 2023
be3f6c7
transformations field not reqiured in Sum..Sample
chakravarthik27 May 17, 2023
53e06bd
update task checking for QA in robustness
ArshaanNazir May 17, 2023
9877613
update robustness for summarization
ArshaanNazir May 17, 2023
5964257
Merge branch 'issue-385-add-support-for-summarization-with-the-xsum-d…
ArshaanNazir May 17, 2023
6af8615
update bias for summarization
ArshaanNazir May 17, 2023
8e0999d
add support for summarization in representation
ArshaanNazir May 17, 2023
09c07b7
updated test_robustness.py
Prikshit7766 May 17, 2023
e42cb06
updated utils.py
Prikshit7766 May 17, 2023
e2c520c
updated robustness.py
Prikshit7766 May 17, 2023
43fb2aa
updated robustness.py
Prikshit7766 May 17, 2023
0ecd7ea
update datasource
ArshaanNazir May 17, 2023
dab7912
summerzation task working upto run()
chakravarthik27 May 17, 2023
6e0206b
summarization for bias
chakravarthik27 May 17, 2023
b3658cb
add representation support
ArshaanNazir May 17, 2023
fba23a7
Merge branch 'issue-385-add-support-for-summarization-with-the-xsum-d…
ArshaanNazir May 17, 2023
93d38d1
update representation
ArshaanNazir May 17, 2023
5bf67ac
update num_to_word to support QA and summarization
ArshaanNazir May 18, 2023
71784e4
fix accuracy bug
alytarik May 18, 2023
ab45c32
only run gender classifier once
alytarik May 18, 2023
0579d0e
fix bug when there were no samples of a gender
alytarik May 18, 2023
6741e39
remove debugging code
alytarik May 18, 2023
2df8806
fix linting
alytarik May 18, 2023
648281b
Merge pull request #429 from JohnSnowLabs/Docs/Add-disclaimer-for-QAEval
ArshaanNazir May 18, 2023
e9d26be
add_ocr_typo
Prikshit7766 May 18, 2023
438a02d
summerization was now perfect
chakravarthik27 May 18, 2023
d8fae2f
updated Robustness_DEMO.ipynb
Prikshit7766 May 18, 2023
1db3a28
cleaned OpenAI_QA_Testing_Notebook
RakshitKhajuria May 18, 2023
e276be9
cleaned Azure_OpenAI_QA_Testing_Notebook
RakshitKhajuria May 18, 2023
2d3fa96
cleaned AI21_QA_Testing_Notebook
Prikshit7766 May 18, 2023
280eb0a
cleaned Notebook
Prikshit7766 May 18, 2023
f7e9c93
update representation method for country dict
ArshaanNazir May 19, 2023
8f13e48
refactor representation code
ArshaanNazir May 19, 2023
73cc83f
remove unnecessary code
ArshaanNazir May 19, 2023
825c20c
add_ocr_typo
Prikshit7766 May 19, 2023
6303b76
cleaned open_ai notebooks
RakshitKhajuria May 19, 2023
0f6bedb
cleaned notebooks
Prikshit7766 May 19, 2023
8031c78
add qa support
alytarik May 19, 2023
6c760ad
Merge pull request #428 from Prikshit7766/fix-ocr-mistake
luca-martial May 19, 2023
73c879c
fixed: task attribute error
chakravarthik27 May 19, 2023
5762ff7
update robustness and bias
ArshaanNazir May 19, 2023
ea902a7
update bias
ArshaanNazir May 19, 2023
db28c90
Merge branch 'issue-385-add-support-for-summarization-with-the-xsum-d…
ArshaanNazir May 19, 2023
2f45928
update bias for ner task
chakravarthik27 May 19, 2023
e625f6d
final update
ArshaanNazir May 19, 2023
90a082e
update bias and robustness for text-classification
chakravarthik27 May 19, 2023
b4b98c1
minor fix
ArshaanNazir May 19, 2023
c5257d7
Merge pull request #431 from JohnSnowLabs/cleaned-notebooks
ArshaanNazir May 19, 2023
0c35cc1
correct the data path
ArshaanNazir May 19, 2023
47c4415
correct name
ArshaanNazir May 19, 2023
94a9e71
fix issues in robustness
ArshaanNazir May 19, 2023
bb54374
add Xsum to package_data
ArshaanNazir May 19, 2023
4c2373d
fix issues in bias
ArshaanNazir May 19, 2023
cf2c0e1
Merge pull request #433 from JohnSnowLabs/issue-385-add-support-for-s…
ArshaanNazir May 19, 2023
065c604
add_ocr_typo_for_QA_and_Summarization
Prikshit7766 May 19, 2023
bb68ad4
minor fixes
ArshaanNazir May 22, 2023
a00fc81
Merge pull request #430 from JohnSnowLabs/feature/fairness-for-qa-task
ArshaanNazir May 22, 2023
3e58e26
fix span start
alytarik May 22, 2023
b1f55ac
Merge pull request #436 from JohnSnowLabs/feature/ocr_typo_test_for_Q…
ArshaanNazir May 22, 2023
5b833fe
Updated def is_pass to take custom prompt in QAEval
RakshitKhajuria May 22, 2023
44b1291
Updated Qaeval prompt template
RakshitKhajuria May 22, 2023
210cbfc
add curated bias data for summarization
ArshaanNazir May 23, 2023
81f2f46
update load_curated_bias method
ArshaanNazir May 23, 2023
cb7f262
Merge pull request #444 from JohnSnowLabs/fix/Review-issues-with-QAEv…
ArshaanNazir May 23, 2023
15d79c4
update spacy version
ArshaanNazir May 23, 2023
63a4b33
update version of dependencies
ArshaanNazir May 23, 2023
b8e74c5
doc's updated
Prikshit7766 May 23, 2023
162751f
files updated
Prikshit7766 May 23, 2023
fdadfd8
format columns and fix column order
alytarik May 23, 2023
59d1203
suuport for summarization-accuracy
alytarik May 23, 2023
448ffc0
suuport for summarization-accuracy
alytarik May 23, 2023
e588923
suuport for summarization-fairness
alytarik May 23, 2023
5d4b051
suuport for summarization-accuracy
alytarik May 23, 2023
732eb06
update requirements.txt
ArshaanNazir May 23, 2023
e17c1bf
update requirements.txt
ArshaanNazir May 23, 2023
b48560d
config.md and data.md updated
Prikshit7766 May 23, 2023
d6da494
bug-fix: config
chakravarthik27 May 23, 2023
3c6fd0f
updated requirements.txt
chakravarthik27 May 23, 2023
4c0cdf2
Merge pull request #445 from JohnSnowLabs/feature/update-bias-in-summ…
ArshaanNazir May 23, 2023
a1d56cc
Merge pull request #446 from JohnSnowLabs/feature/accuracy-fairness-f…
ArshaanNazir May 23, 2023
72d966f
update requirements.txt
ArshaanNazir May 23, 2023
2087a7c
Merge branch 'release/1.3.0' into issue-385-add-support-for-summariza…
ArshaanNazir May 23, 2023
b3922a2
Merge pull request #447 from JohnSnowLabs/issue-385-add-support-for-s…
ArshaanNazir May 23, 2023
ba9d504
test.md updated
Prikshit7766 May 23, 2023
740e940
Merge branch 'release/1.3.0' into Update/docs-for-summarization
Prikshit7766 May 23, 2023
e73d904
updated test.md
Prikshit7766 May 23, 2023
ce59377
updated test.md
Prikshit7766 May 23, 2023
2945d2d
Merge pull request #448 from JohnSnowLabs/Update/docs-for-summarization
ArshaanNazir May 23, 2023
9178d89
hot-fix/XSum-test
Prikshit7766 May 24, 2023
97bd637
fix format for qa task
alytarik May 24, 2023
3b4e68b
Merge pull request #450 from JohnSnowLabs/fix/remove-test-case-column…
ArshaanNazir May 24, 2023
eff51e9
Merge pull request #449 from JohnSnowLabs/fix/XSum-test
ArshaanNazir May 24, 2023
287daa9
fix fairness for llm models
alytarik May 24, 2023
b888123
update summarization prompt
ArshaanNazir May 24, 2023
cb4a226
fix typos
alytarik May 24, 2023
8c08b87
fix column order in generated results
alytarik May 24, 2023
8b57382
fix .testcases() column order
alytarik May 24, 2023
8c895dc
Merge pull request #451 from JohnSnowLabs/fix/summarization_prompt
ArshaanNazir May 24, 2023
28e8bd1
fix hf min_score bug
alytarik May 24, 2023
14fcefd
update supported task
ArshaanNazir May 24, 2023
16da2b3
add llm notebooks to tutorials on website
ArshaanNazir May 24, 2023
09d3e08
update tutorial page
ArshaanNazir May 24, 2023
3c8a257
Merge pull request #453 from JohnSnowLabs/fix/tutorial_nbs
ArshaanNazir May 24, 2023
3a44360
Merge branch 'release/1.3.0' into fix/max-f1-score
alytarik May 24, 2023
8179e20
update REQUIRED_PKGS
ArshaanNazir May 24, 2023
9babb9f
add test pages and update tests table
alytarik May 24, 2023
06443c9
fix supported test in website
alytarik May 24, 2023
0419af2
Merge pull request #452 from JohnSnowLabs/fix/max-f1-score
ArshaanNazir May 24, 2023
b4c5fd5
update tutorial nbs with supported fairness tests
ArshaanNazir May 24, 2023
2799afb
Merge branch 'release/1.3.0' into fix/tutorial_nbs
ArshaanNazir May 24, 2023
2d1dce5
Merge pull request #454 from JohnSnowLabs/fix/tutorial_nbs
ArshaanNazir May 24, 2023
7c5bcdc
fix eval score
alytarik May 24, 2023
610c20a
fix boolq-test dataset
alytarik May 24, 2023
0130f2b
add info to data
alytarik May 24, 2023
f0daa55
fix boolq test
alytarik May 24, 2023
851c659
Merge pull request #455 from JohnSnowLabs/fix/testcase-format
ArshaanNazir May 24, 2023
fef5744
update QA is_pass
ArshaanNazir May 24, 2023
c65b904
Merge pull request #456 from JohnSnowLabs/fix/QA_evaluations
ArshaanNazir May 24, 2023
f7eb00e
updated setup and meta.yaml
ArshaanNazir May 25, 2023
4b04759
Merge branch 'main' into release/1.3.0
ArshaanNazir May 25, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 5 additions & 2 deletions conda/meta.yaml
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
{% set name = "nlptest" %}
{% set version = "1.2.0" %}
{% set version = "1.3.0" %}

package:
name: {{ name|lower }}
version: {{ version }}

source:
url: https://pypi.io/packages/source/{{ name[0] }}/{{ name }}/nlptest-{{ version }}.tar.gz
sha256: 0c8f3e5a8ea8b2333e7b4f740219bdcc275daf02cae45ce7342c7b9b63a8e049
sha256: d4cfdc0b4c55c351b8bf752dc9ec2c6aaf09fd6ea1c58adee6f4931a54e0ca26

build:
number: 0
Expand All @@ -34,6 +34,9 @@ requirements:
- evaluate
- inflect
- rouge-score
- typing-extensions <4.6.0
- sympy
- pillow

test:
imports:
Expand Down
Loading