Skip to content

Commit

Permalink
Models hub internal to Main (#321)
Browse files Browse the repository at this point in the history 
* 2023-03-29-icd10cm_resolver_pipeline_en (#44)

* Add model 2023-03-29-icd10cm_resolver_pipeline_en

* Add model 2023-03-29-icd10cm_resolver_pipeline_en

---------

Co-authored-by: Ahmetemintek <ahmetemin.tek.66@gmail.com>

* 2023-03-29-oncology_general_pipeline_en (#46)

* Add model 2023-03-29-oncology_general_pipeline_en

* Add model 2023-03-29-oncology_diagnosis_pipeline_en

* Add model 2023-03-29-oncology_biomarker_pipeline_en

* Add model 2023-03-29-icd10_icd9_mapping_en

* Add model 2023-03-29-icd10cm_snomed_mapping_en

* Add model 2023-03-29-icd10cm_umls_mapping_en

* Add model 2023-03-29-icd9_resolver_pipeline_en

* Add model 2023-03-29-icdo_snomed_mapping_en

* Add model 2023-03-29-mesh_umls_mapping_en

* Add model 2023-03-29-rxnorm_ndc_mapping_en

* Add model 2023-03-29-rxnorm_umls_mapping_en

* Add model 2023-03-29-snomed_icd10cm_mapping_en

* Add model 2023-03-29-snomed_icd10cm_mapping_en

* Add model 2023-03-29-snomed_icdo_mapping_en

* Add model 2023-03-29-oncology_therapy_pipeline_en

* Add model 2023-03-29-snomed_umls_mapping_en

---------

Co-authored-by: Cabir40 <cabir4006@gmail.com>

* 2023-03-29-icd10cm_resolver_pipeline_en (#45)

* Add model 2023-03-29-icd10cm_resolver_pipeline_en

* Add model 2023-03-29-umls_drug_resolver_pipeline_en

---------

Co-authored-by: Ahmetemintek <ahmetemin.tek.66@gmail.com>

* Add model 2023-03-30-text_generator_biomedical_biogpt_en (#48)

Co-authored-by: Cabir40 <cabir4006@gmail.com>

* 2023-03-30-summarizer_generic_jsl_en (#49)

* Add model 2023-03-30-summarizer_generic_jsl_en

* Update 2023-03-30-summarizer_generic_jsl_en.md

---------

Co-authored-by: Cabir40 <cabir4006@gmail.com>
Co-authored-by: Cabir C <64752006+Cabir40@users.noreply.github.com>

* Add model 2023-03-30-summarizer_clinical_jsl_augmented_en (#51)

* Update 2023-03-30-summarizer_generic_jsl_en.md

* Update 2023-03-30-text_generator_biomedical_biogpt_en.md

* Update 2023-03-30-summarizer_clinical_jsl_augmented_en.md

* 2023-04-02-ner_jsl_limited_80p_for_benchmarks_en (#58)

* Add model 2023-04-02-ner_jsl_limited_80p_for_benchmarks_en

* Update 2023-04-02-ner_jsl_limited_80p_for_benchmarks_en.md

* Update 2023-04-02-ner_jsl_limited_80p_for_benchmarks_en.md

---------

Co-authored-by: Damla-Gurbaz <dml.grbz.01@gmail.com>
Co-authored-by: Cabir C <64752006+Cabir40@users.noreply.github.com>
Co-authored-by: Veysel Kocaman <vkocaman@gmail.com>

* 2023-03-30-ner_vop_wip_en (#52)

* Add model 2023-03-30-ner_vop_wip_en

* Update 2023-03-30-ner_vop_wip_en.md

---------

Co-authored-by: mauro-nievoff <mauro.nievasoffidani@gmail.com>
Co-authored-by: Cabir C <64752006+Cabir40@users.noreply.github.com>

* 2023-03-30-umls_clinical_findings_resolver_pipeline_en (#47)

* Add model 2023-03-30-umls_clinical_findings_resolver_pipeline_en

* Add model 2023-03-30-cvx_resolver_pipeline_en

* Add model 2023-03-30-umls_disease_syndrome_resolver_pipeline_en

* Add model 2023-03-30-umls_major_concepts_resolver_pipeline_en

* Add model 2023-03-30-umls_drug_substance_resolver_pipeline_en

* Add model 2023-03-31-medication_resolver_pipeline_en

* Add model 2023-03-31-medication_resolver_transform_pipeline_en

* Add model 2023-03-31-spellcheck_clinical_pipeline_en

---------

Co-authored-by: Ahmetemintek <ahmetemin.tek.66@gmail.com>

* Add model 2023-04-03-ner_oncology_limited_80p_for_benchmarks_en (#61)

* 2023-04-03-text_generator_biomedical_biogpt_base_en (#60)

* Delete 2023-03-30-text_generator_biomedical_biogpt_en.md

* Update 2023-04-03-text_generator_generic_flan_base_en.md

* Update 2023-03-30-summarizer_clinical_jsl_augmented_en.md

* Update 2023-03-30-summarizer_generic_jsl_en.md

* Add model 2023-04-04-text_generator_generic_flan_t5_large_en (#64)

* 2023-04-07-embeddings_clinical_medium_en (#75)

* Add model 2023-04-07-embeddings_clinical_medium_en

* Update 2023-04-07-embeddings_clinical_medium_en.md

---------

Co-authored-by: Cabir40 <cabir4006@gmail.com>
Co-authored-by: Cabir C <64752006+Cabir40@users.noreply.github.com>

* Add model 2023-04-07-embeddings_clinical_large_en (#79)

* 2023-04-10-genericclassifier_sdoh_mental_health_embeddings_clinical_en (#81)

* Add model 2023-04-10-genericclassifier_sdoh_mental_health_embeddings_clinical_en

* Add model 2023-04-10-genericclassifier_sdoh_under_treatment_sbiobert_cased_mli_en

* Add model 2023-04-10-genericclassifier_sdoh_housing_insecurity_sbiobert_cased_mli_en

* added missing md files

* Add model 2023-04-10-genericclassifier_sdoh_mental_health_clinical_en

* Delete 2023-04-10-genericclassifier_sdoh_mental_health_embeddings_clinical_en.md

* Update 2023-04-10-genericclassifier_sdoh_under_treatment_sbiobert_cased_mli_en.md

* Update 2023-04-10-genericclassifier_sdoh_mental_health_clinical_en.md

* Update 2023-04-10-genericclassifier_sdoh_housing_insecurity_sbiobert_cased_mli_en.md

* Update 2023-04-10-genericclassifier_sdoh_under_treatment_sbiobert_cased_mli_en.md

* Update 2023-04-10-genericclassifier_sdoh_mental_health_clinical_en.md

---------

Co-authored-by: hsaglamlar <hsaglamlar@gmail.com>
Co-authored-by: Cabir ÇELİK <ogr.cabir.celik@ahievran.edu.tr>
Co-authored-by: Cabir C <64752006+Cabir40@users.noreply.github.com>

* 2023-04-10-medication_resolver_pipeline_en (#83)

* Add model 2023-04-10-medication_resolver_pipeline_en

* Add model 2023-04-11-medication_resolver_transform_pipeline_en

---------

Co-authored-by: SKocer <samedkocer22@gmail.com>

* 2023-04-11-umls_clinical_findings_resolver_pipeline_en (#89)

* Add model 2023-04-11-umls_clinical_findings_resolver_pipeline_en

* Add model 2023-04-11-umls_drug_substance_resolver_pipeline_en

---------

Co-authored-by: Cabir40 <cabir4006@gmail.com>

* 2023-04-12-ner_vop_emb_clinical_large_wip_en (#100)

* Add model 2023-04-12-ner_vop_emb_clinical_large_wip_en

* Add model 2023-04-12-ner_vop_emb_clinical_medium_wip_en

---------

Co-authored-by: mauro-nievoff <mauro.nievasoffidani@gmail.com>

* Add model 2023-04-12-biogpt_chat_jsl_en (#103)

Co-authored-by: Cabir40 <cabir4006@gmail.com>

* 2023-04-12-ner_oncology_emb_clinical_large_en (#101)

* Add model 2023-04-12-ner_oncology_emb_clinical_large_en

* Add model 2023-04-12-ner_oncology_emb_clinical_medium_en

---------

Co-authored-by: Meryem1425 <vildansarikaya25@gmail.com>

* 2023-04-12-ner_posology_emb_clinical_large_en (#99)

* Add model 2023-04-12-ner_posology_emb_clinical_large_en

* Update 2023-04-12-ner_posology_emb_clinical_large_en.md

Fixed the given sample text

* Add model 2023-04-12-ner_posology_emb_clinical_medium_en

* Update 2023-04-12-ner_posology_emb_clinical_medium_en.md

Corrected thr code block view

* Add model 2023-04-12-ner_deid_large_emb_clinical_large_en

* Update 2023-04-12-ner_deid_large_emb_clinical_large_en.md

Corrected the code block view

* Add model 2023-04-12-ner_deid_large_emb_clinical_medium_en

* Update 2023-04-12-ner_deid_large_emb_clinical_medium_en.md

corrected the python code block view

* Update 2023-04-12-ner_posology_emb_clinical_medium_en.md

Fixed scala code

* Update 2023-04-12-ner_posology_emb_clinical_large_en.md

Fixed scala code

---------

Co-authored-by: gokhanturer <mgturer@gmail.com>
Co-authored-by: Gökhan <81560784+gokhanturer@users.noreply.github.com>

* 2023-04-12-ner_jsl_emb_clinical_medium_en (#98)

* Add model 2023-04-12-ner_jsl_emb_clinical_medium_en

* Add model 2023-04-12-ner_jsl_emb_clinical_large_en

---------

Co-authored-by: Damla-Gurbaz <dml.grbz.01@gmail.com>

* 2023-04-12-ner_sdoh_emb_clinical_medium_wip_en (#96)

* Add model 2023-04-12-ner_sdoh_emb_clinical_medium_wip_en

* Add model 2023-04-12-ner_sdoh_emb_clinical_large_wip_en

---------

Co-authored-by: hsaglamlar <hsaglamlar@gmail.com>

* 2023-04-13-ndc_hcpcs_mapper_en (#113)

* Add model 2023-04-13-ndc_hcpcs_mapper_en

* Add model 2023-04-13-hcpcs_ndc_mapper_en

---------

Co-authored-by: Ahmetemintek <ahmetemin.tek.66@gmail.com>

* Add model 2023-04-13-medication_resolver_pipeline_en (#110)

Co-authored-by: Cabir40 <cabir4006@gmail.com>

* Add model 2023-04-17-ner_sdoh_emb_clinical_large_wip_en (#126)

* Add model 2023-04-18-biogpt_chat_jsl_conversational_en (#130)

Co-authored-by: HashamUlHaq <Haashaamulhaq@gmail.com>

* 2023-04-20-explain_clinical_doc_medication_en (#140)

* Add model 2023-04-20-explain_clinical_doc_medication_en

* Add model 2023-04-20-explain_clinical_doc_radiology_en

* Add model 2023-04-20-explain_clinical_doc_ade_en

* Add model 2023-04-20-explain_clinical_doc_era_en

* Add model 2023-04-20-explain_clinical_doc_carp_en

---------

Co-authored-by: Cabir40 <cabir4006@gmail.com>

* 2023-04-23-summarizer_jsl_radiology_en (#145)

* Update 2023-04-23-summarizer_jsl_radiology_en.md

* 2023-04-20-ner_vop_anatomy_wip_en (#139)

* 2023-04-26-ner_profiling_biobert_en (#151)

* 2023-04-27-genericclassifier_sdoh_housing_insecurity_sbiobert_cased_mli_en (#168)

* Update 2023-04-23-summarizer_jsl_radiology_en.md

* 2023-04-27-genericclassifier_sdoh_insurance_status_sbiobert_cased_mli_en (#170)

* Add model 2023-04-27-genericclassifier_sdoh_insurance_status_sbiobert_cased_mli_en

* Add model 2023-04-28-genericclassifier_sdoh_insurance_type_sbiobert_cased_mli_en

* Add model 2023-04-28-genericclassifier_sdoh_insurance_coverage_sbiobert_cased_mli_en

* Update 2023-04-27-genericclassifier_sdoh_insurance_status_sbiobert_cased_mli_en.md

* Update 2023-04-28-genericclassifier_sdoh_insurance_type_sbiobert_cased_mli_en.md

---------

Co-authored-by: hsaglamlar <hsaglamlar@gmail.com>
Co-authored-by: Halil Saglamlar <47859156+hsaglamlar@users.noreply.github.com>

* Add model 2023-05-01-bert_token_classifier_ner_jsl_en (#181)

Co-authored-by: Damla-Gurbaz <dml.grbz.01@gmail.com>

* Add model 2023-04-28-icd10cm_resolver_pipeline_en (#174)

Co-authored-by: Meryem1425 <vildansarikaya25@gmail.com>

* 2023-04-28-ner_profiling_biobert_en (#171)

* Add model 2023-04-28-ner_profiling_biobert_en

* Add model 2023-04-28-ner_profiling_clinical_en

---------

Co-authored-by: Cabir40 <cabir4006@gmail.com>

* Add model 2023-05-02-ner_demographic_extended_en (#187)

Co-authored-by: andrei9825 <andrei@johnsnowlabs.com>

* Add model 2023-05-04-classifier_logreg_ade_en (#194)

Co-authored-by: gpirge <gursev.pirge@gmail.com>

* 2023-05-04-ner_profiling_clinical_en (#196)

* Update 2023-05-04-bert_token_classifier_ner_jsl_en.md

Add benchmark

* fixed typos on 2023-05-04-bert_token_classifier_ner_jsl_en.md

* 2023-05-05-ner_clinical_de (#199)

* 2023-05-04-classifierml_ade_en (#197)

* 2023-05-08-summarizer_clinical_key_facts_en (#201)

* Add model 2023-05-08-summarizer_clinical_key_facts_en

* Update 2023-05-08-summarizer_clinical_key_facts_en.md

changed model name

* Update 2023-05-08-summarizer_clinical_key_facts_en.md

Changed description

---------

Co-authored-by: HashamUlHaq <Haashaamulhaq@gmail.com>
Co-authored-by: Damla Gurbaz <81505007+Damla-Gurbaz@users.noreply.github.com>

* renamed md file

* 2023-05-09-generic_logreg_classifier_ade_en (#202)

* Add model 2023-05-09-generic_logreg_classifier_ade_en

* Update 2023-05-09-generic_logreg_classifier_ade_en.md

corrected the indentations of the Python codes

* Update 2023-05-09-generic_logreg_classifier_ade_en.md

changed the title

* Add model 2023-05-09-generic_svm_classifier_ade_en

---------

Co-authored-by: gpirge <gursev.pirge@gmail.com>
Co-authored-by: gursev.pirge <67619330+gpirge@users.noreply.github.com>

* Add model 2023-05-08-ner_clinical_de (#200)

Co-authored-by: Ahmetemintek <ahmetemin.tek.66@gmail.com>

* Add model 2023-05-11-biogpt_chat_jsl_conditions_en (#204)

Co-authored-by: HashamUlHaq <Haashaamulhaq@gmail.com>

* 2023-05-11-classifier_logreg_ade_en (#209)

* Add model 2023-05-11-classifier_logreg_ade_en

* Add model 2023-05-11-classifierml_ade_en

---------

Co-authored-by: gpirge <gursev.pirge@gmail.com>

* 2023-05-12-ner_abbreviation_emb_clinical_medium_en (#214)

* Add model 2023-05-12-ner_abbreviation_emb_clinical_medium_en

* Add model 2023-05-12-ner_abbreviation_emb_clinical_large_en

* Update 2023-05-12-ner_abbreviation_emb_clinical_medium_en.md

* Update 2023-05-12-ner_abbreviation_emb_clinical_large_en.md

---------

Co-authored-by: Damla-Gurbaz <dml.grbz.01@gmail.com>
Co-authored-by: Damla Gurbaz <81505007+Damla-Gurbaz@users.noreply.github.com>

* 2023-05-11-icd10cm_cause_claim_mapper_en (#210)

* Add model 2023-05-11-icd10cm_cause_claim_mapper_en

* Update 2023-05-11-icd10cm_cause_claim_mapper_en.md

The provided example is updated based on the review. Additional explanation is added for the case where there is no equivalent claim analysis code.

* Update 2023-05-11-icd10cm_cause_claim_mapper_en.md

* Update 2023-05-11-icd10cm_cause_claim_mapper_en.md

* Update 2023-05-11-icd10cm_cause_claim_mapper_en.md

* Update 2023-05-11-icd10cm_cause_claim_mapper_en.md

The output results are changed.

---------

Co-authored-by: SKocer <samedkocer22@gmail.com>
Co-authored-by: Samed K <110497137+SKocer@users.noreply.github.com>
Co-authored-by: muhammetsnts <76607915+muhammetsnts@users.noreply.github.com>

* Add model 2023-05-13-spellcheck_drug_norvig_en (#220)

Co-authored-by: Ahmetemintek <ahmetemin.tek.66@gmail.com>

* Update 2023-05-08-summarizer_clinical_guidelines_large_en.md

* 2023-05-15-ner_anatomy_emb_clinical_medium_en (#225)

* Add model 2023-05-15-ner_anatomy_emb_clinical_medium_en

* Add model 2023-05-15-ner_anatomy_emb_clinical_large_en

* Update 2023-05-15-ner_anatomy_emb_clinical_medium_en.md

* Update 2023-05-15-ner_anatomy_emb_clinical_large_en.md

* Update 2023-05-15-ner_anatomy_emb_clinical_medium_en.md

* Update 2023-05-15-ner_anatomy_emb_clinical_large_en.md

* Update 2023-05-15-ner_anatomy_emb_clinical_medium_en.md

---------

Co-authored-by: gokhanturer <mgturer@gmail.com>
Co-authored-by: Gökhan <81560784+gokhanturer@users.noreply.github.com>

* 2023-05-15-biogpt_pubmed_qa_en (#227)

* Add model 2023-05-15-biogpt_pubmed_qa_en

* Update 2023-05-15-biogpt_pubmed_qa_en.md

* Add model 2023-05-15-flan_t5_base_jsl_qa_en

* Update 2023-05-15-flan_t5_base_jsl_qa_en.md

---------

Co-authored-by: Cabir40 <cabir4006@gmail.com>
Co-authored-by: Cabir C <64752006+Cabir40@users.noreply.github.com>

* Add model 2023-05-17-medical_qa_biogpt_en (#234)

Co-authored-by: Cabir40 <cabir4006@gmail.com>

* Update 2023-04-20-explain_clinical_doc_carp_en.md

* Update 2023-04-20-explain_clinical_doc_era_en.md

* Update 2023-04-20-explain_clinical_doc_carp_en.md

* Update 2023-04-28-icd10cm_resolver_pipeline_en.md

* Update 2023-05-08-summarizer_clinical_guidelines_large_en.md

* 2023-05-20-sbiobertresolve_icd10cm_augmented_en (#243)

* Add model 2023-05-20-sbiobertresolve_icd10cm_augmented_en

* Update 2023-05-20-sbiobertresolve_icd10cm_augmented_en.md

* Update 2023-05-20-sbiobertresolve_icd10cm_augmented_en.md

* Update 2023-05-20-sbiobertresolve_icd10cm_augmented_en.md

---------

Co-authored-by: Ahmetemintek <ahmetemin.tek.66@gmail.com>
Co-authored-by: muhammetsnts <76607915+muhammetsnts@users.noreply.github.com>

* 2023-05-21-ner_ade_emb_clinical_medium_en (#244)

* Add model 2023-05-21-ner_ade_emb_clinical_medium_en

* Add model 2023-05-21-ner_ade_emb_clinical_large_en

* Add model 2023-05-24-ner_cellular_emb_clinical_medium_en

* Add model 2023-05-24-ner_cellular_emb_clinical_large_en

---------

Co-authored-by: Damla-Gurbaz <dml.grbz.01@gmail.com>

* 2023-05-23-ner_bacterial_species_emb_clinical_medium_en (#252)

* Add model 2023-05-23-ner_bacterial_species_emb_clinical_medium_en

* Update 2023-05-23-ner_bacterial_species_emb_clinical_medium_en.md

* Add model 2023-05-23-ner_bacterial_species_emb_clinical_large_en

* Update 2023-05-23-ner_bacterial_species_emb_clinical_large_en.md

* Update 2023-05-23-ner_bacterial_species_emb_clinical_medium_en.md

* Update 2023-05-23-ner_bacterial_species_emb_clinical_large_en.md

* Update 2023-05-23-ner_bacterial_species_emb_clinical_medium_en.md

---------

Co-authored-by: gokhanturer <mgturer@gmail.com>
Co-authored-by: Gökhan <81560784+gokhanturer@users.noreply.github.com>

* 2023-05-19-ner_vop_wip_en (#242)

* Add model 2023-05-19-ner_vop_wip_en

* Add model 2023-05-19-ner_vop_wip_embeddings_clinical_medium_en

* Add model 2023-05-19-ner_vop_wip_embeddings_clinical_large_en

* Add model 2023-05-19-ner_vop_anatomy_wip_en

* Add model 2023-05-19-ner_vop_clinical_dept_wip_en

* Add model 2023-05-19-ner_vop_demographic_wip_en

* Add model 2023-05-19-ner_vop_problem_reduced_wip_en

* Add model 2023-05-19-ner_vop_problem_wip_en

* Add model 2023-05-19-ner_vop_temporal_wip_en

* Add model 2023-05-19-ner_vop_test_wip_en

* Add model 2023-05-19-ner_vop_treatment_wip_en

* Update 2023-05-19-ner_vop_anatomy_wip_en.md

Fixing wrong special character (").

* Update 2023-05-19-ner_vop_treatment_wip_en.md

Fixing special character (" to ').

* Update 2023-05-19-ner_vop_test_wip_en.md

Fixing special character (" to ').

* Update 2023-05-19-ner_vop_temporal_wip_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_problem_wip_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_problem_reduced_wip_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_demographic_wip_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_clinical_dept_wip_en.md

Adding sample text.

* Update 2023-05-19-ner_vop_wip_embeddings_clinical_large_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_wip_embeddings_clinical_medium_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_wip_en.md

Special character fix (" to ').

* Update 2023-05-19-ner_vop_wip_embeddings_clinical_medium_en.md

Changing model name ner_vop_wip_embeddings_clinical_medium to ner_vop_wip_emb_clinical_medium.

* Update 2023-05-19-ner_vop_wip_embeddings_clinical_large_en.md

Changing model name ner_vop_wip_embeddings_clinical_large to ner_vop_wip_emb_clinical_large.

* Update 2023-05-19-ner_vop_wip_embeddings_clinical_medium_en.md

Changed s3 link.

* Update 2023-05-19-ner_vop_wip_embeddings_clinical_large_en.md

Changed s3 link.

* Add model 2023-05-24-bert_sequence_classifier_vop_side_effect_en

* Update 2023-05-24-bert_sequence_classifier_vop_side_effect_en.md

* Update 2023-05-24-bert_sequence_classifier_vop_side_effect_en.md

Minor edit.

* Update 2023-05-24-bert_sequence_classifier_vop_side_effect_en.md

Minor edit.

---------

Co-authored-by: mauro-nievoff <mauro.nievasoffidani@gmail.com>
Co-authored-by: mauro-nievoff <55700369+mauro-nievoff@users.noreply.github.com>

* 2023-05-24-sbiobertresolve_icd10cm_generalised_augmented_en (#256)

* 2023-05-29-summarizer_clinical_jsl_pipeline_en (#282)

* 2023-05-29-arabic_medical_ner_model_specific_17_entities_ar (#283)

* Add model 2023-05-29-arabic_medical_ner_model_specific_17_entities_ar

* Update 2023-05-29-arabic_medical_ner_model_specific_17_entities_ar.md

* update md file name

* Add model 2023-05-30-ner_deid_generic_ar

* fixed typos

* fixed typos

---------

Co-authored-by: mellahysf <ysfmell@gmail.com>
Co-authored-by: Cabir C <64752006+Cabir40@users.noreply.github.com>
Co-authored-by: Cabir ÇELİK <ogr.cabir.celik@ahievran.edu.tr>

* 2023-05-29-summarizer_clinical_layman_en (#280)

* Add model 2023-05-29-summarizer_clinical_layman_en

* Update 2023-05-29-summarizer_clinical_layman_en.md

* update model name

* Added English names to the example text

---------

Co-authored-by: dcecchini <dadachini@hotmail.com>
Co-authored-by: Cabir ÇELİK <ogr.cabir.celik@ahievran.edu.tr>

* 2023-05-26-icd10cm_billable_hcc_mapper_en (#266)

* Add model 2023-05-26-icd10cm_billable_hcc_mapper_en

* Update 2023-05-26-icd10cm_billable_hcc_mapper_en.md

md file was fixed based on the feedback.

* Update 2023-05-26-icd10cm_billable_hcc_mapper_en.md

---------

Co-authored-by: Ahmetemintek <ahmetemin.tek.66@gmail.com>
Co-authored-by: muhammetsnts <76607915+muhammetsnts@users.noreply.github.com>

* 2023-05-16-classifier_logreg_ade_en (#232)

* 2023-05-30-genericclassifier_sdoh_housing_insecurity_sbiobert_cased_mli_en (#299)

* 2023-05-30-icd10cm_mapper_en (#295)

* 2023-05-31-sbiobertresolve_hcc_augmented_en (#304)

* Add model 2023-05-31-sbiobertresolve_hcc_augmented_en

* Update 2023-05-31-sbiobertresolve_hcc_augmented_en.md

---------

Co-authored-by: Ahmetemintek <ahmetemin.tek.66@gmail.com>

* 2023-05-31-summarizer_clinical_guidelines_large_pipeline_en (#305)

* Add model 2023-05-31-summarizer_clinical_guidelines_large_pipeline_en

* Add model 2023-05-31-summarizer_radiology_pipeline_en

* Add model 2023-05-31-summarizer_clinical_questions_pipeline_en

* Add model 2023-05-31-summarizer_biomedical_pubmed_pipeline_en

* Delete 2023-05-31-summarizer_biomedical_pubmed_pipeline_en.md

* Add model 2023-05-31-summarizer_generic_jsl_pipeline_en

* Add model 2023-05-31-summarizer_biomedical_pubmed_pipeline_en

* Add model 2023-05-31-summarizer_clinical_jsl_augmented_pipeline_en

* Add model 2023-05-31-summarizer_clinical_jsl_pipeline_en

---------

Co-authored-by: Damla-Gurbaz <dml.grbz.01@gmail.com>
Co-authored-by: Damla Gurbaz <81505007+Damla-Gurbaz@users.noreply.github.com>

* 2023-05-31-sbertresolve_icd10cm_slim_billable_hcc_en (#302)

* 2023-05-31-sbertresolve_icd10cm_augmented_en (#306)

* Update 2023-05-26-icd10cm_billable_hcc_mapper_en.md

* 2023-05-31-ner_deid_subentity_pipeline_ar (#313)

* Add model 2023-05-31-ner_deid_subentity_pipeline_ar

* Add model 2023-05-31-ner_deid_generic_pipeline_ar

---------

Co-authored-by: mellahysf <ysfmell@gmail.com>

* 2023-05-31-ner_deid_subentity_pipeline_ar (#313)

* Add model 2023-05-31-ner_deid_subentity_pipeline_ar

* Add model 2023-05-31-ner_deid_generic_pipeline_ar

* Update 2023-05-31-ner_deid_subentity_pipeline_ar.md

---------

Co-authored-by: mellahysf <ysfmell@gmail.com>
Co-authored-by: Cabir C <64752006+Cabir40@users.noreply.github.com>

---------

Co-authored-by: jsl-models <74001263+jsl-models@users.noreply.github.com>
Co-authored-by: Ahmetemintek <ahmetemin.tek.66@gmail.com>
Co-authored-by: Damla-Gurbaz <dml.grbz.01@gmail.com>
Co-authored-by: Veysel Kocaman <vkocaman@gmail.com>
Co-authored-by: mauro-nievoff <mauro.nievasoffidani@gmail.com>
Co-authored-by: Damla Gurbaz <81505007+Damla-Gurbaz@users.noreply.github.com>
Co-authored-by: hsaglamlar <hsaglamlar@gmail.com>
Co-authored-by: Cabir ÇELİK <ogr.cabir.celik@ahievran.edu.tr>
Co-authored-by: SKocer <samedkocer22@gmail.com>
Co-authored-by: Meryem1425 <vildansarikaya25@gmail.com>
Co-authored-by: gokhanturer <mgturer@gmail.com>
Co-authored-by: Gökhan <81560784+gokhanturer@users.noreply.github.com>
Co-authored-by: HashamUlHaq <Haashaamulhaq@gmail.com>
Co-authored-by: Halil Saglamlar <47859156+hsaglamlar@users.noreply.github.com>
Co-authored-by: andrei9825 <andrei@johnsnowlabs.com>
Co-authored-by: gpirge <gursev.pirge@gmail.com>
Co-authored-by: gursev.pirge <67619330+gpirge@users.noreply.github.com>
Co-authored-by: Samed K <110497137+SKocer@users.noreply.github.com>
Co-authored-by: muhammetsnts <76607915+muhammetsnts@users.noreply.github.com>
Co-authored-by: mauro-nievoff <55700369+mauro-nievoff@users.noreply.github.com>
Co-authored-by: mellahysf <ysfmell@gmail.com>
Co-authored-by: dcecchini <dadachini@hotmail.com>
  • Loading branch information
@Cabir40 @jsl-models
@Ahmetemintek @Damla-Gurbaz @vkocaman @mauro-nievoff @hsaglamlar @SKocer @Meryem1425 @gokhanturer @HashamUlHaq @andrei9825 @gpirge @muhammetsnts @mellahysf @dcecchini
23 people committed Jun 1, 2023
1 parent 5685761 commit 00347f2
Show file tree
Hide file tree
Showing 58 changed files with 8,292 additions and 0 deletions.
175 changes: 175 additions & 0 deletions docs/_posts/Ahmetemintek/2023-05-20-sbiobertresolve_icd10cm_augmented_en.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,175 @@
---
layout: model
title: Sentence Entity Resolver for ICD10-CM (Augmented)
author: John Snow Labs
name: sbiobertresolve_icd10cm_augmented
date: 2023-05-20
tags: [icd10cm, entity_resolution, clinical, en, licensed]
task: Entity Resolution
language: en
edition: Healthcare NLP 4.4.2
spark_version: 3.0
supported: true
annotator: SentenceEntityResolverModel
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

This model maps extracted medical entities to ICD10-CM codes using `sbiobert_base_cased_mli` Sentence Bert Embeddings. Also, it has been augmented with synonyms for making it more accurate and returns the official resolution text within the brackets.

## Predicted Entities

`ICD10CM Codes`

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
[Open in Colab](https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/Certification_Trainings/Healthcare/3.Clinical_Entity_Resolvers.ipynb){:.button.button-orange.button-orange-trans.co.button-icon}
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/clinical/models/sbiobertresolve_icd10cm_augmented_en_4.4.2_3.0_1684591054927.zip){:.button.button-orange.button-orange-trans.arr.button-icon.hidden}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/clinical/models/sbiobertresolve_icd10cm_augmented_en_4.4.2_3.0_1684591054927.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python
document_assembler = DocumentAssembler()\
.setInputCol("text")\
.setOutputCol("document")


sentence_detector = SentenceDetectorDLModel.pretrained("sentence_detector_dl_healthcare","en","clinical/models")\
.setInputCols(["document"])\
.setOutputCol("sentence")

tokenizer = Tokenizer()\
.setInputCols(["sentence"])\
.setOutputCol("token")


word_embeddings = WordEmbeddingsModel.pretrained("embeddings_clinical", "en", "clinical/models")\
.setInputCols(["sentence","token"])\
.setOutputCol("embeddings")


clinical_ner = MedicalNerModel.pretrained("ner_clinical", "en", "clinical/models")\
.setInputCols(["sentence","token","embeddings"])\
.setOutputCol("ner")

ner_converter = NerConverter()\
.setInputCols(["sentence","token","ner"])\
.setOutputCol("ner_chunk")\
.setWhiteList(['PROBLEM'])

chunk2doc = Chunk2Doc().setInputCols("ner_chunk").setOutputCol("ner_chunk_doc")

sbert_embedder = BertSentenceEmbeddings.pretrained("sbiobert_base_cased_mli","en","clinical/models")\
.setInputCols(["ner_chunk_doc"])\
.setOutputCol("sbert_embeddings")

icd10_resolver = SentenceEntityResolverModel.pretrained("sbiobertresolve_icd10cm_augmented","en", "clinical/models") \
.setInputCols(["sbert_embeddings"]) \
.setOutputCol("resolution")\
.setDistanceFunction("EUCLIDEAN")

nlpPipeline = Pipeline(stages=[document_assembler, sentence_detector, tokenizer, word_embeddings, clinical_ner, ner_converter, chunk2doc, sbert_embedder, icd10_resolver])

data_ner = spark.createDataFrame([["A 28-year-old female with a history of gestational diabetes mellitus diagnosed eight years prior to presentation and subsequent type two diabetes mellitus (T2DM), one prior episode of HTG-induced pancreatitis three years prior to presentation, associated with obesity with a body mass index (BMI) of 33.5 kg/m2, presented with a one-week history of polyuria, polydipsia, poor appetite, and vomiting. Two weeks prior to presentation, she was treated with a five-day course of amoxicillin for a respiratory tract infection."]]).toDF("text")

results = nlpPipeline.fit(data_ner).transform(data_ner)
```
```scala
val document_assembler = DocumentAssembler()
.setInputCol("text")
.setOutputCol("document")


val sentence_detector = SentenceDetectorDLModel.pretrained("sentence_detector_dl_healthcare","en","clinical/models")
.setInputCols(Array("document"))
.setOutputCol("sentence")

val tokenizer = Tokenizer()
.setInputCols(Array("sentence"))
.setOutputCol("token")


val word_embeddings = WordEmbeddingsModel.pretrained("embeddings_clinical", "en", "clinical/models")
.setInputCols(Array("sentence","token"))
.setOutputCol("embeddings")


val clinical_ner = MedicalNerModel.pretrained("ner_clinical", "en", "clinical/models")
.setInputCols(Array("sentence","token","embeddings"))
.setOutputCol("ner")

val ner_converter = NerConverter()
.setInputCols(Array("sentence","token","ner"))
.setOutputCol("ner_chunk")
.setWhiteList(Array("PROBLEM"))


val chunk2doc = Chunk2Doc().setInputCols("ner_chunk").setOutputCol("ner_chunk_doc")

val sbert_embedder = BertSentenceEmbeddings.pretrained("sbiobert_base_cased_mli","en","clinical/models")
.setInputCols(Array("ner_chunk_doc"))
.setOutputCol("sbert_embeddings")

val icd10_resolver = SentenceEntityResolverModel.pretrained("sbiobertresolve_icd10cm_augmented","en", "clinical/models")
.setInputCols(Array("sbert_embeddings"))
.setOutputCol("resolution")
.setDistanceFunction("EUCLIDEAN")

val pipeline = new Pipeline().setStages(Array(document_assembler, sentence_detector, tokenizer, word_embeddings, clinical_ner, ner_converter, chunk2doc, sbert_embedder, icd10_resolver))

val data = Seq("A 28-year-old female with a history of gestational diabetes mellitus diagnosed eight years prior to presentation and subsequent type two diabetes mellitus (T2DM), one prior episode of HTG-induced pancreatitis three years prior to presentation, associated with obesity with a body mass index (BMI) of 33.5 kg/m2, presented with a one-week history of polyuria, polydipsia, poor appetite, and vomiting. Two weeks prior to presentation, she was treated with a five-day course of amoxicillin for a respiratory tract infection.").toDF("text")

val result = pipeline.fit(data).transform(data)
```

{:.nlu-block}
```python
import nlu
nlu.load("en.resolve.icd10cm.augmented").predict("""A 28-year-old female with a history of gestational diabetes mellitus diagnosed eight years prior to presentation and subsequent type two diabetes mellitus (T2DM), one prior episode of HTG-induced pancreatitis three years prior to presentation, associated with obesity with a body mass index (BMI) of 33.5 kg/m2, presented with a one-week history of polyuria, polydipsia, poor appetite, and vomiting. Two weeks prior to presentation, she was treated with a five-day course of amoxicillin for a respiratory tract infection.""")
```
</div>

## Results

```bash
+-------------------------------------+-------+------------+-------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------+
| ner_chunk| entity|icd10cm_code| resolutions | all_codes|
+-------------------------------------+-------+------------+-------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------+
| gestational diabetes mellitus|PROBLEM| O24.4|gestational diabetes mellitus [gestational diabetes mellitus], gestational diabetes mellitus [gestational... |O24.4, O24.41, O24.43, Z86.32, Z87.5, O24.31, O24.11, O24.1, O24.81...|
|subsequent type two diabetes mellitus|PROBLEM| O24.11|pre-existing type 2 diabetes mellitus [pre-existing type 2 diabetes mellitus], disorder associated with t... |O24.11, E11.8, E11, E13.9, E11.9, E11.3, E11.44, Z86.3, Z86.39, E11...|
| obesity|PROBLEM| E66.9|obesity [obesity], abdominal obesity [abdominal obesity], obese [obese], central obesity [central obesity... |E66.9, E66.8, Z68.41, Q13.0, E66, E66.01, Z86.39, E34.9, H35.50, Z8...|
| a body mass index|PROBLEM| Z68.41|finding of body mass index [finding of body mass index], observation of body mass index [observation of b... |Z68.41, E66.9, R22.9, Z68.1, R22.3, R22.1, Z68, R22.2, R22.0, R41.8...|
| polyuria|PROBLEM| R35|polyuria [polyuria], nocturnal polyuria [nocturnal polyuria], polyuric state [polyuric state], polyuric ... |R35, R35.81, R35.8, E23.2, R35.89, R31, R35.0, R82.99, N40.1, E72.3...|
| polydipsia|PROBLEM| R63.1|polydipsia [polydipsia], psychogenic polydipsia [psychogenic polydipsia], primary polydipsia [primary po... |R63.1, F63.89, E23.2, F63.9, O40, G47.5, M79.89, R63.2, R06.1, H53....|
| poor appetite|PROBLEM| R63.0|poor appetite [poor appetite], poor feeding [poor feeding], bad taste in mouth [bad taste in mouth], unp... |R63.0, P92.9, R43.8, R43.2, E86, R19.6, F52.0, Z72.4, R06.89, Z76.8...|
| vomiting|PROBLEM| R11.1|vomiting [vomiting], intermittent vomiting [intermittent vomiting], vomiting symptoms [vomiting symptom... |R11.1, R11, R11.10, G43.A1, P92.1, P92.09, G43.A, R11.13, R11.0 |
| a respiratory tract infection|PROBLEM| J98.8|respiratory tract infection [respiratory tract infection], upper respiratory tract infection [upper respi... |J98.8, J06.9, A49.9, J22, J20.9, Z59.3, T17, J04.10, Z13.83, J18.9 ...|
+-------------------------------------+-------+------------+----------------------------------------------------------------------+--------------------------------------+----------------------------------------------------------------------+
```
{:.model-param}
## Model Information
{:.table-model}
|---|---|
|Model Name:|sbiobertresolve_icd10cm_augmented|
|Compatibility:|Healthcare NLP 4.4.2+|
|License:|Licensed|
|Edition:|Official|
|Input Labels:|[sentence_embeddings]|
|Output Labels:|[icd10cm_code]|
|Language:|en|
|Size:|1.5 GB|
|Case sensitive:|false|
## References
Trained on ICD10CM 2023 Codes dataset: https://www.cdc.gov/nchs/icd/icd10cm.htm
106 changes: 106 additions & 0 deletions docs/_posts/Ahmetemintek/2023-05-26-icd10cm_billable_hcc_mapper_en.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,106 @@
---
layout: model
title: Mapping ICD-10-CM Codes with Corresponding Billable and Hierarchical Condition Category (HCC) Scores
author: John Snow Labs
name: icd10cm_billable_hcc_mapper
date: 2023-05-26
tags: [icd10cm, billable, hcc_score, clinical, en, chunk_mapping, licensed]
task: Chunk Mapping
language: en
edition: Healthcare NLP 4.4.2
spark_version: 3.0
supported: true
annotator: DocMapperModel
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

This pretrained model maps ICD-10-CM codes with their corresponding billable and HCC scores. If there is no HCC score for the corresponding ICD-10-CM code, result will be returned as 0.

## Predicted Entities

`billable`, `hcc_score`

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
[Open in Colab](https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/Certification_Trainings/Healthcare/26.Chunk_Mapping.ipynb){:.button.button-orange.button-orange-trans.co.button-icon}
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/clinical/models/icd10cm_billable_hcc_mapper_en_4.4.2_3.0_1685107034729.zip){:.button.button-orange.button-orange-trans.arr.button-icon.hidden}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/clinical/models/icd10cm_billable_hcc_mapper_en_4.4.2_3.0_1685107034729.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}

```python
document_assembler = DocumentAssembler()\
.setInputCol("text")\
.setOutputCol("document")

docMapper= DocMapperModel().pretrained("icd10cm_billable_hcc_mapper", "en", "clinical/models")\
.setInputCols(["document"])\
.setOutputCol("mappings")\
.setRels(["billable", "hcc_score"]) \
.setLowerCase(True) \
.setMultivaluesRelations(True)

pipeline = Pipeline().setStages([
document_assembler,
docMapper])


data = spark.createDataFrame([["D66"], ["S22.00"], ["Z3A.10"]]).toDF("text")

result = pipeline.fit(data).transform(data)
```
```scala
val document_assembler = new DocumentAssembler()
.setInputCol("text")
.setOutputCol("document")

val docMapper = DocMapperModel.pretrained("icd10cm_billable_hcc_mapper", "en", "clinical/models")
.setInputCols("document")
.setOutputCol("mappings")
.setRels(Array(["billable", "hcc_score"]))

val pipeline = new Pipeline().setStages(Array(
document_assembler,
docMapper))


val data = Seq(["D66"], ["S22.00"], ["Z3A.10"]).toDS.toDF("text")

val result= pipeline.fit(data).transform(data)
```
</div>

## Results

```bash
+--------------+----------+-----------+
| icd10cm_code | billable | hcc_score |
+--------------+----------+-----------+
| D66 | 1 | 46 |
| S22.00 | 0 | 0 |
| Z3A.10 | 1 | 0 |
+--------------+----------+-----------+
```

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|icd10cm_billable_hcc_mapper|
|Compatibility:|Healthcare NLP 4.4.2+|
|License:|Licensed|
|Edition:|Official|
|Input Labels:|[document]|
|Output Labels:|[mappings]|
|Language:|en|
|Size:|1.1 MB|
Loading

0 comments on commit 00347f2

Please sign in to comment.