Skip to content

Commit

Permalink
updated md (#1186)
Browse files Browse the repository at this point in the history
  • Loading branch information
akrztrk committed May 8, 2024
1 parent 202c138 commit e4c3680
Show file tree
Hide file tree
Showing 4 changed files with 9 additions and 10 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -37,11 +37,12 @@ It is augmented with `ner_deid_name_multilingual_clinical` model.

<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}

```python

from sparknlp.pretrained import PretrainedPipeline

deid_pipeline = PretrainedPipeline("clinical_deidentification_nameAugmented", "en", "clinical/models")
deid_pipeline = PretrainedPipeline("clinical_deidentification_subentity_nameAugmented", "en", "clinical/models")

text = """Name : Hendrickson, Ora, Record date: 2093-01-13, MR #719435.
Dr. John Green, ID: 1231511863, IP 203.120.223.13.
Expand All @@ -57,7 +58,7 @@ result = deid_pipeline.annotate(text)

import com.johnsnowlabs.nlp.pretrained.PretrainedPipeline

val deid_pipeline = PretrainedPipeline("clinical_deidentification_nameAugmented", "en", "clinical/models")
val deid_pipeline = PretrainedPipeline("clinical_deidentification_subentity_nameAugmented", "en", "clinical/models")

val text = """Name : Hendrickson, Ora, Record date: 2093-01-13, MR #719435.
Dr. John Green, ID: 1231511863, IP 203.120.223.13.
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -44,10 +44,8 @@ Phone (302) 786-5227, 0295 Keats Street, San Francisco, E-MAIL: smith@gmail.com.

deid_result = deid_pipeline.fullAnnotate(text)

print('
'.join([i.metadata['masked'] for i in deid_result[0]['obfuscated']]))
print('
'.join([i.result for i in deid_result[0]['obfuscated']]))
print('\n'.join([i.metadata['masked'] for i in deid_result[0]['obfuscated']]))
print('\n'.join([i.result for i in deid_result[0]['obfuscated']]))
```
```scala
import com.johnsnowlabs.nlp.pretrained.PretrainedPipeline
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -48,8 +48,8 @@ Phone (302) 786-5227, 0295 Keats Street, San Francisco, E-MAIL: smith@gmail.com.

result = deid_pipeline.fullAnnotate(text)

print('\n'.join([i.metadata['masked'] for i in deid_result[0]['obfuscated']]))
print('\n'.join([i.result for i in deid_result[0]['obfuscated']])))
print('\n'.join([i.metadata['masked'] for i in result[0]['obfuscated']]))
print('\n'.join([i.result for i in result[0]['obfuscated']]))
```
```scala
import com.johnsnowlabs.nlp.pretrained.PretrainedPipeline
Expand Down
4 changes: 2 additions & 2 deletions docs/en/spark_nlp_healthcare_versions/release_notes_5_3_1.md
Original file line number Diff line number Diff line change
Expand Up @@ -504,7 +504,7 @@ What sets this release apart is the elimination of complexities typically involv
| [`snomed_drug_resolver_pipeline`](https://nlp.johnsnowlabs.com/2024/03/11/snomed_drug_resolver_pipeline_en.html) | This advanced pipeline extracts drug entities from clinical texts and maps these entities to their corresponding SNOMED codes. |
| [`snomed_resolver_pipeline`](https://nlp.johnsnowlabs.com/2024/03/11/snomed_resolver_pipeline_en.html) | This pipeline extracts `Clinical Findings `, `Morph Abnormality`, `Clinical Drug`, `Clinical Drug Form`, `Procedure`, `Substance`, `Physical Object`, and `Body Structure` concepts from clinical notes and maps them to their corresponding SNOMED codes. |
| [`clinical_deidentification_generic_optimized`](https://nlp.johnsnowlabs.com/2024/03/14/clinical_deidentification_generic_optimized_en.html) | This pipeline can be used to deidentify PHI information from medical texts. |
| [`clinical_deidentification_nameAugmented`](https://nlp.johnsnowlabs.com/2024/03/14/clinical_deidentification_subentity_nameAugmented_en.html) | This pipeline can be used to deidentify PHI information from medical texts. The PHI information will be masked and obfuscated in the resulting text. |
| [`clinical_deidentification_subentity_nameAugmented`](https://nlp.johnsnowlabs.com/2024/03/14/clinical_deidentification_subentity_nameAugmented_en.html) | This pipeline can be used to deidentify PHI information from medical texts. The PHI information will be masked and obfuscated in the resulting text. |
| [`clinical_deidentification_subentity_optimized`](https://nlp.johnsnowlabs.com/2024/03/14/clinical_deidentification_subentity_optimized_en.html) | This pipeline can be used to deidentify PHI information from medical texts. The PHI information will be obfuscated in the resulting text and also masked with entity labels in the metadata. |
| [`explain_clinical_doc_public_health`](https://nlp.johnsnowlabs.com/2024/03/19/explain_clinical_doc_public_health_en.html) | This specialized public health pipeline can extract public health-related entities, assign assertion status to the extracted entities, establish relations between the extracted entities from the clinical documents. In this pipeline, five NER, one assertion, and one relation extraction model were used to achieve those tasks. |
| [`explain_clinical_doc_biomarker`](https://nlp.johnsnowlabs.com/2024/03/11/explain_clinical_doc_biomarker_en.html) | This specialized biomarker pipeline can extract biomarker entities, classify sentences whether they contain biomarker entities or not, establish relations between the extracted biomarker and biomarker results from the clinical documents. |
Expand Down Expand Up @@ -660,7 +660,7 @@ The CPT and MedDRA models have been removed from the S3 storage. As a result, wh
+ `snomed_drug_resolver_pipeline`
+ `snomed_resolver_pipeline`
+ `clinical_deidentification_generic_optimized`
+ `clinical_deidentification_nameAugmented`
+ `clinical_deidentification_subentity_nameAugmented`
+ `clinical_deidentification_subentity_optimized`
+ `umls_rxnorm_mapper`
+ `icd10_meddra_llt_mapper`
Expand Down

0 comments on commit e4c3680

Please sign in to comment.