Models hub legal (#592)

* Add model 2023-07-04-leggen_contract_nli_en (#442) Co-authored-by: gadde5300 <gadde5300@gmail.com> * Add model 2023-08-04-legclf_law_stack_exchange_en (#499) Co-authored-by: Mary-Sci <meryemyildiz366@gmail.com> * 2023-08-07-legner_bert_subpoenas_sm_en (#502) * Add model 2023-08-07-legner_bert_subpoenas_sm_en * Update 2023-08-07-legner_bert_subpoenas_sm_en.md --------- Co-authored-by: gadde5300 <gadde5300@gmail.com> Co-authored-by: GADDE SAI SHAILESH <69344247+gadde5300@users.noreply.github.com> * 2023-08-30-legpipe_deid_en (#567) * Add model 2023-08-30-legpipe_deid_en * Update 2023-08-30-legpipe_deid_en.md --------- Co-authored-by: Meryem1425 <vildansarikaya25@gmail.com> Co-authored-by: Merve Ertas Uslu <67653613+Mary-Sci@users.noreply.github.com> * 2023-08-30-legpipe_deid_en (#568) * Add model 2023-08-30-legpipe_deid_en * Update 2023-08-30-legpipe_deid_en.md * Add model 2023-08-30-legpipe_deid_en --------- Co-authored-by: SKocer <samedkocer22@gmail.com> Co-authored-by: Merve Ertas Uslu <67653613+Mary-Sci@users.noreply.github.com> * Add model 2023-08-30-legpipe_deid_en (#573) Co-authored-by: gokhanturer <mgturer@gmail.com> * Delete 2023-08-30-legpipe_deid_en.md * Add model 2023-08-30-legpipe_deid_en (#575) Co-authored-by: SKocer <samedkocer22@gmail.com> * Add model 2023-09-01-legpipe_deid_en (#585) Co-authored-by: Meryem1425 <vildansarikaya25@gmail.com> * Add model 2023-09-01-legpipe_deid_en (#591) Co-authored-by: SKocer <samedkocer22@gmail.com> --------- Co-authored-by: jsl-models <74001263+jsl-models@users.noreply.github.com> Co-authored-by: gadde5300 <gadde5300@gmail.com> Co-authored-by: Mary-Sci <meryemyildiz366@gmail.com> Co-authored-by: GADDE SAI SHAILESH <69344247+gadde5300@users.noreply.github.com> Co-authored-by: Meryem1425 <vildansarikaya25@gmail.com> Co-authored-by: Merve Ertas Uslu <67653613+Mary-Sci@users.noreply.github.com> Co-authored-by: SKocer <samedkocer22@gmail.com> Co-authored-by: gokhanturer <mgturer@gmail.com>
JohnSnowLabs · Sep 1, 2023 · 03df349 · 03df349
1 parent b924735
commit 03df349
Showing 1 changed file with 175 additions and 0 deletions.
diff --git a/docs/_posts/SKocer/2023-09-01-legpipe_deid_en.md b/docs/_posts/SKocer/2023-09-01-legpipe_deid_en.md
@@ -0,0 +1,175 @@
+---
+layout: model
+title: Legal Deidentification Pipeline
+author: John Snow Labs
+name: legpipe_deid
+date: 2023-09-01
+tags: [licensed, en, legal, deid, deidentification, anonymization]
+task: Pipeline Legal
+language: en
+edition: Legal NLP 1.0.0
+spark_version: 3.2
+supported: true
+annotator: PipelineModel
+article_header:
+  type: cover
+use_language_switcher: "Python-Scala-Java"
+---
+
+## Description
+
+This is a Pretrained Pipeline aimed to deidentify legal and financial documents to be compliant with data privacy regulations as GDPR and CCPA. Since the models used in this pipeline are statistical, make sure you use this model in a human-in-the-loop process to guarantee a 100% accuracy.
+
+You can carry out both masking and obfuscation with this pipeline, on the following entities: 
+`ALIAS`, `EMAIL`, `PHONE`, `PROFESSION`, `ORG`, `DATE`, `PERSON`, `ADDRESS`, `STREET`, `CITY`, `STATE`, `ZIP`, `COUNTRY`
+
+{:.btn-box}
+<button class="button button-orange" disabled>Live Demo</button>
+<button class="button button-orange" disabled>Open in Colab</button>
+[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/legal/models/legpipe_deid_en_1.0.0_3.2_1693602413826.zip){:.button.button-orange.button-orange-trans.arr.button-icon.hidden}
+[Copy S3 URI](s3://auxdata.johnsnowlabs.com/legal/models/legpipe_deid_en_1.0.0_3.2_1693602413826.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}
+
+## How to use
+
+
+
+<div class="tabs-box" markdown="1">
+{% include programmingLanguageSelectScalaPythonNLU.html %}
+```python
+
+from sparknlp.pretrained import PretrainedPipeline
+
+deid_pipeline = PretrainedPipeline("legpipe_deid", "en", "legal/models")
+
+result = deid_pipeline.annotate("""Pizza Fusion Holdings, Inc. Franchise Agreement This Franchise Agreement (the "Agreement") is entered into as of the Agreement Date shown on the cover page between Pizza Fusion Holding, Inc., a Florida corporation, and the individual or legal entity identified on the cover page.
+
+Source: PF HOSPITALITY GROUP INC., 9/23/2015
+
+
+1. RIGHTS GRANTED 1.1. Grant of Franchise. 1.1.1 We grant you the right, and you accept the obligation, to use the Proprietary Marks and the System to operate one Restaurant (the "Franchised Business") at the Premises, in accordance with the terms of this Agreement. 
+
+Source: PF HOSPITALITY GROUP INC., 9/23/2015
+
+
+1.3. Our Limitations and Our Reserved Rights. The rights granted to you under this Agreement are not exclusive.sed Business.
+
+Source: PF HOSPITALITY GROUP INC., 9/23/2015""")
+
+```
+
+</div>
+
+## Results
+
+```bash
+Masked with entity labels
+------------------------------
+<PARTY>. <DOC> This <DOC> (the <ALIAS>) is entered into as of the Agreement Date shown on the cover page between <PARTY> a Florida corporation, and the individual or legal entity identified on the cover page.
+Source: <PARTY>., <DATE>
+
+
+1.
+<PARTY> 1.1.
+<PARTY>.
+1.1.1 We grant you the right, and you accept the obligation, to use the <PARTY> and the System to operate one Restaurant (the <ALIAS>) at the Premises, in accordance with the terms of this Agreement.
+Source: <PARTY>., <DATE>
+
+
+1.3.
+Our <PARTY> and <PARTY>.
+The rights granted to you under this Agreement are not exclusive.sed Business.
+Source: <PARTY>., <DATE>
+
+Masked with chars
+------------------------------
+[************************]. [*****************] This [*****************] (the [*********]) is entered into as of the Agreement Date shown on the cover page between [*************************] a Florida corporation, and the individual or legal entity identified on the cover page.
+Source: [**********************]., [*******]
+
+
+1.
+[************] 1.1.
+[****************].
+1.1.1 We grant you the right, and you accept the obligation, to use the [***************] and the System to operate one Restaurant (the [*******************]) at the Premises, in accordance with the terms of this Agreement.
+Source: [**********************]., [*******]
+
+
+1.3.
+Our [*********] and [*****************].
+The rights granted to you under this Agreement are not exclusive.sed Business.
+Source: [**********************]., [*******]
+
+Masked with fixed length chars
+------------------------------
+****. **** This **** (the ****) is entered into as of the Agreement Date shown on the cover page between **** a Florida corporation, and the individual or legal entity identified on the cover page.
+Source: ****., ****
+
+
+1.
+**** 1.1.
+****.
+1.1.1 We grant you the right, and you accept the obligation, to use the **** and the System to operate one Restaurant (the ****) at the Premises, in accordance with the terms of this Agreement.
+Source: ****., ****
+
+
+1.3.
+Our **** and ****.
+The rights granted to you under this Agreement are not exclusive.sed Business.
+Source: ****., ****
+
+Obfuscated
+------------------------------
+SESA CO.. Estate Document This Estate Document (the (the "Contract")) is entered into as of the Agreement Date shown on the cover page between Clarus llc. a Florida corporation, and the individual or legal entity identified on the cover page.
+Source: SESA CO.., 11/7/2016
+
+
+1.
+SESA CO. 1.1.
+Clarus llc..
+1.1.1 We grant you the right, and you accept the obligation, to use the John Snow Labs Inc and the System to operate one Restaurant (the (the" Agreement")) at the Premises, in accordance with the terms of this Agreement.
+Source: SESA CO.., 11/7/2016
+
+
+1.3.
+Our MGT Trust Company, LLC. and John Snow Labs Inc.
+The rights granted to you under this Agreement are not exclusive.sed Business.
+Source: SESA CO.., 11/7/2016
+
+```
+
+{:.model-param}
+## Model Information
+
+{:.table-model}
+|---|---|
+|Model Name:|legpipe_deid|
+|Type:|pipeline|
+|Compatibility:|Legal NLP 1.0.0+|
+|License:|Licensed|
+|Edition:|Official|
+|Language:|en|
+|Size:|503.2 MB|
+
+## Included Models
+
+- DocumentAssembler
+- SentenceDetector
+- TokenizerModel
+- DateMatcher
+- Date2Chunk
+- RoBertaEmbeddings
+- LegalNerModel
+- NerConverterInternalModel
+- LegalNerModel
+- NerConverterInternalModel
+- LegalNerModel
+- NerConverterInternalModel
+- ContextualParserModel
+- ContextualParserModel
+- ContextualParserModel
+- ContextualParserModel
+- ContextualParserModel
+- ChunkMergeModel
+- DeIdentificationModel
+- DeIdentificationModel
+- DeIdentificationModel
+- DeIdentificationModel