Skip to content

Commit

Permalink
web page update (#1326)
Browse files Browse the repository at this point in the history
* update web page

* updated release notes

* fixed typos
  • Loading branch information
Cabir40 committed Jul 13, 2024
1 parent 3cc0f4a commit dd0a81b
Show file tree
Hide file tree
Showing 11 changed files with 42 additions and 12 deletions.
2 changes: 1 addition & 1 deletion docs/_posts/Cabir40/2024-07-12-jsl_medm_q16_v1_en.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ layout: model
title: JSL_MedM (LLM - q16)
author: John Snow Labs
name: jsl_medm_q16_v1
date: 2024-07-03
date: 2024-07-12
tags: [en, licensed, clinical, medical, llm, summarization, qa, rag, chat]
task: [Summarization, Question Answering]
language: en
Expand Down
2 changes: 1 addition & 1 deletion docs/_posts/Cabir40/2024-07-12-jsl_medm_q4_v1_en.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ layout: model
title: JSL_MedM (LLM - q4)
author: John Snow Labs
name: jsl_medm_q4_v1
date: 2024-07-03
date: 2024-07-12
tags: [en, licensed, clinical, medical, llm, summarization, qa, ragi chat]
task: [Summarization, Question Answering]
language: en
Expand Down
2 changes: 1 addition & 1 deletion docs/_posts/Cabir40/2024-07-12-jsl_medm_q8_v1_en.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ layout: model
title: JSL_MedM (LLM - q8)
author: John Snow Labs
name: jsl_medm_q8_v1
date: 2024-07-03
date: 2024-07-12
tags: [en, licensed, clinical, medical, llm, summarization, qa, rag, chat]
task: [Summarization, Question Answering]
language: en
Expand Down
2 changes: 1 addition & 1 deletion docs/_posts/Cabir40/2024-07-12-jsl_medner_zs_q16_en.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ layout: model
title: JSL_MedM (LLM - q16)
author: John Snow Labs
name: jsl_medner_zs_q16
date: 2024-07-03
date: 2024-07-12
tags: [en, licensed, clinical, medical, llm, ner]
task: [Summarization, Question Answering, Named Entity Recognition]
language: en
Expand Down
2 changes: 1 addition & 1 deletion docs/_posts/Cabir40/2024-07-12-jsl_medner_zs_q4_en.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ layout: model
title: JSL_MedM (LLM - q4)
author: John Snow Labs
name: jsl_medner_zs_q4
date: 2024-07-03
date: 2024-07-12
tags: [en, licensed, clinical, medical, llm, ner]
task: [Summarization, Question Answering, Named Entity Recognition]
language: en
Expand Down
2 changes: 1 addition & 1 deletion docs/_posts/Cabir40/2024-07-12-jsl_medner_zs_q8_en.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ layout: model
title: JSL_MedM (LLM - q8)
author: John Snow Labs
name: jsl_medner_zs_q8
date: 2024-07-03
date: 2024-07-12
tags: [en, licensed, clinical, medical, llm, ner]
task: [Summarization, Question Answering, Named Entity Recognition]
language: en
Expand Down
2 changes: 1 addition & 1 deletion docs/_posts/Cabir40/2024-07-12-jsl_meds_q18_v1_en.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ layout: model
title: JSL_MedS (LLM - q16)
author: John Snow Labs
name: jsl_meds_q16_v1
date: 2024-07-03
date: 2024-07-12
tags: [en, licensed, clinical, medical, llm, summarization, qa]
task: [Summarization, Question Answering]
language: en
Expand Down
2 changes: 1 addition & 1 deletion docs/_posts/Cabir40/2024-07-12-jsl_meds_q4_v1_en.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ layout: model
title: JSL_MedS (LLM - q4)
author: John Snow Labs
name: jsl_meds_q4_v1
date: 2024-07-03
date: 2024-07-12
tags: [en, licensed, clinical, medical, llm, summarization, qa]
task: [Summarization, Question Answering]
language: en
Expand Down
2 changes: 1 addition & 1 deletion docs/_posts/Cabir40/2024-07-12-jsl_meds_q8_v1_en.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ layout: model
title: JSL_MedS (LLM - q8)
author: John Snow Labs
name: jsl_meds_q8_v1
date: 2024-07-03
date: 2024-07-12
tags: [en, licensed, clinical, medical, llm, summarization, qa]
task: [Summarization, Question Answering]
language: en
Expand Down
17 changes: 16 additions & 1 deletion docs/en/spark_nlp_healthcare_versions/licensed_release_notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -62,6 +62,21 @@ These enhancements will elevate your experience with Spark NLP for Healthcare, e

`LLMLoader` is designed to interact with a LLMs that are converted into gguf format. This module allows using John Snow Labs' licensed LLMs at various sizes that are finetuned on medical context for certain tasks. It provides various methods for setting parameters, loading models, generating text, and retrieving metadata. The `LLMLoader` includes methods for setting various parameters such as input prefix, suffix, cache prompt, number of tokens to predict, sampling techniques, temperature, penalties, and more. Overall, the `LLMLoader` provides a flexible and extensible framework for interacting with language models in a Python and Scala environment using PySpark and Java.

{:.table-model-big}
| Model Name | Description |
|-------------------------|-------------|
|[JSL_MedS_q16_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_meds_q16_v1_en.html) | Summarization and Q&A |
|[JSL_MedS_q8_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_meds_q8_v1_en.html) | Summarization and Q&A |
|[JSL_MedS_q4_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_meds_q4_v1_en.html) | Summarization and Q&A |
|[JSL_MedM_q16_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_medm_q16_v1_en.html) | Summarization, Q&A, RAG, and Chat |
|[JSL_MedM_q8_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_medm_q8_v1_en.html) | Summarization, Q&A, RAG, and Chat |
|[JSL_MedM_q4_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_medm_q4_v1_en.html) | Summarization, Q&A, RAG, and Chat |
|[JSL_MedSNer_ZS_q16_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_medsner_zh_q16_en.html)| Extract and link medical named entities |
|[JSL_MedSNer_ZS_q8_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_medsner_zh_q8_en.html) | Extract and link medical named entities |
|[JSL_MedSNer_ZS_q4_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_medsner_zh_q4_en.html) | Extract and link medical named entities |

**We recommend using 8b quantized versions of the models as the qualitative performance difference between q16 and q8 versions is very negligible.**

*Example*:

```python
Expand Down Expand Up @@ -146,7 +161,7 @@ sample_text= """The patient is suspected to have colorectal cancer. Her family h
| 2 | biopsy | 120 | 125 | Pathology_Test | Past | 0.957321 |
| 3 | positive | 131 | 138 | Pathology_Result | Present | 0.956439 |
| 4 | CT scan | 143 | 149 | Imaging_Test | Past | 0.95717 |
| 5 | metastases | 175 | 184 | Metastasis | Possible | 0.549866 ||
| 5 | metastases | 175 | 184 | Metastasis | Possible | 0.549866 |


Please check the [FewShot Assertion Classifier](https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/Certification_Trainings/Healthcare/2.2.FewShot_Assertion_Classifier.ipynb) Notebook for more information
Expand Down
19 changes: 17 additions & 2 deletions docs/en/spark_nlp_healthcare_versions/release_notes_5_4_0.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
layout: docs
header: true
seotitle: Spark NLP for Healthcare | John Snow Labs
title: Spark NLP for Healthcare Release Notes 5.3.3
title: Spark NLP for Healthcare Release Notes 5.4.0
permalink: /docs/en/spark_nlp_healthcare_versions/release_notes_5_4_0
key: docs-licensed-release-notes
modify_date: 2024-07-10
Expand Down Expand Up @@ -62,6 +62,21 @@ These enhancements will elevate your experience with Spark NLP for Healthcare, e

`LLMLoader` is designed to interact with a LLMs that are converted into gguf format. This module allows using John Snow Labs' licensed LLMs at various sizes that are finetuned on medical context for certain tasks. It provides various methods for setting parameters, loading models, generating text, and retrieving metadata. The `LLMLoader` includes methods for setting various parameters such as input prefix, suffix, cache prompt, number of tokens to predict, sampling techniques, temperature, penalties, and more. Overall, the `LLMLoader` provides a flexible and extensible framework for interacting with language models in a Python and Scala environment using PySpark and Java.

{:.table-model-big}
| Model Name | Description |
|-------------------------|-------------|
|[JSL_MedS_q16_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_meds_q16_v1_en.html) | Summarization and Q&A |
|[JSL_MedS_q8_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_meds_q8_v1_en.html) | Summarization and Q&A |
|[JSL_MedS_q4_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_meds_q4_v1_en.html) | Summarization and Q&A |
|[JSL_MedM_q16_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_medm_q16_v1_en.html) | Summarization, Q&A, RAG, and Chat |
|[JSL_MedM_q8_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_medm_q8_v1_en.html) | Summarization, Q&A, RAG, and Chat |
|[JSL_MedM_q4_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_medm_q4_v1_en.html) | Summarization, Q&A, RAG, and Chat |
|[JSL_MedSNer_ZS_q16_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_medsner_zh_q16_en.html)| Extract and link medical named entities |
|[JSL_MedSNer_ZS_q8_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_medsner_zh_q8_en.html) | Extract and link medical named entities |
|[JSL_MedSNer_ZS_q4_v1](https://nlp.johnsnowlabs.com/2024/07/12/jsl_medsner_zh_q4_en.html) | Extract and link medical named entities |

**We recommend using 8b quantized versions of the models as the qualitative performance difference between q16 and q8 versions is very negligible.**

*Example*:

```python
Expand Down Expand Up @@ -145,7 +160,7 @@ sample_text= """The patient is suspected to have colorectal cancer. Her family h
| 2 | biopsy | 120 | 125 | Pathology_Test | Past | 0.957321 |
| 3 | positive | 131 | 138 | Pathology_Result | Present | 0.956439 |
| 4 | CT scan | 143 | 149 | Imaging_Test | Past | 0.95717 |
| 5 | metastases | 175 | 184 | Metastasis | Possible | 0.549866 ||
| 5 | metastases | 175 | 184 | Metastasis | Possible | 0.549866 |


Please check the [FewShot Assertion Classifier](https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/Certification_Trainings/Healthcare/2.2.FewShot_Assertion_Classifier.ipynb) Notebook for more information
Expand Down

0 comments on commit dd0a81b

Please sign in to comment.