Skip to content

The implementation of "BioNART: A Biomedical Non-AutoRegressive Transformer for Natural Language Generation"

License

Notifications You must be signed in to change notification settings

aistairc/BioNART

Repository files navigation

BioNART

The implementation of "BioNART: A Biomedical Non-AutoRegressive Transformer for Natural Language Generation" image

This implementation is intended to run on the ABCI

Requirements

pip install -r requirements.txt

Pre-training on PubMed

cd preprocess_caches
qsub -g GROUPNAME run.sh
cd ..
qsub -g GROUPNAME job_pretraining.sh

Fine-tuning on Biomedical Text Generation tasks

qsub -g GROUPNAME job_bio_generation.sh

Acknowledgements

This work is based on results obtained from a project JPNP20006, commissioned by the New Energy and Industrial Technology Development Organization (NEDO).

About

The implementation of "BioNART: A Biomedical Non-AutoRegressive Transformer for Natural Language Generation"

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages