Files

database
ethical-hacking
general
handling-pdf-files
images
machine-learning
- age-and-gender-detection
- blur-faces
- contour-detection
- edge-detection
- face-age-prediction
- face-gender-detection
- face_detection
- feature-selection
- hog-feature-extraction
- image-classifier-using-transfer-learning
- image-classifier
- image-transformation
- imbalance-learning
- kmeans-image-segmentation
- malaria-classification
- nlp
  - bert-text-classification
  - chatbot-transformers
  - machine-translation
  - pretraining-bert
    - PretrainingBERT.ipynb
    - README.md
    - pretrainingbert.py
    - requirements.txt
  - sentiment-analysis-vader
  - spam-classifier
  - speech-recognition-transformers
  - text-classification
  - text-generation-transformers
  - text-generator
  - text-paraphrasing
  - text-summarization
- object-detection
- optical-character-recognition
- plotly-visualization
- satellite-image-classification
- shape-detection
- sift
- skin-cancer-detection
- speech-emotion-recognition
- speech-recognition
- stock-prediction
- technical-indicators
- text-to-speech
- trading-with-fxcm
python-for-multimedia
python-standard-library
scapy
web-scraping
.gitignore
LICENSE
README.md

pretraining-bert

change default param in pretraining bert tutorial

Oct 27, 2021

3932244 · Oct 27, 2021

This branch is 252 commits behind x4nth055/pythoncode-tutorials:master.

Name		Name	Last commit message	Last commit date
parent directory ..
PretrainingBERT.ipynb		PretrainingBERT.ipynb	change default param in pretraining bert tutorial	Oct 27, 2021
README.md		README.md	add pretraining bert tutorial	Oct 27, 2021
pretrainingbert.py		pretrainingbert.py	change default param in pretraining bert tutorial	Oct 27, 2021
requirements.txt		requirements.txt	add pretraining bert tutorial	Oct 27, 2021

README.md

How to Pretrain BERT using Transformers in Python

To run this:

pip3 install -r requirements.txt