Greek-Bert

We'll use the Bert pre-trained models in Greek language. And we'll fine tune our model by using data I was gathering since 1/6/2019 from Twitter :D

Methodology

We are going to use PyTorch / TensorFlow as our Deep Learning library and CUDA for GPU programming

Coursera Specializations useful for Deep Learning / NLP / Tensorflow

• Tensorflow Specialization - https://www.coursera.org/professional-certificates/tensorflow-in-practice
• Natural Language Specialization - https://www.coursera.org/specializations/natural-language-processing
• Deep Learning Specialization - https://www.coursera.org/specializations/deep-learning

Useful Articles per NLP Task

Intent recognition

• Intent recognition with BERT - https://analyticsindiamag.com/how-to-implement-intent-recognition-with-bert/#:~:text=By%20Mudit%20Rustagi-,Intent%20Classification%2C%20or%20you%20may%20say%20Intent%20Recognition%20is%20the,a%20subdomain%20of%20Artificial%20Intelligence.
• Simple Chatbot using Kaggle dataset of Intent Recognition - https://www.kaggle.com/code/aminianam/simple-chatbot

Language:

• Python 3.8.3
• Conda 4.9.0
• NVidia CUDA

Tools:

• wget - https://builtvisible.com/download-your-website-with-wget/

Transformers guide :

Hugging Face - https://huggingface.co/course/chapter1/3?fw=pt

Installing necessary packages

(The standard ones such as pandas , numpy , json , matplotlib)

pip install unicodedata

pip install transfomers

pip install torch (https://pytorch.org/get-started/locally/ it will suggest you a conda installation command more suitable for you!)

Bibliography:

Books:

Python for Data Analysis (to understand how Python is used)

Deep Learning with PyTorch (having fun with examples and deepen your understanding)

Grokking Deep Learning (In order to acquire the mindset about Deep Learning overall)

Papers:

GREEK-BERT The Greeks visiting Sesame Street

Repositories / URLs :

https://github.com/nlpaueb/greek-bert

https://huggingface.co/*

Playlist to hear that I have created for reading my repos :D : https://open.spotify.com/playlist/13PihYZ73GTgCN6snGAZnV?si=04ad54b6ae244a47