ODSC APAC 2023 Advanced NLP Session

Advanced NLP: Deep Transfer Learning for Natural Language Processing with Transformers and Large Language Models

Abstract:

Being specialized in domains like computer vision and natural language processing is no longer a luxury but a necessity which is expected of any data scientist in today’s fast-paced world! With a hands-on and interactive approach, we will understand essential concepts in deep transfer learning for NLP with a focus on Transformers and Large Language Models. We will compare and contrast transformers like BERT and LLMs like ChatGPT. Finally we will also showcase with hands-on tutorials how to solve popular tasks using NLP including NER, Classification, Search / Information Retrieval, Summarization, Classification, Language Translation, Q&A systems using models like BERT and ChatGPT and popular libraries like HuggingFace, OpenAI and the Python programming language.

Key Hands-on Examples

1. NLP Applications - Sentiment Analysis, Question Answering, Summarization, Translation, Zero-shot Classification
2. NLP Applications using Transformers and Large Language Models - ChatGPT
3. Question-Answering Search Engine Chatbots using Transformers and Large Language Models - ChatGPT

Background Knowledge

Skills: Understanding of Machine Learning and Deep Learning

Tools \ Languages: Python, PyTorch, Open AI, HuggingFace Transformers, Langchain

Author