Large Language Models

This repository is a work in progress and its contents will be updated regularly.

relevant literature review

Review of existing LLMs

Experiments with existing LLMs

Practical Guide and source code containing demos and examples

LLama Models: https://agi-sphere.com/llama-models/

Standford Alpaca: https://github.com/tatsu-lab/stanford_alpaca

GPT4-x-Alpaca: https://huggingface.co/chavinlo/gpt4-x-alpaca

WizardLM: https://github.com/nlpxucan/WizardLM

Vicuna: https://github.com/lm-sys/FastChat https://vicuna.lmsys.org/

Berkeley Koala: https://bair.berkeley.edu/blog/2023/04/03/koala/

Selected Topics in Machine Learning

• Reinforcement Learning and Game Theory

• Offline Reinforcement and Self-Supervised Learning

• NLP Concepts

• Transformers

• Large Language Models

• Bayesian Networks

• Probabilistic Machine Learning

• Optimization, Classification, Regression

• Causal Inference, Root Cause Analysis and Model Checking

• Deep Learning and Neural Networks

• Deep Learning for solving Image Processing problems and Generative Tasks

• Hypothesis Testing, Estimation of Treatment Effects and Generalized Synthetic Control

• Graphs and Dynamic Programming

• Dynamical Systems, State-Space Models, Chaos, Ergodicity

• Information Theory, Statistical Mechanics, Diffusion Models

• Queueing Networks, Queueing Theory, Reversible Stochastic Processes

• Spectral Analysis, Optimization in Spectral Domain, Spectral Domain Modeling

• Computability, Automata, Logic Systems, Formal Grammars and Theory of Parsing

• Thought Forming, Consciousness, Intelligent Machines, Inference, Logic Systems

Note

This repository uses git Large File Storage feature. In order to download locally the large files (> 1MB) which are maintained by git LFS you will need to install the Git extension for versioning large files: https://git-lfs.com/