Home

Machine Learning Concepts

• Types: Supervised Learning, Unsupervised Learning, Reinforcement learning
• Networks: Convolutional Neural Network, Recurrent Neural Network
• Activation function | ReLU | SoftMax

ML benchmarks

• Image classification: ResNet, VGG, Inception, MobileNets, AlexNet, ResNeXt
• Natural language processing: BERT
• MLPerf - MLPerf Inference, MLPerf Training
• Data sets - MNIST database, ImageNet, COCO, PASCAL VOC

Hardware companies

• x86 CPU : Intel| AMD
• Arm CPU: AWS | Marvell Technology Group | Fujitsu | Huawei | NVIDIA | Ampere Computing
• GPU : AMD, NVIDIA
• ML Accelerators: GraphCore, Habana Labs, Groq

ML Software

• Frameworks: TensorFlow, PyTorch, MXNET, Keras
• Inference engines: ArmNN, OpenVINO, TensorRT, TensorFlow Lite, Core ML
• Libraries: cuDNN, MKL-DNN, Arm Compute Library
• BLAS libraries: Eigen, OpenBLAS, MKL, BLIS, cuBLAS
• Compiler tech: MLIR, TensorFlow XLA, TVM

Languages and tools

• Languages - Python | Julia | R
• Compiler - GNU Toolchain | LLVM
• Others - Valgrind | QEMU

Python related

• Interpreters: CPython
• Packaging: pip (package manager), Conda
• Distributions: Anaconda
• Repository: PyPi
• Libraries: NumPy, SciPy

Cloud

• Vendors: AWS, Microsoft Azure, Google Cloud
• Linux distributions: RHEL, SLES, CentOS, OpenSUSE, Ubuntu, Amazon Linux 2
• Containers: Docker, Kubernetes

AWS

• AWS SageMaker | AWS Lambda | AWS EC2 | AWS Elastic Inference
• AWS Graviton 2 | AWS Inferentia

General Benchmarks

• SPEC - SPEC CPU 2017, SPEC OMP 2012, SPEC MPI 2007