Transformer related optimization, including BERT, GPT

该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记

LightSeq: A High Performance Library for Sequence Processing and Generation

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Fast implementation of BERT inference directly on NVIDIA (CUDA, CUBLAS) and Intel MKL

Running BERT without Padding

optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052

C++ model train&inference framework

BERT for Finance : UC Berkeley MIDS w266 Final Project

A tutorial of building tensorflow serving service from scratch

implement bert in pure c++

Method for searching relevant podcast segments from transcripts using transformer models

Dutch/Indonesian BERT-NER setup.

Code repository for the research paper "Space Efficient Transformer Neural Network"