Skip to content

mfkiwl/KernelGeneration

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

KernelGeneration

KernelGeneration is a repository created to evaluate GPU kernel metrics, including:

  • correctness
  • performance
  • portability

Project Structure (Before Cloning)

kernelGen/
├── README.md
├── install.py
└── operators/
    ├── bf16_layernorm/
    └── bf16_matmul/
  • install.py — script to install dependencies, copy operators, and clone TritonBench and KernelLLM
  • operators/ — contains GPU kernel operators
  • TODO/WIP: run_benchmarks.py — script to run all operators and collect results into a JSON file for analysis.

Evaluated Kernels

  • MatMul
  • LayerNorm - WIP add KernelLLM
  • WIP: GELU

Backend Tested:

  • TorchInductor
  • Triton
  • KernelLLM
  • WIP: Mako (based on kernelLLM)

Tested on: TritonBench

Usage

Run the setup and operator installation script:

python install.py

About

Experimental evaluation of GPU kernels (MatMul, LayerNorm, GELU) across multiple backends. Operators are adapted from tutorials and examples and modified for this study.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • Python 100.0%