Skip to content

KernelGenBench v0.2.0

Latest

Choose a tag to compare

@wbavon wbavon released this 28 Sep 09:53
e3cad63

KernelGenBench v0.2.0

Part of FlagOS 2.2.

Changes since v0.1.0 (FlagOS 2.1).

45 pull requests and 1 additional commits.

Source: v0.2.0, commit e3cad63b93af.

New Features

  • feat: auto-detect chip type in test_ops.sh (#19) by @factnn
  • Add Read the Docs configuration files (#31) by @armstrongttwalker-alt
  • feat: multi-chip cuBLAS/CANN backend for Ascend/Hygon/Iluvatar/MUSA/MetaX (#34) by @factnn
  • feat: S-Level anti-cheat sandbox with 7-layer defense system (#39) by @factnn
  • feat: update analyze.py to v6 with token analysis support (#50) by @factnn
  • feat: add MmShapeBench — 50 shapes x 2 dtypes = 100 matmul tests (#51) by @factnn
  • feat: add --base-url and --api-key to generate_kernel_and_verify.py (#52) by @factnn
  • feat(llm-track): support generic compatible API endpoints (#65) by @factnn

Improvements

  • refactor: consolidate sandbox into competition/ package, remove redundancies (#56) by @factnn

Documentation

Testing

  • test: add competition anti-cheat test suite with cheat kernels (#57) by @factnn

Bug Fixes

  • fix: register empty namespace as triton for non-PyTorch operators (#12) by @factnn
  • fix: lower iluvatar dependency versions for CoreX compatibility (#15) by @factnn
  • fix: lower ascend dependency versions for NPU container compatibility (#16) by @factnn
  • fix: wrap vllm imports with try/except for non-NVIDIA platforms (#18) by @factnn
  • fix: repair doubled try/except in vllm import wrappers (#20) by @factnn
  • fix: lower metax dependency versions for MUXI container compatibility (#21) by @factnn
  • fix: lower hygon dependency versions for DCU container compatibility (#24) by @factnn
  • fix: lower musa dependency versions for MUSA container compatibility (#25) by @factnn
  • fix: auto-set TORCH_DEVICE_BACKEND_AUTOLOAD=0 on domestic chips (#28) by @factnn
  • fix: switch anti-hack Layer 1 from blacklist to torch API whitelist (#36) by @factnn
  • fix: add import alias tracking and getattr detection to anti-hack (#37) by @factnn
  • fix: support ANTHROPIC_AUTH_TOKEN and base_url for Anthropic providers (#53) by @factnn
  • Fix linear and matmul accuracy tests (#66) by @factnn

Other

  • chore: add config.yaml with python3 default for agent_bench (#17) by @factnn
  • chore: add Apache 2.0 copyright header to all source files (#59) by @tengqm
  • Update paper PDF to arxiv version (#60) by @factnn
  • Set agent benchmark default max retries to 1 (#63) by @factnn
  • Change project license from MIT to Apache 2.0 (e18a477445e0; commit)

Contributors

Thanks to the contributors to the pull requests included in this release.