Skip to content

v1.0.1-ae (Artifact Evaluation Release)

Choose a tag to compare

@Makiras Makiras released this 10 Apr 02:51
· 3 commits to master since this release

πŸš€ Overview
This is the initial release for the Artifact Evaluation (AE) of our paper. This repository provides a complete environment and automated scripts to reproduce the performance
comparison experiments between different verification methodologies.

πŸ›  Key Features

  • Experiment Group A: Comprehensive comparison among cocotb, python-dpi, python-vpi, and python-mem_direct.
  • Experiment Group B: Multilang performance analysis across raw-verilator, python, cpp, java, and golang.
  • Hardware Targets: Supported DUTs include Rocket (SimTop), coupledL2 (TestTop), and XS (SimTop).
  • Optimized for AE:
    • Dockerized Environment: Fully containerized setup via ghcr.io/makiras/unitychipexp:latest or local Dockerfile for a "one-click" experience.

πŸ“‹ Quick Start for Reviewers

  1. Pull Docker Image: sudo docker pull ghcr.io/makiras/unitychipexp:latest
  2. Run Experiments:
    • Follow the Reproduction Guide in README.md.
    • Use ./scripts/run_experiments.py to automate the benchmarking process.
  3. Analyze Results: Metrics and logs are automatically generated in the results/ directory.
sudo docker pull ghcr.io/makiras/unitychipexp:latest
sudo docker run --rm -it ghcr.io/makiras/unitychipexp:latest

cd /home/xyl/exp
# It may be necessary to adjust the taskset CPU core number.
# Quick Check
./scripts/A_without_XS.sh
./scripts/B_without_XS.sh
# Full Check ( more than 1 days )
# ./scripts/A_with_XS.sh
# ./scripts/B_with_XS.sh