Proposal: Tooling to enable micro benchmarks for GPU/MSMs

[FoodChain1028]

General Grant Proposal

• Project: Tooling to enable micro benchmarks for GPU/MSMs #22

Project Overview 📄

Overview

Implement micro benchmarking tooling for doing MSMs/using GPU on Mobile.

Refer to following for detail

• Proving with GPU on mobile oskarth/mopro#22
• Implement micro benchmarking tooling for doing MSMs/using GPU on Mobile oskarth/mopro#21

Project Details

• implement a basic tooling on real iOS device
• provide documention to benchmarks and instructions to the usage of tooling

Team 👥

Team members

• Names of team members

  • Fu-Chuan Chung
  • Moven Tsai

• Discord handle

  • foodchain1028
  • moventsai

• Email

  • sh1001309@gmail.com
  • moven0831@gmail.com

Team's experience

• Fu-Chuan Chung
  • PSE ZK Summer Open-source Contribution Program Fellow
• Moven Tsai
  • PSE ZK Summer Open-source Contribution Program Fellow

Team Code Repos

• https://github.com/FoodChain1028/mopro-21

Development Roadmap 🔩

Overview

• Total Estimated Duration: Duration of the whole project
• Full-time equivalent (FTE): Workload of an employed person (see)
• Estimated start date: Jan 11st 2024

Milestone 1: run_msm_bench() development, Arkworks MSM integration, FFI & UDL extension.

• Estimated Duration: 1 month
• Estimated delivery date: Feb 11st 2024
• FTE: 0.6
• FTE for us: 12 + 12

Milestone 2: Swift testing on a laptop, initial performance analysis

• Estimated Duration: 0.5 month
• Estimated delivery date: Feb 25th 2024
• FTE: 0.6
• FTE for us: 12 + 12

Milestone 3: iOS app integration, real-device testing, and benchmarks documentation

• Estimated Duration: 1.5 month
• Estimated delivery date: Apr 11st 2024
• FTE: 0.75
• FTE for us: 15 + 15

Deliverables and Specifications

0a. Codebase

We plan to develop a micro benchmarking tool for further enhancements in mopro project. Therefore, we expect the codebase is suitable to integrate back into the mopro project. We have initiated the main work in gpu_explorations directory in mopro-core.

0b. Documentation

We will ensure that all modifications are thoroughly documented. This includes detailed guidelines in the README for running the tool, along with the initial benchmarks observed on an iOS device. Our documentation will clearly explain the purpose and usage of each component, making it easier for future integrations and enhancements.

0c. Testing Guide

we aim to develope a Swift test to assess initial performance on a laptop. This is a precursor to the more crucial phase of testing on an actual iOS device, which will provide real-world performance metrics. We are outlining a comprehensive testing guide that includes procedures for Swift testing on laptops and detailed steps for running the tool on iOS devices. This guide also establishes benchmarking standards for recording and interpreting performance in various testing environments

Additional Information ➕

We have partially completed Milestone 1, which can be seen here

[FoodChain1028]

Hi @NOOMA-42 @oskarth,
@moven0831 and I had finished our proposal, please have a look.

[oskarth]

Looks good to me!