Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add complex benchmarks to vHive #236

Closed
ustiugov opened this issue May 12, 2021 · 2 comments
Closed

Add complex benchmarks to vHive #236

ustiugov opened this issue May 12, 2021 · 2 comments
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
vHive Roadmap
Milestone
Benchmarking at s...

Comments

@ustiugov
Copy link
Member

ustiugov commented May 12, 2021 •
edited

We plan to add more reprepresentative benchmarks to vHive framework, particularly, multi-function apps, apps with various serverful components (e.g., Apache Kafka), data-intensive apps, apps with complex control and data flow.

The confirmed list of functions with committed contributors:

Function name Status Contributor Type Knative infra Link
serving ubench done core team example serving link
eventing ubench done core team example eventing link
Video Analytics done core team data-intensive serving link
MapReduce (Corral) done core team data-intensive serving link
gg laptop-to-Lambda wip Stanford complex dataflow, parallel serving #370
Anomaly detection scheduled individual, AWS Hero parallel serving or eventing
Stacking ensemble training wip individual, AWS Hero parallel serving #365
Iterative RandomForest training wip core team parallel serving
ML ETL pipelines scheduled ETH serving
Latency-critical wip core team auth, encrypt, etc. serving

Next steps: genome sequencing, other ETL pipelines.
@ustiugov ustiugov added the enhancement New feature or request label May 12, 2021
@ustiugov ustiugov added this to the Benchmarking at scale milestone May 12, 2021
@ustiugov ustiugov added this to In progress in vHive Roadmap May 12, 2021
@ustiugov
Copy link
Member Author

We welcome the contributions from the open community here! Please get in touch if you would like to add your benchmarks or request particular benchmarks to be added.

@ustiugov ustiugov added the help wanted Extra attention is needed label May 12, 2021
@ustiugov ustiugov changed the title [Researching] Add complex benchmarks Add complex benchmarks to vHive Jul 1, 2021
@ustiugov
Copy link
Member Author

ustiugov commented Oct 7, 2021

the benchmarks (beta mode) are public in the vSwarm repo.

@ustiugov ustiugov closed this as completed Oct 7, 2021
vHive Roadmap automation moved this from In progress to Done Oct 7, 2021
@dhschall dhschall mentioned this issue Dec 22, 2021
Closed
HermioneKT added a commit that referenced this issue Jan 31, 2024
@HermioneKT
# This is a combination of 252 commits.
3c6919f 
parent 6674807
author HermioneKT <hermionegrangerkt@gmail.com> 1706694164 +0800
committer HermioneKT <hermionegrangerkt@gmail.com> 1706694164 +0800

test

# This is the commit message #157:

test

# This is the commit message #159:

test

# This is the commit message #160:

test

# This is the commit message #161:

test

# This is the commit message #162:

test

# This is the commit message #163:

test

# This is the commit message #164:

tesT

# This is the commit message #165:

test

# This is the commit message #166:

test

# This is the commit message #167:

test

# This is the commit message #168:

test

# This is the commit message #169:

test

# This is the commit message #170:

test

# This is the commit message #171:

Test

# This is the commit message #172:

test

# This is the commit message #173:

test

# This is the commit message #174:

test

# This is the commit message #175:

test

# This is the commit message #176:

test

# This is the commit message #177:

test

# This is the commit message #178:

test

# This is the commit message #179:

test

# This is the commit message #180:

test

# This is the commit message #181:

test

# This is the commit message #182:

test

# This is the commit message #183:

test

# This is the commit message #184:

test

# This is the commit message #185:

test

# This is the commit message #186:

test

# This is the commit message #187:

test

# This is the commit message #188:

test

# This is the commit message #189:

test

# This is the commit message #190:

Test

# This is the commit message #191:

Test

# This is the commit message #192:

test

# This is the commit message #193:

Test

# This is the commit message #194:

test

# This is the commit message #195:

test

# This is the commit message #196:

test

# This is the commit message #197:

test

# This is the commit message #198:

test

# This is the commit message #199:

Test

# This is the commit message #200:

test

# This is the commit message #201:

test

# This is the commit message #202:

Test

# This is the commit message #203:

test

# This is the commit message #204:

test

# This is the commit message #205:

test

# This is the commit message #206:

test

# This is the commit message #207:

test

# This is the commit message #208:

test

# This is the commit message #209:

test

# This is the commit message #210:

test

# This is the commit message #211:

Test

# This is the commit message #212:

test

# This is the commit message #213:

Test

# This is the commit message #214:

Test

# This is the commit message #215:

Test

# This is the commit message #216:

test

# This is the commit message #217:

Test

# This is the commit message #218:

test

# This is the commit message #219:

test

# This is the commit message #220:

test

# This is the commit message #221:

test

# This is the commit message #222:

test

# This is the commit message #223:

test

# This is the commit message #224:

test

# This is the commit message #225:

test

# This is the commit message #226:

test

# This is the commit message #227:

test

# This is the commit message #228:

test

# This is the commit message #229:

Test

# This is the commit message #230:

test

# This is the commit message #231:

test

# This is the commit message #232:

test

# This is the commit message #233:

test

# This is the commit message #234:

Test

# This is the commit message #235:

test

# This is the commit message #236:

test

# This is the commit message #237:

test

# This is the commit message #238:

test

# This is the commit message #239:

test

# This is the commit message #240:

test

# This is the commit message #241:

test

# This is the commit message #242:

test

# This is the commit message #243:

test

# This is the commit message #244:

test

# This is the commit message #245:

test

# This is the commit message #246:

test

# This is the commit message #247:

test

# This is the commit message #248:

test

# This is the commit message #249:

test

# This is the commit message #250:

test

# This is the commit message #251:

test

# This is the commit message #252:

test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
vHive Roadmap
  
Done
Milestone
Benchmarking at scale
Development

No branches or pull requests
1 participant
@ustiugov