This repository has been archived by the owner on Jan 15, 2024. It is now read-only.
[Benchmark] Improve NLP Backbone Benchmark #1473
Labels
enhancement
New feature or request
help wanted
Extra attention is needed
performance
Performance issues
Description
In GluonNLP, we introduced the benchmarking script in https://github.com/dmlc/gluon-nlp/tree/master/scripts/benchmarks.
The goal is to track the training + inference latency of common NLP backbones so that we can choose the appropriate ones for our task. This will help users train + deploy models with AWS.
Currently, we covered:
I will share the following action items that I feel are worthwhile doing:
Short-term Bug-fix + Improvement
Automation + Visualization
Longer-term Backbone Benchmarking Effort
Other longer-term efforts
@dmlc/gluon-nlp-committers
The text was updated successfully, but these errors were encountered: