TFLite Latency Estimator

This is one of Mediapipe opensource project from Google Summer of Code.

It is about latency estimator which is able to get each of convolution layer's estimated latency time.

1. How to use

install packages

pip install -r requirements.txt

run tflite latency estimator

python -m estimator.py --path {TFLITE_MODEL_PATH}

result

2. Model Information

This estimation model uses 3 kind of regression model and ensembled them.

• XGBoost
• (Scikitlearn) RandomForestRegressor
• (Scikitlearn) DecisionTreeRegressor

3. Data used for learning

Combinations of below's list

• kernel : [1, 2, 3, 5]
• filter : [16, 32, 64, 128, 256]
• input_h : [8, 16, 32, 64]
• input_w : [8, 16, 32, 64]
• input_channel : [16, 32, 48]
• stride : [1, 2, 3]

And also got one convolution models from real DCNN models.

• Densenet, MobileNet from tflite model zoo
• face_detection
• hair_segmentation

Etc.

• Mobile Device used to measure latency : Galaxy s6