Fullstack computer vision engineer specializing in deploying models on edge devices for real-time inference.
Explore my webpage »
Projects · Blogs · LinkedIn · X · About
-000000?style=for-the-badge&logo=x&logoColor=white){kind=icon}
|
Accelerate inference speed for PyTorch image models using ONNX Runtime and TensorRT optimizations. Achieve up to 123x speedup over the original PyTorch model on CPU. 📅 September 30, 2024 |
|
PyTorch at the Edge: Deploying Over 964 TIMM Models on Android with TorchScript and Flutter. Deploy PyTorch models on Android using TIMM, Fastai, TorchScript, and Flutter. Select a model from TIMM's 900+ models, train with Fastai, export to TorchScript, and create an Android app with Flutter for inference. 📅 February 7, 2023 |
|
Supercharging YOLOv5: How I Got 182.4 FPS Inference Without a GPU. Optimize YOLOv5 model for CPU inference using Neural Magic's SparseML and DeepSparse. Train on custom data, apply sparsification techniques like pruning and quantization, and achieve up to 180+ FPS on a CPU with only 4 cores. 📅 June 7, 2022 |
|
Faster than GPU: How to 10x your Object Detection Model and Deploy on CPU at 50+ FPS. Optimize a YOLOX object detection model deploy on a CPU. Train with custom data, convert to ONNX and OpenVINO IR formats, and apply post-training quantization. This results in a 10x speed improvement, making real-time inference possible on CPU, even outperforming GPU performance. 📅 April 30, 2022 |
- x.infer
- Framework agnostic computer vision inference. Ever wanted to deploy new computer vision models without the hassle of learning new frameworks? This is for you!
- pgmmr - Vector/Hybrid Search & Retrieval on PostgreSQL database your favorite Vision Language Model.
I was listed in GitHub's trending developers list (October 28th, 2024) for my open-source work x.infer! Thank you for supporting my work!
Deep Learning Frameworks:
Hyperparameter Optimization:
Experiment Management:
Model Deployment:
Hardware:
Software Engineering:
Data:
Frontend:
|
|
|
|---|---|
|
|
|
|
|
|
Creating free machine learning contents doesn't pay my bills. Support me in creating more free contents like these. Consider buying me a coffee. Your support means a lot to me.
