Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

burn-import: ConvTranspose support #883

Closed
npatsakula opened this issue Oct 22, 2023 · 4 comments · Fixed by #1018
Closed

burn-import: ConvTranspose support #883

npatsakula opened this issue Oct 22, 2023 · 4 comments · Fixed by #1018
Labels

Comments

@npatsakula
Copy link

npatsakula commented Oct 22, 2023

Feature description

ConvTranspose support for burn-import ONNX converter.

Feature motivation

I've tried to port onnx-ocr to burn-rs using burn-import and stuck without support of ConvTranspose (two-dimensional version).

Suggest a Solution

I tried to add support by myself and stuck with proper support of constant weights (see my PR).

@npatsakula
Copy link
Author

Hello @antimora!

Thank you for #1018.

@antimora
Copy link
Collaborator

@npatsakula, it has been successfully merged.

I recommend looking into my SqueezeNet ONNX conversation model: SqueezeNet-Burn. Note that SqueezeNet is primarily an image classification model. This version has examples of how to feed an image and utilizes an image normalizer, similar to what onnx-ocr employs.

I'm eager to see what you develop. If you're interested, we could host the model here: Tracel-AI Models. The ONNX file could be downloaded during a build process (using build.rs). I'd be happy to contribute as well.

CC: @nathanielsimard, @Luni-4

@npatsakula
Copy link
Author

@npatsakula, it has been successfully merged.

I recommend looking into my SqueezeNet ONNX conversation model: SqueezeNet-Burn. Note that SqueezeNet is primarily an image classification model. This version has examples of how to feed an image and utilizes an image normalizer, similar to what onnx-ocr employs.

I'm eager to see what you develop. If you're interested, we could host the model here: Tracel-AI Models. The ONNX file could be downloaded during a build process (using build.rs). I'd be happy to contribute as well.

CC: @nathanielsimard, @Luni-4

@antimora, thank you a lot!

I used your SqueezeNet wrapper as a source of inspiration. Unfortunately I'm a little stuck with inference results post-processing (onnx-ocr makes heavy use of PaddleOCR internals; I just don't have time to look at it properly). I plan to to get to working on this after the New Year.

I'm planning to use onnx-ocr burn wrapper for two purposes:

  1. As part of experimental unified inference backend at my work.
  2. As part of my DYI GPhotos pet project (I'm planning to open source it in Q3 2024).

@antimora
Copy link
Collaborator

antimora commented Mar 5, 2024

Linking to the issue to port into burn/models: tracel-ai/models#23

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants