Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generating instructions #7

Open
GumGum10 opened this issue Oct 1, 2023 · 14 comments
Open

Generating instructions #7

GumGum10 opened this issue Oct 1, 2023 · 14 comments

Comments

@GumGum10
Copy link

GumGum10 commented Oct 1, 2023

Hi and thank you so much for your work! It is truly breathtaking!

I've been trying to test this myself but I'm running into many issues with the pretrained weight, mainly I cannot get any video input to work. I've debugged and can read the video file just fine, but afterwards it does not generate anything.
I'm getting frames and labels lenghts 0 as well so I was just wondering if there are any tips on running this locally with Python?

Cheers!

@Fannovel16
Copy link

@Lylo01 Did you generate "vector graph" (aka vectorization of the lineart)?

@hyw-dev
Copy link

hyw-dev commented Oct 1, 2023

@Lylo01 Did you generate "vector graph" (aka vectorization of the lineart)?

Do you have a method to generate a vector graph?

@Fannovel16
Copy link

Fannovel16 commented Oct 1, 2023

@hyw-dev In the paper, the author used https://github.com/MarkMoHR/virtual_sketching. I'm currently finding a way to run it on Colab.

@hyw-dev
Copy link

hyw-dev commented Oct 1, 2023

@hyw-dev In the paper, the author used https://github.com/MarkMoHR/virtual_sketching. I'm currently finding a way to run it on Colab.

I'm thinking about can virtual_sketching directly generate JSON files containing three parameters: vertex, connection, and original index?

@Fannovel16
Copy link

@hyw-dev Afaik, the original index isn't necessary for inference. It can generate vertex and connection but it can't generate JSON output directly.

@hyw-dev
Copy link

hyw-dev commented Oct 1, 2023

@hyw-dev Afaik, the original index isn't necessary for inference. It can generate vertex and connection but it can't generate JSON output directly.

Thank you for your reply. I'll also try it out

@jojokic
Copy link

jojokic commented Oct 6, 2023

@hyw-dev Afaik, the original index isn't necessary for inference. It can generate vertex and connection but it can't generate JSON output directly.

Thank you for your reply. I'll also try it out

hi,i have vector graph picture,then how can i use it?

@jojokic
Copy link

jojokic commented Oct 6, 2023

@Lylo01 Did you generate "vector graph" (aka vectorization of the lineart)?

hi,i have vector graph picture,then how can i use it?

@hyw-dev
Copy link

hyw-dev commented Oct 6, 2023

@hyw-dev Afaik, the original index isn't necessary for inference. It can generate vertex and connection but it can't generate JSON output directly.

Thank you for your reply. I'll also try it out

hi,i have vector graph picture,then how can i use it?

After I used virtual_sketching to generate the svg file(vector graph), I found that the svg contained quadratic Bezier curves. I calculated many points through formulas to replace them, and converted them into vertices and connections.Next it takes time to make some modifications to animeinbet's code to allow input of one's own data.
I can only calculate the correct effect on their datasets but cannot calculate the correct effect on my own data(btw i think the problem is mainly in sketch extraction), I will share my code after I have finished organizing it.

@jojokic
Copy link

jojokic commented Oct 7, 2023

Afaik,原始索引不是推理所必需的。它可以生成顶点和连接,但不能直接生成 JSON 输出。

感谢您的回复。我也会尝试一下

嗨,我有矢量图图片,那我该如何使用它?

在我用virtual_sketching生成svg文件(矢量图)后,我发现svg包含二次贝塞尔曲线。我通过公式计算了许多点来替换它们,并将它们转换为顶点和连接。接下来,需要对animeinbet的代码进行一些修改,以允许输入自己的数据。我只能计算对他们的数据集的正确效果,但无法计算对我自己的数据的正确效果(顺便说一句,我认为问题主要出在草图提取中),我将在完成组织后分享我的代码。

thanks,Waiting for your good news

@trouble-maker007
Copy link

@hyw-dev I think use this one to generate svg file should be a better choice: https://github.com/ivanpuhachov/line-drawing-vectorization-polyvector-flow, but this code depend on a library Gurobi, that is not open source

@niqodea
Copy link

niqodea commented Dec 7, 2023

I also am curious about how to reproduce inference for custom data. I tried converting SVGs to a seemingly matching format with a script I wrote to no avail. The output of the model is just a blank image. It might also be the case that I introduced some bugs in the repository when changing the logic to accomodate custom inputs that do not rely on 3D models (which, as far as I understood, is something possible to do). Would be nice if someone shared a guide on how to consistently do this!

@hyw-dev, do you have any update on the code you were working on? Thank you 🙏

@michaelhzj
Copy link

@hyw-dev Afaik, the original index isn't necessary for inference. It can generate vertex and connection but it can't generate JSON output directly.

Thank you for your reply. I'll also try it out

hi,i have vector graph picture,then how can i use it?

After I used virtual_sketching to generate the svg file(vector graph), I found that the svg contained quadratic Bezier curves. I calculated many points through formulas to replace them, and converted them into vertices and connections.Next it takes time to make some modifications to animeinbet's code to allow input of one's own data. I can only calculate the correct effect on their datasets but cannot calculate the correct effect on my own data(btw i think the problem is mainly in sketch extraction), I will share my code after I have finished organizing it.

We are also attempting to perform inference using our own dataset. If possible, we would like to establish a communication channel to collaborate on improving the code together. Alternatively, if you have already implemented this functionality, we would be interested in obtaining this portion of the code for compensation.
wait for your feed back

@yosefk
Copy link

yosefk commented Apr 15, 2024

For what it's worth, I have code + small patches for feeding data to AnimeInbet. I wouldn't call it pretty or otherwise great, but might be better than nothing for some uses. I'm here to answer any questions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants