Some excellent demo

[lucasjinreal]

Hi, just post some FBX (not rending, in real 3D) demos here, the result is impressive:

Clip_len 24

Clip_len 48

the video I tested is a very challenge one, still get some nice result!

Just still have one issue, the poses might blink in middle of frames. Do u got any thoughts? What's more, what's the best clip len here for realtime applications? (we can't using too big clip len here in realtime)

[Walter0807]

Very cool! Glad to know you've got good results.

1. You can check the 2D pose estimation results first. For example, are there some severe inconsistencies due to occlusion?
2. Jittering might also happen due to clip divisions. It might get improved with some post-processing steps (e.g. moving average with sliding window) to ensemble the predictions.
3. Yes, you can try smaller clip lengths and see how it works. Some smoothing techniques (as mentioned above) might be useful in that case.

[Walter0807]

Btw, would you mind sharing the scripts or the pipeline for exporting FBX animations? I believe it would be useful for many people. Thank you very much!

[lucasjinreal]

Sure, the script I use is from ROMP, I just save motionbert result into pickle file and same way load in ROMP.

[zhangjinyangnwpu]

We can use the script here[https://github.com/Arthur151/ROMP/blob/master/simple_romp/tools/convert2fbx.py] to export fbx

[dddyyyplus]

Sure, the script I use is from ROMP, I just save motionbert result into pickle file and same way load in ROMP.

@lucasjinreal Hi, can I ask which motionbert result you use here, 3d mesh or 3d pose estimation results? Thank you!

[TnoobT]

@lucasjinreal Hello, could you please share the script for converting the output of motionbert to the input data of convert2fbx.py. Thank you very much

[August1996]

@lucasjinreal 请问怎么用convert2fbx来转换motionBERT输出的结果。我输入使用3d pose的npy文件，但是转换失败了

[August1996]

Sure, the script I use is from ROMP, I just save motionbert result into pickle file and same way load in ROMP.当然，我使用的脚本来自 ROMP，我只是将 motionbert 结果保存到泡菜文件中，并以同样的方式加载到 ROMP 中。

这里需要修改motionBERT或者ROMP的脚本代码吗？

[DenisKochetov]

Sure, the script I use is from ROMP, I just save motionbert result into pickle file and same way load in ROMP.当然，我使用的脚本来自 ROMP，我只是将 motionbert 结果保存到泡菜文件中，并以同样的方式加载到 ROMP 中。

这里需要修改motionBERT或者ROMP的脚本代码吗？

Hi, did you find out how to convert it to fbx?

[HoangNguyenHuu]

Sure, the script I use is from ROMP, I just save motionbert result into pickle file and same way load in ROMP.

Thanks for this great work!
@lucasjinreal, @Walter0807. Hi, I have questions. ROMP export to SMPL 24 joints, MotionBert export to H36M 17 joints . How do you save MotionBERT output into a pickle file like ROMP output?
In ROMP, results have "cam_trans" data, how to get it in MotionBERT.
Thank you very much!

[August1996]

cam_trans

You can reference this link

[DenisKochetov]

Thank you, recently found same code in the original video2bvh

cam_trans

You can reference this link