The output is all zeros

[BoMingZhao]

Hi.
After rendering, the output keypoints are all 0. Is there any possible error that could cause this problem？

[chingswy]

Please add flag --vis_det --vis_repro --vis_smpl --verbose for debug and provide more information.

[BoMingZhao]

So I find something strange, my output detec file have no skeleton on the body

And the repro is like this：

I added flag --vis_det --vis_repro --vis_smpl --verbose for debug, it's just output loss functions.

[chingswy]

The unit of extrinsic parameters must be meter. You should check it.

[BoMingZhao]

The unit of extrinsic parameters must be meter. You should check it.

sorry, what resolution do your data use?

[chingswy]

We use 1024x1024 or 1920x1080

[BoMingZhao]

We use 1024x1024 or 1920x1080

Will it work if I change MAX_REPRO_ERROR? Because I found that check_repro_error sets all keypoints to 0.(I use 512 * 512 data)

[chingswy]

You can try it.

[BoMingZhao]

I fixed some intri parameters bug and got this repro. It seems that keypoints3D is not very accurate, and I can’t render the smpl model either

[gcgeng]

Hi Boming, I suspect that your camera parameter still has some errors, please carefully check them in rendering.
Here are some of the expected results if your parameters are correct:

[BoMingZhao]

Hi Boming, I suspect that your camera parameter still has some errors, please carefully check them in rendering.
Here are some of the expected results if your parameters are correct:

thanks! I'll check it.

[BoMingZhao]

I think I have found the problem. My openpose reverses the left and right hands when detecting some frames. And now I can render smpl model like this.

By the way, I wonder to know whether the openpose key_points of quick start demo dataset is annotated by yourself or generated directly with openpose code?
THANKS

[chingswy]

It's generated directly with openpose code. See scripts/preprocess/extract_video.py for more details.

[BoMingZhao]

我尝试去寻找相机参数的bug，但看起来相机参数好像真的找不出bug了，我现在keypoints 2d如下图，上面的三张可以看出整个人和keypoints是左右相反的，但下面的keypoints看起来比较准确。

因此我尝试去修复openpose把左右手搞错的bug，我用数据集自带的点纠正了这些错误的点，并存为json重新运行。但还是和上图一样。
我又对输入的keypoints 2d做了visualize，如下图。


然后发现也没问题，如果输入的2d keypoints，那算出的3d keypoints也应当是对的啊。
此外相机参数如果有问题，不太确定为何会出现有的view对有的不对。
所以想请教一下还有什么可能的bug吗？十分感谢！

[gcgeng]

我尝试去寻找相机参数的bug，但看起来相机参数好像真的找不出bug了，我现在keypoints 2d如下图，上面的三张可以看出整个人和keypoints是左右相反的，但下面的keypoints看起来比较准确。

因此我尝试去修复openpose把左右手搞错的bug，我用数据集自带的点纠正了这些错误的点，并存为json重新运行。但还是和上图一样。
我又对输入的keypoints 2d做了visualize，如下图。


然后发现也没问题，如果输入的2d keypoints，那算出的3d keypoints也应当是对的啊。
此外相机参数如果有问题，不太确定为何会出现有的view对有的不对。
所以想请教一下还有什么可能的bug吗？十分感谢！

Hi Boming, could you describe how you rendered your data? Seems that your data is synthesized rather than captured. Please pay attention to the fact that the definition of camera parameter in CG community and CV community is different, which may cause bugs.

[BoMingZhao]

我尝试去寻找相机参数的bug，但看起来相机参数好像真的找不出bug了，我现在keypoints 2d如下图，上面的三张可以看出整个人和keypoints是左右相反的，但下面的keypoints看起来比较准确。

因此我尝试去修复openpose把左右手搞错的bug，我用数据集自带的点纠正了这些错误的点，并存为json重新运行。但还是和上图一样。
我又对输入的keypoints 2d做了visualize，如下图。


然后发现也没问题，如果输入的2d keypoints，那算出的3d keypoints也应当是对的啊。
此外相机参数如果有问题，不太确定为何会出现有的view对有的不对。
所以想请教一下还有什么可能的bug吗？十分感谢！

Hi Boming, could you describe how you rendered your data? Seems that your data is synthesized rather than captured. Please pay attention to the fact that the definition of camera parameter in CG community and CV community is different, which may cause bugs.

Yes, this is a synthetic data downloaded from the renderpeople dataset.
Thank you very much, I will pay attention!

[BoMingZhao]

我尝试去寻找相机参数的bug，但看起来相机参数好像真的找不出bug了，我现在keypoints 2d如下图，上面的三张可以看出整个人和keypoints是左右相反的，但下面的keypoints看起来比较准确。

因此我尝试去修复openpose把左右手搞错的bug，我用数据集自带的点纠正了这些错误的点，并存为json重新运行。但还是和上图一样。
我又对输入的keypoints 2d做了visualize，如下图。


然后发现也没问题，如果输入的2d keypoints，那算出的3d keypoints也应当是对的啊。
此外相机参数如果有问题，不太确定为何会出现有的view对有的不对。
所以想请教一下还有什么可能的bug吗？十分感谢！

Hi Boming, could you describe how you rendered your data? Seems that your data is synthesized rather than captured. Please pay attention to the fact that the definition of camera parameter in CG community and CV community is different, which may cause bugs.

I have solved the problem, thank you and your excellent work!

[ghost]

The unit of extrinsic parameters must be meter. You should check it.

sorry, what resolution do your data use?

Hey, would you please tell me if the resolution is different from that set by the author, will there be any influence on the reprojection result?

[puppet101]

@BoMingZhao 你好，我也遇到了同样的问题，3d关键点都是0，请问你是怎么解决的呢？

[Langwenchong]

@puppet101 你好我现在也是这个问题，请问你现在解决了吗，可以请教一下吗