Support for post-processing

[markuzo]

Hi!

The documentation in PerceptionCamera.md states that post-processing is not supported. Are there plans to support this or should any post-processing take place after the image generation with Unity entirely?

I see that the post-processing effects do affect the visualization in both the Editor and Standalone Player, however, the captured RGB images do not have any of those effects.

[JonathanHUnity]

Thank you for the report, we have confirmed this is a regression in the latest perception package. We hope to address this problem quickly.

[JonathanHUnity]

An update to the com.unity.simulation.capture package has been released which addresses this issue. In the package manager in your project, upgrade "Unity Simulation Capture" to com.unity.simulation.capture@0.0.10-preview.22

[markuzo]

I can confirm that the RGB captures now have the post-processing information in them, however, they are all flipped in Y. This inverting doesn't affect the InstanceSegmentation capture and only affects preview.22 (I tried preview.21 and the RGB captures were the right way up, but the post-processing stuff was gone). The images displayed in the Editor while in Play mode do not have a flip in the Y.

[mannewalis]

Which platform, graphics api, and pipeline are you using?

[markuzo]

I saw this issue on Windows, Unity 2020.3.3f1, URP, DX11. I normally build to Linux64 and MacUniversal, but I didn't test if it happens on these platforms as well.

[mannewalis]

Hi again, which version of the perception package are you currently using?

[markuzo]

"com.unity.perception": "0.8.0-preview.3". When trying the new version of com.unity.simulation.capture I didn't change anything with the perception package.

[mannewalis]

Hi again, so I am having some trouble reproducing this. I am using TestProjects/PerceptionURP on Windows with Unity 2020.3.3f1, and building a standalone app. The images so far are correct. I am wondering if there are some other differences between our projects that account for this. Can you give me a little more info on how you're setting up the perception package, and which settings are enabled/disabled, or even better, perhaps you could share part of your project, and I can try to diagnose the issue.

[markuzo]

Exactly the same issue with reproducing the problem.

In the same environment in a new Unity project, I couldn't reproduce the issue. Then I created a new scene in the same Unity project that is showing the issue, and got to the point where everything is identical to the problematic scene, but no issue. So in the same project, I have 2 seemingly identical scenes, one exhibiting the problem, and the other not.

Closing the issue. I hope to reproduce it at some point, and will make a new issue accordingly.

[ChumbaWambalala]

I'm experiencing the issue as well. Output images doesn't contain any post processing.
Unity 2020.3.3f1 and Perception Package 0.8.0-preview.3 - March 24, 2021

Here is what I'm expecting. Don't mind the characters :D

Here is a sample output.

URP Settings

Forward Renderer Settings

Camera Settings

I tired the workarounds from this thread and nothing seems to be working.
Any help is much appreciated

[sleal-unity]

Hi @ChumbaWambalala!

I can confirm that I've reproduced your issue and that the we've got a patch release (0.8.0-preview.4) coming soon for the perception package that will include a fix for this particular issue.

[sleal-unity]

Here's a synopsis of the problems I've confirmed:

• The current perception release (version 0.8.0-preview.3) has a dependency on the com.unity.simulation.capture package (version 0.0.10-preview.20)
• This version of the capture package, preview.20, as well as preview.21 have an issue of not capturing post processing effects
• The capture package version of preview.22 fixes this issue, but flips all rendered images upside down when the camera's anti-aliasing setting is set to None while post processing effects are enabled
• Finally, we have a new capture package version preview.23 that fixes all the issues being released very soon
• The perception package will also receive a patch update soon to upgrade its capture package dependency to preview.23 once it is available