SpoutCam not working in Mediapipe tox

[yiwen212]

Hi Torin and Dom, Thanks for all amazing tool. Making it easy for beginners to get started.
I have some problems while using webcam with SpoutCam. I selected 'webcam' in videofilein TOP, and selected 'SpoutCam' in the Mediapipe tox. Both of the resolutions are set to 1280 x 720. However, the Mediapipe window shows RGB noise.

When I use laptop cam and obs in Mediapipe tox, it is successful. Using the webcam, Mediapipe window have image but not working.

I also tried changing the port to 3002, but not working.

I found an interesting part: when I select 'SpoutCam' in Mediapipe tox, window shows RGB noise. However, when I open videofilein TOP and also select 'SpoutCam', videofilein TOP shows the image.

These are the images that I tried loading http://localhost:9222/.
Select 'webcam' in Mediapipe tox

Select 'SpoutCam' in Mediapipe tox

TD Version：2022.33910, 2022.35280
MediaPipe TD Release：v0.2.2
System：Windows 11

If there's anything I haven't noticed or done wrong, please let me know! Thank you for your guidance!

[jossevessies]

Hi Yiwen, have you tried changing the byte size to 8-bit (fixed) rgba?
For me this was a solution.

also I didn’t realize before, but in the mediapipe.toe file that comes with the project Torin and Dom added a spoutout top. Of course disable this feed-out to use your own in the right spout channel name.

[yiwen212]

Hi jossevessies, I got it. I'll give it a try. Thank you very much!!

[yiwen212]

Hi, @jossevessies ! I tried changing the byte size to 8-bit (fixed) rgba in the spoutout top, but it still not working.
I recorded the process so that I can check my steps more easily if something isn't right!
I used another logi 720p webcam is woking!!! yeah!!! However, the entire image is offset. It's good for me already!

Still want to know why SpoutCam didn't work. If there's anything I haven't noticed or done wrong, please let me know!
Thanks again for your help!
https://github.com/torinmb/mediapipe-touchdesigner/assets/147087782/71fa9ac7-2a47-491d-9741-60c3974e4d81

[Truen224]

I have the same issue. Version I'm running is 2022.33910
I attempted to use MovieFileIn TOP to SyphonSpoutOut TOP and then to Mediapipe, but it seems like Mediapipe cannot receive the Spout Cam (although it works with VideoDeviceIn).

I'm not sure what went wrong...

Additionally, a big thank you to Torin and Dom for your amazing work and selfless sharing. I've been trying to integrate Mediapipe with for several months TouchDesigner without success. Your help has been immensely valuable to me!

[domisjustanumber]

Hey everyone, thanks for trying to figure this one out - it's something I sometimes get too and I'm not sure why. I think it's related to SpoutCam not always initialising properly but I'm not sure. The only way I've found to fix it so far is to close TouchDesigner, re-open it and then it will work.

I've tried reloading the MP component and disabling the SyphonSpoutOut and re-enabling, but that doesn't seem to do it, so I'm not sure what the root cause is, but if anyone figures it would we might be able to put something in that can restart whatever is causing it to fail.

[Truen224]

Thank you for your response!
I have tried using NDI WebCamera and successfully imported the video. However, I couldn't get Mediapipe to detect people's movements in the video.

↑ When using my WebCam

↑ Using the NDI WebCam, it appears that the video has been successfully imported, but no detection can be performed.

Could you kindly take a moment to review and identify where the issue might be occurring?

[domisjustanumber]

Hi @Truen224 sorry I missed your reply earlier. If you are still having issues, we have a new release that has many fixes and may solve your problem https://github.com/torinmb/mediapipe-touchdesigner/releases/tag/v0.3.2

[domisjustanumber]

Closing this one for now, please re-open if you have any other issues

[vVattghern]

I was facing a similar issue with Mediapipe only giving me a noisy SpoutCam output. Any changes made in TouchDesigner or by changing plugin versions (for both this plugin and Mediapipe) did not yield any success. I'm adding a comment here because I was eventually able to fix it and want to note it down, in case anyone else faces the same problem:

For diagnosing the issue, I recommend downloading the Spout2 files from the same GitHub profile as the SpoutCam Plugin. This adds some settings and diagnostics options when working with Spout. In my case, my laptop graphics proved to be the problem! When running diagnostics, checking for compatibility and looking at the running spout cam process (all possible through the SpoutPanel and SpoutSettings) it told me that the texture sharing was failing, thus resulting in the noise. After reading through the SpoutSettings and their explanations (not the SpoutCamSettings!), I made sure to put all processes involving spout (so sender & receiver) on the same graphics pipeline (by changing the .exe graphic settings in Windows, this is explained in SpoutSettings), since my laptop has both integrated CPU graphics, as well as a GPU.

This actually fixed my issue!

So for anyone that has a laptop, multiple GPUs or any other Spout issues in combination with this TouchDesigner plugin, I recommend downloading the rest of the Spout software and tinkering a bit.

[domisjustanumber]

Oh wow, thanks for digging into this @vVattghern! I'll add this to the Readme to help people down the road!

[domisjustanumber]

@Ayeshmantha-Maduranga does this solve your issue at all?