FMC on Greyscale Videos

[DestroytheCity]

Hello! We are running into an issue in which FMC seems to be swapping the skeletons generated from one camera onto the view of another camera (see video). Is this a potential result of using greyscale cameras? The calibration seems to work fine as the video generated reflects accurate skeletons, just placed on the wrong camera (ie camera 1 generates skeleton 1, but skeleton 1 is placed onto the view of camera 3). Has anyone encountered similar issues/have any suggestions on how to resolve this issue? Thank you in advance!

testrun1_animVid.mp4

[jonmatthis]

By any chance - did you calibrate with a different number of cameras than you are using here?

In the session folder - open up the ...camera_calibration.toml and see how many camera objects are listed - If it doesn't match the number of cameras you are using here, that might lead to this error.

If you know which camera is which in the calibration file, you can try deleting the unused cameras and then re-processing.

You might have luck re-processing with the alpha GUI - https://github.com/freemocap/freemocap#how-to-run-the-alpha-gui

You can run the GUI and use the import videos option to load in the SynchedVideos folder from the previous run through.

You can then load in your altered calibration toml in the Calibration tab, and then select Process All in the Record and Process Videos tab (or whatever I named it 😂 )

[jonmatthis]

ohh, think I know what's happening!

Looking at the Drive folder from the other Issue - https://drive.google.com/drive/folders/1wv4RHzPFDLeIXr9xONC72fhbW3MKQT_q?usp=sharing

...I see that you've altered the folder names and alot of the sessions are just called sesh - I think that's messing up something in the calibration system and causing it to load the wrong files at some point in the process.

I think the easiest thing for you now is to re-process the videos from these recordings with the alpha GUI - it's not totally fully tested yet, but hopefully it will help you move forward with your project.

Give me a moment to write up a quick How-To guide on a workflow you can use to re-process your existing videos

[DestroytheCity]

Makes a lot of sense! Thank you so much for doing that. All of our videos are pre-recorded (using external cameras) that are already synced.

[jonmatthis]

Ok - Give this a shot and let me know how it goes!

https://freemocap.readthedocs.io/en/latest/How_to_Guides/how_to_process_previously_recorded_videos/

[DestroytheCity]

Wow @jonmatthis working perfectly. Still working out some kinks w/blender but the output is amazing. In awe right now 🥲

[jonmatthis]

Thank you so much for this comment and your work/interest in this project!

And come join the discord, if you like :D