-
-
Notifications
You must be signed in to change notification settings - Fork 29
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Azure Kinect support #33
Comments
I'm looking forward to this! If I can assist you (dev or test) let me know! |
Initial Azure Kinect support is done (color, depth, infrared and depth to color mapping which means the greenscreen works). I had to put a hat on because Azure Kinect has some troubles with my hair, but it flickers a lot less than v2. Shouldn't take long |
Hi looking really forward to this.. so much that I tried to build it after I added some missing parts to the conflig.lua I was able to build unfortunately it craches when I try to add the kinect Source to a scene. |
You're probably missing a few plugins files, but don't worry, packages are coming very soon! |
Here's a test package of obs-kinect with Azure Kinect support (64bits only for now): Unpack the obs-studio folder to your obs-studio folder. I've updated the README for Azure Kinect if you want to test body filtering. Please let me know how it works (or not) for you, and let me know of any bug you encounter! |
@SirLynix Thank you for taking the time and adding support the Azure Kinect so quickly. I have an additional request and offer to help: as you may know, the Azure SDK is also available for Linux (tested on Ubuntu 18.04). This is also sort of related to #9 |
Actually I planned already to release the next version of obs-kinect on Linux (with Azure Kinect support only for now, I hope to bring Kinect V1 and Kinect V2 support next), don't worry! It shouldn't be difficult, I've been thinking of supporting Linux (and macOS) since I started working on 0.3, at this point I think the code is close to ready (it doesn't rely on Windows specific code, which only exists in Sdk10 and Sdk20 backends). |
You're right, I messed up the folder name. I uploaded a fixed package in my original message. Glad to see it's working! It looks great! Did you try body tracking yet? you'll have to install Azure Kinect Body Tracking Sdk dependencies for that. And some new cool effects are coming as well #35 |
Does the Azure Kinect cause problems with its very high resolution video? 12MP - that's a lot more for the GPU to think about... |
4K video is pretty fine on my computer, even with green screen enabled (taking about 20% of GPU). Except for some lag (probably due to depth to color mapping which is pretty compute-heavy especially on 4K). |
Awesome work! Gave it a try and it works really well, also Body masking, though I disable it as it's too heavy on my GPU. |
Hello, and thank you! Yes I'm thinking of using post-processing to improve the filtering. I'm also trying to see if that can be improved at the Azure Kinect level (see here). |
Makes a ton of sense @SirLynix that it should be improved by the AK itself. Great work and glad Microsoft donated that Azure Kinect and you got it quickly implemted. 😉 |
Thanks a lot for the video! Glad my plugin is useful to you! I have a lot of work to do for other projects right now but I will get back to it soon and try to release the (hopefully) stable version asap! |
Does this support more than one kinect camera, like the "official" green screen example? https://github.com/microsoft/Azure-Kinect-Sensor-SDK/tree/develop/examples/green_screen#why-would-more-than-1-camera-be-used |
It does support multiple Kinect when using multiple sources but doesn't support combining multiple Azure Kinect into one result yet. |
Yes indeed, but I will soon try to work on a post-process solution (see #32 ) |
this could also help I guess |
Yes I did check the code. Nothing too complex since it relies on a computer vision library to get the transformation between the two cameras. I think I can do something similar but I'll need someone with two azure kinect to test it. |
thx again! I had so much fun in a meeting today! |
The latest build can be found at the end of #7 with color camera settings for Azure Kinect! |
I need to record videos (RGB, depth and skeleton) with voice at the same time (synchronously) from 3 different Azure kinect which are connected to one PC. How I can do that? |
Hi. I doubt obs and obs-kinect can really help you, you should try using the Kinect SDK directly: https://github.com/microsoft/Azure-Kinect-Sensor-SDK |
Thank you so much for your reply. |
Of course the SDK can do that, it has its own recorder: https://github.com/microsoft/Azure-Kinect-Sensor-SDK/tree/develop/tools/k4arecorder |
Thank you a gain. |
I understand, I'm not saying k4arecorder is the solution to all your problems, but it shows how you can record color and depth using the SDK, adding skeleton and voice shouldn't be a big deal (see k4aviewer which records audio). For skeleton tracking, see https://docs.microsoft.com/en-us/azure/kinect-dk/body-sdk-download See also other examples for synchronisation between Azure Kinect. I don't think there already is a tool which does everything you need, you'll have to code it yourself, feel free to look how I use Azure Kinect in obs-kinect if that helps) |
I appreciate your patience. |
Good news everyone.
Microsoft contacted me about this plugin and is willing to help me support the Azure Kinect by sending one to me so I can add support for it!
This also means I will work on the plugin again, after not touching it for a few months due to other projects.
I'll use this thread to keep you informed about azure kinect support in obs-kinect.
The text was updated successfully, but these errors were encountered: