webrtc-perception can be thought of as a "metapackage" which includes several work-in-progress code bundles that seek to leverage WebRTC to facilitate computational photography, photogrammetry, and modeling tasks, among other things. This project is under heavy development, and things will change and break at irregular intervals (as the developers' time is split between this and other active projects in the lab). For now, your mileage may vary!
A quick overview of what we are shooting for with some of these technologies is included below.
aiortc-server requires Python 3.x and some additional packages to function properly. After installing Python (including pip), execute the following from the command line:
$ pip install aiohttp aiortc opencv-python
The webrtc-perception Python server module leverages aiohttp and aiortc to handle asynchronous I/O and WebRTC API access. The server also makes use of opencv-python data structures and routines to perform meaningful image processing tasks.
Second, you will need to have your own SSL certificate handy, as WebRTC's getUserMedia() was deprecated for unsecure origins in late 2015. Luckily, tutorials for creating SSL/TLS certificates abound.
- Clone this respository.
- Add a folder named "certs" to the root of the
aiortc-serverdirectory and move your SSL certificate and private key inside.
- Execute
sudo python server.pyin the root of theaiortc-serverdirectory. - Navigate a WebRTC-compliant browser to the IP address which is currently being served content by the now-active Python server.
First, ensure you have the latest LTS version of NodeJS installed (with npm). We have been running with node-v10.12.0 internally, but the LTS version should work at this early milestone.
As with the aiortc-server directions above, these examples will require SSL certificates present when running the NodeJS instance
- Clone this respository.
- Add a folder named "certs" to the root of the desired module directory and move your SSL certificate and private key inside.
- Execute
npm install --savein the root of the desired module directory.
Note that, for step 2, you may need to rename the entries in server.js to match your certificate and key file names.
- Execute
sudo node server.jsin the root of the specific module directory you wish to run. - Navigate a WebRTC-compliant browser to the IP address which is currently being served content by the now-active NodeJS instance.
- This project is led by William Spies (MS Robotics, Northwestern University) and Kai Yeh (PhD Computer Science, Northwestern University) with the assistance of Dr. Florian Willomitzer, Dr. Oliver Cossairt, and others from the Computational Photography Lab at Northwestern University.