-
Notifications
You must be signed in to change notification settings - Fork 0
Input Devices
All these devices are Max Audio Effects, so they can be used in any track (Audio or MIDI)
(1 exception : NNM.LeapMotion.makeNote = Max MIDI Effect)
Connect to a Leap Motion controller, and sends tracking data to other devices.
Requires a Leap Motion device (obviously!) - with its up-to-date drivers installed. https://www.ultraleap.com/downloads/
+ Ultraleap package installed from Max Package Manager
Individual parameters are sent to :
- left/tracking left/x left/y left/z left/yaw left/pitch left/roll left/velocity left/acceleration left/pinch left/grab right/tracking right/x right/y right/z right/yaw right/pitch right/roll right/velocity right/acceleration right/pinch right/grab
lists describing the whole hand in 3D :
- Hand descriptor : fingers tips position (x y z) + direction (x y z) * 5 fingers = 30 parameters (range [-1 - 1.]) Sent to left_hand_descriptor & right_hand_descriptor (These default send names can be changed)
- Hand Gesture : position of 5 fingers tips (x y z) relative to hand palm =15 parameters (range [-1 - 1.]) Sent to left_hand_gesture & right_hand_gesture (These default send names can be changed)
Receive a parameter from NNM.LeapMotion.device and takes control of any parameter in Live
= 8 NNM.LeapMotion.simpleMapper in a floating window
Generates a MIDI note when the selected parameter (coming from NNM.LeapMotion.device) crosses a threshold.
Analyzes incoming MIDI notes and generates statistics returned as lists.
A mutiXY UI : 5 independant points in 2D - can be controlled with the mouse (but it’s no fun !) Receives OSC from /multixy Using Open Stage Control https://openstagecontrol.ammd.net/ on any multitouch screen / phone / tablet is recommended. (Load the session O-S-C_multiXY_(sorted).json located in NNM_input_devices folder) Alternatively, these multiXY examples can also receive multitouch data from the Mac trackpad using Tongseng : https://github.com/fajran/tongseng Or : Lemur or TouchOSC should be easily configured to send the proper data (/multixy x1 x2 x3 x4 x5 y1 y2 y3 y4 y5 ) Returns a list in the form x1 x2 x3 x4 x5 y1 y2 y3 y4 y5 « Sort X & Y » button : sort x & y in ascending order
Just a 2D controller that sends a list of 2 elements : x y
(Require an internet connection, as jweb-MediaPipe needs online resources when initializing)
use MediaPipe FaceLandmarker with Max's jweb connected to either a live webcamera stream or using still images.
Provides 51 features per face, which are grouped into a list, send as ‘face-landmarker’
(Require an internet connection, as jweb-MediaPipe needs online resources when initializing)
Use MediaPipe HandLandmarker with Max's jweb connected to either a live webcamera stream or using still images.
The hand landmark model bundle detects the keypoint localization of 21 hand-knuckle coordinates within the detected hand regions. The model was trained on approximately 30K real-world images, as well as several rendered synthetic hand models imposed over various backgrounds.
Returns 2 lists (1 per hand) of 40 elements (x y of 20 hand-knuckle coordinates) :
left-hand-landmarker + right-hand-landmarker
(Require an internet connection, as jweb-MediaPipe needs online resources when initializing)
use Mediapipe Pose Landmarker with Max's jweb
The pose landmarker model tracks 33 body landmark locations (x y), grouped in a list of 66 elements sent as ’pose-landmarker’
Analyzes audio input for MFCCs based on audio onsets and sends 13 mfcc coefficients (skipping the 0th coefficient) to « track#_mfcc »
Requires Data Knot package by Rodrigo Constanzo https://github.com/rconstanzo/data-knot
A utility to ease loading Open Stage Control session files.
The selected session file (.json) can be automatically sent to the connected clients when the Live set is loaded.