Hand Tracking (3 patches)

*Use MusiKraken patch “Meta Hand” on iOS.

Patch 1
This patch takes in CC data from the MusiKraken iOS app which is configured for hand tracking. The hand tracking generates CC messages for XYZ coordinates, hand opening and closing, and the angle of the hand. This data is used to control the timbre, volume, envelope time, and delay time/feedback for the patch.

External Audio Path:
Main audio outputs on channels 1 and 2.

Internal Audio Path:
-4 macro oscillators are fed into a VCA mixer.
-The VCA mixer’s volume is controlled by the Z axis of our CC controller
-The VCA mixer is ran into a 4ms SHEV which provides a looping envelope for the amplitude
The SHEV runs into a delay and then a reverb.
-There is a master limiter on the patch

CC Mappings (MusiKraken hand tracking out):
CC#1 “Hand X” - Macro oscillator timbre (x4)
CC#2 “Hand Y” - Macro oscillator color (x4)
CC#3 “Hand Z” - Volume
CC#4 “Hand Open” - Envelope fall time, delay time, delay feedback amount.
CC#5 “Hand Angle” - Macro oscillator detune (x4)


WIDI 1.vcv (3.2 KB)
WIDI 1.yml (9.6 KB)

Patch 2

*Use MusiKraken patch “Meta Finger” on iOS.

This patch takes in CC data from the MusiKraken iOS app which is configured for finger tracking. The finger tracking generates CC messages for XY coordinates for each individual finger on your hand. This data is used to control the envelope times and reverb parameters of this patch.

External Audio Path:
Main audio outputs on channels 1 and 2.

Internal Audio Path:
-6 sine wave VCOs are fed into the Pressed Duck
-The Pressed Duck runs into a master reverb.

Internal CV Path:
-V/oct output of Strings is fed into each oscillator to create a chord.
-All outputs of an envelope array are ran into the CV inputs of the pressed duck.
-Each envelope is triggered by a channel of the SCM
-The SCM is clocked by an LFO.

CC Mappings (MusiKraken hand tracking out):
CC#1 “Thumb X” - Envelope Array first width
CC#2 “Thumb Y” - Envelope Array last width
CC#3 “Index X” - N/A
CC#4 “Index Y” - Plateau Dry/Wet
CC#5 “Middle X” - Plateau decay time
CC#6 “Middle Y” - Plateau size
CC#7 “Ring X” - Plateau diffusion reverb filter high
CC#8 “Ring Y” - Plateau diffusion reverb filter low
CC#9 “Little X” - Plateau input filter high
CC#10 - “Little Y” - Plateau input filter low


WIDI 3.vcv (3.4 KB)
WIDI 3.yml (13.5 KB)

Patch 3

*Use MusiKraken patch “Meta Finger” on iOS.

This patch takes in CC data from the MusiKraken iOS app which is configured for finger tracking. The finger tracking generates CC messages for XY coordinates for each individual finger on your hand. This data is used to control the filter cutoff of 5 parallel bandpass filters and the volume of each respective band.

External Audio Path:
Main audio outputs on channels 1 and 2.

Internal Audio Path:
-White noise is fed into 5 separate resonant bandpass filters
-The 5 filters are summed to create a comb filter.
-The output of the comb filter is fed into a delay line

Internal CV Path:
-Each filter band’s frequency and volume is controlled by a MIDI CC message that is mapped to each finger.

MetaModule Knob mappings:
A - Filter resonance
B - Delay Time
C - Delay Feedback
D - Delay Dry/Wet

CC Mappings (MusiKraken hand tracking out):
CC#1 “Thumb X” - Filter 1 frequency
CC#2 “Thumb Y” - Filter 1 volume
CC#3 “Index X” - Filter 2 frequency
CC#4 “Index Y” - Filter 2 volume
CC#5 “Middle X” - Filter 3 frequency
CC#6 “Middle Y” - Filter 3 volume
CC#7 “Ring X” - Filter 4 frequency
CC#8 “Ring Y” - Filter 4 volume
CC#9 “Little X” - Filter 5 frequency
CC#10 - “Little Y” - Filter 5 volume


WIDI 4.vcv (3.0 KB)
WIDI 4.yml (11.2 KB)

3 Likes

super fun! also great to know now about that app (and can do that kind of tracking, p rad)

Great stuff! How do you send midi from phone to meta?

CME WIDI BUD Pro!

2 Likes

personally on stage i prefer the safety of wired midi from ios. ive had problems with wireless (probably so many signals via the audiences phones!)

for wired midi from ios to mm i recommend something like:

Does not a simple usbc cable from phone to MM make the job?

unfortunately that doesn’t work. the phone itself cannot show up as a midi controller, it needs a class compliant midi device (or bluetooth midi like cme widi)

Even not with this setting?

maybe just give it a try and see for yourself! :] but ive seen others post about how a usbc male-male cable between their phone or pc doesn’t work. i tried it and it definitely didn’t work although my test was months ago and the firmware has changed a lot. afaik the mm is only programmed to recognize and interact with class compliant usb midi(no audio) devices and also flash drives.

hubs don’t work either, yet. i did see dan mention ages ago that he wanted to try and get hubs to work so you could have a flash drive and a midi controller working both from the usbc port.

i also saw someone post here about how the mm was powering one of their devices(a cv controller i think?) from the usbc so i guess it can also just send the 5v usb power to devices that require that much, which is kind of interesting.