In this test the VR controllers and paper UI are triggering external music software, Apple Logic Pro X and receiving MIDI signals from traditional hardware, Nordlead , Focusrite.
In VR , the headsets and the sticks or remotes you hold in your hands become positional devices that the game needs to be aware of.
In this case if the application knows the position of the keyboard, the application can calculate the position of the paper UI.
The UI triggers transmit OSC data over ethernet. The receiver is in this case, Logic Pro X on a Mac Book Pro. The MIDI keyboard is also connected, via Focusrite soundcard, with Logic Pro X.
This way we have a mix off different input methods, all functioning real-time, with minimal latency.
