This project serves as a proof of concept in bridging themed experiences and digital experiences with OSC signals.
The 'themed' side of things is controlled with Touch Designer, and the digital side is Unreal Engine.
The idea is to have two groups of players, one in digital space, and one in the real world in themed environment- like an escape room.
When one team interacts with their environment, it heavily affects the environment for the other team. This encourages collaboration for the two teams to figure out how to manipualte their environments to help eachother through puzzles or challenges.
In this application Touch Designer inputs are coming from a mouse, but in a real application of this, inputs would come from motion tracking and environmental effects can be done through projection mapping and/or microcontrollers.
In this demo, you will see UE5 control particle generation in TD with OSC switches and TD particle collisions creating OSC data that creates several different effects in the environment.
Particle Generation Fields and Interactor

UE5 OSC switch Generates Particles in TD

Particle Interactions Affect Properties in UE5

External OSC Input from a Mobile Device
