SPECTRAL FACADES

In this project, we explored a stream diffusion model to create dynamic transitions between two types of facades: modern and deteriorated. 

Using the MediaPipe plugin integrated into TouchDesigner, we tracked the tip of the nose to control the height parameter, which influences both the input image fed into the diffusion model and the associated prompt. 

Additionally, we implemented gesture-based controls: closing the hand increases the number of diffusion iterations, resulting in a more defined transition, while opening the hand reduces the iterations for a softer effect. The inputs—nose position and hand gestures—seamlessly guide the two-stage diffusion process. Audio files were also incorporated, dynamically shifting in complexity and tone based on hand gestures, further enriching the interactive experience.

Conceptually, this project served as an exploration of chaos and order, inspired by the duality of Times Square. The model reflects the juxtaposition of chaotic urban life, represented by the spectral facades, and the structured modernism of office buildings that coexist within the same space. By blending physical gestures, audio cues, and visual transitions, we sought to evoke the layered and dynamic nature of this iconic environment.