The House of Future Memory

The House of Future Memory was a show that couldn’t be fully designed in advance, only facilitated in real time. Three forces drove every performance: the audience, who made elemental and color choices that reshaped the world around them; the AI, which generated unique dialogue, lyrics, and scenarios nightly; and the actors, who improvised inside whatever the audience and the AI had just handed them. No two performances could be the same.

The audience’s first choice anchored the design. Early in each show, they picked one of four elemental directions: air, fire, earth, or water. The choice triggered an immediate, visible shift across the entire stage. Air cooled the palette. Fire warmed and reddened it. Earth shifted to greens and oranges. Water moved to blues and cyans. The instant feedback was a crucial story telling element. Without it, audiences wouldn’t trust that they had real control over the narrative. Behind the scenes, the same choice updated color palettes and presets across the rest of the show’s cues, subtly reinforcing the element in ways audiences might never name but would feel.

A second audience choice ran throughout the show: their favorite color for the night. That color appeared as backlight, accent lighting on scenery, or in scattered moments across the rig. It could clash with the elemental palette or harmonize with it. Either way, the design accepted the conflict as the point. If the audience chose it, that was the story they were telling.

The technical architecture leaned on real-time data translation. Using complex video tools, the lighting rig ingested the live AI-generated video content and mapped it back onto the room. Two applications got the most attention. An LED aura glow upstage of the video wall mirrored the video’s outer pixel row, creating a Philips Hue-like ambient effect around the screen. A row of Colorforce II-72s in single-pixel mode (140 individual pixels) was live-mapped to the topmost row of video content, with selective groupings responding to specific visual elements: a moon in one corner, a cloud formation in another, the rest of the pixels rendering as black. The backlight constantly reflected whatever the video system was showing.

House of Future Memory was about how far technology can carry a conceptual ambition: a show that genuinely couldn’t be scripted, only enabled.