Dan Mailman's Studio MindStride
"Genies for Geniuses"
The Stage Genie Project

StageGenies are performance venues that use Studio MindStride's Less Latency (LELA) and Response Composition (RECO)technologies.

As part of the 2016 PassageWays Competition conducted by Chattanooga's River City Company and AIA Tennessee, The Mozilla Foundation helped fund Art120's and Studio Mindstride's collaboration on the programmable StageGenie SoundScape at 715 Market Street in Downtown Chattanooga.  In addition to a default soundScape, There have been several seasonal and event-centric Soundscapes, the most recent of which is the 2016 PassageWays Holiday SoundScape.

LELA - Less Latency
Technology for Global Collaborative Performance

For a variety of reasons, experimental Low Latency (LOLA) technology is "not yet ready for prime-time" when it comes to real-time, real-world collaborative performance. In order to forward the goal of inexpensive, easily accomplished globally collaborative performances, Studio MindStride is developing the LELA technology.

PILOT PROJECT: StudioMindStride is applying standard client/server strategy to Stage Genie Virtual Musical Instruments (VMIs). VMI clients send performer gesture data (not music) to VMI servers. VMI servers translate the gesture data into music, which is played through speakers at performance venues.

Since gesture data is orders of magnitude smaller than music data, latency is all but eliminated (information theoretic analysis argues for it being as short as it's gonna get).

NEAR FUTURE: Once the LELA proof-of-concept is demonstrated via the pilot project, Studio MindStride will work with a local high-tech start-up to commercialize the LELA technology by making devices that simulate musical instruments, but transmit gesture data instead of playing music or that attach to musical instruments and transmit gesture data in addition to making music.

In this way, the LELA tech is immediately available to anyone who already knows how to play the simulated instrument.

DOWN THE ROAD: Future applications of the LELA client/server strategy will send gestural data for other performance types for entertainment (or task types, for industry).

It would be fun, for instance, to make a performance of life-size marionettes (servos in rolling bases) and have several simultaneous performances around the world with each puppeteer (perhaps on-stage) at one of the venues.

For industry and science, one can also envision robotic hands being controlled remotely for complex manipulative tasks.

RECO - Response Composition
(Automated Response to Visual Cues)

Inspired by choreographer Alisa Mitten's request for a musically responsive stage space, Studio MindStride developed the Response Composition client/server technology.

RECO servers are programmed to track objects with cameras. The servers are strategically placed around the performance venue.

The RECO client queries ALL of the servers and integrates the data into a model of stage activity. The client plays pre-programmed music, sound, or samples in response to what's happening on stage.

PILOT PROJECT: A very simple RECO installation that plays music in response to activity in a particilar area is currently in operation at 715 Market Street in Chattanooga, TN. Studio MindStride will demo RECO in response to an object tracked in 3D space at MozFest in late October 2016.

NEAR FUTURE: Art 120 in Chattanooga is collaborating Chattanooga Howard School students for future (mid-2017) RECO installations in the Glass Street Stage Genie, currently in the planning stage.

DOWN THE ROAD: Once the Glass Street Stage Genie is operational, new responses (lighting, projection, displayed images) will be added, as will streaming and recording capability. More complex visual cues will be added as well.

Links For More Information

Art 120's Website

The PassageWays Website

Mozilla Foundation Website