Streaming a live performance (music, gaming, theater, etc.) is common place these days. While the technology to deliver the content has massively improved over the past years, the methods with which to connect the performer with the audience has remained surprisingly static. The most advanced integration of audience feedback that you are likely to see is a chat window or a poll placed along side the stream itself.
This project aims at breaking down this barrier by integrating the audience feedback directly into the performers interface. We chose to focus on discjockeys (DJs), as audience feedback is key during their performances. DJs rely heavily on the direct and indirect feedback from an audience to make informed decisions. When the DJ is performing remotely (i.e. not in the same location as the audience), that feedback vanishes. Of course, a remote performance is not the same as a local performance, and the DJs needs may not be the same in these two situations. However, given the option, most DJs still prefer to know what their audience thinks/feels despite being less inclined to take it into consideration.
The interface consists of a common audio time-line visualization, with general playback and visualization controls at the bottom and a set of drop-down menus for loading audio marked. The entire time-line supports pinch gesture zooming for an ease of overview and/or detail. All loaded audio elements support intuitive drag-and-drop style interaction. Two modes of visualized playback are supported; static time-line with a moving playback line, or moving time-line with a static playback line. The former is ideal for planning ahead and setting up audio elements in advance. The latter mode of visualization is a more dynamic ‘on-the-fly’ style interaction mode. Switching between the two modes is possible at any time to suit the DJ’s current mood and needs.
The interface uses a MT3200 touch-device produced by FlatFrog. The devices supports up to 41 simultaneous touches, as does the DJ interface. The size of the screen easily allows two simultaneous users.
One of the things I most often think about after having worked on a project for a longer period of time, is if I made the right choices along the way. While regrets are a waste of energy, it's healthy to assess whether or nothing things 'could' have gone better so as not to repeat any mistakes. This project has been one of the hardest ones in terms of convincing myself one way or the other. Most likely due to the fact that it was (and still is) one of the most ambitious projects I ever undertook.
Developing this interface has been - by-far - the most encompassing system I've had to develop as it came with some iron-clad requirements:
In retrospect, using C++ has undoubtedly hampered quick iterative development. Given a dedicated team I would probably have opted to develop a prototyping sandbox system in Python to go along with the actual application implementation. However, given that the system was intended to be used live during the final user study, I opted to focus on the version that would end up performing the best, with albeit fewer design iterations.
Here are a few things we learned throughout this project in regards to integrated remote audience feedback:
The participating DJs also made a number of interesting observations:
The feedback was helpful. Particularly if I was doing an online set, that would be really useful. [The feedback] is more direct. If we use a dance floor analogy; People will leave the dance floor [due to fatigue or to get a drink,] not cause they don’t like the music [...]. [...] So in that way, dancing is kind of an imprecise metric.DJ Modality
I wouldn’t do a live [remote] mix, and then get some negative feedback, and [...] just switch genres. I might do that at a [local] club.Phillip Huey
It gives you inspiration and energy. [...] It works. I was surprised.Mark Jackson
It’s interesting to see how people react and what they do. Will it heavily influence what I do? I don’t think so.Matthew Gammon
It would help me understand my audience better, know what they want to hear, which could lead to better parties or sets. That’s important. [...] I can see a lot of uses for that.DJ Vivid
Gallery Function to return as soon as possible. Basically, Foundation 6 still needs to port this functionality from Foundation 5. Early adopter risk/reward.