Reviewing

Bird Song Diamond

Victoria Vesna, Charles Taylor

Featuring Joel Ong, Aisen Caro Chacin, John Brumley, Reiji Suzuki, Mary Tsang, Max Kazemzadeh, Mizuki Oka, Atsushi Masumori, Itsuki Doi, Norihiro Maruyama

Bird Song Diamond is an interactive installation based on long-term research (2011- present) allowing multifaceted, interdisciplinary perspectives — uniquely connecting the nodes of evolutionary biology, artificial intelligence, spatial sound, mechatronic art and interactive technologies. The diamond as a crystal lattice of connected nodes reflects the commitment of each node to its disciplinary rigor held together in balance through shared interests. The sound art installation is an effort to include multiple new facets of the larger public — from children to art lovers and from academics to theoreticians.

Opening from July 3 through July 20 2015
Fort Jay on Governors Island

“The intent of this project is to permit humans to understand the grammar and meaning of bird songs. Recent advances in sensor arrays, computation, and computational linguistics finally make this long-sought goal achievable.” (Charles Taylor, 2011) Beyond developing better analytical tools, this project engages artists who are well versed in the development of art|science interface and interactive installation with sound, to establish an experience that overlays aspects of the life, loft, and language of a bird with that of human characteristics. This last investigation has broad appeal, and can serve to engage younger people to notice their environments and to participate more in scientific activities and initiatives

As an exploration into the interdisciplinary collaboration, the sonic components of the installation are composed under the auspices of the scientific team led by evolutionary biologist Charles Taylor who has been systematically categorizing bird sounds and determining the patterns of communication within spatial networks of birds in the field. Taylor also brings to the art sci team many of his collaborators, including ecologist Dr. Martin Cody, linguist Dr. Edward Stabler and physicist Dr. Takashi Ikegami and his group from the University of Tokyo. It should be noted that Ikegami has collaborated with sound artists on a number of sound installations in the past.

The new tools and methods for collecting and analyzing bird song now allow a level of observation that previously would not have been possible. We are now collecting truly vast amounts of data from previously inaccessible settings and subjecting data to previously undiscovered sophisticated structural analyses. It will be transformational to computational linguistics if the natural world beyond humans were shown to have languages that are radically different from our own (as seems quite likely). Our analysis will be aided – in fact only possible – to the extent that we can view the environment from bird’s perspective — emphasizing the important role for artists in our collaboration.

A guiding theme to our research is the role of complexity and chaos in communication systems. With reference to the complexity categories studied by Wolfram and Langton, the systems we are researching are situated at the edge of chaos: their complexity is above that of fixed sequences of symbols or sounds, but below that of chaotic or purely random systems — at the phase transition between complexity categories 2 and 3. Meaning emerges and is communicated through the evolution and maintenance of intermediate complexity — patterned sequences that are simple enough to be understood, but sufficiently complex that they can carry expressive data or meaning. Among the systems whose vocalizations fall into that class are human language, and the songs of at least three species of birds that we have been studying — California Thrasher and the Cassin’s Vireos and Black-headed Grosbeak. These comprise the target species for this project; our work features field recordings and analyses unique to their songs.

Names of Collaborators:

Art Sci collective: sound artist Joel Ong (PhD candidate, University of Washington, Seattle; Aisen Caro Chacin (PhD candidate, University of Tsukuba); John Brumley (MFA candidate, UCLA Design Media Arts); Reiji Suzuki (Associate Professor, Nagoya University); and Mary Tsang (MS candidate, MIT media lab); Max Kazemzadeh (Associate Professor & Program Director, Gallaudet University)

Ikegami laboratory: Mizuki Oka, Atsushi Masumori, Itsuki Doi and Norihiro Maruyama (University of Tokyo)

Charles Taylor

Charles Taylor is an evolutionary biologist and artificial life expert, who was leading the research on the NSF-funded project, Mapping Acoustic Network of Birds, at UCLA. He collaborated closely with Vesna to explore the relationship between humans and birds in natural and artificial environments.

Joel Ong

Joel is a media artist whose works connect scientific and artistic approaches to the environment, particularly with respect to sound and physical space. Professor Ong’s work explores the way objects and spaces can function as repositories of ‘frozen sound’, and in elucidating these, he is interested in creating what systems theorist Jack Burnham (1968) refers to as “art (that) does not reside in material entities, but in relations between people and between people and the components of their environment”. A serial collaborator, Ong is invested in the broader scope of Art-Science collaborations and is engaged constantly in the discourses and processes that facilitate viewing these two polemical disciplines on similar ground.

Aisen Caro Chacin

Sound artist, PhD candidate at the University of Tsukuba.

John Brumley

John Brumley’s work absorbs contemporary skill sets and emerging forms of diversion into saturated masses of media with the aim of being simultaneously frantic and boring. Emerging conceptions of virtuosity, new modes of learning, and the eminence of “weird trick” solutions have prompted further investigation into the memetics of the mediated physical world. Plotting points at which the motivations for contemporary activities become irrevocably trapped in networks of subterranean fibre. Currently living in Japan and pursuing a PhD. in Empowerment Informatics, Brumley’s research focuses on using mixed reality systems to promote collaboration in physical space. Brumley received an MFA in Design Media Arts from UCLA and a BA in music composition from UC Davis. He has been a Radio DJ, a touring improviser, and a practitioner of Western Javanese Gamelan music.

Reiji Suzuki

Sound artist, Associate Professor at Nagoya University.

Mary Tsang

Sound artist, MS candidate at MIT media lab.

Mizuki Oka

Scientist at the University of Tokyo.

Atsushi Masumori

Scientist at the University of Tokyo.

Itsuki Doi

Scientist at the University of Tokyo.

Norihiro Maruyama

Scientist at the University of Tokyo.