Academic literature on the topic 'Video Game Soundscapes'

In the age of participatory and convergence paradigms, video game music has its own networked culture with cybercommunities that discuss, share, and create content, thus opening up a creative space for artistic activities in a constant digital flow. Music composition and production is one of these activities, with files made available on several platforms such as SoundCloud and YouTube, specifically in the format of modification files (or mods). Building on research for a master’s dissertation, this article examines a new model of online artistic production in the form of the circulation of musical mods that were composed and shared on the Nexus Mods platform for the The Elder Scrolls IV: Oblivion and The Elder Scrolls V: Skyrim video games. These mods add new musical material that is similar to the existing soundtrack of both titles, but the majority of the files in this platform’s audio category are related only to sounds, not to musical composition. By using titles such as “better sounds” or “immersive sounds” to describe their additions, many modders aim to give other gamers a more immersive experience in the game(s). In this case, immersive relates not only to the musical style and sound quality of the aural effects but also a plausible construction of the reality in which the gamers live, play, and negotiate meaning relating to their own social context. Intersecting “playbour,” fandom, aural immersion, and audiovisual literacy, these audio modders work on adding new layers to the soundscapes and environments of the virtual worlds presented in the two games. The modders regard immersion as a key aspect of design and playability, and they contribute audio material to enable their social capital and visibility on online platforms.

“Navigable narratives” are a subgenre of narrative-based video games under the umbrella definition of “walking simulators.” While they are a subgenre of video games, analyzing their score or soundscape purely through a video game lens paints an incomplete picture because of their different artistic focus. Models like Elizabeth Medina-Gray's modular analysis are a useful start but insufficient on their own to understand this genre's sound. Rather, a participant's experience in a navigable narrative is often quite similar to that of a soundwalk, especially a virtual reality soundwalk; the game composer/audio designer creates an intricate soundscape through which the participant moves, and with the main focus on the story and gradual travel, the participant has more time and capacity than in a typical video game to build meaning from the soundwalk they perform. One of the major relationships navigable narratives have with soundwalks is the breakdown of diegesis in the soundscape the participant takes in, which is unlike most video games. To analyze the soundwalk and also the soundscape present in navigable narratives, I draw from R. Murray Schafer, Hildegard Westerkamp, and Janet Cardiff. In the opposite direction, in many ways navigable narratives are very much like “literary computer games,” or interactive narratives that may be analyzed via “ludostylistics” à la Janet Murray and Astrid Ensslin. A key element in many navigable narratives is the use of narrative time, as described by Alicyn Warren, rather than real time, which also sets navigable narratives apart from standard video games and especially from soundwalks. To explore these varied models and lenses, I demonstrate an analytical approach, using Leaving Lyndow (2017) as my primary case study. And so, between these analytical lenses of video game music theory, soundscape and soundwalk study, and ludostylistics applicable to literary computer games, I posit that the sound of navigable narratives is best understood through a synthesis of all three.

One of the objectives of architectural design is to create multi-sensory environments. The users are under the influence of a wide variety and intense perceptual data flow when users experience a designed space. Architects and environmental designers should not ignore the sense of hearing, one of the most important of the five primitive senses that allow us to experience the physical environment within the framework of creative thinking from the first stage of the design process. Today, auditory analysis of spaces has been studied under architectural acoustics, soundscapes, multi-sensory interactions, and sense of place. However, the current sound design methods implemented in the film and video game industries and industrial design have not been used in architectural design practices. Sound design is the art and application of making soundtracks in various disciplines and it involves recognizing, acquiring, or developing of auditory components. This research aims to establish a holistic architectural sound design framework based on the previous sound classification and taxonomic models found in the literature. The proposed sound design framework will help the architects and environmental designers classify the sound elements in the built environment and provide holistic environmental sound design guidelines depending on the spaces' functions and context.

Whereas most of Nintendo’s music from the 1990s used basic looping structure and simple chiptune-reminiscent sounds, Donkey Kong Country (1994), composed by British composer David Wise rather than by Nintendo’s in-house composition team, featured texturally more complex music, including features characteristic of the 1970s/80s progressive rock style such as short repeated melodies and chord progressions with layering (Collins 44). For example, in “Fear Factory” (Figure 1), we hear a repeated chord progression of (VI, iv, i) underneath a faster eighth-note melody. Very little harmonic movement occurs and the focus is more on the melodic layers that occur in this top voice. In addition, “Fear Factory” includes unconventional punk, “mechanic/industrial”, and “glitch” noises that emphasize melodic content (https://www.youtube.com/watch?v=v18pEFQb3EM&t=45s). As William Cheng discusses in Sound Play, the use of such unconventional sounds often contribute to a feeling of dissociation and alienation in the player, and create a divide between diegetic (that is, music the characters are aware of) and non-diegetic (that is, “background” music) soundscapes (Cheng 98-9). While this is not a direct element of prog-rock, both industrial and prog-rock music styles feature a strong focus on texture. Collins speculates that this may have been an attempt by Nintendo to capitalize on the ‘edgier’ market of other game producers such as Sega (Collins 46). In this paper, an analysis of form, melodic structure, and instrumentation from Donkey Kong Country’s “Treetop Rock” and “Fear Factory” will demonstrate features atypical of Nintendo style, which normally features catchy tunes, simple instrumentation, and pop-inspired harmonies. Figure 1: e-: VI iv I VI ivBibliography Cheng, William. Sound Play: Video Games and the Musical Imagination. The Oxford Music/media Series. Oxford: Oxford University Press, 2014. Collins, Karen. Game Sound an Introduction to the History, and Practice of Video Game Music and Sound Design. Cambridge: MIT Press, 2008.

Filmmakers such as Kenneth Anger, David Lynch and Quentin Tarantino have taken full advantage of the disconcerting effect that pop music can have on an audience. Recently, video games have followed their example, with franchises such as Grand Theft Auto, Fallout and BioShock using appropriated music as an almost integral part of their stories and player experiences. BioShock Infinite takes it one step further, weaving popular music of the past and pop music of the present into a compelling tale of time travel, multiverses, and free will. The third installment in the BioShock series has as its setting the floating city of Columbia. Decidedly steampunk, this vision of 1912 makes considerable use of popular music of the past alongside a small number of anachronistic covers of more modern pop music (largely from the 1980s) at crucial moments in the narrative. Music becomes an integral part of Columbia but also an integral part of the player experience. Although the soundscape matches the rest of the environment, the anachronistic covers seem to be directed at the player, the only one who would recognise them as out of place. The player is the time traveller here, even more so than the character they are playing, making BioShock Infinite one of the most literal representations of time travel and the tourist experience which video games can represent.

IntroductionWhen I saw Patriots Day (Berg 2016) at my local multiplex, a family entered the theatre and sat a few rows in front of me. They had a child with them, a boy who was perhaps nine or ten years old. Upon seeing the kid, I had a physical reaction. Not quite a knee-jerk, but more of an uneasy gut punch. ‘Don't you know what this movie is about?’ I wanted to ask his parents; ‘I’ve seen Jeff Bauman’s bones, and that is not something a child should see.’ I had lived through the 2013 Boston Marathon bombing and subsequent manhunt, and the memories were vivid in my mind as I waited for the movie to start, to re-present the memory on screen. Admittedly, I had lived through it from the other side of the world, watching through the mediated windows of the computer, smartphone, and television screen. Nevertheless, I remembered it in blood-soaked colour detail, brought to me by online photo galleries, social media updates, the failed amateur sleuths of Reddit, and constant cable news updates, breaking news even when the events had temporarily stalled. Alison Landsberg has coined the term “prosthetic memory” to describe how historical events are re-created and imbued with an affective experience through cinema and other sites of mass cultural mediation, allowing those who did not experience the past to form a personal connection to and subjective memory of history (2). For the boy in the cinema, Patriots Day would most likely be his first encounter with and memory of the Boston Marathon bombing. But how does prosthetic memory apply to audience members like me, who had lived through the Boston bombing from a great distance, with personalised memories mediated by the first-person perspective of social media? Does the ease of dissemination of information, particularly eyewitness photographs and videos, create possibilities for a prosthetic experience of the present? Does the online mediation of historical events of the present translate to screen dramatisations? These questions become particularly pertinent when the first-release audience of a film has recent, living memories of the real events depicted on screen.The time between when an event occurs and when it is brought to cinemas in a true-events adaptation is decreasing. Rebecca A. Sheehan argues that the cultural value of instant information has given rise to a trend in the contemporary biopic and historical film that sees our mediated world turned into a temporal "paradox in which the present is figured as both historical and ongoing" (36). Since 2005, Sheehan writes, biographical films that depict the lives of still-living public figures or in other ways comment on the ongoing history of the present have become increasingly frequent. Sheehan cites films such as The Social Network (Fincher 2010), The Queen (Frears 2006), W. (Stone 2008), and Game Change (Roach 2012) as examples of this growing biopic trend (35-36). In addition to the instantaneous remediation of public figures in the contemporary biopic, similarly there is a stable of contemporary historical films based on the true stories of ordinary people involved in extraordinary recent events. Films such as The Impossible (Bayona 2012), World Trade Center (Stone 2006), United 93 (Greengrass 2006), and Deepwater Horizon (Berg 2016) bring the death and destruction of real-world natural disasters or terrorist attacks to a sanitised but experiential cinematic event. The sensitive nature of some of the events in question often see the films labelled “too soon” and exploitative of recent tragedy. Films such as these typically do not have known public figures as their protagonists, but they arise from a similar climate of the demands of televisual and online mediation that Sheehan describes in the “instant biopics” of her study (36). Given this rise of brief temporal space between real events and their dramatisations, in this essay, I examine Patriots Day in light of the role digital experience plays in both its dramatisation and how the film's initial audience may remember the event. As Patriots Day replicates a kind of prosthetic memory of the present, it uses the first-instance digital mediation of the event to form prosthetic memories for future viewers. Through Patriots Day, I seek to gesture toward the possibilities of first-person digital mediation of major news events in shaping dramatisations of the recent past.Digital Memories of the Boston Marathon BombingTo examine the ways the Boston Marathon bombing circulated in online space, I look at the link- and image-based online discussion platform Reddit as an example of engagement with and recirculation of the event, particularly as a form of engagement defined by photographs and videos. Because the Boston Marathon is a televised and widely-reported event, professional videographers and photographers were present at the marathon’s finish line at the time of the first explosion. Thus, the first bomb and its immediate aftermath were captured in news footage and still images. The graphic nature of some of these images depicting the violence of the scene saw traditional print and television outlets cropping or otherwise editing the photographs to make them appropriate for mass broadcast (Hughney). Some online outlets, however, showed these pictures in their unedited form, often accompanied by warnings that required readers to scroll further down the page or click through the warning to see the photographs. These distinctive capabilities of the online environment allowed individuals to choose whether to view the image, while still allowing the uncensored image to circulate and be reposted elsewhere, such as on Reddit. In addition to photos and videos shot by professionals at the finish line, witnesses armed with smart phone cameras and access to social media posted their views of the aftermath to social media like Twitter, enabling the collation of both amateur and professionally shot photographs of the scene by online news aggregators such as Buzzfeed (Broderick). The Reddit community is seen as an essential part of the Boston Bombing story for the way some of its users participated in a form of ‘crowd-sourced’ investigation that resulted in the false identification of suspects (see: Nhan et al.; Tapia et al.; Potts and Harrison). There is another aspect to Reddit’s role in the circulation and mediation of the story, however, as online venues became a go-to source for news on the unfolding event, where information was delivered faster and with greater accuracy than the often-sensationalised television news coverage (Starbird et al. 347). In addition to its role in providing information that is a part of Reddit’s culture that “value[s] evidence of some kind” to support discussion (Potts and Harrison 144), Reddit played a number of roles in the sense-making process that social media can often facilitate during crisis situations (Heverin and Zach). Through its division into “subreddits,” the individual communities and discussion areas that make up the platform, Reddit accommodates an incredibly diverse range of topics and interests. Different areas of Reddit were able to play different roles in the process of sharing information and acting in a community sense-making capacity in the aftermath of the bombing. Among the subreddits involved in attempting to make sense of the event were those that served as appropriate places for posting image galleries of both professional and amateur photographs and videos, drawn from a variety of online sources. Users of subreddits such as /r/WTF and /r/MorbidReality, for example, posted galleries of “NSFL” (Not Safe For Life) images of the bombing and its aftermath (see: touhou_hijack, titan059, f00d4tehg0dz). Additionally, the /r/Boston subreddit issued calls for anyone with photographs or videos related to the attack to upload them to the thread, as well as providing an e-mail address to submit them to the FBI (RichardHerold). The /r/FindBostonBombers subreddit became a hub for analysis of the photographs. The subreddit's investigatory work was picked up by other online and traditional media outlets (including the New York Post cover photo which misidentified two suspects), bringing wider attention to Reddit’s unfolding coverage of the bombing (Potts and Harrison 148). Landsberg’s theory of prosthetic memory, and her application of it, largely relates to mass culture’s role in “the production and dissemination of memories that have no direct connection to a person’s lived past” (20). The possibilities for news events to be recorded and disseminated by smart phones and social media, however, help to create a deeper sense of affective engagement with a distant present, creating prosthetic memories out of the mediated first-hand experiences of others. The graphic nature of the photos and videos of the Boston bombing collected by and shared on sites like Reddit, the ongoing nature of the event (which, from detonation to the capture of Dzokhar Tsarnaev, spanned five days), and the participatory activity of scouring photographs for clues to the identity of the bombers all lend a sense of ongoing, experiential engagement with first-person, audiovisual mediations of the event. These prosthetic memories of the present are, as Landsberg writes of those created from dramatisations or re-creations of the past, transferable, able to belong to those who have no “natural” claim to them (18) with an experiential element that personalises history for those who do not directly experience it (33). If widely disseminated first-person mediations of events like the Boston bombing can be thought of as a prosthetic experience of present history, how will they play a part in the prosthetic memories of the future? How will those who did not live through the Boston bombing, either as a personal experience or a digitally mediated one, incorporate this digital memory into their own experience of its cinematic re-creation? To address this question, I turn to consider Patriots Day. Of particular note is the bombing sequence’s resemblance to digital mediations of the event as a marker of a plausible docudramatic resemblance to reality.The Docudramatic Re-Presentation of Digital MemoryAs a cinematic representation of recent history, Patriots Day sits at a somewhat uncomfortable intersection of fact and fiction, of docudrama and popcorn action movie, more so than an instant history film typically would. Composite characters or entirely invented characters and narratives that play out against the backdrop of real events are nothing out of the ordinary in the historical film. However, Patriots Day's use of real material and that of pure invention coincides, frequently in stark contrast. The film's protagonist, Boston Police Sergeant Tommy Saunders (played by Mark Wahlberg) is a fictional character, the improbable hero of the story who is present at every step of the attack and the manhunt. He is there on Boylston Street when the bombs go off. He is there with the FBI, helping to identify the suspects with knowledge of Boylston Street security cameras that borders on a supernatural power. He is there at the Watertown shootout among exploding cars and one-liner quips. When Dzokhar Tsarnaev is finally located, he is, of course, first on the scene. Tommy Saunders, as embodied by Wahlberg, trades on all the connotations of both the stereotypical Boston Southie and the action hero that are embedded in Wahlberg’s star persona. As a result, Patriots Day often seems to be a depiction of an alternate universe where Mark Wahlberg in a cop uniform almost single-handedly caught a terrorist. The improbability of Saunders as a character in a true-events drama, though, is thoroughly couched in the docudramatic material of historical depiction. Steven N. Lipkin argues that docudrama is a mode of representation that performs a re-creation of memory to persuade us that it is representing the real (1). By conjuring the memory of an event into being in ways that seem plausible and anchored to the evidence of actuality—such as integrating archival footage or an indexical resemblance to the actual event or an actual person—the representational, cinematic, or fictionalised elements of docudrama are imbued with a sense of the reality they claim to represent (Lipkin 3). Patriots Day uses real visual material throughout the film. The integration of evidence is particularly notable in the bombing sequence, which combines archival footage of the 2013 race, surveillance footage of the Tsarnaev brothers approaching the finish line, and a dramatic re-creation that visually resembles the original to such an extent that its integration with archival footage is almost seamless (Landler). The conclusion of the film draws on this evidential connection to the real as well, in the way that docudrama is momentarily suspended to become documentary, as interviews with some of the real people who are depicted as characters in the film close out the story. In addition to its direct use of the actual, Patriots Day's re-creation of the bombing itself bears an indexical resemblance to the event as seen by those who were not there and relies on memories of the bombing's initial mediation to vouch for the dramatisation's accuracy. In the moments before the bombing's re-creation, actual footage of the Tsarnaevs's route down Boylston Street plays, a low ominous tone of the score building over the silent security footage. The fictional Saunders’s fictional wife (Michelle Monaghan) has come to the finish line to bring him a knee brace, and she passes Tamerlan Tsarnaev as she leaves. This shot directly crosses a visual resemblance to the actual (Themo Melikidze playing Tsarnaev, resembling the bomber through physicality and costuming) with the fictional structuring device of the film in the form of Tommy Saunders. Next, in a long shot, we see Tsarnaev bump into a man wearing a grey raglan shirt. The man turns to look at Tsarnaev. From the costuming, it is evident that this man who is not otherwise named is intended to represent Jeff Bauman, the subject of an iconic photograph from the bombing. In the photo, Bauman is shown being taken from the scene in a wheelchair with both legs amputated from below the knee by the blast (another cinematic dramatisation of the Boston bombing, Stronger, based on Bauman’s memoir of the same name, will be released in 2017). In addition to the visual signifier of Bauman from the memorable photograph, reports circulated that Bauman's ability to describe Tsarnaev to the FBI in the immediate aftermath of the bombing was instrumental in identifying the suspects (Hartmann). Here, this digital memory is re-created in a brief but recognisable moment: this is the before picture of Jeff Bauman, this is the moment of identification that was widely circulated and talked about, a memory of that one piece of good news that helped satisfy public curiosity about the status of the iconic Man in the Wheelchair.When the bombs detonate, we are brought into the smoke and ash, closer access than the original mediation afforded by the videographers at the finish line. After the first bomb detonates, the camera follows Saunders as he walks toward the smoke cloud. As the second bomb explodes, we go inside the scene. The sequence cuts from actual security camera footage that captured the blast, to a first-person perspective of the explosion, the resulting fire and smoke, and a shot that resembles the point of view of footage captured on a smart phone. The frame shakes wildly, giving the viewer disorienting flashes of the victims, a sense of the chaos without seeing anything in lasting, specific detail, before the frame tips sideways onto the pavement, stained with blood and littered with debris. Coupled with this is a soundscape that resembles both the subjective experience of a bombing victim and what their smart phone video has captured. There is the rumble of the explosion and muffled sounds of debris hidden under the noise of shockwaves of air hitting a microphone, fading into an electronic whine and tinnitus ring. A later shot shows the frame obscured by smoke, slowly clearing to give us a high angle view of the aftermath, resembling photographs taken from a window overlooking the scene on Boylston Street (see: touhou_hijack). Archival footage of first responders and points of view resembling a running cell phone camera that captures flashes of blood and open wounds combine with shots of the actors playing characters (both fictional and based on real people) that were established at the beginning of the film. There is once again a merging of the re-created and the actual, bound together by a sense of memory that encourages the viewer to take the former as plausible, based on its resemblance to the latter.When Saunders runs for the second bombing site further down the street, he looks down at two bodies on the ground. Framed in close-up, the bloodless, empty expression and bright blue shirt of Krystle Campbell are recognisable. We can ignore the inaccuracies of this element of the digital memory amidst the chaos of the sequence. Campbell died in the first bombing, not the second. The body of a woman in a black shirt is between the camera's position on the re-created Boylston Street and the actor standing in for Campbell, the opposite of how Campbell and her friend Karen Rand lay beside each other in photographs of the bombing aftermath. The police officer who takes Krystle's pulse on film and shakes her head at Wahlberg's character is a brunette, not the blonde in the widely-circulated picture of a first responder at the actual bombing. The most visceral portion of the image is there, though, re-created almost exactly as it appeared at its first point of mediation: the lifeless eyes and gaping mouth, the bright blue t-shirt. The memory of the event is conjured into being, and the cinematic image resembles the most salient elements of the memory enough for the cinematic image to be a plausible re-creation. The cinematic frame is positioned at a lower level to the original still, as though we are on the ground beside her, bringing the viewer even closer to the event, even as the frame crops out her injuries as scene photographs did not, granting a semblance of respectful distance from the real death. This re-creation of Krystle Campbell’s death is a brief flash in the sequence, but a powerful moment of recognition for those who remember its original mediation. The result is a sequence that shows the graphic violence of the actuality it represents in a series of images that invite its viewer to expand the sequence with their memory of the event the way most of them experienced it: on other screens, at the site of its first instance of digital mediation.ConclusionThrough its use of cinematography that resembles actual photographic evidence of the Boston Marathon bombing or imbues the re-creation with a sense of a first-person, digitally mediated account of the event, Patriots Day draws on its audience's digital memory of recent history to claim accuracy in its fictionalisation. Not everyone who sees Patriots Day may be as familiar with the wealth of eyewitness photographs and images of the Boston Marathon bombing as those who may have experienced and followed the events in online venues such as Reddit. Nonetheless, the fact of this material's existence shapes the event's dramatisation as the filmmakers attempt to imbue the dramatisation with a sense of accuracy and fidelity to the event. The influence of digital memory on the film’s representation of the event gestures toward the possibilities for how online engagement with major news events may play a role in their dramatisation moving forward. Events that have had eyewitness visual accounts distributed online, such as the 2015 Bataclan massacre, the 2016 Pulse nightclub shooting, the 2017 Manchester Arena bombing and Westminster Bridge attack, or the 2016 police shooting of Philando Castile that was streamed on Facebook live, may become the subject of future dramatisations of recent history. The dramatic renderings of contemporary history films will undoubtedly be shaped by the recent memory of their online mediations to appeal to a sense of accuracy in the viewer's memory. As recent history films continue, digital memories of the present will help make the prosthetic memories of the future. ReferencesBroderick, Ryan. “Photos from the Scene of the Boston Marathon Explosion (Extremely Graphic).” Buzzfeed News, 16 Apr. 2013. 2 Aug. 2017 <https://www.buzzfeed.com/ryanhatesthis/first-photos-from-the-scene-of-the-boston-marathon-explosion?utm_term=.fw38Byjq1#.peNXWPe8G>.f00d4tehg0dz. “Collection of Photos from the Boston Marathon Bombing (NSFW) (NSFL-Gore).” Reddit, 16 Apr. 2013. 8 Aug. 2017 <https://www.reddit.com/r/WTF/comments/1cfhg4/collection_of_photos_from_the_boston_marathon/>.Hartmann, Margaret. “Bombing Victim in Iconic Photo Was Key to Identifying Boston Suspects.” New York Magazine, 18 Apr. 2013. 8 Aug. 2017 <http://nymag.com/daily/intelligencer/2013/04/bombing-victim-identified-suspects.html>.Heverin, Thomas, and Lisl Zach. “Use of Microblogging for Collective Sense-Making during Violent Crises: A Study of Three Campus Shootings.” Journal of the American Society for Information Science and Technology 63.1 (2012): 34-47. Hughney, Christine. “News Media Weigh Use of Photos of Carnage.” New York Times, 17 Apr. 2013. 2 Aug. 2017 <http://www.nytimes.com/2013/04/18/business/media/news-media-weigh-use-of-photos-of-carnage.html>.Landler, Edward. “Recreating the Boston Marathon Bombing in Patriots Day.” Cinemontage, 21 Dec. 2016. 8 Aug. 2017 <http://cinemontage.org/2016/12/recreating-boston-marathon-bombing-patriots-day/>.Landsberg, Alison. Prosthetic Memory: The Transformation of American Remembrance in the Age of Mass Culture. New York: Columbia U P, 2004. Lipkin, Steven N. Docudrama Performs the Past: Arenas of Argument in Films Based on True Stories. Newcastle upon Tyne: Cambridge Scholars, 2011. Nhan, Johnny, Laura Huey, and Ryan Broll. “Digilantism: An Analysis of Crowdsourcing and the Boston Marathon Bombing.” British Journal of Criminology 57 (2017): 341-361. Patriots Day. Dir. Peter Berg. CBS Films, 2016.Potts, Liza, and Angela Harrison. “Interfaces as Rhetorical Constructions. Reddit and 4chan during the Boston Marathon Bombings.” Proceedings of the 31st ACM International Conference on Design of Communication. Greenville, North Carolina, September-October 2013. 143-150. RichardHerold. “2013 Boston Marathon Attacks: Please Upload Any Photos in Relation to the Attacks That You Have.” Reddit, 15 Apr. 2013. 8 Aug. 2017 <https://www.reddit.com/r/boston/comments/1cf5wp/2013_boston_marathon_attacks_please_upload_any/>.Sheehan, Rebecca A. “Facebooking the Present: The Biopic and Cultural Instantaneity.” The Biopic in Contemporary Film Culture. Eds. Tom Brown and Bélen Vidal. New York: Routledge, 2014. 35-51. Starbird, Kate, Jim Maddock, Mania Orand, Peg Achterman, and Robert M. Mason. “Rumors, False Flags, and Digital Vigilantes: Misinformation on Twitter after the 2013 Boston Marathon Bombing.” iConference 2014 Proceedings. Berlin, March 2014. 654-662. Tapia, Andrea H., Nicolas LaLone, and Hyun-Woo Kim. “Run Amok: Group Crowd Participation in Identifying the Bomb and Bomber from the Boston Marathon Bombing.” Proceedings of the 11th International ISCRAM Conference. Eds. S.R. Hiltz, M.S. Pfaff, L. Plotnick, and P.C. Shih. University Park, Pennsylvania, May 2014. 265-274. titan059. “Pics from Boston Bombing NSFL.” Reddit, 15 Apr. 2013. 8 Aug. 2017 <https://www.reddit.com/r/WTF/comments/1cf0po/pics_from_boston_bombing_nsfl/>.touhou_hijack. “Krystle Campbell Died Screaming. This Sequence of Photos Shows Her Final Moments.” Reddit, 18 Apr. 2013. 8 Aug. 2017 <https://www.reddit.com/r/MorbidReality/comments/1cktrx/krystle_campbell_died_screaming_this_sequence_of/>.

In 1956, John Cage predicted that “in the future, records will be made from records” (Duffel, 202). Certainly, musical creativity has always involved a certain amount of appropriation and adaptation of previous works. For example, Vivaldi appropriated and adapted the “Cum sancto spiritu” fugue of Ruggieri’s Gloria (Burnett, 4; Forbes, 261). If stuck for a guitar solo on stage, Keith Richards admits that he’ll adapt Buddy Holly for his own purposes (Street, 135). Similarly, Nirvana adapted the opening riff from Killing Jokes’ “Eighties” for their song “Come as You Are”. Musical “quotation” is actively encouraged in jazz, and contemporary hip-hop would not exist if the genre’s pioneers and progenitors had not plundered and adapted existing recorded music. Sampling technologies, however, have taken musical adaptation a step further and realised Cage’s prediction. Hardware and software samplers have developed to the stage where any piece of audio can be appropriated and adapted to suit the creative impulses of the sampling musician (or samplist). The practice of sampling challenges established notions of creativity, with whole albums created with no original musical input as most would understand it—literally “records made from records.” Sample-based music is premised on adapting audio plundered from the cultural environment. This paper explores the ways in which technology is used to adapt previous recordings into new ones, and how musicians themselves have adapted to the potentials of digital technology for exploring alternative approaches to musical creativity. Sampling is frequently defined as “the process of converting an analog signal to a digital format.” While this definition remains true, it does not acknowledge the prevalence of digital media. The “analogue to digital” method of sampling requires a microphone or instrument to be recorded directly into a sampler. Digital media, however, simplifies the process. For example, a samplist can download a video from YouTube and rip the audio track for editing, slicing, and manipulation, all using software within the noiseless digital environment of the computer. Perhaps it is more prudent to describe sampling simply as the process of capturing sound. Regardless of the process, once a sound is loaded into a sampler (hardware or software) it can be replayed using a MIDI keyboard, trigger pad or sequencer. Use of the sampled sound, however, need not be a faithful rendition or clone of the original. At the most basic level of manipulation, the duration and pitch of sounds can be altered. The digital processes that are implemented into the Roland VariOS Phrase Sampler allow samplists to eliminate the pitch or melodic quality of a sampled phrase. The phrase can then be melodically redefined as the samplist sees fit: adapted to a new tempo, key signature, and context or genre. Similarly, software such as Propellerhead’s ReCycle slices drum beats into individual hits for use with a loop sampler such as Reason’s Dr Rex module. Once loaded into Dr Rex, the individual original drum sounds can be used to program a new beat divorced from the syncopation of the original drum beat. Further, the individual slices can be subjected to pitch, envelope (a component that shapes the volume of the sound over time) and filter (a component that emphasises and suppresses certain frequencies) control, thus an existing drum beat can easily be adapted to play a new rhythm at any tempo. For example, this rhythm was created from slicing up and rearranging Clyde Stubblefield’s classic break from James Brown’s “Funky Drummer”. Sonic adaptation of digital information is not necessarily confined to the auditory realm. An audio editor such as Sony’s Sound Forge is able to open any file format as raw audio. For example, a Word document or a Flash file could be opened with the data interpreted as audio. Admittedly, the majority of results obtained are harsh white noise, but there is scope for serendipitous anomalies such as a glitchy beat that can be extracted and further manipulated by audio software. Audiopaint is an additive synthesis application created by Nicolas Fournel for converting digital images into audio. Each pixel position and colour is translated into information designating frequency (pitch), amplitude (volume) and pan position in the stereo image. The user can determine which one of the three RGB channels corresponds to either of the stereo channels. Further, the oscillator for the wave form can be either the default sine wave or an existing audio file such as a drum loop can be used. The oscillator shapes the end result, responding to the dynamics of the sine wave or the audio file. Although Audiopaint labours under the same caveat as with the use of raw audio, the software can produce some interesting results. Both approaches to sound generation present results that challenge distinctions between “musical sound” and “noise”. Sampling is also a cultural practice, a relatively recent form of adaptation extending out of a time honoured creative aesthetic that borrows, quotes and appropriates from existing works to create new ones. Different fields of production, as well as different commentators, variously use terms such as “co-creative media”, “cumulative authorship”, and “derivative works” with regard to creations that to one extent or another utilise existing works in the production of new ones (Coombe; Morris; Woodmansee). The extent of the sampling may range from subtle influence to dominating significance within the new work, but the constant principle remains: an existing work is appropriated and adapted to fit the needs of the secondary creator. Proponents of what may be broadly referred to as the “free culture” movement argue that creativity and innovation inherently relies on the appropriation and adaptation of existing works (for example, see Lessig, Future of Ideas; Lessig, Free Culture; McLeod, Freedom of Expression; Vaidhyanathan). For example, Gwen Stefani’s 2004 release “Rich Girl” is based on Louchie Lou and Michie One’s 1994 single of the same title. Lou and One’s “Rich Girl”, in turn, is a reggae dance hall adaptation of “If I Were a Rich Man” from Fiddler on the Roof. Stefani’s “na na na” vocal riff shares the same melody as the “Ya ha deedle deedle, bubba bubba deedle deedle dum” riff from Fiddler on the Roof. Samantha Mumba adapted David Bowie’s “Ashes to Ashes” for her second single “Body II Body”. Similarly, Richard X adapted Tubeway Army’s “Are ‘Friends’ Electric?’ and Adina Howard’s “Freak Like Me” for a career saving single for Sugababes. Digital technologies enable and even promote the adaptation of existing works (Morris). The ease of appropriating and manipulating digital audio files has given rise to a form of music known variously as mash-up, bootleg, or bastard pop. Mash-ups are the most recent stage in a history of musical appropriation and they epitomise the sampling aesthetic. Typically produced in bedroom computer-based studios, mash-up artists use software such as Acid or Cool Edit Pro to cut up digital music files and reassemble the fragments to create new songs, arbitrarily adding self-composed parts if desired. Comprised almost exclusively from sections of captured music, mash-ups have been referred to as “fictional pop music” because they conjure up scenarios where, for example, Destiny’s Child jams in a Seattle garage with Nirvana or the Spice Girls perform with Nine Inch Nails (Petridis). Once the initial humour of the novelty has passed, the results can be deeply alluring. Mash-ups extract the distinctive characteristics of songs and place them in new, innovative contexts. As Dale Lawrence writes: “the vocals are often taken from largely reviled or ignored sources—cornball acts like Aguilera or Destiny’s Child—and recast in wildly unlikely contexts … where against all odds, they actually work”. Similarly, Crawford argues that “part of the art is to combine the greatest possible aesthetic dissonance with the maximum musical harmony. The pleasure for listeners is in discovering unlikely artistic complementarities and revisiting their musical memories in mutated forms” (36). Sometimes the adaptation works in the favour of the sampled artist: George Clinton claims that because of sampling he is more popular now than in 1976—“the sampling made us big again” (Green). The creative aspect of mash-ups is unlike that usually associated with musical composition and has more in common with DJing. In an effort to further clarify this aspect, we may regard DJ mixes as “mash-ups on the fly.” When Grandmaster Flash recorded his quilt-pop masterpiece, “Adventures of Grandmaster Flash on the Wheels of Steel,” it was recorded while he performed live, demonstrating his precision and skill with turntables. Modern audio editing software facilitates the capture and storage of sound, allowing mash-up artists to manipulate sounds bytes outside of “real-time” and the live performance parameters within which Flash worked. Thus, the creative element is not the traditional arrangement of chords and parts, but rather “audio contexts”. If, as Riley pessimistically suggests, “there are no new chords to be played, there are no new song structures to be developed, there are no new stories to be told, and there are no new themes to explore,” then perhaps it is understandable that artists have searched for new forms of musical creativity. The notes and chords of mash-ups are segments of existing works sequenced together to produce inter-layered contexts rather than purely tonal patterns. The merit of mash-up culture lies in its function of deconstructing the boundaries of genre and providing new musical possibilities. The process of mashing-up genres functions to critique contemporary music culture by “pointing a finger at how stifled and obvious the current musical landscape has become. … Suddenly rap doesn’t have to be set to predictable funk beats, pop/R&B ballads don’t have to come wrapped in cheese, garage melodies don’t have to recycle the Ramones” (Lawrence). According to Theodor Adorno, the Frankfurt School critic, popular music (of his time) was irretrievably simplistic and constructed from easily interchangeable, modular components (McLeod, “Confessions”, 86). A standardised and repetitive approach to musical composition fosters a mode of consumption dubbed by Adorno “quotation listening” and characterised by passive acceptance of, and obsession with, a song’s riffs (44-5). As noted by Em McAvan, Adorno’s analysis elevates the producer over the consumer, portraying a culture industry controlling a passive audience through standardised products (McAvan). The characteristics that Adorno observed in the popular music of his time are classic traits of contemporary popular music. Mash-up artists, however, are not representative of Adorno’s producers for a passive audience, instead opting to wrest creative control from composers and the recording industry and adapt existing songs in pursuit of their own creative impulses. Although mash-up productions may consciously or unconsciously criticise the current state of popular music, they necessarily exist in creative symbiosis with the commercial genres: “if pop songs weren’t simple and formulaic, it would be much harder for mashup bedroom auteurs to do their job” (McLeod, “Confessions”, 86). Arguably, when creating mash-ups, some individuals are expressing their dissatisfaction with the stagnation of the pop industry and are instead working to create music that they as consumers wish to hear. Sample-based music—as an exercise in adaptation—encourages a Foucauldian questioning of the composer’s authority over their musical texts. Recorded music is typically a passive medium in which the consumer receives the music in its original, unaltered form. DJ Dangermouse (Brian Burton) breached this pact to create his Grey Album, which is a mash-up of an a cappella version of Jay-Z’s Black Album and the Beatles’ eponymous album (also known as the White Album). Dangermouse says that “every kick, snare, and chord is taken from the Beatles White Album and is in their original recording somewhere.” In deconstructing the Beatles’ songs, Dangermouse turned the recordings into a palette for creating his own new work, adapting audio fragments to suit his creative impulses. As Joanna Demers writes, “refashioning these sounds and reorganising them into new sonic phrases and sentences, he creates acoustic mosaics that in most instances are still traceable to the Beatles source, yet are unmistakeably distinct from it” (139-40). Dangermouse’s approach is symptomatic of what Schütze refers to as remix culture: an open challenge to a culture predicated on exclusive ownership, authorship, and controlled distribution … . Against ownership it upholds an ethic of creative borrowing and sharing. Against the original it holds out an open process of recombination and creative transformation. It equally calls into question the categories, rifts and borders between high and low cultures, pop and elitist art practices, as well as blurring lines between artistic disciplines. Using just a laptop, an audio editor and a calculator, Gregg Gillis, a.k.a. Girl Talk, created the Night Ripper album using samples from 167 artists (Dombale). Although all the songs on Night Ripper are blatantly sampled-based, Gillis sees his creations as “original things” (Dombale). The adaptation of sampled fragments culled from the Top 40 is part of Gillis’ creative process: “It’s not about who created this source originally, it’s about recontextualising—creating new music. … I’ve always tried to make my own songs” (Dombale). Gillis states that his music has no political message, but is a reflection of his enthusiasm for pop music: “It’s a celebration of everything Top 40, that’s the point” (Dombale). Gillis’ “celebratory” exercises in creativity echo those of various fan-fiction authors who celebrate the characters and worlds that constitute popular culture. Adaptation through sampling is not always centred solely on music. Sydney-based Tom Compagnoni, a.k.a. Wax Audio, adapted a variety of sound bytes from politicians and media personalities including George W. Bush, Alexander Downer, Alan Jones, Ray Hadley, and John Howard in the creation of his Mediacracy E.P.. In one particular instance, Compagnoni used a myriad of samples culled from various media appearances by George W. Bush to recreate the vocals for John Lennon’s Imagine. Created in early 2005, the track, which features speeded-up instrumental samples from a karaoke version of Lennon’s original, is an immediate irony fuelled comment on the invasion of Iraq. The rationale underpinning the song is further emphasised when “Imagine This” reprises into “Let’s Give Peace a Chance” interspersed with short vocal fragments of “Come Together”. Compagnoni justifies his adaptations by presenting appropriated media sound bytes that deliberately set out to demonstrate the way information is manipulated to present any particular point of view. Playing the media like an instrument, Wax Audio juxtaposes found sounds in a way that forces the listener to confront the bias, contradiction and sensationalism inherent in their daily intake of media information. … Oh yeah—and it’s bloody funny hearing George W Bush sing “Imagine”. Notwithstanding the humorous quality of the songs, Mediacracy represents a creative outlet for Compagnoni’s political opinions that is emphasised by the adaptation of Lennon’s song. Through his adaptation, Compagnoni revitalises Lennon’s sentiments about the Vietnam War and superimposes them onto the US policy on Iraq. An interesting aspect of sampled-based music is the re-occurrence of particular samples across various productions, which demonstrates that the same fragment can be adapted for a plethora of musical contexts. For example, Clyde Stubblefield’s “Funky Drummer” break is reputed to be the most sampled break in the world. The break from 1960s soul/funk band the Winstons’ “Amen Brother” (the B-side to their 1969 release “Color Him Father”), however, is another candidate for the title of “most sampled break”. The “Amen break” was revived with the advent of the sampler. Having featured heavily in early hip-hop records such as “Words of Wisdom” by Third Base and “Straight Out of Compton” by NWA, the break “appears quite adaptable to a range of music genres and tastes” (Harrison, 9m 46s). Beginning in the early 1990s, adaptations of this break became a constant of jungle music as sampling technology developed to facilitate more complex operations (Harrison, 5m 52s). The break features on Shy FX’s “Original Nutta”, L Double & Younghead’s “New Style”, Squarepusher’s “Big Acid”, and a cover version of Led Zepplin’s “Whole Lotta Love” by Jane’s Addiction front man Perry Farrell. This is to name but a few tracks that have adapted the break. Wikipedia offers a list of songs employing an adaptation of the “Amen break”. This list, however, falls short of the “hundreds of tracks” argued for by Nate Harrison, who notes that “an entire subculture based on this one drum loop … six seconds from 1969” has developed (8m 45s). The “Amen break” is so ubiquitous that, much like the twelve bar blues structure, it has become a foundational element of an entire genre and has been adapted to satisfy a plethora of creative impulses. The sheer prevalence of the “Amen break” simultaneously illustrates the creative nature of music adaptation as well as the potentials for adaptation stemming from digital technology such as the sampler. The cut-up and rearrangement aspect of creative sampling technology at once suggests the original but also something new and different. Sampling in general, and the phenomenon of the “Amen break” in particular, ensures the longevity of the original sources; sampled-based music exhibits characteristics acquired from the source materials, yet the illegitimate offspring are not their parents. Sampling as a technology for creatively adapting existing forms of audio has encouraged alternative approaches to musical composition. Further, it has given rise to a new breed of musician that has adapted to technologies of adaptation. Mash-up artists and samplists demonstrate that recorded music is not simply a fixed or read-only product but one that can be freed from the composer’s original arrangement to be adapted and reconfigured. Many mash-up artists such as Gregg Gillis are not trained musicians, but their ears are honed from enthusiastic consumption of music. Individuals such as DJ Dangermouse, Gregg Gillis and Tom Compagnoni appropriate, reshape and re-present the surrounding soundscape to suit diverse creative urges, thereby adapting the passive medium of recorded sound into an active production tool. References Adorno, Theodor. “On the Fetish Character in Music and the Regression of Listening.” The Culture Industry: Selected Essays on Mass Culture. Ed. J. Bernstein. London, New York: Routledge, 1991. Burnett, Henry. “Ruggieri and Vivaldi: Two Venetian Gloria Settings.” American Choral Review 30 (1988): 3. Compagnoni, Tom. “Wax Audio: Mediacracy.” Wax Audio. 2005. 2 Apr. 2007 http://www.waxaudio.com.au/downloads/mediacracy>. Coombe, Rosemary. The Cultural Life of Intellectual Properties. Durham, London: Duke University Press, 1998. Demers, Joanna. Steal This Music: How Intellectual Property Law Affects Musical Creativity. Athens, London: University of Georgia Press, 2006. Dombale, Ryan. “Interview: Girl Talk.” Pitchfork. 2006. 9 Jan. 2007 http://www.pitchforkmedia.com/article/feature/37785/Interview_Interview_Girl_Talk>. Duffel, Daniel. Making Music with Samples. San Francisco: Backbeat Books, 2005. Forbes, Anne-Marie. “A Venetian Festal Gloria: Antonio Lotti’s Gloria in D Major.” Music Research: New Directions for a New Century. Eds. M. Ewans, R. Halton, and J. Phillips. London: Cambridge Scholars Press, 2004. Green, Robert. “George Clinton: Ambassador from the Mothership.” Synthesis. Undated. 15 Sep. 2005 http://www.synthesis.net/music/story.php?type=story&id=70>. Harrison, Nate. “Can I Get an Amen?” Nate Harrison. 2004. 8 Jan. 2007 http://www.nkhstudio.com>. Lawrence, Dale. “On Mashups.” Nuvo. 2002. 8 Jan. 2007 http://www.nuvo.net/articles/article_292/>. Lessig, Lawrence. The Future of Ideas. New York: Random House, 2001. ———. Free Culture: How Big Media Uses Technology and the Law to Lock Down Culture and Control Creativity. New York: The Penguin Press, 2004. McAvan, Em. “Boulevard of Broken Songs: Mash-Ups as Textual Re-Appropriation of Popular Music Culture.” M/C Journal 9.6 (2006) 3 Apr. 2007 http://journal.media-culture.org.au/0612/02-mcavan.php>. McLeod, Kembrew. “Confessions of an Intellectual (Property): Danger Mouse, Mickey Mouse, Sonny Bono, and My Long and Winding Path as a Copyright Activist-Academic.” Popular Music & Society 28.79. ———. Freedom of Expression: Overzealous Copyright Bozos and Other Enemies of Creativity. United States: Doubleday Books. Morris, Sue. “Co-Creative Media: Online Multiplayer Computer Game Culture.” Scan 1.1 (2004). 8 Jan. 2007 http://scan.net.au/scan/journal/display_article.php?recordID=16>. Petridis, Alexis. “Pop Will Eat Itself.” The Guardian UK. March 2003. 8 Jan. 2007 http://www.guardian.co.uk/arts/critic/feature/0,1169,922797,00.html>. Riley. “Pop Will Eat Itself—Or Will It?”. The Truth Unknown (archived at Archive.org). 2003. 9 Jan. 2007 http://web.archive.org/web/20030624154252 /www.thetruthunknown.com/viewnews.asp?articleid=79>. Schütze, Bernard. “Samples from the Heap: Notes on Recycling the Detritus of a Remixed Culture”. Horizon Zero 2003. 8 Jan. 2007 http://www.horizonzero.ca/textsite/remix.php?tlang=0&is=8&file=5>. Vaidhyanathan, Siva. Copyrights and Copywrongs: The Rise of Intellectual Property and How It Threatens Creativity. New York, London: New York University Press, 2003. Woodmansee, Martha. “On the Author Effect: Recovering Collectivity.” The Construction of Authorship: Textual Appropriation in Law and Literature. Eds. M. Woodmansee, P. Jaszi and P. Durham; London: Duke University Press, 1994. 15. Citation reference for this article MLA Style Collins, Steve. "Amen to That: Sampling and Adapting the Past." M/C Journal 10.2 (2007). echo date('d M. Y'); ?> <http://journal.media-culture.org.au/0705/09-collins.php>. APA Style Collins, S. (May 2007) "Amen to That: Sampling and Adapting the Past," M/C Journal, 10(2). Retrieved echo date('d M. Y'); ?> from <http://journal.media-culture.org.au/0705/09-collins.php>.

Suite à un état de l'art détaillant la création et l'utilisation de l'espace sonore dans divers environnements urbains virtuels (soundmaps, jeux vidéo, réalité augmentée), il s'agira de déterminer une méthodologie et des techniques de conception pour les espaces sonores urbains virtuels du point de vue de l'immersion, de l'interface et de la dramaturgie.ces développements se feront dans le cadre du projet terra dynamica, tendant vers une utilisation plurielle de la ville virtuelle (sécurité et sureté, transports de surface, aménagement de l'urbanisme, services de proximité et citoyens, jeux). le principal objectif du doctorat sera de déterminer des réponses informatiques concrètes à la problématique suivante : comment, en fonction de leur utilisation anticipée, les espaces sonores urbains virtuels doivent-ils être structurés et avec quels contenus?la formalisation informatique des solutions étayées au fil du doctorat et la création du contenu sonore illustrant le projet seront basés sur l'analyse de données scientifiques provenant de domaines variés tels que la psychologie de la perception, l'architecture et l'urbanisme, l'acoustique, la recherche esthétique (musicale) ainsi que sur l'observation et le recueil de données audio-visuelles du territoire urbain, de manière à rendre compte tant de la richesse du concept d'espace sonore que de la multiplicité de ses déclinaisons dans le cadre de la ville virtuelle
In video gaming and interactive media, the making of complex sound ambiences relies heavily on the allowed memory and computational resources. So a compromise solution is necessary regarding the choice of audio material and its treatment in order to reach immersive and credible real-time ambiences. Alternatively, the use of procedural audio techniques, i.e. the generation of audio content relatively to the data provided by the virtual scene, has increased in recent years. Procedural methodologies seem appropriate to sonify complex environments such as virtual cities.In this thesis we specifically focus on the creation of interactive urban sound ambiences. Our analysis of these ambiences is based on the Soundscape theory and on a state of art on game oriented urban interactive applications. We infer that the virtual urban soundscape is made of several perceptive auditory grounds including a background. As a first contribution we define the morphological and narrative properties of such a background. We then consider the urban background sound as a texture and propose, as a second contribution, to pinpoint, specify and prototype a granular synthesis tool dedicated to interactive urban sound backgrounds.The synthesizer prototype is created using the visual programming language Pure Data. On the basis of our state of the art, we include an urban ambiences recording methodology to feed the granular synthesis. Finally, two validation steps regarding the prototype are described: the integration to the virtual city simulation Terra Dynamica on the one side and a perceptive listening comparison test on the other

Writing music for games is an art that requires conceptual forethought, specialized technical skill, and a deep understanding of how players interact with games and game audio. The Game Music Handbook embarks on a journey through numerous soundscapes throughout video game history, exploring a series of concepts and techniques that are key to being a successful game music composer. This book organizes key game music scoring concepts into an applicable methodology, describing them with memorable distinctions that leave readers with a clear picture of how to apply them to creating music and sound. Any music composer or musician who wishes to begin a career in game composition can pick up this text and quickly gain a solid understanding of the core techniques for composing video game music, as well as the conceptual differences that separate it from any other compositional field. Some of these topics include designing emotional arcs for nonlinear timelines, the relationship between music and sound design, discussion of the player’s interaction with audio, and more. There is also much to be gained by advanced readers or game audio professionals, who will find detailed discussion of game state and its effect on player interaction, a composer-centric lesson on programming, how to work with version control, information on visual programming languages, emergent audio, music for virtual reality (VR), procedural audio, and other indispensable knowledge about advanced reactive music concepts. The text often explores the effect that music has on a player’s interaction with a game. It discusses the practical application of this interaction through the examination of various techniques employed in games throughout video game history to enhance immersion, emphasize emotion, and create compelling interactive experiences.