• Home
  • About
  • Site Policies
  • Contact

Designing Sound

Art and technique of sound design

  • All Posts
  • Featured
  • News
  • Interviews
  • Reviews
  • Tutorials
  • Resources
    • VR Audio Resources
    • Independent SFX Libraries
    • Events Calendar
  • Series Archives
    • Featured Topics
    • Featured Sound Designers
    • Audio Implementation Greats
    • Exclusive Interviews
    • Behind the Art
    • Webinar/Discussion Group Recordings
    • Sunday Sound Thought
    • The Sound Design Challenge

Audio Implementation Greats #2: Audio Toolsets [Part 2]

January 27, 2010 by lostchocolatelab

Developer created proprietary toolsets continue to provide a vital form of audio integration in the industry, especially in cases where the gameplay specific features need to be exposed and interacted with at a deeper level than what comes “out of the box” with most middleware. In the days before robust audio middleware toolsets this may have been the only way to get past the basic “Play Sound” functionality of an audio engine and pull off amazing feats of groundbreaking interactive audio.

Because of the nature of game development and custom technology, there is not a lot of information made publicly available regarding these tools, and what has been exposed is usually little more than a screen shot or casual mention in a larger article regarding a specific titles sound. In most cases additional links and information have been provided in an attempt to gain a clearer picture of their uses, and what is available may be of value to those who might be involved with tool creation and especially those who are attempting to understand some of the additional esoteric aspects of audio implementation that have developed over time. While this is not a comprehensive look at proprietary toolsets through the years, it is an attempt to survey the landscape of what is known.

Sony SCREAM

Veiled in secrecy, the SONY SCREAM tool provides direct access to the Sony hardware specific audio library MulitStream. Public information has been scarce, unless you are a developer for the PS2/PS3 and the only screens around are found embedded in Presentations or articles. One interesting thing to note is Sony’s adoption of the iXMF interactive standard established by the IASIG in 2009 for their future toolset iterations including AWESOME (audio scripting solution) , SULPHA (a Multi-Stream analyzer/ debugger), and FUSION (modular based synth engine) as noted in an article with SCEE’s Jason Page and subsequent Delop article with Oliver Hume.

Sony’s Page: ‘Next Gen Audio – Is That It?’
Develop Article: SULPHA, so good
SCEE to implement iXMF
Next-Gen Audio Square-Off: PlayStation 3 vs. Xbox 360
IASIG – iXMF
Better Tools for Sound Designers on PlayStation_3

Sony SCREAM
Sony SCREAM
Sony SCREAM
Sony SCREAM

Bungie: Guerilla Toolset

The Guerrilla Toolset used by Bungie for the Halo games has been discussed in several articles, but aside from some general information and a tiny picture in the wild, there aren’t many supporting details. I was able to cobble together some details from notes I recovered from an Audio Boot Camp presentation Jay Weinland gave back at GDC 2006. Among the features over viewed in the session were the ability to subscribe and mix sounds based on their sound_class, visually represent distance rolloff in-game, update values in the tool and update in-game with keystroke, and Reverb interpolation between zones. I’m sure much has changed since 2006 as Bungie continue to ratchet up the quality of audio across their titles. One thing that stands out in Halo 3 is their newly implemented use of Waves EQ and Surround Limiter at runtime to modify the output of the game’s audio. This move toward the use of high end DSP taken from the pro audio realm and converted to work in the engine is a trend that we should be seeing more of in the future.

Halo 3 Audio: Locked and Loaded
Halo 3: Bugie.netAudio Presentation
GDC 2005 Report: Audio Production for Halo 2
Halo 3: Waves DSP at Runtime

Bungie Tool

Bethesda Software: Oblivion

Some of the audio functionality of the Elder Scrolls Construction Set is over viewed in this insightful development journal, along with what are becoming some of the best practices for Ambient sound integration. It’s great to see a visual representation of the ambient being used across an area, along with the parameters for playback. This kindof specific use tool is a great example of bridging the gap between game engines and audio functionality.

Article: Elder Scrolls Construction Set – Audio

Elder Scrolls Region Editor
Elder Scrolls Region Editor
Oblivion Sound
Oblivion Sound

Day 1 Studios: Ducking

In a technical article the overviews the theory of Ducking, Zach Quarles exposes the tool he used at Day 1 Studio’s to accomplish the interactive effect of reducing the volume of non-priority sounds in order to better differentiate mission critical sound or dialog..

Article: Game Audio Theory Ducking
Internal Ruminations of an Audio Monkey 

Day 1 Ducking Tool

Day 1 Ducking Tool
Day 1 Ducking Tool

Radical Games: Prototype

Thanks to the fine folks over at Radical Entertainment, much has been revealed regarding the various tools and techniques utilized by the sound team to push audio quality in games further towards a Hollywood model of sound. While the idea of interactive mixing is a broader topic for another day, some of the recent work that was done with scalable crowd ambience has gone along way towards pushing the dynamics background sound. In a series of articles Scott Morton details of their use of Max/MSP style procedural, runtime Reverb, and the proprietary toolset “Audio Builder” to accomplish the feat of implementing a 18 channel sound file in order to orchestrate the ambient and limit the impact to the disk at runtime. Some of the tools used for this process have been outlined including a peek behind the curtain on some of the creative tools used at Radical.

Article: Dynamic Game Audio Ambience
Article: The Sounds of Prototype

Prepared Piano
Prototype Ambient Tool – Swarm Editor
Audio Builder
Audio Builder

Battlefield Bad Company

In a presentation given at the Game Developers Conference in 2009, DICE Audio Programmer Anders Clerwall gave an overview of their “High Dynamic Range” audio solution spearheaded by David Mollerstedt (Head of Audio, DICE). Simply put, High Dynamic Range Audio allows for the realtime interactive mixing of sound based on prioritization, culling, and loudness measurement during gameplay. The result is an overall sound mix which adapts to the action going on in the game. Furthermore, menu options are made available to adjust the playback device type as explained by Ben Minto (Audio Director, DICE):

“TV/HiFi/Cinema – these (Options) change the way the game is mixed at runtime through Frostbite’s HDR system. The settings are self explanatory – HiFi is default, TV is if you need to hear everything at a quiet volume through a small speaker, and Cinema is if you have a nice posh setup with full range speakers.“

While the technique of providing different playback profiles is not unheard of in other titles, the HDR system easily allows for the dynamic balancing of the listener experience in order to provide the best possible soundscape.

Download: Automatic_Audio_in_Frostbite
Article: Heard About Battlefield Bad Company
How HDR Audio Makes Battlefield: Bad Company Go BOOM


In addition, here are some screens from the Audio Panel within the Frostbite Editor where you can see the “Loudness” attribute for a sound source exposed.

EA: The Simpsons

From a presentation given by the audio team at EA Redwood shores for The Simpsons Game several screens for proprietary tools are exposed including a view of the EA proprietary procedural toolset AEMS or Audio Event Management System, and several custom tools used for modifying parameters related to their physics implementation. AEMS is a general tool at EA made by EA Tech, and it’s been in use since before 2002. Its been used by almost every game during those earlier days, and even today is used in many.

Presentation Slides: Sound Design for The Simpsons Game

EA Tool used on “The Simpsons”
Simpsons PRocedural Tool (AEMS)
EA Tool used on "The Simpsons"
as
EA Tool used on "The Simpsons"
Simpsons Procedural Tool (AEMS)
EA Tool used on "The Simpsons"
Simpsons Impact Tuning
Impact Tuning
Simpsons Impact Roll Tuning
Roll Tuning
Simpsons Slide Tuning
Slide Tuning

Despite the rise of audio middleware in today’s market, it is clear that is not a one size fits all mentality when it comes to creating a toolset and workflow to support the strengths of a particular games design. Hopefully by seeing, and understanding the choices studio’s and game audio professionals are employing to help them creatively add sound to games, we can continue to drive the innovation of game audio through the current console generation and beyond.

Tune in next time when we pontificate further on some of the creative techniques used to bring interactivity to audio in games.

Filed Under: featured Tagged With: audio implementation greats, bungie, damian kastbauer, day 1, ducking, game audio, implementation, oblivion, propetary software, prototype, simpsons, sony scream, tools, toolsets, tutorial

Comments

  1. ASD says

    April 2, 2013 at 2:46 pm

    Seems like open source alternatives could be useful, unless it’s particularly satisfying to have to develop and operate this many separate tools (which I don’t think can really be THAT different from each other).

Trackbacks

  1. Shakaama Live: Game Review: Star Trek Online | STMMO.info says:
    January 29, 2010 at 10:31 pm

    […] Designing Sound » Audio Implementation Greats #2: Audio Toolsets … […]

  2. Wwise – WaveWorks Interactive Sound Engine « bornThinkers says:
    July 27, 2010 at 10:37 am

    […] Jonathan Fish is a Lead Audio Designer at Electronic Arts and has been going through some of the Audio Implementation software being used in the Industry. We recently went through the following article: Audio Implementation Greats #2: Audio Toolsets […]

  3. Designing Sound » Audio Implementation Greats #8: Procedural Audio Now says:
    September 24, 2010 at 1:06 pm

    […] define exactly what implementation and technical sound design is right now. This is not to say that proprietary toolsets shouldn’t exist when necessary, but that our drive to stay proprietary is holding us […]

  4. Reading Digest: The Late 80s/Early 90s Strike Back Edition « Dead Homer Society says:
    June 10, 2011 at 4:36 pm

    […] Audio Implementation Greats #2: Audio Toolsets [Part 2] – This is pretty much for audiophiles only, but if you scroll to the bottom here you can see some screen grabs from a presentation EA games gave about the sound design of The Simpsons Game.  There’s even a link to download their actual Power Point file.  […]

Social Media

  • Twitter
  • YouTube

Posts By Month

#sounddesign on Twitter

#sounddesign

tunepocketTunePocket Music@tunepocket·
26 May 2020

Download royalty free gunshot sound effects, incl. one shot gun sounds, gun cocking sounds, gunshot with silencer, machine guns, and more #gunshot #sfx #sounddesign #videoediting #gamedev #royaltyfree https://t.co/bTTDQkveKF

Reply on Twitter 1265206307927162880Retweet on Twitter 1265206307927162880Like on Twitter 1265206307927162880Twitter 1265206307927162880
Reel2MReel2Media@Reel2M·
26 May 2020

At Reel2Media we are harnessing the power of smart speaker technology, to deliver cutting edge skills that solve problems and add value. To find out more, click here https://t.co/VAAw7vTW1V #sounddesign #smartspeaker #alexaskill #amazonalexa

Reply on Twitter 1265206269255847936Retweet on Twitter 1265206269255847936Like on Twitter 1265206269255847936Twitter 1265206269255847936
SoniKSoundLibSoniK Sound Library@SoniKSoundLib·
26 May 2020

Listen to #soundcloud preview of our next release! #np https://t.co/S3bxxrnqrh #audiopost #soundlibrary #soundediting #sounddesign #ambisonics #spatial #surround #ambience #roomtones

Reply on Twitter 1265204382779559936Retweet on Twitter 12652043827795599361Like on Twitter 12652043827795599361Twitter 1265204382779559936
asoundeffectA Sound Effect@asoundeffect·
26 May 2020

Want to know what the independent sound effects community has been up to? Hear the very latest SFX libraries here: https://t.co/OUBM2SqMoP #sounddesign #soundeffects #soundlibraries #indieSFX #gameaudio #filmsound #filmmaking #gamedev #indiedev #indiefilm

Reply on Twitter 1265199255838511105Retweet on Twitter 1265199255838511105Like on Twitter 1265199255838511105Twitter 1265199255838511105
OblikLinesOblik Lines@OblikLines·
26 May 2020

Working on new tracks with many instances of Misty Valley ! ⁠
Misty Valley is free for all NI Reaktor users⁠
You can get it here: https://t.co/bb53Gtkw5e

#reaktor6 #reaktor #nativeinstruments #synths #vst #sounddesign #virtualinstrument #musicproducer #obliklines #mistyvalley

Reply on Twitter 1265198647307907073Retweet on Twitter 1265198647307907073Like on Twitter 1265198647307907073Twitter 1265198647307907073
Load More...

Copyright Info

All content on Designing Sound is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License.

Copyright © 2023 · Magazine Pro Theme on Genesis Framework · WordPress · Log in