• Home
  • About
  • Site Policies
  • Contact

Designing Sound

Art and technique of sound design

  • All Posts
  • Featured
  • News
  • Interviews
  • Reviews
  • Tutorials
  • Resources
    • VR Audio Resources
    • Independent SFX Libraries
    • Events Calendar
  • Series Archives
    • Featured Topics
    • Featured Sound Designers
    • Audio Implementation Greats
    • Exclusive Interviews
    • Behind the Art
    • Webinar/Discussion Group Recordings
    • Sunday Sound Thought
    • The Sound Design Challenge

Audio Implementation Greats #3: Crackdown – Realtime Worlds

February 10, 2010 by lostchocolatelab

Crackdown

One area that has been gaining ground since the early days of EAX on the PC platform, and more recently it’s omnipresence in audio middleware toolsets, is Reverb. With the ability to enhance the sounds playing back in the game with reverberant information from the surrounding space, you can effectively communicate to the player a truer approximation of “being there” and help to further immerse them in the game world. While we often take Reverb for granted in our everyday life as something that helps us position ourselves in a space (the cavernous echo of an airport, the openness of a forest), it is something that is continually giving us feedback on our surroundings, and thus a critical part of the way we experience the world.

While It has become standard practice to enable Reverb within a single game level and apply a single preset algorithm to a subset of the sound mix. Many developers have taken this a step further and created Reverb regions that will call different Reverb presets based on the area the player is currently located. This allows the Reverb to change based on predetermined locations using predefined Reverb settings. Furthermore, these presets have been extended to area’s outside of the player region so that sounds coming from a different region can use the region and settings of the sounds origin in order to get their Reverberant information. Each of these scenarios is valid in an industry where you must carefully balance all of your resources, and where features must play to the strengths of your game design.

While preset Reverb and Reverb Regions have become a standard, and are a welcome addition to a Sound Designers toolbox, these techniques ignore the inherent physical characteristics of a space and are unable to dynamically react to reflections from these surfaces relative to the player. In order to bring Reverb closer to realtime expectations, level geometry could be referenced based on the originating position of a sound within a space, and that data could then be used to apply appropriate reflections.

One way of accomplishing this in the current generation of consoles is through the use of Ray Traced Convolution Reverb, a technique which snuck in under our noses in the Xbox 360 launch title Crackdown, from Realtime Worlds. 

”When we heard the results of our complex Reverb/Reflections/Convolution or “Audio-Shader” system in Crackdown, we knew that we could make our gunfights sound like that, only in real-time! Because we are simulating true reflections on every 3D voice in the game, with the right content we could immerse the player in a way never before heard.”-Raymond Usher (Team Xbox)

So, what is realtime Reverb using ray tracing and convolution on a per-voice implementation?
Simply put, it is the idea that every sound that happens within the game world has spatially correct reverberation reflections applied to it. Let’s dig in a bit more…

Here’s a quick definition of Ray Tracing as it applies to physics calculation:

“In physics, ray tracing is a method for calculating the path of waves or particles through a system with regions of varying propagation velocity, absorption characteristics, and reflecting surfaces. Under these circumstances, wavefronts may bend, change direction, or reflect off surfaces, complicating analysis. Ray tracing solves the problem by repeatedly advancing idealized narrow beams called rays through the medium by discrete amounts. Simple problems can be analyzed by propagating a few rays using simple mathematics. More detailed analysis can be performed by using a computer to propagate many rays.” –Wikipedia

On the other side of the coin you have the concept of convolution:

“In audio signal processing, convolution Reverb is a process for digitally simulating the reverberation of a physical or virtual space. It is based on the mathematical convolution operation, and uses a pre-recorded audio sample of the impulse response of the space being modeled. To apply the reverberation effect, the impulse-response recording is first stored in a digital signal-processing system. This is then convolved with the incoming audio signal to be processed.” –Wikipedia

So what you end up with is a pre-recorded impulse response of a space (room, cave, outdoor) being modified (or convoluted) by the Ray Traced calculations of the surrounding physical spaces. The distance of a originating sound from the level geometry defined in the Ray Traced calculation gives the reflections their parameters which effect the Impulse Response sample of the space type.

You can hear the results of their effort in every gunshot, explosion, physics object, and vehicle as you travel through the concrete jungle of Pacific City. As the player walks around the city, a passing car is with it’s radio blaring can be heard positionally from the open window in addition to it’s reflection off of a nearby wall; meanwhile footsteps & gunshots are continuously being reverberated realistically depending on the changing environmental characteristics. What this allows the sound to communicate is a greater sense of location and dynamics of the sound at the time it is triggered.

While the result may be less impressive than the complexity of the implementation, the additive effect that it has on the multitude of sounds happening throughout a game can bear a significant effect on adding realism to the environment. It’s also worth noting that Crackdown2 will be hitting shelves soon from Ruffian Games, along with the Realtime Worlds’ new MMO All Points Bulletin. No word yet on whether either of these will continue to push realtime Reverb but all ears will be on them for advancing the potential of this technique.

With a future for convolution Reverb implied in a recent press release for Audiokinetic’s Wwise toolset, and the brief outline of it’s use in Radical’s recent open world game Prototype, let’s hope the idea of Realtime Reverb in some way, shape, or form continues to play an integral part in the next steps towards runtime spatialization.

Article: The Audio of Crackdown
Podcast Interview with MGS Kristofer Mellroth (Starts at 12:00 in)

See video example of Realtime Reverb Debug @ 4:15

Crackdown – Sound Study Footsteps

Filed Under: featured, videos Tagged With: audio implementation greats, convolution, crackdown, damian kastbauer, footsteps, gameaudio, implementation, physics, real time, reverb, sound design, video games, videos, xbox

Comments

  1. Tom@fullsail says

    February 10, 2010 at 2:12 pm

    Thanks again for some great information Damian. I was very impressed with the quality of the environmental reflections in crackdown. I certainly hope that more groups use this kind of Reverberation, which perhaps they already have.

  2. Emilia Beneke says

    February 24, 2010 at 11:19 pm

    Great way to explain it. Can’t say more than to appreciate what you are penned down. can you show how to grab your rss feed? I couldn’t find how.

  3. Miguel Isaza says

    February 24, 2010 at 11:24 pm

    Hi Emilia, Glad to know you like the blog!

    You can get the RSS Feed here:

    https://designingsound.org/feed

    Cheers,

    Miguel

  4. Anon Ymous says

    December 13, 2012 at 1:52 pm

    Great article.  Honestly, fascinating stuff.

    Just a tip though:
    http://www.grammar-monster.com/easily_confused/its_its.htm

  5. Kristofor Mellroth says

    December 18, 2012 at 2:55 pm

    DK, you spelt me name wrong! :)

Trackbacks

  1. Rewind…Audio Implementation Greats #3: Crackdown – Realtime Worlds says:
    December 13, 2012 at 9:51 am

    […] Continue Reading >> audio implementation greats, convolution, crackdown, damian kastbauer, footsteps, gameaudio, implementation, physics, real time, reverb, sound design, video games, videos, xbox, 0 Leave a Reply […]

Social Media

  • Twitter
  • YouTube

Posts By Month

#sounddesign on Twitter

#sounddesign

tunepocketTunePocket Music@tunepocket·
26 May 2020

Download royalty free gunshot sound effects, incl. one shot gun sounds, gun cocking sounds, gunshot with silencer, machine guns, and more #gunshot #sfx #sounddesign #videoediting #gamedev #royaltyfree https://t.co/bTTDQkveKF

Reply on Twitter 1265206307927162880Retweet on Twitter 1265206307927162880Like on Twitter 1265206307927162880Twitter 1265206307927162880
Reel2MReel2Media@Reel2M·
26 May 2020

At Reel2Media we are harnessing the power of smart speaker technology, to deliver cutting edge skills that solve problems and add value. To find out more, click here https://t.co/VAAw7vTW1V #sounddesign #smartspeaker #alexaskill #amazonalexa

Reply on Twitter 1265206269255847936Retweet on Twitter 1265206269255847936Like on Twitter 1265206269255847936Twitter 1265206269255847936
SoniKSoundLibSoniK Sound Library@SoniKSoundLib·
26 May 2020

Listen to #soundcloud preview of our next release! #np https://t.co/S3bxxrnqrh #audiopost #soundlibrary #soundediting #sounddesign #ambisonics #spatial #surround #ambience #roomtones

Reply on Twitter 1265204382779559936Retweet on Twitter 12652043827795599361Like on Twitter 12652043827795599361Twitter 1265204382779559936
asoundeffectA Sound Effect@asoundeffect·
26 May 2020

Want to know what the independent sound effects community has been up to? Hear the very latest SFX libraries here: https://t.co/OUBM2SqMoP #sounddesign #soundeffects #soundlibraries #indieSFX #gameaudio #filmsound #filmmaking #gamedev #indiedev #indiefilm

Reply on Twitter 1265199255838511105Retweet on Twitter 1265199255838511105Like on Twitter 1265199255838511105Twitter 1265199255838511105
OblikLinesOblik Lines@OblikLines·
26 May 2020

Working on new tracks with many instances of Misty Valley ! ⁠
Misty Valley is free for all NI Reaktor users⁠
You can get it here: https://t.co/bb53Gtkw5e

#reaktor6 #reaktor #nativeinstruments #synths #vst #sounddesign #virtualinstrument #musicproducer #obliklines #mistyvalley

Reply on Twitter 1265198647307907073Retweet on Twitter 1265198647307907073Like on Twitter 1265198647307907073Twitter 1265198647307907073
Load More...

Copyright Info

All content on Designing Sound is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License.

Copyright © 2023 · Magazine Pro Theme on Genesis Framework · WordPress · Log in