Want to see something that’ll mess with your head?
Now, you may not have noticed anything all that strange watching the video, but mute the sound and watch it again. After that, close your eyes and listen to just the audio. Notice anything strange now? You’ve just witnessed one of the more interesting perceptual illusions, the McGurk effect.
A few months ago I came across a Twitter post made by Stephan Schütze (a recent Designing Sound contributor) that continues to resonate with me (no pun intended) and I wanted to share it with anyone in the sound design community that has yet to hear these sounds.
As a side note, Stephan’s tweet was unrelated to his Designing Sound contribution (which can be found here) that he wrote for our monthly theme dedicated to Vehicles.
The original Twitter post was for an article entitled:
NASA Probes Record Sounds In Space – And It’s Terrifying.
I was immediately enthralled as soon as I heard the sounds. Opposed to my previous beliefs, outer space actually does produce sound, and the sounds are quite remarkable.
Back around the time I was first starting out, I remember opening up a demo of Cubase VST (on my trusty PowerMac 6400) and taking a look through the various menus. Everything seemed pretty standard, but something in particular caught my eye, a menu item labeled “Ears Only”. Curious, I clicked on it, only to have my monitor go completely blank. After a few seconds of panic thinking I had broken everything, I realized that Steinberg had programmed a mode that completely disabled the monitor and forced you to just listen. At first, this option seemed like a strange addition. Why, when I’m creating sound, would I not be listening to what I’m doing? Listening while working with audio seemed like a no-brainer. However, after gaining a little more experience, this “just listen” mode began to make a lot more sense.
Indiewire has published a guest post by Dolby Institute’s director Glenn Kiser in which he talks to filmmakers about the importance of sound design from the beginning of production.
Making a movie is a never-ending series of compromises, and nothing is as good as the original concept you had in mind. But if you’re really lucky, there’s a moment of alchemy that can happen in the editing room when you put the right piece of music or the right sound effect into the cut. Suddenly something magical happens, and the thing comes to life. You forget about the perfect location you couldn’t secure and the cold your lead actor had on the day you shot the emotional scene. It stops being a maddening litany of disappointments and becomes a movie.
I recently came across the Frictional Games blog and have spent the last few weeks trawling through it’s archive. It provides a wealth of informaiton on game design, and in particular discussions on the point of game narrative. One particular post, 4 Layers, a narrative design approach, written by Thomas Grip, Frictional’s creative director, raised the concept of the mental model, and the impact this can have, not only on game design, but also on a players experience of a game.