When Sight Shapes Sound (And Vice Versa)

We take in streams of information of radically different forms: photons through the eyes, textures through the skin, air vibrations through the ears, molecules through the nose. Marvelously, we manage to integrate all that information into a unified, coherent feel of the world. It turns out that as we draw in these different streams, we use information from one sense to shape what we take in from others. It’s an efficient way to make the most of our imperfect perceptions. But it also leaves us vulnerable to some remarkable illusions, like the one illustrated in this video.

In my latest column for Discover, I explore our powers of multi-sensory integration. Check it out.

Go Further

Subscriber Exclusive Content

Why are people so dang obsessed with Mars?

How viruses shape our world

The era of greyhound racing in the U.S. is coming to an end

See how people have imagined life on Mars through history

See how NASA’s new Mars rover will explore the red planet

Why are people so dang obsessed with Mars?

How viruses shape our world

The era of greyhound racing in the U.S. is coming to an end

See how people have imagined life on Mars through history

See how NASA’s new Mars rover will explore the red planet

Why are people so dang obsessed with Mars?

How viruses shape our world

The era of greyhound racing in the U.S. is coming to an end

See how people have imagined life on Mars through history

See how NASA’s new Mars rover will explore the red planet