meta_pixel
Tapesearch Logo
Log in
The Quanta Podcast

Where We See Shapes, AI Sees Textures

The Quanta Podcast

Quanta Magazine

Life Sciences, Physics, Science

4.7640 Ratings

🗓️ 4 June 2020

⏱️ 16 minutes

🧾️ Download transcript

Summary

To researchers’ surprise, deep learning vision algorithms often fail at classifying images because they mostly take cues from textures, not shapes.

The post Where We See Shapes, AI Sees Textures first appeared on Quanta Magazine

Transcript

Click on a timestamp to play from that location

0:00.0

Welcome to Quantum Magazine's podcast.

0:08.6

Each episode we bring you stories about developments in science and mathematics.

0:13.2

I'm Susan Vallett.

0:14.7

When you look at a photograph of a cat, chances are that you can recognize the pictured animal,

0:19.9

whether it's ginger or striped,

0:22.2

and you still know it's a cat if the image is black and white, covered in dust specs, or worn and faded.

0:28.9

The cat might be a blur of motion or obscured by tree branches, and you'd still know what it is.

0:35.5

You've naturally learned to identify a cat in almost any situation. In contrast,

0:41.0

machine vision systems powered by deep neural networks can sometimes even outperform humans at

0:47.6

recognizing a cat under fixed conditions, but images that are even a little novel, noisy, or grainy, can throw off those systems completely.

0:57.0

A research team in Germany has now discovered an unexpected reason why.

1:02.0

Humans pay attention to the shapes of pictured objects.

1:08.0

If we look at cat pictures, we know the rough outline of a cat,

1:12.9

whether it's standing, curled up sleeping, or climbing a tree. But deep learning computer

1:18.5

vision algorithms routinely latch onto the object's textures instead. Researchers presented this

1:24.9

finding at the International Conference on Learning Representations last year.

1:30.1

It highlights the sharp contrast between how humans think and machines process information.

1:37.0

It illustrates how misleading our intuitions can be, too, about what makes artificial intelligences tick.

1:44.1

It may also hint at why our own vision

1:46.5

evolved the way it did. Let's take a look at how deep learning algorithms work. Say we present

1:53.0

a neural network with thousands of images that either contain or don't contain cats. The system

1:59.5

finds patterns in that data.

...

Please login to see the full transcript.

Disclaimer: The podcast and artwork embedded on this page are from Quanta Magazine, and are the property of its owner and not affiliated with or endorsed by Tapesearch.

Generated transcripts are the property of Quanta Magazine and are distributed freely under the Fair Use doctrine. Transcripts generated by Tapesearch are not guaranteed to be accurate.

Copyright © Tapesearch 2026.