See invisible motion, hear silent sounds. Cool? Creepy? We can't decide | Michael Rubinstein

Prevodilac: Branka Malenica Lektor: Mile Živković

So over the past few centuries, microscopes have revolutionized our world.

Tokom proteklih nekoliko vekova mikroskopi su preokrenuli naš svet.

They revealed to us a tiny world of objects, life and structures

Otkrili su nam taj mali svet predmeta, života i struktura

that are too small for us to see with our naked eyes.

koji su isuviše mali da bismo ih mogli videti golim očima.

They are a tremendous contribution to science and technology.

Dali su ogroman doprinos nauci i tehnologiji.

Today I'd like to introduce you to a new type of microscope,

Danas bih voleo da vam predstavim novi tip mikroskopa,

a microscope for changes.

mikroskop za promene.

It doesn't use optics like a regular microscope

Njemu ne treba optika kao redovnom mikroskopu

to make small objects bigger,

da male objekte učini većim,

but instead it uses a video camera and image processing

nego koristi video kameru i procesor slika

to reveal to us the tiniest motions and color changes in objects and people,

kako bi nam otkrio one najmanje pokrete i promene u boji predmeta i ljudi,

changes that are impossible for us to see with our naked eyes.

promene koje je nemoguće videti golim okom.

And it lets us look at our world in a completely new way.

Tako nam dopušta da vidimo naš svet na sasvim novi način.

So what do I mean by color changes?

No, šta ja mislim pod promenom boja?

Our skin, for example, changes its color very slightly

Naša koža, na primer, neznatno menja boju

when the blood flows under it.

kada krv teče pod njom.

That change is incredibly subtle,

Ta promena je izuzetno suptilna,

which is why, when you look at other people,

i zato kada gledate ljude,

when you look at the person sitting next to you,

kada pogledate osobu koja sedi pored vas,

you don't see their skin or their face changing color.

ne vidite kako se boje menjaju na njihovoj koži ili na licu.

When we look at this video of Steve here, it appears to us like a static picture,

Kada pogledate ovaj snimak sa Stivom, primetićete da deluje kao statična slika,

but once we look at this video through our new, special microscope,

ali kada pogledamo ovaj video snimljen našim novim, specijalnim mikroskopom,

suddenly we see a completely different image.

odjednom primećujemo sasvim novu sliku.

What you see here are small changes in the color of Steve's skin,

Ono što vidite ovde su male promene u boji Stivove kože,

magnified 100 times so that they become visible.

uvećane 100 puta kako bi postale vidljive.

We can actually see a human pulse.

Mi zapravo možemo da vidimo ljudski puls.

We can see how fast Steve's heart is beating,

Možemo videti koliko brzo kuca Stivovo srce

but we can also see the actual way that the blood flows in his face.

ali možemo takođe videti i kako krv zapravo teče u njegovom licu.

And we can do that not just to visualize the pulse,

I to možemo uraditi ne samo da bismo prikazali puls,

but also to actually recover our heart rates,

već da bismo, pored toga, videli

and measure our heart rates.

i izmerili otkucaje svog srca.

And we can do it with regular cameras and without touching the patients.

I to možemo učiniti običnim kamerama, bez dodirivanja pacijenta.

So here you see the pulse and heart rate we extracted from a neonatal baby

Ovde vidite puls i brzinu otkucaja srca koje smo zabeležili kod novorođene bebe

from a video we took with a regular DSLR camera,

u videu koji smo snimili klasičnom DSLR kamerom,

and the heart rate measurement we get

a brzina otkucaja srca koju smo dobili

is as accurate as the one you'd get with a standard monitor in a hospital.

istovetna je onoj koju bi izmerio standardni monitor u bolnici.

And it doesn't even have to be a video we recorded.

A to zapravo ne mora da bude video koji smo mi snimili.

We can do it essentially with other videos as well.

Mi to možemo raditi i sa drugim snimcima.

So I just took a short clip from "Batman Begins" here

Zato sam uzeo klip iz filma "Betmen počinje"

just to show Christian Bale's pulse.

da vam pokažem puls Kristijana Bejla.

(Laughter)

(Smeh)

And you know, presumably he's wearing makeup,

I znate, pošto je on verovatno našminkan,

the lighting here is kind of challenging,

osvetljenje je ovde pravi izazov,

but still, just from the video, we're able to extract his pulse

ali svejedno, iz ovog videa ipak možemo izdvojiti njegov puls

and show it quite well.

i pokazati ga prilično uspešno.

So how do we do all that?

Pa, kako to uopšte radimo?

We basically analyze the changes in the light that are recorded

Mi, zapravo, analiziramo promene svetla

at every pixel in the video over time,

koje se snimaju u svakom pikselu snimka tokom vremena,

and then we crank up those changes.

I onda naglasimo te promene.

We make them bigger so that we can see them.

Uvećamo ih tako da ih možemo videti.

The tricky part is that those signals,

Najteži deo je to što su ti signali,

those changes that we're after, are extremely subtle,

te promene koje mi tražimo, neverovatno suptilne,

so we have to be very careful when you try to separate them

pa moramo da budemo jako oprezni dok ih razdvajamo

from noise that always exists in videos.

od smetnji iz svih tih snimaka.

So we use some clever image processing techniques

Zato koristimo vrlo pametne tehnike u preradi slika

to get a very accurate measurement of the color at each pixel in the video,

kako bismo dobili najtačniju meru boje svakog piksela u videu

and then the way the color changes over time,

i načina na koji se boja vremenom menja,

and then we amplify those changes.

i tek onda mi pojačamo te promene.

We make them bigger to create those types of enhanced videos, or magnified videos,

Uvećavamo ih kako bismo dobili te unapređene ili uvećane snimke

that actually show us those changes.

koji zapravo pokazuju sve te promene.

But it turns out we can do that not just to show tiny changes in color,

Ali, ispostavilo se da tako ne pokazujemo samo promene u boji

but also tiny motions,

već i u malim pokretima,

and that's because the light that gets recorded in our cameras

jer se svetlo snimljeno našim kamerama

will change not only if the color of the object changes,

neće promeniti samo ako se boja objekta menja,

but also if the object moves.

već i kada se objekat pokreće.

So this is my daughter when she was about two months old.

Ovo je moja ćerka kada je imala oko dva meseca.

It's a video I recorded about three years ago.

Ovaj video sam napravio pre tri godine.

And as new parents, we all want to make sure our babies are healthy,

Kao novi roditelji, želimo da budemo sigurni da su naša deca zdrava,

that they're breathing, that they're alive, of course.

da dišu, da su živa, naravno.

So I too got one of those baby monitors

Pa sam i ja nabavio jedan bebi monitor

so that I could see my daughter when she was asleep.

da bih mogao da gledam svoju ćerku dok spava.

And this is pretty much what you'll see with a standard baby monitor.

Ovo je otprilike ono što vidite preko standardnog bebi monitora.

You can see the baby's sleeping, but there's not too much information there.

Možete videti bebu kako spava, ali nema nekih daljih informacija.

There's not too much we can see.

Ne možemo da vidimo puno toga.

Wouldn't it be better, or more informative, or more useful,

Zar ne bi bilo bolje, ili informativnije, ili korisnije,

if instead we could look at the view like this.

kada bismo mogli da vidimo ovakvu sliku.

So here I took the motions and I magnified them 30 times,

Zato sam ovde izdvojio pokrete i uveličao ih 30 puta

and then I could clearly see that my daughter was indeed alive and breathing.

i tek tada sam jasno video da je moja ćerka zaista živa i da diše.

(Laughter)

(Smeh)

Here is a side-by-side comparison.

Uporedite ova dva snimka.

So again, in the source video, in the original video,

Dakle, u izvornom, originalnom videu,

there's not too much we can see,

nema puno toga da se vidi,

but once we magnify the motions, the breathing becomes much more visible.

ali tek kada uvećamo pokrete, disanje postaje lako vidljivo.

And it turns out, there's a lot of phenomena

Na kraju se ispostavilo da ima puno pojava

we can reveal and magnify with our new motion microscope.

koje možemo otkriti i uvećati sa našim novim mikroskopom za pokrete.

We can see how our veins and arteries are pulsing in our bodies.

Možemo videti kako vene i arterije pulsiraju u našim telima.

We can see that our eyes are constantly moving

Možemo videti kako se naše oči konstantno kreću

in this wobbly motion.

uz ovo drhtanje.

And that's actually my eye,

Ovo je zapravo moje oko,

and again this video was taken right after my daughter was born,

i ovaj video je snimljen taman posle rođenja moje ćerke,

so you can see I wasn't getting too much sleep. (Laughter)

pa možete videti da nisam dovoljno spavao. (Smeh)

Even when a person is sitting still,

Čak i kada osoba sedi mirno,

there's a lot of information we can extract

ima puno informacija koje možemo dobiti

about their breathing patterns, small facial expressions.

o načinu njenog disanja i izrazima lica.

Maybe we could use those motions

Možda te pokrete možemo iskoristiti

to tell us something about our thoughts or our emotions.

da saznamo nešto o našim mislima i emocijama.

We can also magnify small mechanical movements,

Možemo takođe uvećati i male mehaničke pokrete,

like vibrations in engines,

poput vibracija u motorima,

that can help engineers detect and diagnose machinery problems,

što može pomoći inžinjerima pri utvrđivanju mašinskih problema,

or see how our buildings and structures sway in the wind and react to forces.

a možemo videti kako se zgrade i građevine njišu na vetru i kako reaguju na silu.

Those are all things that our society knows how to measure in various ways,

Sve su to stvari koje naše društvo zna da izmeri na različite načine,

but measuring those motions is one thing,

ali meriti te pokrete je jedna stvar,

and actually seeing those motions as they happen

zbilja videti kako se ti pokreti prave

is a whole different thing.

je nešto potpuno drugačije.

And ever since we discovered this new technology,

Otkad smo otkrili ovu novu tehnologiju, postavili smo naš kod

we made our code available online so that others could use and experiment with it.

na internet da bi i drugi mogli da ga koriste i eksperimentišu sa njim.

It's very simple to use.

Vrlo je jednostavan.

It can work on your own videos.

Funkcioniše i na vašim privatnim snimcima.

Our collaborators at Quanta Research even created this nice website

Naši saradnici iz "Quanta Research" napravili su ovaj sjajan sajt

where you can upload your videos and process them online,

gde možete postaviti svoje snimke i preraditi ih onlajn.

so even if you don't have any experience in computer science or programming,

Pa čak i ako nemate nikakvog iskustva iz informatike i programiranja,

you can still very easily experiment with this new microscope.

vrlo lako možete eksperimentisati sa ovim novim mikroskopom.

And I'd like to show you just a couple of examples

I voleo bih da vam pokažem nekoliko primera

of what others have done with it.

onoga šta su drugi napravili sa tim.

So this video was made by a YouTube user called Tamez85.

Dakle, ovaj video je napravio YouTube korisnik zvani Tamez85.

I don't know who that user is,

Ja ne znam ko je taj korisnik,

but he, or she, used our code

ali on, ili ona, uzeo je naš kod

to magnify small belly movements during pregnancy.

i povećao sitne pokrete u stomaku tokom trudnoće

It's kind of creepy.

Pomalo je jezivo.

(Laughter)

(Smeh)

People have used it to magnify pulsing veins in their hands.

Ljudi su njime uvećavali pulsiranje vena u njihovim rukama.

And you know it's not real science unless you use guinea pigs,

Ipak, znate da se ne radi o pravoj nauci ako ne koristite zamorčad,

and apparently this guinea pig is called Tiffany,

a ovo zamorče se očito zove Tifani,

and this YouTube user claims it is the first rodent on Earth

a ovaj korisnik na Jutjubu tvrdi da je ona prvi glodar na Zemlji

that was motion-magnified.

čiji su pokreti ovako uvećani.

You can also do some art with it.

Ovako možete praviti i umetnička dela.

So this video was sent to me by a design student at Yale.

Ovaj video mi je poslala studentkinja dizajna sa Jejla.

She wanted to see if there's any difference

Želela je da vidi ima li razlike u tome

in the way her classmates move.

kako se kreću njene kolege.

She made them all stand still, and then magnified their motions.

Svima im je naredila da stoje mirno i onda uvećala njihove pokrete.

It's like seeing still pictures come to life.

To je kao da gledate kako mrtva priroda oživljava.

And the nice thing with all those examples

Lepa stvar u vezi sa svim ovim eksperimentima

is that we had nothing to do with them.

je to što mi nismo imali ništa sa njima.

We just provided this new tool, a new way to look at the world,

Samo smo obezbedili ovu novu alatku, nov način gledanja na svet,

and then people find other interesting, new and creative ways of using it.

a onda su drugi ljudi našli interesantne, nove i kreativne načine da ga upotrebe.

But we didn't stop there.

Ali, nismo tu stali.

This tool not only allows us to look at the world in a new way,

Ova alatka ne samo da nam je dozvolila da gledamo svet novim očima,

it also redefines what we can do

nego je redefinisala ono što mi radimo

and pushes the limits of what we can do with our cameras.

i pogurala granice onoga što možemo da učinimo sa našim kamerama.

So as scientists, we started wondering,

Kao naučnici počeli smo da se pitamo,

what other types of physical phenomena produce tiny motions

koje druge fizičke pojave stvaraju sitne pokrete

that we could now use our cameras to measure?

koje sada možemo izmeriti našim novim kamerama?

And one such phenomenon that we focused on recently is sound.

Jedna takva pojava na koju smo se nedavno fokusirali je zvuk.

Sound, as we all know, is basically changes

Kao što svi znamo, zvuk zapravo predstavlja promene

in air pressure that travel through the air.

u vazdušnom pritisku koje putuju kroz vazduh.

Those pressure waves hit objects and they create small vibrations in them,

Ti talasi pritiska udaraju o objekte i stvaraju male vibracije u njima,

which is how we hear and how we record sound.

i tako mi čujemo i snimamo zvuk.

But it turns out that sound also produces visual motions.

No, ispostavilo se da zvuk uz to stvara i vizuelne pokrete.

Those are motions that are not visible to us

Ti pokreti su nama nevidljivi,

but are visible to a camera with the right processing.

ali ih naša kamera vidi kada se dobro podesi.

So here are two examples.

Evo vam dva primera.

This is me demonstrating my great singing skills.

Ovde ja demonstriram svoje sjane glasovne sposobnosti.

(Singing)

(Pevanje)

(Laughter)

(Smeh)

And I took a high-speed video of my throat while I was humming.

Dok sam tako brujao, snimio sam ubrzani video svog grla.

Again, if you stare at that video,

Opet, ako pažljivo pogledate video,

there's not too much you'll be able to see,

neće biti puno toga što ćete moći da vidite,

but once we magnify the motions 100 times, we can see all the motions and ripples

ali kada uvećamo pokrete 100 puta, možemo videti sve pokrete i talase

in the neck that are involved in producing the sound.

koji učestvuju u stvaranju zvuka u mom vratu.

That signal is there in that video.

Taj signal je tu u tom snimku.

We also know that singers can break a wine glass

Takođe znamo da pevači mogu da razbiju čašu za vino

if they hit the correct note.

ako pogode pravu notu.

So here, we're going to play a note

Pa hajde da odsviramo notu

that's in the resonance frequency of that glass

koja je u rezonantnoj frekvenciji te čaše

through a loudspeaker that's next to it.

na zvučniku koji se nalazi pored nje.

Once we play that note and magnify the motions 250 times,

Kada odsviramo tu notu i uvećamo pokrete 250 puta,

we can very clearly see how the glass vibrates

sasvim jasno ćemo videti kako čaša vibrira

and resonates in response to the sound.

i rezonira u odgovoru na zvuk.

It's not something you're used to seeing every day.

To nije nešto što viđate svakog dana.

But this made us think. It gave us this crazy idea.

Ali ovo nas je nateralo da razmislimo. Dalo nam je ludačku ideju.

Can we actually invert this process and recover sound from video

Možemo li zapravo da obrnemo ovaj proces i izdvojimo zvuk iz snimka

by analyzing the tiny vibrations that sound waves create in objects,

analizom malih vibracija koje zvučni talasi stvaraju u predmetima

and essentially convert those back into the sounds that produced them.

i da ih na kraju konvertujemo natrag u zvuk koji ih je stvorio?

In this way, we can turn everyday objects into microphones.

Ovako sasvim obične predmete možemo pretvoriti u mikrofone.

So that's exactly what we did.

I to je upravo ono što smo uradili.

So here's an empty bag of chips that was lying on a table,

Dakle, ovo je prazna kesica čipsa koja se nalazi na stolu

and we're going to turn that bag of chips into a microphone

i mi ćemo da pretvorimo tu kesicu čipsa u mikrofon

by filming it with a video camera

tako što ćemo je usnimiti kamerom

and analyzing the tiny motions that sound waves create in it.

i analizirati male pokrete koje zvučni talasi stvaraju u njoj.

So here's the sound that we played in the room.

Ovo je zvuk koji smo pustili u toj sobi.

(Music: "Mary Had a Little Lamb")

(Muzika: „Meri je imala malo jagnje“)

And this is a high-speed video we recorded of that bag of chips.

A ovo je taj ubrzani video kesice čipsa koji smo snimili.

Again it's playing.

Evo ga opet.

There's no chance you'll be able to see anything going on in that video

Nema šanse da primetite da se išta dešava u tom snimku

just by looking at it,

dok ga posmatrate,

but here's the sound we were able to recover just by analyzing

ali evo zvuka kojeg smo uspeli da izdvojimo analizom

the tiny motions in that video.

malih pokreta u tom istom snimku.

(Music: "Mary Had a Little Lamb")

(Muzika: „Meri je imala malo jagnje“)

I call it -- Thank you.

Ja to zovem - hvala vam.

(Applause)

(Aplauz)

I call it the visual microphone.

Ja to zovem vizuelnim mikrofonom.

We actually extract audio signals from video signals.

Mi smo, u suštini, izdvojili audio signale iz video signala.

And just to give you a sense of the scale of the motions here,

Samo da dobijete uvid u to o kakvom se nivou pokreta ovde radi,

a pretty loud sound will cause that bag of chips to move less than a micrometer.

od prilično glasnog zvuka, kesica čipsa će se pomeriti manje od mikrometra.

That's one thousandth of a millimeter.

To je hiljaditi deo milimetra.

That's how tiny the motions are that we are now able to pull out

Toliko su mali pokreti koje sada možemo da uočimo

just by observing how light bounces off objects

posmatranjem toga kako se svetlo odbija o predmet,

and gets recorded by our cameras.

što su uspele da zabeleže naše kamere.

We can recover sounds from other objects, like plants.

Možemo da izdvojimo zvuk iz drugih objekata poput biljaka.

(Music: "Mary Had a Little Lamb")

(Muzika: " Meri je imala malo jagnje")

And we can recover speech as well.

A možemo da izdvojimo i govor.

So here's a person speaking in a room.

Evo jedne osobe koja govori u prostoriji.

Voice: Mary had a little lamb whose fleece was white as snow,

Glas: „Meri je imala malo jagnje runa belog kao sneg,

and everywhere that Mary went, that lamb was sure to go.

i svuda gde je Meri išla, jagnje je moralo za njom“

Michael Rubinstein: And here's that speech again recovered

Majkl Rubinštajn: Opet ću vam pustiti isti govor, ali ovaj put

just from this video of that same bag of chips.

izdvojen iz istog onog snimka sa kesicom čipsa.

Voice: Mary had a little lamb whose fleece was white as snow,

Glas: „Meri je imala malo jagnje runa belog kao sneg,

and everywhere that Mary went, that lamb was sure to go.

i svuda gde je Meri išla, jagnje je moralo za njom“

MR: We used "Mary Had a Little Lamb"

MR: Uzeli smo pesmu „Meri je imala malo jagnje“

because those are said to be the first words

zato što se veruje da su to prve reči

that Thomas Edison spoke into his phonograph in 1877.

koje je Tomas Edison izgovorio u svoj fonograf 1877. godine.

It was one of the first sound recording devices in history.

To je bio jedan od prvih aparata za snimanje zvuka u istoriji.

It basically directed the sounds onto a diaphragm

On je u osnovi upućivao zvukove na dijafragmu

that vibrated a needle that essentially engraved the sound on tinfoil

koja je vibrirala iglu, a ova je zapravo urezivala zvuk na list kalaja

that was wrapped around the cylinder.

omotan oko cilindra.

Here's a demonstration of recording and replaying sound with Edison's phonograph.

Evo demonstracije snimka i ponovnog puštanja zvuka sa Edisonovog fonografa.

(Video) Voice: Testing, testing, one two three.

(Video) Glas: „Test, test, jedan dva tri.

Mary had a little lamb whose fleece was white as snow,

Meri je imala malo jagnje runa belog kao sneg,

and everywhere that Mary went, the lamb was sure to go.

I svuda gde je Meri išla, jagnje je moralo za njom.

Testing, testing, one two three.

Test, test, jedan dva tri.

Mary had a little lamb whose fleece was white as snow,

Meri je imala malo jagnje runa belog kao sneg,

and everywhere that Mary went, the lamb was sure to go.

I svuda gde je Meri išla, jagnje je moralo za njom“

MR: And now, 137 years later,

MR: I sada, 137 godina kasnije,

we're able to get sound in pretty much similar quality

u mogućnosti smo da dobijemo zvuk prilično sličnog kvaliteta

but by just watching objects vibrate to sound with cameras,

i to samo kada posmatramo kamerom kako predmeti vibriraju od zvuka,

and we can even do that when the camera

a to možemo postići čak i kada kamera stoji

is 15 feet away from the object, behind soundproof glass.

na 4,5 metra od objekta iza zvučno izolovanog stakla.

So this is the sound that we were able to recover in that case.

Dakle, ovo je zvuk koji smo uspeli da izdvojimo u ovom slučaju.

Voice: Mary had a little lamb whose fleece was white as snow,

Glas: „Meri je imala malo jagnje runa belog kao sneg,

and everywhere that Mary went, the lamb was sure to go.

I svuda gde je Meri išla, jagnje je moralo za njom“

MR: And of course, surveillance is the first application that comes to mind.

MR: Naravno, nadzor će vam verovatno prvo pasti na pamet.

(Laughter)

(Smeh)

But it might actually be useful for other things as well.

Ali to može biti korisno i za neke druge stvari.

Maybe in the future, we'll be able to use it, for example,

Možda ćemo u budućnosti moći to da iskoristimo, na primer,

to recover sound across space,

za izdvajanje zvukova iz svemira,

because sound can't travel in space, but light can.

jer zvuk ne može da putuje svemirom, ali svetlost može.

We've only just begun exploring

Tek smo počeli da istražujemo

other possible uses for this new technology.

druge potencijalne upotrebe ove tehnologije.

It lets us see physical processes that we know are there

Omogućava da vidimo fizičke procese za koje znamo da postoje,

but that we've never been able to see with our own eyes until now.

ali koje do sada nismo mogli da vidimo sopstvenim očima.

This is our team.

Ovo je naš tim.

Everything I showed you today is a result of a collaboration

Sve što sam vam pokazao danas je rezultat saradnje

with this great group of people you see here,

fantastičnih ljudi koje vidite ovde,

and I encourage you and welcome you to check out our website,

i ohrabrujem vas i pozivam vas da posetite naš sajt,

try it out yourself,

da ga sami isprobate,

and join us in exploring this world of tiny motions.

i priključite nam se u istraživanju ovog sveta malih pokreta.

Thank you.

Hvala vam.

(Applause)

(Aplauz)