See invisible motion, hear silent sounds. Cool? Creepy? We can't decide | Michael Rubinstein

Translator: Petra Aquamarine Reviewer: Linda Magáthová

So over the past few centuries, microscopes have revolutionized our world.

Za posledných pár storočí mikroskopy zmenili náš svet.

They revealed to us a tiny world of objects, life and structures

Odhalili nám maličký svet živých i neživých objektov,

štruktúr, ktoré sa nedajú vidieť voľným okom.

that are too small for us to see with our naked eyes.

They are a tremendous contribution to science and technology.

Obrovsky prospeli vede a technike.

Dnes by som vám rád predstavil nový typ mikroskopu,

Today I'd like to introduce you to a new type of microscope,

a microscope for changes.

mikroskop na zmeny.

It doesn't use optics like a regular microscope

Nevyužíva optiku, ako bežný mikroskop,

to make small objects bigger,

na zväčšovanie malých objektov.

but instead it uses a video camera and image processing

Miesto toho pomocou kamery a spracovania obrazu

to reveal to us the tiniest motions and color changes in objects and people,

odhaľuje jemné pohyby a farebné zmeny vecí i ľudí,

changes that are impossible for us to see with our naked eyes.

zmeny, ktoré voľným okom nezbadáme.

And it lets us look at our world in a completely new way.

Dovoľuje nám vidieť náš svet úplne novým spôsobom.

So what do I mean by color changes?

Čo myslím pod farebnými zmenami?

Our skin, for example, changes its color very slightly

Napríklad pleť jemnúčko mení farbu,

when the blood flows under it.

keď pod ňou prúdi krv.

That change is incredibly subtle,

Tá zmena je neuveriteľne malá,

which is why, when you look at other people,

preto, keď sa na niekoho pozriete,

when you look at the person sitting next to you,

na človeka, čo sedí vedľa vás,

you don't see their skin or their face changing color.

nevidíte, že by jeho pleť menila farbu.

When we look at this video of Steve here, it appears to us like a static picture,

Pozrime sa na Stevea na tomto videu. Vyzerá to ako statická fotka.

but once we look at this video through our new, special microscope,

Ale keď sa na video pozrieme naším novým špeciálnym mikroskopom,

suddenly we see a completely different image.

zrazu uvidíme úplne iný obrázok.

What you see here are small changes in the color of Steve's skin,

To čo tu vidíte, sú malé farebné zmeny Steveovej pokožky

magnified 100 times so that they become visible.

zvýraznené 100-krát, takže sa dajú vidieť.

We can actually see a human pulse.

Vidíme vlastne ľudský tep.

We can see how fast Steve's heart is beating,

Vidíme, ako rýchlo bije Steveovi srdce,

but we can also see the actual way that the blood flows in his face.

a tiež cesty, ktorými prúdi krv v jeho tvári.

And we can do that not just to visualize the pulse,

Nielen, že vieme tep zviditeľniť,

but also to actually recover our heart rates,

môžeme aj určiť jeho frekvenciu

and measure our heart rates.

a merať tak tep.

And we can do it with regular cameras and without touching the patients.

Stačí na to obyčajná kamera a pacienta sa netreba ani dotknúť.

So here you see the pulse and heart rate we extracted from a neonatal baby

Tu vidíte tep a srdcovú frekvenciu novorodenca,

from a video we took with a regular DSLR camera,

ktoré sme získali z videa, natočeného obyčajnou DSLR kamerou.

and the heart rate measurement we get

Naše meranie je rovnako presné

is as accurate as the one you'd get with a standard monitor in a hospital.

ako štandardný monitorovací prístroj v nemocnici.

And it doesn't even have to be a video we recorded.

A to ani nemusíme video natočiť sami.

We can do it essentially with other videos as well.

Môžme v podstate použiť aj iné videá.

So I just took a short clip from "Batman Begins" here

Tu som vybral krátky záber z filmu Batman začína,

just to show Christian Bale's pulse.

aby som vám ukázal tep Christiana Balea.

(Laughter)

(smiech)

And you know, presumably he's wearing makeup,

Zrejme má make-up

the lighting here is kind of challenging,

a osvetlenie je trochu problematické,

but still, just from the video, we're able to extract his pulse

ale aj tak vieme len na základe videa určiť jeho tep

and show it quite well.

a celkom pekne ho ukázať.

So how do we do all that?

Takže ako to celé robíme?

We basically analyze the changes in the light that are recorded

V podstate analyzujeme svetelné zmeny

at every pixel in the video over time,

každého pixelu v priebehu času

and then we crank up those changes.

a potom ich zvýrazníme.

We make them bigger so that we can see them.

Zmeny zväčšíme, aby sme ich videli.

The tricky part is that those signals,

Háčik je v tom, že tieto signály,

those changes that we're after, are extremely subtle,

zmeny, ktoré nás zaujímajú, sú extrémne slabé.

so we have to be very careful when you try to separate them

Musíte byť veľmi opatrní pri ich rozlíšení

from noise that always exists in videos.

od ruchu, ktorý je v každom videu.

So we use some clever image processing techniques

Pomocou rôznych šikovných techník spracovania obrazu

to get a very accurate measurement of the color at each pixel in the video,

vieme veľmi presne určiť farbu v každom pixeli,

and then the way the color changes over time,

a tiež farebné zmeny v čase

and then we amplify those changes.

a nakoniec tieto zmeny zvýrazniť.

We make them bigger to create those types of enhanced videos, or magnified videos,

Vytvoríme tak takéto vylepšené či zosilnené videá,

that actually show us those changes.

na ktorých sú zmeny viditeľné.

[Pohybový mikroskop]

But it turns out we can do that not just to show tiny changes in color,

Ukázalo sa, že takto dokážeme zobraziť nielen malé zmeny farieb,

but also tiny motions,

ale aj jemné pohyby,

and that's because the light that gets recorded in our cameras

pretože svetlo, ktoré kamera zachytí,

will change not only if the color of the object changes,

sa nemení len s farbou objektu,

but also if the object moves.

ale tiež, keď sa objekt hýbe.

So this is my daughter when she was about two months old.

Toto je moja dcéra, keď mala tak dva mesiace.

It's a video I recorded about three years ago.

Video som natočil asi pred troma rokmi.

And as new parents, we all want to make sure our babies are healthy,

Ako čerství rodičia si všetci chceme byť istí, že naše bábätko

that they're breathing, that they're alive, of course.

je zdravé, že dýcha, že žije, samozrejme.

So I too got one of those baby monitors

Takže aj ja som si kúpil baby monitor,

so that I could see my daughter when she was asleep.

aby som mohol vidieť malú, keď spí.

And this is pretty much what you'll see with a standard baby monitor.

Takto nejako to vyzerá na bežnom baby monitore.

You can see the baby's sleeping, but there's not too much information there.

Vidíme, že bábo spí, ale príliš veľa informácií nemáme.

There's not too much we can see.

Nevidíme toho zas tak veľa.

Wouldn't it be better, or more informative, or more useful,

Nebolo by lepšie, informatívnejšie, užitočnejšie,

if instead we could look at the view like this.

keby sme sa na to mohli pozrieť takto?

So here I took the motions and I magnified them 30 times,

30-krát som zvýraznil zachytené pohyby

and then I could clearly see that my daughter was indeed alive and breathing.

a hneď som videl, že malá fakt žije a dýcha.

(Laughter)

(smiech)

Here is a side-by-side comparison.

Pre porovnanie.

So again, in the source video, in the original video,

Na pôvodnom videu

there's not too much we can see,

veľa nevidieť,

but once we magnify the motions, the breathing becomes much more visible.

ale keď zvýrazníme pohyby, dýchanie je oveľa lepšie vidno.

And it turns out, there's a lot of phenomena

Ukázalo sa, že je veľa javov,

we can reveal and magnify with our new motion microscope.

ktoré vie náš nový pohybový mikroskop odhaliť.

We can see how our veins and arteries are pulsing in our bodies.

Vidíme, ako nám v tele pulzujú žily a tepny.

We can see that our eyes are constantly moving

Vidíme, že oči máme

in this wobbly motion.

v neustálom pohybe.

And that's actually my eye,

Toto je moje oko,

and again this video was taken right after my daughter was born,

z videa natočeného po narodení dcérky.

so you can see I wasn't getting too much sleep. (Laughter)

Vidno, že som toho veľa nenaspal.

Even when a person is sitting still,

Aj keď človek len kľudne sedí,

there's a lot of information we can extract

vieme získať kopu informácií

about their breathing patterns, small facial expressions.

o jeho dýchacích vzorcoch, jemných výrazoch tváre.

Maybe we could use those motions

Možno by nám tieto pohyby

to tell us something about our thoughts or our emotions.

mohli niečo prezradiť o našich myšlienkach či pocitoch.

We can also magnify small mechanical movements,

Zvýrazniť vieme aj malé mechanické pohyby,

like vibrations in engines,

ako sú vibracie motoru,

that can help engineers detect and diagnose machinery problems,

a pomôcť tak inžinierom detekovať problémy strojného zariadenia

or see how our buildings and structures sway in the wind and react to forces.

alebo vidieť, ako sa konštrukcie kývu vo vetre a reagujú na sily.

Those are all things that our society knows how to measure in various ways,

Všetky tieto veci vieme merať aj inak,

but measuring those motions is one thing,

ale merať pohyby je jedna vec

and actually seeing those motions as they happen

a vidieť ich prebiehať v reálnom čase

is a whole different thing.

je niečo úplne iné.

And ever since we discovered this new technology,

Hneď ako sme túto techniku vyvinuli,

we made our code available online so that others could use and experiment with it.

zverejnili sme softvér na internete, aby s ňou mohol každý experimentovať.

It's very simple to use.

Uživateľsky veľmi jednoduché.

It can work on your own videos.

Funguje s vašimi videami.

Our collaborators at Quanta Research even created this nice website

Naši spolupracovníci v Quanta Research vytvorili dokonca stránku,

where you can upload your videos and process them online,

kde môžte nahrať vaše video a spracovať ho online,

so even if you don't have any experience in computer science or programming,

takže aj keď nemáte skúsenosti s IT a programovaním,

you can still very easily experiment with this new microscope.

ľahko môžete experimentovať s týmto novým mikroskopom.

And I'd like to show you just a couple of examples

Rád by som vám ukázal pár príkladov

of what others have done with it.

od používateľov.

So this video was made by a YouTube user called Tamez85.

Toto video dal na youtube istý Tamez85.

I don't know who that user is,

Neviem, kto to je,

but he, or she, used our code

ale použil alebo použila náš soft

to magnify small belly movements during pregnancy.

na zvýraznenie jemných pohybov brucha v tehotenstve.

It's kind of creepy.

Trošku desivé.

(Laughter)

(smiech)

People have used it to magnify pulsing veins in their hands.

Iní zosilňujú pulzujúce žily na ruke.

And you know it's not real science unless you use guinea pigs,

A nič nie je skutočná veda, kým nepoužijete morča.

and apparently this guinea pig is called Tiffany,

Podľa všetkého sa toto morča volá Tiffany

and this YouTube user claims it is the first rodent on Earth

a daný užívateľ tvrdí, že je to prvý hlodavec na Zemi,

that was motion-magnified.

ktorý bol pohybovo zosilnený.

You can also do some art with it.

Dá sa použiť aj v umení.

So this video was sent to me by a design student at Yale.

Toto mi poslala jedna študentka dizajnu z Yale.

She wanted to see if there's any difference

Zaujímali ju rozdiely

in the way her classmates move.

v pohyboch jej spolužiakov.

She made them all stand still, and then magnified their motions.

Natočila, ako pokojne stoja a potom zvýraznila pohyby.

It's like seeing still pictures come to life.

Ako keď fotky ožijú.

And the nice thing with all those examples

Na týchto ukážkach je pekné to,

is that we had nothing to do with them.

že sme s nimi nemali nič spoločné.

We just provided this new tool, a new way to look at the world,

Len sme poskytli nový nástroj, nový spôsob, ako sa dívať na svet

and then people find other interesting, new and creative ways of using it.

a ľudia sami našli zaujímavé, nové a tvorivé využitie.

But we didn't stop there.

Tým sme ale neskončili.

This tool not only allows us to look at the world in a new way,

Vďaka tomuto nástroju nielen že vidíme svet novými očami,

it also redefines what we can do

ale zároveň redefinujeme

and pushes the limits of what we can do with our cameras.

a posúvame hranice toho, čo sa s foťákom dá robiť.

So as scientists, we started wondering,

Ako vedci sme začali pátrať

what other types of physical phenomena produce tiny motions

po ďalších javoch, vyvolávajúcich malé pohyby,

that we could now use our cameras to measure?

ktoré teraz môžeme merať kamerou.

And one such phenomenon that we focused on recently is sound.

A jeden z takýchto javov, na ktorý sme sa zamerali, je zvuk.

Sound, as we all know, is basically changes

Zvuk, ako všetci vieme, to sú zmeny tlaku,

in air pressure that travel through the air.

ktoré sa šíria vzduchom.

Those pressure waves hit objects and they create small vibrations in them,

Keď táto tlaková vlna narazí na objekt, jemne ho rozvibruje.

which is how we hear and how we record sound.

Vďaka tomu zvuk počujeme i nahrávame.

But it turns out that sound also produces visual motions.

Ukázalo sa, že zvuk tiež vyvoláva vizuálne pohyby.

Those are motions that are not visible to us

Pohyby, ktoré oko neodhalí,

but are visible to a camera with the right processing.

ale video s príslušným spracovaním už áno.

So here are two examples.

Mám tu dva príklady.

This is me demonstrating my great singing skills.

Tu predvádzam svoj úžasný spevácky talent.

(Singing)

(spev)

(Laughter)

(smiech)

And I took a high-speed video of my throat while I was humming.

Nahral som svoje brumendo na vysokorýchlostné video.

Again, if you stare at that video,

Ak sa na video pozriete,

there's not too much you'll be able to see,

ani teraz neuvidíte nič moc,

but once we magnify the motions 100 times, we can see all the motions and ripples

ale keď pohyby zvýrazníme 100-krát,

vidíme, ako sa hrdlo pri vydávaní zvuku hýbe a vlní.

in the neck that are involved in producing the sound.

That signal is there in that video.

Ten signál je tam.

We also know that singers can break a wine glass

Vieme tiež, že speváci dokážu rozbiť pohár na víno,

if they hit the correct note.

ak trafia správny tón.

So here, we're going to play a note

Takže pustíme tón,

that's in the resonance frequency of that glass

ktorý je v rezonancii s pohárom

through a loudspeaker that's next to it.

pomocou reproduktoru vedľa neho.

Once we play that note and magnify the motions 250 times,

Keď pustíme tón a pohyby zvýrazníme 250-krát,

we can very clearly see how the glass vibrates

veľmi jasne vidíme, ako pohár vibruje

and resonates in response to the sound.

a rezonuje v reakcii na ten zvuk.

It's not something you're used to seeing every day.

Toto neuvidíte každý deň.

But this made us think. It gave us this crazy idea.

Nedalo nám to pokoj, prišiel ten šialený nápad.

Can we actually invert this process and recover sound from video

Mohli by sme tento proces obrátiť a dostať zvuk z videa

by analyzing the tiny vibrations that sound waves create in objects,

analýzou vibrácií, vytvorených v objektoch zvukovými vlnami

and essentially convert those back into the sounds that produced them.

a konvertovať ich späť na pôvodný zvuk?

In this way, we can turn everyday objects into microphones.

Takto spravíme z bežných vecí mikrofóny.

So that's exactly what we did.

Presne to sme urobili.

So here's an empty bag of chips that was lying on a table,

Tu máme prázdny obal od zemiačkov ležiaci na stole

and we're going to turn that bag of chips into a microphone

a spravíme z neho mikrofón

by filming it with a video camera

tým, že ho nafilmujeme

and analyzing the tiny motions that sound waves create in it.

a zanalyzujeme jemné pohyby, ktoré v ňom zvukové vlny vytvorili.

So here's the sound that we played in the room.

Toto hralo v tej miestnosti.

(Music: "Mary Had a Little Lamb")

(pesnička Mary mala ovečku)

And this is a high-speed video we recorded of that bag of chips.

a toto je vysokorýchlostné video nášho vrecka.

Again it's playing.

Video je pustené,

There's no chance you'll be able to see anything going on in that video

ale ako vždy, nič nevidíme

just by looking at it,

prostým pohľadom.

but here's the sound we were able to recover just by analyzing

Ale tu máme zvuk, ktorý sme získali len analýzou

the tiny motions in that video.

jemného pohybu na videu.

(Music: "Mary Had a Little Lamb")

(pesnička Mary mala ovečku)

I call it -- Thank you.

Volám to… Ďakujem.

(Applause)

(potlesk)

I call it the visual microphone.

Volám to vizuálny mikrofón.

We actually extract audio signals from video signals.

Extrahujeme audio signál z video signálu.

And just to give you a sense of the scale of the motions here,

Aby ste mali predstavu o mierke,

a pretty loud sound will cause that bag of chips to move less than a micrometer.

fakt silný zvuk pohne vreckom o menej než mikrometer.

That's one thousandth of a millimeter.

To je tisícina milimetra.

That's how tiny the motions are that we are now able to pull out

Tak maličké sú pohyby, ktoré teraz vieme vytiahnuť

just by observing how light bounces off objects

tým, že svetlo, ktoré sa odrazí od predmetu

and gets recorded by our cameras.

nahráme na kameru.

We can recover sounds from other objects, like plants.

Pôvodný zvuk vieme dostať aj z iných predmetov, napríklad z rastlín.

(Music: "Mary Had a Little Lamb")

(pesnička Mary mala ovečku)

And we can recover speech as well.

Funguje to aj s rečou.

So here's a person speaking in a room.

Tu niekto rozpráva v miestnosti.

Voice: Mary had a little lamb whose fleece was white as snow,

Hlas: Mary mala ovečku s bielučkou vlnou

and everywhere that Mary went, that lamb was sure to go.

a všade kam Mary šla, šla ovečka s ňou.

Michael Rubinstein: And here's that speech again recovered

A toto sme z toho dostali

just from this video of that same bag of chips.

pomocou nášho vrecka od zemiačkov.

Voice: Mary had a little lamb whose fleece was white as snow,

Hlas: Mary mala ovečku s bielučkou vlnou

and everywhere that Mary went, that lamb was sure to go.

a všade kam Mary šla, šla ovečka s ňou.

MR: We used "Mary Had a Little Lamb"

Použili sme Mary mala ovečku,

because those are said to be the first words

lebo to sú vraj prvé slová,

that Thomas Edison spoke into his phonograph in 1877.

ktoré Edison nahral svojím fonografom v roku 1877.

It was one of the first sound recording devices in history.

To bol jeden z prvých nahrávacích prístrojov v dejinách.

It basically directed the sounds onto a diaphragm

Zvuk dopadal na membránu,

that vibrated a needle that essentially engraved the sound on tinfoil

tá rozvibrovala ihlu, ktorá zvuk vyryla do staniolu

that was wrapped around the cylinder.

obtočeného okolo valčeku.

Here's a demonstration of recording and replaying sound with Edison's phonograph.

Tu je ukážka nahrávania s Edisonovým fonografom.

(Video) Voice: Testing, testing, one two three.

Hlas: Skúška, skúška raz, dva, tri.

Mary had a little lamb whose fleece was white as snow,

Mary mala ovečku s bielučkou vlnou

and everywhere that Mary went, the lamb was sure to go.

a všade kam Mary šla, šla ovečka s ňou.

Testing, testing, one two three.

Skúška, skúška, raz, dva, tri.

Mary had a little lamb whose fleece was white as snow,

Mary mala ovečku s bielučkou vlnou

and everywhere that Mary went, the lamb was sure to go.

a všade kam Mary šla, šla ovečka s ňou.

MR: And now, 137 years later,

Dnes, o 137 rokov neskôr,

we're able to get sound in pretty much similar quality

vieme dostať zvuk porovnateľnej kvality

but by just watching objects vibrate to sound with cameras,

len na základe videa vibrujúceho predmetu,

and we can even do that when the camera

a to aj keď je kamera

is 15 feet away from the object, behind soundproof glass.

5 metrov od predmetu za zvukotesným sklom.

So this is the sound that we were able to recover in that case.

Za takých podmienok sme získali toto:

Voice: Mary had a little lamb whose fleece was white as snow,

Hlas: Mary mala ovečku s bielučkou vlnou

and everywhere that Mary went, the lamb was sure to go.

a všade kam Mary šla, šla ovečka s ňou.

MR: And of course, surveillance is the first application that comes to mind.

Samozrejme, odpočúvanie je prvá vec, čo človeka napadne.

(Laughter)

(smiech)

But it might actually be useful for other things as well.

Ale dá sa to využiť aj inak.

Maybe in the future, we'll be able to use it, for example,

Možno sa nám v budúcnosti podarí

to recover sound across space,

nahrať zvuky z vesmíru,

because sound can't travel in space, but light can.

pretože zvuk sa v kozme nešíri, ale svetlo áno.

We've only just begun exploring

Len sme začali objavovať

other possible uses for this new technology.

možnosti využitia tejto novej techniky.

It lets us see physical processes that we know are there

Môžme vidieť fyzikálne javy, o ktorých sme síce vedeli,

but that we've never been able to see with our own eyes until now.

ale doteraz sme ich nikdy nevideli na vlastné oči.

This is our team.

Toto je náš tím.

Everything I showed you today is a result of a collaboration

Všetko, čo som vám dnes ukázal, je výsledok spolupráce

with this great group of people you see here,

s touto skvelou partou

and I encourage you and welcome you to check out our website,

a odporúčam vám navštíviť našu stránku,

try it out yourself,

vyskúšajte si to sami,

and join us in exploring this world of tiny motions.

a pridajte sa k nám pri objavovaní sveta malých pohybov.

Thank you.

Ďakujem vám.

(Applause)

(potlesk)