A new way to monitor vital signs (that can see through walls) | Dina Katabi

Translator: Susana Arrizado Gago Reviewer: Serv. de Norm. Lingüística U. de Santiago de Compostela

When I was a kid,

Cando era nena

I was, like many of you in this room, very much fascinated by Star Wars,

coma moitos de vós nesta sala,

estaba moi fascinada por Star Wars.

and what fascinated me the most is this notion of the Force,

O que máis me fascinaba era a noción da Forza.

this energy that connects all people and all objects

Esa enerxía que conecta todas as persoas e todas as cousas

and allows you to feel people that you can't even see.

e permíteche sentir xente que nin sequera podes ver.

And I remember many nights, I would be sitting at home,

Recordo moitas noites, sentada na casa,

just, like, concentrating and focusing, trying to feel the Force,

concentrándome para sentir a Forza

and I didn't feel anything, don't worry.

e non sentía nada de nada, non temades.

(Laughter)

(Risos)

And later in life, I became a scientist.

Máis tarde, convertinme nunha científica.

I joined the MIT faculty and started working on wireless signals.

Uninme ao MIT e comecei a traballar nos sinais sen fíos.

These are things like Wi-Fi or cellular systems,

Cousas coma as redes sen fíos ou os sistemas móbiles.

and I did a lot of work in that domain.

Traballei arreo nese eido.

But then, again, this Force thing kept nagging me,

Mais o tema da Forza seguía a amolarme

and at some point, I was just like,

e, nalgún momento, pensei:

"Wait a minute, these wireless signals -- they are like the Force."

"Un momento, estes sinais sen fíos, son coma a Forza."

So if you think about it,

Se o pensades

wireless signals, they travel through space,

os sinais sen fíos viaxan a través do espazo,

they go through obstacles and walls and occlusions,

atravesan obstáculos e muros e atrancos.

and some of them,

Algúns deles

they reflect off our bodies, because our bodies are full of water,

reflíctense no noso corpo que está cheo de auga

and some of these minute reflections,

e algunhas destas diminutas reflexións

they come back.

retornan.

And if, just if, I had a device that can just sense these minute reflections,

E só con ter un aparello que detectase esas ínfimas reflexións,

then I would be able to feel people that I cannot see.

sería capaz de sentir persoas que non podo ver.

So I started working with my students on building such a device,

Comecei a traballar cos meus estudantes en construír ese aparello

and I want to show you some of our early results.

e vouvos amosar algúns dos nosos primeiros resultados.

So here, you see my student standing,

Aquí vedes o estudante de pé

and here is our device.

e velaquí o dispositivo.

And we are going to put the device in the other office, behind the wall,

Imos poñer o dispositivo na outra oficina, detrás do muro,

and we are going to monitor him as he moves.

e imos controlalo mentres se move.

This red dot is tracking him using wireless signals.

Este punto vermello está a seguilo usando sinais sen fíos.

And as you can see, the red dot is tracking his movements very accurately,

Como podedes ver, o punto vermello segue os seus movementos con moita precisión,

purely based on how his body interacts with the surrounding wireless signals.

baseándose soamente en como o corpo interactúa cos sinais sen fíos do arredor.

Pretty accurate, isn't it?

Bastante preciso, non é?

He has no wearables, nothing.

Non leva ningún conector, nada.

(Applause)

(Aplauso)

Now you might be wondering,

Agora debedes estar pensando

how is it possible that we can sense people

como é posíbel que poidamos sentir a xente

and track them, without any wearables, through walls,

e rastrexala sen tecnoloxía poñíbel, a través dos muros.

and the easiest analogy to think about is radar.

A analoxía máis simple que me vén ao maxín é o radar.

I'm sure many of you have seen this picture.

Seguro que moitos de vós vistes esta foto.

You transmit a wireless signal to the sky,

Transmítese un sinal sen fíos ao ceo,

it reflects off some airplane, comes back to you,

reflíctese nun avión, volve

and you start detecting these airplanes.

e comezades a detectar eses avións.

But if it were just radar,

Pero se fose tan só un radar,

then we would have this 50 years ago.

existiría dende hai 50 anos.

So it's not just radar.

Non é simplemente un radar.

There are two key differences.

Hai dúas diferenzas significativas.

So the first difference, of course --

A primeira, por suposto,

you can't, like radar, just blast wireless power at somebody.

é que non se pode, como un radar, disparar sen máis unha carga eléctrica.

You're going to fry them like if they were in a microwave.

Fritiríamolo coma se estivese nun microondas.

Don't do that.

Non fagades iso.

So it means that you have to be able to deal with very weak signals,

Isto significa que tedes que ser quen de apañarvos con sinais moi febles

and that means that your device has to be very sensitive.

e tamén, que o voso aparello debe ser moi sensíbel.

The second difference is that, unlike the sky, where it's empty --

A segunda diferenza é que o ceo está baleiro

if you are lucky, there is one airplane that you can catch there.

--se tedes sorte, haberá un avión que podes cachar aí arriba.

Like, look at the room

Pero mirade esta sala

and look how many objects and people there are.

e mirade cantos obxectos e persoas hai aquí.

So in indoor environments, the signal not only reflects off the person,

En espazos interiores, o sinal non só se reflicte na persoa,

if reflects off the person, off the floor, the ceiling,

reflíctese na persoa e tamén no chan, no teito,

off other people around,

noutra xente darredor.

and you get very complex reflections

Obtéñense unhas reflexións supercomplexas,

where the same signal reflects off me and then off you,

en que o mesmo sinal se reflicte en ti e en min,

and then off the ceiling, then off the floor.

e volve outra vez ao teito e o chan.

And you have to make sense of that mess.

E tes que darlle un senso a toda esa enleada.

But we were lucky.

Pero tivemos sorte.

We were coming at the right time.

Chegamos no momento xusto.

So two things helped us.

Axudáronnos dúas cousas.

The first thing is radiotechnologies have evolved a lot,

A primeira é que as radiotecnoloxías evolucionaron moito

and over the last decade,

e na última década

radio technology became much more powerful,

a radiotecnoloxía volveuse máis potente

so we were able to build very sensitive radios

polo que puidemos construír radios máis sensíbeis

that can sense weak and minute RF signals.

que poden sentir sinais de radiofrecuencia febles e ínfimos.

The second thing: machine learning.

A segunda foi a aprendizaxe automática.

So you keep hearing about machine learning

Ouvimos falar de seguido da aprendizaxe automática

and there was a revolution of machine learning recently,

e houbo unha revolución nese campo recentemente,

in deep learning,

na aprendizaxe profunda,

and that allowed us to build machine-learning models

e iso permitiunos construír modelos de máquinas intelixentes

that can understand wireless signals and interpret them

que poden comprender os sinais wifi e interpretalos

so they would know what happened in the environment.

de xeito que saiban o que sucede ao redor.

So if you think of it, the radio is like the ear of our device

Se o pensades, a radio é coma o ouvido do noso aparello

and the machine learning is like the brain,

e a aprendizaxe é coma o cerebro.

and together, they have a very powerful device.

Xuntos forman un potente dispositivo.

So what else can we sense about people using wireless signals?

Que máis podemos sentir das persoas mediante sinais sen fíos?

Sleep.

O sono.

Sleep, actually, is something very dear to my heart,

O sono, en realidade, é algo moi prezado para min

because my sleep is a disaster.

porque o meu é unha desfeita.

(Laughter)

(Risos)

So one thing is when you start working on some physiological signal

Cando comezas a traballar nun sinal fisiolóxico

and you discover that yours sucks.

e descobres que o teu dá noxo.

(Laughter)

(Risos)

So you can see why we can capture sleep,

Podedes ver por que podemos capturar o sono

because the person walks and the device sees him as he walks to bed,

porque a persoa camiña e ségueo mentres vai para a cama,

when he stops tossing around in bed,

cando para de dar voltas na cama,

when he steps out of bed,

cando se ergue.

and that measure of sleep is what people call actigraphy.

Esa medición do sono é o que chamamos actigrafía.

It's based on motion.

Está baseada no movemento.

But it turned out that we can actually get sleep

Pero resultou que podemos chegar a ver o sono

at a much more important level.

nun nivel moito máis importante.

We can understand the change in the brain waves

Podemos comprender os cambios das ondas cerebrais

that occur during sleep.

que ocorren durante o sono.

So, many of you probably know that as we go to sleep,

Moitos de vós sabedes sen dúbida, que cando imos durmir

our brainwaves change and we enter different stages:

as ondas cerebrais cambian e entramos en diferentes fases:

awake, light sleep, deep sleep and REM, or rapid eye movement.

vixilia, sono lixeiro, profundo e MOR ou movementos oculares rápidos.

These stages are of course related to sleep disorders,

Estas fases relaciónanse con desordes do sono

but they are also related to various diseases.

pero tamén con outras enfermidades.

So for example, disturbances in REM are associated with depression.

Por exemplo, as desordes no MOR están relacionadas coa depresión.

Disturbances in deep sleep are associated with Alzheimer's.

Os desarranxos no sono profundo están asociados co alzhéimer.

So if you want to get sleep staging,

Se queremos representar o sono

hoxe en día, enviaríamos a persoa ao hospital,

today, you will send the person to the hospital,

they put all of these electrodes on their head,

poñeríanlle todos eses eléctrodos na testa

e pediríanlle que durmise deste xeito.

and they ask them to sleep like that.

(Laughter)

(Risos)

It's not really a happy experience.

Non é unha experiencia feliz.

So what if I tell you that I can do the same thing

E se vos dixera que podemos facer exactamente o mesmo

but without any of these electrodes on the person's body?

pero sen todos eses eléctrodos no corpo?

So here is our device,

Aquí temos o noso dispositivo,

transmitting very low power wireless signal,

mediante a transmisión de sinais sen fíos moi baixos

analyzes the reflections using AI

analiza as reflexións utilizando IA

and spits out the sleep stages throughout the night.

e vai indicando as fases do sono ao longo da noite.

So we know, for example, when this person is dreaming.

Sabemos, por exemplo, cando unha persoa está soñando.

Not just that ...

Non só iso.

we can even get your breathing while you are sitting like that,

Ata podemos gravar a vosa respiración mentres estades aí sentados

and without touching you.

e sen tocarvos.

So he is sitting and reading

Aquí está sentado lendo

and this is his inhales, exhales.

e isto é a inhalación e expiración.

We asked him to hold his breath,

Pedímoslle que contivese o alento

and you see the signal staying at a steady level

e podedes ver que o sinal mantense nun nivel estábel

because he exhaled.

porque só expirou.

He did not inhale.

Non inhalou.

And I want to zoom in on the signal.

Agora quero facer zoom no sinal.

And this is the same signal as before.

É o mesmo sinal que antes.

These are the inhales,

Estas son as inspiracións

these are the exhales.

e estas as expiracións.

And you see these blips on the signal?

E vedes esas pulsacións no sinal?

These are not noise.

Non son ruído.

They are his heartbeats.

Son os latexos do corazón.

And you can see them beat by beat.

Podedes ver latexo a latexo.

So I want to stop here for a moment and show you a live demo.

Quero parar aquí un momento e facer unha demostración en directo

Zach is going to help me with the demo,

Zach vai axudarnos coa demostración.

and we're going to use the device to monitor Zach's breathing.

Imos usar o aparello para controlar a súa respiración.

So this white box that you see here is the device,

Esta caixa branca que vedes aquí é o dispositivo.

and Zach is turning it on ...

Zach está a acendelo.

and let's see whether he breathes well.

Imos ver se respira ben.

So we're going to do exactly what we did in the video with the other guy,

Imos facer exactamente o mesmo ca no vídeo co outro tipo

so the wireless signal is going through,

de modo que o sinal o atravese,

it's touching Zach's body,

toque o corpo de Zach

and it's reflecting back to the device,

e se reflicta de volta no aparello.

and we want to monitor his breathing, his inhale-exhale motion.

Queremos controlar a súa respiración, o movemento inspira-expira.

So we see the inhales, exhales --

Vemos como inspira, expira.

so see, these ups and downs are Zach breathing.

Vedes, ese sube e baixa é Zach respirando.

Inhaling, exhaling.

Inspira, expira.

(Applause)

(Aplauso)

So, he can breathe.

Ou sexa, sabe respirar.

(Laughter)

(Risos)

Zach, can you hold your breath, please?

Zach, poderías aguantar a respiración?

OK, so now he's holding his breath,

Ok, agora está aguantando a respiración,

so you see the signal stays at a steady level,

podemos ver que o sinal segue estábel

and these are his heartbeats.

e estes son os latexos.

Beat, beat, beat, beat, beat.

Pum, pum, pum, pum, pum.

(Applause)

(Aplausos)

OK, Zach, you can breathe again.

OK, Zach, xa podes volver respirar.

(Laughter)

(Risos)

We don't want accidents here.

Non queremos accidentes aquí.

(Laughter)

(Risos)

OK, thank you.

Ok, grazas.

(Applause)

(Aplausos)

So as you can see, we have this device

Como podedes ver, temos este instrumento

that can monitor so many physiological signals for you,

que pode controlarche tantos signos fisiolóxicos

and what is really interesting about this device

e o realmente interesante sobre el

is that it does all this without any wearables,

é que fai todo iso sen sensores,

without asking the person to change his behavior

sen pedirlle á persoa que cambie os seus hábitos

or to wear anything or charge anything special.

ou que leve ou cargue nada especial.

And that got doctors very excited,

Isto entusiasma aos médicos.

because doctors,

Porque os doutores

they always want to know more information about their patients,

sempre queren ter máis información sobre os seus pacientes,

particularly at home,

particularmente na casa.

and this is particularly true in chronic diseases,

Isto é especialmente certo nas enfermidades crónicas

like pulmonary diseases, like COPD,

coma as pneumolóxicas tipo DPOC

or heart failure or Alzheimer's and even depression.

ou problemas cardíacos ou alzhéimer e incluso, na depresión.

All of these chronic diseases are very important.

Todas esas enfermidades son moi importantes.

In fact -- perhaps you know --

De feito, quizais o saiban,

two-thirds of the cost of health care in the US

dous terzos do custo sanitario nos EUA

is due to chronic diseases.

débese a enfermidades crónicas.

But what is really interesting about chronic diseases

Pero o realmente interesante sobre estas enfermidades

is that when the person, for example,

é cando a persoa, por exemplo,

has a problem that leads to the hospital and the emergency room,

ten un problema que a leva ás urxencias do hospital

this problem doesn't happen overnight.

ese problema non pasa dun día para outro.

Actually, things happen gradually.

Ao contrario, sucede gradualmente.

So if we can monitor chronic disease patients in their home,

Se podemos vixiar na súa casa aos pacientes crónicos

we can detect changes in their breathing, heartbeat, mobility, sleep --

poderemos notar cambios na respiración, no pulso, na mobilidade ou o sono.

and we can detect emergencies before they occur

Poderemos detectar urxencias antes de que ocorran

and have the doctor intervene earlier

e facer que o médico interveña antes

so that we can avoid hospitalization.

de modo que evitemos a hospitalización.

And indeed, today we are working with multiple doctors

Por suposto, hoxe estamos traballando con múltiples doutores

in different disease categories.

en diferentes tipos de enfermidades.

So I'm really excited

Estou realmente contenta

because we have deployed the device with many patients.

porque desenvolvemos este aparello con moitos pacientes.

We have deployed the device with patients that have COPD,

Fixémolo con pacientes que teñen DPOC,

which is a pulmonary disease,

unha enfermidade pulmonar,

patients that have Alzheimer's,

con pacientes de alzhéimer,

patients that have depression and anxiety

pacientes que teñen depresión e ansiedade

and people that have Parkinson's.

e persoas con párkinson.

And we are working with the doctors on improving their life,

Estamos traballando cos médicos en mellorar a súa vida,

understanding the disease better.

en comprender mellor a enfermidade.

So when I started, I told you

Cando comecei,

that I'm really fascinated with Star Wars and the Force in Star Wars,

díxenvos que me abraiaba Star Wars e a Forza.

and indeed, I'm still very much fascinated,

Por suposto, sigo fascinada con Star Wars

even now, as a grown-up, with Star Wars,

incluso agora de adulta,

waiting for the next movie.

á espreita da próxima película.

But I'm very fascinated now and excited

Pero agora pásmame e arrebátame

about this new Force of wireless signals,

esta nova Forza dos sinais sen fíos

and the potential of changing health care with this new force.

e o seu potencial para cambiar a asistencia sanitaria.

One of the patients with whom we deployed is actually my aunt.

Un dos pacientes cos que traballamos é de feito a miña tía

She has heart failure,

Ten unha cardiopatía.

and I'm sure many of you guys in the audience

Seguro que moitos de vós no público

have parents, grandparents, loved ones who have chronic diseases.

tedes pais, avós, seres queridos con enfermidades crónicas.

So I want you to imagine with me a future

Quero que imaxinedes comigo un futuro

where in every home that has a chronic disease patient,

en que cada casa cun paciente crónico

there is a device like this device sitting in the background

ten un aparello coma este nalgún curruncho

and just monitoring passively

e simplemente controla de modo pasivo

sleep, breathing, the health of this chronic disease patient,

o sono, a respiración, a saúde do paciente crónico.

and before an emergency occurs,

Antes de que apareza a emerxencia

it would detect the degradation in the physiological signal

detectamos a degradación dos signos fisiolóxicos

and alert the doctor

e alertamos ao doutor

so that we can avoid hospitalization.

para evitar a hospitalización.

This can change health care as we know it today,

Isto pode cambiar a asistencia sanitaria tal e como a coñecemos,

improve how we understand chronic diseases

mellorar a nosa comprensión sobre as enfermidades crónicas

and also save many lives.

e abofé salvar moitas vidas.

Thank you.

Grazas.

(Applause)

(Aplausos)

Helen Walters: Dina, thank you so much.

Helen Waters: Dina, moitas grazas.

Thank you too, Zach.

Grazas tamén, Zach.

So glad you're breathing.

Que ben que respires!

So Dina, this is amazing.

Dina, isto é abraiante.

The positive applications are incredible.

As aplicacións positivas son incribles.

What is the framework, though, like the ethical framework around this?

Cal é o marco de traballo, é dicir, o marco ético en todo isto?

What are you doing to prevent this technology from being used

Que se pode facer para evitar que esta tecnoloxía sexa usada

for other, perhaps less positive types of applications?

para outros propósitos digamos menos positivos?

Dina Katabi: Yeah, this is a very important question, of course,

Dina Katabi: Si, por suposto que é unha cuestión importante

like, what about misuse,

a do mal uso,

or what about, I guess you could say, about the Dark Side of the Force?

ou tamén poderiamos dicir o lado escuro da Forza?

HW: Right, right.

HW: Claro, claro.

(Laughter)

(Risos)

DK: So we actually have technologies

DK: De feito, dispomos de ferramentas

that prevent people from trying to use this device

para evitar que a xente use este aparello

to monitor somebody without their consent.

para controlar a alguén sen o seu consentimento.

Because the device understands space,

Porque o aparello comprende o espazo,

it will ask you to prove, by doing certain movements,

pedirache que probes mediante certos movementos

that you have access to the space

que tes acceso ao espazo arredor

and you are the person who you are asking the device to monitor.

e que es a persoa que solicita iniciar a monitorización.

So technology-wise,

Desde o punto de vista tecnolóxico,

we have technology that we integrate to prevent misuse,

temos tecnoloxía que integramos para previr un mal uso

but also, I think there is a role for policy, like everything else,

pero tamén hai sitio para a lexislación, coma en todo,

and hopefully, with the two of them, we can control any misuse.

e esperamos que entre as dúas partes poidamos controlar o abuso.

HW: Amazing. Thank you so much.

HW: Fantástico. Moitísimas grazas.

DK: Thank you.

DK: Grazas a ti.

(Applause)

(Aplausos)