Dennis Hong: Making a car for blind drivers

Prevoditelj: Tilen Pigac - EFZG Recezent: Mislav Ante Omazić - EFZG

Many believe driving is an activity

Mnogi vjeruju kako je vožnja aktivnost

solely reserved for those who can see.

isključivo rezervirana za one koji vide.

A blind person driving a vehicle safely and independently

Slijepa osoba koja vozi auto sigurno i samostalno

was thought to be an impossible task, until now.

je bilo okarakterizirano kao nemoguća misija, sve do sada.

Hello, my name is Dennis Hong,

Dobar dan, moje ime je Dennis Hong

and we're bringing freedom and independence to the blind

i donosimo slobodu i samostalnost slijepcima

by building a vehicle for the visually impaired.

izrađujući vozila za slabovidne osobe.

So before I talk about this car for the blind,

Dakle, prije nego počnem pričati o tom autu za slijepe osobe,

let me briefly tell you about another project that I worked on

dopustite mi da vam ukratko ispričam o drugom projektu na kojem sam radio

called the DARPA Urban Challenge.

a koji se zove DARPA urbani izazov.

Now this was about building a robotic car

Sada, tu se radilo o izradi robotskog auta

that can drive itself.

koji može voziti sam.

You press start, nobody touches anything,

Pritisnete start, nitko ne dira ništa

and it can reach its destination fully autonomously.

i dolazi do svoje destinacije potpuno samostalno.

So in 2007, our team won half a million dollars

Stoga je 2007. godine naš tim osvojio pola milijuna dolara

by placing third place in this competition.

osvojivši treće mjesto na tom natjecanju.

So about that time,

Dakle, u približno isto vrijeme,

the National Federation of the Blind, or NFB,

Nacionalna federacija slijepih, ili NFS,

challenged the research committee

postavila je izazov istražnom odboru

about who can develop a car

o tome tko može razviti auto

that lets a blind person drive safely and independently.

koji omogućava slijepim osobama da voze sigurno i samostalno.

We decided to give it a try,

Odlučili smo pokušati,

because we thought, "Hey, how hard could it be?"

jer smo pomislili, hej, kako teško to može biti.

We have already an autonomous vehicle.

Već imamo autonomno vozilo.

We just put a blind person in it and we're done, right?

Samo stavimo slijepu osobu unutra i gotovi smo, zar ne?

(Laughter)

(Smijeh)

We couldn't have been more wrong.

Nismo mogli više pogriješiti.

What NFB wanted

Ono što je NFS želio

was not a vehicle that can drive a blind person around,

nije bilo vozilo koje može voziti slijepu osobu okolo,

but a vehicle where a blind person can make active decisions and drive.

već vozilo gdje slijepa osoba može donositi aktivne odluke i voziti.

So we had to throw everything out the window

Stoga smo sve morali izbaciti van

and start from scratch.

i početi ispočetka.

So to test this crazy idea,

Kako bi testirali tu ludu ideju,

we developed a small dune buggy prototype vehicle

razvili smo mali prototip vozila za vožnju po dinama

to test the feasibility.

kako bi testirali njegovu provedivost.

And in the summer of 2009,

A u ljeto 2009. godine

we invited dozens of blind youth from all over the country

pozvali smo desetke slijepih mladih osoba iz cijele zemlje

and gave them a chance to take it for a spin.

i dali im šansu da se provozaju u tom vozilu.

It was an absolutely amazing experience.

Bilo je to potpuno nevjerojatno iskustvo.

But the problem with this car was

Ali problem s tim autom je bio

it was designed to only be driven in a very controlled environment,

to što je on bio dizajniran da ga se vozi samo u strogo kontroliranom okolišu,

in a flat, closed-off parking lot --

na ravnom zatvorenom parkiralištu --

even the lanes defined by red traffic cones.

čak i trake su bile definirane crvenim prometnim stošcima.

So with this success,

Dakle, s tim uspjehom,

we decided to take the next big step,

odlučili smo poduzeti idući veliki korak,

to develop a real car that can be driven on real roads.

razviti pravi auto koji može voziti po pravim cestama.

So how does it work?

Dakle, kako to funkcionira?

Well, it's a rather complex system,

Pa, to je prilično kompleksan sustav,

but let me try to explain it, maybe simplify it.

ali dopustite mi da ga objasnim, možda ga i pojasnim.

So we have three steps.

Dakle imamo tri koraka.

We have perception, computation

Imamo percepciju, računanje

and non-visual interfaces.

i ne vizualna sučelja.

Now obviously the driver cannot see,

Sada, očito je kako vozač ne može vidjeti

so the system needs to perceive the environment

stoga sustav mora vidjeti okolinu

and gather information for the driver.

i prikupiti informaciju za vozača.

For that, we use an initial measurement unit.

Za to, koristimo početnu mjernu jedinicu.

So it measures acceleration, angular acceleration --

Dakle, mjeri ubrzanje, kutno ubrzanje --

like a human ear, inner ear.

poput ljudskog uha, unutarnjeg uha.

We fuse that information with a GPS unit

Spojimo te podatke s GPS jedinicom

to get an estimate of the location of the car.

kako bi dobili procjenu lokacije auta.

We also use two cameras to detect the lanes of the road.

Isto tako koristimo dvije kamere kako bismo detektirali dvije trake ceste.

And we also use three laser range finders.

I isto tako koristimo tri laserska daljinomjera.

The lasers scan the environment to detect obstacles --

Laseri skeniraju okolinu kako bi detektirali prepreke --

a car approaching from the front, the back

auto koji se približava sprijeda, odostraga

and also any obstacles that run into the roads,

i isto tako bilokakve prepreke koje se pojave na cesti,

any obstacles around the vehicle.

bilokakve prepreke oko vozila.

So all this vast amount of information is then fed into the computer,

Zatim je sva ta silna količina informacija proslijeđena u računalo,

and the computer can do two things.

a računalo može učiniti dvije stvari.

One is, first of all, process this information

Jedna je, kao prvo, procesuirati te informacije

to have an understanding of the environment --

kako bi razumijeli okolinu --

these are the lanes of the road, there's the obstacles --

to su trake na cesti, to su prepreke --

and convey this information to the driver.

i prenesti te informacije vozaču.

The system is also smart enough

Sustav je ujedno i dovoljno pametan

to figure out the safest way to operate the car.

da dokuči najsigurniji način upravljanja autom.

So we can also generate instructions

Dakle, možemo isto tako proizvesti upute

on how to operate the controls of the vehicle.

kako upravljati komandama vozila.

But the problem is this: How do we convey

Ali problem je ovaj: Kako prenijeti

this information and instructions

tu informaciju i upute

to a person who cannot see

osobi koja ne može vidjeti

fast enough and accurate enough so he can drive?

dovoljno brzo i dovoljno precizno da on može voziti?

So for this, we developed many different types

Za to smo razvili puno različitih vrsta

of non-visual user interface technology.

tehnologija nevizualnih korisničkih sučelja.

So starting from a three-dimensional ping sound system,

Dakle, od trodimenzionalnog zvučnog sustava fijukanja,

a vibrating vest,

vibracijskog prsluka,

a click wheel with voice commands, a leg strip,

klika kotača s glasovnim upravljanjem, trake za nogu,

even a shoe that applies pressure to the foot.

čak i cipele koja prenosi pristisak na stopalo.

But today we're going to talk about

Ali danas ćemo pričati o

three of these non-visual user interfaces.

tri od tih nevizualnih korisničkih sučelja.

Now the first interface is called a DriveGrip.

Prvo sučelje se zove DriveGrip.

So these are a pair of gloves,

To je par rukavica

and it has vibrating elements on the knuckle part

i ima vibracijske elemente na zglobnom dijelu,

so you can convey instructions about how to steer --

tako da možete prenijeti upute o tome kako upravljati --

the direction and the intensity.

smjer i intenzitet.

Another device is called SpeedStrip.

Druga naprava se zove SpeedStrip.

So this is a chair -- as a matter of fact, it's actually a massage chair.

Dakle, to je sjedalo -- u stvari, to je zapravo sjedalo za masažu.

We gut it out, and we rearrange the vibrating elements in different patterns,

Izvadili smo ga van i premijestili smo vibrirajuće elemente u različite obrasce.

and we actuate them to convey information about the speed,

I uključujemo ih kako bi prenijeli informaciju o brzini

and also instructions how to use the gas and the brake pedal.

i o uputama kako koristiti papučice za gas i kočnicu.

So over here, you can see

Dakle, ovdje možete vidjeti

how the computer understands the environment,

kako računalo razumije okolinu.

and because you cannot see the vibration,

I jer ne možete vidjeti vibraciju,

we actually put red LED's on the driver so that you can see what's happening.

zapravo smo stavili crvene LED-ice na vozača, tako da možete vidjeti što se događa.

This is the sensory data,

Ovo su senzorski podaci

and that data is transferred to the devices through the computer.

i ti podaci se prenose do uređaja preko računala.

So these two devices, DriveGrip and SpeedStrip,

Dakle, ove dvije naprave, DriveGrip i SpeedStrip,

are very effective.

su jako učinkovite.

But the problem is

Ali problem je

these are instructional cue devices.

što su to uređaji za davanje instrukcija.

So this is not really freedom, right?

Dakle, to nije zapravo sloboda, zar ne?

The computer tells you how to drive --

Računalo vam govori kako da vozite --

turn left, turn right, speed up, stop.

skreni lijevo, skreni desno, ubrzaj, stani.

We call this the "backseat-driver problem."

Zovemo to problem vozača na stražnjem sjedalu.

So we're moving away from the instructional cue devices,

Stoga se odmičemo od uređaja za davanje instrukcija

and we're now focusing more

i sada se više fokusiramo

on the informational devices.

na informacijske uređaje.

A good example for this informational non-visual user interface

Dobar primjer tog informacijskog nevizualnog korisničkog sučelja

is called AirPix.

se naziva AirPix.

So think of it as a monitor for the blind.

Dakle, zamislite to kao monitor za slijepe.

So it's a small tablet, has many holes in it,

Dakle, to je mali tablet koji ima puno rupa u sebi

and compressed air comes out,

a komprimiran zrak izlazi van,

so it can actually draw images.

tako da zapravo može vući slike.

So even though you are blind, you can put your hand over it,

Dakle, čak i ako ste slijepi, možete staviti ruku iznad njega

you can see the lanes of the road and obstacles.

i možete vidjeti cestovne trake i prepreke.

Actually, you can also change the frequency of the air coming out

Zapravo, možete ujedno i promijeniti frekvenciju zraka koji izlazi van

and possibly the temperature.

i temperaturu.

So it's actually a multi-dimensional user interface.

Dakle, to je zapravo multidimenzionalno korisničko sučelje.

So here you can see the left camera, the right camera from the vehicle

Ovdje možete vidjeti lijevu kameru, desnu kameru vozila

and how the computer interprets that and sends that information to the AirPix.

i kako računalo tumači to i šalje tu informaciju AirPixu.

For this, we're showing a simulator,

Za to, prikazujemo simulator,

a blind person driving using the AirPix.

slijepu osobu koja vozi koristeći AirPix.

This simulator was also very useful for training the blind drivers

Taj simulator je bio ujedno i jako koristan za obučavanje slijepih vozača

and also quickly testing different types of ideas

i vrlo brzo za testiranje različitih vrsta ideja

for different types of non-visual user interfaces.

za različite vrste nevizualnih korisničkih sučelja.

So basically that's how it works.

Dakle, tako u osnovi funkcionira.

So just a month ago,

Dakle, prije samo mjesec dana,

on January 29th,

29. siječnja,

we unveiled this vehicle for the very first time to the public

otkrili smo to vozili po prvi puta javnosti

at the world-famous Daytona International Speedway

na svjetski poznatom međunarodnom trkalištu Daytona

during the Rolex 24 racing event.

tijekom Rolex 24 utrke.

We also had some surprises. Let's take a look.

Isto tako smo imali neka iznenađenja. Pogledajmo.

(Music)

(Glazba)

(Video) Announcer: This is an historic day in January.

(Video) Spiker: Ovo je povijesni dan [nejasno].

He's coming up to the grandstand, fellow Federationists.

Dolazi do tribina, kolega Federistas.

(Cheering)

(Navijanje)

(Honking)

(Trubljenje)

There's the grandstand now.

Evo i tribine.

And he's [unclear] following that van that's out in front of him.

I on [nejasno] slijedeći taj kombi koji se nalazi ispred njega.

Well there comes the first box.

Evo dolazi i prva kutija.

Now let's see if Mark avoids it.

Da vidimo hoće li je Mark izbjeći.

He does. He passes it on the right.

Hoće. Obilazi je s desna.

Third box is out. The fourth box is out.

Treća kutija je vani. Četvrta kutija je vani.

And he's perfectly making his way between the two.

A on savršeno prolazi između njih dvije.

He's closing in on the van

Približava se kombiju

to make the moving pass.

kako bi ga pretekao.

Well this is what it's all about,

Dakle, o tome se radi,

this kind of dynamic display of audacity and ingenuity.

dinamičan prikaz smjelosti i genijalnosti.

He's approaching the end of the run,

Približava se kraju staze,

makes his way between the barrels that are set up there.

prolazi između bačvi koje su postavljene tamo.

(Honking)

(Trubljenje)

(Applause)

(Pljesak)

Dennis Hong: I'm so happy for you.

Dennis Hong: Tako sam sretan zbog tebe.

Mark's going to give me a ride back to the hotel.

Mark će me odvesti natrag u hotel.

Mark Riccobono: Yes.

Mark Riccobono: Da.

(Applause)

(Pljesak)

DH: So since we started this project,

DH: Dakle, otkako smo započeli s tim projektom,

we've been getting hundreds of letters, emails, phone calls

dobivamo stotine pisama, emailova, telefonskih poziva

from people from all around the world.

od ljudi iz cijelog svijeta.

Letters thanking us, but sometimes you also get funny letters like this one:

Pisma zahvale, ali ponekad dobijemo i smiješna pisma poput ovog:

"Now I understand why there is Braille on a drive-up ATM machine."

"Sada razumijem zašto postoji Braillevo pismo na "drive in" bankomatu."

(Laughter)

(Smijeh)

But sometimes --

Ali ponekad --

(Laughter)

(Smijeh)

But sometimes I also do get --

Ali ponekad isto tako dobijem i --

I wouldn't call it hate mail --

ne bih to nazvao pisma mržnje --

but letters of really strong concern:

već pisma jako velike zabrinutosti:

"Dr. Hong, are you insane,

Dr. Hong, jeste li vi ludi,

trying to put blind people on the road?

pokušavajući staviti slijepe ljude na cestu?

You must be out of your mind."

Vi mora da ste skrenuli."

But this vehicle is a prototype vehicle,

Ali to vozilo je prototip

and it's not going to be on the road

i neće ići na cestu

until it's proven as safe as, or safer than, today's vehicle.

tako dugo dok se ne dokaže kako je sigurno, ili sigurnije, od današnjih vozila.

And I truly believe that this can happen.

I doista vjerujem kako se to može dogoditi.

But still, will the society,

Ali ipak, hoće li društvo,

would they accept such a radical idea?

hoće li oni prihvatiti tako radikalnu ideju?

How are we going to handle insurance?

Kako ćemo riješiti osiguranje?

How are we going to issue driver's licenses?

Kako ćemo izdati vozačke dozvole?

There's many of these different kinds of hurdles besides technology challenges

Postoji mnogo tih različitih vrsta prepreka pokraj tehnoloških izazova

that we need to address before this becomes a reality.

koje moramo riješiti prije nego što to postane stvarnost.

Of course, the main goal of this project

Naravno, glavni cilj ovog projekta

is to develop a car for the blind.

je razviti auto za slijepe osobe.

But potentially more important than this

Ali potencijalno još važnije od toga

is the tremendous value of the spin-off technology

je ogromna vrijednost nove tehnologije

that can come from this project.

koja proizađe iz tog projekta.

The sensors that are used can see through the dark,

Senzori koji su upotrijebljeni mogu vidjeti kroz mrak,

the fog and rain.

maglu i kišu.

And together with this new type of interfaces,

I zajedno s tim novim vrstama sučelja,

we can use these technologies

možemo koristiti te tehnologije

and apply them to safer cars for sighted people.

i primjeniti ih sigurnijim autima za ljude s vidom.

Or for the blind, everyday home appliances --

Ili za slijepe, svakodnevni kućanski aparati --

in the educational setting, in the office setting.

u edukacijskom okruženju, u uredskom okruženju.

Just imagine, in a classroom a teacher writes on the blackboard

Samo zamislite, u učionici učitelj piše na ploču

and a blind student can see what's written and read

a slijepi student može vidjeti što je napisano i može čitati

using these non-visual interfaces.

koristeći ta nevizualna sučelja.

This is priceless.

To je neprocjenjivo.

So today, the things I've showed you today, is just the beginning.

Dakle danas, stvari koje sam vam danas pokazao samo su početak.

Thank you very much.

Puno vam hvala.

(Applause)

(Pljesak)