The thrilling potential of SixthSense technology | Pranav Mistry

譯者: Lucy Chang 審譯者: Coco Shen

We grew up

我們生長在

interacting with the physical objects around us.

和周圍物體互動的環境裡

There are an enormous number of them that we use every day.

有很多很多物品，

是我們每天都要用到的

Unlike most of our computing devices,

和大部分電腦軟體相比，

these objects are much more fun to use.

這些實體有趣多了。

當我們提到物品,

When you talk about objects,

one other thing automatically comes attached to that thing,

會立即出現和這東西有關的另一件事 --

and that is gestures:

姿勢:

how we manipulate these objects,

也就是：我們怎麼使用這些物品,

how we use these objects in everyday life.

我們在每日生活中如何使用這些物品

We use gestures not only to interact with these objects,

我們不只運用不同姿勢來使用物體

but we also use them to interact with each other.

也用來和別人溝通。

A gesture of "Namaste!", maybe, to respect someone, or maybe,

合十的姿勢，可能是表示尊敬某人

或者是 --

in India I don't need to teach a kid that this means

在印度，不必教，小孩都知道這是 --

"four runs" in cricket.

板球的"4"的意思

It comes as a part of our everyday learning.

這是我們的生活常識

So, I am very interested, from the beginning,

所以，我一開始，就很有興趣

想了解， --

how our knowledge about everyday objects and gestures,

我們對於

日常用品和姿勢的認知,

and how we use these objects,

以及，如何把這些物品

can be leveraged to our interactions with the digital world.

運用在我們和數位世界的溝通上

Rather than using a keyboard and mouse,

為什麼沒有鍵盤和滑鼠,

why can I not use my computer

我就沒辦法使用電腦?

in the same way that I interact in the physical world?

為什麼和電腦溝通，不能和實體世界溝通一樣?

So, I started this exploration around eight years back,

我的探索從八年前開始

and it literally started with a mouse on my desk.

從我桌上的滑鼠開始

Rather than using it for my computer, I actually opened it.

我不是在電腦螢幕上使用它

而是拆開它，

Most of you might be aware that, in those days,

你們都知道，在那個年代，

the mouse used to come with a ball inside,

滑鼠裡面有個球，

and there were two rollers

還有兩個滾輪，

that actually guide the computer where the ball is moving,

所以，當滑鼠移動時，

and, accordingly, where the mouse is moving.

滾輪會告訴電腦，球滾動的方向。

So, I was interested in these two rollers,

我對滾輪有興趣，

and I actually wanted more, so I borrowed another mouse from a friend --

但還需要多幾個，所以就跟朋友借他的滑鼠

never returned to him --

一直沒還他 --

and I now had four rollers.

這樣就有了四個滾輪。

Interestingly, what I did with these rollers is,

我怎麼用這些滾輪呢--

basically, I took them off of these mouses and then put them in one line.

基本上，我把它們從滑鼠裡拿出來

放在一條線上

It had some strings and pulleys and some springs.

有線、滑帶和彈簧

What I got is basically a gesture-interface device

我做出了一個偵測姿勢的介面裝置。

that actually acts as a motion-sensing device

像個動作偵測裝置，

made for two dollars.

成本只要兩塊美元。

So, here, whatever movement I do in my physical world

所以，現在，不論我在實體世界做什麼，

is actually replicated inside the digital world

在數位的世界裡就會反映出來

just using this small device that I made, around eight years back,

只要用這個我8年前做的小東西就可以,

in 2000.

那是2000年。

Because I was interested in integrating these two worlds,

我對於整合實體和數位世界有興趣,

I thought of sticky notes.

我想到便利貼。

I thought, "Why can I not connect

我想, "何不把

the normal interface of a physical sticky note

實體便利貼的介面，和

to the digital world?"

數位便利貼整合在一起?"

A message written on a sticky note to my mom,

在便利貼上寫給我媽媽的留言

on paper,

紙條

can come to an SMS,

可以用簡訊傳遞。

or maybe a meeting reminder

或是寫在紙上的會議通知

automatically syncs with my digital calendar --

自動和我的數位行事曆同步 --

a to-do list that automatically syncs with you.

待辦事項會自動在電腦上同步。

But you can also search in the digital world,

但你也同時可以在數位環境裡搜尋,

or maybe you can write a query, saying,

或者是,你可以寫下問題, 如,

"What is Dr. Smith's address?"

"史教授的地址?"

and this small system actually prints it out --

然後這個小系統就把地址列印出來 --

so it actually acts like a paper input-output system,

這就像是個紙做的輸出入系統,

just made out of paper.

用紙就可以做到.

In another exploration,

另一項探索是,

I thought of making a pen that can draw in three dimensions.

我想到用一枝可以畫3D效果的筆

So, I implemented this pen that can help designers and architects

所以就設計出這支筆

幫助設計師和建築師

not only think in three dimensions,

不只以三度空間思考,

but they can actually draw,

也可以畫3D圖形

so that it's more intuitive to use that way.

這樣用起來就更直覺多了。

Then I thought, "Why not make a Google Map,

我又想, "何不做一個實體世界的

but in the physical world?"

Google地圖?"

Rather than typing a keyword to find something,

不必輸入關鍵字來找東西,

I put my objects on top of it.

而是放這個東西在地圖上。

If I put a boarding pass, it will show me where the flight gate is.

如果我把登機證放在地圖上,它會顯示登機口的位置

A coffee cup will show where you can find more coffee,

放咖啡杯，它會顯示咖啡廳的位置,

or where you can trash the cup.

或垃圾筒的位置.

So, these were some of the earlier explorations I did

這些是早期我做的實驗，

because the goal was to connect these two worlds seamlessly.

我的目的是緊密銜接這兩個世界.

Among all these experiments,

在這些實驗之中,

there was one thing in common:

有一個共通點:

I was trying to bring a part of the physical world

我都會把實體的東西帶進數位環境裡.

to the digital world.

我把物品,

I was taking some part of the objects,

or any of the intuitiveness of real life,

或生活中，直覺式的東西,

and bringing them to the digital world,

帶進數位世界裡,

because the goal was to make our computing interfaces more intuitive.

目的是讓電腦介面更人性化

But then I realized that we humans are not actually interested in computing.

但是後來我了解到

人們對電腦沒有興趣

What we are interested in is information.

人們有興趣的是資訊。

We want to know about things.

我們想知道更多事情.

We want to know about dynamic things going around.

我們想知道周圍的各種動態

So I thought, around last year -- in the beginning of the last year --

所以，大約在去年，去年年初的時候--

I started thinking, "Why can I not take this approach in the reverse way?"

我開始想, "我何不顛倒我的研究方向呢?"

或許, "把數位世界的數位資訊，

Maybe, "How about I take my digital world

and paint the physical world with that digital information?"

描畫在實體世界裡??"

因為這些影像，都被包在這些方方的裝置裡

Because pixels are actually, right now, confined in these rectangular devices

然後放進口袋裡.

that fit in our pockets.

Why can I not remove this confine

我何不把這個形體打破

and take that to my everyday objects, everyday life

把資訊放進日常生活中?

so that I don't need to learn the new language

這樣我也不必學新的、

for interacting with those pixels?

和這些象素溝通的語言?

So, in order to realize this dream,

為了實現這個夢想,

I actually thought of putting a big-size projector on my head.

我真的想過把一個投影機放在我的頭上

I think that's why this is called a head-mounted projector, isn't it?

這就是所謂「投(頭)影機」的意思，對吧?!

I took it very literally,

我照著字面意思做了

and took my bike helmet,

我把自行車的頭盔

put a little cut over there so that the projector actually fits nicely.

割掉一點,讓投影機可以放得進去.

So now, what I can do --

這樣，我可以 --

I can augment the world around me with this digital information.

在真實世界中用數位訊息環繞我

But later,

但是,後來

I realized that I actually wanted to interact

我想到 我也要和這些電腦像素溝通.

with those digital pixels, also.

So I put a small camera over there that acts as a digital eye.

所以我加了一個小攝影機,

當作數位眼睛.

Later, we moved to a much better,

之後, 我們進一步,做成--

consumer-oriented pendant version of that,

使用者導向的頸掛式,

that many of you now know as the SixthSense device.

就是很多人知道的「第六感計算裝置」.

But the most interesting thing about this particular technology

這技術最有趣的地方是

is that you can carry your digital world with you

你可以把數位世界帶著走

wherever you go.

到任何地方都可以.

You can start using any surface, any wall around you,

你可以用任何表面或牆壁，

as an interface.

當成介面.

The camera is actually tracking all your gestures.

這錄影機隨時都在偵測你的動作.

Whatever you're doing with your hands,

不論雙手在做什麼,

it's understanding that gesture.

它都知道.

And, actually, if you see, there are some color markers

還有，你看那些色筆

that in the beginning version we are using with it.

那是我們早期用的.

You can start painting on any wall.

可以在任何牆壁上畫畫.

You stop by a wall, and start painting on that wall.

可以停在牆壁前面，開始在牆上作畫.

But we are not only tracking one finger, here.

而且我們不只偵測一根手指.

We are giving you the freedom of using all of both of your hands,

我們讓你可以用兩隻手全部,

so you can actually use both of your hands to zoom into or zoom out

所以可以用兩隻手去放大縮小--

of a map just by pinching all present.

地圖，用捏的.

The camera is actually doing -- just, getting all the images --

錄影機 --

收集所有影像 --

is doing the edge recognition and also the color recognition

執行動作辨識和顏色辨識

and so many other small algorithms are going on inside.

有很多小程式在裡面跑

So, technically, it's a little bit complex,

技術上有點複雜,

but it gives you an output which is more intuitive to use, in some sense.

但是讓人可以用的很自然

But I'm more excited that you can actually take it outside.

我更興奮的是，可以帶到戶外去用

Rather than getting your camera out of your pocket,

不必掏出口袋裡的照相機,

you can just do the gesture of taking a photo,

只要一個照相的姿勢

and it takes a photo for you.

它就替你照相了.

(Applause)

(掌聲)

Thank you.

謝謝.

And later I can find a wall, anywhere,

拍完之後，我隨便找一面牆,

and start browsing those photos

就開始瀏覽這些照片

or maybe, "OK, I want to modify this photo a little bit

或, "我想修改一下這些照片

and send it as an email to a friend."

然後用電子郵件寄給朋友."

So, we are looking for an era

我們面對的世代是 --

where computing will actually merge with the physical world.

與實體世界融合在一起的運算

And, of course, if you don't have any surface,

如果你沒有平面可用，

you can start using your palm for simple operations.

手掌也可以處理簡單的功能.

Here, I'm dialing a phone number just using my hand.

我在這裡只用我的手，撥電話號碼.

The camera is actually not only understanding your hand movements,

攝影機不只了解你手部的動作,

but, interestingly,

而且,

is also able to understand what objects you are holding in your hand.

它還知道在你手裡拿著的是什麼東西.

我們現在正在做的是 --

For example, in this case,

舉個例, 在這裡,

the book cover is matched

這本書的封面

with so many thousands, or maybe millions of books online,

正在和線上的數以百萬計的書封面比對,

and checking out which book it is.

找尋這是哪一本書.

Once it has that information,

一旦找到資料,

it finds out more reviews about that,

它會找到書評,

or maybe New York Times has a sound overview on that,

或者，可能紐約時報有個有聲的簡介,

so you can actually hear, on a physical book,

你就可以, 在實體書上，聽到

a review as sound.

有聲的書評.

(Video) Famous talk at Harvard University --

("哈佛大學的著名演講 ...")

This was Obama's visit last week to MIT.

這是歐巴瑪總統上週來MIT的演講.

(Video) And particularly I want to thank two outstanding MIT --

("... 我特別要感謝2位MIT ...")

Pranav Mistry: So, I was seeing the live [video] of his talk,

我從報紙上,看到他演講的實況錄影.

outside, on just a newspaper.

Your newspaper will show you live weather information

你的報紙會給你看動態天氣報導

rather than having it updated.

不必去更新資料 – 這原本，要上電腦

You have to check your computer in order to do that, right?

才找得到, 是嗎?

(Applause)

(掌聲)

When I'm going back, I can just use my boarding pass

我回印度時, 我只要拿出我的登機證

to check how much my flight has been delayed,

就可以知道我的班機延誤多久,

because at that particular time,

因為在這種時候,

I'm not feeling like opening my iPhone,

我不想打開iPhone,

and checking out a particular icon.

點選某個功能圖案.

And I think this technology will not only change the way --

我相信這個技術不只改變--

(Laughter)

是的. (笑聲)

Yes.

It will change the way we interact with people, also,

也會改變我們和別人的交流

not only the physical world.

不只在實體世界裡.

The fun part is, I'm going to the Boston metro,

好玩的是，我在波士頓的捷運上

and playing a pong game inside the train on the ground, right?

玩踢毽子遊戲

在地上玩, 不錯吧?

(Laughter)

(笑聲)

And I think the imagination is the only limit

我相信，當這種技術和實體生活混在一起時

of what you can think of

想像力是唯一能限制--

when this kind of technology merges with real life.

我們的東西。

But many of you argue, actually,

但很多人會說--

that all of our work is not only about physical objects.

我的工作和實體物品沒什麼關係.

We actually do lots of accounting and paper editing

我們做的大多是會計、編輯這類的事

and all those kinds of things; what about that?

對於這些,你怎麼處理?

And many of you are excited about the next-generation tablet computers

很多人很期待新一代的平板電腦

to come out in the market.

上市

So, rather than waiting for that,

與其等待

I actually made my own, just using a piece of paper.

,我乾脆自己做一個﹐只用了一張紙

So, what I did here is remove the camera --

我把錄影機上的--

All the webcam cameras have a microphone inside the camera.

所有網路度影機上都有個麥克風 .

I removed the microphone from that,

我把麥克風拿下來

and then just pinched that --

夾在--

like I just made a clip out of the microphone --

就像是做了個夾式麥克風 --

and clipped that to a piece of paper, any paper that you found around.

夾在紙上, 隨便的一張紙.

So now the sound of the touch

每當我碰到紙的時候，

is getting me when exactly I'm touching the paper.

這在紙上接觸的聲音就會通知電腦.

But the camera is actually tracking where my fingers are moving.

錄影機還在追蹤我的手指的移動

You can of course watch movies.

你當然也可以看電影

(Video) Good afternoon. My name is Russell,

("午安，我叫羅素 ...")

and I am a Wilderness Explorer in Tribe 54."

("... 我是第54團的荒野探險者.")

PM: And you can of course play games.

也可以玩遊戲.

(Car engine)

(汽車引擎聲)

Here, the camera is actually understanding how you're holding the paper

攝影機知道你拿紙的方向

and playing a car-racing game.

就可以玩賽車遊戲

(Applause)

(掌聲)

Many of you already must have thought, OK, you can browse.

很多人早又想到了，可以瀏覽

對，當然可以瀏覽任何網站

Yeah. Of course you can browse to any websites

or you can do all sorts of computing on a piece of paper

甚至在紙上做各種運算

wherever you need it.

在任何你需要的地方

So, more interestingly,

更有趣的是

I'm interested in how we can take that in a more dynamic way.

我想把這個功能變得更強大一點

When I come back to my desk, I can just pinch that information

當我回到桌上，我可以捏住那個資訊，--

back to my desktop

然後放到我的電腦螢幕上

so I can use my full-size computer.

這樣我就可以用我的桌上電腦

(Applause)

(掌聲)

And why only computers? We can just play with papers.

為什麼要電腦? 用紙也很好玩.

Paper world is interesting to play with.

紙的世界很好玩.

Here, I'm taking a part of a document,

我把文章的一部分

and putting over here a second part from a second place,

放在這裡, 當成第二部份 --

and I'm actually modifying the information that I have over there.

然後調整--

這裡的資訊.

Yeah. And I say, "OK, this looks nice, let me print it out, that thing."

好，然後我說, "OK, 這樣很好,

我要列印出來."

So I now have a print-out of that thing.

就有了一份列印文件, 這樣 --

So the workflow is more intuitive,

工作流程比我們以前用的方式更人性了

the way we used to do it maybe 20 years back,

像20年前的工作方式，

rather than now switching between these two worlds.

而不是像現在，要在兩個世界裡切換

So, as a last thought,

最後，

I think that integrating information to everyday objects

我相信把資訊和所有物件整合，

不僅可以消滅數位落差、

will not only help us to get rid of the digital divide,

the gap between these two worlds,

把兩個世界間的鴻溝填滿,

but will also help us, in some way,

還可以幫助我們,

to stay human,

保有人性,

to be more connected to our physical world.

讓我們和實體世界更連結.

And it will actually help us not end up being machines

最終會幫助我們，不要變成--

sitting in front of other machines.

坐在機器前面的另一部機器。

That's all. Thank you.

就這樣. 謝謝.

(Applause)

(掌聲)

Thank you.

謝謝.

(Applause)

(掌聲)

Chris Anderson: So, Pranav, first of all, you're a genius.

Chris nderson: 嗯﹐Pranav,

首先，你是個天才.

This is incredible, really.

這真的太棒了,真的

What are you doing with this? Is there a company being planned?

你預備怎麼做? 你想開個公司嗎﹖

Or is this research forever, or what?

還是一直繼續研究下去?還是有其他的打算?

Pranav Mistry: So, there are lots of companies,

Pr n v Mistry: 很多公司 --

sponsor companies of Media Lab interested in taking this ahead

就是 Medi L b的贊助者 --

有興趣以其他方法繼續研究

in one or another way.

Companies like mobile-phone operators

像行動通訊公司

want to take this in a different way than the NGOs in India,

和印度非營利機構的應用方法便不同

thinking, "Why can we only have 'Sixth Sense'?

這些機構想 "為什麼只有'第六感'?

We should have a 'Fifth Sense' for missing-sense people who cannot speak.

我們應該為殘障人士，設置第五感

如，啞巴.

This technology can be used for them to speak out in a different way

這種技術可以讓他們用另一種方式「說」出來

maybe a speaker system."

配個喇叭就可以."

CA: What are your own plans? Are you staying at MIT,

C : 你自己的打算呢? 要留在MIT嗎

or are you going to do something with this?

還是你也要參與這些計畫?

PM: 我正試著讓這技術更廣泛的被人們使用

PM: I'm trying to make this more available to people

讓大家都能開發自己的"第六感"裝置

so that anyone can develop their own SixthSense device,

因為硬體其實不難製造

because the hardware is actually not that hard to manufacture

or hard to make your own.

自己做也不難

We will provide all the open source software for them,

我們會提供開放式程式碼軟體給大家

maybe starting next month.

可能下個月就可以

CA: Open source? Wow.

C :開放程式碼﹖哇

(Applause)

(掌聲)

CA: Are you going to come back to India with some of this, at some point?

C : 你會回到印度做這些計畫嗎?

PM: Yeah. Yes, yes, of course.

PM: 是，是，當然.

CA: What are your plans? MIT? India?

C : 你的計畫呢? MIT?

How are you going to split your time going forward?

印度? 未來怎樣分配你的時間?

PM: There is a lot of energy here. Lots of learning.

PM: 這裡有很大的能量. 很多東西可以學

All of this work that you have seen is all about my learning in India.

你剛剛看到的，都是我在

印度學的.

And now, if you see, it's more about the cost-effectiveness:

往成本效益方面去考量:

this system costs you $300

這個系統只要300美元

compared to the $20,000 surface tables, or anything like that.

和2萬美元的桌面電腦相比

Or maybe even the $2 mouse gesture system at that time was costing around $5,000?

或甚至2塊美元的滑鼠

當年可能要價 5,000 美元?

I showed that, at a conference, to President Abdul Kalam, at that time,

不久前，我把這東西展示給

印度總統看

and then he said, "OK, we should use this in Bhabha Atomic Research Centre

他說: "我們應該在原子研究所裡

for some use of that."

用這個技術做些研究."

So I'm excited about how I can bring the technology to the masses

我很期待可以把這些技術帶給普羅大眾

rather than just keeping that technology in the lab environment.

而不是把這些技術留在實驗室裡

(Applause)

(掌聲)

CA: Based on the people we've seen at TED,

C : 我們在 TED,遇過的人之中

I would say you're truly one of the two or three

我可以說你是少數2-3個

best inventors in the world right now.

世界上頂尖的發明家之一

It's an honor to have you at TED.

TED很榮幸邀你來演講.

Thank you so much.

非常感謝.

That's fantastic.

真是太棒了.

(Applause)

(掌聲)