Shape-shifting tech will change work as we know it | Sean Follmer

譯者: Gentian Pan 審譯者: Ariel Hsu

We've evolved with tools, and tools have evolved with us.

我們因工具而進化， 工具因我們而演進。

Our ancestors created these hand axes 1.5 million years ago,

我們的祖先在 150 萬年前 創造了這些手斧，

shaping them to not only fit the task at hand

它們的塑形不僅適合工作本身，

but also their hand.

也適合使用它的「手」。

However, over the years,

然而，多年來，

tools have become more and more specialized.

工具越來越專業。

These sculpting tools have evolved through their use,

這些雕刻工具隨著 它們的使用而發展，

and each one has a different form which matches its function.

而且，針對不同的功能， 每一個都有不同的形狀。

And they leverage the dexterity of our hands

充分的發揮我們手的靈巧性，

in order to manipulate things with much more precision.

使得操控任務時，能達到 更高的精確度。

But as tools have become more and more complex,

但隨著工具變得 越來越複雜，

we need more complex controls to control them.

我們需要更複雜的 操控機制來控制它們。

And so designers have become very adept at creating interfaces

因此，設計者更加擅長建立使用者介面

that allow you to manipulate parameters while you're attending to other things,

當你參與不同場合時 允許你調整參數。

such as taking a photograph and changing the focus

譬如拍照， 改變焦距

or the aperture.

或光圈。

But the computer has fundamentally changed the way we think about tools

然而，電腦從根本上 改變了我們對工具的看法。

because computation is dynamic.

因為計算學是強而有力的，

So it can do a million different things

所以，它可以做 1百萬種不同的事，

and run a million different applications.

並執行1百萬個不同的應用程式。

However, computers have the same static physical form

然而，對不同的應用程式來說，

電腦都提供相同的實體形式

for all of these different applications

and the same static interface elements as well.

和相同不變的介面元素。

And I believe that this is fundamentally a problem,

而且我相信，這會是 根本性的一個問題是。

because it doesn't really allow us to interact with our hands

因為這些介面元素不是 真的可以和我們雙手互動，

and capture the rich dexterity that we have in our bodies.

以展現出我們身體擁有 豐富的充靈巧性。

And my belief is that, then, we must need new types of interfaces

而我的信念是，那麼我們 必須開發新類型的介面。

that can capture these rich abilities that we have

可以充分展現我們 所擁有的豐富能力。

and that can physically adapt to us

而且，是可以為我們 動態調整的「實體」，

and allow us to interact in new ways.

讓我們以新的方式和它互動。

And so that's what I've been doing at the MIT Media Lab

所以這就是我在麻省理工學院 媒體實驗室一直在做的事，

and now at Stanford.

現在則在史丹佛大學。

So with my colleagues, Daniel Leithinger and Hiroshi Ishii,

因此，與我的同事， 丹尼爾和石井浩，

we created inFORM,

我們開發了inFORM介面，

where the interface can actually come off the screen

這介面，實際上可以從 「屏幕」中跳脫出來，

and you can physically manipulate it.

你可以採用「實體」的形態來操控它。

Or you can visualize 3D information physically

或者，你可以看到電腦3D資訊 以「實體」的型態來呈現。

and touch it and feel it to understand it in new ways.

可以觸摸它、感覺它， 以新的方式了解它。

Or you can interact through gestures and direct deformations

或者，你可以透過 手勢的互動，指揮變形，

to sculpt digital clay.

當成「數位化粘土」來玩雕刻，

Or interface elements can arise out of the surface

或是展現「從表面浮出」 的人機介面元素，

and change on demand.

都可隨指令而改變。

And the idea is that for each individual application,

這個想法是，對於 每支應用程式，

the physical form can be matched to the application.

都有其「實體」形態可配合。

And I believe this represents a new way

我相信這是我們將電腦訊息

「實體」化後

that we can interact with information,

與其互動的一個新方法

by making it physical.

So the question is, how can we use this?

所以，問題是，我們如何使用呢？

Traditionally, urban planners and architects build physical models

傳統上，都市規劃者與建築師 會建立城市和建物的「實體」模型，

of cities and buildings to better understand them.

以便更加了解他們的設計與規劃。

So with Tony Tang at the Media Lab, we created an interface built on inFORM

所以，我與東尼．唐，我們在媒體實驗室， 建立了 inFORM 介面。

to allow urban planners to design and view entire cities.

讓都市規劃者用它來設計， 並觀看整個城市面貌。

And now you can walk around it, but it's dynamic, it's physical,

現在，你可以四處走動， 它是動態的、它是「實體」的，

and you can also interact directly.

你也可以直接和它互動。

Or you can look at different views,

或者，你可以看看 不同瀏覽模式，

such as population or traffic information,

譬如居民人數、或交通資訊，

but it's made physical.

但它卻是以「實體」來呈現。

We also believe that these dynamic shape displays can really change

我們也相信，這些 動態外形的顯示真的可以

the ways that we remotely collaborate with people.

改變我們以遠距離的方式 與人合力執行任務的方式。

So when we're working together in person,

當我們與人實際接觸一起工作時，

I'm not only looking at your face

我不是只盯著你的臉

but I'm also gesturing and manipulating objects,

我還與你比手勢， 同時操控物件，

and that's really hard to do when you're using tools like Skype.

這種工作方式 很難以 Skype 工具來取代。

And so using inFORM, you can reach out from the screen

然而使用 inFORM 介面， 你可以從屏幕伸出你的「手」

and manipulate things at a distance.

去操控遠方的物件。

So we used the pins of the display to represent people's hands,

因此，我們使用的顯示器 上的「圖針」來代替我們的手，

allowing them to actually touch and manipulate objects at a distance.

使他們能夠實際接觸物件， 並且以遠距離的方式來操控物件。

And you can also manipulate and collaborate on 3D data sets as well,

而且你還可以操控和與人合力 處理三維空間的資料，

so you can gesture around them as well as manipulate them.

所以你可以在周圍比手勢 以及操控它們。

And that allows people to collaborate on these new types of 3D information

這使人們能夠和人合力 處理三維空間的資料，

in a richer way than might be possible with traditional tools.

這比使用傳統工具的 處理方式更為豐富。

And so you can also bring in existing objects,

所以，你也可以把現有物件帶入，

and those will be captured on one side and transmitted to the other.

讓另一方捕捉， 再傳送到對方。

Or you can have an object that's linked between two places,

或者，你可以擁有 一個「連結兩方」的物件：

so as I move a ball on one side,

所以當我在一側移動一個球時，

the ball moves on the other as well.

另一側的球也是會跟著動。

And so we do this by capturing the remote user

我們利用深度感應攝影機 捕獲遠程使用者的動作，

using a depth-sensing camera like a Microsoft Kinect.

就像微軟Kinect。(time calibration because of merge and sequence)

Now, you might be wondering how does this all work,

現在，你可能想知道 這一切是如何運作。

and essentially, what it is, is 900 linear actuators

基本上，它是900個「線性傳動器」

that are connected to these mechanical linkages

連接到這些「機械聯動裝置」，

that allow motion down here to be propagated in these pins above.

讓底下產生的運動 傳遞到上面的「圖針」。

So it's not that complex compared to what's going on at CERN,

並非像CERN協會的 核子研究那麼複雜，

but it did take a long time for us to build it.

但是要打造它，確實相當費時。

And so we started with a single motor,

於是我們開始使用單一馬達、

a single linear actuator,

單一線性傳動器，

and then we had to design a custom circuit board to control them.

然後我們必須訂製設計 「線路框」來控制它們。

And then we had to make a lot of them.

我們必須製造很多套，

And so the problem with having 900 of something

要製造900 多套的問題是

is that you have to do every step 900 times.

每一步驟必須執行900 多次。

And so that meant that we had a lot of work to do.

這意味著我們有 大量的工作要做。

So we sort of set up a mini-sweatshop in the Media Lab

所以，有點像是在媒體實驗室 設立了迷你血汗工廠，

and brought undergrads in and convinced them to do "research" --

招募大學在校生， 說服他們做「研究」 。

(Laughter)

（笑聲）

and had late nights watching movies, eating pizza

深夜有電影可看，有披薩可吃，

and screwing in thousands of screws.

但你得鎖上成千上萬的螺絲。

You know -- research.

你知道的 - 「研究」。

(Laughter)

（笑聲）

But anyway, I think that we were really excited by the things

但無論如何，我認為我們 興奮的事是

that inFORM allowed us to do.

inFORM 介面技術 可以做到很多事情。

Increasingly, we're using mobile devices, and we interact on the go.

我們可應用在更多「隨身攜帶」的 的行動裝置，與之互動。

But mobile devices, just like computers,

但是，行動裝置，像是電腦，

are used for so many different applications.

可以用在許多不同的應用程式。

So you use them to talk on the phone,

所以，你用它們來講電話、

to surf the web, to play games, to take pictures

上網、玩遊戲、拍照，

or even a million different things.

近上百萬種不同的事情。

But again, they have the same static physical form

但是，對於這些應用程式，

for each of these applications.

它們仍然具有相同的實體形式。

And so we wanted to know how can we take some of the same interactions

因此，我們想知道如何

將我們開發的 inFORM 互動介面

that we developed for inFORM

and bring them to mobile devices.

應用於行動裝置上。

So at Stanford, we created this haptic edge display,

因此，在史丹佛大學， 我們建立「觸感邊緣顯示器」，

which is a mobile device with an array of linear actuators

它是一個搭配「線性傳動器」 的陣列行動裝置，

that can change shape,

可改變形狀，

so you can feel in your hand where you are as you're reading a book.

你可以在手中感覺到它的變化， 因而知道書閱讀至何處。

Or you can feel in your pocket new types of tactile sensations

或者；你可以從口袋 感受到新觸感，

that are richer than the vibration.

這些會比「振動」更豐富。

Or buttons can emerge from the side that allow you to interact

或從側面出現按鈕，

出現在你要的位置， 讓你與之互動。

where you want them to be.

Or you can play games and have actual buttons.

或者，讓你在玩遊戲時 有真實的按鈕可按。

And so we were able to do this

因此，我們能夠做到這一點：

by embedding 40 small, tiny linear actuators inside the device,

在裝置內部嵌入 40個微小「線性驅動器」，

and that allow you not only to touch them

讓你不僅僅可以觸摸他們，

but also back-drive them as well.

還可以把它們收攏。

But we've also looked at other ways to create more complex shape change.

但我們也想看看其它 建立更複雜的形狀變化。

So we've used pneumatic actuation to create a morphing device

我們採用氣動式傳動器 建立一個變形裝置，

where you can go from something that looks a lot like a phone ...

它一開始看起來可以像一支電話...

to a wristband on the go.

變成隨身的腕帶。

And so together with Ken Nakagaki at the Media Lab,

所以，我與肯中垣 在媒體實驗室

we created this new high-resolution version

建立這個「高解析度」版本，

that uses an array of servomotors to change from interactive wristband

使用一些伺服馬達， 改變了不只是互動式腕帶，

to a touch-input device

還有其他如觸摸式輸入裝置、

to a phone.

電話...等。

(Laughter)

（笑聲）

And we're also interested in looking at ways

而且我們也有興趣地尋找

that users can actually deform the interfaces

使用者在實際應用上 可以隨意變形的方法，

to shape them into the devices that they want to use.

可以塑造成他們要的使用裝置。

So you can make something like a game controller,

所以，你可以把它變成遊戲操控器，

and then the system will understand what shape it's in

然後系統偵到測目前 是處於什麼形狀，

and change to that mode.

就切換到該模式。

So, where does this point?

那麼，我們該如何定位？

How do we move forward from here?

又該如何由此更加進步？

I think, really, where we are today

我覺得今天處在

is in this new age of the Internet of Things,

物聯網的新時代，

where we have computers everywhere --

一個電腦無所不在的時代。

they're in our pockets, they're in our walls,

他們在我們的口袋裡、 他們在我們的牆壁、

they're in almost every device that you'll buy in the next five years.

他們幾乎存在於未來五年內 你會購買的每一個裝置裡。

But what if we stopped thinking about devices

但是，如果我們停止思考裝置，

and think instead about environments?

先回頭想想環境呢？

And so how can we have smart furniture

那，我們如何才能擁有智能家具、

or smart rooms or smart environments

智能房間 或 智能環境

or cities that can adapt to us physically,

或者「實體」上可以隨時被我們調整的城市，

and allow us to do new ways of collaborating with people

找到與人合作的新方法

and doing new types of tasks?

執行新類型的任務？

So for the Milan Design Week, we created TRANSFORM,

所以在米蘭設計週， 我們建立了 《蛻變》 TRANSFORM，

which is an interactive table-scale version of these shape displays,

這是一個桌面互動的 「模形顯示器」版本，

which can move physical objects on the surface; for example,

可在表面上移動 實體物件，例如：

reminding you to take your keys.

提醒你攜帶鑰匙。

But it can also transform to fit different ways of interacting.

但它也可以變形以調整 不同互動模式。

So if you want to work,

所以，如果你要工作了，

then it can change to sort of set up your work system.

那麼，它可以改變成 你想要的工作環境。

And so as you bring a device over,

只要把設備帶過來，

it creates all the affordances you need

它建立所有你需要的預設用途，

and brings other objects to help you accomplish those goals.

並帶來其他物件 幫你實現這些目的。

So, in conclusion,

總而言之

I really think that we need to think about a new, fundamentally different way

我真的認為需要思考一下， 一個嶄新的、從根本上改變的

of interacting with computers.

人和電腦互動的方法。

We need computers that can physically adapt to us

我們需要電腦可以在「實體」上 隨時配合我們調整，

and adapt to the ways that we want to use them

調整成我們想使用的方式，

and really harness the rich dexterity that we have of our hands,

真正充分利用我們 手的豐富靈巧性，

and our ability to think spatially about information by making it physical.

並且我們有能力透過 「實體」化的呈現，來思考空間資訊。

But looking forward, I think we need to go beyond this, beyond devices,

但是，期待未來，我認為 我們可以超越這個裝置技術，

to really think about new ways that we can bring people together,

認真思考如何 結合所有人的力量，

and bring our information into the world,

並把我們的資訊 帶入這個世界，

and think about smart environments that can adapt to us physically.

想想智能環境，可以 隨時配合我們調整。

So with that, I will leave you.

基於上述，後續發展我將留給各位

Thank you very much.

非常感謝大家。

(Applause)

（掌聲）