David Merrill: Toy tiles that talk to each other

譯者: Calvin Chun-yu Chan 審譯者: Bill Hsiung

I want to start out by asking you to think back to when you were a kid,

我想這樣開始演說，首先請你回想起童年時，

playing with blocks.

玩樍木的情境。

As you figured out how to reach out and grasp,

當你學會伸手、抓握、

pick them up and move them around,

拿起和移動樍木，

you were actually learning how to think and solve problems

事實上，你正在透過了解及操縱物品間的空間關係，

by understanding and manipulating spatial relationships.

來學習如何思考和解決問題。

Spatial reasoning is deeply connected

空間推理和我們如何理解身邊事物

to how we understand a lot of the world around us.

有着極大關連。

So, as a computer scientist

因此，身為電腦科學家，

inspired by this utility of our interactions with physical objects --

從這種與實物互動的應用當中得到啟發 —

along with my adviser Pattie, and my collaborator Jeevan Kalanithi --

連同我的顧問 Pattie，跟事業夥伴 Jeevan Kalanithi —

I started to wonder -- what if when we used a computer,

我開始想知道 — 假如我們使用電腦時，

instead of having this one mouse cursor that was a like a digital fingertip

所使用的不是那像數位指頭般的滑鼠指標，

moving around a flat desktop,

在平面的電腦桌面上移動，

what if we could reach in with both hands and grasp information physically,

假如我們能以自己雙手，像掌握實物般掌控資訊，

arranging it the way we wanted?

以我們喜歡的方式操控它？

This question was so compelling that we decided to explore the answer,

這問題引發起我們的興趣，所以我們決定

by building Siftables.

通過研發 Siftables 去探求答案。

In a nutshell, a Siftable is an interactive computer

簡單而言，Siftable 就像個

the size of a cookie.

餅乾般大小的互動電腦。

They're able to be moved around by hand,

你可隨意用手移動它們，

they can sense each other, they can sense their motion,

它們會自動感應到其他單元，它們能感測到動作，

and they have a screen and a wireless radio.

且每個單元都有螢幕及無線電收發器。

Most importantly, they're physical,

最重要的是，它們是實物，

so like the blocks, you can move them just by reaching out and grasping.

所以能像積木般，透過伸手抓握，即可拿起和移動它們。

And Siftables are an example of a new ecosystem

Siftables 是一系列嶄新的

of tools for manipulating digital information.

數位資訊操控工具的其中一個例子。

And as these tools become more physical,

當這些工具變得更實物化，

more aware of their motion, aware of each other,

更能感應到動作，感應彼此的存在，

and aware of the nuance of how we move them,

感應到我們如何移動它們，

we can start to explore some new and fun interaction styles.

我們就能夠開始探索一些新奇有趣的互動方式。

So, I'm going to start with some simple examples.

那麼，我將會展示一些簡單的例子。

This Siftable is configured to show video,

這些 Siftable 被設定為視訊放映模式，

and if I tilt it in one direction, it'll roll the video this way;

如果將它往一邊傾斜，視訊會這樣播放、

if I tilt it the other way it rolls it backwards.

將它傾斜到另一邊，則會倒帶。

And these interactive portraits are aware of each other.

這些互動肖像能感知彼此的存在。

So if I put them next to each other, they get interested.

如我將它們放在一起，它們會對彼此產生興趣。

If they get surrounded, they notice that too,

如果被包圍的話，它們一樣會察覺得到，

they might get a little flustered.

然後會顯得有點慌張。

And they can also sense their motion and tilt.

它們也以可感應到動作和傾斜度。

One of the interesting implications on interaction, we started to realize,

我們漸漸發現，在互動之中有一個有趣的蘊含，

was that we could use everyday gestures on data,

就是我們可以將日常用的手勢應用在資訊操控上，

like pouring a color the way we might pour a liquid.

比如像灌注液體般灌注顏色，

So in this case, we've got three Siftables configured to be paint buckets

在這個例子，我們有三顆 Siftables 被設定成油漆桶。

and I can use them to pour color into that central one,

而我可以用它們把顏色灌注到中間的那一顆，

where they get mixed.

混合成新顏色。

If we overshoot, we can pour a little bit back.

假如灌多了，我們可以倒一點回來。

There are also some neat possibilities for education,

還有些能應用在教育上的妙用，

like language, math and logic games

例如語言、數學與邏輯推理的遊戲。

where we want to give people the ability to try things quickly,

我們希望能給人們快速嘗試事物的能力，

and view the results immediately.

且能即時看到成果。

So here I'm --

因此我就…

(Applause)

（掌聲）

This is a Fibonacci sequence that I'm making with a simple equation program.

這是我用簡單的數學程式作的斐波納契數列。

Here we have a word game that's kind of like a mash-up between Scrabble and Boggle.

這是個有點像混合了拼字與 Boggle 的文字遊戲。

Basically, in every round

基本上，每個回合

you get a randomly assigned letter on each Siftable,

每塊 Siftable 會被隨機分配到一個字母。

and as you try to make words it checks against a dictionary.

當你嘗試以這些字母拼字時，它會自動檢查字典。

Then, after about 30 seconds, it reshuffles,

然後，30 秒後它會重新洗牌，

and you have a new set of letters and new possibilities to try.

你會得到新的字母，以嘗試新的可能性。

(Applause)

（掌聲）

Thank you.

謝謝

(Applause)

（掌聲）

So these are some kids that came on a field trip to the Media Lab,

這裡有些來參觀媒體實驗室的小朋友，

and I managed to get them to try it out, and shoot a video.

我讓他們嘗試這玩意，並拍了短片。

They really loved it.

他們非常喜歡。

And, one of the interesting things about this kind of application

而關於這種應用的一件有趣的事是，

is that you don't have to give people many instructions.

你不必給人們太多提示。

All you have to say is, "Make words,"

你只需要講一句「去拼字吧！」

and they know exactly what to do.

他們就知道該怎麼做。

So here's another few people trying it out.

這裡有另一群人正在試玩。

That's our youngest beta tester, down there on the right.

這是當中年紀最小的測試員，他在畫面右方。

Turns out, all he wanted to do was to stack the Siftables up.

結果是，他只想將 Siftables 疊起來。

So to him, they were just blocks.

對他來說，它們只是玩具樍木而已。

Now, this is an interactive cartoon application.

現在，這是個互動式卡通的應用。

And we wanted to build a learning tool for language learners.

我們還想為學語言的人建立學習的工具。

And this is Felix, actually.

事實上，這位是 Felix。

And he can bring new characters into the scene,

他能將新的角色置於場景中，

just by lifting the Siftables off the table that have that character shown on them.

只需把印有不同角色的 Siftables 從桌面上拿起來。

Here, he's bringing the sun out.

這樣，他讓太陽出來。

Video: The sun is rising.

影片：太陽正在升起。

David Merrill: Now he's brought a tractor into the scene.

David Merrill：現在他將拖拉機加入場景中。

Video: The orange tractor.

影片：橙色的拖拉機。

Good job! Yeah!

做得好！很好！

DM: So by shaking the Siftables and putting them next to each other

搖動 Siftables 並將它們排在一起

he can make the characters interact --

他可以讓裡面的人物互動…

Video: Woof!

影片：汪！汪！

DM: inventing his own narrative.

DM：創作屬於自己的故事。

Video: Hello!

影片：哈嘍！

DM: It's an open-ended story,

DM：這是個自由發揮的故事，

and he gets to decide how it unfolds.

他可以自己決定故事的發展。

Video: Fly away, cat.

影片：飛走的小猫

DM: So, the last example I have time to show you today

DM：今天最後展示的例子

is a music sequencing and live performance tool

是個編曲和現場即時表演的工具

that we've built recently,

這是我們最近才完成的，

in which Siftables act as sounds

Siftables 能用來當作樂器

like lead, bass and drums.

像主音，低音和鼓聲。

Each of these has four different variations,

每一個都有四種不同的變化，

you get to choose which one you want to use.

你可以選喜愛的來使用。

And you can inject these sounds into a sequence

而你能把這些聲音加入編曲中

that you can assemble into the pattern that you want.

自由組合想要的形式。

And you inject it by just bumping up the sound Siftable against a sequence Siftable.

你還可以將聲音 Siftable 輕輕碰上編曲 Siftable 來加入樂聲。

There are effects that you can control live, like reverb and filter.

這裡有些效果你能即時控制的，像混響和過濾器。

You attach it to a particular sound and then tilt to adjust it.

你可以將效果指定到特定的聲音，然後以傾斜來調整它。

And then, overall effects like tempo and volume

然後，像拍子和音量等整體效果

that apply to the entire sequence.

能應用到整個編曲上。

So let's have a look.

讓我們一起來看。

Video: (Music)

影片：（音樂）

DM: We'll start by putting a lead

DM：我們首先加進主音

into two sequence Siftables, arrange them into a series,

到兩個編曲 Siftables，排列成一個序列，

extend it, add a little more lead.

延長它，再多加一點主音。

Now I put a bass line in.

現在加上低音。

Video: (Music)

影片：（音樂）

DM: Now I'll put some percussion in.

DM：現在我會加入打擊樂器。

Video: (Music)

影片：（音樂）

DM: And now I'll attach the filter to the drums, so I can control the effect live.

DM：現在我將過濾器用在鼓聲上，然後即時控制效果。

Video: (Music)

影片：（音樂）

DM: I can speed up the whole sequence

DM：我可以加快整個編曲

by tilting the tempo one way or the other.

只要任意傾斜拍子單元的一邊。

Video: (Music)

影片：（音樂）

DM: And now I'll attach the filter to the bass for some more expression.

DM：現在我在低音樂器部份加上過濾器以強化聲調。

Video: (Music)

影片：（音樂）

DM: I can rearrange the sequence while it plays.

DM：我可以在播放途中重新排列編曲。

So I don't have to plan it out in advance, but I can improvise,

我不用預先設計好，而能夠即興創作，

making it longer or shorter as I go.

即時把它加長或減短。

And now, finally, I can fade the whole sequence out

最後，我能將整個編曲淡出

using the volume Siftable, tilted to the left.

利用音量 Siftable，把它傾斜到左邊。

(Applause)

（掌聲）

Thank you.

謝謝。

So, as you can see,

如你所見，

my passion is for making new human-computer interfaces

我熱衷於研制全新的人機界面，

that are a better match to the ways our brains and bodies work.

更有效地配合我們的大腦跟身體的運作。

And today, I had time to show you one point in this new design space,

而今天，我為大家展示了，這全新設計領域的冰山一角，

and a few of the possibilities that we're working to bring out of the laboratory.

一些我們正努力帶離實驗室，並加以推廣應用的可能。

So the thought I want to leave you with

而我希望能給大家一個想法，

is that we're on the cusp of this new generation of tools

就是我們正處於新一代

for interacting with digital media

數位媒體互動工具的尖端，

that are going to bring information into our world

它們能用我們可以理解的詞彙

on our terms.

將資訊帶到我們的世界。

Thank you very much.

非常謝謝大家。

I look forward to talking with all of you.

希望有機會再與各位談話。

(Applause)

（掌聲）