David Merrill: Toy tiles that talk to each other

168,921 views ・ 2009-02-12

TED


请双击下面的英文字幕来播放视频。

翻译人员: han congmei 校对人员: Chaoran Yu
00:12
I want to start out by asking you to think back to when you were a kid,
0
12160
2000
首先,我想请大家回忆一下你们在孩提时代
00:14
playing with blocks.
1
14160
2000
玩过的积木。
00:16
As you figured out how to reach out and grasp,
2
16160
2000
当你构思着怎么去搭建积木
00:18
pick them up and move them around,
3
18160
2000
并且去动手操作的时候,
00:20
you were actually learning how to think and solve problems
4
20160
2000
其实是你正在学习怎样思考和解决问题。
00:22
by understanding and manipulating spatial relationships.
5
22160
3000
这即是对物体的空间结构的理解和感知。
00:25
Spatial reasoning is deeply connected
6
25160
3000
理解物体的空间结构非常有助于
00:28
to how we understand a lot of the world around us.
7
28160
2000
我们对很多周围事物的学习。
00:30
So, as a computer scientist
8
30160
2000
因此,作为一个计算机领域的科学家,
00:32
inspired by this utility of our interactions with physical objects --
9
32160
3000
在这种手动思考方式的启发下,
00:35
along with my adviser Pattie, and my collaborator Jeevan Kalanithi --
10
35160
4000
以及在我的导师Pattie和我的合作伙伴Jeevan Kalanithi的帮助下,
00:39
I started to wonder -- what if when we used a computer,
11
39160
3000
我开始思考--要是我们能用一种新型计算机
00:42
instead of having this one mouse cursor that was a like a digital fingertip
12
42160
3000
来代替鼠标移动光标,就好比一种数字化的手指尖
00:45
moving around a flat desktop,
13
45160
2000
在桌面移动--那样会如何呢?
00:47
what if we could reach in with both hands and grasp information physically,
14
47160
4000
要是我们能用手来直接感知信息,
00:51
arranging it the way we wanted?
15
51160
2000
按我们的思路来组合信息--那样会如何呢?
00:53
This question was so compelling that we decided to explore the answer,
16
53160
3000
这样的疑问不断萦绕在我的脑海中,于是我们决定去探寻答案,
00:56
by building Siftables.
17
56160
2000
所以才有了这款Siftables。
00:58
In a nutshell, a Siftable is an interactive computer
18
58160
3000
简单地说,Siftable是一款互动计算机,
01:01
the size of a cookie.
19
61160
2000
体积如饼干般大小。
01:03
They're able to be moved around by hand,
20
63160
2000
Siftables可以用手随意移动,
01:05
they can sense each other, they can sense their motion,
21
65160
2000
每块Siftable可以互相感知彼此的移动,
01:07
and they have a screen and a wireless radio.
22
67160
3000
每块Siftable还有显示屏和无线电装置。
01:10
Most importantly, they're physical,
23
70160
2000
最重要的是,每块Siftable都是独立的,
01:12
so like the blocks, you can move them just by reaching out and grasping.
24
72160
3000
就像积木一样,可以随意搭配。
01:15
And Siftables are an example of a new ecosystem
25
75160
3000
而且Siftables代表了一种新的生态系统
01:18
of tools for manipulating digital information.
26
78160
2000
--即数字化信息的操作工具。
01:20
And as these tools become more physical,
27
80160
3000
这种操作工具更加独立,
01:23
more aware of their motion, aware of each other,
28
83160
2000
更加灵敏,能彼此感知,
01:25
and aware of the nuance of how we move them,
29
85160
2000
感知任何细微的移动,
01:27
we can start to explore some new and fun interaction styles.
30
87160
3000
所以我们可以使用这种工具尝试一些新的有趣的互动。
01:30
So, I'm going to start with some simple examples.
31
90160
2000
现在,我就来演示一些简单的。
01:32
This Siftable is configured to show video,
32
92160
3000
这块Siftable有映像配置,
01:35
and if I tilt it in one direction, it'll roll the video this way;
33
95160
2000
如果我把它向一侧倾斜,那么它所显示的画面也朝这边倾斜,
01:37
if I tilt it the other way it rolls it backwards.
34
97160
3000
如果我把它朝反方向倾斜,那么图像也朝反方向倾斜。
01:40
And these interactive portraits are aware of each other.
35
100160
3000
而且这些Siftables能互相感知。
01:43
So if I put them next to each other, they get interested.
36
103160
3000
如果把它们一个挨一个摆好,有趣的现象就会发生。
01:46
If they get surrounded, they notice that too,
37
106160
4000
如果把它们随意一堆,他们也会察觉到,
01:50
they might get a little flustered.
38
110160
2000
那就会有点儿混乱。
01:52
And they can also sense their motion and tilt.
39
112160
4000
它们还能感知彼此的移动和倾斜。
01:56
One of the interesting implications on interaction, we started to realize,
40
116160
5000
我们发现一个有趣的互动--
02:01
was that we could use everyday gestures on data,
41
121160
2000
我们可以通过一些常用的手势和Siftables进行互动,
02:03
like pouring a color the way we might pour a liquid.
42
123160
3000
比如象倒液体那样把颜色从一块Siftable倒入另一块Siftable.
02:06
So in this case, we've got three Siftables configured to be paint buckets
43
126160
4000
我们来看这个演示,这有三块设置成油漆桶模式的Siftables,
02:10
and I can use them to pour color into that central one,
44
130160
3000
我们可以把这些桶里的颜色倒入中间的那个,
02:13
where they get mixed.
45
133160
2000
把颜色混在一起.
02:15
If we overshoot, we can pour a little bit back.
46
135160
3000
如果倒多了,可以再倒回去一些。
02:19
There are also some neat possibilities for education,
47
139160
3000
Siftables还有学习机的功能,
02:22
like language, math and logic games
48
142160
2000
可以用来学语言、算算术等--
02:24
where we want to give people the ability to try things quickly,
49
144160
2000
我们希望通过这些功能让学习变得快捷,
02:26
and view the results immediately.
50
146160
3000
更快看到结果。
02:29
So here I'm --
51
149160
2000
这也是我来这里展示Siftables的原因--
02:31
(Applause)
52
151160
2000
(掌声)
02:33
This is a Fibonacci sequence that I'm making with a simple equation program.
53
153160
4000
这是我用一个简单方程式做成的斐波那契数列。
02:37
Here we have a word game that's kind of like a mash-up between Scrabble and Boggle.
54
157160
4000
Siftables还可以玩拼字游戏--一种Scrabble和Boggle混搭的拼字游戏。
02:41
Basically, in every round
55
161160
2000
这种拼字游戏的玩法大致如下,
02:43
you get a randomly assigned letter on each Siftable,
56
163160
2000
你随意拿一块带有字母的Siftable,
02:45
and as you try to make words it checks against a dictionary.
57
165160
3000
当你把几块带有字母的Siftables拼在一起组成单词时,Siftables会在字典里自动查找单词。
02:48
Then, after about 30 seconds, it reshuffles,
58
168160
3000
大约30秒后Siftables会自动根据正确的单词拼写顺序改变原来显示的字母,组成正确的单词,
02:51
and you have a new set of letters and new possibilities to try.
59
171160
3000
你还可以尝试用其他的字母拼出新的单词。
02:54
(Applause)
60
174160
1000
(掌声)
02:55
Thank you.
61
175160
1000
谢谢大家。
02:56
(Applause)
62
176160
2000
(掌声)
02:58
So these are some kids that came on a field trip to the Media Lab,
63
178160
2000
现在,屏幕上显示的是一些孩子正在Media Lab 里参与Siftables的试用体验,
03:00
and I managed to get them to try it out, and shoot a video.
64
180160
3000
我把孩子们的体验过程拍了下来。
03:10
They really loved it.
65
190160
2000
孩子们非常喜欢Siftables。
03:12
And, one of the interesting things about this kind of application
66
192160
3000
而且有趣的是在玩这个拼字游戏的时候
03:15
is that you don't have to give people many instructions.
67
195160
3000
我们并不需要向他们解释什么。
03:18
All you have to say is, "Make words,"
68
198160
2000
只要跟他们说这是个“拼字”游戏时,
03:20
and they know exactly what to do.
69
200160
2000
他们就知道该怎么做了。
03:22
So here's another few people trying it out.
70
202160
2000
现在屏幕上显示的是另一些人在体验Siftables。
03:31
That's our youngest beta tester, down there on the right.
71
211160
3000
右下角这位是年龄最小的体验者。
03:36
Turns out, all he wanted to do was to stack the Siftables up.
72
216160
5000
他只是想把Siftables堆在一起。
03:42
So to him, they were just blocks.
73
222160
3000
在他看来,Siftables只是积木。
03:46
Now, this is an interactive cartoon application.
74
226160
3000
现在屏幕上显示的是一种动画功能的互动尝试。
03:49
And we wanted to build a learning tool for language learners.
75
229160
5000
我们希望Siftables能成为学习语言的帮手。
03:54
And this is Felix, actually.
76
234160
2000
画面上的这个孩子叫Felix。
03:57
And he can bring new characters into the scene,
77
237160
2000
他能把一些新元素添加到动画图像上,
03:59
just by lifting the Siftables off the table that have that character shown on them.
78
239160
4000
他所做的就是把桌上的Siftables拿起来朝着动画图像投一下影,就可以把这些新元素加到动画上了。
04:03
Here, he's bringing the sun out.
79
243160
3000
看,他把太阳加上去了。
04:07
Video: The sun is rising.
80
247160
2000
视频:太阳升起来了。
04:09
David Merrill: Now he's brought a tractor into the scene.
81
249160
3000
大卫·梅若:现在他把拖拉机加上去了。
04:13
Video: The orange tractor.
82
253160
2000
视频:橙色的拖拉机。
04:15
Good job! Yeah!
83
255160
2000
做的不错!
04:18
DM: So by shaking the Siftables and putting them next to each other
84
258160
3000
把Siftables朝动画图像晃一下就可以把新元素加到画面上
04:21
he can make the characters interact --
85
261160
2000
他把新元素加上去了--
04:23
Video: Woof!
86
263160
1000
视频:狗吠声
04:24
DM: inventing his own narrative.
87
264160
2000
梅若:他在编写属于他的动画故事。
04:26
Video: Hello!
88
266160
1000
视频:你好!
04:27
DM: It's an open-ended story,
89
267160
2000
梅若:这是个开放式结局的故事,
04:29
and he gets to decide how it unfolds.
90
269160
2000
他在计划怎样展开故事情节。.
04:34
Video: Fly away, cat.
91
274160
2000
视频:猫坐着热气球飞走了。
04:42
DM: So, the last example I have time to show you today
92
282160
3000
梅若:下面我要给大家进行最后一个展示
04:45
is a music sequencing and live performance tool
93
285160
2000
这个功能可以编排、演奏音乐
04:47
that we've built recently,
94
287160
2000
是我们最近研发的,
04:49
in which Siftables act as sounds
95
289160
3000
Siftables的这种功能体现在声音方面,
04:52
like lead, bass and drums.
96
292160
2000
能发出像超载音、贝斯及鼓的声音。
04:54
Each of these has four different variations,
97
294160
2000
每个模块有四档可供调节,
04:56
you get to choose which one you want to use.
98
296160
2000
任君选择。
04:58
And you can inject these sounds into a sequence
99
298160
3000
你可以把声音模块的Siftable里的声音加入编辑模块的Siftable
05:01
that you can assemble into the pattern that you want.
100
301160
3000
按你喜欢的方式。
05:04
And you inject it by just bumping up the sound Siftable against a sequence Siftable.
101
304160
4000
加入声音只需把声音模块靠近编辑模块。
05:08
There are effects that you can control live, like reverb and filter.
102
308160
4000
还有类似混响器、滤声器作用的Siftable模块。
05:12
You attach it to a particular sound and then tilt to adjust it.
103
312160
3000
把这类模块靠近声音模块就可以调整声音了。
05:15
And then, overall effects like tempo and volume
104
315160
3000
接下来,可以用控制总体节奏和音量的Siftable模块
05:18
that apply to the entire sequence.
105
318160
2000
靠近编辑模块的Siftable来调整节奏和音量。
05:20
So let's have a look.
106
320160
2000
我们来看一下。
05:22
Video: (Music)
107
322160
2000
视频:(音乐)
05:24
DM: We'll start by putting a lead
108
324160
2000
梅若:开始先把超载音
05:26
into two sequence Siftables, arrange them into a series,
109
326160
5000
注入两个编辑模块,
05:31
extend it, add a little more lead.
110
331160
2000
再加一些超载音。
05:34
Now I put a bass line in.
111
334160
2000
现在加入贝斯音。
05:36
Video: (Music)
112
336160
5000
视频:(音乐)
05:41
DM: Now I'll put some percussion in.
113
341160
2000
梅若:现在加入一些打击乐器的声音。
05:43
Video: (Music)
114
343160
5000
视频:(音乐)
05:48
DM: And now I'll attach the filter to the drums, so I can control the effect live.
115
348160
3000
梅若:现在把滤声模块靠近鼓声模块,这样可以调整声音。
05:51
Video: (Music)
116
351160
2000
视频:(音乐)
05:53
DM: I can speed up the whole sequence
117
353160
2000
梅若:我来把节奏加快些
05:55
by tilting the tempo one way or the other.
118
355160
3000
只需把节奏模块靠近编辑模块。
05:58
Video: (Music)
119
358160
2000
视频:(音乐)
06:00
DM: And now I'll attach the filter to the bass for some more expression.
120
360160
3000
梅若:现在再把滤声模块靠近贝斯模块滤声。
06:03
Video: (Music)
121
363160
5000
视频:(音乐)
06:08
DM: I can rearrange the sequence while it plays.
122
368160
3000
梅若:在音乐演奏的过程中还可以重新编排。
06:11
So I don't have to plan it out in advance, but I can improvise,
123
371160
2000
所以并不需要提前编排,而是在演奏时随时改编,
06:13
making it longer or shorter as I go.
124
373160
2000
可长可短。
06:16
And now, finally, I can fade the whole sequence out
125
376160
3000
最后,我来结束整个演奏,
06:19
using the volume Siftable, tilted to the left.
126
379160
3000
用音量模块靠近编辑模块,用左边这个档。
06:22
(Applause)
127
382160
5000
(掌声)
06:27
Thank you.
128
387160
2000
谢谢大家。
06:29
So, as you can see,
129
389160
3000
正如大家看到的,
06:32
my passion is for making new human-computer interfaces
130
392160
3000
我的理想就是研发一款新型的能够人机互动的媒介
06:35
that are a better match to the ways our brains and bodies work.
131
395160
3000
更好地配合人体大脑的运作。
06:38
And today, I had time to show you one point in this new design space,
132
398160
4000
今天,我在这给大家展示了Siftable,
06:42
and a few of the possibilities that we're working to bring out of the laboratory.
133
402160
3000
我们的后续研究正在实验室中进行。
06:45
So the thought I want to leave you with
134
405160
2000
我想跟大家交流的想法就是
06:47
is that we're on the cusp of this new generation of tools
135
407160
3000
我们在研发新一代尖端科技产品
06:50
for interacting with digital media
136
410160
3000
--可以和数字媒体接轨的科技产品,
06:53
that are going to bring information into our world
137
413160
3000
它将给世界带来变化
06:56
on our terms.
138
416160
2000
这样的革新在我们这一代就会看到。
06:58
Thank you very much.
139
418160
1000
非常感谢大家。
06:59
I look forward to talking with all of you.
140
419160
2000
我期待着和大家共同探讨。
07:01
(Applause)
141
421160
2000
(掌声)
关于本网站

这个网站将向你介绍对学习英语有用的YouTube视频。你将看到来自世界各地的一流教师教授的英语课程。双击每个视频页面上显示的英文字幕,即可从那里播放视频。字幕会随着视频的播放而同步滚动。如果你有任何意见或要求,请使用此联系表与我们联系。

https://forms.gle/WvT1wiN1qDtmnspy7