Unveiling the genius of multi-touch interface design | Jeff Han

翻译人员: Wang Qian 校对人员: dayu Vong

I'm really excited to be here today.

今天能来到这里我非常非常激动，

I'll show you some stuff that's just ready to come out of the lab,

因为我会马上给大家展示一些刚从实验室新鲜出炉的成果，

literally, and I'm really glad that you guys

毫不夸张，而且我非常高兴你们能第一时间

are going to be among the first to see it in person,

亲眼看到它，因为我真的，真的认为这将改变

because I really think this is going to really change

－真的改变－从此以后我们与机器互动的方式。

the way we interact with machines from this point on.

Now, this is a rear-projected drafting table.

现在注意，这是一张从背面投影的工作台。它大约36英尺宽，

It's about 36 inches wide

and it's equipped with a multi-touch sensor.

配备有一个多点触摸感应器。现在注意，一般你们看到的触摸感应器，

Normal touch sensors that you see,

好比在自动终端机或交互白板上，

like on a kiosk or interactive whiteboards,

can only register one point of contact at a time.

只能一次注册一个接触点。

This thing allows you to have multiple points at the same time.

而这个东西可以让你同时有多个接触点。

They can use both my hands; I can use chording actions;

它们能感应到我的双手，我可以做拨弦的动作，

I can just go right up and use all 10 fingers if I wanted to.

如果我想的话我可以就这样用十指。

You know, like that.

像这样。

Now, multi-touch sensing isn't completely new.

多点触摸感应不是一项完全新的技术。

People like Bill Buxton have been playing around with it in the '80s.

像Bill Buxton一些人在80年代就已经小试一把。

However, the approach I built here is actually high-resolution,

但是，我的方法事实上是高分辨率，

low-cost, and probably most importantly, very scalable.

低成本，而且可能最重要的，扩展性非常强。

So, the technology, you know,

所以，你知道，这项技术不是最激动人心的，

isn't the most exciting thing here right now,

other than probably its newfound accessibility.

可能除了它的新发现的易接近性。

What's really interesting here is what you can do with it

这里真正有意思的是你能借助它做什么，

and the kind of interfaces you can build on top of it.

和基于它你能建造的那种界面。所以我们来看看。

So let's see.

So, for instance, we have a lava lamp application here.

比如，我们有一个熔岩灯程序在这里。现在，你能看见，

Now, you can see,

I can use both of my hands to kind of squeeze and put the blobs together.

我能用我的两只手去挤，让泡泡合到一起。

I can inject heat into the system here,

我能向这个系统注入热量，

or I can pull it apart with two of my fingers.

或者我能用两个手指把它分开。

It's completely intuitive; there's no instruction manual.

它非常的直观；不需要操作指南。

操作界面就好像消失了一样。

The interface just kind of disappears.

This started out as a screensaver app

这个起初是作为屏幕保护程序的，它由实验室里的博士生之一，

that one of the Ph.D. students in our lab, Ilya Rosenberg, made.

Ilya Rosenberg做的。但是我觉得它的特性在这里表现得很鲜明。

But I think its true identity comes out here.

Now what's great about a multi-touch sensor is that, you know,

一个多点触摸感应器的优势就在于，你知道，

I could be doing this with as many fingers here,

我可以随便用多少个手指，

but of course multi-touch also inherently means multi-user.

但是当然多点触摸也自然意味着多用户。

Chris could be interacting with another part of Lava,

所以Chris可以在这儿摆弄熔岩灯的另一部分，

while I play around with it here.

同时我也在这边玩。 你可以想象一种新的制作雕塑的工具，

You can imagine a new kind of sculpting tool,

where I'm kind of warming something up, making it malleable,

好像我可以把什么东西预热起来，让它有韧性了，

and then letting it cool down and solidifying in a certain state.

然后把它冷却下来，固定成一定形态。

Google should have something like this in their lobby.

Google应该有像这样的东西在他们的大厅里。（笑声）

(Laughter)

I'll show you a little more of a concrete example here,

我再给你们看个东西--在它载入同时，我会举一个更具体的小例子

as this thing loads.

This is a photographer's light-box application.

这是一个给摄影师的看片的程序。

Again, I can use both of my hands to interact and move photos around.

再一次，我可以用我双手和照片交互，把照片挪来挪去去。

But what's even cooler is that if I have two fingers,

但是更神奇的是如果我用两个手指，

I can actually grab a photo and then stretch it out like that really easily.

我可以抓住一张照片并且像这样非常容易地把它放大。

I can pan, zoom and rotate it effortlessly.

我可以毫不费力地移动，伸缩并且转动。

I can do that grossly with both of my hands,

我可以用我的两只手一起地这样做，

or I can do it just with two fingers on each of my hands together.

或者我可以只用两个手指，每只手分别一个。

If I grab the canvas, I can do the same thing -- stretch it out.

如果我抓住画布，我可以同样地把它放大。

I can do it simultaneously, holding this down,

我可以同时按住这个，

and gripping on another one, stretching this out.

而且握住另一个，把这个放大像这样。

Again, the interface just disappears here.

再一次，界面在这里不存在了。

There's no manual.

没有使用说明。这完全是你期望的，

This is exactly what you expect,

especially if you haven't interacted with a computer before.

尤其是如果你从前没有操作过计算机。

Now, when you have initiatives like the $100 laptop,

现在，要是你有初级的设备，比如100美元的笔记本电脑

I kind of cringe at the idea

要向大家介绍全新的与以往传统鼠标--窗口操作界面不同的概念，

of introducing a whole new generation to computing

我挺紧张的

with this standard mouse-and-windows-pointer interface.

This is something that I think is really the way

我认为这将真正是我们与计算机交互的方式

we should be interacting with machines from now on.

从今以后。（鼓掌）

(Applause)

Now, of course, I can bring up a keyboard.

当然，我可以打开一个键盘。

(Laughter)

And I can bring that around, put that up there.

而且我能随意摆放，放在上面这儿。

Obviously, this is a standard keyboard,

很明显，这是一个标准键盘，

but of course I can rescale it to make it work well for my hands.

但是当然我能缩放它以适合我手的大小。

That's really important, because there's no reason in this day and age

这很重要，因为在当今这个时代没有理由

that we should be conforming to a physical device.

我们应当屈就一个设备。

That leads to bad things, like RSI.

那会导致不好的事情，比如肢体劳损。

We have so much technology nowadays

我们如今有太多科技而

that these interfaces should start conforming to us.

这些设备应当开始顺应我们。

There's so little applied now to actually improving

从这一时刻起运用到改善人机互动

the way we interact with interfaces from this point on.

少之又少

This keyboard is probably actually the really wrong direction to go.

键盘也许不是个好法子

You can imagine, in the future, as we develop this kind of technology,

试想未来随着科技进步

a keyboard that kind of automatically drifts as your hand moves away,

会有一种跟着你的手移动

and really intelligently anticipates which key you're trying to stroke.

并能预测你输入的键盘

So -- again, isn't this great?

很棒吧？

(Laughter)

观众：你的实验室在哪儿？

Audience: Where's your lab?

Jeff Han: I'm a research scientist at NYU in New York.

Jeff Han：我是纽约大学的研究员

Here's an example of another kind of app. I can make these little fuzz balls.

接下来的是另一种应用程序。我能整出些绒毛球

It'll remember the strokes I'm making.

这些球会记住我的抚摸动作。当然了，我能用双手来做

Of course I can do it with all my hands.

It's pressure-sensitive.

正如你们看到的，这是压力感应的

What's neat about that is,

绝妙的地方是，我已经展示过两指

I showed that two-finger gesture that zooms in really quickly.

迅速放大的功能。因为你不必用现实生活中的工具

Because you don't have to switch to a hand tool

or the magnifying glass tool,

或放大镜什么的

你能同时让物体连续成倍放大

you can just continuously make things

in real multiple scales, all at the same time.

I can create big things out here,

我能弄出点大东西，但也可以后退再后退

but I can go back and really quickly go back

to where I started, and make even smaller things here.

直到起点，在做出些小不点儿

This is going to be really important

运用到数据可视化领域，这一发明可是非常重要的

as we start getting to things like data visualization.

比如，Hans Rosling的演讲大家都很喜欢

For instance, I think we all enjoyed Hans Rosling's talk,

and he really emphasized the fact I've been thinking about for a long time:

他着重讲的内容我也思考过很久

We have all this great data,

我们有庞大的数据，但却被闲置

but for some reason, it's just sitting there.

We're not accessing it.

我们真没怎么用这些数据。我想愿意有一点

And one of the reasons why I think that is

will be helped by things like graphics and visualization and inference tools,

因为有图像、可视化界面工具

but I also think a big part of it

但更重要的是我们会有更好的界面

is going to be having better interfaces,

to be able to drill down into this kind of data,

能够钻研深 入像这样的数据，但同时仍能保持对整体的宏观性

while still thinking about the big picture here.

Let me show you another app here. This is called WorldWind.

现在，让我 向你们展示另一个应用程序。这个程序叫做"世界风"

It's done by NASA.

是NASA研发的。它就像我们都见过的谷歌地球

We've all seen Google Earth;

this is an open-source version of that.

这就好像是 它的开源码版本。有附加档能够加载

There are plug-ins to be able to load in different data sets

NASA多年搜集的各种资料

that NASA's collected over the years.

As you can see, I can use the same two-fingered gestures

但是，如你 所见，我可以使用同样的两指手势

非常迅速的 下潜、进入地球。又一次的，我们看不到操控界面的存在

to go down and go in really seamlessly.

There's no interface, again.

It really allows anybody to kind of go in --

这真的能让 所有人，感觉非常地融入那个环境，而且操作就如同你所预期一般

and it just does what you'd expect, you know?

再一次，在这边你看不到操作接口。接口就这样消失了

Again, there's just no interface here. The interface just disappears.

I can switch to different data views.

我可以切换 到不同的数据浏览。这就是这个应用程序绝妙的地方。

That's what's neat about this app here.

NASA's really cool.

就像这样。NASA非常的酷。它们有这些超光谱影像

These hyper-spectral images are false-colored so you can --

这些影像是 人工成色的，对于决定植物的繁茂程度非常有帮助。让我们回到刚刚那里

it's really good for determining vegetative use.

Well, let's go back to this.

地图软件了不起的地方是，

The great thing about mapping applications --

它不只是二维平面，它也可以是三维立体影像。所以再一次，应用多点触控界面，

it's not really 2D, it's 3D.

So, again, with a multi-point interface, you can do a gesture like this --

你可以使用 像这样的手势，所以你可以使画面像这样倾斜，

so you can be able to tilt around like that --

(Surprised laughter)

你知道。不 只是受限于简单的二维平面攀移与移动。

It's not just simply relegated to a kind of 2D panning and motion.

This gesture is just putting two fingers down --

我们已经研 发出了这些手势，像这样，只要放入你的两跟手指，

it's defining an axis of tilt -- and I can tilt up and down that way.

它界定了倾 斜的轴线，如此这般我就可以向上或向下任意倾斜。

We just came up with that on the spot,

这是我们在 这边，刚刚想出来的点子，

it's probably not the right thing to do,

也许这不是这样做最好的方法，

but there's such interesting things you can do with this interface.

但是使用这 种接口，你可以做许多很有趣的事情。

It's just so much fun playing around with it, too.

就算你什么 都不做，只是玩玩，也会感觉愉快。（笑声）

(Laughter)

And so the last thing I want to show you is --

最后 一件我想要向你们展示的东西是，

I'm sure we can all think of a lot of entertainment apps

我 确信我们都可以想到很多，你可以利用这个东西所做的

that you can do with this thing.

娱乐方面的 应用

I'm more interested in the creative applications we can do with this.

我对于我们 可以利用这东西，所做的创意性应用更感兴趣

Now, here's a simple application here -- I can draw out a curve.

现在，这边 有一个简单的程序，我可以画曲线。

And when I close it, it becomes a character.

当我将曲线 封闭起来的时候，它就变成一个人偶。

But the neat thing about it is I can add control points.

但是有趣的 事情是，我可以增加控制点。

And then what I can do is manipulate them with both of my fingers at the same time.

然后我可以 用我双手的手指同时操控它们。

And you notice what it does.

你会注意到 它是怎么做的。

It's kind of a puppeteering thing,

这就像是操 控木偶一般，这边我可以使用

where I can use as many fingers as I have to draw and make --

我的十根手指去画出并做出玩偶。

Now, there's a lot of actual math going on under here

事实上，在 这表象之下需要很多数学运算，

for this to control this mesh and do the right thing.

然后它才能 控制这些图案，并正确的反应。

This technique of being able to manipulate a mesh here, with multiple control points,

我的意思 是，在这边这个能够操控图案的技术，

并使用多个 操控点，事实上是属于一种尖端科技

is actually state of the art.

It was released at SIGGRAPH last year.

这个技术去 年才在计算器图形学会议上公开，

It's a great example of the kind of research I really love:

但这是我热爱的研究领域的最好范例。

所有这些需 要使事情做正确，背后的计算机运算。

all this compute power to make things do the right things,

intuitive things, to do exactly what you expect.

直觉性的事 情。做如你所预期一模一样的事。

So, multi-touch interaction research is a very active field right now in HCI.

多点触控互 动研究，现在在人机界面领域非常地活跃。

I'm not the only one doing it, a lot of other people are getting into it.

我不是唯一 一个在做这方面研究的，还有很多其它的人也在这领域钻研

This kind of technology is going to let even more people get into it,

而这种技 术，将会让更多人加入这个领域的研究，

I'm looking forward to interacting with all of you over the next few days

我真的非常 期待，跟在场各位接下来几天的互动

看看这技 术，将能如何应用在你们所处的领域

and seeing how it can apply to your respective fields.

谢谢。

Thank you.

(鼓掌)

(Applause)