Haptography: Digitizing our sense of touch - Katherine Kuchenbecker

396,067 views ・ 2013-03-25

TED-Ed


Please double-click on the English subtitles below to play the video.

00:00
Translator: Andrea McDonough Reviewer: Morton Bast
0
0
7000
00:14
I'm a mechanical engineering professor
1
14745
1943
00:16
at the University of Pennsylvania,
2
16712
1645
00:18
and my favorite hobby is photography.
3
18381
2959
00:21
And as I travel around the world,
4
21364
1785
00:23
I love taking photographs like these,
5
23173
2152
00:25
so I can remember all the beautiful and interesting things
6
25349
2919
00:28
that I've seen.
7
28292
1278
00:29
But what I can't do is record and share
8
29594
3676
00:33
how these objects feel to touch.
9
33294
3349
00:36
And that's kind of surprising,
10
36667
1540
00:38
because your sense of touch is really important.
11
38231
2265
00:40
It's involved in every physical interaction you do every day,
12
40520
2870
00:43
every manipulation task, anything you do in the world.
13
43414
2550
00:45
So the sense of touch is actually pretty interesting.
14
45988
2507
00:48
It has two main components.
15
48519
1642
00:50
The first is tactile sensations,
16
50185
2337
00:52
things you feel in your skin.
17
52546
2090
00:54
And the second is kinesthetic sensations.
18
54660
2258
00:56
This has to do with the position of your body and how it's moving,
19
56942
3190
01:00
and the forces you encounter.
20
60156
1571
01:01
And you're really good at incorporating
21
61751
1897
01:03
both of these types of sensations together
22
63672
2206
01:05
to understand the physical interactions you have with the world
23
65902
2980
01:08
and understand as you touch a surface:
24
68906
1825
01:10
is it a rock, is it a cat, is it a bunny, what is it?
25
70755
3039
01:13
And so, as an engineer,
26
73818
2240
01:16
I'm really fascinated
27
76082
1392
01:17
and I have a lot of respect for how good people are with their hands.
28
77498
3309
01:20
And I'm intrigued and curious
29
80831
1902
01:22
about whether we could make technology better
30
82757
2411
01:25
by doing a better job at leveraging
31
85192
1698
01:26
the human capability with the sense of touch.
32
86914
2122
01:29
Could I improve the interfaces to computers and machines
33
89060
2933
01:32
by letting you take advantage of your hands?
34
92017
2573
01:34
And indeed, I think we can,
35
94614
1565
01:36
and that's at the core of a field called haptics,
36
96203
2592
01:38
and this is the area that I work in.
37
98819
1730
01:40
It's all about interactive touch technology.
38
100573
2345
01:42
And the way it works is,
39
102942
1153
01:44
as you move your body through the world,
40
104119
2505
01:46
if, as an engineer, I can make a system that can measure that motion,
41
106648
3284
01:49
and then present to you sensations over time
42
109956
2530
01:52
that kind of make sense,
43
112510
1244
01:53
that match up with what you might feel in the real world,
44
113778
2674
01:56
I can fool you into thinking you're touching something
45
116476
2544
01:59
even though there's nothing there.
46
119044
1685
02:00
So here are three examples
47
120753
1616
02:02
and these are all done from research in my lab at Penn.
48
122393
3110
02:05
The first one is all about that same problem that I was showing you:
49
125527
3257
02:08
how can we capture how objects feel
50
128808
1967
02:10
and recreate those experiences?
51
130799
1997
02:12
So the way we solve this problem
52
132820
1999
02:14
is by creating a hand-held tool
53
134843
2065
02:16
that has many different sensors inside.
54
136932
1872
02:18
It has a force sensor, so we can tell how hard you're pushing;
55
138828
3352
02:22
it has motion tracking, so we can tell exactly where you've moved it;
56
142204
3308
02:25
and it has a vibration sensor, an accelerometer, inside,
57
145536
2690
02:28
that detects the shaking back and forth of the tool
58
148250
2442
02:30
that lets you know that's a piece of canvas
59
150716
2032
02:32
and not a piece of silk or something else.
60
152772
2022
02:34
Then we take the data we record from these interactions.
61
154818
2639
02:37
Here's ten seconds of data.
62
157481
1294
02:38
You can see how the vibrations get larger and smaller,
63
158799
2885
02:41
depending on how you move.
64
161708
1476
02:43
And we make a mathematical model of those relationships
65
163208
2743
02:45
and program them into a tablet computer
66
165975
2419
02:48
so that when you take the stylus
67
168418
1564
02:50
and go and touch the screen,
68
170006
1429
02:51
that voice-coil actuator in the white bracket
69
171459
2830
02:54
plays vibrations to give you the illusion
70
174313
2267
02:56
that you're touching the real surface,
71
176604
2030
02:58
just like if you touched, dragged back and forth, on the real canvas.
72
178658
3269
03:01
We can create very compelling illusions.
73
181951
1941
03:03
We can do this for all kinds of surfaces and it's really a lot of fun.
74
183916
3570
03:07
We call it haptography -- haptic photography.
75
187510
3917
03:11
And I think it has potential benefits in all sorts of areas
76
191451
2780
03:14
like online shopping, maybe interactive museum exhibits,
77
194255
2706
03:16
where you're not supposed to touch the precious artifacts,
78
196985
2754
03:19
but you always want to.
79
199763
1376
03:21
The second example I want to tell you about comes from a collaboration I have
80
201163
3678
03:24
with Dr. Margrit Maggio at the Penn Dental School.
81
204865
2342
03:27
Part of her job is to teach dental students
82
207231
2015
03:29
how to tell where in a patient's mouth there are cavities.
83
209270
2782
03:32
Of course they look at X-rays,
84
212076
1521
03:33
but a large part of this clinical judgment comes from what they feel
85
213621
3250
03:36
when they touch your teeth with a dental explorer.
86
216895
2366
03:39
You've all had this happen, they go across.
87
219285
2008
03:41
What they're feeling for is if the tooth is really hard, then it's healthy,
88
221317
3543
03:44
but if it's kind of soft and sticky,
89
224884
1746
03:46
that's a signal that the enamel is starting to decay.
90
226654
2504
03:49
These types of judgments are hard for a new dental student to make,
91
229182
3221
03:52
because they haven't touched a lot of teeth yet.
92
232427
2258
03:54
And you want them to learn this before they start practicing
93
234709
2838
03:57
on real human patients.
94
237571
1160
03:58
So what we do is add an accelerometer on to the dental explorer,
95
238755
4286
04:03
and then we record what Dr. Maggio feels
96
243065
1933
04:05
as she touches different extracted teeth.
97
245022
2170
04:07
And we can play it back for you as a video
98
247216
2763
04:10
with a touch track --
99
250003
1653
04:11
not just a sound track, but also a touch track,
100
251680
2219
04:13
that you can feel by holding that repeating tool.
101
253923
2326
04:16
You feel the same things the dentist felt when they did the recording,
102
256273
3293
04:19
and practice making judgments.
103
259590
1441
04:21
So here's a sample one.
104
261055
1162
04:22
Here's a tooth that looks kind of suspicious, right?
105
262241
2489
04:24
It has all those brown stains.
106
264754
2524
04:27
You might be thinking, "We should definitely put a filling in this tooth."
107
267302
3483
04:30
But if you pay attention to how it feels,
108
270809
1960
04:32
all the surfaces of this tooth are hard and healthy,
109
272793
2634
04:35
so this patient does not need a filling.
110
275451
2259
04:37
And these are exactly the kind of judgments doctors make every day
111
277734
3123
04:40
and I think this technology we've invented has a lot of potential
112
280881
3072
04:43
for many different things in medical training, because it's really simple
113
283977
3451
04:47
and it does a great job at recreating what people feel through tools.
114
287452
3546
04:51
I think it could also help make games more interactive and fun
115
291022
3020
04:54
and more realistic in the sensations that you feel.
116
294066
2577
04:56
The last example I want to tell you about is again about human movement.
117
296667
3629
05:00
So if any of you have ever learned sports,
118
300320
2000
05:02
how do you get good at something like surfing?
119
302344
2263
05:04
You practice.
120
304631
1151
05:05
You practice some more and more, right?
121
305806
1862
05:07
Making small corrections, maybe getting some input from a coach,
122
307692
3069
05:10
learning how to improve your motions.
123
310785
1776
05:12
I think we could use computers
124
312585
1462
05:14
to help make that process more efficient and more fun.
125
314071
2596
05:16
And so here, for example, if I have six different arm movements
126
316691
2960
05:19
that I want you to learn,
127
319675
1196
05:20
you come into my lab at Penn and try out our system.
128
320895
3376
05:24
We use a Kinect to measure your motions, we show graphics on the screen,
129
324295
3459
05:27
and then we also give you touch cues,
130
327778
2093
05:29
haptic feedback on your arm,
131
329895
1588
05:31
delivered by these haptic arm bands which have motors inside,
132
331507
3360
05:34
and guide you as you move.
133
334891
1571
05:36
So, if we put it together,
134
336486
1266
05:37
as you're trying to track this motion,
135
337776
2325
05:40
if you deviate -- say, maybe, your arm is a little too high --
136
340125
3164
05:43
we turn on the motors right there on the skin
137
343313
2109
05:45
to let you know you should move down,
138
345446
1771
05:47
almost like a coach gently guiding you
139
347241
1862
05:49
and helping you master these movements more quickly
140
349127
2891
05:52
and make more precise corrections.
141
352042
1849
05:53
We developed this system for use in stroke rehabilitation,
142
353915
2762
05:56
but I think there are a lot of applications,
143
356701
2304
05:59
like maybe dance training or all sorts of sports training as well.
144
359029
4210
06:03
So now you know a little bit about the field of haptics,
145
363263
2716
06:06
which I think you'll hear more about in the coming years.
146
366003
2702
06:08
I've shown you three examples.
147
368729
1430
06:10
I just want to take a moment
148
370183
1351
06:11
to acknowledge the great students who work with me in my lab at Penn
149
371558
3208
06:14
and my collaborators.
150
374790
1151
06:15
They're a great group.
151
375965
1157
06:17
I also want to thank you for your kind attention.
152
377146
2898
06:20
(Applause)
153
380068
3002
About this website

This site will introduce you to YouTube videos that are useful for learning English. You will see English lessons taught by top-notch teachers from around the world. Double-click on the English subtitles displayed on each video page to play the video from there. The subtitles scroll in sync with the video playback. If you have any comments or requests, please contact us using this contact form.

https://forms.gle/WvT1wiN1qDtmnspy7