The birth of virtual reality as an art form | Chris Milk

120,716 views ・ 2016-07-11

TED


Please double-click on the English subtitles below to play the video.

00:14
When I was a kid,
0
14134
1159
00:15
I experienced something so powerful,
1
15317
2508
00:17
I spent the rest of my life searching for it,
2
17849
3074
00:20
and in all the wrong places.
3
20947
1512
00:23
What I experienced wasn't virtual reality.
4
23327
2593
00:26
It was music.
5
26633
1183
00:28
And this is where the story begins.
6
28251
2296
00:31
That's me,
7
31797
1370
00:33
listening to the Beatles' "White Album."
8
33191
1946
00:35
And the look on my face is the feeling
9
35161
3168
00:38
that I've been searching for ever since.
10
38353
2746
00:41
Music goes straight to the emotional vein,
11
41938
2586
00:44
into your bloodstream
12
44548
1606
00:46
and right into your heart.
13
46178
1331
00:48
It deepens every experience.
14
48157
2521
00:51
Fellas?
15
51717
1166
00:53
(Music)
16
53454
4218
00:59
This is the amazing McKenzie Stubbert
17
59472
2152
01:01
and Joshua Roman.
18
61648
1879
01:03
Music --
19
63551
1163
01:04
(Applause)
20
64738
1194
01:05
Yeah.
21
65956
1158
01:08
Music makes everything have more emotional resonance.
22
68630
3825
01:13
Let's see how it does for this talk.
23
73229
1929
01:15
The right piece of music at the right time fuses with us
24
75825
3744
01:19
on a cellular level.
25
79593
1325
01:21
When I hear that one song
26
81382
2280
01:24
from that one summer
27
84502
1303
01:26
with that one girl,
28
86488
1177
01:28
I'm instantly transported back there again.
29
88480
2021
01:31
Hey, Stacey.
30
91963
1167
01:34
Here's a part of the story, though, where I got a little greedy.
31
94908
3278
01:38
I thought if I added more layers on top of the music,
32
98210
3598
01:42
I could make the feelings even more powerful.
33
102394
3252
01:45
So I got into directing music videos.
34
105670
2834
01:49
This is what they looked like.
35
109432
1474
01:54
That's my brother, Jeff.
36
114429
1243
01:56
Sorry about this, Jeff.
37
116799
1322
01:58
(Laughter)
38
118145
1087
01:59
Here's me, just so we're even.
39
119256
1947
02:02
Incredible moves.
40
122682
1203
02:04
Should've been a dancer.
41
124444
1341
02:05
(Laughter)
42
125809
1122
02:06
These experiments grew,
43
126955
1312
02:08
and in time, started to look more like this.
44
128291
2784
02:13
In both, I'm searching for the same thing, though,
45
133852
2640
02:16
to capture that lightning in a bottle.
46
136516
2659
02:20
Except, I'm not.
47
140192
1673
02:21
Adding moving pictures over the music added narrative dimension, yes,
48
141889
3559
02:26
but never quite equated the power
49
146261
2524
02:28
that just raw music had for me on its own.
50
148809
2744
02:32
This is not a great thing to realize when you've devoted your life
51
152795
3154
02:35
and professional career to becoming a music video director.
52
155973
2839
02:38
I kept asking myself, did I take the wrong path?
53
158836
2301
02:42
So I started thinking: if I could involve you, the audience, more,
54
162353
3851
02:46
I might be able to make you feel something more as well.
55
166228
3002
02:49
So Aaron Koblin and I began auditioning new technologies
56
169901
3185
02:53
that could put more of you inside of the work,
57
173110
3138
02:56
like your childhood home in "The Wilderness Downtown,"
58
176272
3634
03:00
your hand-drawn portraits, in "The Johnny Cash Project,"
59
180750
3760
03:05
and your interactive dreams
60
185581
1400
03:07
in "3 Dreams of Black."
61
187791
1697
03:11
We were pushing beyond the screen,
62
191469
1957
03:13
trying to connect more deeply
63
193450
1981
03:15
to people's hearts and imaginations.
64
195455
2377
03:18
But it wasn't quite enough.
65
198745
1346
03:21
It still didn't have the raw experiential power of pure music for me.
66
201258
4799
03:27
So I started chasing a new technology
67
207443
2061
03:29
that I only had read about in science fiction.
68
209528
2699
03:32
And after years of searching, I found a prototype.
69
212826
2409
03:35
It was a project from Nonny de la PeΓ±a in Mark Bolas's lab in USC.
70
215871
4224
03:41
And when I tried it, I knew I'd found it.
71
221102
3068
03:45
I could taste the lightning.
72
225095
1492
03:47
It was called virtual reality.
73
227334
1650
03:50
This was it five years ago when I ran into it.
74
230047
2256
03:53
This is what it looks like now.
75
233530
2062
03:56
I quickly started building things in this new medium,
76
236846
3905
04:00
and through that process we realized something:
77
240775
2217
04:03
that VR is going to play an incredibly important role
78
243664
3417
04:07
in the history of mediums.
79
247105
1715
04:09
In fact, it's going to be the last one.
80
249681
2717
04:13
I mean this because it's the first medium that actually makes the jump
81
253390
3615
04:17
from our internalization of an author's expression
82
257029
3288
04:20
of an experience,
83
260341
1670
04:22
to our experiencing it firsthand.
84
262035
2652
04:25
You look confused. I'll explain. Don't worry.
85
265691
2164
04:27
(Laughter)
86
267879
1394
04:29
If we go back to the origins of mediums,
87
269830
3190
04:33
by all best guesses,
88
273044
1364
04:34
it starts around a fire, with a good story.
89
274432
2966
04:37
Our clan leader is telling us
90
277986
1465
04:39
about how he hunted the woolly mammoth on the tundra that day.
91
279475
3629
04:44
We hear his words
92
284069
1339
04:46
and translate them into our own internal truths.
93
286090
3273
04:50
The same thing happens
94
290839
1165
04:52
when we look at the cave painting version of the story,
95
292028
2642
04:56
the book about the mammoth hunt,
96
296241
1583
04:58
the play,
97
298472
1234
05:00
the radio broadcast,
98
300109
1186
05:01
the television show
99
301749
1165
05:03
or the movie.
100
303582
1155
05:05
All of these mediums require what we call "suspension of disbelief,"
101
305532
3732
05:09
because there's a translation gap between the reality of the story
102
309288
4058
05:13
and our consciousness interpreting the story
103
313370
3422
05:16
into our reality.
104
316816
1268
05:19
I'm using the word "consciousness" as a feeling of reality that we get
105
319081
4076
05:23
from our senses experiencing the world around us.
106
323181
3336
05:28
Virtual reality bridges that gap.
107
328580
2797
05:31
Now, you are on the tundra hunting with the clan leader.
108
331985
4213
05:36
Or you are the clan leader.
109
336222
2354
05:38
Or maybe you're even the woolly mammoth.
110
338600
2702
05:41
(Laughter)
111
341326
1635
05:46
So here's what special about VR.
112
346218
1612
05:48
In all other mediums,
113
348726
1579
05:50
your consciousness interprets the medium.
114
350329
2270
05:53
In VR, your consciousness is the medium.
115
353044
4170
05:58
So the potential for VR is enormous.
116
358399
2434
06:00
But where are we now?
117
360857
1674
06:02
What is the current state of the art?
118
362555
2586
06:06
Well,
119
366318
1150
06:08
we are here.
120
368746
1189
06:10
We are the equivalent of year one of cinema.
121
370724
3148
06:13
This is the Lumière Brothers film
122
373896
1626
06:15
that allegedly sent a theater full of people running for their lives
123
375546
3359
06:18
as they thought a train was coming toward them.
124
378929
2293
06:22
Similar to this early stage of this medium,
125
382136
3276
06:25
in VR, we also have to move past the spectacle
126
385436
3541
06:29
and into the storytelling.
127
389001
1886
06:30
It took this medium decades
128
390911
1747
06:32
to figure out its preferred language of storytelling,
129
392682
2658
06:35
in the form of a feature film.
130
395364
1776
06:37
In VR today, we're more learning grammar
131
397164
3354
06:40
than writing language.
132
400542
1291
06:42
We've made 15 films in the last year at our VR company, Vrse,
133
402880
3551
06:46
and we've learned a few things.
134
406455
1617
06:48
We found that we have a unique, direct path into your senses,
135
408801
3315
06:52
your emotions, even your body.
136
412140
2809
06:55
So let me show you some things.
137
415897
1675
06:57
For the purpose of this demo,
138
417596
1398
06:59
we're going to take every direction that you could possibly look,
139
419018
3065
07:02
and stretch it into this giant rectangle.
140
422107
2213
07:05
OK, here we go.
141
425083
1950
07:09
So, first: camera movement is tricky in VR.
142
429642
4281
07:13
Done wrong, it can actually make you sick.
143
433947
2102
07:16
We found if you move the camera at a constant speed in a straight line,
144
436930
4499
07:21
you can actually get away with it, though.
145
441453
2217
07:23
The first day in film school,
146
443694
1727
07:25
they told me you have to learn every single rule
147
445445
2587
07:28
before you can break one.
148
448056
1758
07:29
We have not learned every single rule.
149
449838
2174
07:32
We've barely learned any at all,
150
452036
1528
07:33
but we're already trying to break them
151
453588
1817
07:35
to see what kind of creative things we can accomplish.
152
455429
2529
07:37
In this shot here, where we're moving up off the ground, I added acceleration.
153
457982
3712
07:41
I did that because I wanted to give you a physical sensation
154
461718
2833
07:44
of moving up off the ground.
155
464575
1383
07:45
In VR, I can give that to you.
156
465982
2493
07:49
(Music)
157
469797
4074
07:55
Not surprisingly, music matters a lot in this medium as well.
158
475882
3547
07:59
It guides us how to feel.
159
479842
1874
08:02
In this project we made with the New York Times, Zach Richter
160
482354
3321
08:05
and our friend, JR,
161
485699
1755
08:07
we take you up in a helicopter,
162
487478
1885
08:09
and even though you're flying 2,000 feet above Manhattan,
163
489387
3938
08:13
you don't feel afraid.
164
493349
1588
08:14
You feel triumphant for JR's character.
165
494961
2908
08:19
The music guides you there.
166
499022
1479
08:20
(Music)
167
500525
2000
08:29
Contrary to popular belief,
168
509364
1607
08:30
there is composition in virtual reality,
169
510995
2666
08:33
but it's completely different than in film,
170
513685
2061
08:35
where you have a rectangular frame.
171
515770
1725
08:37
Composition is now where your consciousness exists
172
517519
2512
08:40
and how the world moves around you.
173
520055
1947
08:42
In this film, "Waves of Grace," which was a collaboration between Vrse,
174
522927
3364
08:46
the United Nations, Gabo Arora, and Imraan Ismail,
175
526315
2909
08:49
we also see the changing role of the close-up in virtual reality.
176
529248
3242
08:53
A close-up in VR means you're actually close up to someone.
177
533139
4213
08:57
It brings that character inside of your personal space,
178
537954
2643
09:00
a space that we'd usually reserve for the people that we love.
179
540621
3845
09:04
And you feel an emotional closeness to the character
180
544490
3170
09:07
because of what you feel to be a physical closeness.
181
547684
2708
09:16
Directing VR is not like directing for the rectangle.
182
556639
4339
09:21
It's more of a choreography of the viewer's attention.
183
561002
3084
09:24
One tool we can use to guide your attention
184
564864
2594
09:27
is called "spatialized sound."
185
567482
1433
09:28
I can put a sound anywhere in front of you, to left or right,
186
568939
2968
09:31
even behind you,
187
571931
1379
09:33
and when you turn your head, the sound will rotate accordingly.
188
573334
2996
09:36
So I can use that to direct your attention to where I want you to see.
189
576354
3502
09:40
Next time you hear someone singing over your shoulder,
190
580308
2578
09:42
it might be Bono.
191
582910
1261
09:44
(Laughter)
192
584195
1207
09:50
VR makes us feel like we are part of something.
193
590539
2755
09:54
For most of human history, we lived in small family units.
194
594459
3509
09:57
We started in caves,
195
597992
1511
09:59
then moved to clans and tribes, then villages and towns,
196
599527
3433
10:02
and now we're all global citizens.
197
602984
2692
10:06
But I believe that we are still hardwired to care the most
198
606211
3800
10:10
about the things that are local to us.
199
610035
2497
10:13
And VR makes anywhere and anyone feel local.
200
613325
4958
10:18
That's why it works as an empathy machine.
201
618307
2508
10:20
Our film "Clouds Over Sidra" takes you to a Syrian refugee camp,
202
620839
3224
10:24
and instead of watching a story about people over there,
203
624087
4551
10:28
it's now a story about us here.
204
628662
3823
10:34
But where do we go from here?
205
634386
1510
10:36
The tricky thing is that with all previous mediums,
206
636432
2457
10:38
the format is fixed at its birth.
207
638913
2370
10:42
Film has been a sequence of rectangles,
208
642182
1889
10:44
from Muybridge and his horses to now.
209
644095
2839
10:47
The format has never changed.
210
647377
1550
10:49
But VR as a format, as a medium,
211
649654
3447
10:54
isn't complete yet.
212
654370
1249
10:56
It's not using physical celluloid or paper or TV signals.
213
656767
3199
10:59
It actually employs what we use to make sense of the world.
214
659990
3819
11:04
We're using your senses as the paints on the canvas,
215
664642
3903
11:08
but only two right now.
216
668569
1322
11:11
Eventually, we can see if we will have all of our human senses employed,
217
671653
3840
11:15
and we will have agency to live the story in any path we choose.
218
675517
4195
11:20
And we call it virtual reality right now,
219
680575
2456
11:23
but what happens when we move past simulated realities?
220
683055
2794
11:27
What do we call it then?
221
687345
1430
11:29
What if instead of verbally telling you about a dream,
222
689503
2836
11:32
I could let you live inside that dream?
223
692363
2774
11:35
What if instead of just experiencing visiting some reality on Earth,
224
695860
3627
11:39
you could surf gravitational waves on the edge of a black hole,
225
699511
4426
11:43
or create galaxies from scratch,
226
703961
2776
11:46
or communicate with each other not using words
227
706761
3084
11:49
but using our raw thoughts?
228
709869
1903
11:53
That's not a virtual reality anymore.
229
713254
2081
11:56
And honestly I don't know what that's called.
230
716052
2346
11:58
But I hope you see where we're going.
231
718884
2332
12:02
But here I am, intellectualizing a medium I'm saying is experiential.
232
722629
3722
12:06
So let's experience it.
233
726839
1426
12:08
In your hands, you hopefully hold a piece of cardboard.
234
728845
3195
12:13
Let's open the flap.
235
733143
1633
12:14
Tap on the power button to unlock the phone.
236
734800
2533
12:18
For the people watching at home,
237
738145
1624
12:19
we're going to put up a card right now
238
739793
1836
12:21
to show you how to download this experience on your phone yourself,
239
741653
3230
12:24
and even get a Google cardboard of your own to try it with.
240
744907
3301
12:29
We played in cardboard boxes as kids,
241
749275
2527
12:31
and as adults, I'm hoping we can all find a little bit of that lightning
242
751826
4584
12:36
by sticking our head in one again.
243
756434
2774
12:41
You're about to participate
244
761615
1429
12:43
in the largest collective VR viewing in history.
245
763068
4452
12:48
And in that classic old-timey style of yesteryear,
246
768236
3618
12:51
we're all going to watch something
247
771878
2231
12:54
at the exact same time, together.
248
774133
1997
12:57
Let's hope it works.
249
777019
1423
12:58
What's the countdown look like? I can't see.
250
778466
2185
13:04
Audience: ...15, 14, 13, 12, 11, 10, 9,
251
784564
6994
13:11
8, 7, 6, 5, 4, 3, 2, 1
252
791582
6864
13:22
(Birds singing)
253
802327
3828
13:34
(Train engine)
254
814508
2660
13:45
Audience: (Shreiks)
255
825351
2000
14:03
(Video) JR: Let me tell you
256
843285
1290
14:04
how I shot the cover of the New York Times Magazine,
257
844599
2477
14:07
"Walking New York."
258
847100
2094
14:18
I just got strapped on outside the helicopter,
259
858577
3410
14:22
and I had to be perfectly vertical so I could grab it.
260
862011
4244
14:26
And when I was perfectly above --
261
866279
1618
14:27
you know, with the wind, we had to redo it a few times --
262
867921
2737
14:30
then I kept shooting.
263
870682
1794
14:39
(Video) Woman's voice: Dear Lord,
264
879598
1698
14:41
protect us from evil,
265
881900
1320
14:44
for you are the Lord,
266
884654
1211
14:47
the light.
267
887044
1187
14:53
You who gave us life took it away.
268
893824
2383
14:58
Let your will be done.
269
898191
1580
15:00
Please bring peace to the many who have lost loved ones.
270
900941
4564
15:05
Help us to live again.
271
905529
1743
15:10
(Music)
272
910564
3119
15:29
(Video) (Children's voices)
273
929066
1461
15:31
Child's voice: There are more kids in Zaatari than adults right now.
274
931504
4665
15:41
Sometimes I think
275
941924
2029
15:43
we are the ones in charge.
276
943977
2434
15:51
Chris Milk: How was it?
277
951410
1375
15:52
(Applause)
278
952809
3715
15:56
That was a cheap way of getting you to do a standing ovation.
279
956548
2929
15:59
I just made you all stand. I knew you'd applaud at the end.
280
959501
2808
16:02
(Applause)
281
962333
1641
16:03
I believe that everyone on Earth needs to experience
282
963998
3819
16:07
what you just experienced.
283
967841
1580
16:10
That way we can collectively start to shape this,
284
970036
3167
16:13
not as a tech platform
285
973227
1774
16:15
but as a humanity platform.
286
975025
1575
16:17
And to that end, in November of last year,
287
977498
3184
16:20
the New York Times and Vrse made a VR project called "The Displaced."
288
980706
3286
16:24
It launched with one million Google Cardboards
289
984016
2346
16:26
sent out to every Sunday subscriber with their newspaper.
290
986386
3473
16:29
But a funny thing happened that Sunday morning.
291
989883
2518
16:32
A lot of people got them
292
992425
1322
16:33
that were not the intended recipients on the mailing label.
293
993771
4206
16:38
And we started seeing this all over Instagram.
294
998001
3544
16:45
Look familiar?
295
1005059
1180
16:48
Music led me on a path
296
1008252
2143
16:50
of searching for what seemed like the unattainable
297
1010419
3049
16:53
for a very long time.
298
1013492
1253
16:55
Now, millions of kids just had the same formative experience
299
1015466
3971
16:59
in their childhood
300
1019461
1741
17:01
that I had in mine.
301
1021226
2304
17:04
Only I think this one
302
1024316
2229
17:06
surpasses it.
303
1026569
1158
17:08
Let's see
304
1028358
1150
17:09
where this
305
1029859
1150
17:11
leads them.
306
1031573
1150
17:13
Thank you.
307
1033384
1151
17:14
(Applause)
308
1034559
6482
About this website

This site will introduce you to YouTube videos that are useful for learning English. You will see English lessons taught by top-notch teachers from around the world. Double-click on the English subtitles displayed on each video page to play the video from there. The subtitles scroll in sync with the video playback. If you have any comments or requests, please contact us using this contact form.

https://forms.gle/WvT1wiN1qDtmnspy7