How volumetric video brings a new dimension to filmmaking | Diego Prilusky

Prevodilac: Milenka Okuka Lektor: Ivana Korom

I love making movies.

Volim da pravim filmove.

Motion pictures have been in existence for more than a hundred years.

Filmovi postoje više od stotinu godina.

Filmmaking hasn't changed for the dimensional mindset.

Snimanje filmova se nije promenilo kada je u pitanju dimenzija posmatranja.

Placing the camera in a scene and pressing "record" hasn't changed.

Pozicioniranje kamere u sceni i snimanje se nisu promenili.

Filmmaking is still a frontal experience,

Filmsko stvaralaštvo je i dalje frontalno iskustvo,

and creating the film has the possibility

a stvaranje filmova ima mogućnost

to follow the same direction of the content creation.

da prati isti smer pravljenja sadržaja.

We still stand in front of a flat image,

I dalje stojimo pred ravnom slikom,

watching the fiction.

posmatrajući fikciju.

There's nothing wrong with it.

To je sasvim u redu.

I love watching movies and going to the theaters.

Volim da gledam filmove i odlazim u bioskop.

The experiences can be such emotional experiences.

Ta iskustva mogu da budu veoma emotivna.

The art and craft of emotional experiences within a frame

Umetnost i umeće emotivnih iskustava unutar kadra

can be so strong to drive a stronger emotion.

mogu da budu toliko snažni da pokreću snažnije emocije.

The question we're asking is,

Pitanje koje postavljamo glasi:

How the experience of motion pictures can exist beyond the flat screen.

kako iskustvo filmova može da postoji izvan ravnog ekrana.

How can we start creating content

Kako da počnemo da stvaramo sadržaje

for the next generation of content experiences?

za narednu generaciju doživljaja sadržaja?

Traditionally, when we imagine a scene,

Tradicionalno, kada zamislimo scenu,

we look at the frame and the composition.

posmatramo kadar i kompoziciju.

We have to think about how we create depth and parallax

Moramo da razmišljamo kako da stvorimo dubinu i paralaksu

using foreground, background elements as the camera moves.

koristeći elemente u pročelju i začelju dok se kamera kreće.

With the technology today and devices of VR glasses,

Sa današnjom tehnologijom i uređajima poput naočara za virtuelnu

AR glasses, smart devices,

i proširenu stvarnost, pametnih uređaja,

allowing three-dimensional and full navigation in space,

koji omogućuju trodimenzionalnu i potpunu navigaciju u prostoru,

we have the possibility to enable audiences

imamo mogućnost da publici omogućimo

to experience content from multiple perspectives.

da doživi sadržaj iz više perspektiva.

What we have to think about is how we take this technology,

Moramo da razmišljamo o tome kako da uzmemo ovu tehnologiju,

all the capabilities,

sve njene mogućnosti

and enable the experience to move farther away inside the scene.

i da omogućimo iskustvu da prevaziđe okvire scene.

Now we're not talking about video games or computer-generated actors,

Ne govorimo o video igrama ili o kompjuterski generisanim glumcima,

which look tremendously realistic.

koji izgledaju beskrajno realistično.

We're talking about real actors and real performance,

Govorimo o stvarnim glumcima i stvarnim nastupima,

performing onstage.

nastupima na sceni.

We have to start thinking how we capture the actors

Moramo da počnemo da razmišljamo kako da snimamo glumce

and how we capture the real scene

i kako da snimamo stvarne scene

in order to immerse inside.

da bismo imali sveobuhvatan doživljaj.

Now, we're familiar with the 360-degree video,

Poznat nam je video od 360 stepeni

where you place a camera inside the scene

gde smestite kameru unutar scene

and you can create this beautiful panoramic image all around you,

i možete da napravite tu prelepu panoramsku sliku skroz oko sebe,

but from the same aspect,

ali sa istog gledišta,

filmmaking is still frontal.

filmsko stvaralaštvo je i dalje frontalno.

In order to emerge fully inside the scene,

Kako bismo bili potpuno obuhvaćeni scenom,

we will need to capture the light from all the possible directions.

moraćemo da uhvatimo svetlost iz svih mogućih smerova.

We will have to surround the scene with an enormous amount of sensors,

Moraćmo da opkolimo scenu ogromnom količinom senzora,

with all possible capabilities to capture the light

sa svim mogućim opcijama da se uhvati svetlost

and enable us to emerge inside afterwards again.

i omogući nam da budemo vidljivi u unutrašnjosti scene ponovo.

Now, in this setup,

U ovoj postavci,

there's no more foreground or background

više nemamo pročelje i začelje,

or a camera placed in space

niti kameru smeštenu u prostoru,

but hundreds of sensors capturing the light

već na stotine senzora koji hvataju svetlost

and capturing the motion from all the possible directions.

i hvataju pokrete iz svih mogućih uglova.

With the new technological advancements,

S novim tehnološkim napretkom,

we can start looking at 3D photography,

možemo da počnemo da posmatramo 3D fotografiju,

capturing the light from multiple perspectives,

koja hvata svetlost iz višestrukih perspektiva,

enabling us to reconstruct the object.

omogućujući nam da rekonstruišemo objekat.

This is like photography in 3D space.

Ovo liči na fotografiju u 3D prostoru.

Now, with these technological advancements,

Uz ovaj tehnološki napredak,

we can record video not just as a flat image

možemo da pravimo snimke, koji nisu samo ravna slika

but as a volume.

već imaju i zapreminu.

This is what we call "volumetric video,"

Ovo nazivamo „volumetrijskim videom”,

and it has the capability to record every action of the scene

i on može da snimi sva dešavanja na sceni

as a full three-dimensional volume.

u vidu trodimenzionalne zapremine.

Now, what is a voxel?

Šta je voksel?

A voxel is like a three-dimensional pixel,

Voksel je poput trodimenzionalnog piksela,

but instead of being a flat image square, staying light and colored,

samo što se ne radi o ravnom kvadratu koji je osvetljen i obojen,

it's like a three-dimensional cube in space,

radi se o trodimenzionalnoj kocki u prostoru,

with x, y, and z positions.

sa x, y i z pozicijama.

This enables us to create a full capture of the scene

Ovo nam omogućuje da snimimo scenu u totalu

from any perspective.

iz svih perspektiva.

Now this renders a fully light-immersive scene

Ovo daje scenu koja je u potpunosti prožeta svetlošću

from multiple perspectives.

iz višestrukih uglova.

This capability requires an insane amount of information to be processed.

Ova mogućnost zahteva obradu sumanuto velike količine informacija.

We will have to capture the light from an enormous amount of cameras

Morali bismo da uhvatimo svetlost ogromnog broja kamera

to create this information.

kako bismo stvorili ovu informaciju.

Now, in order to do such a thing,

Da bismo uradili nešto takvo,

we would need a setup that would host a numerous amount of cameras

morali bismo da imamo postavku koja bi sadržala veliki broj kamera

installed in a stage

postavljenih na sceni

and a stage big enough in order to fit a full cinematic experience.

kao i dovoljno veliku scenu kako bi u nju stalo kompletno filmsko iskustvo.

Now that sounds like a crazy idea, but that's exactly what we did.

Ovo zvuči kao blesava ideja, ali mi smo upravo to i uradili.

For the last three years,

Poslednje tri godine,

we have been building a huge volumetric camera chamber.

gradili smo ogromnu volumetrijsku komoru od kamera.

It's 10,000 square feet of a stage,

Radi se o sceni veličine 929 metara kvadratnih,

enabling to capture the action from any location.

koja omogućuje snimanje događaja sa bilo koje lokacije.

We have deployed hundreds of cameras,

Angažovali smo na stotine kamera,

sending a tremendous amount of information

koje šalju zapanjujuće količine informacija

to a huge data center powered by Intel supercomputers.

u ogromne centre za podatke pohranjene u intelovim superkompjuterima.

The ability to have this 10,000 feet

To što imamo ovih 929 metara

enables us to fit any kind of action,

nam omogućuje da uklopimo bilo kakvo zbivanje,

any kind of performance.

bilo kakav nastup.

It is the size of an average Broadway stage.

To je veličina prosečne brodvejske pozornice.

We call it Intel Studios,

Nazvali smo je Intel studios

and it's the largest volumetric stage in the world,

i radi se o najvećoj volumetrijskoj pozornici na svetu,

with the objective of enabling and exploring

a njen cilj je da omogući i istraži

the next generation of this immersive media filmmaking.

novu generaciju pravljenja sveobuhvatnih filmova.

Now, to test these ideas,

Kako bismo testirali ove ideje,

we were thinking about what we can do as the first scene to try it out.

razmišljali smo koja scena bi mogla da bude dobra za testiranje.

So we chose the Western scene.

Pa smo odabrali scenu iz vesterna.

We brought horses, set designers, dirt,

Doveli smo konje, dizajnere setova, prašinu,

everything needed to create the full scene of a Western.

sve što je potrebno da se stvori potpuna scena iz vesterna.

But this time, there was no camera inside.

Međutim, ovaj put nismo imali kameru na sceni.

There was nothing really moving besides all the cameras

Ništa se zaista nije pomeralo osim kamera

installed outside.

postavljenih spolja.

The challenge of the actors was tremendous.

Izazov za glumce je bio ogroman.

They have to perform a flawless action visible from all the directions.

Morali su da izvedu besprekornu akciju vidljivu iz svih uglova.

There's no possibility to hide a punch or not show the action.

Ne postoji mogućnost da se sakrije udarac ili da se ne prikaže akcija.

Everything is captured and everything is seen.

Sve se hvata i sve se vidi.

The output of the capture --

Ishod snimka -

this is our future capture --

ovo je naš prvi snimak -

opened our eyes for the immense capabilities.

otvorio nam je vidike za mogućnosti sveobuhvatnog filma.

It was like a full 3D scan of the entire scene.

Ličilo je na 3D skeniranje celokupne scene.

We were able to move around and travel in the space.

Mogli smo da se krećemo okolo i da putujemo u prostoru.

The thing about this,

Radi se o tome

it's not anymore about perceiving the light emitted from a screen

da više ne zapažamo svetlost koja se emituje na ekranu,

but now traveling inside the light,

već sad putujemo unutar svetlosti,

traveling inside the scene.

putujemo unutar scene.

This obviously opens possibilities for an enormous amount

Ovo očito otvara mogućnosti za ogromne količine

of storytelling and methodologies of creation.

novog tipa pripovedanja i nove metodologije stvaranja.

This is the possibilities of your personal narrative,

Radi se o mogućnostima vašeg ličnog pripovedanja,

the possibility of creating your own story inside,

mogućnosti da stvorite sopstvenu priču unutra

or maybe following other stories.

ili da možda pratite druge priče.

Let's take a look at one of the last renders and see.

Pogledajmo jedan od poslednjih rendera i uverimo se.

(Music)

(Muzika)

What you're seeing here is full volumetric video,

Gledate u potpunosti volumetrijski video

and there's no physical camera in the scene.

i nemamo fizičku kameru na sceni.

(Music)

(Muzika)

We have the full control

Imamo punu kontrolu

(Music, sounds of combat)

(Muzika, zvuk borbe)

of space and time.

nad prostorom i vremenom.

(Music, sounds of combat)

(Muzika, zvuk borbe)

Now, again, no physical camera was here.

Opet, nemamo fizički prisutnu kameru.

Everything was captured surrounding.

Sve je snimljeno spolja.

Now, this is very nice,

Ovo je veoma lepo,

but what if we wanted to see the scene, maybe, from the eyes of the horse?

ali šta ako bismo želeli da vidimo scenu možda kroz oči konja?

Well, we can do that as well.

Pa, možemo i to da uradimo.

(Horse galloping)

(Konj galopira)

So what you're seeing right now is the same action,

Upravo gledate isto dešavanje,

but this time, we're watching exactly from the eyes of the horse.

ali ovaj put posmatramo tačno kroz oči konja.

The possibilities are, well, unlimited.

Mogućnosti su, pa, neograničene.

(Applause)

(Aplauz)

Thank you.

Hvala vam.

(Applause)

(Aplauz)

So this is all great for creators and storytellers.

Sve ovo je sjajno za stvaraoce i pripovedače.

It really opens a huge canvas

Zaista otvara ogroman prostor

for a different type of storytelling and moviemaking.

za različit vid pripovedanja i filmskog stvaralaštva.

But what about the audience?

Međutim, šta je s publikom?

How can the audience experience this differently?

Kako da publika ovo doživi drugačije?

In order to [create] our explorations,

Kako bismo istražili,

we partnered with Paramount Pictures

udružili smo se sa Paramaunt pikčers

in order to explore immersive media in a Hollywood movie production.

kako bismo istražili sveobuhvatni medijum u holivudskoj filmskoj produkciji.

Together with the director Randal Kleiser,

Zajedno sa rediteljem Rendalom Klejzerom,

we reimagined the iconic movie of 1978,

ponovo smo osmislili kultni film iz 1978:

"Grease."

„Briljantin”.

Some of you know it, some of you don't.

Nekima od vas je poznat, nekima ne.

A 40-year-old movie, amazing experience.

Film star 40 godina, neverovatno iskustvo.

And our goal was really to look at how we can take this iconic action and dance

A naš cilj je bio da razmotrimo kako da uzmemo ove kultne pokrete i ples

and bring it deeper into the experience,

i da produbimo iskustvo,

bring it deeper into the audience.

da ga više približimo publici.

Imagine that you can not just watch the movie

Zamislite da možete ne samo da posmatrate film,

but get inside it and dance with the actors

već i da uđete unutar njega i plešete sa glumcima,

and dance with the performance.

da plešete uz njihov nastup.

Now we're breaking, really, the traditional 2D mindset of thinking,

Ovim zaista rušimo tradicionalni dvodimenzionalni način posmatranja

and bringing a much richer possibility of moviemaking

i donosimo veće izobilje mogućnosti za pravljenje filmova

and content creation.

i stvaranje sadržaja.

But why watch it on the screen?

Međutim, zašto da to gledamo na ekranu?

Let's try to bring these actors here on the stage.

Pokušajmo da dovedemo glumce ovde na scenu.

So they're not going to really come --

Dakle, neće zaista da dođu -

I'm going to use an iPad.

koristiću ajped.

(Laughter)

(Smeh)

Sorry.

Izvinjavam se.

I'm going to use an iPad in order to bring in augmented reality.

Koristiću ajped kako bih doneo proširenu stvarnost.

Now, obviously, these devices have their own limitations

Očito, ovi uređaji imaju sopstvena ograničenja

in terms of the data-computing process,

u smislu procesa obrade podataka,

so we have to reduce the amount of resolution.

pa moramo da umanjimo jačinu rezolucije.

So what I'm doing now, I'm placing here a marker,

Sada ovde smeštam strelicu,

so I'll be able to position exactly where I want everyone to appear.

kako bih bio u stanju da svakoga smestim baš tamo gde želim da se pojavi.

OK.

U redu.

I think we have them here.

Mislim da su tu.

(Applause)

(Aplauz)

John Travolta, or --

Džon Travolta ili -

(Laughter)

(Smeh)

a version of him.

njegova verzija.

Let's take a look.

Pogledajmo.

(Video) Female: Hey.

(Video) Žena: Hej.

Male: And that is how it's done.

Muškarac: I tako se to radi.

Female: Your turn.

Žena: Ti si na redu.

Male: Hey, guys! Check this out.

Muškarac: Hej, momci! Pazite ovo.

(Song: "You're the one that I want")

(Pesma: „You're the one that I want”)

Danny: Sandy!

Deni: Sendi!

Sandy: Tell me about it, stud.

Sendi: Pričaj mi o tome, frajeru.

(Singing) I got chills. They're multiplying

(Pevanje) Žmarci u meni se sve više množe

And I'm losing control

i ja gubim kontrolu.

'Cause the power you're supplying

Jer struja koju odašilješ

It's electrifying!

je elektrišuća!

(Video ends)

(Kraj snimka)

(Applause and cheers)

(Aplauz i klicanje)

Diego Prilusky: Thank you.

Dijego Priluski: Hvala vam.

(Applause and cheers)

(Aplauz i klicanje)

So as you can see,

Kao što vidite,

we can watch and experience content in the traditional way

možemo da posmatramo i doživimo sadržaj na tradicionalan način

or in an immersive way.

ili na sveobuhvatan način.

Really, the possibilities are open.

Mogućnosti su uistinu otvorene.

We're not trying to change or replace movies.

Ne pokušavamo da promenimo ili zamenimo filmove.

We're enhancing them.

Unapređujemo ih.

The technologies enable new possibilities to start thinking beyond the flat screen.

Ova tehnologija pruža nove mogućnosti za razmišljanje izvan ravnog ekrana.

We're in immersive and really exciting times in filmmaking.

U sveobuhvatnom smo i zaista uzbudljivom vremenu filmskog stvaralaštva.

We're at the threshold of a new era.

Na pragu smo nove ere.

We're opening the gates for new possibilities

Otvaramo kapije novih mogućnosti

of immersive storytelling,

sveobuhvatnog pripovedanja

and exploration and defining what immersive media filmmaking means.

i istražujemo i definišemo šta sveobuhvatni film znači.

We're really just at the beginning,

Zaista smo tek na početku

and we invite you all to join us.

i sve vas pozivamo da nam se pridružite.

Thank you.

Hvala vam.

(Applause)

(Aplauz)