Jared Ficklin: New ways to see music (with color! and fire!)

Translator: Joseph Geni Reviewer: Morton Bast

Prevoditelj: Ivan Stamenković Recezent: Tilen Pigac - EFZG

My passions

Moje strasti

are music, technology and making things.

su glazba, tehnologija i pravljenje stvari.

And it's the combination of these things

I kombinacija ovih stvari

that has led me to the hobby of sound visualization,

dovela me je do hobija vizualizacije zvuka,

and, on occasion, has led me to play with fire.

i, ponekad, dovelo me da se igram s vatrom.

This is a Rubens' tube. It's one of many I've made over the years,

Ovo je Rubenova cijev. To je jedna od mnogih koje sam napravio s godinama

and I have one here tonight.

i imam jednu ovdje večeras.

It's about an 8-foot-long tube of metal,

To je cijev od metala duga 8 stopa,

it's got a hundred or so holes on top,

ima stotinu ili više rupa na vrhu,

on that side is the speaker, and here

i sa strane je zvučnik, i ovdje

is some lab tubing, and it's connected to this tank

imamo cijevi iz laboratorija, povezanih s ovim spremnikom

of propane.

propana.

So, let's fire it up and see what it does.

Pa, upalimo ga da vidimo što radi.

So let's play a 550-herz frequency

Zasvirajmo frekvenciju od 550 herca

and watch what happens.

i pogledajmo što se događa.

(Frequency)

(Frekvencija)

Thank you. (Applause)

Hvala vam. (Pljesak)

It's okay to applaud the laws of physics,

U redu je zapljeskati zakonima fizike,

but essentially what's happening here

ali ono što se zapravo događa

-- (Laughter) --

-- (Smijeh) --

is the energy from the sound via the air and gas molecules

je da energija iz zvuka putem molekula zraka i plina

is influencing the combustion properties of propane,

utječe na zapaljiva svojstva propana,

creating a visible waveform,

stvarajući vidljiv oblik valova,

and we can see the alternating regions of compression

i možemo vidjeti izmjenjujuća područja kompresije

and rarefaction that we call frequency,

i frekvenciju,

and the height is showing us amplitude.

i visinu koja nam pokazuje amplitudu.

So let's change the frequency of the sound,

Dakle, promijenimo frekvenciju zvuka,

and watch what happens to the fire.

i pogledajmo što se događa s vatrom.

(Higher frequency)

(Viša frekvencija)

So every time we hit a resonant frequency we get a standing wave

Tako kad god pogodimo rezonantnu frekvenciju dobijemo stojeći val

and that emergent sine curve of fire.

i tu uzlaznu krivulju vatre.

So let's turn that off. We're indoors.

Isključimo sad to. Nalazimo se unutra.

Thank you. (Applause)

Hvala vam. (Pljesak)

I also have with me a flame table.

Također imam sa sobom i vatreni stol.

It's very similar to a Rubens' tube, and it's also used

Vrlo je sličan Rubensovoj cijevi, i također je rabljen

for visualizing the physical properties of sound,

za vizualizaciju fizičkih osobnosti zvuka,

such as eigenmodes, so let's fire it up

pa upalimo ga

and see what it does.

i vidimo što radi.

Ooh. (Laughter)

Ooh. (Smijeh)

Okay. Now, while the table comes up to pressure,

Okej. Sad, dok stol dolazi do pritiska,

let me note here that the sound is not traveling

samo da napomenem kako zvuk ne putuje

in perfect lines. It's actually traveling in all directions,

u savršenim linijama. On zapravo putuje u svim smjerovima,

and the Rubens' tube's a little like bisecting those waves

i rubensova "cijev" radi disekciju tih valova

with a line, and the flame table's a little like

linijom, a vatreni stol

bisecting those waves with a plane,

radi disekciju tih valova po ravnini,

and it can show a little more subtle complexity, which is why

i može nam pokazati malo suptilne složenosti, zašto

I like to use it to watch Geoff Farina play guitar.

volim koristiti to kako bih gledao Geoff Farinu kako svira gitaru.

(Music)

(Glazba)

All right, so it's a delicate dance.

Dakle, to je složen ples.

If you watch closely — (Applause)

Ako gledate pažljivo --- (Pljesak)

If you watch closely, you may have seen

ako gledate pažljivo, možda ste vidjeli

some of the eigenmodes, but also you may have seen

neke od eigenmodova, ali možda ste vidjeli i to

that jazz music is better with fire.

da je jazz glazba bolja s vatrom.

Actually, a lot of things are better with fire in my world,

Zapravo, puno stvari je bolje s vatrom u mom svijetu,

but the fire's just a foundation.

ali vatra je samo osnova.

It shows very well that eyes can hear,

Pokazuje vrlo dobro da oči mogu čuti,

and this is interesting to me because

i ovo je meni zanimljivo zato što

technology allows us to present sound to the eyes

nam tehnologija dozvoljava da predstavimo zvuk očima

in ways that accentuate the strength of the eyes

na način koji naglašava snagu očiju

for seeing sound, such as the removal of time.

kako bi vidjele zvuk, kao što je izmicanje vremena.

So here, I'm using a rendering algorithm to paint

Dakle, ovdje koristimo algoritam kako bismo naslikali

the frequencies of the song "Smells Like Teen Spirit"

frekvencije pjesme "Smells Like Teen Spirit"

in a way that the eyes can take them in

na način na koji ga oči mogu primiti

as a single visual impression, and the technique

kao jednu vizualnu impresiju, i tehnika

will also show the strengths of the visual cortex

će također pokazati snage vizualnog korteksa

for pattern recognition.

za prepoznavanje uzoraka.

So if I show you another song off this album,

Pa ako vam pokažem još jednu pjesmu s ovog albuma,

and another, your eyes will easily pick out

i još jednu, vaše oći će lako moći razabrati

the use of repetition by the band Nirvana,

korištenje ponavljanja od strane Nirvane,

and in the frequency distribution, the colors,

i u distribuciji frekvencija, u bojama,

you can see the clean-dirty-clean sound

možete vidjeti čisti-prljavi-čisti zvuk

that they are famous for,

po kojem su poznati,

and here is the entire album as a single visual impression,

i ovdje je cijeli album kao jedna vizualna impresija,

and I think this impression is pretty powerful.

i mislim da je ova impresija vrlo moćna.

At least, it's powerful enough that

Barem, dovoljno je jaka kako bi

if I show you these four songs,

ako vam pokažem ove četiri pjesme,

and I remind you that this is "Smells Like Teen Spirit,"

i podsjetim vas da je ovo "Smells Like Teen Spirit,"

you can probably correctly guess, without listening

možete vrlo vjerojatno točno pogoditi, bez slušanja

to any music at all, that the song

glazbe, da će pjesma

a die hard Nirvana fan would enjoy is this song,

u kojoj će uživati pravi fanovi Nirvane je ova pjesma,

"I'll Stick Around" by the Foo Fighters,

"I'll Stick Around" od Foo Fightersa,

whose lead singer is Dave Grohl,

čiji je pjevač Dave Grohl,

who was the drummer in Nirvana.

koji je bio bubnjar u Nirvani.

The songs are a little similar, but mostly

Pjesme su pomalo slične, ali najviše

I'm just interested in the idea that someday maybe

me zanima ideja da ćemo jednog dana možda

we'll buy a song because we like the way it looks.

moći kupiti pjesmu jer nam se sviđa kako izgleda.

All right, now for some more sound data.

U redu, pogledajte sada malo više zvukovnih podataka.

This is data from a skate park,

Ovo je podatak iz skate parka,

and this is Mabel Davis skate park

i ovo je Mabel Davis skate park

in Austin, Texas. (Skateboard sounds)

u Austinu, Texas. (Zvuk skejta)

And the sounds you're hearing came from eight

I zvukovi koje čujete dolaze iz osam

microphones attached to obstacles around the park,

mikrofona spojenih na rampe po parku,

and it sounds like chaos, but actually

i zvuči kao kaos, ali zapravo

all the tricks start with a very distinct slap,

trikovi počinju sa vrlo određenim udarcem,

but successful tricks end with a pop,

ali uspješni trikovi završavaju s pucketanjem,

whereas unsuccessful tricks

gdje neuspješni trikovi

more of a scratch and a tumble,

završe sa grebanjem i udaranjem,

and tricks on the rail will ring out like a gong, and

dok trikovi na šipci zvone kao gong, i

voices occupy very unique frequencies in the skate park.

glasovi su na jedinstvenoj frekvenciji u skate parku.

So if we were to render these sounds visually,

Pa ako bismo vizualno prikazali ove zvukove,

we might end up with something like this.

možda ćemo završiti s nečim kao što je ovo.

This is all 40 minutes of the recording,

Ovo je svih 40 minuta snimke,

and right away the algorithm tells us

i odmah nam algoritam govori

a lot more tricks are missed than are made,

da ima više neuspjelih nego uspjelih trikova,

and also a trick on the rails is a lot more likely

i da će trik na šipci vrlo vjerojatno

to produce a cheer, and if you look really closely,

izazvati poklike, i ako pogledate pažljivo,

we can tease out traffic patterns.

možemo izvući uzorke prometa.

You see the skaters often trick in this direction. The obstacles are easier.

Vidite, skejteri često rade trikove u tom smjeru. Rampe su lakše.

And in the middle of the recording, the mics pick this up,

I usred snimanja, mikrofoni pokupe ovo,

but later in the recording, this kid shows up,

ali kasnije u snimci, ovaj klinac se pojavi,

and he starts using a line at the top of the park

i počinje koristiti smjer na vrhu parka

to do some very advanced tricks on something

kako bi napravio neke napredne trikove na nečem

called the tall rail.

što se zove visoka šipka.

And it's fascinating. At this moment in time,

I to je fascinantno. U ovom trenutku u vremenu,

all the rest of the skaters turn their lines 90 degrees

svi ostali skejteri okreću svoj smjer kretanja za 90 stupnjeva

to stay out of his way.

kako bi mu se maknuli s puta.

You see, there's a subtle etiquette in the skate park,

Vidite, postoji suptilna pristojnost u parku,

and it's led by key influencers,

i vode ju glavni nositelji utjecaja,

and they tend to be the kids who can do the best tricks,

i to su najčešće djeca koja mogu raditi najbolje trikove,

or wear red pants, and on this day the mics picked that up.

ili nose crvene hlače, i ovog dana mikrofoni su to primjetili.

All right, from skate physics to theoretical physics.

Od fizike skejta do teoretske fizike.

I'm a big fan of Stephen Hawking,

Ja sam veliki fan Stephen Hawkinga,

and I wanted to use all eight hours

i htio sam iskoristiti svih osam sati

of his Cambridge lecture series to create an homage.

njegovog predavanja na Cambridgeu kako bih stvorio posvetu.

Now, in this series he's speaking with the aid of a computer,

Sada, u ovoj seriji on govori uz pomoć računala,

which actually makes identifying the ends of sentences

što zapravo omogućuje identifikaciju krajeva rečenica

fairly easy. So I wrote a steering algorithm.

dosta jednostavno. Pa sam stvorio skretajući algoritam.

It listens to the lecture, and then it uses

On sluša predavanje, i onda koristi

the amplitude of each word to move a point on the x-axis,

amplitude svake riječi kako bi pomaknuo točku na x osi,

and it uses the inflection of sentences

i koristi modulaciju rečenica

to move a same point up and down on the y-axis.

kako bi pomaknuo istu točku gore i dolje po y osi.

And these trend lines, you can see, there's more questions

I ove linije, kao što vidite, ostavljaju više pitanja

than answers in the laws of physics,

nego odgovora u zakonima fizike,

and when we reach the end of a sentence,

i kad dođemo do kraja rečenice,

we place a star at that location.

stavljamo zvjezdicu na tu lokaciju.

So there's a lot of sentences, so a lot of stars,

Dakle postoji puno rečenica, pa puno zvijezda,

and after rendering all of the audio, this is what we get.

i nakon renderiranja sveg zvuka, ovo je što dobijemo.

This is Stephen Hawking's universe.

Ovo je svemir Stephena Hawkinga.

(Applause)

(Pljesak)

It's all eight hours of the Cambridge lecture series

Ovo je svih osam sati predavanja sa Cambridgea

taken in as a single visual impression,

prikazanih u jednoj vizualnoj impresiji,

and I really like this image,

i stvarno mi se sviđa ova slika,

but a lot of people think it's fake.

ali mnogo ljudi misli da je ovo lažno.

So I made a more interactive version,

Pa sam stvorio interaktivniju verziju,

and the way I did that is I used their position in time

a to sam učinio tako što sam koristio njihov položaj u vremenu

in the lecture to place these stars into 3D space,

u predavanju kako bih postavio ove zvijezdice u 3D prostoru,

and with some custom software and a Kinect,

i s nešto posebnog softwarea i Kinectom,

I can walk right into the lecture.

mogu ušetati u predavanje.

I'm going to wave through the Kinect here

Mahnut ću kroz Kinect ovdje

and take control, and now I'm going to reach out

i preuzeti kontrolu, i sada ću posegnuti

and I'm going to touch a star, and when I do,

i dodirnuti zvjezdu, i kada to učinim,

it will play the sentence

pustit će rečenicu

that generated that star.

koja je stvorila tu zvjezdu.

Stephen Hawking: There is one, and only one, arrangement

Stephen Hawking: Postoji jedan, i samo jedan, aranžman

in which the pieces make a complete picture.

u kojem dijelovi čine čitavu sliku.

Jared Ficklin: Thank you. (Applause)

Jared Ficklin: Hvala vam. (Pljesak)

There are 1,400 stars.

Postoji 1.400 zvjezda.

It's a really fun way to explore the lecture,

To je zaista zanimljiv način za istraživanje predavanja,

and, I hope, a fitting homage.

i, nadam se, dostojna posveta.

All right. Let me close with a work in progress.

U redu. Dopustite da završim sa radom koji je u tijeku.

I think, after 30 years, the opportunity exists

Mislim, nakon 30 godina, da postoji prilika

to create an enhanced version of closed captioning.

za stvaranje poboljšane verzije zatvorenog titlovanja.

Now, we've all seen a lot of TEDTalks online,

Sad, puno nas je vidjelo puno TED govora online,

so let's watch one now with the sound turned off

pa pogledajmo jedan bez zvuka

and the closed captioning turned on.

i uključenim sustavom zatvorenog titlovanja.

There's no closed captioning for the TED theme song,

Ne postoji zatvoreno titlovanje za TED pjesmu,

and we're missing it, but if you've watched enough of these,

i nedostaje nam, ali ako ste pogledali dovoljno ovoga,

you hear it in your mind's ear,

čujete ju u vašem uhu,

and then applause starts.

i onda pljesak počinje.

It usually begins here, and it grows and then it falls.

Obično počinje ovdje, i raste a zatim pada.

Sometimes you get a little star applause,

Nekad dobijete pljesak male zvjezde,

and then I think even Bill Gates takes a nervous breath,

i onda mislim da čak i Bill Gates nervozno udahne,

and the talk begins.

i govor počne.

All right, so let's watch this clip again.

Dobro, pogledajmo ovaj isječak ponovno.

This time, I'm not going to talk at all.

Ovoga puta, neću uopće govoriti.

There's still going to be no audio,

I dalje neće biti zvuka,

but what I am going to do is I'm going to render the sound

ali ono što ću ja učiniti je prevesti zvuk

visually in real time at the bottom of the screen.

vizualno u realnom vremenu na dnu ekrana.

So watch closely and see what your eyes can hear.

Gledajte pažljivo i vidite što vaše oči mogu čuti.

This is fairly amazing to me.

Ovo je poprilično zadivljuuće za mene.

Even on the first view, your eyes will successfully

Čak i na prvi pogled, oči će uspješno

pick out patterns, but on repeated views,

izabrati uzorke, no u opetovanim gledanjem,

your brain actually gets better

vaš mozak zapravo postaje bolji

at turning these patterns into information.

u pretvaranju ovih uzoraka u informacije.

You can get the tone and the timbre

Možete osjetiti ton i boju zvuka

and the pace of the speech,

i brzinu govora,

things that you can't get out of closed captioning.

stvari koje ne možete dobiti iz zatvorenog titlovanja.

That famous scene in horror movies

Ona poznata scena u horor filmovima

where someone is walking up from behind

gdje netko dolazi straga

is something you can see,

je nešto što možete vidjeti,

and I believe this information would be something

i vjerujem da je ova informacija nešto

that is useful at times when the audio is turned off

što je korisno kada je isključen zvuk

or not heard at all, and I speculate that deaf audiences

ili nije čuo uopće, i pretpostavljam da će gluha publika

might actually even be better

možda biti i bolja

at seeing sound than hearing audiences.

u viđenju zvuka nego publika koja čuje.

I don't know. It's a theory right now.

Ne znam. Za sada je to samo teorija.

Actually, it's all just an idea.

Zapravo, to je sve samo ideja.

And let me end by saying that sound moves in all directions,

I dopustite da završim s tim da se zvuk kreće u svim smjerovima,

and so do ideas.

a tako se kreću i ideje.

Thank you. (Applause)

Hvala vam. (Pljesak)