How technology can fight extremism and online harassment | Yasmin Green

Prevodilac: Aleksandar Bošnjak Lektor: Ivana Korom

My relationship with the internet reminds me of the setup

Moja veza sa internetom me podseća na radnju

to a clichéd horror movie.

predvidivog horor filma.

You know, the blissfully happy family moves in to their perfect new home,

Presrećna porodica se useljava u svoju novu kuću,

excited about their perfect future,

uzbuđeni zbog svoje savršene budućnosti,

and it's sunny outside and the birds are chirping ...

a napolju je sunčano, pričice cvrkuću...

And then it gets dark.

A onda postaje mračno.

And there are noises from the attic.

I čuju se zvukovi na tavanu.

And we realize that that perfect new house isn't so perfect.

Pa shvatamo da ta savršena nova kuća nije toliko savršena.

When I started working at Google in 2006,

Kada sam počela da radim u Guglu 2006,

Facebook was just a two-year-old,

Fejsbuk je imao samo dve godine,

and Twitter hadn't yet been born.

a Tviter još nije bio rođen.

And I was in absolute awe of the internet and all of its promise

Bila sam potpuno zapanjena internetom i svim njegovim obećanjima

to make us closer

da nas zbliži

and smarter

da nas načini pametnijim

and more free.

i slobodnijim.

But as we were doing the inspiring work of building search engines

Ali kako smo radili inspirušući posao izrađivanja pretraživača,

and video-sharing sites and social networks,

sajtova za razmenu video klipova i socijalnih mreža,

criminals, dictators and terrorists were figuring out

kriminalci, diktatori i teroristi su shvatali

how to use those same platforms against us.

kako da koriste te iste platforme protiv nas.

And we didn't have the foresight to stop them.

Nismo imali smotrenosti da ih zaustavimo.

Over the last few years, geopolitical forces have come online to wreak havoc.

Proteklih godina geopolitičke sile su došle na internet da izazovu propast.

And in response,

A kao odgovor,

Google supported a few colleagues and me to set up a new group called Jigsaw,

Gugl je podržao nekoliko kolega i mene da osnujemo novu grupu "Slagalica",

with a mandate to make people safer from threats like violent extremism,

sa mandatom da načinimo ljude sigurnijima od pretnji kao što su nasilni eksremizam,

censorship, persecution --

cenzura, progon -

threats that feel very personal to me because I was born in Iran,

pretnje koje su meni veoma lične jer sam rođena u Iranu,

and I left in the aftermath of a violent revolution.

i otišla sam tokom posledica nasilne revolucije.

But I've come to realize that even if we had all of the resources

Shvatila sam da čak i da imamo sve resurse

of all of the technology companies in the world,

svih tehnoloških kompanija na svetu,

we'd still fail

i dalje bismo gubili

if we overlooked one critical ingredient:

ako bismo predvideli jedan presudan sastojak:

the human experiences of the victims and perpetrators of those threats.

ljudska iskustva žrtava i izvršioce tih pretnji.

There are many challenges I could talk to you about today.

Ima mnogo izazova o kojima bih mogla da vam pričam danas.

I'm going to focus on just two.

Foksiraću se na samo dva.

The first is terrorism.

Prvi je terorizam.

So in order to understand the radicalization process,

Dakle, da bismo razumeli proces radikalizacije,

we met with dozens of former members of violent extremist groups.

sastali smo se sa desetinom bivših članova ekstremističkih grupa.

One was a British schoolgirl,

Jedna je bila britanska učenica,

who had been taken off of a plane at London Heathrow

koja je bila izvedena iz aviona na Londonskom aerodromu "Hitrou"

as she was trying to make her way to Syria to join ISIS.

dok je pokušavala da dođe do Sirije da bi se pridružila ISIS-u.

And she was 13 years old.

A imala je 13 godina.

So I sat down with her and her father, and I said, "Why?"

Sela sam sa njom i njenim ocem, i pitala sam: “Zašto?”

And she said,

a ona je rekla:

"I was looking at pictures of what life is like in Syria,

“Gledala sam slike na kojima je prikazano kakav je život u Siriji

and I thought I was going to go and live in the Islamic Disney World."

i mislila sam da idem da živim u islamskom Dizni svetu.”

That's what she saw in ISIS.

To je ono što je ona videla u ISISu.

She thought she'd meet and marry a jihadi Brad Pitt

Mislila je da će upoznati i venčati se sa džihadi Bredom Pitom

and go shopping in the mall all day and live happily ever after.

i da će biti u tržnom centru ceo dan i živeti srećno sve do kraja života.

ISIS understands what drives people,

ISIS razume šta pokreće ljude,

and they carefully craft a message for each audience.

oni pažljivo kreiraju poruku za svaku publiku.

Just look at how many languages

Samo pogledajte na koliko jezika

they translate their marketing material into.

oni prevode svoj propagandni materijal.

They make pamphlets, radio shows and videos

Prave brošure, radio emisije i klipove

in not just English and Arabic,

ne samo na engleskom i arapskom,

but German, Russian, French, Turkish, Kurdish,

već i nemačkom, ruskom, francuskom, turskom, kurdskom,

Hebrew,

hebrejskom

Mandarin Chinese.

mandarinskom.

I've even seen an ISIS-produced video in sign language.

Čak sam videla i video gde koriste znakovni jezik.

Just think about that for a second:

Samo mislite o tome na sekundu:

ISIS took the time and made the effort

ISIS je odvojio vreme i uložio napor

to ensure their message is reaching the deaf and hard of hearing.

da osigura da njihova poruka dosegne i do gluvih i onih sa slabijim sluhom.

It's actually not tech-savviness

Nije zapravo razumevanje u tehnologiju

that is the reason why ISIS wins hearts and minds.

razlog što ISIS osvaja srca i umove.

It's their insight into the prejudices, the vulnerabilities, the desires

Razlog su njihovi uvidi u predrasude, ranjivosti, žudnje

of the people they're trying to reach

ljudi koje pokušavaju da dosegnu.

that does that.

That's why it's not enough

Zato nije dovoljno

for the online platforms to focus on removing recruiting material.

za internet platforme da se fokusiraju na uklanjanje materijala za vrbovanje.

If we want to have a shot at building meaningful technology

Ako želimo da imamo šansu u stvaranju značajne tehnologije

that's going to counter radicalization,

koja će se protiviti radikalizaciji,

we have to start with the human journey at its core.

moramo da počnemo sa ljudskim putem u svojoj srži.

So we went to Iraq

Otišli smo u Irak

to speak to young men who'd bought into ISIS's promise

da pričamo sa mladićem koji je poverovao u obećanje ISIS-a

of heroism and righteousness,

o heroizmu i pravednosti,

who'd taken up arms to fight for them

koji je uzeo oružje da se bori za njih,

and then who'd defected

a onda je dezertirao

after they witnessed the brutality of ISIS's rule.

nakon što je bio očevidac brutalnih pravila ISIS-a.

And I'm sitting there in this makeshift prison in the north of Iraq

Sedim tamo u improvizovanom zatvoru na severu Iraka

with this 23-year-old who had actually trained as a suicide bomber

sa dvadesettrogodišnjakom koje je trenirao da postane bombaš samoubica

before defecting.

pre nego što je dezertirao.

And he says,

On kaže:

"I arrived in Syria full of hope,

"Stigao sam u Siriju pun nade,

and immediately, I had two of my prized possessions confiscated:

i odmah su mi konfiskovali dve najvažnije stvari:

my passport and my mobile phone."

moj pasoš i mobilni telefon."

The symbols of his physical and digital liberty

Simboli njegove fizičke i digitalne slobode

were taken away from him on arrival.

su mu bili oduzeti po dolasku.

And then this is the way he described that moment of loss to me.

A ovo je način kojim je on meni opisao taj momenat gubitka.

He said,

Rekao je:

"You know in 'Tom and Jerry,'

"Znate u ‘Tomu i Džeriju’,

when Jerry wants to escape, and then Tom locks the door

kad Džeri želi da pobegne, pa onda Tom zaključava vrata

and swallows the key

i proguta ključ,

and you see it bulging out of his throat as it travels down?"

a onda vidite kako se ocrtava na njegovom vratu dok ide ka dole?”

And of course, I really could see the image that he was describing,

Naravno, stvarno sam mogla da vidim sliku koju je opisivao,

and I really did connect with the feeling that he was trying to convey,

i zaista sam se povezala sa osećanjem koje je on pokušavao da prenese,

which was one of doom,

koje je bilo osećanje propasti,

when you know there's no way out.

kad znate da nema izlaza.

And I was wondering:

Pitala sam se:

What, if anything, could have changed his mind

šta je, ako išta, moglo da promeni njegovo mišljenje

the day that he left home?

na dan kad je otišao?

So I asked,

Pa sam ga pitala:

"If you knew everything that you know now

"Da si znao sve što sada znaš

about the suffering and the corruption, the brutality --

o patnji, korupciji i brutalnosti -

that day you left home,

tog dana kad si otišao,

would you still have gone?"

da li bi i pored toga opet otišao?"

And he said, "Yes."

On je rekao: "Da."

And I thought, "Holy crap, he said 'Yes.'"

Pomislila sam: "Zaboga, rekao je 'da.'"

And then he said,

A onda je rekao:

"At that point, I was so brainwashed,

"U tom trenutku mi je mozak bio ispran,

I wasn't taking in any contradictory information.

nisam uzimao u obzir bilo koju protivrečnu informaciju.

I couldn't have been swayed."

Nisam mogao biti pokoleban."

"Well, what if you knew everything that you know now

"Šta da si znao sve što sada znaš

six months before the day that you left?"

šest meseci pre dana kada si otišao?"

"At that point, I think it probably would have changed my mind."

"U tom trenutku, mislim da bi mi to promenilo mišljenje."

Radicalization isn't this yes-or-no choice.

Radikalizacija nije da ili ne izbor.

It's a process, during which people have questions --

To je proces tokom kog ljudi imaju pitanja -

about ideology, religion, the living conditions.

o ideologiji, religiji, uslovima življenja.

And they're coming online for answers,

Idu na internet u potragu za odgovorima,

which is an opportunity to reach them.

što je prilika da se do njih dođe.

And there are videos online from people who have answers --

Postoje klipovi na internetu od ljudi koji imaju odgovore -

defectors, for example, telling the story of their journey

dezerteri, na primer, pričaju priču o svom putovanju

into and out of violence;

u i iz nasilja;

stories like the one from that man I met in the Iraqi prison.

priče kao što je od onog čoveka kog sam upoznala u iračkom zatvoru.

There are locals who've uploaded cell phone footage

Ima lokalaca koji su postavljali telefonske snimke

of what life is really like in the caliphate under ISIS's rule.

o tome kakav je život u kalifatu pod pravilima ISIS-a.

There are clerics who are sharing peaceful interpretations of Islam.

Postoje sveštenici koji dele miroljubive interpretacije islama.

But you know what?

Ali znate šta?

These people don't generally have the marketing prowess of ISIS.

Ovi ljudi obično nemaju marketinšku sposobnost ISIS-a.

They risk their lives to speak up and confront terrorist propaganda,

Oni rizikuju svoje živote da se pročuju i usprotive terorističkoj propagandi,

and then they tragically don't reach the people

a onda na žalost ne dosegnu do ljudi

who most need to hear from them.

koji najviše treba da ih čuju.

And we wanted to see if technology could change that.

Želeli smo da vidimo da li bi tehnologija mogla to da promeni.

So in 2016, we partnered with Moonshot CVE

Tako da smo se 2016. udružili sa "Moonshot CVE"

to pilot a new approach to countering radicalization

da sprovedemo novi pristup borbe protiv radikalizacije

called the "Redirect Method."

zvan "Metod preusmeravanja."

It uses the power of online advertising

Koristi potencijal online oglašavanja

to bridge the gap between those susceptible to ISIS's messaging

da premosti jaz između onih podložnih porukama ISIS-a

and those credible voices that are debunking that messaging.

i onih uverljivih glasova koji razbijaju iluzije iz tih poruka.

And it works like this:

Funkcioniše ovako:

someone looking for extremist material --

neko kad traži eksremistički materijal -

say they search for "How do I join ISIS?" --

recimo da pretražuju "Kako da se pridružim ISIS-u?" -

will see an ad appear

videće kako se pojavljuje oglas

that invites them to watch a YouTube video of a cleric, of a defector --

koji ih poziva da pogledaju YouTube video sveštenika, dezertera -

someone who has an authentic answer.

nekoga ko ima autentičan odgovor.

And that targeting is based not on a profile of who they are,

I to targetiranje nije zasnovano na profilu njihove ličnosti

but of determining something that's directly relevant

nego na određivanju nečega što je direktno u vezi

to their query or question.

sa njihovom nedoumicom ili pitanjem.

During our eight-week pilot in English and Arabic,

Tokom našeg osmonedeljnog pilot programa

we reached over 300,000 people

na engleskom i arapskom, dosegli smo preko 300.000 ljudi

who had expressed an interest in or sympathy towards a jihadi group.

koji su izrazili interesovanje ili naklonost prema džihadskoj grupi.

These people were now watching videos

Ovi ljudi su sada gledali klipove

that could prevent them from making devastating choices.

koji bi mogli da ih spreče od pravljenja poražavajućih izbora.

And because violent extremism isn't confined to any one language,

A zbog toga što nasilni ekstremizam nije ograničen samo na jedan jezik,

religion or ideology,

jednu religiju ili ideologiju,

the Redirect Method is now being deployed globally

"Metod preusmeravanja" sada biva globalno raspoređen

to protect people being courted online by violent ideologues,

da zaštiti ljude od izloženosti nasilnih ideologija na internetu,

whether they're Islamists, white supremacists

bilo da su islamisti, beli supremacisti

or other violent extremists,

ili drugi nasilni ekstremisti,

with the goal of giving them the chance to hear from someone

sa ciljem da im da šansu da čuju od nekoga

on the other side of that journey;

sa druge strane tog putovanja;

to give them the chance to choose a different path.

da im damo šansu da odaberu drugačiji put.

It turns out that often the bad guys are good at exploiting the internet,

Ispada da su često loši momci dobri u iskorišćavanju interneta,

not because they're some kind of technological geniuses,

ne zato što su neki tehnološki geniji,

but because they understand what makes people tick.

nego zato što razumeju šta pokreće ljude.

I want to give you a second example:

Hoću da vam dam drugi primer:

online harassment.

uznemiravanje na internetu.

Online harassers also work to figure out what will resonate

Uznemirivači na internetu rade da bi shvatili šta će imati uticaja

with another human being.

na druge ljude.

But not to recruit them like ISIS does,

Ali ne da bi ih regrutovali kao ISIS,

but to cause them pain.

nego da im prouzrokuju bol.

Imagine this:

Zamislite ovo:

you're a woman,

žena ste,

you're married,

venčani ste,

you have a kid.

i imate dete.

You post something on social media,

Objavljujete nešto na društvenim mrežama,

and in a reply, you're told that you'll be raped,

i u komentarima vam je rečeno da ćete biti silovani,

that your son will be watching,

da će vaš sin gledati,

details of when and where.

detalji vremena i mesta.

In fact, your home address is put online for everyone to see.

Zapravo, vaša adresa je stavljena na internet da je svi vide.

That feels like a pretty real threat.

To izgleda kao prava pretnja.

Da li mislite da biste vi otišli kući?

Do you think you'd go home?

Do you think you'd continue doing the thing that you were doing?

Mislite li da biste nastavili da radite stvar koju ste radili?

Da li biste nastavili da radite tu stvar koja iritira vašeg napadača?

Would you continue doing that thing that's irritating your attacker?

Online abuse has been this perverse art

Zloupotreba interneta je izopačena umetnost

of figuring out what makes people angry,

shvatanja šta nervira ljude,

what makes people afraid,

šta ih plaši,

what makes people insecure,

šta ih čini nesigurnim,

and then pushing those pressure points until they're silenced.

a onda stiskanja tih slabih tačaka dok ih ne ućutkaju.

When online harassment goes unchecked,

Kad internet uznemiravanje prođe neprovereno,

free speech is stifled.

slobodan govor je ugušen.

And even the people hosting the conversation

Čak i ljudi koji su osnovali razgovor

throw up their arms and call it quits,

dižu ruke i napuštaju ga,

closing their comment sections and their forums altogether.

zatvarajaći u isti mah sekciju sa komentarima i njihove forume.

That means we're actually losing spaces online

To znači da zapravo gubimo mesta na internetu

to meet and exchange ideas.

za upoznavanje i razmenjivanje ideja.

And where online spaces remain,

I tamo gde internet mesta ostaju,

we descend into echo chambers with people who think just like us.

mi ulazimo u eho-komore sa ljudima koji misle isto kao i mi.

But that enables the spread of disinformation;

Ali to omogućava širenje dezinformacija;

that facilitates polarization.

to olakšava polarizaciju.

What if technology instead could enable empathy at scale?

Šta ako bi tehnologija mogla da omogući empatiju u većoj meri?

This was the question that motivated our partnership

Ovo pitanje je motivisalo naše partnerstvo

with Google's Counter Abuse team,

sa Guglovim timom za suzbijanje zloupotreba,

Wikipedia

Vikipedijom

and newspapers like the New York Times.

i novinama kao što su Njujork Tajms.

We wanted to see if we could build machine-learning models

Želeli smo da vidimo da li bismo mogli da napravimo modele za mašinsko učenje

that could understand the emotional impact of language.

koji mogu da razumeju emocionalni uticaj jezika.

Could we predict which comments were likely to make someone else leave

Možemo li predvideti koji komentari će naterati nekoga da napusti

the online conversation?

internet razgovor?

And that's no mean feat.

A to nije zloban podvig.

That's no trivial accomplishment

To nije trivjalno ostvarenje

for AI to be able to do something like that.

za VI da bude u mogućnosti da uradi nešto tako.

I mean, just consider these two examples of messages

Samo uzmite u obzir ova dva primera poruka

that could have been sent to me last week.

koje su mi mogle biti poslate prošle nedelje.

"Break a leg at TED!"

"Slomi nogu na TED-u!"

... and

...i

"I'll break your legs at TED."

"Polomiću ti noge na TED-u!"

(Laughter)

(Smeh)

You are human,

Vi ste ljudi,

that's why that's an obvious difference to you,

zato je vama to očigledna razlika,

even though the words are pretty much the same.

iako su reči skoro iste.

But for AI, it takes some training to teach the models

Ali za VI je potrebna vežba da bi se podučavali modeli

to recognize that difference.

da bi se te razlike prepoznale

The beauty of building AI that can tell the difference

Lepota izgradnje Vl koja može da kaže razliku

is that AI can then scale to the size of the online toxicity phenomenon,

je da Vl može da odredi veličinu fenomena zatrovanosti na internetu,

and that was our goal in building our technology called Perspective.

i to je bio naš cilj tokom izgradnje naše tehnologije "Perspektiva".

With the help of Perspective,

Pomoću "Perspektive”,

the New York Times, for example,

Njujork Tajms, na primer,

has increased spaces online for conversation.

je povećao mesta na internetu za razgovor.

Before our collaboration,

Pre naše saradnje,

they only had comments enabled on just 10 percent of their articles.

imali su omogućene komentare na samo 10% svojih članaka.

With the help of machine learning,

Pomoću mašinskog učenja,

they have that number up to 30 percent.

povećali su taj broj do 30%.

So they've tripled it,

Pa su ih utrostručili,

and we're still just getting started.

a mi smo tek započeli.

But this is about way more than just making moderators more efficient.

Ovo je o nečemu više od same činjenice da činimo moderatore efikasnijim.

Right now I can see you,

Sada mogu da vas vidim

and I can gauge how what I'm saying is landing with you.

i mogu da ocenim kako vam ovo što pričam ulazi u uši.

You don't have that opportunity online.

Nemate prilike za to na internetu.

Imagine if machine learning could give commenters,

Zamislite kad bi mašinsko učenje moglo dati ljudima koji pišu komentare,

as they're typing,

real-time feedback about how their words might land,

povratne informacije u realnom vremenu

o tome kako njihove reči mogu biti shvaćene,

just like facial expressions do in a face-to-face conversation.

baš kao što izrazi lica to rade u razgovoru licem u lice.

Machine learning isn't perfect,

Mašinsko učenje nije savršeno,

and it still makes plenty of mistakes.

i dalje pravi dosta grešaka.

But if we can build technology

Ali ako možemo izgraditi tehnologiju

that understands the emotional impact of language,

koja razume emocionalni uticaj jezika,

we can build empathy.

možemo da izgradimo empatiju.

That means that we can have dialogue between people

To znači da možemo da imamo dijalog između ljudi

with different politics,

sa različitim politikama,

different worldviews,

drugačijim pogledima na svet,

different values.

drugačijim vrednostima.

And we can reinvigorate the spaces online that most of us have given up on.

i možemo da osvežimo mesta na internetu od kojih smo digli ruke.

When people use technology to exploit and harm others,

Kad ljudi koriste tehnologiju da eksploatišu i čine nažao drugima,

they're preying on our human fears and vulnerabilities.

oni se hvataju za naše strahove i ranjivosti.

If we ever thought that we could build an internet

Ako smo ikad mislili da bismo mogli da izgradimo internet

insulated from the dark side of humanity,

izolovan od mračne strane čovečanstva,

we were wrong.

pogrešili smo.

If we want today to build technology

Ako želimo danas da izgradimo tehnologiju

that can overcome the challenges that we face,

koja može da savlada izazove sa kojima se susrećemo,

we have to throw our entire selves into understanding the issues

moramo da damo sve od sebe da shvatimo probleme

and into building solutions

i da stvaramo rešenja

that are as human as the problems they aim to solve.

koja su ljudska kao i problemi koje oni ciljaju da reše.

Let's make that happen.

Hajde da ostvarimo to.

Thank you.

Hvala vam.

(Applause)

(Aplauz)