How a Deepfake Almost Ruined My Political Career | Cara Hunter | TED

翻译人员: Jovina Ma 校对人员: Bruce Wang

This talk contains mature language

这个演讲包含了成熟的语言

“You’re a little whore,

“你是个小婊子，

and we've all seen your little video."

我们都看过你的小视频。”

That was the text message that was sent to me in April of 2022.

那是2022年4月发给我的短信。

I'm sitting in my grandmother's living room

在祖母90岁生日那天，我正坐

in what is her 90th birthday,

在她的起居室里，

surrounded by family and friends

周围是家人和朋友，

as my phone blows up with messages from strangers

来自全国各地的陌生人发来的消息， 令我的手机炸了.

right across the country

who say they have seen a video of me

他们说他们看过一段

关于我和一个男人进行硬核色情活动的视频。

engaging in hardcore pornographic activity with a man.

I knew this was impossible.

我知道这是不可能的。

With just three weeks out from my election,

I felt as though my career was crumbling before my very eyes.

我感觉自己的职业生涯好像在我眼前崩溃 了。

My heart pounded,

我的心跳加速，

my mind raced, sweat beaded on my skin.

心跳加速，汗水流过我的皮肤。

And then I watched the video, and my worst fear was realized.

然后我看了视频， 我最大的恐惧意识到了。

Although this woman in the video was not me,

尽管视频 中的这个女人不是我，但

she looked exactly like me.

她长得和我一模一样。

Impossibly like me.

不可能像我一样。

Eerily like me.

怪异地像我。

I had so many questions running through my mind.

我脑海里浮现了很多问题。

Was this AI?

这是人工智能吗？

Was it not?

不是吗？

Who made this?

谁做了这个？

How did they make it?

他们是怎么做到的？

Why did they make it?

他们为什么这样做？

So I did what anyone would do,

因此，我做了任何人都会做的事情，

and I approached my local police service to ask for advice, for guidance.

然后我联系了当地的警察部门， 寻求建议和指导。

And really, where did I go from there?

真的，我从那里去了哪里？

But they informed me that they wouldn't have the cybercrime technology to assist,

但是他们告诉我，他们 没有网络犯罪技术可以提供帮助，

to find out where this video came from.

也无法了解这段视频的来源。

And it was from that moment I knew that I was on my own.

从那一刻起，我就 知道自己只能靠自己了。

Now to set the stage, as you can probably tell,

现在要做好准备， 正如你可能知道的那样，

I’m from Ireland,

我来自爱尔兰，

and to be exact, I'm from Northern Ireland,

确切地说， 我来自北爱尔兰，

which is an even smaller place.

那是一个更小的地方。

We have just 1.8 million people,

我们只有180万人口，

very similar to the size of Vienna.

与维也纳的面积非常相似。

So you can imagine a rumor of this sinister nature,

因此，你可以想象，关于这种险恶性质的谣言，

particularly in the world of politics, can go very far, very fast.

特别是在政治领域， 可以传播得非常广，非常快。

And that old saying, “seeing is believing” began to haunt me.

那句老话 “眼见为实” 开始困扰着我。

And in the weeks leading up to my election,

在我当选前的几周里，这个视频，

this video, this false video,

这个虚假的视频，在WhatsApp上 被分享了成千上万次。

was shared thousands and thousands of times across WhatsApp.

And attached to this video was photos of me at work,

这段视频附有我在工作、

smiling, campaigning,

微笑、竞选、与选民 建立信任感的照片。

building a sense of trust with my constituents.

And as the weeks went on,

随着几周的流逝，

messages flooded in faster and faster,

信息的涌入速度越来越快，

and they were of a very vile and sexual nature.

而且它们具有非常卑鄙 和色情的性质。

Ding!

叮！

"We've all seen your little video."

“我们都看过你的小视频。”

Ding!

叮！

"You should be ashamed of yourself."

“你应该为自己感到羞耻。”

Ding!

叮当！

"Ah, now I see how you got your position in politics."

“啊，现在我明白 你是如何获得政治地位的。”

It was very difficult.

这非常困难。

And having been in politics since the age of 23,

我从23岁 起就进入政界，

and at this point I've been in it for about four to five years,

此时我已经在政治领域工作了大约四到五年，

and I'm from Northern Ireland, which is a post-conflict society,

我来自北爱尔兰， 这是一个冲突后社会，

still very deeply divided.

仍然存在严重的分歧。

So I anticipated challenges,

因此，我预见了挑战，

I anticipated disagreements,

我预见了分歧，

I even anticipated attacks, is politics after all.

我甚至预见了袭击，毕竟是政治。

But what I did not anticipate was this moment.

但我没想到的是这一刻。

This was different.

这不一样。

This was the moment where misogyny meets the misuse of technology,

这是厌女症与滥用技术相遇的时刻，

and even had the potential to impact the outcome of a democratic election.

甚至有可能影响民主 选举的结果。

And the sad thing for me was this lie became so far spread,

对我来说，可悲的是，这个谎言传播得

so far, so fast,

如此之远，如此之快，

that even my own family started to believe it.

以至于连我自己的家人也 开始相信。

Some would say that they'd heard it at a golf club,

有些人会说他们在高尔夫俱乐部听过，

others would say they heard it at the bar,

另一些人会说他们在酒吧听过，

and of course, some even said they heard it in a locker room.

当然，有些人甚至说 他们在更衣室里听见了。

A really good example of how far this went

一个很好的例子说明了这件事走 了多远，我知道我一生

was people that I knew my entire life

would pass me in the street without whispering a word.

都在街上遇见我时不发一言地走过。

People like school teachers,

像学校老师这样的人，

people I had a sense of trust with

我信任的人，你知道的，

and, you know, an affinity with.

和我有亲和力的人。

And that was really hard.

那真的很难。

It felt like overnight I was wearing a scarlet letter.

感觉就像一夜之间 我戴着一封猩红色的字母。

And as things moved on

随着事情的发展，

and were about two, three weeks out from the election,

距离选举还有大约两三 周的时间，

I kept receiving messages, and it got wider and wider.

我不断收到信息， 而且信息越来越广泛。

It was global.

这是全球性的。

Not only was I receiving messages from Dublin and from London,

我不仅收到了 来自都柏林和伦敦的消息，

but I was also receiving messages from Massachusetts, Manhattan,

我还收到了来自马萨诸塞州、

and I was getting so many follows on my political social media,

曼哈顿的消息，我的政治社交媒体 上获得了很多关注，

predominantly from men hungry for more of this scandal.

主要来自 渴望更多地了解这起丑闻的人。

And this intersection of online harms impacting my real life

而这种影响我现实生活的网络危害交汇点

was something I found utterly strange and surreal.

令我感到非常怪异和超现实。

But it got to the point where I was recognized on the street

但是到了这样 的地步：我在街上被认出来

and approached by a stranger who asked me for a sexual favor.

并被一个陌生 人走近，他向我寻求性方面的帮助。

And it was just, for me, it was like in the blink of an eye,

只是，对我来说， 就像在眨眼之间，

everything had just changed,

一切都变了，

and it was utterly humiliating.

太丢脸了。

I didn't want to leave the house,

我不想离开家，

and I had turned notifications off in my phone

我关闭了手机中的通知

just so I could kind of catch my breath,

只是为了屏住呼吸，

but this wasn't ideal in the lead up, of course, to an election.

但这在选举之前 当然并不理想。

And for me, I think that was the purpose of this false video, was to do just that.

对我来说，我认为这就是这段虚假视频 的目的，就是这么做。

But what hurt the most for me

但是对我来说最痛苦 的是让父亲坐下

was sitting down my father

and having to explain to him this strange, surreal situation.

而且必须向他解释 这种奇怪的、超现实的情况。

My father is an Irishman,

我父亲是爱尔兰人，

completely disconnected from tech,

与科技完全脱节，

and so having to explain

因此不得不解释

this horrific situation was an entire fabrication

这种可怕的情况完全是捏造的，

was very hard to do.

很难做到。

This was this strange moment

这是一个奇怪的时刻，

where the online world met my life, my reality.

网络世界遇到了我的生活，我的现实。

Not only having the impact to ruin my reputation,

不仅会破坏我的声誉，

but have the capacity to change the outcome

而且有能力改变民主选举的结果。

of a democratic election.

And, you know,

而且，你知道，

for years I spent so much time building trust with my constituents.

多年来我花了很多时间与选民 建立信任。

I mean, we all know how much people like politicians.

我的意思是，我们都知道人们 有多喜欢政治家。

You know, we’re as likeable as the tax man.

你知道，我们和税务人员 一样讨人喜欢。

So for me, it was hard.

所以对我来说，这很难。

It was really hard

这真的很难，

because it was years of hard work.

因为这是多年的辛勤工作。

You know, I’m so passionate about my job,

你知道，我对自己的工作充满热情，

and this video, this complete falsehood,

而这段视频完全是虚假的，

had the ability to just undermine years of hard work in mere seconds.

能够在短短几秒钟内破坏多 年的辛勤工作。

But instead of succumbing entirely to victimhood,

但是，我没有完全屈服于受害者身份，

I ask myself today,

而是问自己，

you know, where do we go from here?

你知道吧，我们该走向何方？

And how can AI evolve to prevent something like this happening again?

以及人工智能如何发展以防止这样 的事情再次发生？

Not only has it happened to me,

这不仅发生在我身上，

but we want to future-proof and ensure that this doesn't happen

而且我们希望经得起未来考验， 确保明天的女性不会发生这种情况。

to the women of tomorrow.

How can we, you and I, people who care about people,

我们，你和我，关心他人的人， 如何才能确保这是一项有益的技术？

ensure that this is a tech for good?

How can we, the policymakers, the creators, the consumers,

我们，决策者，创造者， 消费者，如何

ensure we regulate AI and things like social media,

确保我们监管人工智能 和社交媒体等事物，

putting humans and humanity at the center of artificial intelligence?

将人类和人性置于人工智能的中心？

AI can change the world.

人工智能可以改变世界。

In fact, as we've heard today, it already has.

实际上，正如我们今天所听到的那样， 它已经做到了。

In a matter of seconds,

在短短几秒钟内， 说完全不同语言的人

people who speak completely different languages

can connect and understand one another.

可以相互联系和理解。

And we've even seen the Pope as a style icon in a puffer jacket.

我们甚至将教皇 视为身穿羽绒夹克的时尚偶像。

So some really important uses right there.

所以这里有一些非常重要的用途。

But then in my case as well,

但是，就我而言，

we can also see how it is weaponized against the truth.

我们也可以看到它是如何用武器来 对抗真相的。

And good examples of this would be art that appears like reality,

这方面的一个很好的例子是看似现实的 艺术、

AI-generated reviews unfairly boosting certain products

人工智能生成的 不公平地宣传某些产品的评论

and things like chatbot propaganda.

以及诸如聊天机器人宣传之类的东西。

And then, politically speaking,

然后，从政治上讲，这些年来， 我们已经看到南希·佩洛西口齿不清、

we've seen over the years deepfakes of Nancy Pelosi slurring,

Joe Biden cursing

乔·拜登在诅咒，

and even President Zelensky

甚至泽伦斯基总统 要求他的士兵交出武器的假话。

asking his soldiers to surrender their weapons.

So when AI is used like this, to manipulate,

因此，当这样使用人工智能进行操纵时，

it can be a threat to our democracy.

它可能会对我们的民主构成威胁。

And the tech is becoming so advanced

而且这项技术变得如此先进，

that it's hard to differentiate fact from fiction.

以至于很难区分 事实和虚构。

So how does AI interfere with politics?

那么，人工智能如何干扰政治呢？

And for us as politicians, what should we be worried about?

对于我们作为政治家来说，我们应该担心 什么？

Could truth and democracy become shattered by AI?

人工智能 会粉碎真理和民主吗？

Has it already?

已经发生了吗？

Well, to dive a little deeper here,

好吧，为了更深入地了解一下，

I think firstly we need to talk about the concept of truth.

我认为首先我们需要谈 谈真理的概念。

Without truth, democracy collapses.

没有真相，民主就会崩溃。

Truth allows us to make informed decisions,

真理使我们能够 做出明智的决定，

it enables us to hold leaders accountable, which is very important.

它使我们能够追究领导者的责任， 这非常重要。

And it also allows us, as political representatives,

它还使我们作为政治代表

to create a sense of trust with our citizens and our constituents.

能够与我们的公民和选民建立信任感。

But without that truth,

但是，如果没有这个真相，

democracy is vulnerable to misinformation,

民主很容易受到错误信息、

manipulation, and, of course, corruption.

操纵，当然还有腐败的影响。

When AI erodes truth,

当人工智能侵蚀真理时，

it erodes trust,

它就会侵蚀信任，

and it undermines our democracy.

破坏我们的民主。

And for me, in my experience with a deepfake,

对我来说，根据我使用deepfake 的经验，

I've seen what a fantastic distortion tool that deepfakes really are.

我已经看到了deepfakes到底是多棒的失真工具。

So how can we safeguard democracy from this ever-advancing technology?

那么，我们怎样才能保护民主 免受这种不断进步的技术的侵害呢？

It's becoming ever harder to distinguish between real and synthetic content.

And politically, what role does AI play in the future?

在政治上，人工智能在未来扮演 什么角色？

And I can't talk about politics without talking about media as well.

如果不谈论媒体，我 就谈不上政治。

They're undeniably linked, they're intertwined.

不可否认，它们是相互关联的，交织 在一起的。

And I think journalism has its own battle here as well.

而且我认为新闻业在这里 也有自己的战斗。

From AI algorithms boosting articles unfairly

从人工智能算法不公平地 提升文章

to clickbait headlines,

到点击诱饵头条，

and then also moments where they can manipulate the public as well.

再到他们也可以 操纵公众的时刻。

But politically speaking,

但是从政治上讲，

we've seen AI-tailored political messaging

我们已经看到人工智能量身定制的政治信息

influencing voters,

影响了选民，

we’ve seen it adding to existing bias.

我们看到它加剧了现有的偏见。

And definitely I think we all have that aunt that’s on Facebook

当然，我认为我们都有那个在 Facebook 上的什么都相信的阿姨。

and kind of believes anything.

So for me, as a politician,

因此，对我来说，作为一名政治家，我认为 深入研究人工智能、

I think it's really important we dive a little deeper

into the relationship of AI, journalism and media.

新闻和媒体之间的关系非常重要。

But it also puts us at risk

但这也使我们面临制造更加分裂 和反动社会的风险，

of creating a more divided and reactionary society,

because falsehoods can create a lot of reaction.

因为虚假信息会引起 很多反应。

And for myself, coming from Northern Ireland,

就我自己而言， 来自北爱尔兰，

which is that post-conflict society,

也就是冲突后的社会，

I do have concerns about how it could shape our political landscape

我确实担心它会如何 影响我们的政治格局

and other places across the globe.

和全球其他地方。

Sadly, this deepfake video

可悲的是，这段深度伪造的视频

is not the only instance of me having experienced abuse with AI.

并不是我 遭受人工智能虐待的唯一例子。

Just six months ago,

就在六个月前，

I received 15 deepfake images of myself in lingerie

我收到了15张自己穿着内衣挑衅性 摆姿势的deepfake照片。

posing provocatively.

And I thought to myself, here we go again.

然后我心想，又开始了。

And you know, I spoke with some other female politicians.

而且你知道，我 和其他一些女性政治家谈过。

Thankfully, where I represent, we have more women getting into politics.

值得庆幸的是，在我所代表的地方， 有更多的女性参政。

But I had a really good conversation with them,

但我和他们进行了非常愉快的 交谈， 如果现在发生在你身上，

and it’s around, if this is happening to you now,

what happens to me tomorrow?

明天我会怎样？

And I think this really strikes at the heart of the climate of fear

而且我认为这确实触及了人工智能可能 为公共生活中的人们造成的恐惧气氛的核心。

that AI can create for those in public life.

And I don't blame women.

而且我不怪女人。

It's very sad.

太可悲了。

I don't blame women for not wanting to get into politics

我不责怪女性在看到这种 技术出现时不想参政，

when they see this kind of technology come forward,

so that's so important that we safeguard it.

所以保护它非常重要。

What also concerned me was the position of elderly voters

同样令我 担忧的是老年选民的地位，

and perhaps their media literacy,

也许还有他们的媒体素养，

their comprehension of this technology.

他们对这项技术的理解。

People who don't use the internet,

不使用互联网的人， 他们可能对人工智能及其许多用途一无所知。

who perhaps are not aware of AI and its many, many uses.

So that was really concerning as well.

所以这也非常令人担忧。

But it doesn't have to be this way.

但不一定是这样。

We can be part of the change.

我们可以成为变革的一部分。

For me and my video,

对于我和我的视频，直到今天 我还不知道是谁干的。

I still don't know, to this day, who did this.

I can imagine why they did it, but I don't know who did it.

我能想象他们为什么这么做， 但我不知道是谁干的。

And sadly for me and for across the globe,

不幸的是，对我和全球而言，

it still wouldn't be considered a crime.

它仍然不会被视为犯罪。

So from being the enemy of fair, transparent,

因此，从公平、透明、

good-natured politics,

善良的政治，

to warfare, to international interference,

到战争，再到国际干预，

despite its beauty and its potential,

尽管它既美观又有潜力，

AI is still a cause for concern.

人工智能仍然令人担忧。

But it doesn't have to be this way.

但不一定是这样。

I feel passionately that AI can be a humanistic technology

我深深地感到，人工智能可以成为 一种具有人类价值观的人文技术，

with human values

that complements the lives that we live

它可以补充我们的生活，

to make us the very best versions of ourselves.

使我们成为自己最好的 版本。

But to do that,

但是要做到这一点，

I think we need to embed ethics into this technology,

我认为我们需要 将伦理纳入这项技术，

to eliminate bias, to install empathy

消除偏见，树立同理心，

and make sure it is aligned with human values and human principles.

并确保它 与人类价值观和人类原则保持一致。

Who knows, our democracy could depend on it.

谁知道，我们的民主 可能取决于它。

And today I know we have some of the brightest minds in this room.

今天我知道这个房间里 有一些最聪明的人。

I heard some of the talks earlier, and I'm certain of that.

我之前听过一些会谈， 我确信这一点。

And I know each and every one of you have weight on your shoulders

而且我知道展望未来时， 你们每一个人都有重担。

when looking to the future.

But I also know each and every one of you want to see this tech for good.

但我也知道你们每个人都 希望看到这项技术用在好的事情上。

And what gives me hope

给我带来希望的是目睹全球各地的运动，

is witnessing the movement right across the globe

to see this hard journey begin,

看到这段艰难的旅程开始，

to regulate this ever-advancing technology,

监管这个不断进步的技术，

which can be used for bad or for good.

它可以用来做坏事，也可以用来做好事。

But perhaps we, each and every one of us in this room,

但是，也许我们，在座的每一个人，

can be part of finding the solution.

都可以参与寻找解决方案。

(Applause)

（掌声）