When AI Can Fake Reality, Who Can You Trust? | Sam Gregory | TED

翻译人员: Yip Yan Yeung 校对人员: suya f.

It's getting harder, isn't it, to spot real from fake,

有没有觉得辨别真伪、分辨 AI 还是人类生成的结果越来越难了？

AI-generated from human-generated.

With generative AI,

有了生成式 AI，

along with other advances in deep fakery,

加上深度伪造领域的其他进步，

it doesn't take many seconds of your voice,

不需要几秒钟你的声音、 几张你的照片

many images of your face,

to fake you,

就能假扮你，

and the realism keeps increasing.

还越来越逼真。

I first started working on deepfakes in 2017,

我从 2017 年开始研究深度伪造，

when the threat to our trust in information was overhyped,

当时我们对信息信任的威胁被夸大了，

and the big harm, in reality, was falsified sexual images.

其实最大的危害 是伪造的色情图片。

Now that problem keeps growing, harming women and girls worldwide.

这个问题不断加剧， 危害着全世界的妇女和女孩。

But also, with advances in generative AI, we're now also approaching a world

但是，随着生成式 AI 的进步， 我们现在也进入了一个

where it's broadly easier to make fake reality,

更容易制造虚假现实的世界，

but also to dismiss reality as possibly faked.

但也更容易将现实 误认为是虚假的。

Now, deceptive and malicious audiovisual AI

欺骗性和恶意的视听 AI

is not the root of our societal problems,

不是我们社会问题的根源，

but it's likely to contribute to them.

但它很可能会助长这些问题。

Audio clones are proliferating in a range of electoral contexts.

音频克隆在各种选举场合中激增。

"Is it, isn't it" claims cloud human-rights evidence from war zones,

“是吗，不是吗” 的说法 掩盖了战区的人权证据，

sexual deepfakes target women in public and in private,

性深度伪造不分公私地针对女性，

and synthetic avatars impersonate news anchors.

合成形象冒充新闻主播。

I lead WITNESS.

我是首席证人。

We're a human-rights group

我们是一个人权组织，

that helps people use video and technology to protect and defend their rights.

帮助人们使用视频和技术 保护和捍卫自己的权利。

And for the last five years, we've coordinated a global effort,

在过去的五年中， 我们组织了一场全球活动，

"Prepare, Don't Panic,"

名为“做好准备，不要惊慌”，

around these new ways to manipulate and synthesize reality,

围绕这些操纵和合成现实的新方式，

and on how to fortify the truth

以及如何巩固如履薄冰的一线记者和 人权捍卫者带来的真相。

of critical frontline journalists and human-rights defenders.

Now, one element in that is a deepfakes rapid-response task force,

其中一个部分是 深度伪造快速反应工作组，

made up of media-forensics experts

由媒体取证专家和愿意付出 时间和技能的公司组成，

and companies who donate their time and skills

to debunk deepfakes and claims of deepfakes.

揭穿深度伪造和对深度伪造的指控。

The task force recently received three audio clips,

工作组最近收到了三段 来自苏丹、西非和印度的录音片段。

from Sudan, West Africa and India.

People were claiming that the clips were deepfaked, not real.

人们声称这些片段 是深度伪造的，不是真实的。

In the Sudan case,

在苏丹的案例中，

experts used a machine-learning algorithm

专家们使用了一种机器学习算法，

trained on over a million examples of synthetic speech

由超过一百万个合成语音样本训练而成，

to prove, almost without a shadow of a doubt,

几乎毋庸置疑地证明了它是真实的。

that it was authentic.

In the West Africa case,

以西非为例，

they couldn't reach a definitive conclusion

他们无法得出明确的结论，

because of the challenges of analyzing audio from Twitter,

因为分析来自推特的音频有挑战，

and with background noise.

而且有背景噪音。

The third clip was leaked audio of a politician from India.

第三段是一位印度政客泄露的音频。

Nilesh Christopher of “Rest of World” brought the case to the task force.

《世界其他地区》的尼莱什·克里斯托弗 （Nilesh Christopher）

向工作组提交了这个案件。

The experts used almost an hour of samples

专家们使用了将近一个小时的样本

to develop a personalized model of the politician's authentic voice.

开发出了政客真实声音的个性化模型。

Despite his loud and fast claims that it was all falsified with AI,

尽管他大张旗鼓地迅速声称 这些都是用 AI 伪造的，

experts concluded that it at least was partially real, not AI.

但专家得出的结论是， 这至少是部分真实的，而不是 AI。

As you can see,

如你所见，

even experts cannot rapidly and conclusively separate true from false,

即使是专家也无法迅速 又言之凿凿地分辨真伪。

and the ease of calling "that's deepfaked" on something real

而且对真实事物说 “那是深度伪造的”

is increasing.

也越来越容易了。

The future is full of profound challenges,

未来充满了重大的挑战，

both in protecting the real and detecting the fake.

无论是在保护真实还是检测虚假上。

We're already seeing the warning signs

我们已经看到了区分事实与虚构 这一挑战的预警信号。

of this challenge of discerning fact from fiction.

Audio and video deepfakes have targeted politicians,

音频和视频深度伪造的目标是政客、

major political leaders in the EU, Turkey and Mexico,

欧盟、土耳其和墨西哥的主要政治领导人

and US mayoral candidates.

以及美国市长候选人。

Political ads are incorporating footage of events that never happened,

政治广告中包含了 从未发生过的事件的片段，

and people are sharing AI-generated imagery from crisis zones,

人们正在分享危机地区的 AI 生成的图像，

claiming it to be real.

声称这些图像是真实的。

Now, again, this problem is not entirely new.

同样，这并不是一个全新的问题。

The human-rights defenders and journalists I work with

我共事的人权捍卫者和记者

are used to having their stories dismissed,

习惯于他们的报道被无视，

and they're used to widespread, deceptive, shallow fakes,

习惯于广为流传、 欺骗性的、肤浅的赝品、

videos and images taken from one context or time or place

从一个环境、时间或地点 拍摄的视频和图像，

and claimed as if they're in another,

再声称它们取自 另一个环境、时间或地点，

used to share confusion and spread disinformation.

习惯于混淆视听、散布虚假信息。

And of course, we live in a world that is full of partisanship

当然，我们生活在一个充满党派偏见

and plentiful confirmation bias.

和大量证实偏差的世界中。

Given all that,

鉴于此，

the last thing we need is a diminishing baseline

我们最不需要的就是不断降低

of the shared, trustworthy information upon which democracies thrive,

民主赖以蓬勃发展的共享、 可信信息的底线，

where the specter of AI

AI 这个幕后黑手

is used to plausibly believe things you want to believe,

会被用于让你名正言顺地 相信你想相信的事，

and plausibly deny things you want to ignore.

名正言顺地否认你想无视的事。

But I think there's a way we can prevent that future,

但我认为，有这么一个方法 可以让我们防止这样的未来出现，

if we act now;

如果我们现在就采取行动，

that if we "Prepare, Don't Panic,"

如果我们“做好准备，不要惊慌”，

we'll kind of make our way through this somehow.

我们就能以某种方式度过难关。

Panic won't serve us well.

恐慌对我们没有好处。

[It] plays into the hands of governments and corporations

（它）落入了政府和企业的手中，

who will abuse our fears,

他们会滥用我们的恐惧，

and into the hands of people who want a fog of confusion

也落入了那些想要混乱的迷雾

and will use AI as an excuse.

并以人工智能为借口的人手中。

How many people were taken in, just for a minute,

有多少人信以为真， 至少相信了那么一下，

by the Pope in his dripped-out puffer jacket?

教皇穿着炫酷的羽绒服？

You can admit it.

你就承认吧。

(Laughter)

（笑声）

More seriously,

更严重的是，

how many of you know someone who's been scammed

有多少人有认识的人 被像他们孩子的语音骗过？

by an audio that sounds like their kid?

And for those of you who are thinking "I wasn't taken in,

对于那些在想“我可没被骗，

I know how to spot a deepfake,"

我知道怎么分辨深度伪造”的人来说，

any tip you know now is already outdated.

你知道的各种小知识已经过时了。

Deepfakes didn't blink, they do now.

深度伪造以前不会眨眼， 但现在会眨眼。

Six-fingered hands were more common in deepfake land than real life --

六根手指的手在深度伪造的世界 比现实生活常见多了，

not so much.

也不见得如此。

Technical advances erase those visible and audible clues

技术进步抹去了 那些可看见、可听见的痕迹，

that we so desperately want to hang on to

这些我们迫切希望抓住的救命稻草，

as proof we can discern real from fake.

作为我们可以辨别真假的证据。

But it also really shouldn’t be on us to make that guess without any help.

但我们也不该独自 承担做出判断的责任。

Between real deepfakes and claimed deepfakes,

在真正的深度伪造 和声称的深度伪造之间，

we need big-picture, structural solutions.

我们需要宏观的、 结构化的解决方案。

We need robust foundations

我们需要坚实的基础，

that enable us to discern authentic from simulated,

使我们区分真实和仿真，

tools to fortify the credibility of critical voices and images,

我们需要增强重要声音 和图像可信度的工具

and powerful detection technology

以及不会引起更多疑虑的 强大检测技术。

that doesn't raise more doubts than it fixes.

There are three steps we need to take to get to that future.

要走向这样的未来， 我们需要采取三个步骤。

Step one is to ensure that the detection skills and tools

第一步是确保检测技能和工具

are in the hands of the people who need them.

掌握在有需要的人手中。

I've talked to hundreds of journalists,

我已经与数百名记者、

community leaders and human-rights defenders,

社区领袖和人权捍卫者进行了对话，

and they're in the same boat as you and me and us.

他们与你、我和我们不谋而合。

They're listening to the audio, trying to think, "Can I spot a glitch?"

他们听音频的时候会想： “我能听出破绽吗？”

Looking at the image, saying, "Oh, does that look right or not?"

看着图片，说： “哦，看起来对不对？”

Or maybe they're going online to find a detector.

或者他们也许要上网找一个检测器。

And the detector they find,

而他们找到的检测器，

they don't know whether they're getting a false positive, a false negative,

他们不知道自己得到的是假阳性、假阴性

or a reliable result.

还是可靠的结果。

Here's an example.

举个例子。

I used a detector, which got the Pope in the puffer jacket right.

我用了检测器， 它查出了穿着羽绒服的教皇。

But then, when I put in the Easter bunny image that I made for my kids,

但是，当我输入我为孩子们制作的 复活节兔子照片时，

it said that it was human-generated.

它说它是人类生成的。

This is because of some big challenges in deepfake detection.

这是因为深度伪造检测 存在一些重大挑战。

Detection tools often only work on one single way to make a deepfake,

检测工具通常只能用于 检测制作深度伪造的一种途径，

so you need multiple tools,

因此你需要多种工具，

and they don't work well on low-quality social media content.

而且它们不能很好地处理 低质量的社交媒体内容。

Confidence score, 0.76-0.87,

置信度分数为 0.76 到 0.87，

how do you know whether that's reliable,

你该如何得知是否可靠，

if you don't know if the underlying technology is reliable,

如果你都不知道底层技术是否可靠，

or whether it works on the manipulation that is being used?

或者它受到了操控？

And tools to spot an AI manipulation don't spot a manual edit.

而且识别 AI 操控的工具 无法识别手动编辑。

These tools also won't be available to everyone.

这些工具也不是 所有人都可以使用的。

There's a trade-off between security and access,

安全性和可访问性之间 需要权衡取舍，

which means if we make them available to anyone,

意味着如果我们 让任何人都能使用它们，

they become useless to everybody,

它们就会对所有人都毫无用处，

because the people designing the new deception techniques

因为设计新的欺骗技术的人

will test them on the publicly available detectors

会在公开可用的检测器上 对其进行测试，

and evade them.

找到钻空子的方法。

But we do need to make sure these are available

但是，我们确实需要确保 全球的记者、社区领袖、

to the journalists, the community leaders,

the election officials, globally, who are our first line of defense,

选举官员都能获得这些信息， 他们是我们的第一道防线，

thought through with attention to real-world accessibility and use.

慎重考虑现实世界中的可访问性和用途。

Though at the best circumstances,

尽管在最乐观的情况下，

detection tools will be 85 to 95 percent effective,

检测工具的有效性 可以达到 85％ 至 95％，

they have to be in the hands of that first line of defense,

但是它们必须被掌握在 第一道防线的手中，

and they're not, right now.

然而现实并非如此。

So for step one, I've been talking about detection after the fact.

第一步，我一直在谈论事后检测。

Step two -- AI is going to be everywhere in our communication,

第二步，AI 将在 我们的沟通中无处不在，

creating, changing, editing.

创建、修改、编辑。

It's not going to be a simple binary of "yes, it's AI" or "phew, it's not."

它不是“是的，是 AI” 或 “哦，不是”的非黑即白。

AI is part of all of our communication,

AI 是我们所有沟通的一部分，

so we need to better understand the recipe of what we're consuming.

所以我们得更好地了解 我们究竟在使用什么。

Some people call this content provenance and disclosure.

有人称之为“内容来源和披露”。

Technologists have been building ways to add invisible watermarking

技术专家们一直在研究 向 AI 生成的媒体

to AI-generated media.

添加不可见水印的方法。

They've also been designing ways --

他们还在设计一种方法，

and I've been part of these efforts --

我也参与其中，

within a standard called the C2PA,

在符合 C2PA 这一标准的前提下，

to add cryptographically signed metadata to files.

将经过加密签名的元数据 加入文件中。

This means data that provides details about the content,

也就是说， 提供内容详细信息的数据，

cryptographically signed in a way that reinforces our trust

经过了加密签名， 借此增强我们对该信息的信任。

in that information.

It's an updating record of how AI was used to create or edit it,

它是一份不断更新的记录，记下了 AI 如何被用于创建、编辑内容，

where humans and other technologies were involved,

人类和其他技术如何参与其中，

and how it was distributed.

它是如何被传播的。

It's basically a recipe and serving instructions

它就是一份食谱和使用说明，

for the mix of AI and human

描述的对象就是你所见所闻的 AI 和人类的融合。

that's in what you're seeing and hearing.

And it's a critical part of a new AI-infused media literacy.

这是 AI 参与的 新型媒体素养的关键部分。

And this actually shouldn't sound that crazy.

其实听起来没有那么离谱。

Our communication is moving in this direction already.

我们的沟通正在朝这个方向转变。

If you're like me -- you can admit it --

如果你和我一样，就承认吧，

you browse your TikTok “For You” page,

你在浏览抖音的“为你推荐”页面，

and you're used to seeing videos that have an audio source,

你都看惯了带有音频源、

an AI filter, a green screen, a background,

AI 滤镜、绿屏、背景、

a stitch with another edit.

加入混剪的视频。

This, in some sense, is the alpha version of this transparency

从某种意义上说， 这是我们当今使用的

in some of the major platforms we use today.

一些主流平台展现透明度的初级版本。

It's just that it does not yet travel across the internet,

只是它还没有在互联网上传播，

it’s not reliable, updatable, and it’s not secure.

它不可靠、不可更新，而且不安全。

Now, there are also big challenges

这类基础架构在真实性方面 也面临着巨大的挑战。

in this type of infrastructure for authenticity.

As we create these durable signs of how AI and human were mixed,

当我们留下了 AI 和人类结合的持久记录时，

that carry across the trajectory of how media is made,

遍布媒体制作的整个过程，

we need to ensure they don't compromise privacy or backfire globally.

我们得确保它们不会在全球范围内 侵害隐私或适得其反。

We have to get this right.

我们必须做对这一点。

We can't oblige a citizen journalist filming in a repressive context

我们不能强迫公民记者 在受压迫的环境下拍摄，

or a satirical maker using novel gen-AI tools

也不能强迫讽刺作者 使用新型的生成式 AI 工具

to parody the powerful ...

模仿有权有势的人...

to have to disclose their identity or personally identifiable information

强迫披露他们的身份 或个人身份信息

in order to use their camera or ChatGPT.

才能使用他们的相机或 ChatGPT。

Because it's important they be able to retain their ability to have anonymity,

因为在保证创造的工具是透明的同时，

at the same time as the tool to create is transparent.

保障保持匿名的权利非常重要。

This needs to be about the how of AI-human media making,

必须有关于 AI-人类创作媒体的方式，

not the who.

而不是谁去创作。

This brings me to the final step.

这就说到了最后一步。

None of this works without a pipeline of responsibility

如果没有责任链，

that runs from the foundation models and the open-source projects

包括基础模型、开源项目

through to the way that is deployed into systems, APIs and apps,

直至部署到系统、API 和应用程序、

to the platforms where we consume media and communicate.

我们使用媒体、用于交流的平台， 所有这些都行不通。

I've spent much of the last 15 years fighting, essentially, a rearguard action,

在过去的 15 年中，我的大部分时间 投入了最后一搏，

like so many of my colleagues in the human rights world,

如同我在人权届的很多同志们，

against the failures of social media.

抗争社交媒体的失败。

We can't make those mistakes again in this next generation of technology.

我们不能再在下一代技术中犯这些错误。

What this means is that governments

这意味着政府

need to ensure that within this pipeline of responsibility for AI,

必须确保在 AI 的责任链上，

there is transparency, accountability and liability.

有透明度、职责义务、法律责任。

Without these three steps --

如果没有这三个步骤——

detection for the people who need it most,

为最需要的人提供检测器、

provenance that is rights-respecting

尊重权利的来源、

and that pipeline of responsibility,

责任链，

we're going to get stuck looking in vain for the six-fingered hand,

我们就是在徒劳地寻找 六根手指的手、不会眨眼的眼睛。

or the eyes that don't blink.

We need to take these steps.

我们必须采取这些步骤。

Otherwise, we risk a world where it gets easier and easier

否则，我们就会有风险 看见这样的世界，越来越容易

to both fake reality

捏造现实，

and dismiss reality as potentially faked.

又把现实当作可能是伪造的。

And that is a world that the political philosopher Hannah Arendt

政治哲学家汉娜·阿伦特 （Hannah Arendt）

described in these terms:

这样描述了这个世界：

"A people that no longer can believe anything

“一个再也无法相信任何东西的人

cannot make up its own mind.

无法下定决心。

It is deprived not only of its capacity to act

他/她不仅被剥夺了行动能力，

but also of its capacity to think and to judge.

还被剥夺了思考和判断的能力。

And with such a people you can then do what you please."

这样的人能让你随心所欲。”

That's a world I know none of us want,

我知道这是我们都不想见到的世界，

that I think we can prevent.

我认为我们可以避免让它来临。

Thanks.

谢谢。

(Cheers and applause)

（欢呼和掌声）