How to keep human bias out of AI | Kriti Sharma

Translator: Ivana Korom Reviewer: Joanna Pietrulewicz

翻译人员: jacks peng 校对人员: Bighead Ge

How many decisions have been made about you today,

你今天，这周，或今年

or this week or this year,

有多少决定

by artificial intelligence?

是人工智能（AI）做出的？

I build AI for a living

我靠创建AI为生，

so, full disclosure, I'm kind of a nerd.

所以，坦白说，我是个技术狂。

And because I'm kind of a nerd,

因为我是算是个技术狂，

wherever some new news story comes out

每当有关于人工智能 要抢走我们的工作

about artificial intelligence stealing all our jobs,

这样的新闻报道出来，

or robots getting citizenship of an actual country,

或者机器人获得了 一个国家的公民身份时，

I'm the person my friends and followers message

我就成了对未来感到 担忧的朋友和关注者

freaking out about the future.

发消息的对象。

We see this everywhere.

这种事情随处可见。

This media panic that our robot overlords are taking over.

媒体担心机器人 正在接管人类的统治。

We could blame Hollywood for that.

我们可以为此谴责好莱坞。

But in reality, that's not the problem we should be focusing on.

但现实中，这不是 我们应该关注的问题。

There is a more pressing danger, a bigger risk with AI,

人工智能还有一个更紧迫的 危机， 一个更大的风险，

that we need to fix first.

需要我们首先应对。

So we are back to this question:

所以我们再回到这个问题：

How many decisions have been made about you today by AI?

今天我们有多少决定 是由人工智能做出的？

And how many of these

其中有多少决定

were based on your gender, your race or your background?

是基于你的性别，种族或者背景？

Algorithms are being used all the time

算法一直在被用来

to make decisions about who we are and what we want.

判断我们是谁，我们想要什么。

Some of the women in this room will know what I'm talking about

在座的人里有些女性 知道我在说什么，

if you've been made to sit through those pregnancy test adverts on YouTube

如果你有上千次 被要求看完YouTube上

like 1,000 times.

那些怀孕测试广告，

Or you've scrolled past adverts of fertility clinics

或者你在Faceboo的短新闻中

on your Facebook feed.

刷到过生育诊所的广告。

Or in my case, Indian marriage bureaus.

或者我的遇到的情况是， 印度婚姻局。

（笑声）

(Laughter)

But AI isn't just being used to make decisions

但人工智能不仅被用来决定

about what products we want to buy

我们想要买什么产品，

or which show we want to binge watch next.

或者我们接下来想刷哪部剧。

I wonder how you'd feel about someone who thought things like this:

我想知道你会怎么看这样想的人：

"A black or Latino person

“黑人或拉丁美洲人

is less likely than a white person to pay off their loan on time."

比白人更不可能按时还贷。”

"A person called John makes a better programmer

“名叫约翰的人编程能力

than a person called Mary."

要比叫玛丽的人好。”

"A black man is more likely to be a repeat offender than a white man."

“黑人比白人更有可能成为惯犯。”

You're probably thinking,

你可能在想，

"Wow, that sounds like a pretty sexist, racist person," right?

“哇，这听起来像是一个有严重 性别歧视和种族歧视的人。” 对吧？

These are some real decisions that AI has made very recently,

这些都是人工智能 近期做出的真实决定，

based on the biases it has learned from us,

基于它从我们人类身上

from the humans.

学习到的偏见。

AI is being used to help decide whether or not you get that job interview;

人工智能被用来帮助决定 你是否能够得到面试机会；

how much you pay for your car insurance;

你应该为车险支付多少费用；

你的信用分数有多好；

how good your credit score is;

and even what rating you get in your annual performance review.

甚至你在年度绩效评估中 应该得到怎样的评分。

But these decisions are all being filtered through

但这些决定都是 通过它对我们的身份、

its assumptions about our identity, our race, our gender, our age.

种族、性别和年龄的 假设过滤出来的。

How is that happening?

为什么会这样？

Now, imagine an AI is helping a hiring manager

想象一下人工智能 正在帮助一个人事主管

find the next tech leader in the company.

寻找公司下一位科技领袖。

So far, the manager has been hiring mostly men.

目前为止，主管雇佣的大部分是男性。

So the AI learns men are more likely to be programmers than women.

所以人工智能知道男人比女人 更有可能成为程序员，

And it's a very short leap from there to:

也就更容易做出这样的判断：

men make better programmers than women.

男人比女人更擅长编程。

We have reinforced our own bias into the AI.

我们通过人工智能强化了自己的偏见。

And now, it's screening out female candidates.

现在，它正在筛选掉女性候选人。

Hang on, if a human hiring manager did that,

等等，如果人类招聘主管这样做，

we'd be outraged, we wouldn't allow it.

我们会很愤怒， 不允许这样的事情发生。

This kind of gender discrimination is not OK.

这种性别偏见让人难以接受。

And yet somehow, AI has become above the law,

然而，或多或少， 人工智能已经凌驾于法律之上，

because a machine made the decision.

因为是机器做的决定。

That's not it.

这还没完。

We are also reinforcing our bias in how we interact with AI.

我们也在强化我们与 人工智能互动的偏见。

How often do you use a voice assistant like Siri, Alexa or even Cortana?

你们使用Siri，Alexa或者Cortana 这样的语音助手有多频繁？

They all have two things in common:

它们有两点是相同的：

one, they can never get my name right,

第一点，它们总是搞错我的名字，

and second, they are all female.

第二点，它们都有女性特征。

They are designed to be our obedient servants,

它们都被设计成顺从我们的仆人，

turning your lights on and off, ordering your shopping.

开灯关灯，下单购买商品。

You get male AIs too, but they tend to be more high-powered,

也有男性的人工智能， 但他们倾向于拥有更高的权力，

like IBM Watson, making business decisions,

比如IBM的Watson可以做出商业决定，

Salesforce Einstein or ROSS, the robot lawyer.

还有Salesforce的Einstein 或者ROSS, 是机器人律师。

So poor robots, even they suffer from sexism in the workplace.

所以即便是机器人也没能 逃脱工作中的性别歧视。

(Laughter)

（笑声）

Think about how these two things combine

想想这两者如何结合在一起，

and affect a kid growing up in today's world around AI.

又会影响一个在当今人工智能 世界中长大的孩子。

So they're doing some research for a school project

比如他们正在为学校的 一个项目做一些研究，

and they Google images of CEO.

他们在谷歌上搜索了CEO的照片。

The algorithm shows them results of mostly men.

算法向他们展示的大部分是男性。

And now, they Google personal assistant.

他们又搜索了个人助手。

As you can guess, it shows them mostly females.

你可以猜到，它显示的大部分是女性。

And then they want to put on some music, and maybe order some food,

然后他们想放点音乐， 也许想点些吃的，

and now, they are barking orders at an obedient female voice assistant.

而现在，他们正对着一位 顺从的女声助手发号施令。

Some of our brightest minds are creating this technology today.

我们中一些最聪明的人 创建了今天的这个技术。

Technology that they could have created in any way they wanted.

他们可以用任何他们 想要的方式创造技术。

And yet, they have chosen to create it in the style of 1950s "Mad Man" secretary.

然而，他们却选择了上世纪50年代 《广告狂人》的秘书风格。

Yay!

是的，你没听错！

But OK, don't worry,

但还好，不用担心。

this is not going to end with me telling you

这不会因为我告诉你

that we are all heading towards sexist, racist machines running the world.

我们都在朝着性别歧视、 种族主义的机器前进而结束。

The good news about AI is that it is entirely within our control.

人工智能的好处是， 一切都在我们的控制中。

We get to teach the right values, the right ethics to AI.

我们得告诉人工智能 正确的价值观，道德观。

So there are three things we can do.

所以有三件事我们可以做。

One, we can be aware of our own biases

第一，我们能够意识到自己的偏见

and the bias in machines around us.

和我们身边机器的偏见。

Two, we can make sure that diverse teams are building this technology.

第二，我们可以确保打造 这个技术的是背景多样的团队。

第三，我们必须让它 从丰富的经验中学习。

And three, we have to give it diverse experiences to learn from.

I can talk about the first two from personal experience.

我可以从我个人的经验来说明前两点。

When you work in technology

当你在科技行业工作，

and you don't look like a Mark Zuckerberg or Elon Musk,

并且不像马克·扎克伯格 或埃隆·马斯克那样位高权重，

your life is a little bit difficult, your ability gets questioned.

你的生活会有点困难， 你的能力会收到质疑。

Here's just one example.

这只是一个例子。

Like most developers, I often join online tech forums

跟大部分开发者一样， 我经常参加在线科技论坛，

分享我的知识帮助别人。

and share my knowledge to help others.

And I've found,

我发现，

when I log on as myself, with my own photo, my own name,

当我用自己的照片， 自己的名字登陆时，

I tend to get questions or comments like this:

我倾向于得到这样的问题或评论：

"What makes you think you're qualified to talk about AI?"

“你为什么觉得自己 有资格谈论人工智能？”

"What makes you think you know about machine learning?"

“你为什么觉得你了解机器学习？”

So, as you do, I made a new profile,

所以，我创建了新的资料页，

and this time, instead of my own picture, I chose a cat with a jet pack on it.

这次，我没有选择自己的照片， 而是选择了一只带着喷气背包的猫。

And I chose a name that did not reveal my gender.

并选择了一个无法体现我性别的名字。

You can probably guess where this is going, right?

你能够大概猜到会怎么样，对吧？

So, this time, I didn't get any of those patronizing comments about my ability

于是这次，我不再收到 任何居高临下的评论，

and I was able to actually get some work done.

我能够专心把工作做完。

And it sucks, guys.

这感觉太糟糕了，伙计们。

I've been building robots since I was 15,

我从15岁起就在构建机器人，

I have a few degrees in computer science,

我有计算机科学领域的几个学位，

and yet, I had to hide my gender

然而，我不得不隐藏我的性别

in order for my work to be taken seriously.

以让我的工作被严肃对待。

So, what's going on here?

这是怎么回事呢？

Are men just better at technology than women?

男性在科技领域就是强于女性吗？

Another study found

另一个研究发现，

that when women coders on one platform hid their gender, like myself,

当女性程序员在平台上 隐藏性别时，像我这样，

their code was accepted four percent more than men.

她们的代码被接受的 比例比男性高4%。

So this is not about the talent.

所以这跟能力无关。

This is about an elitism in AI

这是人工智能领域的精英主义，

that says a programmer needs to look like a certain person.

即程序员看起来得像 具备某个特征的人。

What we really need to do to make AI better

让人工智能变得更好， 我们需要切实的

is bring people from all kinds of backgrounds.

把来自不同背景的人集合到一起。

We need people who can write and tell stories

我们需要能够书写和讲故事的人

to help us create personalities of AI.

来帮助我们创建人工智能更好的个性。

We need people who can solve problems.

我们需要能够解决问题的人。

We need people who face different challenges

我们需要能应对不同挑战的人，

and we need people who can tell us what are the real issues that need fixing

我们需要有人告诉我们什么是 真正需要解决的问题，

and help us find ways that technology can actually fix it.

帮助我们找到用技术 解决问题的方法。

Because, when people from diverse backgrounds come together,

因为，当不同背景的人走到一起时，

when we build things in the right way,

当我们以正确的方式做事情时，

the possibilities are limitless.

就有无限的可能。

And that's what I want to end by talking to you about.

这就是我最后想和你们讨论的。

Less racist robots, less machines that are going to take our jobs --

减少种族歧视的机器人， 减少夺走我们工作的机器——

and more about what technology can actually achieve.

更多专注于技术究竟能实现什么。

So, yes, some of the energy in the world of AI,

是的，人工智能世界中，

in the world of technology

科技世界中的一些能量

is going to be about what ads you see on your stream.

是关于你在流媒体中看到的广告。

But a lot of it is going towards making the world so much better.

但更多是朝着让世界更美好的方向前进。

Think about a pregnant woman in the Democratic Republic of Congo,

想想刚果民主共和国的一位孕妇，

who has to walk 17 hours to her nearest rural prenatal clinic

需要走17小时才能 到最近的农村产前诊所

to get a checkup.

进行产检。

What if she could get diagnosis on her phone, instead?

如果她在手机上 就能得到诊断会怎样呢？

Or think about what AI could do

或者想象一下人工智能

for those one in three women in South Africa

能为1/3面临家庭暴力的

who face domestic violence.

南非女性做什么。

If it wasn't safe to talk out loud,

如果大声说出来不安全的话，

they could get an AI service to raise alarm,

她们可以通过一个 人工智能服务来报警，

get financial and legal advice.

获得财务和法律咨询。

These are all real examples of projects that people, including myself,

这些都是包括我在内， 正在使用人工智能的人

所做的项目中的真实案例。

are working on right now, using AI.

So, I'm sure in the next couple of days there will be yet another news story

我确信在未来的几十天里面， 会有另一个新闻故事，

about the existential risk,

告诉你们，

robots taking over and coming for your jobs.

机器人会接管你们的工作。

(Laughter)

（笑声）

And when something like that happens,

当这样的事情发生时，

I know I'll get the same messages worrying about the future.

我知道我会收到 同样对未来表示担忧的信息。

But I feel incredibly positive about this technology.

但我对这个技术极为乐观。

This is our chance to remake the world into a much more equal place.

这是我们重新让世界 变得更平等的机会。

But to do that, we need to build it the right way from the get go.

但要做到这一点，我们需要 在一开始就以正确的方式构建它。

We need people of different genders, races, sexualities and backgrounds.

我们需要不同性别，种族， 性取向和背景的人。

We need women to be the makers

我们需要女性成为创造者，

and not just the machines who do the makers' bidding.

而不仅仅是听从创造者命令的机器。

We need to think very carefully what we teach machines,

我们需要仔细思考 我们教给机器的东西，

what data we give them,

我们给它们什么数据，

so they don't just repeat our own past mistakes.

这样它们就不会 只是重复我们过去的错误。

So I hope I leave you thinking about two things.

所以我希望我留给你们两个思考。

First, I hope you leave thinking about bias today.

首先，我希望你们思考 当今社会中的的偏见。

And that the next time you scroll past an advert

下次当你滚动刷到

that assumes you are interested in fertility clinics

认为你对生育诊所

or online betting websites,

或者网上投注站有兴趣的广告时，

这会让你回想起

that you think and remember

that the same technology is assuming that a black man will reoffend.

同样的技术也在假定 黑人会重复犯罪。

Or that a woman is more likely to be a personal assistant than a CEO.

或者女性更可能成为 个人助理而非CEO。

And I hope that reminds you that we need to do something about it.

我希望那会提醒你， 我们需要对此有所行动。

And second,

第二，

I hope you think about the fact

我希望你们考虑一下这个事实，

that you don't need to look a certain way

你不需要以特定的方式去看，

or have a certain background in engineering or technology

也不需要有一定的工程或技术背景

to create AI,

去创建人工智能，

which is going to be a phenomenal force for our future.

人工智能将成为我们未来的 一股非凡力量。

You don't need to look like a Mark Zuckerberg,

你不需要看起来像马克·扎克伯格，

you can look like me.

你可以看起来像我。

And it is up to all of us in this room

我们这个房间里的所有人都有责任

to convince the governments and the corporations

去说服政府和公司

to build AI technology for everyone,

为每个人创建人工智能技术，

including the edge cases.

包括边缘的情况。

And for us all to get education

让我们所有人都能

about this phenomenal technology in the future.

在未来接受有关这项非凡技术的教育。

Because if we do that,

因为如果我们那样做了，

then we've only just scratched the surface of what we can achieve with AI.

才刚刚打开了人工智能世界的大门。

Thank you.

谢谢。

(Applause)

（鼓掌）