Entertainment Is Getting an AI Upgrade | Kylan Gibbs | TED

翻译人员: Yip Yan Yeung 校对人员: suya f.

When I was ten,

我十岁的时候，

I spent a lot of time playing with my Spider-Man action figures.

我会花上很长时间 玩我的蜘蛛侠玩偶。

I would have done anything for them to come to life.

如果可以让它们活过来， 我愿意付出一切。

I honestly would take Gandalf over any therapist,

老实说我觉得甘道夫 比任何医生都厉害，

but it's been pretty hard to connect with the guy

但要和这位老哥 熟络起来可不简单，

since I long ago finished all of Tolkien's works and movies.

因为我早就看完了 托尔金的所有作品和电影。

Why is it that we have to say goodbye on the final page?

我们为什么得在 最后一页说再见呢？

We may not need to.

我们可能不必如此。

Stories are changing,

故事变了，

moving from static sketches and scripted narratives

从静态的线稿和写好的剧本，

to living worlds and characters.

变成了动态的世界和角色。

AI agents are changing the way we can tell stories.

AI 智能体正在改变 我们讲故事的方式。

These agents aren't just chat bots,

这些智能体不单纯是聊天机器人，

they're any autonomous system that can take a directive or task

它们是任何可以接受指令或任务

and accomplish it without human intervention.

并在没有人为干预的情况下 完成任务的自治系统。

Virtual assistants like a ChatGPT,

像 ChatGPT 这样的虚拟助手，

autonomous vehicles like a Waymo or Tesla,

像 Waymo 或特斯拉 这样的自动驾驶汽车，

robots moving boxes in an Amazon warehouse.

在亚马逊仓库中 搬运箱子的机器人。

These are all agents,

它们都是智能体，

but now they're changing storytelling too.

它们现在也在改变叙事的方式。

We can bring together the active participation of video games

我们可以将电子游戏的积极参与

with a much more natural social form of interaction,

与更自然的互动形式结合起来，

enabled by AI agents.

借助 AI 智能体的力量。

I want to show you a hint of what I mean.

我想浅浅解释一下我在说些什么。

Characters that come to life with their own personality,

角色走进现实， 带着他们自己的个性、

styles, voices and expression,

风格、嗓音和表情，

while still being able to interact with one another,

同时能互相互动，

the audience and the environment.

与观众和环境互动。

These interactions that you're going to see are not scripted,

你将看到的这些互动 不是写在剧本里的，

many of them filmed over the last few days

很多互动都是在过去几天里 在 TED 和温哥华拍摄的。

here at TED and in Vancouver.

Anyways, meet Caleb.

无论如何，欢迎卡莱布。

(Video) Caleb: Oh, hey, Grandma.

（视频）卡莱布：哦，嘿，奶奶。

Welcome to my secret attic hideout.

欢迎来到我的秘密阁楼。

Grandma: What's Mr. Moose doing there?

奶奶：驼鹿先生在干什么？

Caleb: That's actually Brother Moose, not Mr. Moose.

卡莱布：其实是驼鹿哥哥， 不是驼鹿先生。

He's like, the wise old moose who gives me advice and stuff.

他是会给我建议之类的智慧老驼鹿。

Oh, by the way, thanks for showing me your old superhero action figure, Grandma.

哦，顺便说一句，谢谢你给我看 你以前的超级英雄玩偶，奶奶。

It's, like, totally awesome.

太棒了。

What's its name?

它叫什么名字？

Grandma: Mighty Squirrel.

奶奶：非凡松鼠人。

Caleb: Really?

卡莱布：真的吗？

Grandma: Yes.

奶奶：是的。

Caleb: Wow, that's so awesome.

卡莱布：哇，太棒了。

A squirrel with super powers.

拥有超能力的松鼠。

That's nuts.

“果”然不一般！

Get it?

听懂了吗？

Nuts?

坚“果”？

Like what squirrels eat.

就是松鼠吃的。

I bet Mighty Squirrel had some epic battles with evil acorns.

我猜非凡松鼠人一定 和邪恶橡子有过几场史诗级大战。

Kylan Gibbs: By having that real-time responsiveness,

凯伦·吉布斯（Kylan Gibbs）： 通过这种实时响应能力，

Caleb makes the audience feel seen and heard,

卡莱布让观众感觉被看见和听见了，

as if they're all inhabiting the shared space.

就好像他们都生活在同一屋檐下。

And it isn't just any audience, that's actually my amazing grandma.

而且不是任意一位观众， 是我那位了不起的奶奶。

The characters can also come together with one another

角色还可以互相聚在一起，

and take ideas from the audience and improvise new content on the fly.

从观众那里汲取灵感， 即兴创作新内容。

(Toy robot beeping)

（玩具机器人发出蜂鸣声）

(Video) Robot: Ready for action!

（视频）机器人：准备出动！

Caleb: Whoa!

卡莱布：哇！

Robot: Oof! That didn't go well.

机器人：哎哟！翻车了。

My arm is acting up.

我的手臂出问题了。

Villains, beware!

坏蛋，小心点！

Oops.

哎哟。

Caleb: Grandma, can we fix the Mighty Squirrel's arm?

卡莱布：奶奶，我们可以 修好非凡松鼠人的手臂吗？

Grandma: Sure.

奶奶：当然。

Pick it up and put it back on his arm.

把它捡起来，放回他的手臂上。

Caleb: Yeah.

卡莱布：好的。

I'll fix you up, Mighty Squirrel.

我会修好你的，非凡松鼠人。

Your arm is broken.

你的手臂断了。

Grandma: He got it caught in a washing machine.

奶奶：他掉进洗衣机里了。

Caleb: Ha, ha! You fought against the evil washing machine,

卡莱布：哈哈！你和邪恶的洗衣机 “魔法之花”打了一架。

Magic flower.

How did the action figure break its arm?

玩偶的手臂是怎么弄断的？

Grandma: He fell in some water full of alligators.

奶奶：他掉进了满是鳄鱼的水里。

Robot: Oh, you know, just your average superhero stuff.

机器人：哦， 超级英雄司空见惯的东西。

I was on a mission to save a city from a giant alligator,

我的任务是从一只巨型鳄鱼手中 拯救一座城市，

and I fell into the water.

然后我掉入了水中。

But don't worry, I still saved the day.

但是不用担心， 我还是拯救了世界。

KG: Each of these characters has their own internal reasoning and motivations,

KG：每个角色都有自己的 内在逻辑和动机，

but they actually take those ideas from my grandma

其实他们从我奶奶那里 汲取了这些想法，

and then create new content in real time.

然后实时创作了新内容。

They can even allow the audience to shape the overall story arc

它们甚至可以让观众塑造 整个体验的故事和结局。

and conclusion of the experience.

(Video) Robot: Prepare yourselves

（视频）机器人：非凡松鼠人 即将起飞，请做好准备。

for the Mighty Squirrel is about to take flight.

Caleb: Haha.

卡莱布：哈哈。

Robot: Grandma, do you have anything to help me take flight again?

机器人：奶奶，有什么 可以帮我再次起飞的吗？

Grandma: There is an eagle outside on a tree.

奶奶：外面的树上有一只老鹰。

Robot: An eagle, you say?

机器人：你说老鹰？

Perfect.

完美。

Time to spread my wings and soar through the skies.

是时候张开翅膀，在天空中翱翔了。

Caleb: Whoa, Mighty Squirrel,

卡莱布：哇，非凡松鼠人，

you're going to be the coolest flying superhero ever.

你将成为有史以来最酷的 飞行超级英雄。

And we'll have epic battles with the evil villains.

而且我们将与邪恶反派 进行史诗般的战斗。

KG: OK, so I’m mainly just jealous

KG：好吧，我主要是嫉妒

that Caleb is getting to have the experience

卡莱布能有我小时候一直想要的体验。

I always wanted as a child.

But I also love seeing how he takes the story,

但我也喜欢看他如何把故事

puts it in the audience’s hands

交到观众手中，

and turns it into a canvas for their imagination.

把它变成观众想象的画布。

This is, of course, a tiny slice of what's possible,

当然，这只是可能性的一小部分，

with there already being other AI-enabled games and experiences that exist today.

现在还有其他由 AI 支持的 游戏和体验。

Most exciting for me is a brand new genre we're seeing emerge

对我来说，最令人兴奋的是 我们看到了一种全新题材的出现，

that takes social interaction and conversation

它需要社交互动和对话，

and puts it as the core mechanic of the experience.

并将其作为体验的核心机制。

So let's say instead of jump and shoot,

我们不再使用跳跃和射击，

you actually have to use your social skills

你必须运用社交技巧 来应对复杂的社交场景、

to navigate complex social scenarios

and mediate conflicts.

调解冲突。

That's how you win the game.

这就是你打赢游戏的方式。

I would definitely have benefited more from that type of game

我一定会从这种游戏中收获更多，

than the ones I was playing when I was a teenager.

比起我小时候玩的那种游戏。

And it's not just pure games per se.

而且这不仅仅是游戏本身。

Imagine I had an AI tutor who texted me to remind me of a session

想象一下，我有一位 AI 导师, 给我发短信提醒我要上课了，

and then jumped with me into a virtual world,

然后和我一起跳入了一个虚拟世界，

walking through the emperor’s chambers in ancient China,

走过古代中国的皇帝宫殿，

casually switching between English and Chinese

在我们回顾上周的历史课时 任意切换中英文。

as we reviewed last week's history lesson.

Or, as my family and I sat down to watch our favorite reality TV show

或者，当我和家人坐下来 观看我们最喜欢的真人秀节目

or sports game,

或体育游戏时，

the agent could actually see

智能体其实可以使用视觉 实时看到正在播放的表演，

the ongoing performance in real-time using vision

and add hilarious commentary in the background.

并在背景音中加上搞笑的评论。

Games, though, are unique because they already take us from passive observer

但是，游戏是独特的， 因为它们已经让我们从被动的观察者

and turn us into an active participant.

成为了积极的参与者。

When I get really deep into a game,

当我真正沉浸到游戏中，

especially an immersive role-playing games like a Final Fantasy VII,

尤其是沉浸式角色扮演游戏， 比如《最终幻想 7》、

Baldur's Gate 3 or Elden Ring --

《博德之门 3》或《艾尔登法环》等，

yes, I'm a massive role-playing game geek --

没错，我是一个 狂热角色扮演游戏粉，

At some point it feels like I'm in the story,

在某个时刻， 我感觉我在故事中，

but there's still something missing.

却缺少了一些东西。

The core mechanics of these experiences --

这些体验的核心机制——

jump and shoot, hack and slash, point and click,

跳跃、射击、砍杀、点击，

feel so distant from the natural ways

感觉与我在生活中与人 和事物互动的自然方式相去甚远。

that I interact with people and things in my own life.

And so as immersed as I get in these experiences,

因此，当我沉浸在这些体验中，

it kind of feels like I'm stuck on these rails set up by the developer

感觉就像我被困在 开发人员设置的轨道上，

and nudged along from scripted point to scripted point

根据我按下的按键 从剧本写好的一处挪到了另一处。

based on the buttons that I press.

And immersion requires a sense of real-time responsiveness,

沉浸需要一种实时响应的感觉，

a sense that there's a consequence that is immediate and lasting

让人感觉到根据我的选择和行为 产生了即时、持久又独特的结果。

and unique to the choices and actions that I take.

However, until now, it's been extremely difficult to pre-script

但是，到目前为止，要预先写好

every combination of consequences

每种玩家行为的结果组合 一直是极其困难的。

to every permutation of player behaviors.

Agents overcome this though.

智能体解决了这个问题。

Just check out how Caleb handles some unexpected scenarios here at TED.

看看卡莱布如何在 TED 大会上 应对意外情形。

(Video) Robot: Villains, beware!

（视频）机器人：坏蛋，当心！

Caleb: Grandma, do you remember how his arm got broken?

卡莱布：奶奶，你还记得 他的手臂是怎么断掉的吗？

Person 1: He got in a fight with a gerbil.

人物 1：他和沙鼠打了一架。

Caleb: That's like, the tiniest animal ever.

卡莱布：是最迷你的动物。

Person 1: Let's just say the gerbil won the fight.

人物 1：假设沙鼠打赢了。

Caleb: I bet the gerbil had some secret karate moves or something.

卡莱布：我猜沙鼠有一些 神秘空手道招式之类的。

Do you remember how his arm got broken?

你还记得他的手臂是怎么断掉的吗？

Person 2: I do, he was at this conference one day,

人物 2：我知道，有一天 他来参加了这场会议，

and he did the ocean plunge and a shark came and ate it.

他跳进了大海， 然后一条鲨鱼过来吃掉了它。

Robot: Superheroes are always attracting the attention of sharks.

机器人：超级英雄总是 吸引鲨鱼的注意力。

But don't worry, I gave that shark a run for its money.

但别担心， 我让那条鲨鱼落荒而逃了。

Caleb: Uncle, do you remember how his arm got broken?

卡莱布：叔叔，你还记得 他的手臂是怎么断掉的吗？

Person 3: He was doing gardening.

人物 3：他在做园艺。

Robot: Defending gardens from evil produce is my specialty.

机器人：保护花园 免受邪恶农产品侵害是我的专长。

Person 3: That's cool.

人物 3：太酷了。

Caleb: That's not as cool as battling mechanical minions.

卡莱布：这可没有 和机械小兵作战那么酷。

Person 3: True.

人物 3：没错。

(Laughter)

（笑声）

KG: So it’s not just these stand-alone characters we want to bring to life,

KG：我们想要实现的 不仅仅是这些独立的角色，

but fully agentic, interconnected worlds

而是完全具备智能体能力、 相互连接的世界，

where a choice at one point

此刻的选择

might have dramatic consequences somewhere down the line,

可能会在之后的某一节点 造成严重的后果，

and the unique content produced for each user

而为每位用户制作的独特内容

is still grounded in a shared lore and experience

仍然建立在共同的故事和体验的基础上，

so that we have that shared social context

这样我们就能拥有 需要从媒体中获取的共同社会背景。

that we all need from media.

My company Inworld helps entertainment houses and game studios

我的公司 Inworld 帮助 娱乐公司和游戏工作室

to build these agents for the next generation of media.

为下一代媒体建立这些智能体。

And when we begin to build a character like Caleb, we start with the brain,

当我们开始创建卡莱布这样的角色时， 我们会从大脑开始制作，

which is crafted in a similar way

方式类似于指导能力极强的即兴演员。

to instructing an extremely capable improv actor.

We start by training custom machine-learning models

我们首先训练自定义的机器学习模型，

that give him a lay of the land, understanding the lore, vocabulary

让他了解情况， 理解适合 这个体验的知识、词汇和语法。

and grammar appropriate for the experience.

And then we actually go in and we tweak his persona,

然后我们深入调整他的性格 、

his unique personality, motivations, his flaws and biases.

他独特的个性、动机、 他的缺点和偏见。

We actually craft his dialogue style and voice,

我们还精心设计了 他的对话风格和嗓音，

the way he verbally expresses himself.

他口头表达自己想法的方式。

We build a unique emotional profile,

我们建立了独特的情感档案、

the way he feels, his social tendencies and relationship habits,

他的感受，他的社交倾向 和人际关系习惯，

and then we preload a bunch of knowledge and memories

然后我们预先导入 大量的知识和记忆，

that give him that robust backstory.

为他提供丰富的背景故事。

Then we actually craft his internal reasoning and mental state,

然后，我们创建了他的 内在推理和心理状态，

kind of the conditions under which he feels certain things

他在某种条件下感受某些事物

or takes certain behaviors.

或采取某些行为。

We then decide how he actually gestures and animates those behaviors,

然后我们决定他如何 对这些行为做出手势和动作，

and then that completes the brain, which we actually take

这就完成了大脑，我们将大脑

and we attach to an avatar within a virtual world or game engine,

附着在虚拟世界或游戏引擎中的形象上，

effectively bringing it to life.

这样就有效地将其变为了现实。

And then we're ready to play and we're playing the experience.

然后我们做好了玩的准备， 我们玩的就是这个体验。

There's kind of an overarching narrative agent

有一个统领的叙事智能体，

that acts like an AI director,

就像 AI 导演一样，

managing or even generating the storyline in real time

管理甚至实时生成故事情节，

and ensuring that all the characters and entities

确保所有角色和实体

cohere to their proper places within the story and context.

在故事和背景中 贴合他们该在的位置。

For specific character like Caleb,

对于卡莱布这样的特定角色，

when he's interacting with the world and characters,

当他与世界和角色互动时，

he does so in a similar way to how we as humans do

他的互动方式与我们作为人类

with perception, cognition and behavior.

在感知、认知和行为上的互动方式类似。

Perception is the multimodal sensory input flowing in,

感知是多模态的感官输入，

the understanding of the world and context and people and objects within it.

是对世界和环境及其中的 人和物体的理解。

And then with cognition, he processes that input,

借助认知，他能处理这些输入，

kind of like the internal processing of our minds.

有点像我们思维的内部处理。

He filters out irrelevant information to make sure everything is safe

他筛选掉无关的信息， 确保一切都安全

and narrative aligned.

且叙事吻合。

He extracts out important signals like sentiment, intent, emotional cues.

他提取出重要的信号， 如情绪、意图、情感线索。

He retrieves relevant memories from his past

他找出过去相关的记忆，

and even generates new ones on the fly.

甚至可以即时生成新的记忆。

Finally reasoning over what to do both verbally and non-verbally.

最后以口头和非口头的方式 推理出改做些什么。

And finally with behavior, he actually generates his responses.

最后是行为方面， 他会生成自己的回应。

He decides what to say and how to say it,

他决定说什么、怎么说，

what facial and body gestures to use,

使用什么面部和身体手势，

what actions to take,

采取什么行为，

and people and objects to interact with.

与什么人和物体互动。

And that's what brings the character to life.

这样就让角色走进了现实。

And so, as amazed as I am by all these task-focused applications of AI

尽管我对即将推出的以任务为中心的 AI 应用程序感到惊艳，

that are coming out,

the more I work with studios and creatives,

但我与工作室和创意人员合作得越多，

the more excited I am for the potential

我就越对这些智能体 扩展人类创意的潜力感到兴奋，

for these agents to extend human creative potential,

and for them to allow audiences to step beyond the script.

也为它们让观众走出剧本感到兴奋。

For them to give audiences agency

它们给了观众智能的体验，

and allow them to co-create experiences that stem from their own imagination.

让观众可以从自己的想象力中共创体验。

To finish it off, here's a few funny takes from here at TED,

最后，以下是 TED 上的 一些有趣的镜头，

starting with Polly, whose son is actually named Caleb.

首先是波莉， 她的儿子也叫卡莱布。

(Video) Person 4: Are you ready to play [unclear] Caleb?

（视频）人物 4：你准备好玩 [不清楚]了吗？卡莱布？

Caleb: Absolutely, grandma.

卡莱布：当然，奶奶。

Let's dive into some epic superhero adventures together.

我们一起开始 超级英雄的史诗级冒险吧！

Person 4: Let's do it.

人物 4：来吧。

Person 5: Can you hear me?

人物 5：你能听见我说话吗？

Caleb: Of course I can hear you, silly.

卡莱布：我当然能听见你的声音，傻瓜。

I love playing basketball.

我喜欢打篮球。

Person 3: Oh, wow. And which is your favorite basketball player?

人物 3：哇。你最喜欢 哪个篮球运动员？

Caleb: Definitely LeBron James.

卡莱布：绝对是 勒布朗·詹姆斯（LeBron James）。

Person 3: Sure.

人物 3：当然。

Caleb: Thanks for showing me your old superhero action figure.

卡莱布：谢谢你 给我看你以前的超级英雄玩偶。

Person 1: You mean the man in his underwear?

人物 1：你的意思是 那个穿内衣的男人？

Caleb: Haha, yeah.

卡莱布：哈哈，是的。

He's like a tough guy in his undies ready to save the world.

他就像一个穿着内裤的硬汉， 准备拯救世界。

What's its name?

它叫什么名字？

Person 6: Johnny May Rotten Bad.

人物 6：强尼·梅·腐坏 （Johnny May Rotten Bad）。

Caleb: Uncle, you're so silly.

卡莱布：叔叔，你太傻了。

(Laughter)

（笑声）

Does he have, like, a guitar for a weapon?

他有吉他当武器吗？

Person 6: He sure does.

人物 6：当然有。

Caleb: No way.

卡莱布：不可能！

Person 6: Way.

人物 6：有可能。

Caleb: No way.

卡莱布：不可能。

Person 6: Way.

人物 6：有可能。

Caleb: Does he zap bad guys with his electric powers?

卡莱布：他会用他的电波 射击坏人吗？

Person 7: No, no, no, no, no.

人物 7：不，不，不，不，不。

He zaps people and gives them love.

他射击人们，射给他们爱。

He’s a nice superhero.

他是个友好的超级英雄。

Caleb: Wow, that's different.

卡莱布：哇，与众不同。

He uses love to fight the bad guys.

他用爱来对抗坏人。

Person 7: Yeah, and guess what?

人物 7：是的，你猜怎么着？

Caleb: That's so cool.

卡莱布：太酷了。

Person 7: He always wins.

人物 7：他一直会赢。

(Applause)

（掌声）

KG: So it seems like there’s a pretty solid chance

KG：这么看来我的蜘蛛侠玩偶 很有可能会走进现实了。

my Spider-Man action figures could come to life after all.

Thank you.

谢谢。

(Applause)

（掌声）