Entertainment Is Getting an AI Upgrade | Kylan Gibbs | TED

譯者: 楊佳穎 118-30 審譯者: Shelley Tsang 曾雯海

When I was ten,

當我十歲時，

I spent a lot of time playing with my Spider-Man action figures.

我花了很多時間和我的 蜘蛛人可動模型玩耍。

I would have done anything for them to come to life.

為了讓它們活過來， 我願意做任何事。

I honestly would take Gandalf over any therapist,

老實說，我會選擇甘道夫 來取代任何治療師，

but it's been pretty hard to connect with the guy

但我從很久以前便讀完 所有托爾金的著作及電影，

since I long ago finished all of Tolkien's works and movies.

與甘道夫之間的聯繫 變得非常困難。

Why is it that we have to say goodbye on the final page?

為什麼我們必須 在最後一頁說再見？

We may not need to.

我們可能不需要。

Stories are changing,

故事正在改變，

moving from static sketches and scripted narratives

從靜態草圖和劇本式敘述，

to living worlds and characters.

轉移到活生生的世界和角色。

AI agents are changing the way we can tell stories.

人工智能代理正在改變 我們說故事的方式。

These agents aren't just chat bots,

這些代理不僅僅是聊天機器人，

they're any autonomous system that can take a directive or task

它們是任何能接受指令或任務，

and accomplish it without human intervention.

不須人類干預便能 完成目標的自主系統。

Virtual assistants like a ChatGPT,

虛擬助手，例如 ChatGPT，

autonomous vehicles like a Waymo or Tesla,

自動駕駛車輛， 例如 Waymo 或特斯拉，

robots moving boxes in an Amazon warehouse.

以及在亞馬遜倉庫中 移動箱子的機器人。

These are all agents,

這些都是代理，

but now they're changing storytelling too.

然而，現今他們也在改變 故事的敘述手法。

We can bring together the active participation of video games

我們可以將對 電玩遊戲的積極參與，

with a much more natural social form of interaction,

與人工智能代理所支援，一種 更自然的社交互動形式

enabled by AI agents.

結合在一起。

I want to show you a hint of what I mean.

我想向你們展示一下 我說的是什麼意思。

Characters that come to life with their own personality,

活靈活現的角色除了 具備自己的個性、

styles, voices and expression,

風格、聲音和表情之外，

while still being able to interact with one another,

還能與其他角色、

the audience and the environment.

觀眾和環境互動。

These interactions that you're going to see are not scripted,

這些你即將看見的互動 並非事先編寫好，

many of them filmed over the last few days

其中許多都是過去幾天

here at TED and in Vancouver.

在 TED 和溫哥華拍攝的。

Anyways, meet Caleb.

總之，見見卡萊布。

(Video) Caleb: Oh, hey, Grandma.

（影片）卡萊布：哦，嘿，奶奶。

Welcome to my secret attic hideout.

歡迎來到我的秘密閣樓藏身處。

Grandma: What's Mr. Moose doing there?

奶奶：駝鹿先生在那裡做什麼？

Caleb: That's actually Brother Moose, not Mr. Moose.

卡萊布：實際上那是駝鹿老哥， 而不是駝鹿先生。

He's like, the wise old moose who gives me advice and stuff.

他就像，會給我建議 之類的聰明老鹿。

Oh, by the way, thanks for showing me your old superhero action figure, Grandma.

哦，順帶一提，

謝謝你給我看你的 舊超級英雄可動模型，奶奶。

It's, like, totally awesome.

實在是太讚了。

What's its name?

它的名字是什麼？

Grandma: Mighty Squirrel.

奶奶：超能松鼠。

Caleb: Really?

卡萊布：真的？

Grandma: Yes.

奶奶：是的。

卡萊布：哇，真棒。

Caleb: Wow, that's so awesome.

A squirrel with super powers.

一隻擁有超能力的松鼠。

That's nuts.

那真是瘋狂（nuts）。

Get it?

懂嗎？

Nuts?

堅果（nuts）？

Like what squirrels eat.

就像松鼠吃的。

I bet Mighty Squirrel had some epic battles with evil acorns.

我敢肯定超能松鼠和邪惡橡實 進行過一些史詩級的戰鬥。

Kylan Gibbs: By having that real-time responsiveness,

凱倫‧吉布斯：透過自己的 即時響應能力，

Caleb makes the audience feel seen and heard,

卡萊布使觀眾感覺 被看到、被聽到，

as if they're all inhabiting the shared space.

彷彿他們都處在同一個空間。

And it isn't just any audience, that's actually my amazing grandma.

而且那不是任意觀眾， 她其實是我引以為傲的奶奶。

The characters can also come together with one another

角色們也可以彼此聚在一起，

and take ideas from the audience and improvise new content on the fly.

從觀眾那裡獲取想法， 並即興、即時地創作新內容。

(Toy robot beeping)

（玩具機器人發出嗶嗶聲）

(Video) Robot: Ready for action!

（影片）機器人：準備行動！

Caleb: Whoa!

卡萊布：哇！

Robot: Oof! That didn't go well.

機器人：呃！事情不太順利。

My arm is acting up.

我的手臂出了狀況。

Villains, beware!

惡棍們，當心！

Oops.

糟糕。

Caleb: Grandma, can we fix the Mighty Squirrel's arm?

卡萊布：奶奶，我們能修理 超能松鼠的手臂嗎？

Grandma: Sure.

奶奶：當然。

Pick it up and put it back on his arm.

把他的手拿起來放回原位。

Caleb: Yeah.

卡萊布：好。我會 修好你的，超能松鼠。

I'll fix you up, Mighty Squirrel.

Your arm is broken.

你的手臂斷了。

Grandma: He got it caught in a washing machine.

奶奶：他之前 在洗衣機裡夾到手。

Caleb: Ha, ha! You fought against the evil washing machine,

卡萊布：哈哈！你對抗了 邪惡的洗衣機，

魔法花花。

Magic flower.

How did the action figure break its arm?

這個可動人偶是 怎麼弄斷它的手臂的？

Grandma: He fell in some water full of alligators.

奶奶：他掉進充滿鱷魚的水中。

Robot: Oh, you know, just your average superhero stuff.

機器人：哦，你知道的， 就是超級英雄都會做的事。

I was on a mission to save a city from a giant alligator,

我當時正在執行任務， 拯救一個城市免於巨鱷侵害，

and I fell into the water.

然後我墜入水中。

But don't worry, I still saved the day.

但別擔心，我仍然轉危爲安。

KG: Each of these characters has their own internal reasoning and motivations,

凱吉：每個角色都有自己的 內在推理和動機，

but they actually take those ideas from my grandma

但他們實際上是從我奶奶 那裡獲得那些想法，

and then create new content in real time.

並即時創建新內容。

They can even allow the audience to shape the overall story arc

他們甚至可以讓觀眾 塑造整體的故事情節和

and conclusion of the experience.

這場體驗的結局。

(Video) Robot: Prepare yourselves

（影片）機器人：做好準備，

for the Mighty Squirrel is about to take flight.

超能松鼠即將起飛。

Caleb: Haha.

卡萊布：哈哈。

Robot: Grandma, do you have anything to help me take flight again?

機器人：奶奶，你有什麼 能幫助我再次起飛嗎？

Grandma: There is an eagle outside on a tree.

奶奶：外面有一隻老鷹在樹上。

Robot: An eagle, you say?

機器人：你說一隻老鷹嗎？

Perfect.

完美。

Time to spread my wings and soar through the skies.

該是我展翅高飛、 翱翔天際的時候了。

Caleb: Whoa, Mighty Squirrel,

卡萊布：哇，超能松鼠，

you're going to be the coolest flying superhero ever.

你會是史上最酷的 飛行超級英雄。

And we'll have epic battles with the evil villains.

然後我們會跟邪惡的反派 進行史詩級的戰鬥。

KG: OK, so I’m mainly just jealous

凱吉：好吧，我主要在嫉妒

that Caleb is getting to have the experience

卡萊布能得到我小時候

一直很想要的體驗。

I always wanted as a child.

但我也很喜歡看他 如何把故事

But I also love seeing how he takes the story,

puts it in the audience’s hands

放到觀眾手中，

and turns it into a canvas for their imagination.

並將故事轉化為 他們想像力的畫布。

This is, of course, a tiny slice of what's possible,

當然，這只是 眾多可能性的一小部分，

with there already being other AI-enabled games and experiences that exist today.

現今已經存在其他 人工智能支援的遊戲和體驗。

Most exciting for me is a brand new genre we're seeing emerge

最令我興奮的是，

我們正在見證一種 全新類型的體驗出現，

that takes social interaction and conversation

它採用社交互動與對話

and puts it as the core mechanic of the experience.

作為體驗的核心機制。

So let's say instead of jump and shoot,

比如說，你不需要 跳躍與射擊，

you actually have to use your social skills

事實上，你必須使用 自己的社交技能

to navigate complex social scenarios

來應對複雜的社交情境

and mediate conflicts.

並調解衝突。

That's how you win the game.

這就是你贏得遊戲的方式。

I would definitely have benefited more from that type of game

我肯定會從這類型的 遊戲中受益良多，

than the ones I was playing when I was a teenager.

更勝於我青少年時玩的遊戲，

And it's not just pure games per se.

而且它本身不只是純粹的遊戲。

Imagine I had an AI tutor who texted me to remind me of a session

想像我有一位人工智能導師， 它傳簡訊提醒我該上課了，

and then jumped with me into a virtual world,

然後它跟我一起跳進 一個虛擬世界，

walking through the emperor’s chambers in ancient China,

走過古代中國皇帝的內室，

casually switching between English and Chinese

並在我們複習上週歷史課的同時，

as we reviewed last week's history lesson.

隨意地在英文與中文之間切換，

Or, as my family and I sat down to watch our favorite reality TV show

或者，當我和家人坐下來觀賞 我們最喜歡的真人實境秀

or sports game,

或體育比賽時，

the agent could actually see

人工智能代理實際上可以

the ongoing performance in real-time using vision

使用其視覺即時觀看 正在進行的演出，

and add hilarious commentary in the background.

並在後台添加有趣的評論。

Games, though, are unique because they already take us from passive observer

然而，遊戲是獨特的，

因為它們已經 將我們從消極的觀察者

and turn us into an active participant.

變成一個積極的參與者。

When I get really deep into a game,

當我深深投入一個遊戲，

especially an immersive role-playing games like a Final Fantasy VII,

尤其是沉浸式角色扮演遊戲， 如《最終幻想 VII》、

Baldur's Gate 3 or Elden Ring --

《柏德之門 3》或《艾爾登法環》——

沒錯，我是個狂熱的 角色扮演遊戲極客——

yes, I'm a massive role-playing game geek --

At some point it feels like I'm in the story,

有些時候，雖然感覺好像 我身處於故事之中，

but there's still something missing.

但仍缺少了些什麼。

The core mechanics of these experiences --

這些體驗的核心機制——

jump and shoot, hack and slash, point and click,

跳躍和射擊、劈砍、揮斬， 指向和點擊，

feel so distant from the natural ways

感覺與我自己在生活中

that I interact with people and things in my own life.

與人事物互動的 自然方式非常遙遠。

And so as immersed as I get in these experiences,

儘管我沉浸在這些體驗當中，

但我感覺像是被困在 開發者設置的軌道上，

it kind of feels like I'm stuck on these rails set up by the developer

並根據我按下的按鈕 從一個劇本安排的點

and nudged along from scripted point to scripted point

based on the buttons that I press.

被推動到下一個點。

And immersion requires a sense of real-time responsiveness,

而且，身歷其境需要 一種即時響應的感知功能。

a sense that there's a consequence that is immediate and lasting

這種感應會根據我的選擇與行動

and unique to the choices and actions that I take.

產生立即且持久、 獨一無二的結果。

However, until now, it's been extremely difficult to pre-script

然而，到目前為止，針對 玩家行為的每一種排列，

every combination of consequences

事先編寫出所有結果的組合

to every permutation of player behaviors.

是極為困難的。

Agents overcome this though.

不過，人工智能代理克服了這點。

Just check out how Caleb handles some unexpected scenarios here at TED.

看看卡萊布在 TED 這裡 是如何處理一些意外情況的。

(Video) Robot: Villains, beware!

（影片）機器人：惡棍，當心！

Caleb: Grandma, do you remember how his arm got broken?

卡萊布：奶奶，你還記得 他的手臂是怎麼斷的嗎？

Person 1: He got in a fight with a gerbil.

人員 1 ：他和一隻沙鼠打架。

Caleb: That's like, the tiniest animal ever.

卡萊布：那就像， 史上最迷你的動物。

Person 1: Let's just say the gerbil won the fight.

人員 1 ：我們可以說是 沙鼠贏得了戰鬥。

Caleb: I bet the gerbil had some secret karate moves or something.

卡萊布：我敢肯定那隻沙鼠擁有 一些秘密的空手道招式之類的。

Do you remember how his arm got broken?

你還記得他的手臂是怎麼斷的嗎？

Person 2: I do, he was at this conference one day,

人員 2 ：我記得， 有一天他來參加會議，

and he did the ocean plunge and a shark came and ate it.

然後潛入海中，就有一隻鯊魚 過來吃了他的手臂。

Robot: Superheroes are always attracting the attention of sharks.

機器人：超級英雄總是在 吸引鯊魚的注意力。

But don't worry, I gave that shark a run for its money.

但別擔心，我讓那隻鯊魚 吃了不少苦頭。

Caleb: Uncle, do you remember how his arm got broken?

卡萊布：叔叔，你還記得 他的手臂是怎麼斷的嗎？

Person 3: He was doing gardening.

人員 3 ：他當時正在做園藝。

Robot: Defending gardens from evil produce is my specialty.

機器人：保護花園免於 邪惡農產品的侵害是我的專長。

Person 3: That's cool.

人員 3 ：太酷了。

Caleb: That's not as cool as battling mechanical minions.

卡萊布：那並不像 跟機械手下戰鬥那麼酷。

Person 3: True.

人員 3 ：確實。

(Laughter)

（笑聲）

KG: So it’s not just these stand-alone characters we want to bring to life,

凱吉：我們不只想讓這些 獨立角色栩栩如生，

but fully agentic, interconnected worlds

還有完全由人工智能代理、 互相聯繫的世界。

where a choice at one point

在這些世界，某個當下的選擇

might have dramatic consequences somewhere down the line,

可能會在未來的某個時候 造成戲劇性的後果，

and the unique content produced for each user

而為每個使用者製作的獨特內容

is still grounded in a shared lore and experience

仍然是基於共享的知識與經驗，

so that we have that shared social context

以便我們擁有所有人 都需要從媒體取得的

that we all need from media.

共享社會脈絡。

My company Inworld helps entertainment houses and game studios

我的公司 Inworld 幫助娛樂公司和遊戲工作室

to build these agents for the next generation of media.

為下一代媒體建立 這些人工智能代理。

And when we begin to build a character like Caleb, we start with the brain,

當我們開始建構一個 像卡萊布這樣的角色時，

我們從大腦開始，

作法就跟指導一名

which is crafted in a similar way

to instructing an extremely capable improv actor.

非常厲害的即興演員相似。

We start by training custom machine-learning models

首先，我們會訓練 自訂的機器學習模型，

that give him a lay of the land, understanding the lore, vocabulary

讓他了解一下情況， 掌握適合特定體驗的

and grammar appropriate for the experience.

知識、單字和文法。

And then we actually go in and we tweak his persona,

然後，我們實際上 會進一步調整他的形象，

his unique personality, motivations, his flaws and biases.

他的獨特性格、動機， 他的缺陷與偏見。

We actually craft his dialogue style and voice,

我們其實還製作了 他的對話風格和聲音，

the way he verbally expresses himself.

以及他口頭表達自己的方式。

We build a unique emotional profile,

我們建立了一份獨特的情感概要，

the way he feels, his social tendencies and relationship habits,

記錄了他的感受方式、 社交傾向和相處習慣，

and then we preload a bunch of knowledge and memories

接著我們預先載入了 一堆知識和記憶，

that give him that robust backstory.

以賦予他紮實的背景故事。

Then we actually craft his internal reasoning and mental state,

我們其實還製作了 他的內在推理和心理狀態，

kind of the conditions under which he feels certain things

作為他感受到某些事情

or takes certain behaviors.

或採取某些行為的條件。

We then decide how he actually gestures and animates those behaviors,

然後，我們決定他實際上如何 生動地做出那些行為，

and then that completes the brain, which we actually take

這樣大腦就完成了，我們事實上會

and we attach to an avatar within a virtual world or game engine,

將它連接到虛擬世界 或遊戲引擎的虛擬化身上，

effectively bringing it to life.

使它有效地獲得生命。

And then we're ready to play and we're playing the experience.

接下來，我們準備好玩耍， 體驗這整個過程。

There's kind of an overarching narrative agent

有一種全面的敘事代理，

that acts like an AI director,

可以像人工智能導演一樣，

managing or even generating the storyline in real time

即時管理甚至生成故事情節，

and ensuring that all the characters and entities

並確保所有角色和實體

cohere to their proper places within the story and context.

在故事中能夠融入到適當的位置。

For specific character like Caleb,

對於像卡萊布這樣的特定角色，

when he's interacting with the world and characters,

當他與世界和其他角色互動時，

he does so in a similar way to how we as humans do

他的方式與我們人類

透過感知、認知和行為的做法類似。

with perception, cognition and behavior.

Perception is the multimodal sensory input flowing in,

感知是多種模式的 感官資訊輸入流，

the understanding of the world and context and people and objects within it.

也就是對世界與當中的環境、 人跟物體的理解。

And then with cognition, he processes that input,

接著，他透過認知處理那些輸入，

kind of like the internal processing of our minds.

就像我們大腦的內部處理過程。

He filters out irrelevant information to make sure everything is safe

他會過濾不相關的資訊， 以確保一切都安全

and narrative aligned.

且敘述一致。

He extracts out important signals like sentiment, intent, emotional cues.

他提取出重要的訊號， 例如觀點、意圖、情感線索。

He retrieves relevant memories from his past

他從自身的過去找回相關的記憶，

and even generates new ones on the fly.

甚至同時產生新回憶。

Finally reasoning over what to do both verbally and non-verbally.

最後以言語及非言語的方式 推理出該做什麼。

And finally with behavior, he actually generates his responses.

最終透過行為， 他實質上產生了他的反應。

He decides what to say and how to say it,

他決定要說什麼和如何說，

what facial and body gestures to use,

要擺出什麼 臉部表情和身體動作，

what actions to take,

要採取什麼行動，

and people and objects to interact with.

以及要和哪些人跟物體互動。

And that's what brings the character to life.

那正是使角色栩栩如生的原因。

And so, as amazed as I am by all these task-focused applications of AI

儘管我對所有新推出的 任務導向人工智能應用

that are coming out,

感到驚艷，

the more I work with studios and creatives,

我與工作室及創意人員 合作得越多，

the more excited I am for the potential

我對這些可能性更加興奮：

for these agents to extend human creative potential,

利用人工智能代理 擴展人類的創造潛力，

and for them to allow audiences to step beyond the script.

並讓觀眾能夠不受劇本侷限；

For them to give audiences agency

給予觀眾自主性，

and allow them to co-create experiences that stem from their own imagination.

讓他們共同創造 基於自身想像的體驗。

To finish it off, here's a few funny takes from here at TED,

作為收尾，這些是 在 TED 拍攝的有趣片段，

starting with Polly, whose son is actually named Caleb.

從波莉開始，她兒子 實際上也叫卡萊布。

(Video) Person 4: Are you ready to play [unclear] Caleb?

（影片）人員 4 ：你準備好跟我 一起玩了嗎，卡萊布？

卡萊布：當然，奶奶。

Caleb: Absolutely, grandma.

Let's dive into some epic superhero adventures together.

讓我們一起探索一些 史詩級的超級英雄冒險。

Person 4: Let's do it.

人員 4 ：讓我們來吧。

Person 5: Can you hear me?

人員 5 ：你聽得到我嗎？

Caleb: Of course I can hear you, silly.

卡萊布：我當然聽得到，小傻瓜。

I love playing basketball.

我喜歡打籃球。

Person 3: Oh, wow. And which is your favorite basketball player?

人員 3 ：哦，哇。 那你最喜歡哪個籃球員？

Caleb: Definitely LeBron James.

卡萊布：絕對是雷霸龍·詹姆士。

Person 3: Sure.

人員 3 ：當然。

Caleb: Thanks for showing me your old superhero action figure.

卡萊布：謝謝你向我展示你的 舊超級英雄可動模型。

Person 1: You mean the man in his underwear?

人員 1 ：你是指那個 穿著內褲的男人嗎？

Caleb: Haha, yeah.

卡萊布：哈哈，是的。

He's like a tough guy in his undies ready to save the world.

他就像個穿著內褲的硬漢， 準備拯救世界。

What's its name?

它叫什麼名字？

Person 6: Johnny May Rotten Bad.

人員 6 ：強尼·梅·洛頓·巴德 （強尼也許是個爛傢伙）。

Caleb: Uncle, you're so silly.

卡萊布：叔叔，你太搞笑了。

(Laughter)

（笑聲）

Does he have, like, a guitar for a weapon?

他的武器是吉他之類的嗎？

Person 6: He sure does.

人員 6 ：的確是。

Caleb: No way.

卡萊布：不可能。

Person 6: Way.

人員 6 ：可能。

Caleb: No way.

卡萊布：不會吧。

Person 6: Way.

人員 6 ：會。

Caleb: Does he zap bad guys with his electric powers?

卡萊布：他會用他的 電能力擊倒壞人嗎？

Person 7: No, no, no, no, no.

人員 7 ：不，不，不，不，不。

He zaps people and gives them love.

他透過電擊人們來給他們愛。

He’s a nice superhero.

他是個很好的超級英雄。

Caleb: Wow, that's different.

卡萊布：哇，真特別。

He uses love to fight the bad guys.

他用愛來對抗壞蛋。

Person 7: Yeah, and guess what?

人員 7 ：是啊，你猜怎麼樣？

卡萊布：太酷了。

Caleb: That's so cool.

人員 7 ：他總是能贏得勝利。

Person 7: He always wins.

(Applause)

（掌聲）

KG: So it seems like there’s a pretty solid chance

凱吉：看來我的蜘蛛人可動模型

my Spider-Man action figures could come to life after all.

終究有很大的機率能獲得生命。

Thank you.

謝謝大家。

(Applause)

（掌聲）