Can a computer write poetry? | Oscar Schwartz

I have a question.

Can a computer write poetry?

This is a provocative question.

You think about it for a minute,

and you suddenly have a bunch of other questions like:

What is a computer?

What is poetry?

What is creativity?

But these are questions

that people spend their entire lifetime trying to answer,

not in a single TED Talk.

So we're going to have to try a different approach.

So up here, we have two poems.

One of them is written by a human,

and the other one's written by a computer.

I'm going to ask you to tell me which one's which.

Have a go:

Poem 1: Little Fly / Thy summer's play, / My thoughtless hand / Has brush'd away.

Am I not / A fly like thee? / Or art not thou / A man like me?

Poem 2: We can feel / Activist through your life's / morning /

Pauses to see, pope I hate the / Non all the night to start a / great otherwise (...)

Alright, time's up.

Hands up if you think Poem 1 was written by a human.

OK, most of you.

Hands up if you think Poem 2 was written by a human.

Very brave of you,

because the first one was written by the human poet William Blake.

The second one was written by an algorithm

that took all the language from my Facebook feed on one day

and then regenerated it algorithmically,

according to methods that I'll describe a little bit later on.

So let's try another test.

Again, you haven't got ages to read this,

so just trust your gut.

Poem 1: A lion roars and a dog barks. It is interesting / and fascinating

that a bird will fly and not / roar or bark. Enthralling stories about animals

are in my dreams and I will sing them all if I / am not exhausted or weary.

Poem 2: Oh! kangaroos, sequins, chocolate sodas! / You are really beautiful!

Pearls, / harmonicas, jujubes, aspirins! All / the stuff they've always talked about (...)

Alright, time's up.

So if you think the first poem was written by a human,

put your hand up.

OK.

And if you think the second poem was written by a human,

put your hand up.

We have, more or less, a 50/50 split here.

It was much harder.

The answer is,

the first poem was generated by an algorithm called Racter,

that was created back in the 1970s,

and the second poem was written by a guy called Frank O'Hara,

who happens to be one of my favorite human poets.

(Laughter)

So what we've just done now is a Turing test for poetry.

The Turing test was first proposed by this guy, Alan Turing, in 1950,

in order to answer the question,

can computers think?

Alan Turing believed that if a computer was able

to have a to have a text-based conversation with a human,

with such proficiency such that the human couldn't tell

whether they are talking to a computer or a human,

then the computer can be said to have intelligence.

So in 2013, my friend Benjamin Laird and I,

we created a Turing test for poetry online.

It's called bot or not,

and you can go and play it for yourselves.

But basically, it's the game we just played.

You're presented with a poem,

you don't know whether it was written by a human or a computer

and you have to guess.

So thousands and thousands of people have taken this test online,

so we have results.

And what are the results?

Well, Turing said that if a computer could fool a human

30 percent of the time that it was a human,

then it passes the Turing test for intelligence.

We have poems on the bot or not database

that have fooled 65 percent of human readers into thinking

it was written by a human.

So, I think we have an answer to our question.

According to the logic of the Turing test,

can a computer write poetry?

Well, yes, absolutely it can.

But if you're feeling a little bit uncomfortable

with this answer, that's OK.

If you're having a bunch of gut reactions to it,

that's also OK because this isn't the end of the story.

Let's play our third and final test.

Again, you're going to have to read

and tell me which you think is human.

Poem 1: Red flags the reason for pretty flags. / And ribbons.

Ribbons of flags / And wearing material / Reasons for wearing material. (...)

Poem 2: A wounded deer leaps highest, / I've heard the daffodil

I've heard the flag to-day / I've heard the hunter tell; /

'Tis but the ecstasy of death, / And then the brake is almost done (...)

OK, time is up.

So hands up if you think Poem 1 was written by a human.

Hands up if you think Poem 2 was written by a human.

Whoa, that's a lot more people.

So you'd be surprised to find that Poem 1

was written by the very human poet Gertrude Stein.

And Poem 2 was generated by an algorithm called RKCP.

Now before we go on, let me describe very quickly and simply,

how RKCP works.

So RKCP is an algorithm designed by Ray Kurzweil,

who's a director of engineering at Google

and a firm believer in artificial intelligence.

So, you give RKCP a source text,

it analyzes the source text in order to find out how it uses language,

and then it regenerates language

that emulates that first text.

So in the poem we just saw before,

Poem 2, the one that you all thought was human,

it was fed a bunch of poems

by a poet called Emily Dickinson

it looked at the way she used language,

learned the model,

and then it regenerated a model according to that same structure.

But the important thing to know about RKCP

is that it doesn't know the meaning of the words it's using.

The language is just raw material,

it could be Chinese, it could be in Swedish,

it could be the collected language from your Facebook feed for one day.

It's just raw material.

And nevertheless, it's able to create a poem

that seems more human than Gertrude Stein's poem,

and Gertrude Stein is a human.

So what we've done here is, more or less, a reverse Turing test.

So Gertrude Stein, who's a human, is able to write a poem

that fools a majority of human judges into thinking

that it was written by a computer.

Therefore, according to the logic of the reverse Turing test,

Gertrude Stein is a computer.

(Laughter)

Feeling confused?

I think that's fair enough.

So far we've had humans that write like humans,

we have computers that write like computers,

we have computers that write like humans,

but we also have, perhaps most confusingly,

humans that write like computers.

So what do we take from all of this?

Do we take that William Blake is somehow more of a human

than Gertrude Stein?

Or that Gertrude Stein is more of a computer than William Blake?

(Laughter)

These are questions I've been asking myself

for around two years now,

and I don't have any answers.

But what I do have are a bunch of insights

about our relationship with technology.

So my first insight is that, for some reason,

we associate poetry with being human.

So that when we ask, "Can a computer write poetry?"

we're also asking,

"What does it mean to be human

and how do we put boundaries around this category?

How do we say who or what can be part of this category?"

This is an essentially philosophical question, I believe,

and it can't be answered with a yes or no test,

like the Turing test.

I also believe that Alan Turing understood this,

and that when he devised his test back in 1950,

he was doing it as a philosophical provocation.

So my second insight is that, when we take the Turing test for poetry,

we're not really testing the capacity of the computers

because poetry-generating algorithms,

they're pretty simple and have existed, more or less, since the 1950s.

What we are doing with the Turing test for poetry, rather,

is collecting opinions about what constitutes humanness.

So, what I've figured out,

we've seen this when earlier today,

we say that William Blake is more of a human

than Gertrude Stein.

Of course, this doesn't mean that William Blake

was actually more human

or that Gertrude Stein was more of a computer.

It simply means that the category of the human is unstable.

This has led me to understand

that the human is not a cold, hard fact.

Rather, it is something that's constructed with our opinions

and something that changes over time.

So my final insight is that the computer, more or less,

works like a mirror that reflects any idea of a human

that we show it.

We show it Emily Dickinson,

it gives Emily Dickinson back to us.

We show it William Blake,

that's what it reflects back to us.

We show it Gertrude Stein,

what we get back is Gertrude Stein.

More than any other bit of technology,

the computer is a mirror that reflects any idea of the human we teach it.

So I'm sure a lot of you have been hearing

a lot about artificial intelligence recently.

And much of the conversation is,

can we build it?

Can we build an intelligent computer?

Can we build a creative computer?

What we seem to be asking over and over

is can we build a human-like computer?

But what we've seen just now

is that the human is not a scientific fact,

that it's an ever-shifting, concatenating idea

and one that changes over time.

So that when we begin to grapple with the ideas

of artificial intelligence in the future,

we shouldn't only be asking ourselves,

"Can we build it?"

But we should also be asking ourselves,

"What idea of the human do we want to have reflected back to us?"

This is an essentially philosophical idea,

and it's one that can't be answered with software alone,

but I think requires a moment of species-wide, existential reflection.

Thank you.

(Applause)