Art that reveals how technology frames reality | Jiabao Li

I'm an artist and an engineer.

And lately, I've been thinking a lot about how technology mediates

the way we perceive reality.

And it's being done in a superinvisible and nuanced way.

Technology is designed to shape our sense of reality

by masking itself as the actual experience of the world.

As a result, we are becoming unconscious and unaware

that it is happening at all.

Take the glasses I usually wear, for example.

These have become part of the way I ordinarily experience my surroundings.

I barely notice them,

even though they are constantly framing reality for me.

The technology I am talking about is designed to do the same thing:

change what we see and think

but go unnoticed.

Now, the only time I do notice my glasses

is when something happens to draw my attention to it,

like when it gets dirty or my prescription changes.

So I asked myself, "As an artist, what can I create

to draw the same kind of attention

to the ways digital media -- like news organizations, social media platforms,

advertising and search engines --

are shaping our reality?"

So I created a series of perceptual machines

to help us defamiliarize and question

the ways we see the world.

For example, nowadays, many of us have this kind of allergic reaction

to ideas that are different from ours.

We may not even realize that we've developed this kind of mental allergy.

So I created a helmet that creates this artificial allergy to the color red.

It simulates this hypersensitivity by making red things look bigger

when you are wearing it.

It has two modes: nocebo and placebo.

In nocebo mode, it creates this sensorial experience of hyperallergy.

Whenever I see red, the red expands.

It's similar to social media's amplification effect,

like when you look at something that bothers you,

you tend to stick with like-minded people

and exchange messages and memes, and you become even more angry.

Sometimes, a trivial discussion gets amplified

and blown way out of proportion.

Maybe that's even why we are living in the politics of anger.

In placebo mode, it's an artificial cure for this allergy.

Whenever you see red, the red shrinks.

It's a palliative, like in digital media.

When you encounter people with different opinions,

we will unfollow them,

remove them completely out of our feeds.

It cures this allergy by avoiding it.

But this way of intentionally ignoring opposing ideas

makes human community hyperfragmented and separated.

The device inside the helmet reshapes reality

and projects into our eyes through a set of lenses

to create an augmented reality.

I picked the color red, because it's intense and emotional,

it has high visibility

and it's political.

So what if we take a look

at the last American presidential election map

through the helmet?

(Laughter)

You can see that it doesn't matter if you're a Democrat or a Republican,

because the mediation alters our perceptions.

The allergy exists on both sides.

In digital media,

what we see every day is often mediated,

but it's also very nuanced.

If we are not aware of this,

we will keep being vulnerable to many kinds of mental allergies.

Our perception is not only part of our identities,

but in digital media, it's also a part of the value chain.

Our visual field is packed with so much information

that our perception has become a commodity with real estate value.

Designs are used to exploit our unconscious biases,

algorithms favor content that reaffirms our opinions,

so that every little corner of our field of view is being colonized

to sell ads.

Like, when this little red dot comes out in your notifications,

it grows and expands, and to your mind, it's huge.

So I started to think of ways to put a little dirt,

or change the lenses of my glasses,

and came up with another project.

Now, keep in mind this is conceptual. It's not a real product.

It's a web browser plug-in

that could help us to notice the things that we would usually ignore.

Like the helmet, the plug-in reshapes reality,

but this time, directly into the digital media itself.

It shouts out the hidden filtered voices.

What you should be noticing now

will be bigger and vibrant,

like here, this story about gender bias emerging from the sea of cats.

(Laughter)

The plug-in could dilute the things that are being amplified by an algorithm.

Like, here in this comment section,

there are lots of people shouting about the same opinions.

The plug-in makes their comments super small.

(Laughter)

So now the amount of pixel presence they have on the screen

is proportional to the actual value they are contributing to the conversation.

(Laughter)

(Applause)

The plug-in also shows the real estate value of our visual field

and how much of our perception is being commoditized.

Different from ad blockers,

for every ad you see on the web page,

it shows the amount of money you should be earning.

(Laughter)

We are living in a battlefield between reality

and commercial distributed reality,

so the next version of the plug-in could strike away that commercial reality

and show you things as they really are.

(Laughter)

(Applause)

Well, you can imagine how many directions this could really go.

Believe me, I know the risks are high if this were to become a real product.

And I created this with good intentions

to train our perception and eliminate biases.

But the same approach could be used with bad intentions,

like forcing citizens to install a plug-in like that

to control the public narrative.

It's challenging to make it fair and personal

without it just becoming another layer of mediation.

So what does all this mean for us?

Even though technology is creating this isolation,

we could use it to make the world connected again

by breaking the existing model and going beyond it.

By exploring how we interface with these technologies,

we could step out of our habitual, almost machine-like behavior

and finally find common ground between each other.

Technology is never neutral.

It provides a context and frames reality.

It's part of the problem and part of the solution.

We could use it to uncover our blind spots and retrain our perception

and consequently, choose how we see each other.

Thank you.

(Applause)