Ben Goldacre: Battling Bad Science

768,347 views ・ 2011-09-30

TED


Fai dobre clic nos subtítulos en inglés a continuación para reproducir o vídeo.

Translator: Carme Paz Reviewer: Xusto Rodriguez
Eu son médico, pero inclineime pola investigación
e agora son epidemiólogo.
00:15
So I'm a doctor, but I kind of slipped sideways into research,
0
15402
3064
E ninguén sabe de certo que é a epidemioloxía.
00:18
and now I'm an epidemiologist.
1
18490
1698
A epidemioloxía é a ciencia que estuda como saber no mundo real
00:20
And nobody really knows what epidemiology is.
2
20212
2144
se algo é bo ou malo para nós.
00:22
Epidemiology is the science of how we know in the real world
3
22380
3153
Enténdese mellor a través dun exemplo:
00:25
if something is good for you or bad for you.
4
25557
2110
é a ciencia deses titulares tolos, absurdos, dos xornais.
00:27
And it's best understood through example
5
27691
1960
00:29
as the science of those crazy, wacky newspaper headlines.
6
29675
4651
Imos ver algúns exemplos.
Este é do Daily Mail. Todos os países teñen un xornal coma este.
00:34
And these are just some of the examples.
7
34350
2333
00:36
These are from the Daily Mail.
8
36707
1450
Ten o estraño proxecto filosófico
00:38
Every country in the world has a newspaper like this.
9
38181
2519
de dividir os obxectos inanimados do mundo
00:40
It has this bizarre, ongoing philosophical project
10
40724
2350
nos que causan cancro e nos que o preveñen.
00:43
of dividing all the inanimate objects in the world
11
43098
2355
Segundo eles, causan cancro:
00:45
into the ones that either cause or prevent cancer.
12
45477
2353
o divorcio, a rede sen fíos, os artigos de aseo e o café.
00:47
Here are some of the things they said cause cancer:
13
47854
2508
E preveñen o cancro:
a codia, o pemento vermello, a regalicia e o café.
00:50
divorce, Wi-Fi, toiletries and coffee.
14
50386
1981
00:52
Some things they say prevent cancer:
15
52391
1764
Como podedes ver, hai contradicións.
00:54
crusts, red pepper, licorice and coffee.
16
54179
1922
O café causa cancro e á vez preveno.
00:56
So you can see there are contradictions.
17
56125
1906
E cando comezades a ler vedes
que quizais haxa algún tipo de interese político por tras.
00:58
Coffee both causes and prevents cancer.
18
58055
2000
01:00
As you start to read on, you can see
19
60079
1724
Para as mulleres, o traballo doméstico causa cancro de mama
01:01
that maybe there's some political valence behind some of this.
20
61827
2939
pero para os homes, comprar pode facelos impotentes.
01:04
For women, housework prevents breast cancer,
21
64790
2061
01:06
but for men, shopping could make you impotent.
22
66875
3045
Así que hai que comezar
descifrando a ciencia que hai aí detrás.
01:09
(Laughter)
23
69944
1009
01:10
So we know that we need to start unpicking the science behind this.
24
70977
4504
E espero demostrar
que examinar afirmacións tan arriscadas,
01:15
And what I hope to show is that unpicking the evidence behind dodgy claims
25
75505
5533
examinar a evidencia que subxace a elas
non é rosmar con mala intención;
socialmente é útil,
01:21
isn't a kind of nasty, carping activity;
26
81062
3720
pero ademais é unha ferramenta explicativa
01:24
it's socially useful.
27
84806
1361
extremadamente valiosa.
01:26
But it's also an extremely valuable explanatory tool,
28
86191
4558
Porque a ciencia verdadeira consiste
na avaliación crítica das probas que avalan unha postura.
01:30
because real science is about critically appraising the evidence
29
90773
3035
Así se fai nas publicacións académicas.
01:33
for somebody else's position.
30
93832
1393
E nas reunións académicas.
As preguntas que seguen unha presentación de datos
01:35
That's what happens in academic journals,
31
95249
1959
01:37
it's what happens at academic conferences --
32
97232
2064
adoitan ser un baño de sangue.
E a ninguén lle importa. Gústanos.
01:39
the Q&A session after a postdoc presents data is often a bloodbath.
33
99320
3309
É como unha actividade intelectual sadomasoquista consensuada.
01:42
And nobody minds that; we actively welcome it.
34
102653
2158
01:44
It's like a consenting intellectual S&M activity.
35
104835
3038
Así que vou amosarvos
as partes principais,
01:47
(Laughter)
36
107897
1155
as características principais da miña disciplina:
01:49
So what I'm going to show you is all of the main things,
37
109076
2994
a medicina baseada en evidencias.
01:52
all of the main features of my discipline, evidence-based medicine.
38
112094
3190
Explicaréivolas
e demostrareivos como funcionan
01:55
And I will talk you through all of these and demonstrate how they work,
39
115308
3883
usando exclusivamente exemplos de xente que o fai mal.
Así que comezaremos coa forma máis débil de evidencia coñecida polo home:
01:59
exclusively using examples of people getting stuff wrong.
40
119215
3342
02:02
We'll start with the absolute weakest form of evidence known to man,
41
122581
3754
a autoridade.
Na ciencia, non nos importa cantos títulos tes.
02:06
and that is authority.
42
126359
1626
O que queremos é saber as túas razóns para crer en algo.
02:08
In science, we don't care how many letters you have after your name --
43
128009
3440
Como sabes que algo é bo
02:11
we want to know what your reasons are for believing something.
44
131473
3012
ou malo para nós?
Non nos impresiona a autoridade,
02:14
How do you know that something is good for us or bad for us?
45
134509
2996
porque é tan fácil inventala...
02:17
But we're also unimpressed by authority because it's so easy to contrive.
46
137529
4181
Esta é a Dra. Gillian McKeith
ou, para darlle o seu título médico completo, Gillian McKeith.
02:21
This is somebody called Dr. Gillian McKeith, PhD,
47
141734
2382
(Risos)
02:24
or, to give her full medical title, Gillian McKeith.
48
144140
3169
En fin, todos os países teñen alguén así.
02:27
(Laughter)
49
147333
2660
É a nosa gurú mediática das dietas.
02:30
Again, every country has somebody like this.
50
150017
2156
Ten cinco programas de televisión en horario de máxima audiencia
02:32
She is our TV diet guru.
51
152197
1644
02:33
She has five series of prime-time television,
52
153865
2907
nos que dá consellos moi exóticos sobre saúde.
02:36
giving out very lavish and exotic health advice.
53
156796
2318
Resulta que ten un doutoramento non oficial por correspondencia,
02:39
She, it turns out, has a non-accredited correspondence course PhD
54
159138
3855
de algures nos Estados Unidos.
Tamén se gaba de ser membro certificado
da Asociación Americana de Consultores Nutricionais,
02:43
from somewhere in America.
55
163017
1280
02:44
She also boasts that she's a certified professional member
56
164321
2765
que soa moi glamuroso e fascinante.
Danche un certificado e todo.
02:47
of the American Association of Nutritional Consultants,
57
167110
2592
Este é de Hetti, a miña defunta gata. Unha gata horrible.
02:49
which sounds very glamorous; you get a certificate.
58
169726
2399
Vas á web, enches o impreso,
02:52
This one belongs to my dead cat, Hettie. She was a horrible cat.
59
172149
3017
dáslles 60 dólares e chégache por correo.
Pero esta non é a única razón para pensar que é idiota.
02:55
You go to the website, fill out the form,
60
175190
1964
02:57
give them $60, it arrives in the post.
61
177178
1821
Tamén vai e di cousas como
02:59
That's not the only reason we think this person is an idiot.
62
179023
2833
que deberiamos comer moita verdura verde escura
03:01
She also says things like eat lots of dark green leaves,
63
181880
2649
porque ten moita clorofila e iso osixena o sangue.
Calquera que estudara bioloxía na escola lembra
03:04
they contain chlorophyll and really oxygenate your blood.
64
184553
2857
que a clorofila e os cloroplastos
03:07
And anybody who's done school biology remembers
65
187434
2199
só producen osíxeno á luz do día
03:09
that chlorophyll and chloroplasts only make oxygen in sunlight,
66
189657
3212
e os intestinos están bastante escuros para as espinacas.
03:12
and it's quite dark in your bowels after you've eaten spinach.
67
192893
3130
Seguimos. Precisamos ciencia e evidencia axeitadas.
"O viño tinto axuda a previr o cancro de mama."
03:16
Next, we need proper science, proper evidence.
68
196047
2499
Este é un titulardo Daily Telegraph do Reino Unido.
03:18
So: "Red wine can help prevent breast cancer."
69
198570
2442
"Un vaso de viño tinto ao día axuda a previr o cancro de mama."
03:21
This is a headline from The Daily Telegraph in the UK.
70
201036
2563
03:23
"A glass of red wine a day could help prevent breast cancer."
71
203623
2918
Pero collemos o xornal e descubrimos
que é un verdadeiro artigo científico.
03:26
So you find this paper, and find that it is a real piece of science.
72
206565
3236
É a descrición dos cambios nun enzima
ao colocar unha gota dun produto químico extraído da tona da uva tinta
03:29
It's a description of the changes in the behavior of one enzyme
73
209825
2997
03:32
when you drip a chemical extracted from some red grape skin
74
212846
3169
en células cancerosas
nunha mesa de laboratorio en algures.
03:36
onto some cancer cells
75
216039
1575
03:37
in a dish on a bench in a laboratory somewhere.
76
217638
3200
E esa é unha cousa moi útil para describir
03:40
And that's a really useful thing to describe in a scientific paper.
77
220862
4092
nunha publicación científica,
pero en canto ao risco persoal
de ter cancro de mama se bebemos viño tinto,
03:44
But on the question of your own personal risk of getting breast cancer
78
224978
3358
non di nada.
En realidade, resulta que o risco de cancro de mama
03:48
if you drink red wine,
79
228360
1151
03:49
it tells you absolutely bugger all.
80
229535
1681
aumenta un pouco
03:51
Actually, it turns out that your risk of breast cancer
81
231240
2537
canto máis alcol bebemos.
03:53
increases slightly with every amount of alcohol you drink.
82
233801
2963
Queremos estudos feitos en xente real.
03:56
So what we want are studies in real human people.
83
236788
3848
Aquí hai outro exemplo
do destacado nutricionista británico do Daily Mirror,
04:00
And here's another example.
84
240660
1576
04:02
This is from Britain's "leading" diet nutritionist in the Daily Mirror,
85
242260
4161
o noso segundo xornal máis vendido:
"Un estudo australiano do 2001 atopou
04:06
our second-biggest selling newspaper.
86
246445
1774
que o aceite de oliva combinado con froitas, vexetais e legumes
04:08
"An Australian study in 2001 found that olive oil,
87
248243
2358
protexe contra as engurras da pel."
04:10
in combination with fruits, vegetables and pulses,
88
250625
2342
E despois dános un consello:
04:12
offers measurable protection against skin wrinklings,"
89
252991
2548
"Se tomamos aceite de oliva e vexetais teremos menos engurras."
04:15
and give the advice:
90
255563
1151
E dinos como atopar a publicación.
04:16
"If you eat olive oil and vegetables, you'll have fewer wrinkles."
91
256738
3130
Así que buscas o artigo e o que atopas é un estudo observacional.
04:19
They helpfully tell you how to find the paper,
92
259892
2158
Obviamente, ninguén puido ir a 1930,
04:22
and what you find is an observational study.
93
262074
2087
coller os bebés dunha maternidade,
04:24
Obviously, nobody has been able to go back to 1930,
94
264185
2921
facer que a metade comese moita froita, verduras e aceite de oliva
04:27
get all the people born in one maternity unit,
95
267130
2493
e a que outra metade comese McDonald's
04:29
and half of them eat lots of fruit and veg and olive oil,
96
269647
2696
e despois analizar as súas engurras.
04:32
half of them eat McDonald's,
97
272367
1346
Hai que facer unha mostraxe de como son as persoas agora.
04:33
and then we see how many wrinkles you've got later.
98
273737
2403
E o que atopas, claro,
é que a xente que come verduras e aceite de oliva ten menos engurras.
04:36
You have to take a snapshot of how people are now.
99
276164
2413
04:38
And what you find is, of course:
100
278601
1564
Pero iso é porque a xente que come froita e aceite de oliva
04:40
people who eat veg and olive oil have fewer wrinkles.
101
280189
2501
é rara, non é normal, é coma vós;
04:42
But that's because people who eat fruit and veg and olive oil are freaks --
102
282714
3741
veñen a eventos coma este.
04:46
they're not normal, they're like you; they come to events like this.
103
286479
3824
Son elegantes, son ricos, traballan menos ao aire libre,
04:50
(Laughter)
104
290327
1059
fan menos traballos manuais,
04:51
They're posh, they're wealthy, less likely to have outdoor jobs,
105
291410
3019
teñen máis apoio social, fuman menos...
04:54
less likely to do manual labor,
106
294453
1516
así que por unha chea de fascinantes razóns,
04:55
they have better social support, are less likely to smoke;
107
295993
2740
sociais, políticas e culturais entrelazadas,
04:58
for a host of fascinating, interlocking
108
298757
1874
é menos probable que teñan engurras na pel.
05:00
social, political and cultural reasons,
109
300655
1869
Iso non significa que sexa polos vexetais e o aceite de oliva.
05:02
they're less likely to have wrinkles.
110
302548
1772
05:04
That doesn't mean it's the vegetables or olive oil.
111
304344
2402
(Risos)
Entón, o ideal sería facer un ensaio.
05:06
(Laughter)
112
306770
1246
Todo o mundo cre que sabe que é un ensaio.
05:08
So ideally, what you want to do is a trial.
113
308040
2493
Os ensaios son moi antigos. O primeiro está na Biblia, Daniel 1:12.
05:10
People think they're familiar with the idea of a trial.
114
310557
2580
É moi fácil, cóllese un grupo de xente, divídese en dous,
05:13
Trials are old; the first one was in the Bible, Daniel 1:12.
115
313161
2816
trátase un grupo dun xeito, e o outro, doutro,
05:16
It's straightforward: take a bunch of people, split them in half,
116
316001
3075
e despois, fáiselles un seguimento
para ver que ocorre con cada un.
05:19
treat one group one way, the other group, the other way.
117
319100
2626
Así que vou falarvos dun ensaio
05:21
A while later, you see what happened to each of them.
118
321750
2523
que foi probablemente o máis popular
nos medios británicos na pasada década.
05:24
I'm going to tell you about one trial,
119
324297
1834
05:26
which is probably the most well-reported trial
120
326155
2166
É o ensaio das pílulas de aceite de peixe.
05:28
in the UK news media over the past decade.
121
328345
2005
Dicíase que melloraban o rendemento escolar
05:30
This is the trial of fish oil pills.
122
330374
1736
e o comportamento na maioría dos nenos.
05:32
The claim: fish oil pills improve school performance and behavior
123
332134
3153
Dixeron: "Fixemos un ensaio.
Os anteriores foron positivos e sabemos que este tamén."
05:35
in mainstream children.
124
335311
1151
05:36
They said, "We did a trial.
125
336486
1294
Iso sempre debería facer soar unha alarma.
05:37
All the previous ones were positive, this one will be too."
126
337804
2772
Porque se xa se sabe a resposta do ensaio non se debería facer.
05:40
That should ring alarm bells:
127
340600
1382
Ou está manipulado o deseño
05:42
if you know the answer to your trial, you shouldn't be doing one.
128
342006
3060
ou xa hai datos dabondo, así que non é preciso probalo en máis persoas.
05:45
Either you've rigged it by design,
129
345090
1628
05:46
or you've got enough data so there's no need to randomize people anymore.
130
346742
3437
Isto é o que ían facer no seu ensaio.
Ían coller 3 000 nenos,
05:50
So this is what they were going to do in their trial:
131
350203
2501
ían darlles unhas enormes pílulas de aceite de peixe,
05:52
They were taking 3,000 children,
132
352728
2077
seis ao día,
05:54
they were going to give them these huge fish oil pills, six of them a day,
133
354829
3654
e un ano máis tarde, ían medir o rendemento escolar en exames
e comparar ese rendemento
05:58
and then, a year later, measure their school exam performance
134
358507
3113
co que eles calculaban que terían
06:01
and compare their performance
135
361644
1774
se non tomaran as pílulas.
06:03
against what they predicted their exam performance would have been
136
363442
3156
Pode ver alguén o punto fraco no deseño?
06:06
if they hadn't had the pills.
137
366622
2076
Se sodes profesores de metodoloxía de ensaios clínicos
06:08
Now, can anybody spot a flaw in this design?
138
368722
2807
non respondades esta cuestión.
06:11
(Laughter)
139
371553
1015
06:12
And no professors of clinical trial methodology
140
372592
2243
Non hai control; non hai ningún grupo de control.
06:14
are allowed to answer this question.
141
374859
1726
Pero isto soa moi técnico.
06:16
So there's no control group.
142
376609
2001
É un termo técnico.
06:18
But that sounds really techie, right? That's a technical term.
143
378634
3335
Os rapaces tomaron as pílulas e o seu rendemento mellorou.
06:21
The kids got the pills, and their performance improved.
144
381993
2633
Que outra cousa podería ser senón as pílulas?
Medraron. Todos evolucionamos co tempo.
06:24
What else could it possibly be if it wasn't the pills?
145
384650
2673
Por suposto, tamén está o efecto placebo,
06:28
They got older; we all develop over time.
146
388128
2273
que é unha das cousas máis fascinantes en medicina.
06:30
And of course, there's the placebo effect,
147
390425
2165
E non se trata só de tomar unha pílula e que mellore o rendemento e a dor.
06:32
one of the most fascinating things in the whole of medicine.
148
392614
2838
06:35
It's not just taking a pill and performance or pain improving;
149
395476
2913
Trátase das nosas crenzas e expectativas.
Do significado cultural dun tratamento.
06:38
it's about our beliefs and expectations, the cultural meaning of a treatment.
150
398413
3663
E isto demostrouse nunha chea de estudos fascinantes
que comparaban un tipo de placebo con outro.
06:42
And this has been demonstrated in a whole raft of fascinating studies
151
402100
3270
Sabemos, por exemplo, que 2 pílulas de azucre ao día
06:45
comparing one kind of placebo against another.
152
405394
2217
son máis efectivas para as úlceras gástricas
06:47
So we know, for example,
153
407635
1158
06:48
that two sugar pills a day are a more effective treatment
154
408817
2713
que unha soa pílula de azucre.
2 pílulas ao día son mellores que unha.
06:51
for gastric ulcers
155
411554
1219
06:52
than one sugar pill.
156
412797
1240
Ese é un achado estraño e ridículo, pero verdadeiro.
06:54
Two sugar pills a day beats one a day.
157
414061
1961
Sabemos por 3 estudos diferentes sobre 3 tipos de dor
06:56
That's an outrageous and ridiculous finding, but it's true.
158
416046
2775
que unha inxección de auga salgada é máis efectivo para a dor
06:58
We know from three different studies on three different types of pain
159
418845
3297
que tomar unha pílula de azucre, unha pílula que non contén nada,
07:02
that a saltwater injection is a more effective treatment
160
422166
2645
non porque unha nin outra fagan algo fisicamente no corpo,
07:04
than a sugar pill, a dummy pill with no medicine in it,
161
424835
2605
senón porque a inxección parece unha intervención máis drástica.
07:07
not because the injection or pills do anything physically to the body,
162
427464
3344
Sabemos que as nosas crenzas e expectativas
07:10
but because an injection feels like a much more dramatic intervention.
163
430832
3356
poden ser manipuladas,
07:14
So we know that our beliefs and expectations can be manipulated,
164
434212
3062
por iso facemos ensaios
onde comparamos un control cun un placebo:
07:17
which is why we do trials where we control against a placebo,
165
437298
4048
a metade da xente recibe o tratamento real
e a outra metade, o placebo.
07:21
where one half of the people get the real treatment,
166
441370
2538
Pero non abonda.
07:23
and the other half get placebo.
167
443932
1677
O que vos amosei son exemplos das formas sinxelas e directas
07:25
But that's not enough.
168
445633
1849
en que xornalistas e vendedores de suplementos dietéticos
07:28
What I've just shown you are examples
169
448496
1776
07:30
of the very simple and straightforward ways
170
450296
2172
e naturópatas
terxiversan as probas a favor dos seus propios intereses.
07:32
that journalists and food supplement pill peddlers and naturopaths
171
452492
3263
O que é realmente fascinante
07:35
can distort evidence for their own purposes.
172
455779
2457
é que a industria farmacéutica
07:38
What I find really fascinating
173
458260
2180
usa exactamente os mesmos trucos e instrumentos
07:40
is that the pharmaceutical industry uses exactly the same kinds
174
460464
3157
pero con versións lixeiramente máis sofisticadas
07:43
of tricks and devices,
175
463645
1528
para terxiversar as probas que lles dan a médicos e pacientes
07:45
but slightly more sophisticated versions of them,
176
465197
2767
07:47
in order to distort the evidence they give to doctors and patients,
177
467988
3178
e que usamos para tomar decisións vitais.
En primeiro lugar, o ensaio con placebos:
07:51
and which we use to make vitally important decisions.
178
471190
2562
todo o mundo pensa que un ensaio debería ser
07:53
So firstly, trials against placebo:
179
473776
2533
unha comparación entre un novo fármaco e un placebo.
07:56
everybody thinks a trial should be a comparison
180
476333
2372
Pero, realmente, moitas veces non é así
07:58
of your new drug against placebo.
181
478729
1595
porque a miúdo xa existe un bo tratamento
08:00
But in a lot of situations that's wrong;
182
480348
1920
así que non queremos saber se o novo tratamento alternativo
08:02
often, we already have a good treatment currently available.
183
482292
2898
é mellor que nada.
08:05
So we don't want to know that your alternative new treatment
184
485214
2833
Queremos saber se supera o mellor dos tratamentos que xa temos.
08:08
is better than nothing,
185
488071
1151
E aínda así, de xeito repetido vemos xente
08:09
but that it's better than the best available treatment we have.
186
489246
2968
que fai ensaios contra o placebo.
08:12
And yet, repeatedly, you consistently see people doing trials
187
492238
2873
E pódese obter licenza para sacar un fármaco ao mercado
08:15
still against placebo.
188
495135
1306
só cuns datos que digan que é mellor que nada,
08:16
And you can get licensed to bring your drug to market
189
496465
2507
algo inútil para un médico coma min que intenta tomar unha decisión.
08:18
with only data showing that it's better than nothing,
190
498996
2499
Pero non é a única forma de manipular os datos.
08:21
which is useless for a doctor like me trying to make a decision.
191
501519
3002
Tamén pode facerse comparando o novo fármaco
08:24
But that's not the only way you can rig your data.
192
504545
2365
08:26
You can also rig your data
193
506934
1248
con algo inútil.
08:28
by making the thing you compare your new drug against
194
508206
2493
Pódese dar o fármaco competidor en dose moi baixa
08:30
really rubbish.
195
510723
1157
para que a xente non teña o tratamento adecuado.
08:31
You can give the competing drug in too low a dose,
196
511904
2469
Ou nunha dose moi alta
08:34
so people aren't properly treated.
197
514397
1633
para que produza efectos secundarios.
08:36
You can give the competing drug in too high a dose,
198
516054
2397
Isto foi talmente o que ocorreu
cos antipsicóticos para a esquizofrenia.
08:38
so people get side effects.
199
518475
1296
08:39
And this is exactly what happened
200
519795
1680
Hai 20 anos, apareceu unha nova xeración de antipsicóticos
08:41
with antipsychotic medication for schizophrenia.
201
521499
2465
08:43
Twenty years ago, a new generation of antipsychotic drugs were brought in;
202
523988
3532
coa promesa de que terían menos efectos secundarios.
Así que se comezaron a facer ensaios con eles
08:47
the promise was they would have fewer side effects.
203
527544
2557
comparándoos cos vellos
pero dábanse doses ridiculamente altas dos vellos fármacos
08:50
So people set about doing trials of the new drugs against the old drugs.
204
530125
3454
-20 mg ao día de haloperidol.
08:53
But they gave the old drugs in ridiculously high doses:
205
533603
2685
E é unha conclusión evidente
08:56
20 milligrams a day of haloperidol.
206
536312
1845
que se se dá un fármaco nunha dose tan alta
08:58
And it's a foregone conclusion if you give a drug at that high a dose,
207
538181
3554
terá máis efectos secundarios e o novo parecerá mellor.
09:01
it will have more side effects, and your new drug will look better.
208
541759
3280
Hai 10 anos, repetiuse a historia
cando a risperidona, o primeiro antipsicótico da nova xeración,
09:05
Ten years ago, history repeated itself,
209
545063
1988
xa non tiña dereitos de autor, e podía reproducirse libremente.
09:07
when risperidone, the first of the new-generation antipsychotic drugs,
210
547075
3325
Todos querían probar que o seu fármaco era mellor ca ela
09:10
came off copyright, so anybody could make copies.
211
550424
2342
así que houbo moitos ensaios que comparaban os novos antipsicóticos
09:12
Everybody wanted to show their drug was better than risperidone,
212
552790
3032
con 8 mg por día de risperidona.
09:15
so you see trials comparing new antipsychotic drugs
213
555846
2401
Outra vez, non é unha dose absurda, non é ilegal,
09:18
against risperidone at eight milligrams a day.
214
558271
2167
pero está moi cerca de superar o normal.
09:20
Again, not an insane dose, not an illegal dose,
215
560462
2214
Así, seguro que o novo fármaco parecerá mellor.
09:22
but very much at the high end of normal.
216
562700
1918
Polo tanto, non sorprende que, en xeral,
09:24
So you're bound to make your new drug look better.
217
564642
2517
os ensaios financiados pola industria
09:27
And so it's no surprise that overall,
218
567183
2597
teñan 4 veces máis probabilidades de dar un resultado positivo
09:29
industry-funded trials are four times more likely
219
569804
2769
que os independentes.
09:32
to give a positive result
220
572597
1329
09:33
than independently sponsored trials.
221
573950
2053
Pero -e este é un pero moi grande-
09:36
But -- and it's a big but --
222
576989
2644
(Risos)
resulta que
09:39
(Laughter)
223
579657
2521
cando observas os métodos usados en ensaios financiados pola industria
09:42
it turns out,
224
582202
1281
09:43
when you look at the methods used by industry-funded trials,
225
583507
3641
ves que son realmente mellores
que os independentes.
09:47
that they're actually better than independently sponsored trials.
226
587172
3686
E, aínda así, sempre conseguen os resultados que queren.
09:50
And yet, they always manage to get the result that they want.
227
590882
2892
Entón..., como pode ser?
(Risos)
Como podemos explicar este estraño fenómeno?
09:53
So how does this work?
228
593798
1150
09:54
(Laughter)
229
594972
1013
Ben, pois o que ocorre
09:56
How can we explain this strange phenomenon?
230
596009
2767
é que os datos negativos pérdense en combate;
09:58
Well, it turns out that what happens
231
598800
1798
non se revelan a médicos e pacientes.
10:00
is the negative data goes missing in action;
232
600622
2233
Este é o aspecto máis importante da historia.
10:02
it's withheld from doctors and patients.
233
602879
1937
Está no cume da pirámide de probas.
10:04
And this is the most important aspect of the whole story.
234
604840
2698
Precisamos ter todos os datos dun tratamento en concreto
10:07
It's at the top of the pyramid of evidence.
235
607562
2034
para saber se é efectivo ou non.
10:09
We need to have all of the data on a particular treatment
236
609620
2686
E hai dous modos de ver
se algúns datos se perderon en combate.
10:12
to know whether or not it really is effective.
237
612330
2160
10:14
There are two different ways you can spot whether some data has gone missing.
238
614514
3667
Pódense usar estatísticas ou historias.
Eu prefiro as estatísticas, así que empezarei por elas.
10:18
You can use statistics or you can use stories.
239
618205
2199
Isto é unha gráfica de funil.
10:20
I prefer statistics, so that's what I'll do first.
240
620428
2389
É unha moi boa forma de identificar
10:22
This is a funnel plot.
241
622841
1322
se pequenos ensaios negativos desapareceron en combate.
10:24
A funnel plot is a very clever way of spotting
242
624187
2191
10:26
if small negative trials have disappeared, have gone missing in action.
243
626402
3365
Esta é unha gráfica de todas as probas
que se fixeron dun tratamento concreto.
10:29
This is a graph of all of the trials done on a particular treatment.
244
629791
3478
Ao observar a parte superior da gráfica
vese que cada punto é un ensaio.
10:33
As you go up towards the top of the graph,
245
633293
2255
E ao subir, estes son os ensaios máis grandes, con menos erros.
10:35
what you see is each dot is a trial.
246
635572
1929
É menos probable que dean falsos positivos ou falsos negativos.
10:37
As you go up, those are bigger trials, so they've got less error;
247
637525
3126
10:40
they're less likely to be randomly false positives or negatives.
248
640675
3146
Así que todos se agrupan.
Os grandes ensaios están máis cerca da resposta real.
10:43
So they all cluster together.
249
643845
1392
Cando imos cara ao fondo,
10:45
The big trials are closer to the true answer.
250
645261
2507
o que vemos é, neste lado, os falsos negativos espurios
10:47
Then as you go further down at the bottom,
251
647792
2016
e, neste lado, os falsos positivos espurios.
10:49
what you can see is, on this side, spurious false negatives,
252
649832
2919
Se hai un nesgo na publicación
10:52
and over on this side, spurious false positives.
253
652775
2246
se os pequenos ensaios negativos desapareceron,
10:55
If there is publication bias,
254
655045
2076
pódese ver nunha destas gráficas.
10:57
if small negative trials have gone missing in action,
255
657145
2530
Aquí pódese ver que os pequenos ensaios negativos
10:59
you can see it on one of these graphs.
256
659699
1815
que deberían estar abaixo á esquerda desapareceron.
11:01
So you see here that the small negative trials
257
661538
2151
Esta gráfica demostra a presenza de nesgos na publicación
11:03
that should be on the bottom left have disappeared.
258
663713
2453
en estudos sobre nesgos nas publicacións.
11:06
This is a graph demonstrating the presence of publication bias
259
666190
2935
E penso que esta é a broma epidemiolóxica
11:09
in studies of publication bias.
260
669149
1920
máis graciosa que escoitastes.
11:11
And I think that's the funniest epidemiology joke you will ever hear.
261
671093
3302
Así é como se proba estatisticamente, pero
que pasa coas historias?
11:14
(Laughter)
262
674419
1011
11:15
That's how you can prove it statistically.
263
675454
2024
Ben, son odiosas, abofé que si.
11:17
But what about stories?
264
677502
1151
Hai un fármaco chamado reboxetina.
11:18
Well, they're heinous, they really are.
265
678677
1915
É un medicamento que eu mesmo lles prescribín a pacientes.
11:20
This is a drug called reboxetine.
266
680616
1589
E son un médico moi aplicado.
11:22
This is a drug which I, myself, have prescribed to patients.
267
682229
2939
Fago o posible por intentar ler e entender a bibliografía.
11:25
And I'm a very nerdy doctor.
268
685192
1336
11:26
I hope I go out of my way
269
686552
1312
Lin os ensaios sobre este fármaco. Todos positivos. Todos ben dirixidos.
11:27
to try and read and understand all the literature.
270
687888
2359
11:30
I read the trials on this.
271
690271
1308
Non atopei puntos febles.
11:31
They were all positive, all well-conducted.
272
691603
2267
Por desgraza, resultou
11:33
I found no flaw.
273
693894
1151
que moitos deses ensaios,
11:35
Unfortunately, it turned out, that many of these trials were withheld.
274
695069
3581
en realidade, o 76 %
dos que se fixeron con este fármaco
11:38
In fact, 76 percent of all of the trials that were done on this drug
275
698674
4545
ocultáronselles a médicos e pacientes.
Se o pensades,
se eu tiro unha moeda ao ar cen veces,
11:43
were withheld from doctors and patients.
276
703243
1951
e se me permite ocultar
11:45
Now if you think about it,
277
705218
1253
11:46
if I tossed a coin a hundred times,
278
706495
2297
o resultado a metade das veces,
11:48
and I'm allowed to withhold from you the answers half the times,
279
708816
3536
podería convencervos
de que teño unha moeda de dúas caras.
11:52
then I can convince you that I have a coin with two heads.
280
712376
4089
Se eliminamos a metade dos datos,
nunca poderemos saber os verdadeiros efectos dese fármaco.
11:56
If we remove half of the data,
281
716489
1913
11:58
we can never know what the true effect size of these medicines is.
282
718426
3738
E isto non é unha historia illada.
Case a metade da información de ensaios con antidepresivos está oculta
12:02
And this is not an isolated story.
283
722188
2071
12:04
Around half of all of the trial data on antidepressants has been withheld,
284
724283
3794
pero isto vai máis alá.
O Nordic Cochrane Group intentou acceder a esa información
12:08
but it goes way beyond that.
285
728101
1436
para agrupala.
12:09
The Nordic Cochrane Group were trying to get ahold of the data on that
286
729561
3346
Os Cochrane Groups son unha alianza internacional sen fin de lucro
12:12
to bring it all together.
287
732931
1195
que fai revisións sistemáticas de todos os datos que aparecen.
12:14
The Cochrane Groups are an international nonprofit collaboration
288
734150
3019
E precisan ter acceso a todos os datos dos ensaios.
12:17
that produce systematic reviews
289
737193
1490
12:18
of all of the data that has ever been shown.
290
738707
2097
Pero as compañías ocúltanlles esta información,
12:20
And they need to have access to all of the trial data.
291
740828
2534
tal como fixo tamén a Axencia Europea de Medicamentos
12:23
But the companies withheld that data from them.
292
743386
2443
durante 3 anos.
12:25
So did the European Medicines Agency --
293
745853
2195
Este é un problema actualmente sen solución.
12:28
for three years.
294
748072
1586
12:29
This is a problem that is currently lacking a solution.
295
749682
3032
E para amosarvos o seu tamaño, velaquí un fármaco chamado Tamiflu,
12:32
And to show how big it goes, this is a drug called Tamiflu,
296
752738
2899
en que os gobernos do mundo
gastaron miles e miles de millóns de dólares.
12:35
which governments around the world
297
755661
1662
E gastáronos coa promesa
12:37
have spent billions and billions of dollars on.
298
757347
2843
de que era un fármaco que reduciría a taxa
12:40
And they spend that money on the promise that this is a drug
299
760214
2867
de complicacións da gripe.
Xa temos os datos
12:43
which will reduce the rate of complications with flu.
300
763105
2972
que din que reduce a duración da gripe nunhas horas.
12:46
We already have the data
301
766101
1151
Pero a min éme igual. E aos gobernos tamén.
12:47
showing it reduces the duration of your flu by a few hours.
302
767276
2794
Sinto que teñades a gripe, sei que é horrible,
12:50
But I don't care about that, governments don't care.
303
770094
2454
pero non imos gastar miles de millóns de dólares
12:52
I'm sorry if you have the flu, I know it's horrible,
304
772572
2454
para intentar reducir a duración dos síntomas da túa gripe
12:55
but we're not going to spend billions of dollars
305
775050
2244
en medio día.
Prescribimos eses fármacos, acumulámolos para emerxencias
12:57
trying to reduce the duration of your flu symptoms by half a day.
306
777318
3162
pensando que reducirían o número de complicacións,
13:00
We prescribe these drugs.
307
780504
1325
13:01
We stockpile them for emergencies
308
781853
1803
é dicir, pneumonía e morte.
13:03
on the understanding they'll reduce the number of complications,
309
783680
3089
O Cochrane Group de enfermidades infecciosas, con sede en Italia,
13:06
which means pneumonia and death.
310
786793
1534
intentou obter
13:08
The infectious diseases Cochrane Group, which are based in Italy,
311
788351
3459
das compañías farmacéuticas todos os datos nun formato usable
13:11
has been trying to get the full data in a usable form
312
791834
3177
para poder decidir de forma concluínte
13:15
out of the drug companies,
313
795035
1268
se o fármaco é efectivo ou non
13:16
so they can make a full decision
314
796327
2091
e non foron capaces de conseguir esa información.
13:18
about whether this drug is effective or not,
315
798442
2097
13:20
and they've not been able to get that information.
316
800563
2966
Este é, sen dúbida,
o problema ético máis grande
13:23
This is undoubtedly the single biggest ethical problem
317
803553
5206
con que bate a medicina hoxe en día.
Non podemos tomar decisións
13:28
facing medicine today.
318
808783
1976
ao non termos toda a información.
13:31
We cannot make decisions in the absence of all of the information.
319
811204
5333
Así que é un pouco difícil
13:37
So it's a little bit difficult from there
320
817789
2977
extraer algún tipo de conclusión positiva.
13:40
to spin in some kind of positive conclusion.
321
820790
3446
Pero eu diría isto:
13:45
But I would say this:
322
825196
1631
creo que a luz do sol
13:48
I think that sunlight
323
828931
2796
é o mellor desinfectante.
Todas estas cousas están ocorrendo diante dos nosos ollos,
13:51
is the best disinfectant.
324
831751
1724
e todas están protexidas
13:54
All of these things are happening in plain sight,
325
834077
2735
por un campo de forza de tedio.
13:56
and they're all protected by a force field of tediousness.
326
836836
4331
E penso que, con todos os problemas da ciencia,
unha das mellores cousas que podemos facer
14:01
And I think, with all of the problems in science,
327
841631
2407
é levantar a tapa,
remexer nos mecanismos e osmar.
14:04
one of the best things that we can do
328
844062
1820
14:05
is to lift up the lid, finger around at the mechanics
329
845906
2803
Moitas grazas.
(Aplausos)
14:08
and peer in.
330
848733
1279
14:10
Thank you very much.
331
850036
1160
14:11
(Applause)
332
851220
3238
About this website

Este sitio presentarache vídeos de YouTube que son útiles para aprender inglés. Verás clases de inglés impartidas por profesores de primeiro nivel de todo o mundo. Fai dobre clic nos subtítulos en inglés que aparecen en cada páxina de vídeo para reproducir o vídeo desde alí. Os subtítulos desprázanse sincronizados coa reprodución do vídeo. Se tes algún comentario ou solicitude, póñase en contacto connosco a través deste formulario de contacto.

https://forms.gle/WvT1wiN1qDtmnspy7