site banner

Cochrane review is out and masks have weak evidence that they are not effective

vinayprasadmdmph.substack.com

This one is against rationalists because when Scott wrote his review that masks could be effective many of us trusted it.

I don't blame Scott for failing this one because doing review of hundreds of studies is hard and one person can hardly do it. But this clearly shows that rationalist way of thinking has no special formula, they can be easily mistaken and fall by accepting general consensus just like any other person.

I was impressed when Scott did his review about masks. I trusted it because there was no other clear evidence available. Cochrane hadn't done its review yet and NICE guidelines were silent on the issue. We vaguely knew from previous studies that masks are not effective, The WHO had said so. Suddenly everyone flipped and it was not because the evidence had changed. We simply wanted to believe that masks work and we mocked those who said “no evidence that masks help”.

Even with the belief that masks work, I never wanted mask mandates. I preferred recommendations only, so that no one was penalized or prohibited entry, travel etc if one doesn't want to wear mask. Scott unwillingly had been a catalyst for governments to introduce mask mandates and all this heavy handed approach has been for nothing.

Now we are back to square one, the evidence about masks is weak and it does not support their use even in hospital settings. We can all reflect now what happened in between during these 2 or 3 years. When I realized that Scott's review is clearly insufficient as evidence, I asked some doctors if they have any better evidence that masks work. Instead of getting answer I was told not to be silly, parachutes don't need RCTs and accused me of being covid denier for nor reason. Many so-called experts were making the same mistake as Scott by looking at the issue too emotionally. It is time to get back to reality and admit that it was a mistake and we should have judged the issue with more rational mind.

14
Jump in the discussion.

No email address required.

Just before seeing this post, I saw an article on social media arguing it was misleading: The Conversation: "Yes, masks reduce the risk of spreading COVID, despite a review saying they don’t". The summary of that article is that the review finds weak effects because it mixes together too many things that you would expect to have weak/no effect:

  • "mask" includes cloth/surgical masks (as opposed to [K]N95+ or equivalent masks) that we don't expect to work except maybe as source control.

  • Related, none of the studies look at masks as source control. i.e., they only study individuals wearing masks, not groups.

  • Most of the studies only had people wear masks in "high-risk" situations (i.e. around known-infected individuals) as opposed to, say, all the time while at work. Any consideration of the claimed mechanism of airborne transmission often from asymptomatic cases would lead you to expect that to not work, especially where "work" means medical settings where you have higher expectation of infected people around.

  • Bonus: none of the studies compare mask wearing to not masking wearing, only being advised to wear masks to not being advised to wear masks.

The articles claims if you pare down to only the studies looking at "Does wearing N95s all the time reduce COVID-19 transmission?" the answer is in fact "yes", the opposite of the headline.

Isn't "properly fitted N95s work" just another way of saying "mask mandates don't work"?

Yes! Mask mandates, as implemented, clearly didn't work. But this does not mean masks, if used properly, don't work - yet that's how everyone is interpreting it, including the other reply to your comment.

I don't think this is how he's talking about it, but he can defend himself.

What's the point of discussing some abstract perfect usage of a mask type most people didn't even have, given the policies that were implemented and the censorship of dissent? When people say "masks don't work", they clearly mean the masks they were forced to wear.

You cannot separate “telling people to wear masks work” from “wearing masks work” in the intervention. It is the real life we are talking about.

The argument that maybe the results would be better if we apply efforts to improve the compliance is a real one and was raised by the Cochrane group reviewers. Their answer was that no one has studied it, so we don't know and cannot claim that it would have helped.

I was just learning about different contraceptive methods. Their reported results of effectiveness are not some best case values but real life results from studies. https://en.wikipedia.org/wiki/Pearl_Index Even that is being criticised that in studies people get better counselling and training and may not represent the real life values. I find interesting that fertility rhythm method has very high theoretical effectiveness (slightly worse than condoms – https://en.wikipedia.org/wiki/Comparison_of_birth_control_methods) and yet it is heavily criticized by all experts in the field. It is always more easier to take a pill than measure temperature daily plus all other behavioural aspects.

Some argue that it still makes sense for their elderly relative to wear mask to protect themselves. Maybe, but I don't know your elderly relative. The statistical chances are that they are as much non-compliant as any other member of the population. Telling all hundred or thousand of them (how many readers do we have?) to wear a mask will statistically yield the same result as in those studies.

You cannot separate “telling people to wear masks work” from “wearing masks work” in the intervention. It is the real life we are talking about.

Then you just go back to the seat belt problem. Seat belts existed since the early 1960s but usage rates were abysmal for 25 years. Someone studying the effect of seat belts in 1985 would have found their efficacy lacking for the simple reason that few people used them. Seat belts had been required equipment in cars for some time but given that so few people were using them so long after their introduction, the Federal government could have been forgiven for scrapping the requirement altogether as ineffective. Instead, this is around the time state governments started requiring seat belt use among all front seat occupants. As the 1980s became the 1990s and more states started adopting such laws, auto fatalities, which had been more or less stagnant for decades, halved between the late 1980s and the present. Part of the problem could be that in a lot of places these so-called "mask mandates" were so inconsistently enforced and widely ignored that the actual effect was that of no mandate whatsoever, and that the real solution is stricter enforcement. This isn't necessarily a policy I would advocate for, but simply stating noncompliance is proof that the underlying implication is wrong is disingenuous, to say the least.

Someone studying the effect of seat belts in 1985 would have found their efficacy lacking for the simple reason that few people used them.

Nope. They'd find typical usage would (on average) result in people surviving the car crashes, and the non-usage in dying. We don't have anything like that justifying even an N95 mandate.

No, his claim is if you studied P(death | accident, car with seat belt) / P(death | accident) you wouldn't find an effect unless the sample size was massive because P(wears seat belt| car with seat belt) is very low, so P(death | accident, car with seat belt) = .1 * P(death | accident, wearing seat belt) + .9 * P(death | accident) which is .92 * P(death | accident), even if seat belts reduce crash risk by 80%!