site banner

Small-Scale Question Sunday for September 10, 2023

Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?

This is your opportunity to ask questions. No question too simple or too silly.

Culture war topics are accepted, and proposals for a better intro post are appreciated.

2
Jump in the discussion.

No email address required.

I'm doing a fun little assignment where we're supposed to find a few misleading graphs, infographics, or other data visualization and talk about how it could be misleading. For example, I remember this fun one from the CBC in Canada that deliberately misstated the proportion of public funding. Anyone have any other good examples that spring to mind? (Not that I'm trying to freeload, it's not that kind of difficult assignment, but I'm curious if there are any that have just stuck in your head like that one did for months or years?

I'll always point to ProPublica's Machine Bias as the example of lying with statistics and stories. Compare their pair of graphs "Black Defendants’ Risk Scores" and "White Defendants’ Risk Scores" to the Washington Post's article's graph "Recidivism Rates by Risk Score".

Maybe don't include that example in your assignment, though.

Could you share this instead as pictures or whatever? Wapo has a paywall, and the wayback machine does not include images.

If I’m reading this right, it looks like the risk scores are pretty well calibrated.

I assume ProPublica was using their graphs to argue the difference in histograms was a systemic bias?

Nothing nearly that sophisticated I'm afraid. Here is one of Propublica's senior writers accusing crime prediction algorithms of being racially biased for predicting more crime in black neighborhoods.

/images/16945411023725226.webp

And so PredPol continues to make crime predictions that are incredibly unevenly distributed by race. Take these two neighborhoods in Plainfield, N.J. – where 11 crimes were predicted in the White neighborhood and 1,940 in the Black & Brown neighborhood.