When we say that "an algorithm is biased" we usually mean, "biased people made an algorithm." This explains why so much machine learning prediction turns into phrenology.

1/

Researchers with phrenological delusions ask machines to find statistical correlates of personalities or emotions, and machines dutifully provides them. It's high-stakes, machine-human collaborative apophenia, detecting patterns where none exist.

https://t.co/2b0IkQrI62

2/
Regrettably, this junk science gets published in respected journals. In 2017, @nature published a study by Stanford's Michal Kosinski claiming that machine learning could detect the facial correlates of homosexuality, creating an alleged AI gaydar.

3/
Unsurprisingly, Kosinski's study spectacularly failed to replicate. But as is so often the case, the blockbuster finding gets all the press, the careful replication work that calls it into doubt is roundly ignored.

https://t.co/J4rd6nLA4n

4/
Kosinski hasn't given up on AI phrenology. His lab's latest paper (published by Nature...again!) claims that he can detect political affiliation from social media photos.

https://t.co/kNPJ4vOwEr

5/
Spoiler: he can't.

What his system is most likely detecting is certain conventions in poses and expressions that are used in different political subcultures. Resting Karen face, basically.

6/
Unfortunately, this claim is being credulously reported in the tech press as true, even as the writer notes that this ML system barely outperforms random chance.

https://t.co/z1nkFFod3H

7/
Scientific racism has been with us for centuries. It's enjoying a renaissance today, driven in part by the neophrenologists of the ML world. They are the modern descendants of the caliper-wielding eugenicists of yore.

8/
To understand the genomic science that refutes all of this nonsense, you can read @AdamRutherford's brilliant, short, witty, vastly informative book HOW TO ARGUE WITH A RACIST. You'll be glad you did.

https://t.co/bPO3y5CzIX

9/
Image:
Cryteria (modified)
https://t.co/ICebVcdH1f

CC BY:
https://t.co/5YJhpDj3vT

eof/

More from Cory Doctorow #BLM

Happy Birthday to the queen of the scream queens, Barbara Steele! https://t.co/qnhQvROGVa


Happy Birthday to the queen of the scream queens, Barbara Steele!
https://t.co/qnhQvROGVa


Happy Birthday to the queen of the scream queens, Barbara Steele! https://t.co/qnhQvROGVa


Happy Birthday to the queen of the scream queens, Barbara Steele! https://t.co/qnhQvROGVa


Happy Birthday to the queen of the scream queens, Barbara Steele! https://t.co/qnhQvROGVa
Today's Twitter threads (a Twitter thread).

Inside: Stop saying "it's not censorship if it's not the government"; Trump's swamp gators find corporate refuge; and more!

Archived at: https://t.co/7JMcAbaULj

#Pluralistic

1/


Monday night, I'll be helping William Gibson launch the paperback edition of his novel AGENCY at a Strand Bookstore videoconference. Come say hi!

https://t.co/k3fvBdqOK0

2/


Stop saying "it's not censorship if it's not the government": I didn't expect the Spanish Inquisition.

https://t.co/7I0MpCTez5

3/


Trump's swamp gators find corporate refuge: The Swamped project.

https://t.co/MUJyIOr2iw

4/


#15yrsago A-Hole bill would make a secret technology into the law of the land https://t.co/57bJaM1Byr

#15yrsago Hollywood’s MP loses the election — hit the road, Sam! https://t.co/12ssYpV46B

#15yrsago How William Gibson discovered science fiction https://t.co/MYR0go37nW

5/

More from Tech

You May Also Like

So the cryptocurrency industry has basically two products, one which is relatively benign and doesn't have product market fit, and one which is malignant and does. The industry has a weird superposition of understanding this fact and (strategically?) not understanding it.


The benign product is sovereign programmable money, which is historically a niche interest of folks with a relatively clustered set of beliefs about the state, the literary merit of Snow Crash, and the utility of gold to the modern economy.

This product has narrow appeal and, accordingly, is worth about as much as everything else on a 486 sitting in someone's basement is worth.

The other product is investment scams, which have approximately the best product market fit of anything produced by humans. In no age, in no country, in no city, at no level of sophistication do people consistently say "Actually I would prefer not to get money for nothing."

This product needs the exchanges like they need oxygen, because the value of it is directly tied to having payment rails to move real currency into the ecosystem and some jurisdictional and regulatory legerdemain to stay one step ahead of the banhammer.