Machine Learning Paper Reviews 🔎📜

Check out this thread for short reviews of some interesting Machine Learning and Computer Vision papers. I explain the basic ideas and main takeaways of each paper in a Twitter thread.

👇 I'm adding new reviews all the time! 👇

Machine Learning in the Real World 🧠 🤖

ML for real-world applications is much more than designing fancy networks and fine-tuning parameters.

In fact, you will spend most of your time curating a good dataset.

Let's go through the process together 👇

#RepostFriday

Collect Data 💽

We need to represent the real world as accurately as possible. If some situations are underrepresented we are introducing Sampling Bias.

Sampling Bias is nasty because we'll have high test accuracy, but our model will perform badly when deployed.

👇

Traffic Lights 🚦

Let's build a model to recognize traffic lights for a self-driving car. We need to collect data for different:

▪️ Lighting conditions
▪️ Weather conditions
▪️ Distances and viewpoints
▪️ Strange variants

And if we sample only 🚦 we won't detect 🚥 🤷‍♂️

👇

Data Cleaning 🧹

Now we need to clean all corrupted and irrelevant samples. We need to remove:

▪️ Overexposed or underexposed images
▪️ Images in irrelevant situations
▪️ Faulty images

Leaving them in the dataset will hurt our model's performance!

👇

Preprocess Data ⚙️

Most ML models like their data nicely normalized and properly scaled. Bad normalization can also lead to worse performance (I have a nice story for another time...)

▪️ Crop and resize all images
▪️ Normalize all values (usually 0 mean and 1 std. dev.)

👇

This is Karma. Karma is not a machine learning classifier 🐕‍🦺

Karma is a real dog trained to detect drugs. However, he would fail the simplest tests we apply in ML...

Let me take you through this story from the eyes of an ML engineer.

https://t.co/WAXRUlTvSI

Thread 🧵

Story TLDR 🔖

The story is about police dogs trained to sniff drugs. The problem is that the dogs often signal drugs even if there are none. Then innocent people land in jail for days.

The cops even joke about the “probable cause on four legs”.

Let's see why is that 👇

1. Sampling Bias 🤏

Drugs were found in 64% of the cars Karma identified, which was praised by the police as very good. In the end, most people don't carry drugs in their cars, so 64% seems solid.

There was a sampling problem though... 👇

The cars were not sampled at random! The police only did the sniff test if there was a serious suspicion that something is wrong.

The chance there are drugs in the car is much higher in this case!

2. Evaluation Metrics 🔍

The police referred to a 2014 study from Poland measuring the efficacy of sniffer dogs. The problem was that every test actually contained drugs!

This means there was no chance to measure false positives from the dogs! Only recall, not precision 🤦‍♂️

Dataset bias strikes again! 😬

This is a great example of dataset bias! This ML method classifies skin lesions as being malignant or not.

Can you see the problem from the examples? 🤔

Let me shortly explain 👇

The dataset used to train the model contains images of both malignant and benign lesions. The problem is that the malignant images often contain rulers printed on the skin. They are used by doctors to assess the lesion over time.

Guess what the model learned... 👇

The ML model learned to detect the rulers... 🤷‍♂️

"In our dataset, images with rulers were more likely to be malignant; thus the algorithm inadvertently “learned” that rulers are

AI Job Interviews - another good example of bias in ML 🤦‍♂️

Two journalists tested some AI tools for assessing job candidates. Even when the candidate read a Wiki article in German instead of answering questions in English, the AI systems gave them good scores 🤷‍♂️

Let's unpack 👇

The Setup 🔬

The journalists created a fake job posting on two AI interview platforms. They specified the traits of the ideal candidate and provided the questions that need to be answered during the interview.

Then they started experimenting... 👇

The Positive Test ✅

One of them did a fake interview giving all the right answers and predictably got very high scores - 8.5 out of 9 👍

Then she tried something different... 👇

The Negative Test ❌

In a second interview, instead of answering the questions in English, she just read the article on psychometrics from the German Wikipedia 😁

One system gave her a score of 6 out of 9, while the other determined she is a 73% match for the job.

Oops... 👇

What happened? 🔍

Interestingly, one of the systems generated a transcript which was obviously meaningless.

This means that the machine learning model behind the tool likely captured nuances of the intonation of the speaker instead of the meaning of the actual words.

👇

MAHARAJA CHHATRASAL BUNDELA was the great Bundela King who revolted against the Mughal ruler Aurangzeb.
Chhatrasal Bundela was born in year 1649 CE in Maur Hill of Bundela region to Champat Rai and Lal Kunwar. He was the descendent of Rudra Pratap of Orchha.

His ancesters were the vassals of Mughal Emperor. He drew inspiration from his father and revolted against the alien rule of Mughals. He was just 12 yrs old when his parents died in fight against the Mughal Army of Aurangzeb in 1661.

When his beloved father attained martyrdom in the year 166, the young Chatrasal was present in the last battle of his father against the Mughal and from these valiant campaigns,..

..he gathered the courage to free Bundelkhand from Aurangzeb’s rule.
He joined the Mughals initially, and was recommended by the Rajput King Mirza Jai Singh to be recruited in the Mughal Army in order to support their Deccan Campaigns.

But serving the alien rule of Mughals which brought chaos and misery to Bundelkhand was unacceptable for Chatrasal Bundela and his father’s incessant struggle against the Mughals kept the fire of independent Bundelkhand alive in his heart.

Please please please take your cyber security seriously even if you don’t consider yourself a high risk person. Here are a few easy things to start with. 1/n

Switch from WhatsApp to Signal and enable disappearing messages. Most of us cannot stop using WhatsApp entirely but at least turn off back ups to Google Drive or iCloud. 2/n

Do not have private conversations using the messaging service on any social media platform like Facebook, Instagram or Twitter. 3/n

Switch from Gmail to ProtonMail or any other secure email service provider. 4/n


Switch from Google Docs to CryptPad or RiseUp Pad.

@JeffJacksonNC @buzz\_chronicles @buzz\\\_chronicles @buzz_chronicles save as category @pdfmakerapp grab @pdfmakerapp grab this @readwiseio save @readwiseio save thread @threader compile summarize @Threadreaderapp unroll please @ttttreads unroll @unrollthread.com @SaveToBookmarks

Mahabharat - the great war - 18 days of heroism, deceit, blood and intrigue - now as a mega Twitter thread.

I'll add the events from a few days of the war each day.

Caveats: lots of editorialization, creative liberties and interpretations.

There will also be a lot of asides - especially around war strategy and tactics, the characters and their motivations and non-canon storylines.

Over the years, I've read multiple versions, phenomenal translations and modern retellings. So be prepared for a potpourri.

There are different ways of looking at this war. Was it a family feud? Sure - but whose family? Shantanu's or Satyavati's? Was Vyas essentially telling us his family history? And then Kunti added a twist to this tale. Here's a helpful chart:

Satyavati's two sons from Shantanu both died without children. Vyas - her first son - fathered Dhritarashtra and Pandu (and Vidur).

Pandu never fathered any children. Kunti and Madari gave birth to six demi-gods (Karna and the five Pandavs).

So Satyavati Vs Kunti and Madari.

Or was this a fight between two massive neighbouring kingdoms - the Kurus and the Panchals? While many smaller kingdoms joined the battle, most of the Pandav army (more than half of their 7 divisions) came from the Panchals. King Drupad and his son Shikhandi led two divisions.