[thread]

I am going to do a thread on several numbers

1

2,996

4,494

43,730

106,158

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

"How the Avengers would respond to the Capitol riot" (a thread)

CAPTAIN AMERICA - tells Falcon, "I fought Nazis once before. They're extremely dangerous." They then see the guy scaling the Capitol wall fall into the shrubs. Falcon: "You sure these are the same Nazis?"

IRON MAN - lands by the guy carrying the podium. Says, "Mind if I borrow this?" then tosses it to Hulk, who swings it like a bat at the mob. Guy: "Hey, that's MY podium!" Iron Man: "Actually it's the Speaker's. And technically, it's a lectern." Then punches him through a wall.

BLACK WIDOW - enters hotel room where Jack Dorsey is tied up. Rips duct tape off his mouth. Jack: "I'll do anything you want!" BW: "Disable POTUS's Twitter. NOW!" Jack fumbles with his phone. "Done. Anything else?" BW: "Yeah. Trim your beard for God's sake." *tosses him clippers*

HULK - grabs a selfie stick from one of the guys and beats him over the head with it. Deeming it too small, he grabs another guy's Confederate flag and takes out a whole swath of rioters. He then tosses the flag to Cap, who uses it as a javelin to impale a fleeing Ted Cruz.

HAWKEYE - hears Iron Man in his earpiece say, "Looks like Orange Julius is tweeting from another account." Hawkeye: "On it." He locks in on Trump through the White House window and fires an arrow, knocking the phone out of Trump's hands. Hawkeye: "Damn that felt good."

SRI KANTESH HANUMANTHA, KADARAMANDALAGI (KAR)
#bharatmandir

KANTESHA means Prabhu full of brightness.
Here, Sri Hanuman appears with a front face and sparkling eyes. Earlier, the village was also called KANTESHPURI on the name of Kantesha Hanuman.

Several thousands of years ago, Hanuman lived in this village. He once saw the Sun and mistaking it to be a fruit, began flying towards it. Since then, this village came to be known as Kadara Man Dalagi. (Kadar means rays, mandala is cluster of rays).

It is believed that King Janmejaya had set up the shrine to get rid of his difficulties.
There is a small pond on the right side of the kshetram where Teppotsava (Float festival) is celebrated.

Kanaka Dasa has praised Sri Kantesha in his various poetic compositions.

Kanaka Dasa was the first devotee to popularize the power of Kantesha. It is said that once Kanaka Dasa was deeply wounded in a battle. To seek blessings, he visited Tirupati but Sri Venkatesha appeared in his dream and advised him to see Kantesha first before seeing him.