1/ Today I prepared for talking about common mistakes startups make (founding -> growth stages) by writing it in tweet form. I ramble too much when public speaking and hoped it would make the core ideas clearer in my mind and more concise. Think it worked. Here are the tweets

12 Azhwars (Alwars)

The 12 Azhwars, (the Main composers of Naalayira Divya Prabandam - 4000 poetic Rhymes) are known as Nityasuris or Divyasuris; those who reside permanently with the Lord in His Heavenly abode.

They have incarnated as Azhwars -Vasihnavite Saints - to propagate Bhakthi Marga, devotion to Lord Vishnu.

Alwars have dedicated their lives towards Lord Sriman Narayana and they led their life by praising Him.

These Alwars were born in various parts of our country but they were all united in a common subject, ie dedicating their lives and praising the Lord.

Poigai Alwar, Bhoodath Alwar and Pei Alwar are collectively called as "Mudhal Alwars" were found in the same period of time.

Thirumazhisai Alwar, who thought the Perumal as his friend and has sung Mangalasasanam on Perumal.

Thirumangai Alwar was a great king and later, changed his life to work for the Perumal and for his bhaktaas.

Thondaradippodi Alwar, who is also named as "Vipra Narayanar" led his life as the servant to the God and did service to Him by offering beautiful Garlands.

You want to know something about how bullshit insane our brains are?
OK, so there's a physical problem with our eyes: We move them in short fast bursts called "saccades", right? very quick, synchronized movements.
The only problem is: they go all blurry and useless during this

having your vision turn into a blurry mess every time you move your eyes is obviously not a good idea, so our brains hide it from us. Now, imagine you're an engineer and you have this problem.

You've got some obvious solutions you could do.
1. make the vision go black during movement. (Some VR games do this!)
2. just keep showing the last thing we saw prior to movement

both are good options with different downsides, but OH NO. this is assuming everything makes sense and is chronological and (regular) logical.
Your brain does neither of these options, really.

first, it basically puts your visual system on "pause". You're not seeing blackness or even nothing, you're just not seeing period.
then when you finish your saccade, it shows you what you now see at the new position. and then it pretends it can time travel.

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

Did you know?

Rani Bhabani was the Queen of Natore, Bengal or 'Natorer Rani' as she was famously called. She made great contributions in Tarapith & renovated Benaras.

In Varanasi, Durga Kund Mandir was constructed by Rani Bhabani in the 18th century.

Born in Chhatimgram village, Bogra District,Her father's name was Atmaram Choudhury.Bhabani was married off to Raja Ramkanta Moitra,the then zamindar of Rajshahi.After his death, Bhabani became the zamindar, and started being referred to as Rani.She was known as Ardhabangeshwari.

A woman as a zamindar was extremely rare in those days, but Rani Bhabani managed the vast Rajshahi zamindari most efficiently and effectively for over four decades.
Maharani Bhavani was very pious in her personal life. She passed her life in a strict disciplined way.

She conducted the administrative work skillfully. As a Maharani she was an impartial judge. Rani Bhavani had a very hard time during the fag end of her life. The Zamindari (estate) incurred serious loss due to the change of the revenue policy of the company.

In spite of being the owner of a large Zamindari (estate), she had to depend on the stipend of the government in the later part of her life. The amount of this stipend gradually decreased and became Rs. 1000/- only in the end.