Young, early stage founder asked for any hiring thoughts - figured worth sharing with the twitter-verse if they can be helpful.

1a) Make people do the work they are going to do for you during the interview process.

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

NESARA / GESARA explained for all who are not aware.

"The End of Poverty, The End of Debt, The Beginning of a New Golden Age!"

No Poverty, No Hunger, No Debt, Only Global Prosperity and Peace for ALL

NESARA will merge with GESARA

N = National (US)
G = Global

1/ Jassa Singh Ahluwalia & his role in the history of Shri Harmandir Sahib (A Thread)

2/ Jassa Singh was born in 1720/21 at a village called Ahlu in the Lahore District of Punjab.

3/ Jassa Singh was educated in Delhi, in Persian, Arabic & more, under the care & supervision of Mata Sundari Ji.

Mata Sundari Gurdwara in Delhi.

4/ In 1733, Jassa Singh's mama, Thag Singh (ਤਾਗ ਸਿੰਘ), requested Mata Sundari Ji's permission to take Jassa Singh back to Punjab.

5/ At first Mata Ji refused but eventually gave permission for Jassa Singh to go with his mama, giving Jassa Singh a blessing and weapons, informing him, it was now the right time to take up arms.

(An extract from Field Marshal Sam Manekshaw, Soldiering with Dignity)

The man eventually destined to be free India's first Field Marshal was born on 3rd April 1914 at Amritsar. How did a Parsi couple settle for the holy city of the Sikhs? I once asked him and was told that in+

1899, his father recently qualified as a doctor and just married, could make no professional headway in Bombay, and was advised to try his luck at Lahore in the Punjab. With his young wife, he set off by train for Lahore. The long dusty and hot journey took five days and by the+

end of it, his young wife, who had never left the comforts and civilization of Bombay, was in hysterics and cried to go back. Poor Dr Manekshaw did all he could to comfort her, but as the train steamed into Amritsar, with her first sight of the Sikhs the young bride screamed her+

lungs out and refused to go any further. So they left the train at Amritsar, and there they stayed for forty-five years.

The Manekshaws had six children, four boys and two girls, and Sam was the fifth child. Sam had his schooling at Nainital's Sherwood College.+

After completing his schooling, he should have gone to England to pursue higher studies; this was the promise made to him by his father but, fortunately for the Indian Army, Dr Manekshaw felt that this particular son was far too young to be on his own in a foreign country, even+