@Rossana38510044 @ydeigin @MonaRahalkar @BahulikarRahul Excellently written article
Nicholson Baker
https://t.co/IZWOjdYeGL
https://t.co/0jeie0jIHO

Worth its long length, although the conclusion is muted, for acceptability I imagine.

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

#Thread Two divine forms of Khatu Shyam ji...

On the day of Amavasya, devotees get the darshan of Shyam Baba in Shyam varan (black color). In ordinary days, the form of Baba is saffron. The reason for this is a custom. The real head of Shyam Baba which had appeared from Shyam Kund is of Shyam varan.

Every day Shyam Baba's grand Shringar is done by Pujaris. The main part of Shyam Baba's shringar is Tilak. This Shringar is done by the members of Nij Mandir sevaks. The sevaks of the Nij Mandir do sandalwood tilak to Baba everyday in the auspicious time.

This Divine Tilak is applied from the forehead to the nose. When Baba is given a bath by sevaks, this tilak comes off. Then in the auspicious time, the sevaks again apply tilak to Baba.

There is no auspicious time on the Amavasya. Because of this, tilak is not done on that day. That's why devotees have darshan of Shyam Baba on the Amavasya only in the actual real form (Shyam Swaroop). Baba's tilak is done on Amavasya only on the day of Deepawali.

Again, at such a key moment in UK and at such high political levels, evidence of deep misunderstanding of EU: The PM is under pressure in some quarters to delay #Brexit vote to allow her first to “improve” deal in Brussels BUT EU is determined not to budge at this stage

2) All EU leaders watching tomorrow’s vote. Of course they want to avoid a no deal #Brexit BUT they feel the deal - so painfully negotiated between EU and UK - is too fresh to re-open. Clarifications, yes but fundamental renegotiations, no.

3) The EU’s international reputation as a tough deal-maker is at stake here too. If Brussels now suddenly “gives in” to U.K. on EU red lines (eg backstop) then that would weaken the EU’s reputation in future trade negotiations with other non EU countries

4) Also on backstop the EU is unlikely to cave in to favour a relationship with a leaving member state (UK) against the explicit wishes and ignoring the deep concerns of a continuing member: Ireland.

5) Both the EU and the PM signed up to a guarantee to protect the border between Northern Ireland and the Republic of Ireland. If either the U.K. or EU can leave the backstop unilaterally then this clearly is no longer a guarantee.