Learn UI/UX Design for FREE 🤩

Thread 🧵

Important paper from Google on large batch optimization. They do impressively careful experiments measuring # iterations needed to achieve target validation error at various batch sizes. The main "surprise" is the lack of surprises. [thread]

https://t.co/7QIx5CFdfJ

The paper is a good example of lots of elements of good experimental design. They validate their metric by showing lots of variants give consistent results. They tune hyperparamters separately for each condition, check that optimum isn't at the endpoints, and measure sensitivity.

They have separate experiments where the hold fixed # iterations and # epochs, which (as they explain) measure very different things. They avoid confounds, such as batch norm's artificial dependence between batch size and regularization strength.

When the experiments are done carefully enough, the results are remarkably consistent between different datasets and architectures. Qualitatively, MNIST behaves just like ImageNet.

Importantly, they don't find any evidence for a "sharp/flat optima" effect whereby better optimization leads to worse final results. They have a good discussion of experimental artifacts/confounds in past papers where such effects were reported.

The Straddle is my favorite trade these days. But more often than not, one needs to adjust to make a good return from it. There are many ways to do this depending on your view, psychology and imagination. Will discuss a few that I use

The Straddle is a delta neutral strategy and it is important to keep deltas in check during the course of the Trade and not let them run away from you. Of course Volatility is the elephant in the room- but not going there as that will require a separate discussion

The first and most common method is to go 'inverted.' That is to say to shift the untested side to generate additional Premium and increase the runway to Breakeven. So if you start with a Straddle at 700 and price goes to 740, you can move the PE up to say 720.

How much should you move the untested side? While again this is a matter of skill, experience and artistry, the rule of thumb is to cut deltas by half. Remember, prices will move and you have to allow sufficient room for them to fluctuate

The second method is to shift the entire Straddle in the direction of the move. So if you have a 700 Straddle and Price goes to 740, you can shift the Straddle to 720. If you time this right, it can generally be done at virtually no cost or minimal cost.

On December 25 Mr Pool retweeted August 16 message about the Phoenix and that the worst was still on the horizon to come. 1/*

Maybe now we can assume that November 3 message meant "FUD" nor "FUN". Putting the word in capital letters seems to indicate the aspect the word fud has in our space, FUD. 2/*

Brad started it on December 22 (1/3 posts (Don't say? Sure) = 13 = Plan B). 3/*

And immediately the SEC followed dropping the bomb (1.3 billions (Don't say? Sure) = 13 = Plan B). 4/*

FUD materializes, Bitstamp is one of the first that haltes XRP trading and so on. 5/*

According to psychologists, there are four types of intelligence:

- Intelligence Quotient (IQ)
- Emotional Quotient (EQ)
- Social Quotient (SQ)
- Adversity Quotient (AQ)

1. IQ is the measure of one's ability to comprehend, solve maths; memorize things & recall subject matters.

2. EQ is the measure of your ability to maintain peace with others; keep to time; be responsible; be honest; respect boundaries; be humble, genuine, and considerate.

3. SQ is the measure of one's ability to build a network of friends & maintain it over a long period of time.

4. AQ is the measure of your ability to go through a rough patch in life and come out without losing your mind. It is a new paradigm and can be used to determine who will give up in face of troubles and may abandon their families.

Now to the very interesting & analytical part👇

People that have higher EQ & SQ tend to go further in life than those with high IQ but low EQ &SQ.

Most schools capitalize on improving IQ level while EQ & SQ are played down.

A man of high IQ can end up being employed by a man of high EQ & SQ even though he has an average IQ.

Your EQ represents your character; your SQ represents your charisma. Give in to habits that will improve these three Qs but more especially your EQ and SQ.

EQ and SQ make one manage better than the other.

Try not only to have a higher IQ but also to have higher EQ and SQ.