BC DATA SCIENCE
Saved by @zmbnski

An amazing new project from @bearpelican was just released: https://t.co/DBov6sZTVS . A beautiful design; you can auto-generate a melody from chords, chords from a melody, and more.

It's technically brilliant, combining BERT, seq2seq, and Transformer XL
https://t.co/jF3mO5aXiu

 It's also a wonderful example of leveraging and customizing the fastai framework in a deep & thoughtful way.
Here's the full set of blog posts diving in to this project:

https://t.co/jF3mO5aXiu

https://t.co/DrCJxxJRAy

https://t.co/GgatWxa9nM

https://t.co/U9Yp5IZpxt

More from Data science

John Myles White
John Myles White
@johnmyleswhite
This post is pretty bizarre, but it manages to hit on so many false beliefs that I've seen hurt junior data scientists that it deserves some explicit

(1) The notion that R is well-suited to "building web applications" seems totally out of left field. I don't feel like most R loyalists think this is a good idea, but it's worth calling out that no normal company will be glad you wrote your entire web app in R.

(2) It is true that Python had some issues historically with the 2-to-3 transition, but it's not such a big deal these days. On the flip side, I have found interesting R code that doesn't run in modern R interpreters because of changes in core operations (e.g. assignment syntax).

(3) "Most of the time we only need a latest, working interpreter with the latest packages to run the code" -- this is where things get real and reveal some things that hurt data scientists. If this sentence is true, it's likely because you don't share code with coworkers.

(3) Really is a broader issue in data science: people only think of what they need to do their work if no one else existed and code was never maintained. Junior data scientists almost always operate on projects they start from scratch and don't have to maintain for long.
DATA SCIENCE
Data Professor
Data Professor
@thedataprof
Cheat sheet that summarizes #DataScience in 10 pages
(Links in the comments below 👇)


2/ Link to the cheatsheet by Maverick
CODING RESOURCE , DATA SCIENCE
Advertisement
Greg Yang
Greg Yang
@TheGregYang
1/ A ∞-wide NN of *any architecture* is a Gaussian process (GP) at init. The NN in fact evolves linearly in function space under SGD, so is a GP at *any time* during training. https://t.co/v1b6kndqCk With Tensor Programs, we can calculate this time-evolving GP w/o trainin any NN


2/ In this gif, narrow relu networks have high probability of initializing near the 0 function (because of relu) and getting stuck. This causes the function distribution to become multi-modal over time. However, for wide relu networks this is not an issue.

3/ This time-evolving GP depends on two kernels: the kernel describing the GP at init, and the kernel describing the linear evolution of this GP. The former is the NNGP kernel, and the latter is the Neural Tangent Kernel (NTK).

4/ Once we have these two kernels, we can derive the GP mean and covariance at any time t via straightforward linear algebra.


5/ So it remains to calculate the NNGP kernel and NT kernel for any given architecture. The first is described in https://t.co/cFWfNC5ALC and in this thread
DATA SCIENCE
Emil Wallner
Emil Wallner
@EmilWallner
Tips for AI writers:

1. Spend 30% of your effort on skimming all student ML papers (e.g. Stanford NLP CS224n) the past 3 years and prototype your favorites

The idea is everything. Pick an area you are interested in and ideally something that has a visual aspect to it

Most of my 'on the top of my mind' ideas were bad in retrospect. Skimming 100s of student papers will give you an overview of what's interesting.

Student papers are overlooked, easy to understand, and have good compute constraints.

2. Spend 30% on your effort on coding

Create an edge to the project. Apply it to something new and use FastAI or Keras to improve the accuracy with 5-30%.

3. Spend 30% writing an in-depth article

Have a north star article in terms of structure and quality. Find something that stretches you to your utmost capability. I used @copingbear’s Style transfer article:

4. Spend 10% marketing your project

Invest a week in studying the strategies to rank on sites like HN and Reddit, then use them. If you have an interesting result and a great article, you've done the hard work.
DATA SCIENCE
Sophie Hill
Sophie Hill
@sophie_e_hill
This is a more wonky thread about how I made this visualization in #Rstats using the awesome visNetwork

First step is to create the underlying network data. We need one file of "nodes" - i.e. the people and organizations. And one file of "edges" - i.e. the connections between them.

I created these by hand, based on excellent investigate journalism:


Now we can pull these together to create a network visualization!

You'll notice that I included a column for "type" in the nodes file. This allows me to use different icons for people vs firms vs political organizations.


All the icons are taken from @fontawesome. I *think* the visNetwork 📦 currently only works with fontawesome version 4.7, which is a bit limited – e.g. I decided to use a book icon to represent the fringe Evangelical Christian sect "Exclusive Brethren"! 😂


I very much enjoyed getting to use the "incognito" icon to represent all the unknown donors that have funded Tory MP Owen Paterson's overseas jaunts!
DATA SCIENCE

You May Also Like

Simon Wardley #EEA
Simon Wardley #EEA
@swardley
X : Our executive team is concerned that we need to up our game in order to out innovate Amazon.
Me : Do you map?
X : Yes
Me : Like this?
X : No. What's that?
Me : A map of a tea shop.


X : Why is that a map?
Me : Long story, all to do with how space has meaning. To keep it short, maps help people to focus on user needs, the components involved, to communicate missing components and scenario play ideas like staff becoming robots.


Me : They’re also good for measuring and managing capital flow, making investment decisions, removing bias and getting rid of duplication.
X : I don’t see how that helps with innovation?


Me : Well, innovation is a tricky word because we use it to describe many things. If you’re talking about differentiation with the adjacent unexplored then you’re experimenting in the “uncharted” space e.g. immortality with magic provided by the special custom built kettle.


X : That sounds like nonsense.
Me : A lot of what people think will be the next great innovation is nonsense. Actually, most of it is. That’s the nature of the uncharted space, it’s experimental, high risk and generally results in failure.
X : We need more reliable innovation.
TECH
STEALTH JEFF
STEALTH JEFF
@drawandstrike
So it's now October 10, 2018 and....Rod Rosenstein is STILL not fired.

He's STILL in charge of the Mueller investigation.

He's STILL refusing to hand over the McCabe memos.

He's STILL holding up the declassification of the #SpyGate documents & their release to the public.

I love a good cover story.......

The guy had a face-to-face with El Grande Trumpo himself on Air Force One just 2 days ago. Inside just about the most secure SCIF in the world.

And Trump came out of AF1 and gave ol' Rod a big thumbs up!

And so we're right back to 'that dirty rat Rosenstein!' 2 days later.

At this point it's clear some members of Congress are either in on this and helping the cover story or they haven't got a clue and are out in the cold.

Note the conflicting stories about 'Rosenstein cancelled meeting with Congress on Oct 11!"

First, rumors surfaced of a scheduled meeting on Oct. 11 between Rosenstein & members of Congress, and Rosenstein just cancelled it.
ALL
Advertisement
History Under Your Feet
History Under Your Fee...
@HUFToday
#TodayInHistory Ram Prasad Bismil,Ashfaqullah Khan and Roshan Singh are hanged in 1927, as they give up their life for the cause of freedom and inspire many a revolutionary. #LestWeForget


Shahjahanpur was a hub of revolution during the freedom struggle. Most of the revolutioaries in the North, were from this town. And among them, the most famous were two friends, whom destiny would bring together- Ram Prasad Bismil and Ashfaqullah Khan.

Ashfaqullah Khan was born at the turn of the 20th century on October 22, while Bismil was born 3 years earlier on June 11, in the same town. Both of them were excellent writers in Urdu and Hindi.

Both of them would come together under the Hindustan Republican Association, not to mention the fact that Ashfaq was an admirer of Bismil’s poetry, and became close friends with him on that account.

And both these men were hanged on the same date, December 19, 1927 for their involvement in the Kakori event. Two men from different religions, different backgrounds, yet destiny would bring them together.
HISTORY
Greg Olear
Greg Olear
@gregolear
Strange things are afoot at the Circle K. Let’s sort it out.

[THREAD]


1/ Two nights ago, Rupert Murdoch called on Mitch McConnell, after hours. Since then, two Fox News-related Twitter accounts have not tweeted.

2/ Trump fired Sessions on Wednesday, replacing him with human dildo/Putin collaborator Matt Whitaker. Sessions had asked to stay until Friday and was told to leave immediately. So there was clearly some urgency to install the dildo...er, puppet.

3/ The Democrats won the SHIT out of the Midterms. Come January, the House check on Trump will leave him so hobbled, he’ll be like the dude from Misery.

4/ Trump went to Paris, ostensibly for an Armistice Day centennial event. He skipped the event, and much of the dinner tonight, because of “weather,” which everyone seems to agree is a bullshit excuse.
POLITICS
Michael Dearing
Michael Dearing
@mcgd
An irony of facebook's situation.

Sheryl got her MBA at Harvard. One of the most famous cases (Extra Strength Tylenol) in one of the most famous classes (Business History) she took: in 1982, someone put cyanide in Extra Strength Tylenol capsules and killed 7 people in Chicago.

What do you do when someone turns your product into a weapon? When they use the system you built to harm? James Burke, CEO of J&J, was shockingly open with the public, he pulled the product and made significant packaging changes to make product safer (but not tamper-proof).

He over-shared every step along the way re investigation, redesign, stood up as both CEO and human. The reintroduction of new Extra Strength Tylenol succeeded. Burke saved the brand.

But four years later it happened again. A killer put cyanide in the capsules, this time a woman in Yonkers died. Same CEO, Burke, pulled the product again, completely changed the form factor from capsule to caplet and relaunched *again*. It worked *again*. How'd they do that?

Burke (CEO) tapped J&Js goodwill bank account w/ the public. Two big withdrawals from that bank account in four years + 8 dead bodies! But his honesty, openness, humanity (choked up about the deaths more than once), humility kept the goodwill bank balance positive the whole time.
TECH