BC DATA SCIENCE

Saved by @zmbnski

Emil Wallner
@EmilWallner 6 years, 11 months ago 1683 views

Save to PDF Share See On Twitter

Tips for AI writers:

1. Spend 30% of your effort on skimming all student ML papers (e.g. Stanford NLP CS224n) the past 3 years and prototype your favorites

The idea is everything. Pick an area you are interested in and ideally something that has a visual aspect to it

Most of my 'on the top of my mind' ideas were bad in retrospect. Skimming 100s of student papers will give you an overview of what's interesting.

Student papers are overlooked, easy to understand, and have good compute constraints.

2. Spend 30% on your effort on coding

Create an edge to the project. Apply it to something new and use FastAI or Keras to improve the accuracy with 5-30%.

3. Spend 30% writing an in-depth article

Have a north star article in terms of structure and quality. Find something that stretches you to your utmost capability. I used @copingbear’s Style transfer article: https://t.co/OrR1B94t1w

4. Spend 10% marketing your project

Invest a week in studying the strategies to rank on sites like HN and Reddit, then use them. If you have an interesting result and a great article, you've done the hard work.

Also, cross-publish. Aim for top tech publications on Medium(e.g. @TDataScience), @freecodecamp's blog and youtube channel, @hackernoon's blog, FastAI's blog, Keras's blog, @thepracticaldev, and email 10-30 established tech sites like @thenextweb.

5. Spend 1-2 months on each article/project

Articles will market you 24/7 worldwide. You want them to be relevant for a decade. High-quality articles increase your reputation and spread easier on the web.

cc @remiconnesson @mehtadata_

More from Data science

Ryan J. Gallagher
@ryanjgallag

Tired of word clouds? Want to do better sentiment analysis? Not sure how to look at the words underneath your measures?

Our long overdue paper on generalized word shift graphs is finally here!
https://t.co/lIBXvbMJWX
https://t.co/vSL1REYT8V

So what are they?

1/n

If we have two texts, there are many ways we can compare them. Weighted averages are a particularly useful measure because they're flexible and interpretable

Proportions, Shannon entropy, the KLD, the JSD, and dictionary methods can all be written as weighted averages

2/n

But weighted avgs are also slippery. When we try to compress complex phenomena like happiness, surprise, divergence, or diversity into a single number, it can be unclear what we're measuring

If the measure goes up, what does that mean? Why did it do that? Can we trust it?

3/n

Very often, that's the end of the line and we're left with an uneasy feeling in the pit of our stomach that our weighted avg is actually picking up a data artifact or some other unintended peculiarity

Word shift graphs help us address those concerns

4/n

First, word shifts look under the hood of weighted averages to see what's going on

All weighted averages are a sum of contributions from individual words. We can pull out those words, and rank which ones contribute the most to the difference between two texts

5/n

Simon DeDeo
@SimonDeDeo

On Bayesianism, the Many Worlds Interpretation, and personal identity.

Some thoughts worked out in a letter to a friend, which is the kind of thing you do when off Twitter for a glorious week. (🧵)

“Chance is ignorance”—the Bayesian story; all probabilities represent states of mind, not states of the world. One *could* put (some) chances “in the world”, but let’s take Occam’s Razor seriously...

That the probability of a fair coin coming up heads is 50% simply means that marginalizing (tracing, as the physicists say) over the hidden facts leaves you, nearly, maximally ignorant of the outcome.

Quantum uncertainty (access below!) poses an apparent challenge to this story. There seems to be nothing to be ignorant about when it comes to (say) electron spin—there is nothing “inside” the

The electron is a simple object, in other words. So where does the uncertainty come from? One could follow David Wallace’s wonderful interpretation in terms of chaotic dynamics and decoherence, but let’s see if we can take another route...

Advertisement

elvis
@omarsar0

I have always emphasized on the importance of mathematics in machine learning.

Here is a compilation of resources (books, videos & papers) to get you going.

(Note: It's not an exhaustive list but I have carefully curated it based on my experience and observations)

📘 Mathematics for Machine Learning

by Marc Peter Deisenroth, A. Aldo Faisal, and Cheng Soon Ong

https://t.co/zSpp67kJSg

Note: this is probably the place you want to start. Start slowly and work on some examples. Pay close attention to the notation and get comfortable with it.

📘 Pattern Recognition and Machine Learning

by Christopher Bishop

Note: Prior to the book above, this is the book that I used to recommend to get familiar with math-related concepts used in machine learning. A very solid book in my view and it's heavily referenced in academia.

📘 The Elements of Statistical Learning

by Jerome H. Friedman, Robert Tibshirani, and Trevor Hastie

Mote: machine learning deals with data and in turn uncertainty which is what statistics teach. Get comfortable with topics like estimators, statistical significance,...

📘 Probability Theory: The Logic of Science

by E. T. Jaynes

Note: In machine learning, we are interested in building probabilistic models and thus you will come across concepts from probability theory like conditional probability and different probability distributions.

Maria Khalusova
@mariaKhalusova

To my JVM friends looking to explore Machine Learning techniques - you don’t necessarily have to learn Python to do that. There are libraries you can use from the comfort of your JVM environment. 🧵👇

https://t.co/EwwOzgfDca : Deep Learning framework in Java that supports the whole cycle: from data loading and preprocessing to building and tuning a variety deep learning networks.

https://t.co/J4qMzPAZ6u Framework for defining machine learning models, including feature generation and transformations, as directed acyclic graphs (DAGs).

https://t.co/9IgKkSxPCq a machine learning library in Java that provides multi-class classification, regression, clustering, anomaly detection and multi-label classification.

https://t.co/EAqn2YngIE : TensorFlow Java API (experimental)

$Sunrit Jana \U0001f680$

Sunrit Jana 🚀
@JanaSunrise

Pandas is an amazing data analysis and manipulation library for python, Really popular when working with ML, Data science or more.

It has a robust data structure, Dataframe for manipulation and analyzing data.

Here's some tips to help you work better with pandas. Let's go! ↓

If you're not aware about what a Dataframe is, It's an optimized data structure for loading data, analysing it, manipulating data in it, and Mostly gathering insights.

It uses Cython backend which transpiles into C for optimized code.

Here's how a dataframe looks like,

Before we start, You need to ensure, you have pandas installed. If you don't, Do that before moving ahead!

Here are the tips, Let's go!

1/ Convert PD series to Dataframe

We all have struggled, when we deal with pandas series. It's always easier to work with Dataframes, rather than series. Here is how you can convert series to dataframe easily.

2/ How to create dummy Dataframe for testing

We always need dataframes for testing and analysing normally, if we do not have data ready. Here is how you can use Pandas API to generate different types of data.

You May Also Like

Hypertroph | Fitness C...
@CoachHypertroph

Transform your body in next 6 months.

People will charge INR 27,000+ for this course.

I am giving away the entire course for FREE:

Module 1:
Build your Fat Loss Diet Plan

· Step by Step Tutorial
· Length: 26

Module 2:
Learn how to easily track your calories/macros.

· Step by Step Tutorial
· Length: 17

Module 3:
Calculate how many weeks it will take to reach six pack.

. Math behind building six pack
· Length: 12

Module 4:
Learn how to Burn Belly Fat in 3 steps

· Science behind belly fat
· 100% Works
· Length: 15

raina douris
@RahRahRaina

fascinated by this man, mario cortellucci, and his outsized influence on ontario and GTA politics. cortellucci, who lives in vaughan and ran as a far-right candidate for the italian senate back in 2018 - is a major ford donor...

his name might sound familiar because the new cortellucci vaughan hospital at mackenzie health, the one doug ford has been touting lately as a covid-centric facility, is named after him and his family

but his name also pops up in a LOT of other ford projects. for instance - he controls the long term lease on big parts of toronto's portlands... where doug ford once proposed building an nfl stadium and monorail... https://t.co/weOMJ51bVF

cortellucci, who is a developer, also owns a large chunk of the greenbelt. doug ford's desire to develop the greenbelt has been

and late last year he rolled back the mandate of conservation authorities there, prompting the resignations of several members of the greenbelt advisory

Advertisement

asif
@aj_raja

PAKISTAN-INDIA WATER ISSUES – HOW INDIA STOPPED WATER IN PAKISTAN's CANALS IN 1948

Thread

After partition in 1947, the water system was also bifurcated between Pakistan n India.

India cheated Pakistan when on April 1, 1948, India suddenly n without warning stopped...
1/n

...the supply of waters flowing into Pakistan's Central Bari Doab and Dipalpur Canals.

The boundary award on the partition of the sub-continent had left the headworks of these canals in Indian territory, and in accepting it India had implied her willingness to leave...

2/n

...the historic distribution of common waters undisturbed.

India's action was therefore in flagrant disregard not only of international law n morality, but of her solemn commitments with Pakistan and a gross violation of this country's historical rights over common waters.

3/n

Faced with a threat of utter desolation of millions of acres of fertile land, Pakistan had perforce to sign a document with India in which she agreed to "India's progressively diminishing water supplies to these canals and to the West Punjab government's tapping...

4/n

...alternative resources".

A specific reservation was made in the document with regard to India's claim that she had full property rights over waters flowing into her territory, and could therefore use them as she liked.

The issue was, however, to be examined...

5/n

foone
@Foone

So I was talking to @gewt about Job: A Comedy of Justice and I came up with a theory that I think explains why Heinlein's late-period work is so kinda-terrible and why I still enjoy it so much

So Heinlein had always been very interesting in the short parts of his novels, like the little snippets inside chapters. He had a very fun writing style, and wrote some fun dialogue with fun characters, right?>
It probably comes from how much of his early stuff was short fiction

And I think what happened with a lot of his longer works is that he'd just start writing fun bits and hope it would end up going somewhere or having a bigger plot by the end. like eventually he'd figure out where this was going, then go back and rewrite it into a cohesive whole

and I'm sure he had editors that'd help this process. No editor would let you publish something as rambly and changing-gears-every-other-chapter as The Number Of The Beast, for example... unless you were God-King Of Science Fiction 1980s Robert Heinlein.

so basically I think what happened is that by the 80s (when he was in his seventies!!) he lost the drive to go back and rewrite and he was too Untouchable for editors to make him.

Vibhu Vashisth
@VIBHU_Tweet

Santkumaras-The four adorable kids of the Universe.

The Kumaras r the four sages who roam the Universe as children from the Puranic texts of Hinduism named,Sanaka, Sanatana,Sanandana& Sanatkumara.They r described as the first mind-born creations &sons of the creator God Brahma.

Brahma,who had received the knowledge of Puranas from the Universal being(God Himself), imbibed this to his 4 Kumaras.
Sanat Kumaras then taught the Puranas to Narada.Narada transmitted it to Krishna Dwaipayana who in turn scripted them in monumental epic documents of 18 Puranas.

The Vishnu Purana is recorded in two parts,the Vishnu Purana & Naradiya Purana.The teachings of Sanaka of the Kumara brothers r contained in the Naradiya Purana which is also divided in two parts, the first part containing the teachings of Sanaka &second part,teachings of others.

Born from Brahma's mind,4 Kumars took lifelong vows of celibacy against their father's wishes.They r said to wander throughout materialistic &spiritualistic universe without any desire but with the aim to teach.All 4 brothers studied Vedas from their Childhood&travelled together.

The Bhagwata Purana lists the Kumaras among the 12 Mahajanas(great devotees or bhaktas) who although being eternally liberated souls from birth, still became attracted to the devotional service of Vishnu from their already enlightened state.