BC DATA SCIENCE
Saved by @Jacobtldr

🔥 Putting ML in Production! We're going to publicly develop @madewithml's first ML service. Here is the broad curriculum:

- 📦 Product
- 🔢 Data
- 🤖 Modeling
- 📝 Scripting
- 🛠 API
- 🚀 Production

More details (lessons, task, etc.) here: https://t.co/xmMm9XGK9j

Thread 👇

 Questions that this thread will answer:

- What is it?
- Who is this course for?
- What is the format?
- What makes this course unique?
- Why constrain to open source tools?
- What are my qualifications?
- Why is this free?
- What are the prerequisites?

https://t.co/xmMm9XGK9j
What is it?

Putting ML in Production: a guide and code-driven case study on MLOps. We will be developing and deploying Made With ML's first ML service, from Product → ML → Production, with open source tools.
This ML service will act as a foundation for all future ML features and subsequent iterations. The first feature is tagifai - multilabel classification of tags for a project. We'll discuss the need and utility of this feature in the first lesson.
Who is this course for?

- ML developers looking to become end-to-end ML developers.
- Software engineers looking to learn how to responsibly deploy and monitor ML systems.
- Product managers who want to have a comprehensive understanding of the different stages of ML dev.
What is the format of each lesson?

- Intuition: high level overview of the concepts.
- Code: simple code examples to illustrate the concept.
- Application: applying the concept to our specific task.
- Extensions: brief look at other tools and techniques that will be useful.
What makes this course unique?

1. Hands-on
2. Intuition-first
3. Software engineering
4. Focused yet holistic
5. Open source tools
1. Hands-on:

If you search production ML or MLOps online, you'll find great blog posts and tweets. But in order to really understand these concepts, you need to implement them.
2. Intuition-first:

We will never jump straight to code. In every lesson, we will develop intuition for the concepts and think about it from a product perspective.
3. Software engineering:

This course isn't just about ML. In fact, it's mostly about clean software engineering! We'll cover important concepts like versioning, testing, logging, etc. that really makes this a production-grade product.
4. Focused yet holistic:

For every concept, we'll not only cover what's most important for our specific task (this is the case study aspect) but we'll also cover related methods (this is the guide aspect) which may prove to be useful in other situations.
4. (cont.) For example, when we're serving our application, we'll expose our latest model as an API endpoint. However, there are several other popular ways to serving models and we'll briefly illustrate those and talk about advantages / disadvantages.
5. Open source tools:

We will be using only open source tools for this project, with the exception of @googlecloud for storage and compute (free credit will be plenty).
Why constrain to open source tools?

1. We can focus on the fundamentals, everyone can participate (single player mode as my friend @eugeneyan coined) and you will have much better understanding when you do finally use a paid tool at work (if you want to).
2. Large companies that deploy ML to production have complicated and scaled processes that don’t make sense for the vast majority of companies / individuals.
Note: I will regularly make suggestions for tools (other open source, freemium and paid) as we progress because they each have their unique advantages.
For example, for data versioning and experiment tracking, we'll use @DVCorg + @MLflow but we'll also highlight why you may consider @weights_biases or @Cometml because it’s important to know about them and what they each bring to the table.
My qualifications for teaching this:

1. I've deployed large scale ML systems at @Apple as well as smaller systems with constraints at startups and want to share the common principles I've learned along the way.
2. I created @madewithml so that the community can explore, learn and build ML and I learned how to build it into an end-to-end product that's currently used by over 5K daily active users.
You can learn more at my personal website or LinkedIn.

LinkedIn: https://t.co/xWmPKz53vw
Personal website: https://t.co/NpLSczadPn
Why is this free?

1. Personal reason: Every day, people explore the amazing work on @madewithml to learn from and contribute themselves. To stay consistent with this free spirit, I'm releasing this free course to pass on the lessons I've learned from my mentors and experiences.
2. Societal reason: This is especially targeted for people who don't have as much opportunity around the 🌍. I firmly believe that creativity and intelligence are randomly distributed but opportunity is siloed. I want to enable more people to create and contribute to innovation.
What are the prerequisites?

- You should have some familiarity with Python and basic ML algorithms. While we will be experimenting with deep learning (w.r.t compute/performance tradeoffs), you can easily apply the lessons to any class of ML models.

https://t.co/V35zXocadQ
The course hasn't even begun yet but there's already quite a few friends to thank for helping me thinking through some of this. We'll be referring to their work throughout the course. @josh_tobin_ @jeremyjordan @eugeneyan @nlpguy_ @MLinProduction @FullStackML
First lesson releases next week (📦 Product) & subsequent lessons will follow a weekly cadence. Be sure to follow me or @madewithml for updates, discussions & feedback because I'll be creating the course content dynamically using the community's feedback.

https://t.co/cmTTeALWz1

More from Data science

elvis
elvis
@omarsar0
I have always emphasized on the importance of mathematics in machine learning.

Here is a compilation of resources (books, videos & papers) to get you going.

(Note: It's not an exhaustive list but I have carefully curated it based on my experience and observations)

📘 Mathematics for Machine Learning

by Marc Peter Deisenroth, A. Aldo Faisal, and Cheng Soon Ong

https://t.co/zSpp67kJSg

Note: this is probably the place you want to start. Start slowly and work on some examples. Pay close attention to the notation and get comfortable with it.


📘 Pattern Recognition and Machine Learning

by Christopher Bishop

Note: Prior to the book above, this is the book that I used to recommend to get familiar with math-related concepts used in machine learning. A very solid book in my view and it's heavily referenced in academia.


📘 The Elements of Statistical Learning

by Jerome H. Friedman, Robert Tibshirani, and Trevor Hastie

Mote: machine learning deals with data and in turn uncertainty which is what statistics teach. Get comfortable with topics like estimators, statistical significance,...


📘 Probability Theory: The Logic of Science

by E. T. Jaynes

Note: In machine learning, we are interested in building probabilistic models and thus you will come across concepts from probability theory like conditional probability and different probability distributions.
DATA SCIENCE
Research Engineering at the Turing
Research Engineering a...
@turinghut23
✨✨ BIG NEWS: We are hiring!! ✨✨
Amazing Research Software Engineer / Research Data Scientist positions within the @turinghut23 group at the @turinginst, at Standard (permanent) and Junior levels 🤩

👇 Here below a thread on who we are and what we

We are a highly diverse and interdisciplinary group of around 30 research software engineers and data scientists 😎💻 👉 https://t.co/KcSVMb89yx #RSEng

We value expertise across many domains - members of our group have backgrounds in psychology, mathematics, digital humanities, biology, astrophysics and many other areas 🧬📖🧪📈🗺️⚕️🪐
https://t.co/zjoQDGxKHq
/ @DavidBeavan @LivingwMachines

In our everyday job we turn cutting edge research into professionally usable software tools. Check out @evelgab's #LambdaDays 👩‍💻 presentation for some examples:

We create software packages to analyse data in a readable, reliable and reproducible fashion and contribute to the #opensource community, as @drsarahlgibson highlights in her contributions to @mybinderteam and @turingway: https://t.co/pRqXtFpYXq #ResearchSoftwareHour
DATA SCIENCE
Advertisement
John Myles White
John Myles White
@johnmyleswhite
This post is pretty bizarre, but it manages to hit on so many false beliefs that I've seen hurt junior data scientists that it deserves some explicit

(1) The notion that R is well-suited to "building web applications" seems totally out of left field. I don't feel like most R loyalists think this is a good idea, but it's worth calling out that no normal company will be glad you wrote your entire web app in R.

(2) It is true that Python had some issues historically with the 2-to-3 transition, but it's not such a big deal these days. On the flip side, I have found interesting R code that doesn't run in modern R interpreters because of changes in core operations (e.g. assignment syntax).

(3) "Most of the time we only need a latest, working interpreter with the latest packages to run the code" -- this is where things get real and reveal some things that hurt data scientists. If this sentence is true, it's likely because you don't share code with coworkers.

(3) Really is a broader issue in data science: people only think of what they need to do their work if no one else existed and code was never maintained. Junior data scientists almost always operate on projects they start from scratch and don't have to maintain for long.
DATA SCIENCE
Greg Yang
Greg Yang
@TheGregYang
1/ A ∞-wide NN of *any architecture* is a Gaussian process (GP) at init. The NN in fact evolves linearly in function space under SGD, so is a GP at *any time* during training. https://t.co/v1b6kndqCk With Tensor Programs, we can calculate this time-evolving GP w/o trainin any NN


2/ In this gif, narrow relu networks have high probability of initializing near the 0 function (because of relu) and getting stuck. This causes the function distribution to become multi-modal over time. However, for wide relu networks this is not an issue.

3/ This time-evolving GP depends on two kernels: the kernel describing the GP at init, and the kernel describing the linear evolution of this GP. The former is the NNGP kernel, and the latter is the Neural Tangent Kernel (NTK).

4/ Once we have these two kernels, we can derive the GP mean and covariance at any time t via straightforward linear algebra.


5/ So it remains to calculate the NNGP kernel and NT kernel for any given architecture. The first is described in https://t.co/cFWfNC5ALC and in this thread
DATA SCIENCE
Ryan J. Gallagher
Ryan J. Gallagher
@ryanjgallag
Tired of word clouds? Want to do better sentiment analysis? Not sure how to look at the words underneath your measures?

Our long overdue paper on generalized word shift graphs is finally here!
https://t.co/lIBXvbMJWX
https://t.co/vSL1REYT8V

So what are they?

1/n


If we have two texts, there are many ways we can compare them. Weighted averages are a particularly useful measure because they're flexible and interpretable

Proportions, Shannon entropy, the KLD, the JSD, and dictionary methods can all be written as weighted averages

2/n

But weighted avgs are also slippery. When we try to compress complex phenomena like happiness, surprise, divergence, or diversity into a single number, it can be unclear what we're measuring

If the measure goes up, what does that mean? Why did it do that? Can we trust it?

3/n

Very often, that's the end of the line and we're left with an uneasy feeling in the pit of our stomach that our weighted avg is actually picking up a data artifact or some other unintended peculiarity

Word shift graphs help us address those concerns

4/n

First, word shifts look under the hood of weighted averages to see what's going on

All weighted averages are a sum of contributions from individual words. We can pull out those words, and rank which ones contribute the most to the difference between two texts

5/n
DATA SCIENCE

You May Also Like

Jaya_Upadhyaya
Jaya_Upadhyaya
@Jayalko1
SRISAILAM: KASHI OF THE SOUTH (AP)
#andhratemples

The divine abode of Mallikarjuna Swamy (Jyotirlinga) and Devi Brahmaramba (Shaktipeeth).

When Ganesha was married before Kartikeya, he left in anger to Kraunch mountain. Shiva and Parvati also followed him there.


Shiva assumed the form of Jyotirlinga and resided on the mountain by the name of Mallikarjuna. Mallika means Parvati while Arjuna is another name of Shiva
It is also said that once, a princess Chandravathi, saw a cow shedding milk on a rock resembling a shivlingam.
@DubeyYash1911


She started praying to the lingam daily and used to offer jasmine (mallika pushpam) daily. Pleased Shiva appeared before her and agreed to wear jasmine garland (mallika pushpmala) on his head permanently. Since then, Shiva became known as Mallikarjun Swamy.


At this place, Shakti took the form of Bhramaram (bee) to kill Arunasur and settled as Bhramaramba Devi. The place is a Shakti Peeth as the neck portion of Devi Sati fell here.

It is said that by merely seeing the hill, one is emancipated from all his sins and worries.
ALL
EverythingOppresses
EverythingOppresses
@SoOppressed
The first area to focus on is diversity. This has become a dogma in the tech world, and despite the fact that tech is one of the most meritocratic industries in the world, there are constant efforts to promote diversity at the expense of fairness, merit and competency. Examples:

USC's Interactive Media & Games Division cancels all-star panel that included top-tier game developers who were invited to share their experiences with students. Why? Because there were no women on the

ElectronConf is a conf which chooses presenters based on blind auditions; the identity, gender, and race of the speaker is not known to the selection team. The results of that merit-based approach was an all-male panel. So they cancelled the conference.

Apple's head of diversity (a black woman) got in trouble for promoting a vision of diversity that is at odds with contemporary progressive dogma. (She left the company shortly after this

Also in the name of diversity, there is unabashed discrimination against men (especially white men) in tech, in both hiring policies and in other arenas. One such example is this, a developer workshop that specifically excluded men: https://t.co/N0SkH4hR35
TECH
Advertisement
Antonio Garc\xeda Mart\xednez
Antonio García Martíne...
@antoniogm
Ok, I'll hop on this Elizabeth Warren/Native American testing bandwagon (gently and non-politically).

I've been a @23andMe customer for a while, and have followed their ancestry updates closely.

All is more or less as expected....except for this bit about Native American.


The family is almost completely composed of Spanish peasants (from various regions) who emigrated, along with a massive wave in the late 19th-cent./early 20th-cent., to Cuba back when it was a booming economy (richer than Spain's) and worth emigrating to (Communism killed that).

Also, the native population of Cuba was annihilated early on---was the first place the Spanish colonized after all. Having a native background in Cuba would be like having the same in, say, Massachusetts, particularly if you're (say) mostly Irish. Just really, really unlikely.

(Note: the North African/Arab background is less mysterious. The Iberian peninsula was part of the Muslim world for centuries. It would be odd *not* to have some Arab/Middle Eastern background coming from Spain. Given the family is mostly from Northern Spain, it's small though.)

I have a Spanish passport, have been back to the ancestral villages in Spain, seen the church where my grandmother was baptized, my grandfather told me stories about growing up as the child of Spanish colonists in rural Cuba. The native bit just clashes with all the family lore.
ALL
Dr Amanda Moehring
Dr Amanda Moehring
@FlyBehaviour
In Academia, people aren’t always supported when they need it. I want to share what @WesternU did when my husband died right after the pandemic shutdown. It should be shared with other uni’s as a model for empathy and proactive care when someone is in crisis.
1/
#AcademicChatter
SCIENCE
Anu Satheesh \U0001f1ee\U0001f1f3
Anu Satheesh 🇮🇳...
@AnuSatheesh5
Thiruvizha Mahadeva Kshetram
#Alappuzha 
#Keralatemples 🚩

Thiruvizha Mahadeva Kshetram is located in Cherthala and it is believed that Prathishta of temple was done by Vilwamangalam Swamy. Paramashiva is Swayambhu here and is worshipped as Kalakandha which means who swallowed


Halahala visham to save the world during Samudra mathanam. 

It is a famous temple where people seek the blessings, for curing the Kaivisham. The poison given by someone to destroy a person is made to vomit here. This is removed by making them vomit the poison by a special


medicine.
The medicine for vomiting is made from a plant near temple by Palodathu family. The milk offered to Bhagwan is mixed with the extracts of the plant.

Story says that once this place was a dense forest, and a woman was looking for the presence of a tortoise in the pond


and the tip of her stick hit the bottom and it started bleeding in the pond. 
Frightened, the lady informed every one and after searching in pond people found Swayambhu Lingam inside the pond. Thus Prathishta was done here.

Om Namah Shivaye
Shambo Mahadeva
🙏🕉🙏
ALL