BC MACHINE LEARNING

Saved by @CodyyyGardner

Santiago
@svpino 5 years, 5 months ago 1174 views

Save to PDF Share See On Twitter

For a long time, I didn't understand how to use Virtual Environments in Python 🐍.

If this is just, let's end it here and now: 🧵👇

[2] Virtual Environments let you deal with the dependencies that your code has with external Python libraries.

It avoids having conflicts when your projects depend on different versions of the same library.

👇

[3] Let's imagine that you are building your first Python project and you install the "requests" library:

pip install requests

You get version 2.24.0 installed in your system.

👇

[4] A month later, you decide to work on your second project. It also needs the "requests" library.

But the latest version is not 2.24.0 anymore.

Now version 3 is available, and that's the one you want to use!

👇

[5] You could upgrade your entire system to version 3, but then you'll be potentially breaking the first project you built that depends on 2.24.0!

Can you imagine this happening on a server with many more applications running?

👇

[6] Virtual environments solve this problem.

The first step for every new project is to create a virtual environment for it.

Some people have a central location where they store all environments. I prefer to keep them inside the project folder.

👇

[7] You can create a new virtual environment with Python 3 using the following command:

python3 -m venv .myvenv

Then, you can use "source" to activate the environment.

At this point, you'll have full isolation for your project.

👇

[8] If you install any libraries within a virtual environment, they will never mess with the libraries installed at the system level or other virtual environments.

And this is great!

Here is a @realpython's article covering virtual environments: https://t.co/lgXqJDUlKw

[9] The built-in "venv" module is not the only way to create virtual environments. Here are other options:

- conda
- pipenv
- virtualenv

What's your choice?

More from Santiago

Santiago
@svpino

Machine learning education is broken.

If you are preparing for a research position, you are good. If you are looking to get out there and start solving problems, not even close.

Here are some thoughts so you can get ahead.

↓

Most classes, courses, and books cover the same road.

They start with a dataset. They finish with a working model. The focus is always on everything that happens in between.

Dataset → Model.

This is great, but not enough.

Real-life situations rarely start with a dataset, and they never end after you finish building your model.

Applying machine learning successfully is hard.

Here are a few examples that you should keep in mind.

First challenge: Properly framing up the problem.

If you don't understand the problem, you can't determine what data you need. If you don't understand the data, you can't build a good model.

I've never seen a company that had their data ready to go.

In fact, most of them don't even have data at all and need you to determine what exactly they should start collecting.

You usually have to go Problem → Potential Solution → Data.

Santiago
@svpino

What's machine learning?

Not a framework. Not a different language. Not the latest "cool" thing around the Internet.

Thread: Let me convince you that machine learning is the best thing since sliced bread 🍞.

Let's start with a simple exercise:

"Write a function that returns 0 if a supplied number is even or 1 if the number is odd."

If you are a developer, I'm sure you know how to write this function. It should be simple, right?

To avoid using a specific syntax, let's represent this function as follows:

y = f(X)

Where:
• X → The input number
• y → The result (0 if even, 1 otherwise)
• f → The function that does the work

We can now get to the interesting part.

If you are a programmer, writing this function is simple.

You know the relationship between X (the input number) and y (the output), so you can easily write the rules (the function.)

In machine learning, we don't write the rules. We learn them.

Imagine we had an algorithm that processes many samples (X → y), learns the relationship between them, and comes up with the correct rules.

We call these samples "training data," and they would like like this:

• 2 → 0
• 5 → 1
• 8 → 0
• 4 → 0
• 3 → 1
• ...

Advertisement

Santiago
@svpino

I'll blow your mind with a technique you aren't using yet.

Sometimes, you want your system to do exactly the opposite of what your machine learning model thinks you should do.

Let me convince you. ↓

I'm going to start with a nice problem:

Imagine a model that looks at a picture of an electrical transformer and predicts whether it's about to break or not.

Don't worry about how the model does this. We are going to focus on the results instead.

There are 4 possible results for this model:

1. It predicts a bad unit as bad.
2. It predicts a bad unit as good.
3. It predicts a good unit as bad.
4. It predicts a good unit as good.

#2 and #3 are the mistakes the model makes.

Assuming we run 100 units through the model, we can organize the results in a matrix:

• The rows represent the "actual" condition of the transformer.

• The columns represent the "prediction" of the model.

We call this a "Confusion Matrix."

This is how we can read this confusion matrix:

• 60 bad units were predicted as bad.
• 3 bad units were predicted as good.
• 7 good units were predicted as bad.
• 30 good units were predicted as good.

Santiago
@svpino

Some of my machine learning books.

Hands-On Machine Learning from @aureliengeron and Deep Learning with Python from @fchollet.

Santiago
@svpino

The two main machine learning techniques used in the industry today:

1. Gradient Boosted Trees
2. Deep Learning

Focus your time learning Scikit-Learn, XGBoost, and a Deep Learning library like Keras or PyTorch and you'll get the most for your time.

If you need to deal with structured data: Scikit-Learn + XGBoost.

If you need to deal with unstructured data (perceptual tasks): Keras or PyTorch.

Of course, there are many more techniques that will be helpful, but if you focus on these you'll be maximizing your ability to deliver value in the short term.

More from Machine learning

Pratham Prasoon
@PrasoonPratham

Are you planning to learn Python for machine learning this year?

Here's everything you need to get started.
🧵👇

In this thread, we'll look at all the concepts in Python you need to know for machine learning along with free resources to help you out.

All of this is based on my experience of successfully teaching 300+ students how to code using Python.

(2 / 19

You can use many languages for machine learning, why Python?

Because of 2 reasons:
- Comparatively easier to learn than other languages
- Has the biggest and most mature community

This makes Python a no-brainer to learn for machine learning as a beginner.

(3 / 19)

These are the absolute basics which you must know about:

- Basic terminal commands
- Basic arithmetic (+,-,/,*)
- Accepting user input
- For & While loops
- Exception handling
- If-Else statements
- Functions, modules & Imports

(4 / 19)

Then comes the more tougher concepts which you must know about:

- Object oriented programming in Python:Classes, Objects, Methods
- PIP (Pypi)
- List slicing
- String formatting
- Dictionaries & Tuples
- Managing environments
- Dunder methods like __init__

(5 / 19)

Mads Brodt
@madsbrodt

I've applied for a total of 10 development jobs in my life:

- 7 lead to interviews
- Of those 7, 4 was a good fit for me
- Of those 4, 3 offered me the job
- In all 3 cases, I negotiated a better deal

🧵 on what worked for me and what YOU can do to get similar results 👇

1. Apply for the RIGHT jobs. Look for midsize to large companies, not necessarily tech related. These tend to get way fewer applications than traditional tech companies, so it's easier to get your foot in the door - and they also tend to be great environments for learning.

2. Spend time on your application. Make sure your resumé and written application is tailored to the exact position. Recruiters or hiring managers can smell a copy/pasted resumé from miles away. Use as many words from the job spec in your application as possible.

3. Have a portfolio. Show off your skills and some personality on your website. This is a nobrainer for front-end devs, but it's true for other areas too. It's a great way to stand out over other candidates by actually *showing* the value you can create and your experience.

4. Establish personal contact. Send a quick message or make a phone call before applying. Just introduce yourself to the person in charge of hiring and ask a simple question. It's the best way I find to make them remember your application when you submit it.

Advertisement

Pratham Prasoon
@PrasoonPratham

Are you planning to learn to Python for machine learning this year?

Here's everything you need to get started.
🧵👇

In this thread we'll look at all the concepts in Python you need to know for machine learning along with free resources to help you out.

All of this is based on my experience of successfully teaching 300+ students how to code using Python.

(2 / 19

You can use many languages for machine learning, why Python?

Because of 2 reasons:
- Comparatively easier to learn than other languages
- Has the biggest and most mature community

This makes Python a no-brainer to learn for machine learning as a beginner.

(3 / 19)

These are the absolute basics which you must know about:

- Basic terminal commands
- Basic arithmetic (+,-,/,*)
- Accepting user input
- For & While loops
- Exception handling
- If-Else statements
- Functions, modules & Imports

(4 / 19)

Then comes the more tougher concepts which you must know about:

- Object oriented programming in Python:Classes, Objects, Methods
- PIP (Pypi)
- List slicing
- String formatting
- Dictionaries & Tuples
- Managing environments
- Dunder methods like __init__

(5 / 19)

Santiago
@svpino

An introduction to one of the the most basic structures used in machine learning: a tensor.

🧵👇

Tensors are the data structure used by machine learning systems, and getting to know them is an essential skill you should build early on.

A tensor is a container for numerical data. It is the way we store the information that we'll use within our system.

(2 / 16)

Three primary attributes define a tensor:

▫️ Its rank
▫️ Its shape
▫️ Its data type

(3 / 16)

The rank of a tensor refers to the tensor's number of axes.

Examples:

▫️ The rank of a matrix is 2 because it has two axes.
▫️ The rank of a vector is 1 because it has a single axis.

(4 / 16)

The shape of a tensor describes the number of dimensions along each axis.

Example:

▫️ A square matrix may have (3, 3) dimensions.
▫️ A tensor of rank 3 may have (2, 5, 7) dimensions.

(5 / 16)

$Pratham Prasoon \U0001f680$

Pratham Prasoon 🚀...
@PrasoonPratham

Here's how I got started with my first machine learning project and you can too.
Let's take a look.

(This thread will take from zero to being a hero in machine learning, trust me)

(1 / 22)
🧵👇

Getting started with your first machine learning project might actually much easier than it seems, if I can do it, certainly anyone can.

I did not use:
- Any Math
- An expensive computer
- Complex programming concepts

(2 / 22)

Here's what I did use:

- A free GPU on Google Colab
- Python
- TensorFlow
- Numpy
- Pandas
- Kaggle
- Scikit-Learn
- Google
- StackOverFlow

(3 / 22)

This project was actually a Kaggle challenge based on the MNIST dataset which is a collection images of 70,000 hand written digits.

You can find the dataset here👇
🔗//kaggle.com/c/digit-recognizer

(4 / 22)

Before we go over the code of this project, it is highly reccomended that you complete this free course on YouTube👇

Machine Learning foundations course
🔗//youtu.be/_Z9TRANg4c0

Code👇
🔗//colab.research.google.com/github/PrasoonPratham/Kaggle/blob/main/MNIST.ipynb

(5 / 22)

You May Also Like

History Under Your Fee...
@HUFToday

#TodayInHistory Ram Prasad Bismil,Ashfaqullah Khan and Roshan Singh are hanged in 1927, as they give up their life for the cause of freedom and inspire many a revolutionary. #LestWeForget

Shahjahanpur was a hub of revolution during the freedom struggle. Most of the revolutioaries in the North, were from this town. And among them, the most famous were two friends, whom destiny would bring together- Ram Prasad Bismil and Ashfaqullah Khan.

Ashfaqullah Khan was born at the turn of the 20th century on October 22, while Bismil was born 3 years earlier on June 11, in the same town. Both of them were excellent writers in Urdu and Hindi.

Both of them would come together under the Hindustan Republican Association, not to mention the fact that Ashfaq was an admirer of Bismil’s poetry, and became close friends with him on that account.

And both these men were hanged on the same date, December 19, 1927 for their involvement in the Kakori event. Two men from different religions, different backgrounds, yet destiny would bring them together.

Anshul Pandey
@Anshulspiritual

SHAKTA DHARMA AND THEIR ACHARYAS

Śhākta or Shakti or Devi pooja is not a new upasana. It is being carried out right from the time of Vedic period. Puran's tell us that Rishi Vashishth would worship Tara devi. Parshuram ji worshipped Tripura devi,

Agastya learned the secrets of Shri Vidya from Vishnu ji in Hayagriva avtaar. Bhagwan Ram, Laxman and Krishna too learned the tantrik vidya. Even Rig Ved 7.103.5 Sayan Bhasya also mentions about Śhākta/शाक्त(शाक्तस्येव शक्तिमतः).

Then we find that in the Harrappan excavations many figurines depicting Shakti were found. So in that age too, which was supposedly an urban city shakti was being worshipped. So naturally this tradition would be prevalent in rural areas too.

It is wrong to say that shakti puja originated from Bengal although it was popular there. Matsyendranath received this vidya from Maheshwari herself in Kamrup. We know that Shakti pooja is practised all over India.

Not much is known about the Śhākta saints in other parts of India in the middle ages.

Adi Shankaracharya wrote Pramanech saar named book on tantra and Anand lahri book on Devi strotras. Then there were Acharya Shankar, Bhaskar Rai, Laxman, Deshikendra, Raghav Bhatt, Krishnand,

Advertisement

Zach Weinersmith
@ZachWeiner

Hey, for people interested in this stuff, here's a thread about a change we made to running our facebook account:

So, about 5 years ago, we got on facebook. Why? Well, facebook has a big audience and they like to consume on facebook. So, we started posting comics there, even though we got paid nothing and facebook made money off the free content.

Why? Because back then, once in a while, you would say "also hey, I sell books" or "hey, I'm going to be signing at this event" and your facebook followers would actually see it.

Effectively, the implicit old arrangement was "facebook lets me reach readers efficiently, and I supply facebook with free content they run ads on."

Over time, like a bad business partner, facebook basically made it impossible to reach your audience without *paying them*. Thus, you supply them free content on which they run ads, and you get nothing in exchange.

itrade(DJ)
@ITRADE191

Here is the detailed information of about strategy,

Entry time : 9.30 - 10
Exit : Upto you

Strategy :
Sell weekly ATM CE & PE at almost equal price
For ex : Sell Nifty 17250 CE at 50 and Nifty 17250 PE at 48 so it will become short straddle

Buy monthly ATM or near ATM CE & PE at matching price (5-10 points diff should be fine) as hedge
For ex : Buy Nifty 17250 CE at 150 and Nifty 17300 PE at 155 so it will become long straddle.

Weekly Short straddle + Monthly Long straddle

Adjustment:

• If you feel slightly bullish/bearish then no adjustment needed
• If Nifty moves 50 up or down and sustain then just simply roll up or down half of qnty and keep rest of the quantity. If market goes up or down further then roll up or down rest.

• If Nifty moves one side or about to breach BEP then add equal amount of lot. This can balance tested side. For ex: If I bought 17300 CE 4 lot as hedge then add 4 lot so you will have only one side risk . Note: Remember to keep SL at cost price (only for additional lot bought)

Capital requirement:
2.2 L for 4 lot
Adjustment requires additional capital upto 1L

Note : High risk high reward strategy, please don’t execute until you fully understand. Kindly do paper trading or backtest.
RR : 1:1
POP : 45-55%

asif
@aj_raja

THE LAST PRINCESS OF LAHORE - BAMBA DULEEP SINGH (1869 - 1957)

Thread

Post partition, every morning a weak old woman would board the Model Town bus service headed to the city. The conductor never asked her for money or he would invite anger of the last Queen of Punjab.

1/n

Princess Bamba Sutherland, the eldest daughter of Maharaja Duleep Singh and grand-daughter of Maharaja Ranjit Singh, was born on Sep 29, 1869, in London.

Duleep Singh, the last Maharaja of Punjab was taken away to England by British after annexing Punjab.

2/n

Since he was still a child he was forcibly converted to Christianity and made to adopt British values in order to prevent him from ever thinking about regaining Punjab.

He was also kept away from his mother Maharani Jindan.
When he finally met his mother years later...

3/n

...he was told about his lost kingdom and religion after which he decided to reclaim it from British treachery.
During his struggle he married and had six children, 3 sons & 3 daughters from the 1st marriage.

Bamba was the most colorful character among 6 and was a rebel...
4/n

...like her father and daring like her Grandfather Ranjit Singh. She married Col Sutherland who later became principal of King Edward Medical College.

When she got permission to bring her grandmother Maharani Jindan's ashes to Lahore in 1924, she saw a huge crowd gathered...
5/n