BC DATA SCIENCE

Saved by @Jacobtldr

Sophie Hill
@sophie_e_hill 5 years, 6 months ago 1710 views

Save to PDF Share See On Twitter

This is a more wonky thread about how I made this visualization in #Rstats using the awesome visNetwork

First step is to create the underlying network data. We need one file of "nodes" - i.e. the people and organizations. And one file of "edges" - i.e. the connections between them.

I created these by hand, based on excellent investigate journalism:

Now we can pull these together to create a network visualization!

You'll notice that I included a column for "type" in the nodes file. This allows me to use different icons for people vs firms vs political organizations.

All the icons are taken from @fontawesome. I *think* the visNetwork 📦 currently only works with fontawesome version 4.7, which is a bit limited – e.g. I decided to use a book icon to represent the fringe Evangelical Christian sect "Exclusive Brethren"! 😂

I very much enjoyed getting to use the "incognito" icon to represent all the unknown donors that have funded Tory MP Owen Paterson's overseas jaunts!

The icons are also scaled by how many "edges" connect to each "node".

Unsurprisingly, this means that the UK government and the Conservative party emerge as the most connected nodes in this network!

The great thing about visNetwork 📦 is that it's SO easy to make this visualization interactive with #RShiny.

You can add pop-up boxes ("tool-tips") that show more information when the user hovers over a node or edge – perfect for linking to the original reporting that I used.

Check out the full code and data on github! https://t.co/rWuCxbCnW3

More from Data science

Research Engineering a...
@turinghut23

✨✨ BIG NEWS: We are hiring!! ✨✨
Amazing Research Software Engineer / Research Data Scientist positions within the @turinghut23 group at the @turinginst, at Standard (permanent) and Junior levels 🤩

👇 Here below a thread on who we are and what we

We are a highly diverse and interdisciplinary group of around 30 research software engineers and data scientists 😎💻 👉 https://t.co/KcSVMb89yx #RSEng

We value expertise across many domains - members of our group have backgrounds in psychology, mathematics, digital humanities, biology, astrophysics and many other areas 🧬📖🧪📈🗺️⚕️🪐
https://t.co/zjoQDGxKHq
/ @DavidBeavan @LivingwMachines

In our everyday job we turn cutting edge research into professionally usable software tools. Check out @evelgab's #LambdaDays 👩‍💻 presentation for some examples:

We create software packages to analyse data in a readable, reliable and reproducible fashion and contribute to the #opensource community, as @drsarahlgibson highlights in her contributions to @mybinderteam and @turingway: https://t.co/pRqXtFpYXq #ResearchSoftwareHour

Maria Khalusova
@mariaKhalusova

To my JVM friends looking to explore Machine Learning techniques - you don’t necessarily have to learn Python to do that. There are libraries you can use from the comfort of your JVM environment. 🧵👇

https://t.co/EwwOzgfDca : Deep Learning framework in Java that supports the whole cycle: from data loading and preprocessing to building and tuning a variety deep learning networks.

https://t.co/J4qMzPAZ6u Framework for defining machine learning models, including feature generation and transformations, as directed acyclic graphs (DAGs).

https://t.co/9IgKkSxPCq a machine learning library in Java that provides multi-class classification, regression, clustering, anomaly detection and multi-label classification.

https://t.co/EAqn2YngIE : TensorFlow Java API (experimental)

Advertisement

Jeremy Howard
@jeremyphoward

An amazing new project from @bearpelican was just released: https://t.co/DBov6sZTVS . A beautiful design; you can auto-generate a melody from chords, chords from a melody, and more.

It's technically brilliant, combining BERT, seq2seq, and Transformer XL
https://t.co/jF3mO5aXiu

It's also a wonderful example of leveraging and customizing the fastai framework in a deep & thoughtful way.

Here's the full set of blog posts diving in to this

Simon DeDeo
@SimonDeDeo

On Bayesianism, the Many Worlds Interpretation, and personal identity.

Some thoughts worked out in a letter to a friend, which is the kind of thing you do when off Twitter for a glorious week. (🧵)

“Chance is ignorance”—the Bayesian story; all probabilities represent states of mind, not states of the world. One *could* put (some) chances “in the world”, but let’s take Occam’s Razor seriously...

That the probability of a fair coin coming up heads is 50% simply means that marginalizing (tracing, as the physicists say) over the hidden facts leaves you, nearly, maximally ignorant of the outcome.

Quantum uncertainty (access below!) poses an apparent challenge to this story. There seems to be nothing to be ignorant about when it comes to (say) electron spin—there is nothing “inside” the

The electron is a simple object, in other words. So where does the uncertainty come from? One could follow David Wallace’s wonderful interpretation in terms of chaotic dynamics and decoherence, but let’s see if we can take another route...

Ryan J. Gallagher
@ryanjgallag

Tired of word clouds? Want to do better sentiment analysis? Not sure how to look at the words underneath your measures?

Our long overdue paper on generalized word shift graphs is finally here!
https://t.co/lIBXvbMJWX
https://t.co/vSL1REYT8V

So what are they?

1/n

If we have two texts, there are many ways we can compare them. Weighted averages are a particularly useful measure because they're flexible and interpretable

Proportions, Shannon entropy, the KLD, the JSD, and dictionary methods can all be written as weighted averages

2/n

But weighted avgs are also slippery. When we try to compress complex phenomena like happiness, surprise, divergence, or diversity into a single number, it can be unclear what we're measuring

If the measure goes up, what does that mean? Why did it do that? Can we trust it?

3/n

Very often, that's the end of the line and we're left with an uneasy feeling in the pit of our stomach that our weighted avg is actually picking up a data artifact or some other unintended peculiarity

Word shift graphs help us address those concerns

4/n

First, word shifts look under the hood of weighted averages to see what's going on

All weighted averages are a sum of contributions from individual words. We can pull out those words, and rank which ones contribute the most to the difference between two texts

5/n

You May Also Like

Vibhor Varshney
@nakulvibhor

On the occasion of youtube 20k and Twitter 70k members

A small tribute/gift to members

Screeners

technical screeners - intraday and positional both

before proceeding - i have helped you , can i ask you so that it can help someone else too

thank you

positional one

run - find #stock - draw chart - find levels

1- Stocks closing daily 2% up from 5 days
https://t.co/gTZrYY3Nht

2- Weekly breakout
https://t.co/1f4ahEolYB

3- Breakouts in short term
https://t.co/BI4h0CdgO2

4- Bullish from last 5

intraday screeners

5- 15 minute Stock Breakouts
https://t.co/9eAo82iuNv

6- Intraday Buying seen in the past 15 minutes
https://t.co/XqAJKhLB5G

7- Stocks trading near day's high on 5 min chart with volume BO intraday
https://t.co/flHmm6QXmo

Thank you

SK
@sk_diary1

Kolaru Pathigam-Thevaram hymn composed by ThiruGnana Sambandar- #Thread

In Tamil Kol means planets,Aru means cut- set of songs in Kolaru Pathigam addresses all Navagrahas& last 2 lines of every song with end a plea to Bhagwan Shiva to reduce/erase the ill effects of Navagrahas

கோளறு பதிகம் - This pathigam was sung by Thirugnana Sambandar at Thirumaraikadu Kshetram -Vedaranyam,Tamilnadu

Thirugnana Sambandar & Appar(Thirunavukkarasar) travelled together to various Shiva Alayam to spread shivam & bhakti among people.They both reached Thirumaraikadu.

Thirumaraikadu(Vedaranyam) -
Appar & Sambandar were asked to enter the temple through side entrance.The main door was locked by Vedas many years ago.Appar&Sambandar sang devotional hymns praising Shiva, after which the gates opened & closed.After which main door opened for all.

After darshan of Bhagwan Shiva at Thirumaraikkadu,Sambandar received a message to travel to Madurai.
During that time, Samanam was on the rise in the Pandya Kingdom.The Pandya King converted to Samanam.The Queen Mangaiyarkkarasi was a staunch Shiva devotee and was upset.

Kularchirai Nayanar ,Chief Minister of Pandya kingdom was in agony by the turn of events.Queen requested Kulachirai Nayanar to escort Thiru gnana Sambandar to Madurai.Kularchirai Nayanar met Thiru gnana Sambandar at Thirumaraikkadu & requested him to visit Madurai.

Advertisement

Lakshminarayan G
@narayanagl

The Chanting of following names of Bhagwan Vishnu, immensely helps us in overcoming the obstacles in our daily life.
These names are from Sri Vishnu Sahasranama!
|. "Om Vashatkaaraaya Namaha" : For Success in Business.
||. "Om Aksharaaya Namaha" : For Success in Studies.

|||. "Om Bhuthabhavanaya Namaha" : For Good Health.
|V. "Om Paramaathmane Namaha" : For Self Confidence.

Src: VAK magazine from Chilkur Balaji Temple, Hyderabad - Sri @csranga
#SanatanaDharma #SanatanaSanskriti #Sattology

One needs to chant the following slokas 28 times to get rid of certain problems in life.
Om Hrushikesaya Namah - For Overcoming Bad habits
Om Vashatkaaraya Namah - For Success in Business, Interviews, visa interviews, building relationships

Om Srimate Namah - For Handsome appearance & wealth
Om Aksharaya Namah - For Education & better financial strength
Om Paramatmane Namah - For self employed people, for promotions and success in games.
Om Putatmane Namah - To remove mental stress & for mental peace

Om Sarmane Namah - For Job Satisfaction
Om Bhutadaye Namah -To amend soured friendship or any personal relationship
Om Dhatre Namah - For issueless couple
Om vidhatre Namah - Pregnant Ladies to Chant for healthy babies.
Chant the following 108 times :

Will Buxton
@wbuxtonofficial

The Haas / Force India argument is fascinating, and the decision of the stewards may still have consequences. The first key finding is that the stewards ruled Racing Point Force India to be a valid constructor. That means that it builds its own cars.

Haas had argued that the cars had been designed by Force India, but as Haas knows only too well, "outsourcing" is legal. The stewards decided that "there is no regulatory support for the argument that Outsourcing of Listed Parts cannot come from a former or excluded team."

In determining this, the stewards also came to the following conclusion: "In relation to the submission by the Racing Point Force India F1 Team that it is not a new team, the Stewards decide that the Racing Point Force India F1 Team is indeed a new team."

This will have a big knock on effect for Haas in its continued arguments over the rights of RPFI as relates to its eligibility and rights under the complex payments structure. Haas has argued all along that RPFI should be treated as a new team and tread the same path that it did.

TLDR? Haas lost the fight but may have won the war. In having its argument that Racing Point hadn't designed their own car thrown out, they gained clarification that RPFI was a new team.

Anu Satheesh
@AnuSatheesh5

Sri Mridanga Saileswari Temple Muzhakkunnu, Kannur KERALA

The temple is established by Parasurama and it is one among 108 Durga temples.
Devi will answer all the prayers of her devotees who pray to her with utmost devotion lighting the ghee deepam.

It is the family diety of Kerala Varma Pazhassi Raja.
Devi is present in three forms Kali, Saraswati and Lakshmi.

Legend...👇
Once a Mridungam ( musical instrument) shaped rock fell from heaven here.
@SriramKannan77

Devi originated in the form of Mridangam and Parasurama captivated the essence of Devi into a Vigraham. Vigraham is made of Panchaloham.
Kathakali, an art form of Kerala originated here.

Temple Vigraham was stolen 3-4 times, but because of power of Devi all the attempts were failure. Police records says that Whenever the thieves try to steal, they lose their senses, and they will be in a confused state. So they will abandon the idol.
🕉