If You Feel Stuck, Read This:
(everyday)

https://t.co/oMallKjC4n
https://t.co/QtRdTfVefU
https://t.co/IPoM2kpd31
https://t.co/OXZLXPWHdC
https://t.co/2146okskrp
https://t.co/lquPr3fdJ8
Unwanted thoughts cause plenty:
- distress
- frustrations

Work on your mental models:
• control the mind
• focus on what matters
• understand how the world works

Bonus: Get Top 50 Books For Free

Grab your copy here:
https://t.co/pHZMwiPiaA
If you enjoyed this thread, please:

1. Follow me (@Phi_of_Mind) for more

2. Retweet the 1st tweet below to share this thread https://t.co/cXABvE1SBX

More from Philosophy of Mind

More from All

How can we use language supervision to learn better visual representations for robotics?

Introducing Voltron: Language-Driven Representation Learning for Robotics!

Paper: https://t.co/gIsRPtSjKz
Models: https://t.co/NOB3cpATYG
Evaluation: https://t.co/aOzQu95J8z

🧵👇(1 / 12)


Videos of humans performing everyday tasks (Something-Something-v2, Ego4D) offer a rich and diverse resource for learning representations for robotic manipulation.

Yet, an underused part of these datasets are the rich, natural language annotations accompanying each video. (2/12)

The Voltron framework offers a simple way to use language supervision to shape representation learning, building off of prior work in representations for robotics like MVP (
https://t.co/Pb0mk9hb4i) and R3M (https://t.co/o2Fkc3fP0e).

The secret is *balance* (3/12)

Starting with a masked autoencoder over frames from these video clips, make a choice:

1) Condition on language and improve our ability to reconstruct the scene.

2) Generate language given the visual representation and improve our ability to describe what's happening. (4/12)

By trading off *conditioning* and *generation* we show that we can learn 1) better representations than prior methods, and 2) explicitly shape the balance of low and high-level features captured.

Why is the ability to shape this balance important? (5/12)

You May Also Like