This is what he was talking about.
Did somebody say \u201cLet\u2019s Go Brandon?\u201c pic.twitter.com/NrFN2HZ3R5
— MeidasTouch.com (@MeidasTouch) December 24, 2021
More from All
How can we use language supervision to learn better visual representations for robotics?
Introducing Voltron: Language-Driven Representation Learning for Robotics!
Paper: https://t.co/gIsRPtSjKz
Models: https://t.co/NOB3cpATYG
Evaluation: https://t.co/aOzQu95J8z
🧵👇(1 / 12)
Videos of humans performing everyday tasks (Something-Something-v2, Ego4D) offer a rich and diverse resource for learning representations for robotic manipulation.
Yet, an underused part of these datasets are the rich, natural language annotations accompanying each video. (2/12)
The Voltron framework offers a simple way to use language supervision to shape representation learning, building off of prior work in representations for robotics like MVP (https://t.co/Pb0mk9hb4i) and R3M (https://t.co/o2Fkc3fP0e).
The secret is *balance* (3/12)
Starting with a masked autoencoder over frames from these video clips, make a choice:
1) Condition on language and improve our ability to reconstruct the scene.
2) Generate language given the visual representation and improve our ability to describe what's happening. (4/12)
By trading off *conditioning* and *generation* we show that we can learn 1) better representations than prior methods, and 2) explicitly shape the balance of low and high-level features captured.
Why is the ability to shape this balance important? (5/12)
Introducing Voltron: Language-Driven Representation Learning for Robotics!
Paper: https://t.co/gIsRPtSjKz
Models: https://t.co/NOB3cpATYG
Evaluation: https://t.co/aOzQu95J8z
🧵👇(1 / 12)
Videos of humans performing everyday tasks (Something-Something-v2, Ego4D) offer a rich and diverse resource for learning representations for robotic manipulation.
Yet, an underused part of these datasets are the rich, natural language annotations accompanying each video. (2/12)
The Voltron framework offers a simple way to use language supervision to shape representation learning, building off of prior work in representations for robotics like MVP (https://t.co/Pb0mk9hb4i) and R3M (https://t.co/o2Fkc3fP0e).
The secret is *balance* (3/12)
Starting with a masked autoencoder over frames from these video clips, make a choice:
1) Condition on language and improve our ability to reconstruct the scene.
2) Generate language given the visual representation and improve our ability to describe what's happening. (4/12)
By trading off *conditioning* and *generation* we show that we can learn 1) better representations than prior methods, and 2) explicitly shape the balance of low and high-level features captured.
Why is the ability to shape this balance important? (5/12)
You May Also Like
Speech Delay is most common in children nowadays
In ancient times, our grandparents used to follow typical natural way of caring the needs of a child. All they used were more of natural products than chemical based for the growth of child.
One of major step followed was to feed Gurbach Jadd/ Vasa Kommu/ Acorus Calamus for initiating good speech ability in a child. This stem was needed to babies on Tuesdays and Sundays in mother's milk.
Vasa is feed to baby after the 1st bath on 12th day in week. Weekly only thrice it is fed and named as :
Budhwar - Budhi Vasa
Mangalwar - Vaak Vasa
Ravi Vaar - Aayush Vasa
This stem is burnt and rubbed against the grinding stone in mother's milk or warm water to get a paste
The procedure to make it is in the link
https://t.co/uo4sGp7mUm
It should not be given daily to the child. Other main benefits are
1. It clears the phlegm in child's throat caused due to continuous milk intake. It clears the tracts and breathing is effortless.
2. Digestion
For children who haven't got their speech and is delayed than usual should feed this vasa on these days in week atleast for 6months. Don't get carried away with this dialogue
"Some gain speech little late"
In ancient times, our grandparents used to follow typical natural way of caring the needs of a child. All they used were more of natural products than chemical based for the growth of child.
One of major step followed was to feed Gurbach Jadd/ Vasa Kommu/ Acorus Calamus for initiating good speech ability in a child. This stem was needed to babies on Tuesdays and Sundays in mother's milk.
Vasa is feed to baby after the 1st bath on 12th day in week. Weekly only thrice it is fed and named as :
Budhwar - Budhi Vasa
Mangalwar - Vaak Vasa
Ravi Vaar - Aayush Vasa
This stem is burnt and rubbed against the grinding stone in mother's milk or warm water to get a paste
The procedure to make it is in the link
https://t.co/uo4sGp7mUm
It should not be given daily to the child. Other main benefits are
1. It clears the phlegm in child's throat caused due to continuous milk intake. It clears the tracts and breathing is effortless.
2. Digestion
For children who haven't got their speech and is delayed than usual should feed this vasa on these days in week atleast for 6months. Don't get carried away with this dialogue
"Some gain speech little late"