This jump is surprising and I’d like to understand better why it happens at all.
Thread on @AnthropicAI's cool new paper on how large models are both predictable (scaling laws) and surprising (capability jumps).
1. That there’s a capability jump in 3-digit addition for GPT3 (left) is unsurprising. Good challenge to better predict when such jump will occur.
This jump is surprising and I’d like to understand better why it happens at all.
Related work:
1. @gwern's list of capability jumps and classic article on scaling
https://t.co/C8qljJa13A
https://t.co/er791mhbjP
3. Lukas Finnveden's post on GPT-n extrapolation /scaling on different task shttps://www.lesswrong.com/posts/k2SNji3jXaLGhBeYP/extrapolating-gpt-n-performance
More from All
ChatGPT is a phenomenal AI Tool.
But don't limit yourself to just ChatGPT.
Here're 8 AI-powered tools you should try in 2023:
1. KaiberAI
@KaiberAI helps you generate beautiful videos in minutes.
Transform your ideas into the visual stories of your dreams with this Amazing Tool.
New features:
1. Upload your custom music
2. Prompt Templates
3. Camera Movements:
Check here
https://t.co/ivnDRf628L
2. @tldview TLDV
Best ChatGPT Alternative for meetings.
Make your meetings 10X more productive with this amazing tool.
Try it now:
https://t.co/vOy3sS4QfJ
3. ComposeAI
Use ComposeAI for generating any text using AI.
It’s will help you write better content in seconds.
Try it here:
https://t.co/ksj5aop5ZI
4. Browser AI
Use this AI tool to extract and monitor data from any website.
Train a robot in 2 minutes to do your work.
No coding required.
https://t.co/nNiawtUMyO
But don't limit yourself to just ChatGPT.
Here're 8 AI-powered tools you should try in 2023:
1. KaiberAI
@KaiberAI helps you generate beautiful videos in minutes.
Transform your ideas into the visual stories of your dreams with this Amazing Tool.
New features:
1. Upload your custom music
2. Prompt Templates
3. Camera Movements:
Check here
https://t.co/ivnDRf628L
2. @tldview TLDV
Best ChatGPT Alternative for meetings.
Make your meetings 10X more productive with this amazing tool.
Try it now:
https://t.co/vOy3sS4QfJ
3. ComposeAI
Use ComposeAI for generating any text using AI.
It’s will help you write better content in seconds.
Try it here:
https://t.co/ksj5aop5ZI
4. Browser AI
Use this AI tool to extract and monitor data from any website.
Train a robot in 2 minutes to do your work.
No coding required.
https://t.co/nNiawtUMyO