Quoting Andrej Karpathy
Read OriginalThe article quotes Andrej Karpathy comparing the 2019 training of GPT-2 (costing ~$43K over 7 days) to a modern, more efficient training run achieving a higher benchmark score in just 3.04 hours for ~$73. This demonstrates a 600x cost reduction over 7 years, equating to training costs falling by approximately 2.5x annually in AI/ML.
Comments
No comments yet
Be the first to share your thoughts!
Browser Extension
Get instant access to AllDevBlogs from your browser
Top of the Week
1
The Beautiful Web
Jens Oliver Meiert
•
2 votes
2
When your coding agent doesn’t understand your project, you’ll get junk
Benjamin Cane
•
1 votes
3
LLM Use in the Python Source Code
Miguel Grinberg
•
1 votes
4
Wagon’s algorithm in Python
John D. Cook
•
1 votes
5
An example conversation with Claude Code
Dumm Zeuch
•
1 votes