Once again processing 11 million rows, now in seconds
Read OriginalThe article chronicles a performance optimization journey for a PHP script handling 11 million database events. Starting from 30 events per second, the author improved to 50k/sec, then doubled it to 100k/sec by batching INSERT queries. A further optimization involved moving count aggregation from MySQL's ON DUPLICATE KEY UPDATE to PHP, pre-calculating sums before a single bulk database operation, drastically reducing runtime.
0 comments
Comments
No comments yet
Be the first to share your thoughts!
Browser Extension
Get instant access to AllDevBlogs from your browser
Top of the Week
1
The Beautiful Web
Jens Oliver Meiert
•
2 votes
2
When your coding agent doesn’t understand your project, you’ll get junk
Benjamin Cane
•
1 votes
3
LLM Use in the Python Source Code
Miguel Grinberg
•
1 votes
4
Wagon’s algorithm in Python
John D. Cook
•
1 votes
5
An example conversation with Claude Code
Dumm Zeuch
•
1 votes