Discover and read the best of Twitter Threads about #GrodEngine
Most recents (1)
Details still pending, but what if I told you I discovered a way to improve cluster scheduling performance under load by up to 60000% or more? Sun Microsystems hid a really amazing optional feature in #GrodEngine and it has largely been unknown/unused/unfinished for 19 years!
The problem arises when you have over 100k pending jobs. Things start to slow down, job wait times sky-rocket, and the end-result is low-throughout. All-bad if you spent $8MM for your equipment and it is under-performing, and not returning your investment. Well...
It turns out that Sun Microsystems identified the problem almost two full decades before hardware would be powerful enough to push these boundaries. Thankfully there was a solution 99% coded and ready to go. The missing 1% you ask? 💥
