🧵As I mentioned last week GOV.UK removed jQuery as a dependency for all frontend apps, meaning 32 KB of minified & compressed JS was removed. So let's see what difference this has made for users by examining our RUM data. Thread will mainly focus on JS CPU time.
A good place to start is users on low spec devices. The Universal Credit sign-in page shows a lot of this traffic, as seen in the images below.
We see many of our key metrics trending down (for p75) after the change, including frontend time, First CPU Idle, JS Long Tasks
If we compare before / after for our JavaScript performance, we can easily see the percentage improvements:
If we look at the extreme end (our P95 users). they also see significant improvements:
If we remove the page label restriction and look at all pages RUM data, we see a similar drop across all pages for users at P75:
This improvement is still seen across all pages at P50 (median):
If we examine only Android users across all pages at P75, we also see improvements to JS Long tasks of 7%.
If we restrict it to only mobile devices at P50 users across GOV.UK we see a 10% improvement in JS Long Tasks:
2/26
‡ Note: since December 2019 GOV.UK requires explicit opt-in for tracking which introduces bias. This is especially true for mobile devices, since the cookie banner takes up more screen estate and is more likely to be accepted.
‡ Note: since December 2019 GOV.UK requires explicit opt-in for tracking which introduces bias. This is especially true for mobile devices, since the cookie banner takes up more screen estate and is more likely to be accepted.
Users - GA definition based on cookies:
- Safari - 42.81%
- Chrome - 39.79%
- Edge - 7.67%
- Samsung Internet - 4.86%
- Firefox - 1.29%
- Safari (in-app) - 1.24%
- Android Webview - 1.22%
- Internet Explorer - 0.57%
- Amazon Silk - 0.27%
‡ Note: since December 2019 GOV.UK requires explicit opt-in for tracking which introduces bias. This is especially true for mobile devices, since the cookie banner takes up more screen estate and is more likely to be accepted.
Users - GA definition based on cookies:
- Safari - 45.09%
- Chrome - 37.98%
- Edge - 7.04%
- Samsung Internet - 4.81%
- Safari (in-app) - 1.39%
- Android Webview - 1.33%
- Firefox - 1.27%
- Internet Explorer - 0.59%
- Amazon Silk - 0.25%