Browser Reliability Improves - Even For IE
Written by Alex Armstrong   
Friday, 23 August 2013

Browser crash data from Sauce Labs reveals that, although over the long term IE has been the worst performing browser, if you consider the latest browser version it has cleaned up its act considerably.

As a testing-as-a-service company, Sauce Labs is in a good position to discover which browsers cause the most errors.

 

saucelabs

 

It explained its methodology in a recent blog post:

By looking at metadata on the over 50 million tests run on Sauce, we can see which browsers cause the most errors.

Sometimes errors we see are caused by connectivity issues or bugs in code. But sometimes, those errors are caused by the browser itself crashing. Sauce will actually reboot the browser and rerun the test when this happens, without you even knowing (magic!), but we record all the instances of this happening. From this, we can see the error rate of all the different browsers we support.

 


Looking at the chart of all tests ever run on Sauce, which go back over 4 years, IE is way in the lead with an error rate of 0.25%.

 

sauceerr400

(click chart to enlarge)

 

However if you split out browser versions, it is immediately apparent that IE 6 and IE 7 are the main culprits with 0.31% and 0.29% respectively.

And when you look at the error rate for the latest browser versions IE is no longer the most error prone - that accolade now goes to Safari 6 with an error rate of 0.12, followed by Opera 12 at 0.08%, while IE 10 has a respectable 0.04%.

saucecht3

 

What is clear from this final chart is how much more reliable the most recent browsers are. Chrome 27 has an error rate of 0.02% and Firefox, which has always been the most stable, has such a low rate that it doesn't even show on the chart.

 

saucebrowsers

 

More Information

SauceLabs

Related Articles

Which Browser Holds Sway?

 

To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, Facebook, Google+ or Linkedin,  or sign up for our weekly newsletter.

 

espbook

 

Comments




or email your comment to: comments@i-programmer.info

 

Banner


TestSprite Announces End-to-End QA Tool
14/11/2024

TestSprite has announced an early access beta program for its end-to-end QA tool, along with $1.5 million pre-seed funding aimed at accelerating product development, expanding the team, and scaling op [ ... ]



Copilot Improves Code Quality
27/11/2024

Findings from GitHub show that code authored with Copilot has increased functionality and improved readability, is of better quality, and receives higher approval rates than code authored without it.

 [ ... ]


More News

Last Updated ( Friday, 23 August 2013 )