Firefly Testing Policy
Updated: March 4, 2019
Our Standard Web Development Testing Practices
This page was created to document the approach we take in quality assurance testing across devices, browsers, and operating systems. These standard testing practices will be updated regularly in response to changes in technology. Please ask your Firefly point of contact if you have questions or need testing that falls outside of these standard practices. Last Updated: March 4, 2019.
Browser Testing & Supported Browsers: Chrome, Firefox, Internet Explorer, Edge, & Safari
The specific browsers we test as part of our standard practices are determined by their percentage of market share – in other words – how many people use it? We use NetMarketShare to identify the most frequently used browsers, and we focus our testing efforts on these top browsers. We test on the most recent versions of: Chrome, Firefox, Internet Explorer 11, Microsoft Edge, and Safari. We use Browserstack to test different combinations of browsers and operating systems.
Our standard browser testing practices do not include browsers in beta versions, nor do they include testing older browser versions that are no longer supported. As of January 12, 2016, Microsoft will no longer support IE8, IE9 or IE10, and these browsers have been removed from our standard testing practices.
Mobile Device Testing: iPhone, iPad, Android
Firefly will use the mobile devices and operating systems available in Browserstack to provide device testing for the most commonly used devices based on U.S. market share. Our standard IOS testing currently includes IOS operating system 11 and 12 on iPhone XS, iPhone XR, iPhone 8 and 8 Plus, iPhone SE, and iPad Pro. Our standard Android testing currently includes Android operating system 8 and 7 on Galaxy S9 and S9+, Galaxy Note 9, and Galaxy Tablet S4. The Windows Phone, Google Pixel, Blackberry, and KindleFire/FireOS are excluded from our standard device testing practices due to limited market share.
If you see features or designs no longer looking or working as you expect, it may be due to these common updates to browsers, email clients, or devices. If this happens to you and you’d like us to troubleshoot, call us at 303.515.7155 or contact us electronically. We’ll get a new contract in place quickly to help identify the root cause and fix things up again.