DevOps.com

  • Latest
    • Articles
    • Features
    • Most Read
    • News
    • News Releases
  • Topics
    • AI
    • Continuous Delivery
    • Continuous Testing
    • Cloud
    • Culture
    • DevSecOps
    • Enterprise DevOps
    • Leadership Suite
    • DevOps Practice
    • ROELBOB
    • DevOps Toolbox
    • IT as Code
  • Videos/Podcasts
    • DevOps Chats
    • DevOps Unbound
  • Webinars
    • Upcoming
    • On-Demand Webinars
  • Library
  • Events
    • Upcoming Events
    • On-Demand Events
  • Sponsored Communities
    • AWS Community Hub
    • CloudBees
    • IT as Code
    • Rocket on DevOps.com
    • Traceable on DevOps.com
    • Quali on DevOps.com
  • Related Sites
    • Techstrong Group
    • Container Journal
    • Security Boulevard
    • Techstrong Research
    • DevOps Chat
    • DevOps Dozen
    • DevOps TV
    • Digital Anarchist
  • Media Kit
  • About
  • AI
  • Cloud
  • Continuous Delivery
  • Continuous Testing
  • DevSecOps
  • DevOps Onramp
  • Practices
  • ROELBOB
  • Low-Code/No-Code
  • IT as Code
  • More
    • Application Performance Management/Monitoring
    • Culture
    • Enterprise DevOps

Home » Latest News Releases » Sauce Labs Launches New Machine Learning-Based Analytics Solution to Improve Test Quality

Sauce Labs Launches New Machine Learning-Based Analytics Solution to Improve Test Quality

By: Deborah Schalm on May 13, 2020 2 Comments

    Recent Posts By Deborah Schalm
    • Exabeam Reinvents Security Analytics with Fusion XDR and Fusion SIEM Cloud Products to Address Security Needs at Scale
    • New Study Reveals Importance of Optimized Strategy for the Selection, Support, and Maintenance of Open Source Software
    • Applitools Integrates With Rally for Fast and Automated Bug Management
    More from Deborah Schalm
    Related Posts
    • Sauce Labs Launches New Machine Learning-Based Analytics Solution to Improve Test Quality
    • TestProject and Sauce Labs Team Up to Deliver Codeless Test Automation Experience
    • Sauce Labs Launches New Front-End Performance Testing Solution to Help Organizations Further Accelerate App Delivery and Improve User Experiences
      Related Categories
    • Latest News Releases
      Related Topics
    • Sauce Labs
    Show more
    Show less
  • 2020 Continuous Testing Benchmark Report reveals 27 percent of all test failures are traceable to a single common failure pattern
  • New Failure Analysis offering leverages AI and ML to rapidly analyze test data and use pattern recognition to surface most common causes of test failure
  • Enables developers to quickly address the most pervasive issues impacting test quality

 

SAN FRANCISCO – May 12, 2019 – Sauce Labs Inc., the leading provider of continuous testing solutions that deliver digital confidence, today announced the launch of Failure Analysis, a new analytics solution that applies sophisticated machine learning to customers’ pass/fail data in order to surface the most common reasons a given set of tests fail. Failure Analysis gives developers, testers, and QA managers insight into how often the same type of failure repeats itself across a given test suite, enabling them to move quickly to address the most pervasive issues and drive rapid improvement in test quality.

AppSec/API Security 2022

 

The newly released Sauce Labs Continuous Testing Benchmark Report for 2020 reveals that a significant portion of test failures can be traced to a small number of underlying issues impacting a test suite. Based on anonymized data from millions of tests run on the Sauce Labs platform, the benchmark report found the single most common failure pattern was responsible for 27 percent of all failures within a test suite. The top three most common failure patterns accounted for 48.2 percent of all failures, and the top five most common failure patterns accounted for 59.3 percent of all failures. By finding and aggregating the most common failure patterns, developers can remedy the majority of test failures with just a few fixes, eliminating much of the costly and time-consuming manual follow up traditionally required to determine the source of failed tests.

 

“Testing is critical to delivering flawless applications and creating great user experiences, yet the task of maintaining a high-quality test suite has only become more difficult as organizations accelerate the pace of development and automate testing at scale,” said Matt Wyman, chief product officer, Sauce Labs. “With Failure Analysis, developers finally have a machine learning-driven tool to help balance the demand for faster deployments with the heightened need to maintain a reliable test suite. We’re excited to deliver this new resource to aid in the testing community’s collective efforts to improve test quality, increase developer productivity, and build digital confidence.”

 

Improving test quality is a critical need

The release of Failure Analysis comes as many development teams reach an inflection point in their digital journeys. Though more organizations than ever have shifted to agile development methodologies and implemented continuous testing throughout the software development cycle, poor test quality continues to undermine many efforts to deliver quality applications at speed. Poor test quality also increases the occurrence of false failures, frustrating testers and developers responsible for manually following up on those failures, and eroding confidence in the overall automated testing process.

 

The findings of the 2020 Continuous Testing Benchmark Report underscore just how prevalent poor test quality is among most enterprise organizations. The report found that only 24.37 percent of organizations pass at least 90 percent of their desktop tests, while only 25.45 percent of organizations pass at least 90 percent of their mobile tests.

 

Failure Analysis from Sauce Labs addresses this increasingly urgent need by helping testers and developers better understand why tests are failing and enabling them to prioritize remediation accordingly. Leveraging powerful machine learning algorithms to analyze an organization’s pass/fail data and its Selenium and Appium command logs, Failure Analysis gives testers and developers visibility into precisely where and how often failure patterns recur within a test suite, all from a single dashboard view within the Sauce Labs UI. Using the learnings provided by Failure Analysis to improve test quality, organizations can also dramatically lower the occurrence of false failures, ensuring that failed tests carry a high signal-to-noise ratio and developers feel confident that a failed test has truly detected a breaking change as opposed to the flaky noise of an unreliable test suite.


Failure Analysis is available now as a standard capability for enterprise customers as part of the Insights package within the Sauce Labs Continuous Testing Cloud. Sauce Labs provides a host of analytics capabilities that provide intelligent views into test data, including a new test overview and trends dashboard, interactive visualizations that enable customers to drill down on granular data sets, and a powerful REST API that allows users to aggregate data into their home-grown quality dashboard or test analytics tools. For more information, visit the Insights landing page.

 

The 2020 Sauce Labs Continuous Testing Benchmark Report is also now available as a free community resource.

About Sauce Labs

Sauce Labs is the leading provider of continuous testing solutions that deliver digital confidence. The Sauce Labs Continuous Testing Cloud delivers a 360-degree view of a customer’s application experience, ensuring that web and mobile applications look, function, and perform exactly as they should on every browser, OS, and device, every single time. Sauce Labs is a privately held company funded by Toba Capital, Salesforce Ventures, Centerview Capital Technology, IVP, Adams Street Partners, and Riverwood Capital. For more information, please visit https://saucelabs.com.

# # #

Filed Under: Latest News Releases Tagged With: Sauce Labs

Sponsored Content
Featured eBook
The 101 of Continuous Software Delivery

The 101 of Continuous Software Delivery

Now, more than ever, companies who rapidly react to changing market conditions and customer behavior will have a competitive edge.  Innovation-driven response is successful not only when a company has new ideas, but also when the software needed to implement them is delivered quickly. Companies who have weathered recent events ... Read More
« OpenStack Delivers Ussuri Update
DRY Comes to COBOL in IBM Z Development »

TechStrong TV – Live

Click full-screen to enable volume control
Watch latest episodes and shows

Upcoming Webinars

Code Tampering: Four Keys to Pipeline Integrity
Wednesday, August 17, 2022 - 1:00 pm EDT
The ROI of Integration: Must-Have Capabilities to Maximize Efficiency and Communication
Thursday, August 18, 2022 - 11:00 am EDT
Best Practices For Writing Secure Terraform
Thursday, August 18, 2022 - 3:00 pm EDT

Latest from DevOps.com

Contrast Security Adds API Support to Security Platform
August 16, 2022 | Mike Vizard
Avoiding Security Review Delays
August 16, 2022 | Waqas Nazir
Building a Platform for DevOps Evolution, Part One
August 16, 2022 | Bob Davis
Techstrong TV: Leveraging Low-Code Technology with Tools & Digital Transformation
August 15, 2022 | Mitch Ashley
Five Great DevOps Job Opportunities
August 15, 2022 | Mike Vizard

GET THE TOP STORIES OF THE WEEK

Download Free eBook

The State of Open Source Vulnerabilities 2020
The State of Open Source Vulnerabilities 2020

Most Read on DevOps.com

MLOps Vs. DevOps: What’s the Difference?
August 10, 2022 | Gilad David Maayan
We Must Kill ‘Dinosaur’ JavaScript | Microsoft Open Sources ...
August 11, 2022 | Richi Jennings
What GitHub’s 2FA Mandate Means for Devs Everywhere
August 11, 2022 | Doug Kersten
CloudNativeDay: WASM to Drive Next IT Epoch
August 10, 2022 | Mike Vizard
Next-Level Tech: DevOps Meets CSOps
August 12, 2022 | Jonathan Rende

On-Demand Webinars

DevOps.com Webinar ReplaysDevOps.com Webinar Replays
  • Home
  • About DevOps.com
  • Meet our Authors
  • Write for DevOps.com
  • Media Kit
  • Sponsor Info
  • Copyright
  • TOS
  • Privacy Policy

Powered by Techstrong Group, Inc.

© 2022 ·Techstrong Group, Inc.All rights reserved.