A
About
CloudBees Smart Tests (formerly Launchable) is an AI-powered test intelligence platform designed to modernize software testing in CI/CD pipelines. By analyzing historical test data and code change patterns, it automatically selects only the tests most likely to surface failures for a given commit—dramatically cutting pipeline run times without sacrificing quality. The platform surfaces actionable analytics that categorize tests by performance characteristics: flaky, long-running, or reliably passing. Engineering leaders and developers share the same data dashboard, enabling informed, data-driven decisions about test suite health. Automated failure triage classifies test failures, surfaces patterns, and notifies code owners—eliminating the manual debugging grind. Smart Tests integrates into any CI/CD environment and is trusted by enterprises such as Salesforce. Its intelligent test scheduling and binning maximize throughput while maintaining coverage confidence. Teams typically achieve up to 80% reduction in test execution time, 2× improvement in annual release velocity, and savings of 3–5 cloud compute instances per test hour. Ideal for developer-led teams, QA engineers, and DevOps leaders who need to scale software delivery without scaling costs, Launchable/CloudBees Smart Tests transforms testing from a bottleneck into a competitive advantage. It offers a free trial and is suited for startups and large enterprises alike.
Key Features
- AI-Driven Test Selection: Automatically selects the subset of tests most likely to catch failures for each code change, reducing test execution time by up to 80%.
- Flaky Test Detection & Analytics: Intelligently categorizes tests by performance characteristics—flaky, slow, or reliable—giving teams a clear picture of test suite health.
- Automated Failure Triage: Classifies test failures, surfaces historical patterns, and sends automated notifications to code owners, eliminating manual debugging.
- Intelligent Test Scheduling & Binning: Prioritizes and bins tests to maximize CI/CD throughput while maintaining confidence in overall test coverage.
- Unified Test Analytics Dashboard: Provides engineering leaders and developers a shared, single source of truth for test performance data and delivery metrics.
Use Cases
- Enterprise engineering teams reducing bloated CI pipelines that take too long to run, cutting feedback loops from hours to minutes.
- DevOps and platform teams looking to lower cloud compute costs by running only the most relevant tests per code change.
- QA engineers identifying and eliminating flaky tests that undermine confidence in the test suite and slow down deployments.
- Development managers seeking data-driven insights into test suite health, release velocity, and engineering productivity.
- Organizations modernizing legacy Jenkins-based pipelines who need intelligent test orchestration without fully replacing their toolchain.
Pros
- Dramatic CI Time Reduction: Up to 80% reduction in test execution time translates directly into faster feedback loops and accelerated release velocity.
- Significant Cloud Cost Savings: Cuts compute consumption by 3–5 cloud instances per test hour, lowering infrastructure costs at scale.
- Seamless CI/CD Integration: Works with existing pipelines and DevOps toolchains without requiring teams to rip and replace their current setup.
- Enterprise-Grade Trust: Used by large organizations like Salesforce, demonstrating reliability and scalability for demanding production environments.
Cons
- Requires Historical Test Data: AI recommendations improve over time as more test run data is collected, so value may be limited for brand-new projects with sparse history.
- Enterprise Focus May Overwhelm Small Teams: The breadth of features and CloudBees platform integration can feel complex for small teams with simple testing needs.
- Pricing Transparency: Full enterprise pricing details are not publicly listed, requiring a demo or sales conversation to understand total cost of ownership.
Frequently Asked Questions
What is Launchable AI Test / CloudBees Smart Tests?
Launchable has been rebranded as CloudBees Smart Tests. It is an AI-powered test intelligence solution that selects, prioritizes, and analyzes tests within CI/CD pipelines to cut execution time and reduce engineering toil.
How does AI test selection work?
The platform analyzes historical test results alongside metadata about code changes to predict which tests are most likely to fail for a given commit. Only that high-value subset is run, dramatically reducing pipeline time.
Can it integrate with my existing CI/CD tooling?
Yes. CloudBees Smart Tests is designed to plug into existing CI/CD pipelines—including Jenkins, GitHub Actions, and other major platforms—without requiring a full migration or replacement of your current tools.
Is there a free trial available?
Yes. The platform offers a 'Try for free' option, allowing teams to evaluate the AI test selection and analytics capabilities before committing to a paid plan.
What kind of cost savings can teams expect?
Teams typically save 3–5 cloud compute instances per test hour and achieve up to 80% reduction in test execution time, which translates to significant CI infrastructure cost reductions over time.
