24 Best A/B Testing Tools in 2022 (Reviewed by CRO Experts)
So, you’ve decided to use an A/B testing tool to optimise your website – how do you know which one is best for you? Our CRO Experts reviewed 24 of the most popular A/B testing tools to help you pick the best one for your business.
There are now 24 major A/B testing tools on the market (not to mention those that offer testing as part of a wider service). We took the market leaders, including Optimizely, VWO, and Google Optimize, and ranked them according to features, usability and price.
UPDATE August 2021: We have removed ClickThroo and Unbounce form the list, since these are Landing Page Builders with A/B Testing feature, not A/B Testing tools to test any website. We have added Evolv.ai and InspectLet that now offers A/B Testing.
UPDATE September 2021: Glassbox has acquired Convertize A/B testing platform, meaning that plans and prices are expected to change as Glassbox integrate the A/B testing tool to their suite.
The 24 Best A/B Testing Tools in 2022
- The Features A/B testing Tools Need
- The 24 Best A/B Testing Tools in 2022
- Glassbox (Convertize)
- Optimizely
- Google Optimize
- VWO
- AB Tasty
- Convert
- Kameleoon
- Omniconvert
- Accenture Testing Platform
- Adobe Target
- Bound
- Conductrics
- Evolv.ai
- Freshmarketer
- HiConversion
- InspectLet
- Kibo (Monetate)
- OpenText Optimost
- Oracle Maxymiser
- Simplify (SiteGainer)
- SiteSpect
- SiteTuners
- Webtrends
- Zoho Pagesense
- A/B Testing Tools Comparison table
- Conclusion
Four years ago, the market for A/B testing tools was divided between two options: Optimizely and VWO. Since then, the number of options has grown. AB Tasty arrived, with a set of advanced features. In 2017, Google launched Optimize and Optimize 360. Now, there are more than 24 A/B Testing tools on the market.
Some options, such as VWO, offer features like heat-maps, questionnaires and session recording. Others have simplified their software and made it easier to use. Our list takes all these factors into account.
Price is usually the first thing people ask about when choosing a new tool. The second is how easy it is to use. But there are other factors to consider. Our Comparison Table of A/B Testing Tools lists a series of ‘Must-have’ features, ‘Luxury’ features and technical specifications.
A/B Testing Tools “Must-have” features
- A/B/n Testing -In an A/B test, your visitor sees version A or version B of a particular page. A test with three page versions might be called an A/B/C test. “A/B/n” is used as shorthand for a test that has “n” different versions.
- Visual Editor – Some of the A/B testing tools have in-built platforms for creating and editing webpages — a bit like having their own WordPress interface. They can be useful (particularly if the thought of working with your company’s IT team gives you the shudders)
A/B Testing Tools “Luxury” features
- Dynamic Traffic Allocation (Multi-Armed Bandit) – This allows your Autopilot to finish the test as quickly as possible whilst sending traffic to the highest-converting page. The “Multi-Armed Bandit” is an algorithm that directs traffic to better-performing pages. Some A/B testing tools allocate traffic evenly between variation A and B. This could mean directing half of a website’s traffic to a bad version (which can cost large companies vast amounts of money). A Multi-Armed Bandit stops that happening.
- Library of A/B Testing Ideas – Everyone has experienced a mind-blank at some point. A library of ideas helps to break the ice
- Multivariate Testing (MVT) -“Multivariate” or “Multivariable” (MVT) tests are simply ones in which you carry out A/B tests (or A/B/n ones) on several independent page elements simultaneously. There are different ways of carrying out multivariate (MVT) tests. You can show every single possible combination of page elements (“full factorial”) or only a fraction of them. The various kinds of “fractional factorial” test often have complicated-sounding names (for example, “Taguchi”). You can also choose to display losing combinations less frequently.
Technical Specifications
- Client-side – A/B testing tools work by telling internet browsers how to display a page. This is done by ‘tagging’ the page with several lines of Javascript. When the page is loaded, the Javascript contacts a back-office system which then tells the browser which content to show. This back-office system also keeps score of conversions.
- Server Side -“Server-side” A/B testing tools run on the page’s server. The page is compiled by the server, and is presented to the browser in its finished form. In the same way that some PC software is only available for Windows or for Macs, some server-side software is only available for particular servers (such as PHP).
The tool you choose should reflect the size of your business, your previous experience with A/B testing tools and your resources. If you need help deciding what kind of tool you need, we have created a set of questions to help you find the best A/B testing software.
Here is our list of the best A/B Testing tools for web agencies, marketers and e-commerce. For each one, we have built a table of prices and features. The tables show if the tool includes A/B/N testing, MVT, page editing and features like autopilot.
To compare all of them at once, scroll down to our comparison table or click here: A/B testing tools comparison table
Glassbox (Israel) has recently acquired the Convertize A/B testing platform. The software allows any marketer to test their ideas, without the need for a webmaster. The most complex parts of a test, like how to distribute your traffic, have been automated.
The pricing scale is based on traffic and all plans include all features.
Please note that current plans and prices are expected to change as Glassbox will integrate the tool to their suite.
20,000 monthly visitors | 100,000 monthly visitors | 500,000 monthly visitors | 1,000,000monthly visitors | |
Cost/month | $49/month | $199/month | $329/month | $499/month |
Starting from just $49 for 20,000 a month (the minimum required for statistically significant results), the tool allows users to test up to 1,000,000 visitors for $499 a month.
Setup & Subscription | $49/month |
How Pages are Loaded | Client-side script with "Lightning Mode" |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | No |
Autopilot Mode or Multi-Armed Bandit | Yes: Autopilot with Hybrid Statistics |
Page Editing | SmartEditor |
Tactic Library | Yes: Neuromarketing Tactics |
Optimizely (USA) is an executive solution that offers A/B testing and customisation options. This is the oldest and best known platform. It is also the most expensive at well over $1000/month.
Setup and Subscription | Around $1000 (Available on Request) |
How Pages are Loaded | Client Side or Server Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot Mode or Multi-Armed Bandit | Multi-Armed Bandit |
Page Editing | WYSIWYG Editor |
Tactics Library | Yes: Optiverse |
Google Optimize (USA) is Google’s A/B testing tool. It connects to Google Analytics (which is required to use the software). Google Optimize requires a Chrome extension, whilst Optimize 360 provides a paid-for service that can test up to 10 variations of a page. Ergonomics and limitations make the A/B Testing tool difficult to use but it remains a popular option.
Setup and Subscription | Free |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes, in Beta |
Autopilot or Multi-Armed Bandit | Non |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
VWO or Visual Website Optimizer (India) is another popular A/B testing tool with a focus on graphics and design. While VWO used to offer plans starting at $199/month, it’s not the case anymore. VWO has gone entreprise and you must contact sales to get custom pricing.
The pricing scale for VWO is based on both features and traffic.On their last public pricing update in Jan 2019, the most basic plan was priced at $368/month for 50,000 visitors per month.
Testing Growth | Testing Pro | Testing Enterprise | |
Price per month (monthly plan) | Gated price | Gated price | Gated price |
Annual Price | Gated price | Gated price | Gated price |
Setup and Subscription | Gated price (at least $4,000 per year) |
How Pages are Loaded | Client-Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | Yes: Idea Factory |
AB Tasty (France) is a well-known platform on the French market. It offers a good range of user insight and personalisation features. This A/B testing tool is designed with enterprise marketers in mind. Prices are no longer displayed on the site, indicating a switch in focus towards executive customers.
Setup and Subscription | $1000 Setup (min.) and $200/month |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot or Multi-Armed Bandit | Multi-Armed Bandit |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
Convert (USA) is one of the A/B Testing tools recommended by ConversionXL founder Peep Laja. The tool positions itself as the alternative to Optimizely, and is similarly high-powered. The pricing policy is now business-oriented, with the first plan costing over $599/month (paid annually).
Convert charges based on both traffic and features. Because of this, the precise cost for each feature is difficult to estimate.
10,000 monthly visitors | >10,000 | 700,000 monthly visitors | 1,300,000 monthly visitors | |
Essential | $599/month | Contact sales | Contact sales | Not available |
Pro | Not available | Not available | $799/month | $1699/month |
One of the most important differences between the Essential and Pro plans is that the Pro plan includes “DMP profiling”. This feature is an automatic audience profiling system that helps you to segment your visitors.
Setup and Subscription | $599/month |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
Kameleoon (France) is an A/B testing tool designed for mid-sized and enterprise companies. It scales to also include server-side A/B/n testing, feature flagging, and AI personalization. Ecommerce brands value its integrations, including with Shopify Plus. HIPAA and GLBA compliant, Kameleoon is also a popular choice for healthcare and financial services.
The price of the annual license depends on your average monthly unique users/visitors over the last year. Expect to pay at least $500/month.
Setup and Subscription | Available on request |
How Pages are Loaded | Client Side (install SDK for server-side testing) |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot or Multi-Armed Bandit | Multi-Armed Bandit |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
Omniconvert (Romania) targets small and medium enterprises. The A/B testing tool offers local segmentation and personalisation features, and the platform has consistently offered exceptional value for its range of features. The free plan (which allows testing on up to 5000 views) does not provide a plausible alternative to paid software, as it would be almost impossible to achieve significant results with this volume.
Setup and Subscription | $324/month |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
The Accenture Testing Platform, launched in 2016, is a suite of digital testing systems which includes an A/B testing feature. Because of this, it is by far the most expensive option on our list. Installation and set-up alone costs over $25000. However, the service provided is comprehensive, and goes well beyond page testing. For those willing to spend the money, the platform provides AI, security and performance testing as well as user-engagement.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | Over $25,000 |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
Adobe Target (USA) is Adobe’s A/B testing tool. This is an executive service used, for example, by HSBC. The price plan easily exceeds $10,000/month. However, for those who can justify such a heavy outlay, the tool provides large-scale high-powered testing.
Setup and Subscription | Setup Fee and $1000/month (min) |
How Pages are Loaded | Server Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot Mode or Multi-Armed Bandit | Multi-Armed Bandit |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
Bound 360 is a user-friendly mid-range platform. For the price, it is disappointing that the platform does not offer multivariate testing.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | Contact sales |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | No |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
Conductrics is built around the concept of “versions”. The platform delivers both personalisation and A/B testing, giving you full control over who sees what on your website. There is a user-friendly page builder for marketers who don’t have coding experience (“Conductrics Express”) and there is also an API solution for developers.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | On request |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot Mode or Multi-Armed Bandit | Yes |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
Evolv AI is an A/B Testing tool that utilize AI and Evolutionary algorithms to speed up multivariate testing. This high-level value proposition is aimed at Entreprise customers.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | On request |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot Mode or Multi-Armed Bandit | Yes |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
FreshMarketer (‘Zarget’) (India & USA) Freshworks bought Zarget in 2017 and renamed it Freshmarketer. The A/B testing platform is now part of a bewildering array of marketing tools offered by Freshworks. Despite this, the A/B testing tool comes as part of a generous Conversion Rate Optimization package which includes heat-mapping, personalisation, and page-editing features. The free option is gone and you now need to take the Conversion Rate Optimization Add-on starting from £165 for 10’000 visitors.
Setup and Subscription | £165/month |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | Yes |
Tactics Library | No |
HiConversion is based around a “Mobile Optimization Community”. The principle is that each member of the community shares the insights from their tests to help build shared optimization templates. This is complemented by full MVT capabilities and live-data optimization. Prices are only available on request, but this is known to be a high-cost option.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | On Request |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes "Ensemble Testing" |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
InspectLet (USA) started as a session recording and heatmaps tool, they later added A/B Testing to their software suite. Features are pretty limited but enough to run straightforward A/B Tests. They offer a Free plan.
Setup and Subscription | Free, then $39/month |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | No |
Autopilot or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
Monetate is joining with the personalisation software group Kibo to provide a new hybrid service. The platform is based around the principle of optimizing customer experiences and involves testing, personalisation and segmentation.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | On Request (based on traffic) |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes "Ensemble Testing" |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
OpenText OptiMost is a versatile platform that includes customer experience management and marketing. However, it is certainly more appropriate for larger businesses than small or medium enterprises, with the monthly cost typically over four figures.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | On Request |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
Maxymiser is another enterprise option with powerful testing capabilities. Where other tools create a package including consulting services, Oracle Maxymiser is a self-service tool. To make full use of the APIs and tracking features, you will need some technical expertise. This is a solution built for data-driven marketing departments with in-house IT support.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | On Request |
How Pages are Loaded | Client Side/Server Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes "Ensemble Testing" |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
Simplify (SiteGainer) purchased SiteGainer in 2018 to integrate the A/B testing to its conversion optimization platform. Pricing has been removed and the business model seems to have gone Entreprise.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | On Request (based on traffic) |
How Pages are Loaded | Client Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes (new) |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
SiteSpect is a feature-rich solution designed for large, high-volume websites. Each of the packages includes a ROI analysis by a SiteSpect expert and training for your marketing team. SiteSpect describes itself as the “Fastest Optimisation Platform,” which is important for websites that focus on high-impact graphics and user experiences.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | On Request |
How Pages are Loaded | Depends on Package |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes (new) |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor (not for server-side package) |
Tactics Library | No |
SiteTuners are a CRO agency focused on partnerships and consulting. The tool they offer is priced according to the number of tests you run. Whilst the support provided is generous, this is not a particularly flexible option. It would suit a medium-sized company without its own CRO department.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | Charged per test |
How Pages are Loaded | Client side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
Webtrends Optimize supports both A/B/n and multivariate testing across each of your marketing channels. The platform can be used as part of a self-service or “managed” software package, or as a hybrid of the two, so you can choose exactly how much support your team needs. The platform includes a range of additional features that are useful for a multi-channel strategy, such as email capture popups, re-marketing automation, Social Proof features and form optimisation.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | On request |
How Pages are Loaded | Client Side or Server Side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | Yes |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
This tool from Zoho is an affordable and user-friendly way to perform website analytics. It supports all major integrations and offers a wide range of features. Although the platform does not support multivariate tests, it is a fantastic option for small and medium businesses who do not have the traffic required for those sorts of tests.
A/B Testing Tool Features | |
---|---|
Setup and Subscription | $18-435/month |
How Pages are Loaded | Client side |
A/B/n Testing & Split Testing | Yes |
Multivariate Testing (MVT) | No |
Autopilot Mode or Multi-Armed Bandit | No |
Page Editing | WYSIWYG Editor |
Tactics Library | No |
SETUP + Fees TECHNOLOGY COMPATIBILITY A/B/n TESTING & SPLIT TESTING MULTI-VARIABLE TESTING (MVT) AUTOPILOT MODE PAGE EDITING A/B TESTING IDEAS
Glassbox (Convertize)
0 + 49/month Client Side with Lightning Mode
Autopilot with Hybrid AlgorithmSmartEditor
Neuromarketing Tactics
AB Tasty Contact sales Client Side Editor WYSIWYG
Accenture Testing Platform >25,500 + >10,000/month Client Side Editor WYSIWYG
Adobe Target Contact sales Client Side Editor WYSIWYG
Bound Contact sales Client Side Editor WYSIWYG
Conductrics Contact sales Client Side Editor WYSIWYG
Convert 0 + 599/month Client Side Editor WYSIWYG
Evolv 0 + 95/month Client Side Editor WYSIWYG
FreshMarketer (Zarget) £165/month Client Side
Google Optimize 360 Contact sales Client Side Editor WYSIWYG
HiConversion Contact sales Client Side Editor WYSIWYG
InspectLet 0 + 39/month Server Side Editor WYSIWYG
Kameleoon Contact sales Client/Server Side Editor WYSIWYG
Kibo (Monetate) Contact sales Client/Server Side Editor WYSIWYG
Omniconvert $324/month Client Side Editor WYSIWYG
OpenText Optimost Contact sales Client Side Editor WYSIWYG
Optimizely Contact sales Client Side Editor WYSIWYG
Optiverse
Oracle Maxymiser Contact sales Client Side Editor WYSIWYG
Symplify (SiteGainer) Contact sales Client Side
With the Executive Plan
SiteSpectContact sales Proxy Server Method Editor WYSIWYG
SiteTuners $/test (contact sales) Client Side Editor WYSIWYG
VWO Contact sales Client Side Editor WYSIWYG
IdeaFactory
Webtrends Contact sales Client/Server Side Editor WYSIWYG
Zoho Pagesense 0 + $18/month Client Side Editor WYSIWYG
The top 10 tools on our list perform well in our comparison table. In particular, Optimizely, VWO and Convert provide robust tried-and-tested ways to test enterprise-level websites. However, with a couple of exceptions, they tend to be much more expensive than the challengers.
There are also some really good options among tools that are not known as A/B testing platforms. In particular, Zoho Pagesense have incorporated A/B testing features to create excellent all-round products.
Here are our recommendations for choosing an A/B testing tool in 2022:
- The best solutions for large businesses: 1. Adobe Target 2. Optimizely 3. Google Optimize 360 (the integrations alone make this a great option)
- The Best A/B testing tools for marketing teams: 1. Convertize 2. VWO 3. Optimizely (if you have the budget)
- The Best A/B testing tools for small and medium-sized business: 1. Convertize 2. Zoho Pagesense 3. InspectLet
However, the A/B testing software market is in a healthy place, with solutions for every size and type of business. Most of the options in our list include a free trial (some as long as 60 days), so there is no reason not to try them for yourself.
Before you sign up for a subscription, it is important to be clear about the needs and resources of your business. An A/B testing tool costs money both directly and through the man-hours it takes up. The best way to ensure you run successful A/B tests is to bookmark the Convertize A/B Testing Guide 2022.
This free guide combines an introduction to A/B testing, a step-by-step guide to conducting tests and a significance calculator. By following it section-by-section, you can calculate your sample size, run tests to statistical significance and avoid some of the most common A/B testing mistakes.
If you have any feedback or insight into the A/B testing tools in our list, please consider giving our other readers the benefit of your experience. Leave your thoughts in the comments section and we will make sure they are reflected in our recommendations.
Mikaela Benson says
Great list! I’ve used a few of these before but there are some I hadn’t heard of!
Stephen Courtney says
Thanks for the feedback, and I’m glad you found something new! We update this list every month, so keep checking for new features and price updates…
Robert Kingston says
@Stephen – great list. I hadn’t heard of Convertize before this.
What do you think about open source options out there, such as PlanOut.js, GTM Tester or Mojito (the last of which I am a maintainer of)?
Sherry says
Hello,
Just a heads-up that Monetate does offer autopilot. That is if I am understanding your reference correctly.
I remember when Monetate rolled out this feature ~5 yrs ago because my company was one of the first to adopt it when they rolled it out. I checked just now, and they still offer it, as quoted specifically from the Kibo site:
“Go beyond A/B testing with machine learning—avoid having to wait for statistical significance, reduce risk and adapt to fluctuating consumer behaviors by auto-allocating your traffic to winning variants.”