A/B testing to improve conversions

Cotswold Web • Nov 30, 2020

A/B testing, sometimes called split testing, is comparing two different versions of a web page, email or ad to see which performs better. 

A/B tests are carried out by giving one version to one group of people and a different version to another group. You can then judge which one works best, whether you are looking to increase sales, clicks or subscriptions.




An isometric illustration of a person typing on a laptop


Knowing which version is most effective will help you plan for the future, when you design new web pages, marketing campaigns, emails or anything else.

Creating your website, landing page or PPC advertising is your first step. Once you have created them, you want to know what helps and what hinders sales.

Even the smallest changes can impact sales and A/B testing will show you which words, images, headlines and even colours have the most impact.

The best elements to test are:

  • Headlines and copywriting

Your headline is the first thing visitors see, so it needs to grab their attention. If you’re not sure what to write, digital marketing expert Neil Patel has a video with some great suggestions. The remainder of your copy is important too – think about the length of your paragraphs and the language you use. Are your potential customers interested in the hard sell or a softer approach, do they like formal language or a chatty style, do they prefer statistics or anecdotes?



  • Images and video

The images you use and where you place them can increase conversions, so test different variations. Do people prefer close-up products shots or photos of people using the products? Do they react better to larger or small images? Would people rather watch a video than read a page of copy?



  • CTAs

Your call to action (CTA) tells visitors what you want them to do, and even small changes can make a difference. Try using a button instead of a link or a different size, shape or colour of button. The important thing is to change only one element at a time.



A white board with a question about a / b test
  • Page length

Some people want to know everything there is to know about a product from the start, while others just want the basics. Not sure which category your target audience falls into? Test shorter landing pages and blogposts against significantly longer versions to see which ones convert better.



  • Email subject lines

Email can be a very effective form of marketing, but the challenge is always to get people to open them in the first place. If a reader isn’t interested in the subject heading, they will simply delete without opening. Vary the length of subject lines and try questions or action words to see which works best.



  • Product descriptions

Do your customers need to know everything from your product descriptions, or are they happy with basic information? Test detailed descriptions against shorter versions to see which works best. Once you know what length of description to use, try testing the layout too – do your visitors respond better to bullet points or a simple few lines of text?



A group of people are standing in front of a laptop with a circle with the letter b on it
  • Reviews and testimonials

At least 70% of people use online reviews before they buy, so it’s really important to share reviews and testimonials across you site. Test star ratings against words and static reviews against scrolling reviews. Do testimonials work better if they are bigger or a different font to the other text on a page?



  • Landing pages

Your landing pages are some of the most important pages on your site. If visitors don’t convert here, you risk losing the sale. Test the layout of your landing pages to find out where people are more likely to click, then put the most important elements of the page, like your CTAs, in that position.



  • Email marketing

It is easy to A/B test your marketing emails – simply send one version to half of your subscribers and the other version to the other half. Make sure each half is balanced and representative of your entire audience, so that the results are valid.



Two hands holding two cell phones with a and b written on them



How to do A/B testing

A/B testing isn’t rocket science, but you need to start with a strategy. Target the areas which are working least well or which can give you the quick wins.


You could start with a question, like ‘Why aren’t subscribers opening my emails?’. By making changes to the subject line, images, copy length etc, you can collect the data which will give you the answer to the question.


Here’s an easy process to follow…



  • Choose what you want to test

It should be relevant to the improvements you want to make – so if you are looking to improve conversions, focus on your headlines or a CTA.



  • Set goals

What are you looking to improve? Whether it is sales or conversions or time spent on a page, focus on a single goal first to give you clear data.



  • Analyse your data

Use something like Google Analytics to look at your existing data. This is your starting point and your aim is to improve on your starting point.



A computer monitor with a graph on it
  • Choose the page to test

Focus on an important page first, which could be your home page or a landing page with lots of traffic. Improving this page could have a significant impact on your bottom line.



  • Set the elements to A/B test

Start with the elements of your page which are most likely to help you reach your goal.




  • Create your challenger

Create a variant of the element you selected above, with just one change. You might change the wording of the headline or the colour of the CTA button, while everything else should stay exactly the same.



A cartoon illustration of a laboratory with a computer , cell phone , and test tubes.
  • Choose your testing tools

If you are A/B testing your email, most service providers have built-in testing tools. If you are testing your landing pages, you could try Crazy Egg’s tool.



  • Design your test

Make sure you include detail like how long the test should run for, because you want enough data for it to be meaningful.



  • Wait for the data

Some tools, like Crazy Egg, will allow you to keep track of the progress of your test. When the test finishes, you can see how many people visited each variation, what devices they used and more.



  • Analyse the statistics

Did your original version win, or was it the challenger? Was there a significant difference between the two variations?




  • Start again

Once you have your data and your winner, you can start the process again with a different variant.




A group of people are sitting around a table with papers and a laptop


How long should a test run?

How long an A/B test should run depends on the sort of traffic you usually get and what it is you are testing. Testing an email is likely to be much quicker, as most people either open them straightaway or not at all.


It is important to run the test for long enough to iron out any differences over time. It may be that one variation appears to be much more popular at the start, but the difference between them decreases after a few hours or a few days.


If you are testing a landing page and have steady traffic, testing for a few weeks will probably give you the clear, statistically significant results you are looking for.


Many companies publish the findings of their A/B testing, so that others can benefit from their learning. You could look at A/B testing examples from other websites for inspiration and guidance. While your test is unlikely to be identical, it will give you a clearer idea of what to expect.



When looking at your results, you should consider how many visitors each variation received and by what percentage the winner beat the loser. A single figure percentage difference might indicate that your audience had no real preference for one variation or the other. But if one outperforms the other by 20 per cent or more, you have got valuable information about what your audience prefers.


A/B testing doesn’t give overnight results, but the results are accurate and reliable. They are one of the best indicators of what your audience likes in terms of the content and layout of your website, emails and ads. A/B testing can also help you create a smoother journey through your website, with less chance of your prospective customers becoming frustrated and going elsewhere, all of which will boost your sales and profits.


Keep going back and following the same procedure to help you learn more about what will persuade your audience to convert. This information can then feed into your website going forward to help the growth of your business and the bottom line.


More Posts.

SEO Audit by Cotswold Web Cheltenham
by Cotswold Web 01 Oct, 2024
An SEO audit is a way to evaluate how well your website is optimised for search engines
A computer monitor is sitting on a desk with purple lights behind it.
30 Jul, 2024
When was the last time you had your business website redesigned? If it's been more than two or three years, it likely needs an update...
The word seo is written on scrabble tiles on a wooden table.
24 Jun, 2024
Local SEO (or search engine optimisation) is a way of allowing your business to rank highly in local search results
A black and white logo of a monkey wearing headphones and a hat.
23 May, 2024
Automating your business with Connectors - Marketing your business is powered by data – and your company needs that data to stay ahead of the competition.
13 Mar, 2024
Heading 1 The best way to drive traffic to your website for most businesses is through search engines, so it is essential to secure a prominent position on a Search Engine Results Page (SERP). The two ways to do this are through search engine optimisation (SEO) and pay-per-click (PPC) advertising. The two options offer a different approach to generating leads and sales. Depending on what you are looking to achieve, either PPC or SEO might be better at reaching your business goals. With PPC, businesses bid on relevant keywords to appear as a sponsored link at the top of SERPs. When visitors search for those keywords, the ad will be displayed in the sponsored results section. A business only pays for the ad if the link is clicked. The most popular ads are Google Ads, but advertising on Facebook, LinkedIn (ADD LINK - Why you need LinkedIn paid ads for your business (cotswoldweb.co.uk)) (ADD LINK - Facebook Ads: Measure your conversions! (cotswoldweb.co.uk)) or other social media can be just as effective, depending on your own target audience. SEO is a long-term strategy to generate clicks without having to pay for them directly. It is about optimising your website content around relevant target keywords to convince a search engine that your business is a leading authority on a particular subject. Here we will discuss the pros and cons of each, and which delivers the better return on investment (ROI) for your marketing budget. One way to help you make a decision on which is the best option for your business is to check out the competition. They are targeting the same audience as you, so you can learn from their successes and their failures. If your competitors are investing heavily in PPC, it could indicate it would work well for your business too. And on the flipside, if they are ranking well in search results, investing in SEO could be the way forward. 
by Cotswold Web 14 Feb, 2024
Heading 1 LinkedIn might not be the first platform you think about for advertising your business. But if you’re looking for business-to-business (B2B) sales, you shouldn’t ignore LinkedIn’s paid ads. Most online advertising is geared towards business-to-consumer (B2C) businesses. In B2C, you can rely on mass advertising and big audiences. But B2B is all about being more focused on finding the right people. LinkedIn has an audience of 850 million professionals. They are potential customers for your B2B business. (For comparison, there are just over 3 billion Facebook users, but the demographic of Facebook is much more mixed, and its advertising is far more relevant than to a B2C audience.) While your own (or your company’s) LinkedIn profile might be active, your posts will only reach your direct connections. If direct connections comment on or share your post, it might then reach second- or third-degree connections. But it’s not going to reach even a fraction of the audience you want to target. Using paid ads on LinkedIn will take your reach way beyond your organic following. B2B buying has a much longer lead time than B2C. According to LinkedIn, the average B2B sales cycle is six to nine months. Advertising in the B2B sector is about building long-term relationships. And LinkedIn helps you to do that. LinkedIn says it helps businesses to ‘Target the professionals you care about’ and ‘Reach a qualified audience with sophisticated B2B targeting’. According to its own data: 180 million senior-level influencers are on LinkedIn Four out of five LinkedIn members drive business decisions LinkedIn audiences are six times more likely to convert LinkedIn’s audience has double the buying power of the average web audience 40% of B2B marketers see LinkedIn as the most effective channel for driving high quality leads LinkedIn has a ready-made audience of professionals, a variety of ad types and the right data to help you target your advertising to reach the right audience. LinkedIn’s audience data is what it calls ‘deep zero-party data’. In other words, the data has been provided by LinkedIn members themselves – so it is trustworthy, accurate and frequently updated. This means your ads can be targeted at a very specific audience.
Share by: