Homepage tests

Homepage tests allow you to make visual changes to your shop's homepage and track impressions, clicks, and conversions so you can make changes with confidence. 

There are a few major differences between homepage tests and other tests provided by Neat A/B Testing you should be aware of. 

  1. Homepage tests do not cycle. When you create a homepage test, your users are split in real time. 
  2. Return visitors will have a consistent experience. If a visitor is put into the test group, for example, they will see the test version on subsequent visits to your shop until you stop the test. 
  3. Homepage tests will flicker. Because the app uses client side JavaScript to execute the test, there will be a brief flicker where both versions are visible. This only affects tests that appear "above the fold". 
  4. Stopping a homepage test does not automatically make the change to your shop. When you stop a test, you need to manually remove the losing section from your homepage to make the change permanent. 

To create a homepage test, just follow these simple steps.

1. Make your changes in a theme copy

Create a copy of your current theme by opening your Shopify admin and going to Online Store > Themes. Where it says Current theme, click Actions > Duplicate. This will create a copy of your current published theme. 

Next, open the duplicate theme by clicking Customize next to your newly created theme copy. 

Next, add a new section to your homepage immediately under the section you would like to test. This will be the test version of your homepage section. Set it up how you would like the test version of that section to appear. Here is an example where we are testing a new headline and background image on our hero section. Notice both are visible here. 

Save your theme copy. 

2. Create a homepage test in Neat A/B Testing

Open up the Neat A/B Testing app, click Create a test, and select Homepage test on the next screen. 

Name your test something you will remember and select the copy of the theme you just created in the theme dropdown. It will load your homepage sections here, allowing you to select the sections you want to test. The sections are loaded in the order they appear on the page, so the easiest way to figure out the section name is just to go by their position on the page. In the example above, we're testing our first section and we created the test section immediately below that, so we want to check the first two boxes in the sections list. 

Next, choose your test split. The test split is the percentage of users that will be shown the control version. This is 50% by default, and that's usually a good number to use. If you select 75% there for example, 75% of your visitors will be placed into the control group and 25% will be placed into the test group. This is useful if you want to test on a smaller segment of your audience. 

Finally, if you want to schedule the test to start in the future, you can do so by editing the schedule field. 

Here is what our ready-to-go test looks like. 

When you're ready, click Start test. This will publish the theme copy you just created and activate your test. 

Still need help? Contact Us Contact Us