Kimonix Help Center | How to create an A/B test?

All Categories

Collections Tools

How to create an A/B test?

Learn how to set tests to optimize your collections strategies.

Stacey From Kimonix

Last Update sebulan yang lalu

In this article, we will be exploring the following topics:

What is an A/B test?
Before starting the test
Getting started
Creating the Test
Implementing Variation Strategies
Running the A/B test
Reviewing Test Results / Analytics
Ending the Test and Implementation

Let's Begin:

1. What is an A/B test?

An A/B test is a controlled experiment where two or more versions of something, such as a collection page, are presented to different segments of an audience. The primary aim is to determine which variation performs better in terms of achieving specific goals, like higher conversion rates, sales, or engagement.

With the app, you can conduct an A/B test for your collections, enabling you to identify which strategies perform best in terms of conversion, sales, and more. These tests are integral to the process of optimizing conversion rates and continuously improving your store’s performance.

Please note: You can only conduct a variation test on sorted collections, including both pre-existing Shopify collections and Kimonix collections.

You can read more about creating Kimonix collections in this article and about sorting pre-existing Shopify collections in this article.

2. Before Starting the Test:

Define Your Testing Objective: First, decide what you want to test. You can experiment with different filtering and sorting methods. In this example, we're testing the best sorting strategy for our "White" collection.
>> We encourage you to advise with our success managers, to help you set your first goals. Write us a chat to learn more about how to set a meeting.
Identify Variations: Decide on the number of variations.

Once you start an A/B test 2 variations will be created automatically, but you can add more if you'd like.

In our example, we will have 2 variations: the original collection (sorted with Kimonix's AI smart sorter) and a variation with custom sorters of our choice.

3. Getting Started:

Option 1: From the A/B Tests Page

Go to the A/B Tests page
Click on "Start a new test"

Option 2: From the Collections Page

Go to your Collections page
Find the collection you want to test.
Click the three dots on the right side of the collection.
Choose "Create A/B test".

4. Creating the Test:

A pop-up will appear. Ensure you select the correct collection from the dropdown (in option 2, the collection will be already selected).
Click on "Create test".

A test has been created with 2 variations that are identical to the original collection. So, 50% of the customers who visit the original "White" collection will be automatically referred to the first variation, and the other 50% to the second variation.

These variations have their own URLs (as seen under “Variation Handle”), and they are not being indexed by search engines so they do not affect SEO.

Good to know: On your Shopify admin, each variation will be presented as a separate collection.

5. Implementing Variation Strategies:

Now, it's time to set the strategies for each variation.

Click on the 3 dots found to the left of the variation name.
Click the Edit button.

Add a different variation name for easy identification.

This is exactly like building a collection: set the strategy, and change the Variation name based on its strategy. In our case, we will have "AI Sorting" and "Bestsellers + Inventory sorting".
Adjust the parameters based on the sorting strategy chosen for each variation.
Don't forget to save each variation separately.

6. Running the A/B test:

Congratulations! Your test is now active.

The original collection page will automatically redirect to its variations, and each variation will receive a proportional amount of the redirection traffic based on the number of variations. For example, if there are 2 variations, each will receive 50% of the redirection traffic.
Allow the variations some time to run. We recommend giving it at least 7 days and making sure it has a sufficient number of views before ending it.

7. Reviewing Test Results / Analytics:

For each variation, you will get the following metrics: Collection views; Product views; CTR; Sales; Sales quantity; Daily sales; Daily sales quantity; Conversion rate; Appeared in orders, and Gross profit.
The calculation of each metric can be viewed by clicking the small “i” icon next to each of them.

8. Ending the Test and Implementation:

Once you are ready to choose the winner, click on "End test" under the test name.

Important note: if you choose one of the variations as the winner, the original collection will be replaced with the winning variation collection.

A pop-up will appear where you can select the winning variation.
Select the winning variation and click “End test”.

Good to know: you can also choose to stay with the "Original collection" and not implement any variation.

Your test is now complete, and the chosen variation will replace the original collection automatically on your Collections page to optimize its results.

That's all for this tutorial! 👏 Until the next one, happy testing and optimizing your collections!

Have any feature requests? Need our help?
We are here --> Message us directly through this chat link.

Was this article helpful?

0 out of 0 liked this article

Still need help? Message Us