A/B Testing Results & Examples

Display User-Generated Content on Home Page

The Experiment

Short Description: Move the social media user generated carousel (UGC) below the main homepage sliders.

Hypothesis/Success Criteria: If we move the UGC carousel below the main homepage slider then we will increase customer engagement and therefore decrease bounce rate.

Supporting Data: User-generated content has a big influence on purchasing decisions.
According to Gartner’s research, 84% of millennials are likely to be influenced to make a purchase based upon user-generated content that is created by strangers.

CONTROL

EXPERIMENT

The Details

How Does It Work?

Utilizing our partner Curalate that lets you use social content and audiences to sell more effectively online. They allow us to bring social content onto our sites that inspire visitors and encourages purchases. The location of the social content displayed on site is important to the customer’s journey.

Why are we testing this?

Integrate images and videos from customers, influencers, partners, and our own social media accounts throughout your site to help people envision your products in their lives. Especially in the case of furniture, where design, trending styles, comfort, size, and fit are all rather difficult to display through a website.

The Results

Below is the recap of the hypothesis, success criteria, along with our go-forward recommendation the Homepage – Curalate Carousel Placement.

Hypothesis/Success Criteria: If we move the Curalate carousel below the main homepage slider then we will increase customer engagement and therefore decrease the bounce rate.

Recommendation: Based on our hypotheses, success metrics, and sample size we can say that our hypothesis was correct. We see a significant decrease in home page bounce rate when the user-generated content is below the homepage sliders. This is leading to a significant increase in the homepage click-through rate. We see no negative effect on any primary revenue KPI’s. Our recommendation is to move the winning variant to 100%