When applied to the right spot (at the right time) even minor changes can have a huge impact on conversion—good or bad.
TrueCar is my current home, and the place is awesome. They (we?) are also a publicly traded company, so for the sake of this case study I'm not going to include specific growth numbers or time stamps. In the financial world, that's called "inside information," or some such crap, and my mama didn't raise no fool.
Anyway, the first step in our testing process was to dive into the analytics and identify an opportunity. A so-called "friction point."
when we looked at visitor data, we identified that a lot users were dropping off when they reached a specific "next steps" confirmation page.
This page required a user to review their chosen car, click a terms and conditions agreement radio button and then a CTA.
Prior to this screen, the users had already entered their name, email address, chosen a password and entered their address and phone number. So, in theory, there should have been very little attrition on this page as it wasn't asking the users to input any information. All we were asking was that they click a button.
The fallout represented a significant opportunity to increase throughput of the entire experience.
Using a software called Optimizely, we then ran a A/B test of the current control next steps page versus this new challenger redesign.
This test showed immediate improvement in favor of the new design and message. We were able to determine with 99% statistical significance that we had improved the conversion rate by over 7%.