1. Buy with Prime
  2. Impact analysis

Analyze. Iterate. Improve.

Analyze. Iterate. Improve.

Use a performance impact analysis to uncover critical insights about your ecommerce site that can help you make key business decisions.

Get started

Measure impact on shopper conversion

Test Buy with Prime and site performance

The cornerstone offering of a performance impact analysis is an A/B test that you can use to evaluate Buy with Prime and other aspects of your site or shopper experience.

Measure conversions effectively

An A/B test is one of the most accurate ways to determine the impact on shopper conversion when offering Buy with Prime on your site because it minimizes variables that might skew results collected through other methods of analysis.

Use data to drive improvements

Following an A/B test, receive data and recommendations that can help you improve your site and shopper experience.

 

How A/B testing works

Confirm your fit

Merchants with monthly traffic >10,000 visitors are best suited for A/B testing because they see statistically significant results faster than merchants with lower traffic.

Launch your A/B test

Work with our third-party provider to A/B test aspects of the Buy with Prime shopper experiences on select product pages to identify the best-performing version.

Collect data from randomized transactions

During the test, your site visitors are split and only half see the aspect of the shopper experience that you’re testing, allowing you to collect comprehensive conversion data.

Use learnings to boost growth

Evaluate your A/B test results to determine the impact of Buy with Prime on your site and help optimize your shopper experience.

Ready to get started?

Sign up

vector-info For more information, go to the Performance impact analysis help article.

Frequently asked questions

  • A performance impact analysis helps you evaluate the impact of Buy with Prime on your ecommerce site, with A/B testing as a cornerstone offering. With a performance impact analysis, you can collect key data points about your ecommerce site and shopper experience and uncover critical insights that can inform key business decisions.

  • An A/B test is a type of performance impact analysis. It can help you uncover critical insights that can inform key business decisions. A/B testing compares two versions of a user experience (a control group and a test group) against each other to reveal which performs better based on your test goal. For example, you could test your current shopper experience without Buy with Prime compared to your shopper experience with Buy with Prime. Other aspects of Buy with Prime that you can A/B test include button placement, a collections page, Buy with Prime branding on your home page, or Reviews from Amazon on your product pages.

     

  • An A/B test is an accurate and efficient way to determine the impact on shopper conversion when offering Buy with Prime on your site. It minimizes variables that might skew results collected through other methods of analysis, such as seasonality, days of the week, and ongoing promotions. Upon completion of an A/B test, you receive a detailed report on the impact of Buy with Prime on your site and tailored post-analysis recommendations to improve your shopper experience and help boost shopper conversions.

  • The only requirements are that you conduct your A/B test with VWO, the third-party service provider supporting Buy with Prime merchants on A/B testing, and start your test within the first 30 days of registering for your free trial with VWO.Beyond these requirements, there are some best practices we recommend to help ensure that you’re getting the most meaningful results in your A/B tests.

    • Although all Buy with Prime merchants can participate in A/B testing, merchants with monthly traffic greater than 10,000 visitors are best suited for A/B testing because they see statistically significant results faster than merchants with lower monthly traffic.
    • Test 100% of the SKUs that you intend to offer Buy with Prime on. For example, if you have 100 SKUs on your site and you plan to activate Buy with Prime on 80% of them, we recommend including all 80 SKUs in the test.
    • Activate Buy with Prime on your most popular SKUs to collect the highest volume of data.
    • Start by testing button placement on your product pages. We recommend placing it below your site’s native “Add to cart” button.
    • Test one thing at a time so that you can easily attribute results and make changes as needed.
    • Check out more tips and best practices on the related Buy with Prime blog article.

  • VWO collects and stores data associated with the aspects that you’re testing on your site, such as page activity and orders completed, and provides it to Buy with Prime for purposes of analyzing your site's performance and providingrecommendations to you on how to leverage Buy with Prime features and services. The data collected is aggregated with data from other merchants that are participating in A/B testing to help us understand and communicate the overall impact of Buy with Prime features and services. VWO does not collect site or business data unrelated to the A/B test, personal identifying information on customers, or order details.

  • Buy with Prime receives data that VWO collects during A/B testing on your site. It’s used in two ways:

    • The Buy with Prime performance impact analysis team collects and reviews the data, and then provides it to your Buy with Prime sales representative to share with you. They also provide results-based recommendations for improving shoppers’ experience using Buy with Prime on your site to help drive greater impact.
    • Buy with Prime may use aggregated, anonymized information collected from participating Buy with Prime merchants to publish recommendations and the latest performance metrics about Buy with Prime.

  • You receive results halfway through each test and at the end of the test. An A/B test typically lasts about 3–5 weeks, which is the average amount of time typically needed to capture statistically significant results. Additional tests on updated versions of your site or experience may be necessary to capture additional learnings and find the best-performing version.

  • Yes, after you have conducted an initial A/B test of Buy with Prime on your site, you can use A/B testing on other aspects of your site or shopper experience.

  • You can receive a free nine-month, enterprise-level trial with VWO for A/B testing as long as your first test measures an aspect of Buy with Prime on your site, such as button placement or Buy with Prime badge usage, and is started within the first 30 days of registering for your free trial with VWO.