Suggestions for A/B testing.
- Don't finish a test too early. Ensure that your test reaches statistical significance or
that the results are clear.
- Check the test at predetermined times to determine if you want to continue based on
results.
- Test only those site visitors that you want to test: Use customer groups to focus on
specific types of customers.
- Trust the data you collect: Don't reject the results because you do not believe them.
Remember why you tested in the first place — because you wanted to learn how customers
actually behave.
- Testing for conversion optimization is a long-term commitment: Make A/B testing part of
your long-term marketing strategy.
- Beware of the never-ending test: Consider every test an opportunity to learn. Don't waste
time on a test that isn't yielding results.
Clearing Cookies When You Are Verifying Your
Tests
When you have configured and enabled (important) your tests, run them to see if
the results are what you expect. Consider opening various browsers and entering the storefront,
simulating customer behavior. During this process, clear cookies on your browser each time you
enter a site to simulate the entry by a different visitor.
To clear cookies, first
identify your browser.
Microsoft Internet Explorer
- On the Tools menu, click Internet Options and the
General tab.
- To delete all cookies, in the Browsing History section, click
Delete.
- Uncheck the top Preserve Favorites Website Data box.
- Check the box beside Cookies.
- Click Delete.
Mozilla Firefox
- On the Tools menu, click Clear Recent History.
- Set the Time range to clear to Everything.
- Select Cookies.
- Click Clear Now.