A/B Test Participation Triggers

With Salesforce B2C Commerce A/B testing, you can define triggers that a customer must access in order to be considered for participation in a particular test. These triggers can be:

Note: A/B testing metrics are only calculated after A/B test participation. If a customer has already added items to the cart before participating in the A/B test and then submits an order, the corresponding add to cart events don't count for the test, though the order and revenue do.
Note: A/B test triggers are included in import/export data.

Pipeline Triggers

The participation trigger can't be the same pipeline as one that collects data. Consider how you want to trigger the participation of a user in an A/B test. Reporting an A/B test participation can't be the trigger itself. The site entrance is a good trigger; but if you want to use a pipeline as a trigger, use a different pipeline or call a simple pipeline through a remote include, at the appropriate place.

For example, you can use any of the existing pipelines as a trigger-except for a few reserved pipelines, such as ReportingEvent-Start. Or you can create a new simple pipeline, that contains just a start node and an empty template, and include it in your code as appropriate. Also, you can test pipeline triggering by calling the pipeline directly in the browser via its pipeline URL.

Site Entrance / Customer Login Triggers

The customer triggers participation for an A/B test without customer group qualification as soon the customer accesses the site.

The customer triggers participation for an A/B test with customer group qualification as soon as the customer logs in.

For example, a merchant wants to show two different banners within the storefront header. Banner 1 offers Free Shipping on Orders over $150 with a corresponding promotion. Banner 2 offers 10% off orders over $150 with a corresponding promotion. The merchant configures an A/B test as follows:

When the customer accesses the site, the customer is immediately placed in one of the three test groups because the header banner is persistent throughout the storefront. The statistics are significant because customers always see the header.

Category Page View Triggers

The customer triggers participation when the customer views the category page for one of the configured categories. This means that a call was made to Search-Show?cgid=xxxx for one of the configured category IDs.

For example, a merchant wants to shows two different banners on the Kids category page within the storefront. Banner 1 offers Buy one kid's winter hat, get one free with a corresponding promotion. Banner 2 offers 20% off on kid's winter hats. The merchant configures an A/B test as follows:

The customer is only assigned to one of the three test groups if the customer actually views the Kids category page. If the customer doesn't view this page, no metrics are collected.

Home Page View Triggers

The customer triggers participation by viewing the default storefront URL (that is, "/") or the Home-Show pipeline.

For example, a merchant wants to show two different banners on the home page within the storefront. Banner 1 offers Free Shipping on Orders over $150 with a corresponding promotion. Banner 2 offers 10% off orders over $150 with the corresponding promotion. The merchant configures an A/B test as follows:

The customer is only assigned to one of the three test groups by actually viewing the home page. If the customer doesn't view this page, no metrics are collected.

Pipeline Call Triggers

The customer triggers participation when a request calls a configured pipeline name and start node (for example, Account-Show). The use of triggers has no effect on the pipeline or scripting API because A/B test triggers are executed by B2C Commerce request-handling logic.

For example, a merchant wants to understand how well a particular promotion is doing for its registered customers. The merchant configures a banner within the My Account section as follows:

The merchant only wants the customer to be assigned to an A/B test if the My Account section is viewed because this is where the banners A and B appear. For example, a customer might go immediately to a product detail page, add a product, and check out. The customer is only put into one of the two A/B test groups by actually accessing My Account and seeing the banner. If this pipeline isn't accessed, the customer is never assigned to either test.

Related Links

A/B Testing

A/B Testing Participants

A/B Testing for Developers