Skip to content
Quantalog
Start free

Quantalog A/B Tests

Test page changes, split URLs or code variants against the original and see which one converts better.

Quantalog A/B Tests splits your visitors between the original version of a page and up to three variants, and shows which one gets more people to your goal. It runs through the Quantalog tracking script. It is an official Quantalog app that a workspace admin unlocks in Apps.

#Turning tests on for a site

Add data-experiments="on" to the Quantalog tracking tag on the site you want to test. With it, the tracker applies a variant before the page shows, so visitors never see the original flash first. While it loads the test settings, the page stays hidden for at most 0.8 seconds, and after that the settings are reused for five minutes. Sites without the attribute are not affected.

#Three kinds of test

  • Page changes: pick an element with a CSS selector such as h1 or .cta-button, then replace its text, hide it, change a link or image address, or add CSS.
  • Split URL: visitors in a variant group are sent to a different page as soon as they land, with the address query kept.
  • Code: your developer reads the visitor's group with rta.variant("your-test-key", function (variant) { … }) and builds the change. The original group is called control, the others b, c and d.

#Goal and results

A goal is a page, such as /thank-you, or a custom event you track with rta.track(). A visitor counts as converted when they reach the goal in the same visit, after seeing the test. The results show visitors, conversions and conversion rate for each group, the change against the original, and the chance each variant beats it. A winner is called once each group has at least 100 visitors and a variant is 95% likely to be better, or the original is 95% likely to be better than every variant.

#Starting, pausing and ending

  • New tests are saved as drafts. Press Start test to begin splitting visitors.
  • Pause a test to change it. While paused, everyone sees the original.
  • End a test and pick the winner. For page changes and split URL tests you can keep showing the winner to every visitor until you update your site.

Each visitor keeps the same group on every visit. Free runs 1 test at a time, Starter 3 and Pro 10. Test views do not count towards your monthly event allowance.