Showing version A vs. version B

  • Resolved hermk

    (@hermk)


    9 years, 11 months ago

    Hi, nice plugin. I’m liking it so far and thinking of upgrading to the Premium version. A couple quick questions about the plugin showing version A vs. version B…

    1. In my first test, I chose the default option of 50% for version A and 50% for version B. There have been 6 visitors so far (not a lot, I know), and so far it has shown version A to 5 of the visitors (83%) and version B to only 1 visitor (17%). Just curious how it picks which version of the page to show a visitor. Is it a “50-50 chance” every time (like tossing a coin)? Or is it supposed to alternate back & forth (A, B, A, B, A, B, etc.)? I know my sample size is still very small, but it seems strange that the #s have been 5-to-1 so far instead of 3-to-3.

    2. Does the plugin do anything to ensure that a particular person sees the same version of the page EVERY TIME he visits it (at least during a certain period of time)? Does it use “sessions” or “IP address tracking” or some other way to make sure he sees the same version of the page? I’m planning to use this plug-in on my membership site to test out different PRICE POINTS for membership (i.e. version A shows a price of $147, version B shows a price of $197). It will look very strange to my visitors if they see $147 the first time they visit the page and then see $197 if they visit the page a few minutes (or a day or two) later.

    3. In the stats, where it shows the # of times each version of the page has been viewed, how does it treat it if the SAME PERSON visits the page multiple times? Does it count it just 1 time? Or does it count it EVERY TIME the page is loaded?

    Thanks for your time. Looking forward to your response.

    https://www.ads-software.com/plugins/simple-page-tester/

Viewing 1 replies (of 1 total)
  • Plugin Author Josh Kohlbach

    (@jkohlbach)

    Hi hermk,

    Thanks for the questions:

    1. It’s more like tossing a coin with the probability rigged a little ensure a semi-even split based on the percentages you select. This creates a “random” element of the test which ensure integrity.

    2. Yes, just check the “Force User To See Same Variation” checkbox on your test and they will always see the same variation unless they changes browsers/computer or clear their browser cache. It’s based on sessions.

    3. It counts every time as a visit. We’re looking at introducing a “uniques” option soon.

    Hope this helps!

    Cheers,
    Josh

Viewing 1 replies (of 1 total)
  • The topic ‘Showing version A vs. version B’ is closed to new replies.

Tags