1559 | Add guided selling tool (Aiden) | Mobile
In this experiment, we tested adding the Aiden guided selling tool to product pages. The variant displayed a visible “Help me choose” tab, allowing shoppers to receive support while selecting a product.
This hypothesis is grounded in these main psychological principles:
Make it easier: Guided support simplifies product selection and reduces the effort needed to compare options.
Reduce Uncertainty: Recommendations can reassure shoppers that they are choosing the right product.
Based on this background, we believe that adding the Aiden guided selling tool for product-page visitors will cause more shoppers to complete their purchase. We will know this when we see online transactions increase.
The guided selling tool had a positive effect on online transactions. This indicates that offering visible product-selection support helped more visitors move toward purchase.
Reasons why it tested positively:
The guided selling tool helped visitors narrow down options, making product selection feel easier.
Personalized guidance reassured shoppers that they were choosing a suitable product.
The “Help me choose” tab made support more visible by clearly signaling that assistance was available.
All A/B tests in Evidoo have been analysed using Bayesian Statistics. The most important advantage of Bayesian statistics is that it is easy to understand. If there is a difference between the control and the variant, we determine the probability that there is a difference. The probability that the variation differs from the control, is indicated in a percentage.
An A/B test labeled as ">80%" (winner), indicates that the hypothesis has a high probability (>80%) of being true.
An A/B test labeled as "21 - 79%" (inconclusive), suggests the hypothesis has an intermediate chance of being true. This probability range indicates that there is still uncertainty regarding the hypothesis. Therefore it can not be clearly categorized as true or false.
An A/B test labeled as "< 20%" (loser), likely represents a hypothesis that has less than a 20% chance of being true. This suggests that the hypothesis is likely false.
If the primairy KPI is ‘transactions’, there is no impact on average order value, unless mentioned in the learnings.
All A/B tests in Evidoo are also analysed on secondary KPIs, for example 'add to carts'. If we found remarkable results on other KPI’s, check the tab 'learnings'. We also analysed different segments, for example 'new visitors' or 'returning visitors'. If we found remarkable results on specific segments, check also the tab 'learnings'.
All conducted A/B tests in Evidoo comply with:
- conducting sample size and power checks.
- performing the experiment only after an A/A test has been completed.
- implementing Sample Ratio Mismatch (SRM) checks.
- maintaining a minimum runtime of 2 weeks.
- measuring A/B tests only when they are visible to the website visitor, such as counting an A/B test in the middle of the product page only if the visitor has scrolled to that point.