- 67% of customers who had a great experience with an employee said they would buy again from that organisation, compared to 11% who had a bad experience.
- 63% of customers who had a great experience with an employee said they would recommend that organisation, compared to 10% who had a bad experience.
Investing in service strategies through A/B testing enhances retention rates, increasing revenue.
The methodology
The following outlines the recommended steps to implement this methodology:
- Identify and deploy a Service Improvement Strategy ā This can be any targeted service enhancement (such as reducing call response times to under one minute) that is expected to impact customer experience positively.
- Define and isolate your test segment ā Choose a representative customer segment (e.g., 10% of the customer base) to apply this new service strategy, ensuring a control group remains unaffected for comparison.
- Implement and monitor your service strategy ā Execute the strategy for the test group, ensuring consistent application (e.g., all calls answered in under one minute), then track retention and churn metrics over time for both test and control groups.
- Analyse the correlation ā Identify links between improved service outputs (e.g., reduced call response time) and changes in retention/churn rates. Demonstrate how the service strategy led to increased customer retention and reduced churn.
An example of how an organisation might use the Retention and A/B Testing metric
A telecom provider noticed long wait times were driving customer churn. To test a solution, they prioritised 10% of customers, ensuring calls were answered within 60 seconds, while a control group experienced standard wait times.
After six months, the test group saw a 12% increase in retention, an 8% drop in churn, and CSAT scores rose by 15 points. Using CLV data, the company calculated an additional Ā£5M in revenue from retained customers.
TEST
Things to consider
Choose a service strategy that directly impacts customer experience. This can include: reducing call response times, enhancing self-service processes, personalised support, training and upskilling agents. You need to isolate one area that is easily connected to changes in your service strategy.
To implement this method your organisation needs a strong infrastructure to measure outputs to any changes made, such as when service initiatives are tested in specific locations or operations, with performance compared to similar areas.
Ensure your test group is a meaningful portion of your customer base (e.g., 10%) while keeping a control group for comparison.
Apply the improvement uniformly to avoid inconsistencies that could skew results.
Calculate revenue changes using Customer Lifetime Value (CLV) to determine ROI.