A/B testing new eCommerce recommendation engine
Question
Suppose you're working for an eCommerce company like Amazon. Your team is testing a new algorithm to generate recommended products for users. You've been tasked with setting up an A/B test to help measure the impact of the change, and decide whether or not to roll out the new recommendation engine more widely.
Walk through the steps you would take to set up the A/B test, and highlight some examples of potential pitfalls/risks in your analysis.