What type of experimental design is an A B test?
A/B testing, also known as split testing, refers to a randomized experimentation process wherein two or more versions of a variable (web page, page element, etc.) are shown to different segments of website visitors at the same time to determine which version leaves the maximum impact and drives business metrics.
When should AB tests end?
Keep going until you reach 95-99% statistical significance. Make sure your sample size is large enough (at least 1,000 conversions). Don't stop running your test too soon. Aim for 1-2 weeks.