Increasing experimental power with variance reduction at the BBC

This article discusses how the Experimentation team have been accounting for pre-experiment variance in order to increase the statistical power of their experiments

Introduction

In the Experimentation and Optimisation team at the BBC we have the privilege to be working with very large sample sizes, which means we can confidently determine how our variants have performed in a…