US Patent 11475095 Statistics acceleration in multivariate testing

A method includes determining a plurality of epochs from a timeline of an experiment, wherein each of the plurality of epochs corresponds to a constant traffic allocation. The method further includes calculating, by a processing device, first and second mean values corresponding to a baseline of the experiment and a variation of the experiment for each epoch, respectively. The method further includes determining, for each epoch, a difference between the first mean value and the second mean value to generate a plurality of differences. The method further includes calculating, by the processing device, a weighted sum of the plurality of differences to generate a final difference in mean values.