Patent 11593667 was granted and assigned to Optimizely on February, 2023 by the United States Patent and Trademark Office.
A method of executing an A/B test includes, during execution of the A/B test, determining, by a processing device using a sequential frequentist test, that a sample ratio mismatch has occurred, wherein the sample ratio mismatch is determined before the A/B test ends the execution. The method further includes, in response to the determining, ending the execution of the A/B test before a previously scheduled end of the A/B test.