Georgi Georgiev – Medium

Georgi Georgiev

Featured Book

Statistical Methods in Online a/B Testing: Statistics for Data-Driven Business Decisions and Risk Management in E-commerce

Statistical Methods in Online a/B Testing: Statistics for Data-Driven Business Decisions and Risk Management in E-commerce

A comprehensive guide to statistics and its applications in online controlled experiments (a.k.a. A/B tests).

2019

Georgi Zdravkov Georgiev

Georgi Zdravkov Georgiev

Stories

Georgi Georgiev

The Business Value of A/B Testing

Does it pay off to experiment versus shipping as fast as possible (without testing)?

Oct 22

The Business Value of A/B Testing

Oct 22

Georgi Georgiev

Q&A on Sequential Statistics in A/B Testing

Sequential statistics are gathering interest and there are more and more questions posed by CROs looking into the matter. For this article…

Aug 30, 2023

Q&A on Sequential Statistics in A/B Testing

Aug 30, 2023

Georgi Georgiev

Sequential Testing is About Improving Business Returns

A central feature of sequential testing is the idea of stopping “early”, as in “earlier compared to an equivalent fixed-sample size test”…

May 1, 2023

Sequential testing versus fixed-sample testing

May 1, 2023

Georgi Georgiev

False Positive Risk in A/B Testing

Have you heard how there is a much greater probability than generally expected that a statistically significant test outcome is in fact a…

Apr 19, 2023

False Positive Risk in A/B Testing

Apr 19, 2023

Georgi Georgiev

How to Run Shorter A/B Tests?

Running shorter tests is key to improving the efficiency of experimentation as it translates to smaller direct losses from testing inferior…

Dec 2, 2022

How to Run Shorter A/B Tests?

Dec 2, 2022

Georgi Georgiev

Statistical Power, MDE, and Designing Statistical Tests

One topic has surfaced in my ten years of developing statistical tools, consulting, and participating in discussions and conversations with…

Oct 25, 2022

Statistical Power, MDE, and Designing Statistical Tests

Oct 25, 2022

Georgi Georgiev
in
Towards Data Science

What Can Be Learned From 1,001 A/B Tests?

A meta-analysis with insights into test duration, sample size, lift, power, confidence thresholds, and the performance of sequential tests.

Oct 18, 2022

What Can Be Learned From 1,001 A/B Tests?

Oct 18, 2022

Georgi Georgiev
in
Experience Stack

Top Misconceptions About Scientific Rigor in A/B Testing

It is high time to dispense with the myth that “statistically rigorous A/B tests are impractical”.

Jan 20, 2022

Top Misconceptions About Scientific Rigor in A/B Testing

Jan 20, 2022

Georgi Georgiev
in
Towards Data Science

Improve Your A/B Tests with 9 Lessons from the COVID-19 Vaccine Trials

What practitioners of online experimentation can learn and generalize from a complex process

Jan 12, 2022

Improve Your A/B Tests with 9 Lessons from the COVID-19 Vaccine Trials

Jan 12, 2022

Georgi Georgiev
in
Towards Data Science

The Perils of Using Google Analytics User Counts in A/B Testing

Inaccuracies in the user counts provided by Google Analytics can have disastrous effects on the validity of your statistical analyses.

Oct 19, 2020

Absolute Difference in Proportions p-values from the HLL++ A/A Tests

Oct 19, 2020

Georgi Georgiev

Georgi Georgiev

Book Author

Applied statistician and optimizer by calling. Author of “Statistical Methods in Online A/B Testing”. Founder of Analytics-Toolkit.com and GIGAcalculator.com.

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams