Georgi Georgiev – Medium

Georgi Georgiev

Featured Book

Statistical Methods in Online a/B Testing: Statistics for Data-Driven Business Decisions and Risk Management in E-commerce

Statistical Methods in Online a/B Testing: Statistics for Data-Driven Business Decisions and Risk Management in E-commerce

A comprehensive guide to statistics and its applications in online controlled experiments (a.k.a. A/B tests).

2019

Georgi Zdravkov Georgiev

Georgi Zdravkov Georgiev

Stories

Georgi Georgiev

Q&A on Sequential Statistics in A/B Testing

Sequential statistics are gathering interest and there are more and more questions posed by CROs looking into the matter. For this article…

9 min readAug 30, 2023

--

Q&A on Sequential Statistics in A/B Testing

--

Georgi Georgiev

Sequential Testing is About Improving Business Returns

A central feature of sequential testing is the idea of stopping “early”, as in “earlier compared to an equivalent fixed-sample size test”…

5 min readMay 1, 2023

--

Sequential testing versus fixed-sample testing

--

Georgi Georgiev

False Positive Risk in A/B Testing

Have you heard how there is a much greater probability than generally expected that a statistically significant test outcome is in fact a…

30 min readApr 19, 2023

--

False Positive Risk in A/B Testing

--

Georgi Georgiev

How to Run Shorter A/B Tests?

Running shorter tests is key to improving the efficiency of experimentation as it translates to smaller direct losses from testing inferior…

7 min readDec 2, 2022

--

How to Run Shorter A/B Tests?

--

Georgi Georgiev

Statistical Power, MDE, and Designing Statistical Tests

One topic has surfaced in my ten years of developing statistical tools, consulting, and participating in discussions and conversations with…

17 min readOct 25, 2022

--

Statistical Power, MDE, and Designing Statistical Tests

--

Georgi Georgiev
in
Towards Data Science

What Can Be Learned From 1,001 A/B Tests?

A meta-analysis with insights into test duration, sample size, lift, power, confidence thresholds, and the performance of sequential tests.

15 min readOct 18, 2022

--

1

What Can Be Learned From 1,001 A/B Tests?

--

1

Georgi Georgiev
in
Experience Stack

Top Misconceptions About Scientific Rigor in A/B Testing

It is high time to dispense with the myth that “statistically rigorous A/B tests are impractical”.

11 min readJan 20, 2022

--

Top Misconceptions About Scientific Rigor in A/B Testing

--

Georgi Georgiev
in
Towards Data Science

Improve Your A/B Tests with 9 Lessons from the COVID-19 Vaccine Trials

What practitioners of online experimentation can learn and generalize from a complex process

14 min readJan 12, 2022

--

Improve Your A/B Tests with 9 Lessons from the COVID-19 Vaccine Trials

--

Georgi Georgiev
in
Towards Data Science

The Perils of Using Google Analytics User Counts in A/B Testing

Inaccuracies in the user counts provided by Google Analytics can have disastrous effects on the validity of your statistical analyses.

13 min readOct 19, 2020

--

Absolute Difference in Proportions p-values from the HLL++ A/A Tests

--

Georgi Georgiev
in
Towards Data Science

Has Interest in Data Science Peaked Already?

Analysis of 10 years of search interest trends in data science related topics: fastest growing areas, growth patterns, and correlations.

8 min readJun 8, 2020

--

1

Growth trends of data science search terms relative to Jun 2010

--

1

Georgi Georgiev

Georgi Georgiev

Book Author

Applied statistician and optimizer by calling. Author of “Statistical Methods in Online A/B Testing”. Founder of Analytics-Toolkit.com and GIGAcalculator.com.

Following

Help
Status
About
Careers
Blog
Privacy
Terms
Text to speech
Teams