Что такое аналитика – средство для убеждения, метод принятия решений или данные для планирования? Леонид Кулигин из Google учит правильно работать с данными и рассказывает про частые ошибки в проведении экспериментов. Если вы все еще думаете, что провести A/B тест легко и просто, то этот выпуск для вас!
Полезные ссылки:
- Cassie Kozyrkov, Chief Decision Scientist, Google - speaking at the Chief Data Officer Summit at DATAx New York 2018 - Making Data Useful www.youtube.com/watch?v=hSHzQbpcxak
Darrell Hugg How to Lie with Statistics www.amazon.com/gp/product/B00351…kinw_myk_ro_title
Alex Reinhart Statistics Done Wrong: The Woefully Complete Guide
www.amazon.com/gp/product/B00UMA…kinw_myk_ro_title
Evan Miller How Not To Run an A/B Test www.evanmiller.org/how-not-to-run-an-ab-test.html
Emily Robinson Guidelines for A/B Testing hookedondata.org/guidelines-for-a…=Data_Elixir_194
Anirban Deb, Suman Bhattacharya, Jeremy Gu, Tianxia Zhou, Eva Feng, and Mandie Liu Under the Hood of Uber’s Experimentation Platform eng.uber.com/xp/
Ron Kohavi et. al. Seven Rules of Thumb for Web Site Experimenters www.exp-platform.com/Documents/2014…lesOfThumb.pdf
Jan Overgoor Experiments at Airbnb medium.com/airbnb-engineering/…airbnb-e2db3abf39e7
H. Hohnhold Focusing on the Long-term: It’s good for Users and Business ai.google/research/pubs/pub43887
P. Dmitriev et. al A dirty dozen: 12 Common Metric Interpretation Pitfalls in Online Controlled Experiments www.kdd.org/kdd2017/papers/view…ls-in-online-contro
D. Reiley et. al Here, There, and Everywhere: Correlated Online Behaviors Can Lead to Overestimates of the Effects of Advertising www.ssrn.com/abstract=2080235
Sangho Yoon Designing A/B tests in a collaboration network ai.google/research/pubs/pub46616
Misadventures in experiments for growth
www.unofficialgoogledatascience.com/2019/04…th.html