Loved the video. So informative. One question: When you decide Test pool size, how do they get allocated for Test groups (Test group A and Test group B)? Example you have given, out of 10k, 3k will be the test group. So are both Test groups A and B divided 15% each and winning criteria will automatically will be sent to the 70% non-test group?
Hey Kasey, you're speaking of bigger Subscriber sizes of at least 1k+ People . But what if the subscriber size is really small, let's say 50 people only. Do you think that it's even worth to A/B-Test at that stage? Or do you think it isn't worth the effort because there is no statistical evidence due to the small size? Love your videos and would also love a quick response!😀
hey Luca! With an audience size of below 1,000 subscribers, A/B testing is not worth the effort because there is no statistical evidence due to the small size, as you've rightfully mentioned. I wouldn't worry too much about A/B testing until you're at about 3,000 or even 5,000 subscribers. Your attention would be better spent at growing your audience and creating great content for your subscribers. With a smaller audience, you could do "informal" A/B testing where you're not technically splitting the audience, but you're sending different types of content and see which topics resonate best over time.
nice video. thanks. I have a question: the 30% of the email receivers might take time to open their email so would the 70% of the people who are supposed to get a winning variant of the test email, would have to wait till the result compiles?
@@zakariaabali4750 are you familiar with the iOS15 update? I talk more about it in this video: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-zmY0LK3Wu7Q.html
