Expand AB testing for email features
Would like to be able to create multiple alternative emails and then measure results and have one version automatically chosen after a set sample size is reached based on the more opens or the more clicks or even better the more visits to a specific page (i.e. form confirmation) to show measure conversions.
We’ve added an AB Split action and you can learn how to use it to do an email AB split test here: https://support.autopilothq.com/hc/en-us/articles/206308443-Action-AB-Split. We’re actively reviewing your feedback on further AB testing features. Thanks for all of your input.
-
Anonymous commented
The feature shouldn't just be a funnel to a specific branch of a journey. An A/B Testing feature should not only make it easy to setup and specify which variant should be measured, but it should measure, analyze results and declare a winner. It should also have both an automatic trigger of test winner to the balance of segments being mailed or the option to be able to declare a manual winner for later.
-
AdminChris Sharkey (CTO, Autopilot) commented
We’ve added an AB Split action and you can learn how to use it to do an email AB split test here: https://support.autopilothq.com/hc/en-us/articles/206308443-Action-AB-Split. We’re actively reviewing your feedback on further AB testing features. Thanks for all of your input.
-
Leonne commented
This feature is great, but would be even better if the rest of the contacts receive the winning email automatically instead of the having to change it manually.
-
Sean Whiteley commented
This feature sounds great...a nice baby step would be to easily see the open/click/conversion rates on live view. You have to click into each email to see the results! Hard to remember what it is or to compare the results!
-
Daniel Chalef commented
At a minimum, I'd like to see a single report for all emails in a test, highlighting the winning content. Indicating whether a result is significant would be nice too.
Flipping backwards and forwards between reports is a bit tedious.
-
AdminChris Sharkey (CTO, Autopilot) commented
Hi there, if you check out https://autopilothq.zendesk.com/hc/en-us/articles/206308443-Action-AB-Split towards the bottom I've added a video walking you through how to duplicate your email so you can test something specific, like the subject line. Hope this helps!
-
Anonymous commented
That's a great feature, thanks Peter. However, it would be very useful to have A/B testing for individual features such as the Subject line or images or body of text, rather than just the whole email.
-
Phil commented
Great feature. 2 elements to this: A/B testing of subject lines sent to group (20% usually) of full send - remainder automatically sent based on winner after x hours.
Then as Andy describes, a deeper behavioral A/B test of content based on actions post-open on specific pages.
Thanks!
-
Andy Morris commented
Agreed justin
-
Justin Holland commented
This could also be architected at the journey level which probably prove more flexible.
-
Anonymous commented
Yes! Super Important