Product Feedback: Setting up "Average Time" or "Median Time" A/B Test
requester jake.schlack@dat.com
Type of issue: Feature Experimentation
Jake Schlack sent a feedback.
Description: Good afternoon,
My team and I would like to run an A/B test that measures the median time that occurs between two tracking events in our product.
Based on your documentation, it looks like we can create a "value" property that tracks the time between these two events (in the second, concluding event.
My question is: How do we then set up a "Total Value" A/B Test that looks at a metric other than counts or sums? In this case, we want to use a median, but could use average if median is not possible.
While your "Total Value" documentation suggests that Optimizely can be used to measure "Article page load time" and other similar metrics, it does not actually show how to set these metrics up. For "Article page load time", would one set up a "Decrease in total value per visitor for [event]" metric? What measure would Optimizely actually be using to measure that decrease: sum, average, median, etc.? Is there a way to change that in Optimizely, or is that something that our tracking needs to account for elsewhere?
Apologies if this message is confusing. Please let me know if you have any clarifying questions. Also happy to jump on a call to explain what I am trying to do.
User email: jake.schlack@dat.com
User id: 5lxk1PjURheCWqJ17_nhTQ
Account: DAT Solutions
Account id: 57bf1781-7260-d3bf-a925-74d9d65f3cf0
https://u44077338.ct.sendgrid.net/wf/open?upn=u001.UBmjMNjeoRXVAL5fZIj9r-2BwTWSmrIurBSeJzOMyEw1fTSPxXUpbKnEl0EWfaLcdzSWgPc6aRI2qA6TrfDDxAa0EaRMsM6VPM40QaFh5K7mILVG5eOsMA7zM3-2FIA4YGxIzsDVoJzEoj5Ha24-2F1NOv3fO1B2Ty8LBcbZzCiPFeCagAnLVSFrw1M0B8vYxG9NtD6eEaH-2FBvhN10FL-2BPYCspKj6qu751-2Fm-2BakCmn3FMuNcv8rVJPLaSK-2FXSjXEbqyY5m