Skip to Main Content
Customer Feedback

We love feedback from you on our products and the problems in your daily work that you would like us to solve. Please describe the challenge you're encountering and your desired outcome. Be as detailed as possible.

For technical issues or bugs please head to Support or our Developer Community. You can assign up to 20 votes in total. Thank you for your feedback.

Status explanation: 'Future Consideration' = Continuing to collect further feedback, not planned at this time. 'Investigating' = Prioritized for deeper customer and feasibility investigations ahead of planning development.

Categories Results Page
Created by Guest
Created on Feb 28, 2023

Have the stats page reflect when outlier smoothing will go in effect, through a warning message

Customer: one of our experimenters paused an experiment after 80 minutes when noticing the negative impact on Average Order Value. This was caused by some outliers. When does Optimizely starts applying the outlier smoothing? Maybe some copy around: "it's too early to apply outlier smoothing, wait X hours", could reassure the experimenter here.

Rebecca Carter: values will be appropriately ameliorated within 24 hours and further over the course of a week, per the documentation.As for when and how extreme values are winsorized and adjusted, please see the documentation: https://support.optimizely.com/hc/en-us/articles/4410289414413-How-Optimizely-Web-Experimentation-and-Optimizely-Feature-Experimentation-handle-outliers#heading-1