83 results found
-
Experiment change notification
I would like to have a notification set up for a list of users whenever a new test is set to go live or set to pause.
I am aware that there is an existing approval feature that sends approval request to a list of users. However this is not fit for purpose due to the extra steps created in the publish workflow.
We would like to have a standalone notification feature to allow key stakeholders to be notified of key experiment changes without creating too many extra steps to the current flow of the release.
7 votes -
Experiment Organization Folders
It would be great to be able to create folders in the experiments list to group items together. (Not the sort feature). Often, I have multiple experiments (separate mobile and desktop project that are the same content) - it would be useful to be able to organize these into groups - like in a file folder system. (See mockup)
7 votesWe are planning to redo some parts of the dashboard and the setup of certain things. As a lot of creation things will be moving into the new VE, we will be taking this into account and I will be reaching out when we get to the dashboard part.
-
reusable/transportable variants in web experimentation
As a user building variants in web experimentation,
I would like to be able to save and reuse variants across campaigns, pages and projects while deciding at the campaign/page level whether to allow the selected version to stand apart or be kept in sync (copy local versus linked). Localized from linked save could require a new name but retain the link to the original and allow for a button to copy the parent for resync/update needs.
So that I can more easily have a dev, qa, prod environment setup in web experimentation.
This would likely require that variants live outside…
2 votes -
New Editor -- Have option to position at top of page and control the background of the editir for visibility
Be able to have the editor at the top of the page. And add controls to alter the visual editor's color so that it can be seen easier on white pages. (Mockup uses red for example).
2 votes -
Enhancing A/B Testing with ES11 Modern JavaScript Features
I am proposing that we upgrade to ES11 to stay aligned with the latest JavaScript standards and leverage modern language features such as optional chaining, nullish coalescing, and Promise.allSettled. These enhancements significantly simplify handling complex asynchronous logic, reduce verbose and repetitive code, and improve overall readability and maintainability of our experiment scripts.
While we understand that upgrading is not strictly required to run experiments, adopting ES11 is vital for our growth and development as devs. It enables us to build more robust and reliable A/B tests, accelerate development and iteration cycles, and minimize technical debt. Keeping pace with evolving web…
8 votesThis will become a project setting option.
-
Prioritization of Experiments and Personalization Campaigns
Problem Statement (The "Why"):
I need an easy way to manage the hierarchy of experience delivery across overlapping audiences. Currently, Optimizely allows for experience prioritization within a specific Personalization Campaign, but it lacks a "Global Air Traffic Control" for the entire Web project.
When I have multiple experiments or personalizations live on the same page (e.g., the Homepage), there is no native way to ensure that a high-value visitor (like Enterprise or Mid-Market) is prioritized into a specific experiment before being eligible for a general "All Traffic" A/B test.
Current Workaround (The Pain Point):
To achieve this today, I have…
2 votes -
UX Change: Run Time Calculator
Masorange has requested the run time calculator to be usable without having to create an experiment first. Once an experiment is set up, the calculator can be accessed, but it was flagged as difficult to locate and sometimes they want to use the calculator ahead of set-up. The ask is to move it to a more prominent and easily discoverable location.
3 votes -
Do not remove code when changing activation targets.
Frequently I need to switch my coding / set up from a staging to a production environment. Optimizely warns me and then REMOVES all my code.
This is fine if you are a basic non-technical user.
It would be better if this was an optional change.
Possibly provide a check box and a message in the button (see screenshot) - which would allow me to change the targeting.
8 votes -
Title: Improving Revenue Experiment Accuracy for High-Variance Transactions
Optimizely currently defines revenue outliers using a fixed threshold of mean + 3 standard deviations. This approach works well for classic e-commerce use cases with stable pricing, but it becomes less reliable in scenarios where transaction values are inherently unpredictable.
In donation-based fundraising—and in other models with variable or open-ended transaction values (e.g. donations, contributions, pay-what-you-want, grants, or memberships) - there is no fixed price catalogue. As a result, a small number of very high transactions can disproportionately influence revenue and average gift metrics.
After reviewing this with our analysts and experimentation team, we found that applying a mean +…
1 vote -
Missing preview url in new visual editor
The "share preview" is missing in the new editor. Once the old VE is retired, how do we share the changes with other team members for review?
1 vote -
Delete Change feature in new Visual Editor
Delete change feature is buried in the new UX. Add a "delete change" feature in the main view (suggested at top). See screenshot for visual example
1 vote -
metrics
As an experiment builder and analyst
I would like to create advanced ratio metrics by combining events in the numerator and denominator.
Importantly, if the metric in a ration metric is custom, I need to be able to set custom properties in their definition.
So that I can more easily and accurately define my target metrics without extra work.
Use case: i use a custom property called 'environment' that sets 'dev','qa','prod' so I can distinguish between events in different environments. Without that property, ratio metrics cannot utilize the event.
1 vote -
experiment publish note
AS an experiment builder and program manager,
I WOULD LIKE to be able to add a custom note each time I publish an experiment in both web and feature experimentation and have that note show up in history as part of the list view and details
SO I can more easily find changes in history by seeing the note displayed in the history list and associate changes to ticketing systems when appropriate.
1 vote -
Mutually Exclusive Manager
It would be nice to be able to preset up the Mutually Exclusive experiments without saving them and possibly have it start/stop at a specific time.
1 vote -
property
Today in the Optimizely UI there is a limit of 15 properties per event and we cannot delete properties that have already been added.
At the beginning some of our teams have created events with lots of properties but some were not so relevant in the end, or would be merged with other team's need.
Instead of creating new event each time a property is not necessary (added by error, archived, event reshaped) so that we can have a clean list and not be blocked from adding more properties, we would like to be able to keep existing events, not…
1 vote -
Automatic Screenshot Generation
Create an automatic screenshot generation feature. It would work like this:
When enabled (via a setting that enables a "generate screenshot" button) Optimizely will load each variation - behind the scenes - including the control and create a screenshot based on the target audience. (i.e.: laptop, desktop, tablet, mobile - using average sizes or customer's defined UX design).
The images can be updated manually if needed.
This will save tons of time doing this manually.
1 vote -
See Deployed Variations with Active Tests
I would like to easily see deployed variations from winning tests alongside Active/Running tests. Since deployed variations are only visible in the Concluded section, it's easy for them to get lost.
4 votes -
variation editor option to publish directly
As an experiment builder that generally uses the code editors and who uses the cookie and querystring model for qa and works with intricate code that is load dependent and requires more than a few updates to get working properly within the actual site code
I would like to have the ability to publish the variation update on the variation screen (perhaps a 'publish' button)
So I don't have to save the code changes, then go to main experiment screen and publish and then navigate back to the variation and wait for the page (which will fail because it is…
1 vote -
Edge Delivery with Fastly CDN
I am the Product Manager at Hearst Magazines.
Our current Web Experimentation implementation is set up with the snippet in the <body> tag, which causes significant flicker for experiments involving changes above the fold.
Your new Edge on CDN feature could be a game changer for us. However, the blocker is that we currently use Fastly CDN, which is not supported by your Edge product.12 votes -
Improved QA plug-in
Customers use the Chrome Plug-in often for debugging, QA and forcing themselves into variations. It does not always work, and is pretty limited.
9 votes
- Don't see your idea?