Skip to content

Feature Experimentation

Categories

JUMP TO ANOTHER FORUM

25 results found

  1. Depending on the number of teams operating in FX, tech debt accumulates quickly if not managed. Help customers determine how and when to consider tech debt in their FX endeavors.

    Some customers struggle with outdated flags that have not been used in a while, but it is hard for them to determine which ones are outdated.

    Help customers understand how their users are reacting to a new feature rollout.

    4 votes
    New  ·  3 comments  ·  Admin →
    How important is this to you?
  2. When the platform says another 50k users to reach significance, could a date be added? E.g. it has taken 3 weeks to get to 25k so give the date in 3 weeks as the date when the 50k will be reached

    3 votes
    New  ·  0 comments  ·  UX  ·  Admin →
    How important is this to you?
  3. Unfortunately, in the new Flags UI the JIRA Integration is no longer available (as it is not yet migrated). My Idea Post is about requesting its availability.

    In our Company we have a very close relationship between JIRA Tickets + Experiment Rules (1:1). That's why, this integration is/was helpful to relate Code/Work accordingly.

    Many thanks in advance
    Michael

    2 votes
    New  ·  0 comments  ·  SDKs  ·  Admin →
    How important is this to you?
  4. In the overview page of metrics hub, I would like to filter by linked event. So I can see all the existing metrics linked to a specific event. Currently it's only possible to filter by metrics name, id or description.

    2 votes
    New  ·  0 comments  ·  Admin →
    How important is this to you?
  5. Add a "status changed" date to the FX Flags overview page. Because currently, there is a "created" and "modified" column. However, "Modified" refers to any changes, and there is no easy way to see when a status was changed, so when a rule was changed to its current state (started/paused/concluded)... it would be valuable information for the customer just within the FX UI.

    Additional context: https://jira.sso.episerver.net/browse/DHK-2914?focusedId=2087943&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-2087943

    4 votes
    New  ·  0 comments  ·  UX  ·  Admin →
    How important is this to you?
  6. It is sometimes hard to trigger a test variant when deeper into a flow. Could a bookmark be created to easily trigger a test on any given page?

    2 votes
    New  ·  0 comments  ·  UX  ·  Admin →
    How important is this to you?
  7. Currently, user profile service (UPS) maintains a map of user IDs to the experiment IDs they've previously been exposed to and the variation ID they received. The SDKs continuously append to the UPS without any cleanup, even if an experiment has been concluded and is no longer relevant.

    Customers have in the past implemented diff logic to compare the live experiment IDs in the datafile vs UPS and remove experiment IDs from the UPS that are no longer in the datafile.

    2 votes
    New  ·  0 comments  ·  SDKs  ·  Admin →
    How important is this to you?
  8. I know that Optimizely tries to keep bucketing consistent when traffic allocation and or distribution changes.
    It would be great to be able to see the bucketing allocation (eg. 1-5000 for A, 5001-10000 for B) in the interface.
    In this example it is simple, but when ramping up (and possibly at the same time changing the distribution of traffic) it would be great to be able to verify via the interface which buckets are being set.
    I am aware of Customer Profile Service but I see this as independent from that.

    1 vote
    New  ·  0 comments  ·  UX  ·  Admin →
    How important is this to you?
  9. I know that Optimizely tries to keep bucketing consistent when traffic allocation and or distribution changes.
    It would be great to be able to see the bucketing allocation (eg. 1-5000 for A, 5001-10000 for B) in the interface.
    In this example it is simple, but when ramping up (and possibly at the same time changing the distribution of traffic) it would be great to be able to verify via the interface which buckets are being set.
    I am aware of Customer Profile Service but I see this as independent from that.

    1 vote
    New  ·  0 comments  ·  UX  ·  Admin →
    How important is this to you?
  10. As of now, in Feature Experimentation, if a variant performs (very) bad, there is no way to deactivate it or set its behavior back to baseline without needing to create a new rule.
    This of course slows down experimentation speed.
    I do understand that the results of that variant are not usable after setting a variant's behavior back to baseline behavior. However, that is not the issue. The goal is to simply be able to continue letting the test run while disabling a bad-performing variant.

    1 vote
    New  ·  0 comments  ·  UX  ·  Admin →
    How important is this to you?
  11. To enable FX personalization, be able to pull audiences from other tools.

    3 votes
    New  ·  0 comments  ·  Admin →
    How important is this to you?
  12. Similar to Optimizely Web, capture basic segmentation (browser, device, ...) out of the box.

    3 votes
    New  ·  0 comments  ·  SDKs  ·  Admin →
    How important is this to you?
  13. I would like the ability to create folders within projects to organize our work. This would allow users to organize work by developer or by area of the site.

    1 vote
    New  ·  0 comments  ·  UX  ·  Admin →
    How important is this to you?
  14. If Optimizely's CDN goes down or is inaccessible, the SDKs don't have a default fallback mechanism to evaluate feature flags without access to the datafile hosted on the CDN.

    It's possible to initialize the SDK with a cached datafile, but that requires custom logic. Ideally, Optimizely could provide a default mechanism to provide a fallback datafile (e.g., a "relay proxy" service that caches the datafile, or a default mechanism within the SDKs).

    1 vote
    New  ·  0 comments  ·  SDKs  ·  Admin →
    How important is this to you?
  15. It would be great to have some kind of filters that allow a deeper dive into data. So if we wanted to see how many people bought a licence AFTER triggering a specified conversion

    1 vote
    New  ·  0 comments  ·  UX  ·  Admin →
    How important is this to you?
  16. Make change to flag (e.g., toggle on/off) based on event from external system (e.g., APM alert).

    2 votes
    New  ·  0 comments  ·  Admin →
    How important is this to you?
  17. It's hard to manage flags/tests at scale without being able to group them and capture more metadata on them.

    2 votes
    New  ·  0 comments  ·  Admin →
    How important is this to you?
  18. Help customers understand how flags/experiments are affecting site performance.

    1 vote
    New  ·  1 comment  ·  Admin →
    How important is this to you?
  19. Hello!

    We very much appreciate the arrival of ratio metrics. However, they do provide limited value to us as long as Custom Event properties are not usable for either numerator or denominator.

    It would be awesome to see that added.

    Role: I am the Team Lead for our experimentation center-of-excellence and infra team.

    1 vote
    New  ·  0 comments  ·  UX  ·  Admin →
    How important is this to you?
  20. Customers want to have metrics they track in their analytics in Optimizely. Today they have to manually add new event instrumentation. Would be great to integrate with other analytics and import their event tracking in Optimizely (ie. similar to Segment integration)

    1 vote
    New  ·  0 comments  ·  Admin →
    How important is this to you?
← Previous 1
  • Don't see your idea?