Optimizely for Web Well Suited to Marketing Use Cases.
May 06, 2024

Optimizely for Web Well Suited to Marketing Use Cases.

Anonymous | TrustRadius Reviewer
Score 6 out of 10
Vetted Review
Verified User

Overall Satisfaction with Optimizely Web Experimentation

A/B testing of various web experiments on our semi-static published site and our dynamic, complex app focuses on UI changes within a page; in my opinion, the optimized is poorly suited for true feature flag functionality.

Pros

  • A/B testing on simple UI changes within one page.

Cons

  • Feature flag management of A/B testing of multi-page web flows.
  • Integration with Segment is extremely poor, especially when integrating front-end and back-end signals.
  • Integration with Segment is extremely poor when tying into the web; many excuses are given by Optimizely's advanced tech teams.
  • Several experiments with limited scope change show up to 1% revenue improvement.
  • Large-scale experiments with multiple page flows have improved business by up to 5%, but they required significant work on the backend's data analysis using Segment to understand what actually happened.
I have to write tons of Optimizely-specific code to get anything meaningful done; challenging work done on Segment to unify across all systems is not directly usable by Optimizely if they are back-end events, making the overall experience poor.
Simple A/B testing of small UX/CSS changes on a single page or URL split testing of two totally static pages works excellent. Anything dynamic tied to the back end works poorly.
Marketing mostly focuses on small changes to static sites, which is well suited to Optimizely.

Do you think Optimizely Web Experimentation delivers good value for the price?

Yes

Are you happy with Optimizely Web Experimentation's feature set?

No

Did Optimizely Web Experimentation live up to sales and marketing promises?

No

Did implementation of Optimizely Web Experimentation go as expected?

No

Would you buy Optimizely Web Experimentation again?

No

A/B testing of a simple UX change or wording change on a single page, where there can be many entry and exit points; crude feature flag support for feature testing if you're willing to write significant, complex, and difficult-to-debug and maintain code unique to Optimizely alongside all your 90+ other SaaS tools.

Optimizely Web Experimentation Feature Ratings

a/b experiment testing
6
Split URL testing
6
Multivariate testing
1
Multi-page/funnel testing
1
Cross-browser testing
6
Mobile app testing
6
Test significance
6
Visual / WYSIWYG editor
1
Advanced code editor
1
Preview mode
4
Test duration calculator
1
Experiment scheduler
6
Experiment workflow and approval
6
Dynamic experiment activation
1
Client-side tests
1
Server-side tests
1
Mutually exclusive tests
1
Standard visitor segmentation
1
Behavioral visitor segmentation
1
Traffic allocation control
7
Website personalization
1
Form fill analysis
1
Goal tracking
1
Test reporting
1
Results segmentation
1
CSV export
1

Comments

More Reviews of Optimizely Web Experimentation