Mixpanel just put Experiments and Feature Flags on its Free and Growth plans.
Free: unlimited experiments, 1k monthly experiment users, up to 10 active flags.
Growth: 5k monthly experiment users, up to 50 active flags.
For a lot of SaaS and product teams, cost is no longer the reason not to test.
The new bottleneck is the event data underneath.
An experiment readout is only as trustworthy as the events feeding it. Before running your first test, I'd check:
1. Your success metric is a clean, deduplicated event. If "Signup Completed" fires from both the client and the server, conversion looks inflated in every variant and real differences get muddied.
2. Identity is stitched correctly. If identify isn't called at signup and login, one person can show up as two users.
3. Events carry the properties you'll want to segment by (plan, platform, acquisition source) from day one. Adding them later doesn't fix past data.
4. You know how much traffic ad blockers remove. Mixpanel also released First-Party Domains in August, which routes tracking through a subdomain you control (currently on Enterprise). On other plans, a proxy setup is the usual route.
5. Your Lexicon is documented, so whoever reads the results knows exactly what each event means.
Cheap experiments on messy data just produce confident wrong answers faster.
Planning to switch on Mixpanel Experiments and want your tracking plan checked first? Comment "Mixpanel" or send me a DM, and I'll review your event setup with you.
#Mixpanel #ProductAnalytics #Experimentation #SaaS #Analytics
Read more from Anthropic: