OPTIMIZATION:
Conversion Rate Optimization Training
WE DELIVER:
Introduce new advanced qualitative and quantitative research methods to supplement test ideation
Assist with key prioritization methodologies to allow the team to have the biggest impact on program ROI
Enhance test design and test planning to complement the planning roadmap, setting clear expectations, and aim to increase testing validity in experimentation
Introduce test setup and coding best practices to ensure a robust and successful test
Train your team on how to use a newly acquired optimization tool
Train new and existing team members throughout your organization who are interested in getting started with optimization
Teach advanced optimization concepts and how to implement them
Inform on best practices when analyzing optimization campaigns, especially on different types of experiments conducted
SUCCESS STORIES
- Released first production dashboards within 90 days
- Built a center of data excellence.
- Instilled an experimentation culture and optimization capability
- Drove 11% growth of registrations
- 388 net new contacts, opportunity valued at nearly $7.7MM
- Potential of $1MM cost savings in media spend
- 5.4% growth in YoY donations
OUR APPROACH
STEP 1:
STEP 2:
STEP 3:
STEP 4:
STEP 5:
LATEST INSIGHTS:

Sample Ratio Mismatch: What is it? Do I have it? How do I fix it?
Learn from Lukas Vermeer’s conversation with the Test and Learn Community about Sample Ratio Mismatch (SRM) or what he calls “one neat trick to run better experiments.” Here’s a simple tool to test for data quality issues. The Test and Learn Community met with the Director of Experimentation at Booking.com, Lukas Vermeer, on a beautiful

How to A/B Test Statistical Intuition via Simulation. Bonus! Free A/B Test Simulation Tool Included!
Developing a solid intuition about the statistical concepts that drive the interpretation of a basic A/B test is a powerful thing. Explore an A/B test simulator to lock in that intuition!

A Cranium-Expanding Machine Learning Discussion with Matt Gershoff
We recap Matt Gershoff’s machine learning discussion with the Test and Learn Community. Read more to see if you’re ready to invest in machine learning!

How (and Why!) To Monitor Your Tests
Common Mistakes When Running A/B Tests There are a few. When running a test, there are multiple places where one can misstep to put the test, and the program, in jeopardy: Peeking at your test. If you have set up a beautiful fixed horizon A/B test, but then you peek for results and call it