OPTIMIZATION:
CURRENT STATE ASSESSMENTS
WE DELIVER:
- Objective 3rd-party assessment of your optimization program health
- Detailed recommendations on how you can move your program forward
- Prioritization support so you can calendarize those improvement plans
- Implementation and training support for program improvements
SUCCESS STORIES
- Released first production dashboards within 90 days
- Built a center of data excellence.
- Instilled an experimentation culture and optimization capability
- Drove 11% growth of registrations
- 388 net new contacts, opportunity valued at nearly $7.7MM
- Potential of $1MM cost savings in media spend
- 5.4% growth in YoY donations
OUR APPROACH
Our approach to Current State Assessments provides you with the keys to unlock program and process improvements that will help you accelerate and expand the impact of experimentation. Gain a real understanding of where your program can find and implement changes to deliver increasing value.
Our Current State Assessment evaluates your program in the areas of Strategy, People, Process, Technology, Impact, and Culture.
STEP 1:
STEP 2:
STEP 3:
STEP 4:
STEP 5:
CURRENT STATE ASSESSMENT

Progressing from Status Quo to Ideal State

LATEST INSIGHTS:

Sample Ratio Mismatch: What is it? Do I have it? How do I fix it?
Learn from Lukas Vermeer’s conversation with the Test and Learn Community about Sample Ratio Mismatch (SRM) or what he calls “one neat trick to run better experiments.” Here’s a simple tool to test for data quality issues. The Test and Learn Community met with the Director of Experimentation at Booking.com, Lukas Vermeer, on a beautiful

How to A/B Test Statistical Intuition via Simulation. Bonus! Free A/B Test Simulation Tool Included!
Developing a solid intuition about the statistical concepts that drive the interpretation of a basic A/B test is a powerful thing. Explore an A/B test simulator to lock in that intuition!

A Cranium-Expanding Machine Learning Discussion with Matt Gershoff
We recap Matt Gershoff’s machine learning discussion with the Test and Learn Community. Read more to see if you’re ready to invest in machine learning!

How (and Why!) To Monitor Your Tests
Common Mistakes When Running A/B Tests There are a few. When running a test, there are multiple places where one can misstep to put the test, and the program, in jeopardy: Peeking at your test. If you have set up a beautiful fixed horizon A/B test, but then you peek for results and call it