Calculating ‘Truth’ (while avoiding existential crises)
How can you calculate something unknowable like “Truth”? Statistics has a way to estimate that!
Don’t Run with Scissors! How to Safely Calculate Program ROI
When we can understand the statistics and the risks, we’ll be better able to responsibly calculate and communicate program impacts.
Adobe Target Standard v. Premium: Help me choose!
Adobe Target Standard v. Premium: Help me choose! Confused about whether Adobe Target Standard or Premium is best for you? Read on for use case clarity. Finally!Skip ahead if you must: IntroductionTL;DRExperience TargetingAuto-AllocateAuto-TargetAutomated...
Let the Bandit Decide: Optimization with Machine Learning
Let the Bandit Decide: Optimization with Machine Learning We’ve all heard of the one-armed bandit: the slot machine. The consummate victor engineered to best all players. But cue the lone tumbleweed and standoff music, because it’s high noon, and a stranger’s come...
Test and Learn Community — Join the conversation!
Test and Learn Community — Join the conversation! Several years ago, in a small conference room with a view of the Pacific, I was talking optimization with 17 others at the XChange conference. The conversation was lively, educational, and zingy in that way that...
Sample Size Calculation — Myth Buster Edition
It’s a dangerous question to answer, but are the testing results statistically significant?
Multivariate Testing 101
There’s a lot to learn about A/B and multivariate testing, and a lot of debate about whether (and when) to use each. But don’t fret! This post seeks to clarify issues surrounding both…
Search Discovery Adds Dynamic Duo to Optimization Team
“A true optimization program does not actually test everything; it optimizes everything.”
Optimizing Ideation: Using Data to Drive Better Brainstorming
Using analysis to identify problems is great, but it will never make you better! Learn what happens when we instead use data and brainstorming to identify problems and suggest solutions.