Let the Bandit Decide: Optimization with Machine Learning
Let the Bandit Decide: Optimization with Machine Learning We’ve all heard of the one-armed bandit: the slot machine. The consummate victor engineered to best all players. But cue the lone tumbleweed and standoff music, because it’s high noon, and a stranger’s come...
Test and Learn Community — Join the conversation!
Test and Learn Community — Join the conversation! Several years ago, in a small conference room with a view of the Pacific, I was talking optimization with 17 others at the XChange conference. The conversation was lively, educational, and zingy in that way that...
Sample Size Calculation — Myth Buster Edition
It’s a dangerous question to answer, but are the testing results statistically significant?
Multivariate Testing 101
There’s a lot to learn about A/B and multivariate testing, and a lot of debate about whether (and when) to use each. But don’t fret! This post seeks to clarify issues surrounding both…
Search Discovery Adds Dynamic Duo to Optimization Team
“A true optimization program does not actually test everything; it optimizes everything.”
Optimizing Ideation: Using Data to Drive Better Brainstorming
Using analysis to identify problems is great, but it will never make you better! Learn what happens when we instead use data and brainstorming to identify problems and suggest solutions.
Agile for Optimization…or Maybe Not?
See why organizations realize there is a great need for process in order to organize and provide quality control for testing programs.
Objective Approaches to Test Prioritization
If you’ve got more ideas than you have people to test them, you’re not alone. Learn how to make the most of limited resources and ensure that ideas are being prioritized correctly.