Predict Before Running
Write down what you expect before executing a test, query, benchmark, or probe. A result only teaches when it can disagree with a model.
Test
The question
What do I expect to observe, and why?
Do this
- Make the prediction specific enough to be wrong.
- Include the mechanism that produces the expected result.
- Investigate disagreement instead of editing the prediction after the fact.
Example
- Prediction: two concurrent decrements guarded by
stock > 0will let one buyer succeed and reject the other. Observation: both succeed. The model or query is wrong.
Ask next
- ?What result would refute my model?
- ?Which mechanism produces my prediction?
- ?What changed when prediction and observation differed?