Context Evaluation
When context is changed, evaluate its effect with both quantitative and qualitative measures.
Core Metrics
Section titled “Core Metrics”- Information density: effective information per token.
- Verbosity: excess wording that can reduce attention on critical details.
- Correctness: whether system outputs include expected facts and decisions.
Evaluation Notes
Section titled “Evaluation Notes”- Evaluate before broad rollout of major context changes.
- Track metric movement over time to detect drift.
- Pair metric scores with scenario-based examples so changes remain interpretable.