7.4 Module 7 · Evaluation & Observability

Trajectory vs Final-Response Evaluation

Score the same agent run two ways. Discover how trajectory quality and final-response accuracy can diverge, and what that means for your evaluation strategy.

Trajectory Scorer Final-Response Comparator

Trajectory Scorer

Rate each step in the agent's reasoning trajectory. Did it take the right actions in the right order? Score each step, then compare with the final-response evaluation below.

Agent Task
Trajectory Score
--

Final-Response Comparator

Compare the agent's final output against the expected answer. Score accuracy, completeness, and relevance independently of how the agent got there.

Agent Output
Expected Answer
Accuracy
Completeness
Relevance
Final-Response Score
--

Divergence Dashboard

See how trajectory and final-response scores compare. Cases where they diverge reveal critical blind spots in single-method evaluation.

Key insight: Rate both scorers above to see how the two evaluation methods compare. Divergence between trajectory and final-response scores is where the most important lessons hide.