Evaluator-Optimizer Workflow
Analogous Procedural
How to study this: Anchor to the writer-editor analogy: generate -> critique -> refine in a loop.
Definition
A workflow where one LLM call generates a response and another provides evaluation and feedback in a loop, iteratively refining the output.
Key points
- Analogous to a human writer iterating with editorial feedback.
- When to use: when there are clear evaluation criteria AND "LLM responses can be demonstrably improved" through iterative refinement.
Why it matters for the exam
- "Evaluator-optimizer" is a named workflow pattern; recognize the generator + evaluator loop and its precondition of clear, actionable evaluation criteria.
Common gotchas
- Start simple; only add agentic complexity when it demonstrably improves outcomes — the loop only pays off when feedback measurably improves responses.
See also
Sources
Referenced by
Your notes optional
🔗 Anchor: Anchor to the writer-editor analogy: generate -> critique -> refine in a loop.
Link this to something you already know:
Saved
Practice questions optional · AI
Generate fresh practice questions about this concept with AI. These are not vault-verified.