Introduction to comparing model responses
Compare answers against explicit requirements, factual accuracy and uncertainty.
Annotator · Original teaching guide
What to learn and do
Turn requirements into checkable criteria, assess each answer separately, then cite passages to explain the comparison. Fluency does not cancel factual errors, and preference does not justify unrequested criteria.
Original teaching example
Original example: summarize three supplied facts in two sentences. A adds a date absent from the source; B preserves all three facts and the sentence limit. Under these requirements, B is better supported.
Counterexample and correction
Counterexample: preferring A simply because it is longer. Correction: identify the unsupported date and the evidence requirement it violates.
When evidence is uncertain
If an external fact lacks a reliable source, mark it for verification; confident wording is not verified evidence.
Next step
Explain in your own words which judgment is supported and which remains uncertain, then continue to practice. Practice requires registration or sign-in. Reading this introduction is not course completion, assessment success or professional certification.
Continue to learning and practice