Skip to content
Astera Technology

Evaluate answers when approved sources disagree

Use unresolved contradictory extracts to test whether an assistant shows the conflict and follows the supplied ownership rule.

Download complete case notes and answer keys ↓

Distinguish precedence from unresolved conflict

Original synthetic conflicting extracts
Supplied evidenceQuestion or inputExpected result
Approved FAQ: closes 17:00; approved timetable: closes 18:00; no precedence ruleWhen does the centre close?State the two conflicting times and request owner confirmation
Approved FAQ: closes 17:00; approved timetable: closes 18:00; supplied rule: timetable governs opening hoursWhich time should be used?18:00, with the supplied precedence rule as the reason
Separate nonconflicting fixture: approved FAQ says “Location: Demo Building, Room C”; approved timetable says “Saturday: 10:00–14:00”. No street address or other hours supplied.Give the location and Saturday hours.Demo Building, Room C; Saturday 10:00–14:00. Do not add an address or other opening days.
Download editable CSV ↓

The centre and extracts are invented. Two sources containing different fields are not automatically in conflict. An authority rule must be supplied rather than guessed from a more official-looking filename.

Avoid manufacturing a compromise

The assistant says “The centre closes around 17:30” after seeing 17:00 and 18:00. Why is that a failure?

Show the worked answer

Neither source supports 17:30. Averaging the values hides the disagreement instead of resolving it. The expected response names the conflict and uses the supplied resolution route.

Keep unresolved conflict separate from an out-of-date document that has an explicit replacement. Record the conflicting passages and owner decision, then make the resolved case a new fixture rather than silently changing the old expectation.

Related resources