STEP 01
Keep provenance at ingestion
OpenYour passage records
A useful record contains more than text.
- Store a stable document ID, version, title, source location, and passage ID with each chunk.
- Keep these fields attached to results returned by search.
- For private files, enforce the user's access scope before results reach the model.
Every result can be traced back to a specific document version.
If it does not work
If IDs change on every request, assign them during indexing instead of generation.
STEP 02
Validate a claim and citation
OpenYour answer view
The practice FAQ gives a precise printer location.
- Ask: "Where is the Harbor Studio printer?"
- Confirm the answer says second floor, beside the blue cabinet.
- Open the cited passage and confirm it contains both details. Reject or flag IDs that were not in the retrieved set.
Where is the Harbor Studio printer?The citation resolves to the printer paragraph in version 1 and supports the full claim.
If it does not work
If the wrong passage is cited, inspect the result list and the model output separately.
STEP 03
Check another fact
OpenYour evaluation notes
A single correct citation is insufficient.
- Repeat with the 60-minute booking question.
- Check that both the answer and the passage agree on the number.
- Record any unsupported answer as a failure even if a citation badge is present.
Both sample answers have source support.
If it does not work
Do not synthesize a source link from the model's free-form filename; use verified IDs.
Add a no-evidence path and test it beside a covered question.