Skip to content

How to verify an extraction

On projects with two or more extractors, every paper’s extraction is checked by a second person before it counts as done. Verification isn’t redoing the work — it’s reading the extractor’s answers against the paper, correcting what’s wrong, and validating the result. Everyone plays both parts: you verify papers that others extracted while they verify yours.

Sidebar → ExtractionMy verification queue. It works like the extraction queue, with one difference that defines the rhythm: a paper is only verifiable after its extractor submits. Until then its card reads Awaiting extraction with a lock, and if everything is still locked, the top bar says so plainly — N papers waiting on extraction — you can verify each one as soon as its extractor submits — instead of leaving you with an empty Start Verification button.

My Verification Queue: the Verification card reading “You have 1 paper waiting to verify” with its Start Verification button, the search box, an Any status filter and a “Needs attention (1)” chip above a “7 papers” count, and paper cards mixing one ready row — amber flag, Pending badge and a purple Verify button — with locked rows badged Awaiting extraction whose Verify buttons are greyed out

Ready papers show a purple Verify button. Watch for the amber flag some cards carry: the extractor marked that paper Needs attention — a caveat, an uncertainty, a PDF problem. The Needs attention filter chip pulls exactly those papers, so you can triage them first.

Verify opens the Verification Workspace — the same split view the extractor had, with the PDF on the left and the form on the right, but wearing a purple Verifier badge and an Extracted by line so it’s clear whose work you’re reading. Three things are laid out for the check:

  • The form arrives prefilled with the extractor’s answers — you read and correct, not retype.
  • Their note and Needs attention flag, if any, sit at the top of the form.
  • Their evidence links render on the PDF and under each field, so confirming an answer is one View click to the passage behind it.

The Verification Workspace: the header carrying a green Saved chip, a purple Verifier badge, an “Extracted by Amelia Hart” line and the Save Progress and purple Validate buttons; the paper’s PDF filling the left panel; and on the right the extractor’s amber Needs attention callout sitting above the section tabs, over a form already filled with her answers for Sector Industry, Analysis Level and Sample Size

Change any field you disagree with — it picks up an amber Modified badge, keeping your interventions visible as you work. Save Progress stores a half-done check for later.

  1. Click Validate when you’ve been through the form.

  2. The Confirm Verification dialog plays back your corrections — each changed field with its original and new value side by side — or states All fields will be marked as agreed if you changed nothing.

  3. Optionally add Notes, then confirm with Validate. Required fields must all be filled to complete the validation.

The Confirm Verification dialog: “You have modified 2 fields.” above the two changes — Sector Industry and Direction of Effect — each showing the extractor’s original value in grey, an arrow, and the verifier’s corrected value in amber, with the optional notes textarea beneath and the Cancel and purple Validate buttons

The paper is done: it shows Validated in your verification queue (and Completed in the extractor’s), the extraction record locks on both sides — the extractor can no longer edit their answers, and reopening the paper shows it read-only — and your corrections are counted on the progress pages. Field by field, the record keeps what was agreed and what was corrected, so the review can always say how much verification actually changed.