What we have built, and how we know it works

Before a finding is stored, its quotation of the legislation is checked word for word against the statutory text, and every passage quoted from a client document is checked against the text extracted from that document. A quotation that fails is not used.

Limit. This proves the quoted words exist in the source. It does not prove the assessment drawn from them is right. That judgement is yours, which is why every finding is reviewed.

• Test: backend/tests/test_adviser_report.py test_every_quote_is_verbatim
• Test: backend/tests/test_adviser_report.py test_tampered_legislation_quote_refused
• Test: backend/tests/test_adviser_report.py test_fabricated_client_excerpt_refused
• Test: backend/tests/test_adviser_applicability.py test_rule_commencement_and_intake_bases_are_verbatim

If the engine's quotation of the legislation fails verification, its assessment is discarded and the obligation is shown as Unclear, with the statutory text, for you to review. An obligation that applies is never silently dropped.

• Test: backend/tests/test_adviser_report.py test_failed_verification_becomes_unclear_finding_not_a_hole

If the engine rates an obligation as met but does not cite a verified passage from the client's documents that shows it, the finding is shown as Unclear with a note, not as Met.

• Test: backend/tests/test_adviser_engine_safety.py test_met_without_a_client_excerpt_is_shown_as_unclear
• Test: backend/tests/test_adviser_engine_safety.py test_met_with_a_verified_excerpt_stays_met

Document text reaches the AI model inside marked boundaries and is declared untrusted. Text that tries to close those boundaries or give the model instructions is neutralised before it is sent.

Limit. This reduces the risk that a document steers the analysis. It cannot remove it entirely, which is another reason every finding is reviewed.

• Test: backend/tests/test_adviser_engine_safety.py test_prompt_declares_document_text_untrusted
• Test: backend/tests/test_adviser_engine_safety.py test_document_cannot_close_its_own_fence

Each finding needs your decision: accept, edit or reject. The Word export is refused until every finding has one. A rejection needs a written reason.

• Test: backend/tests/test_adviser_export.py test_export_refused_until_every_finding_reviewed
• Test: backend/tests/test_adviser_export.py test_builder_itself_refuses_unreviewed_views
• Test: backend/tests/test_adviser_review.py test_gate_blocks_until_every_finding_reviewed
• Test: backend/tests/test_adviser_review.py test_reject_requires_a_note

You can change a finding's status, assessment, recommended action and client excerpt. You cannot change its legislation quotation. A replacement client excerpt must appear word for word in the document as it was when the report was run.

• Test: backend/tests/test_adviser_review.py test_legislation_citation_cannot_be_edited
• Test: backend/tests/test_adviser_review.py test_edited_excerpt_must_be_verbatim_in_frozen_document
• Test: backend/tests/test_adviser_review.py test_excerpt_edit_refused_once_document_replaced

Every review decision is kept with the reviewer and the time. A new decision is added alongside earlier ones and never overwrites them. The engine's original finding is never modified. The database itself refuses an attempt to rewrite either.

Limit. Today the reviewer is recorded as the name entered at review. Signed-in adviser accounts, so the name comes from the login, are being built for the pilot service.

• Test: backend/tests/test_adviser_review.py test_engine_finding_and_review_trail_are_immutable_in_the_store
• Test: backend/tests/test_adviser_review.py test_rereview_appends_and_latest_wins

Rejected findings are left out of the client's report. Anything you changed is marked as your edit, and where you changed a status the engine's draft status is shown alongside.

• Test: backend/tests/test_adviser_export.py test_quotes_reproduced_exactly_and_rejected_omitted
• Test: backend/tests/test_adviser_export.py test_adviser_edits_are_marked_and_engine_draft_disclosed

Each report states the date it was assessed against. Commencement dates, and exclusions such as qualifying periods, are backed by word-for-word quotations of the legislation that sets them, and an exclusion that will stop applying shows the date it lapses.

• Test: backend/tests/test_adviser_applicability.py test_short_service_excludes_ordinary_unfair_dismissal_until_reform
• Test: backend/tests/test_adviser_applicability.py test_qualifying_period_bases_are_verbatim
• Test: backend/tests/test_adviser_applicability.py test_unknown_answers_never_exclude

Deleting a document removes the uploaded file and its extracted text. Deleting a client removes its documents and files, and its reports and review records from the database.

Limit. Exported Word reports kept on our side are not yet removed when a client is deleted. This is being fixed before the pilot service opens.

• Test: backend/tests/test_adviser_workspaces.py test_delete_document_and_client_remove_files

Client document excerpts are sent only to Anthropic's API. Using any other AI provider for analysis is switched off and refuses to start unless deliberately enabled.

• Test: backend/tests/test_adviser_engine_safety.py test_openai_refused_by_default