NotchPath

Human-in-the-loop AI

How do we keep people in control of AI-assisted work?

Human-in-the-loop AI is not a manual checkpoint added to every step. It is a deliberate control system that identifies consequential decisions, shows the evidence and uncertainty, and gives the right owner authority before external action.

What reliable automation requires

A review queue only works when authority and evidence are explicit

Risk-based approval gates

Define which outcomes can proceed, which require approval, which must escalate, and which are denied instead of sending everything through the same queue.

Named decision owners

The person reviewing a refund, policy exception, customer promise, or workflow activation needs the authority and context to make that decision.

Evidence beside the proposal

Reviewers should see the source facts, policy result, missing information, and proposed action without reconstructing the case across several systems.

Clear exception categories

Missing facts, conflicting knowledge, low confidence, policy blocks, sensitive cases, and delivery failures require different owners and next steps.

Editable proposals

A reviewer should be able to approve, edit, hold, reject, or request more information while preserving what changed and why.

Traceable activation

The final record should connect the original trigger, AI proposal, checks, reviewer decision, tool action, and delivery outcome.

The NotchPath approach

Ingest, infer, propose, confirm, activate

1

Ingest

Bring the request and approved operating context into a reviewable case.

2

Infer

Interpret intent, evidence, uncertainty, and the likely policy path.

3

Propose

Prepare the response or action without treating the proposal as authority.

4

Confirm

Apply deterministic checks and collect approval from the accountable owner.

5

Activate

Execute only the approved action and retain a complete decision trace.

Product fit

Fit depends on the work, not organisation size

A good fit when

  • AI can prepare meaningful work, but some outcomes carry financial, customer, legal, or operational consequences.
  • Different teams own different policies, exceptions, and external permissions.
  • Reviewers need concise evidence instead of raw prompts, logs, or model reasoning.
  • You want to expand automation gradually as policies and knowledge become more reliable.

Not designed for

  • Using a generic approval button without defining what the reviewer is accountable for.
  • Treating human review as a substitute for reliable sources and deterministic safeguards.
  • Hiding uncertainty or unsupported claims from the person making the decision.
  • Allowing an approved draft to trigger a different, broader, or unrecorded external action.

Common questions

What teams usually want to know

What does human-in-the-loop AI mean?

It means people retain defined authority over consequential decisions while AI assists with interpretation and preparation. The human checkpoint is placed according to risk, policy, uncertainty, and permissions.

Does human review make automation too slow?

It can if every case follows the same path. A better design lets deterministic checks clear well-understood low-risk work while routing only exceptions and approval-required actions to people.

What information should an approver see?

The current request, selected source facts, relevant policy checks, missing or conflicting information, the proposed response or action, and the exact consequence of approval.

Can approval rules change over time?

Yes. Teams can tighten or relax gates as knowledge quality, policy coverage, permissions, and observed workflow performance improve, while retaining an audit trail of those decisions.