BLOG POST

Multi-Agent Orchestration for Financial Operations

Multi-agent orchestration turns siloed AI agents into one audited financial ops workflow. Supervisor, handoff, pipeline: a worked reconciliation example.
July 20268 min read
Evan
- multi-agent orchestration- multi-agent systems- agentic automation financial services- agentic process automation- reconciliation automation ai- exception handling automation- human-in-the-loop ai agents- ai agent audit trail- agentic ai for regulated industries- ai agent orchestration platform

Why one agent is not enough

A single LLM agent is a generalist. Give it one well-scoped task, a handful of tools, and a clear success criterion, and it performs well. Give it a real financial operations workflow, and it degrades: reconciling a cash account touches a ledger extract, a payments file, a matching rulebook, an exceptions queue, and a reviewer with signing authority. One model holding all of that in context starts to drop constraints, invent matches, or quietly skip the approval gate.

Multi-agent orchestration splits the workflow into specialist agents, each with a narrow contract, and a coordinating layer that routes work, state, and approvals between them. The difference is not cosmetic. A generalist agent gives you an answer; an orchestrated team gives you a process you can audit.

In regulated operations the tolerance for "mostly right" is effectively zero. A reconciliation that matches 99.7 percent of entries is a control failure, not a win, because the remaining 0.3 percent is exactly where losses and fraud live. The multi-agent approach earns its place for two reasons. First, each agent can be optimized and evaluated against one narrow task, so its failure modes are known and bounded. Second, every step is attributable: one agent owns extraction, another owns matching, another owns exception handling, and a human owns the final sign-off. When a result is wrong, you can name the agent and the rule that produced it.

That attribution is what banks, insurers, and lenders actually buy when they buy agentic automation for financial services. The models are commodity; the contract between agents is the asset.


The orchestration patterns: supervisor, handoff, pipeline

Three patterns cover most financial operations use cases. In practice you combine them inside one workflow, but each boundary should be designed deliberately.

Supervisor

A supervisor agent delegates subtasks to worker agents, inspects their outputs, and decides whether to accept, retry, or escalate.

  • The supervisor holds the plan and the thresholds, not the raw data.

  • Workers stay single-purpose: one extracts, one validates, one summarizes.

  • The supervisor enforces ordering and the stop conditions for escalation.

The supervisor pattern is the right default for anything with a compliance gate, because the routing decisions themselves become a reviewable artifact. You do not need a "manager" model that is smarter than every worker; you need a deterministic controller that knows the workflow graph and the escalation thresholds. Keep the supervisor's own logic as close to plain rules as possible, and reserve the model for judgment calls only.

Handoff

In a handoff, control passes from one agent to another along with a structured context object. Each agent works one stage and then transfers ownership.

  • Use handoff when the workflow is linear and each stage changes the type of work.

  • Keep the handoff payload small and typed: a case ID, the source fields, the actions taken, and a confidence level.

  • Do not hand off raw conversation history; hand off structured state.

The discipline of a typed handoff is what keeps context from ballooning across a long process. Every handoff should be small enough to inspect in one screen, because a reviewer will need to inspect it when something breaks.

Pipeline

A pipeline runs stages concurrently where they are independent and joins them at a synchronization point. This is the throughput pattern for batch work, such as reconciling a nightly file against several reference sources in parallel.

  • Stage results flow into a join step that must see all inputs before proceeding.

  • Pipelines suit deterministic, high-volume steps with no ambiguity to resolve.

  • Keep branching logic out of the pipeline and inside the supervisor.

In most real deployments you nest the patterns: a pipeline feeds a supervisor, which triggers a handoff to a human-facing agent for exceptions.

A workflow is only as trustworthy as its weakest handoff. Design the boundary first, then the agent.


A reconciliation worked example

Reconciliation is the canonical test case because it is tedious, rule-heavy, and unforgiving, and it already has a control owner who must sign off. Here is how a four-agent orchestration handles a daily bank-to-ledger cash reconciliation.

Agent 1: extraction. It pulls the bank statement, the ledger export, and the prior-day open items. It normalizes currency, dates, and identifiers into one canonical schema and stamps each record with its source. It never decides a match; it only prepares clean, comparable records.

Agent 2: matching. It applies the matching rulebook: exact amount and reference first, then amount plus date within tolerance, then fuzzy reference for the remainder. It emits three buckets: matched, unmatched, and near-match. The near-match bucket is the important one. It contains every record that matched on amount but not reference, or reference but not amount.

Agent 3: exception handling. It triages the near-match and unmatched buckets. For each item it proposes a classification: duplicate, timing difference, currency rounding, known counterparty, or genuinely unknown. It attaches the evidence, the rule that fired, and a confidence score. It does not resolve anything on its own for items above a materiality threshold.

Agent 4: the reviewer handoff. It packages everything above threshold into a sign-off queue with a one-line rationale per item, ranked by materiality. The human reviewer approves, rejects, or remaps each item, and every decision is written back to the case.

In a 40,000-row nightly run, a tuned pipeline will auto-match well over 90 percent of rows in the exact bucket. The orchestration exists for the last few hundred, which is where the risk is. The measure of the system is not the auto-match rate; it is how fast and how completely the residual items reach a documented resolution.

The auto-match rate is vanity; the residual-item closure rate is the control.

Here is where the patterns stack. Extraction through matching is a pipeline. The exception agent is a handoff recipient that takes the matched state. The supervisor sits above the loop, enforcing the rulebook version, the materiality threshold, and the escalation path. Swap one agent out, and the contract the others rely on stays intact.


Exception handling with human-in-the-loop

The human in the loop is not a fallback you bolt on at the end. In regulated operations it is the control, and the orchestration must treat it as a first-class stage.

  • A human review always has a deadline and an escalation owner.

  • Items route to the right reviewer by type, not into one shared queue.

  • The reviewer sees evidence and the proposed action, never just a raw item.

Design the human stage with the same contract discipline as any agent: defined inputs, defined outputs, and an audit record of the decision. When an item ages past its SLA, the supervisor re-routes or escalates it rather than letting it sit. This is where agentic process automation pays for itself in operations: not by removing people, but by making sure the right person sees the right exception at the right time.

One practical rule from production work: never let an agent close a high-value exception. Agents propose; humans decide above the threshold, and below it the agent closes with a full rationale plus a sample-based quality check. That split keeps throughput high without removing accountability.


Observability and audit

A multi-agent system that cannot be replayed is not ready for a regulated environment. Build the audit trail from the first run, not as an afterthought.

  • Log every agent call with its inputs, outputs, tool calls, and the model version.

  • Persist the rulebook version and thresholds so a decision can be reconstructed months later.

  • Store every handoff payload as an immutable event, so the case can be replayed end to end.

  • Tie each record to a run ID, so a batch can be traced from source file to sign-off.

The audit artifact is the orchestration trace: the ordered events, the rules that fired, and the human decisions, in one replayable sequence. This is what separates an ai agent audit trail that satisfies an auditor from a chat log that does not. A reviewer should be able to ask, "why was item 4,182 classified as a timing difference?" and get the rule, the evidence, and the confidence score in one lookup.

Two things to watch. First, model drift: when the matching agent's model changes, re-run a frozen golden set of cases and diff the outputs before promoting the change. Second, non-determinism: pin the temperature and the seed where it matters, and treat any output that changes across runs as an exception rather than as noise.


Getting started

Do not start with the whole back office. Pick one workflow that is narrow, rule-driven, and already has an owner.

  1. Pick a reconciliation or exception queue with a written procedure and a known error rate.

  2. Define the agent contracts on paper first: inputs, outputs, tools, and thresholds for each agent.

  3. Build the supervisor as deterministic logic before adding any model-based routing.

  4. Run it in shadow mode against a week of historical data and diff against the real outcome.

  5. Promote only after the residual-item closure rate and the audit trace meet the control owner's bar.

Start with a workflow where the current manual cost and error rate are already measured, so the orchestration has a baseline to beat. That baseline is also your evidence for the auditor and your business case for the next workflow.

From there, the pattern scales: the same supervisor, handoff, and pipeline contracts you built for cash reconciliation carry over to loan servicing exceptions, claims triage, and counterparty matching. The agents change; the orchestration layer does not.

Simple 3 click setup.

Deploy Kolega.dev.

Find and fix your technical debt.

No credit card required · 7-day free trial