I once signed a contract that paid an AI vendor only when their agent produced “successful small-group matches.” I believed this would keep costs honest because we would only pay after something concrete happened. The first invoice arrived thirty days later for three matches, and every one of them dissolved before the second meeting.
The real cost showed up in volunteer hours spent chasing people who never returned and in the quiet decision to run the pilot for another month anyway. We had protected the budget line but exposed the actual ministry work to metrics that rewarded volume over endurance. That invoice is the reason I now insist on agent outcome pricing that only pays for verified, lasting change — not activity dressed up as a result.
This is the foundational misread that causes product teams to accept outcome pricing that still measures activity instead of lasting change. The vendor simply redefines the outcome around whatever their model can count quickly. Ministry teams end up funding the appearance of progress while the harder work of retention and life change stays unfunded and unmeasured.
The anchor that exposed the problem was the outcome ledger we kept during that first agent pilot. We tracked every billed event against three columns: what the agent recorded, what the ministry team observed thirty days later, and whether any volunteer or participant could name a single concrete difference. The ledger made the gap visible in numbers we could not ignore.
The invoice that charged for three successful small-group matches
The line items listed three new groups formed through the agent’s outreach. Each carried a per-match fee that looked modest on paper. When we pulled the actual participant data, two of the three groups had zero attendance after week one and the third had lost its volunteer leader by week three.
We had assumed the vendor’s definition of success matched ours: a group that continued without staff intervention. Their system only needed an initial RSVP and a confirmation message. The ledger showed we paid for the confirmation step, not the continuation.
The pattern repeated in the next billing cycle. Every match that survived past two weeks had required manual follow-up from our own team. The agent’s contribution ended at the first message. We were effectively paying a finder’s fee for introductions that our volunteers still had to turn into relationships.
How the ledger forced us to rewrite the contract clause
We stopped arguing about price and started arguing about the definition column. The ledger required every billed outcome to include a thirty-day verification step that only the ministry side could complete. If the group or participant could not be confirmed by someone inside the church, the line item was clawed back.
The vendor pushed back on verification costs and latency. We held the line because the ledger already proved that unverified matches produced zero downstream activity. The revised clause tied payment to verified continuation rather than initial contact — the core move behind any real agent outcome pricing model.
That single change shifted the pilot economics. The number of billable events dropped by more than half, but the events that remained showed measurable retention and volunteer completion rates that aligned with our own historical curriculum data. The cost per lasting group became visible for the first time.
The quiet shift from seat counts to verified life change
Most ministry tools still price on seats or logins because those numbers are easy to export. The ledger experiment showed that seat counts hid the same problem we had seen with the agent matches. People created accounts after an automated nudge and never returned.
We began requiring every new pricing discussion to include a verification step tied to observable behavior thirty days out. For curriculum tools the check became whether the volunteer actually completed and returned the lesson. For discipleship agents it became whether the participant joined a recurring group or requested follow-up from a real person.
The shift forced vendors to surface data we could verify rather than data they could generate automatically. It also changed how we evaluated internal experiments. Features that drove quick sign-ups but flat thirty-day activity were deprioritized even when they looked good in the dashboard.
Your Turn: Apply This Today
- Pull the last three invoices from any agent or automation tool and list every line item the vendor called an outcome.
- For each item, add a column that only your team can fill: did the billed event produce a verifiable continuation thirty days later?
- Mark every item where the answer is unknown or negative and calculate what percentage of the bill that represents.
- Write one sentence that defines continuation for your context (group still meeting, volunteer still active, participant requested next step) and send it to the vendor as a proposed contract clause.
- Run the same thirty-day verification on your highest-volume internal feature for the next billing cycle and compare the numbers.
- Bring the ledger to the next renewal conversation and refuse to discuss price until the outcome definition matches the verification column.
The same pattern showed up when we added the knowledge graph to control token spend and again when we had to build a custom evaluation layer because off-the-shelf agents could not read our ministry data. Both posts trace the same need for teams to own the definition of progress rather than accept the one the model makes cheap to count.
I consult with faith-tech product leaders on outcome definitions for agent tools, contract clauses that protect verified ministry progress, and evaluation layers that survive real ministry data. Let’s talk.
Discover more from Dr. Joshua Read
Subscribe to get the latest posts sent to your email.

