MishaBook a demo

Aug 31, 2026

Did the action actually work?

The closed loop is the step after execution: checking, against a named metric and a defined window, whether an approved action actually worked - and recording the verdict, including when it did not.

Execution is not the finish line

The chain most marketing AI advertises ends at execution. The proposal is generated, you approve it, the campaign gets paused or the segment gets built, and the system reports back a green checkmark: done.

Done is not an outcome. The only verdict that matters is what happened to the metric the action targeted. Pause the campaign - did spend efficiency recover, or did you just cut a channel that was about to exit its learning phase? Build the churn-risk segment - did repeat purchase behavior change, or did you build a list nobody mails? A tool that never returns to ask is an automation, not an operator.

The gap is subtle because the action usually was reasonable. The failure is not that the AI did the wrong thing. It is that nobody ever found out whether the thing worked.

What a closed loop actually requires

Closing the loop is not a dashboard. It is a discipline with specific parts:

  • A named target metric at proposal time - the action declares, before execution, which number it intends to move
  • An evaluation window set before execution, long enough for the effect to exist (email: days; budget moves: weeks, because of learning-phase resets)
  • The noise question answered - what else changed in the window (a promo, a creative launch, a spend change) that could claim the credit
  • A written verdict attached to the approval record: worked, did not work, or inconclusive with a stated reason
  • The misses recorded with the same prominence as the hits

Why most tools skip the loop

Attribution is genuinely hard, and admitting which part of the lift you cannot measure is fine. Silence is worse. A tool that goes quiet after execution has not solved attribution - it has opted out of accountability.

The loop is also unglamorous. Proposal-to-action demos beautifully: watch the AI pause a campaign, live, in thirty seconds. Action-to-outcome takes weeks, produces ambiguous evidence, and cannot be demoed at a conference. Vendors build what demos.

And there is the uncomfortable one: verification can contradict the vendor's own story. A system that measures its own actions will sometimes prove itself wrong, in writing, in front of the customer. Most products are not built to do that on purpose.

Receipts, including the negative ones

A receipt is the full record of one action: what was proposed and on what evidence, who approved it and when, what was executed, and what happened next to the target metric. The negative receipt - approved, executed, metric did not move - is the most valuable document in the system, because it is the one a vendor has no incentive to show you.

We will say plainly where we are on this. Misha's approval loop - propose with evidence, approve in Slack, execute with an audit reference, log including rejections - ships today, and the audit reference answers what he did and when. The outcome receipts, the what-happened-next half, are being built. When they ship, they will include the negative ones, because a record that only shows wins is a marketing channel pretending to be an operator. Until then, hold any AI tool - including ours - to the standard in the next section.

How to demand the loop from any tool

You do not have to wait for vendors to catch up. Make the loop a procurement requirement:

  • Require a target-metric field on every proposed action - a proposal that cannot name its metric is a guess wearing a suit
  • Set the evaluation window at approval time, in writing, not retroactively
  • Ask for the verdict in writing, attached to the approval record, within the window
  • Sample-audit monthly, and include the misses: 'show me the actions that did not work'
  • If the vendor cannot answer that last question, that is the answer

What changes when the loop closes

Fewer vanity actions. An action that never gets verified quietly loses priority - there is no green checkmark to harvest, so the system stops proposing it. The proposal queue gets shorter and better.

Trust compounds in the useful direction. Every verified hit earns the next approval faster; every recorded miss makes the next proposal more honest. After a quarter of closed loops, approving takes seconds because the record does the arguing.

And budget conversations get boring, which is the point. 'We paused these four campaigns, here is what happened to MER, here is the one that we got wrong' is a five-minute meeting instead of a debate.

Questions

FAQ

What is a closed loop in marketing AI?

It is the step most systems skip: after an approved action executes, the system checks whether the metric it named at proposal time actually moved, records the verdict, and shows it to you - including when the answer is no.

Should an AI tool verify its own work?

It should produce the evidence; you keep the judgment. Self-grading without evidence is marketing. Evidence attached to a record you can audit - proposal, approval, execution, outcome - is the product.

What is a negative receipt?

A record of an action that was proposed, approved and executed, whose target metric did not move (or moved the wrong way). It is the most valuable record in the system because nothing selects for it - it exists only if the loop is honest.

How long should the evaluation window be?

Long enough for the effect to exist, decided before execution. Email sends: 7-14 days. Budget reallocations: 14-28 days, because learning-phase resets distort the first week. Pausing a broken campaign: days. The specific window matters less than setting it before you know the result.

Want this on your account?

Thirty minutes. Bring the number that keeps you up.

More from the blog