Menu

Testing and iteration

We design each test before anything is filmed: the variable, the metric that decides it, the spend each variant gets and the rule for cutting it. Each result then becomes the brief for the next round.

Handlebar view of an electric bike on a palm-lined residential road under a clear sky
Source: Buttered Side Down (YouTube)

Scope

  • We change one variable per test, whether that is the hook, the creator, the format, the offer or the end card.

  • We set the decision metric and a spend threshold per variant before launch, so nobody reads a result early.

  • We structure campaigns so that variants get comparable delivery, which keeps the comparison fair.

  • We cut variants that miss their threshold, move budget to the leaders, and put each winner up against a fresh challenger.

  • We turn each readout into the next brief: new hooks on a winning body, a winning hook on new creators, or a new concept once a line runs out.

What it looks like

Mock test matrix: hook rate and CPA for four hooks across three creators, target CPA $22. Not client data.
Hook / creatorCreator ACreator BCreator C
ProblemScaleHook 31.2%CPA $18.40IterateHook 28.4%CPA $21.10ScaleHook 33.9%CPA $17.60
ResultCutHook 24.7%CPA $24.90CutHook 22.1%CPA $27.30IterateHook 26.3%CPA $23.80
DemoCutHook 35.8%CPA $29.70CutHook 30.6%CPA $31.20CutHook 38.2%CPA $26.40
ObjectionScaleHook 21.3%CPA $19.60IterateHook 19.8%CPA $22.80ScaleHook 23.5%CPA $18.90
Mock data. Not a client account. Target CPA $22, read once every cell reached its spend threshold.

What you get

  • Test plan per round
  • Cut and scale rules
  • Iteration brief
  • Log of every variable tested

FAQ

How do you spot creative fatigue?

In the numbers: frequency rising while hook rate and click-through fall on the same audience. Because challengers are always in test, a replacement is ready when a winner starts to slip.

Can you test without new production?

Often. New hooks, captions and end cards can be cut from raw footage we already hold, which is why we keep it.

Plan a first test

Send the product, your target metric and a monthly budget range. We reply with a proposed first test.

Plan a test