Does the video really work? How we measure revenue uplift honestly

Here's a sentence you read on every other e-commerce tool page: "Boost your revenue by X%." And here's the uncomfortable truth behind it: almost no one who claims this can prove it was the tool.

Because revenue fluctuates anyway. There's season, weather, holidays, trends, competitors' price promotions. Whoever embeds a video in November and sells more in December doesn't have proof — they have a calendar. This exact fallacy sits inside almost every "success measurement" in e-commerce. And we didn't want to repeat it.

Expand

The problem with "before versus after"

Imagine you embed a video in your 100 best-selling listings. Four weeks later your revenue is up 20%. Did the video work?

You don't know. Maybe it was the video. Maybe it was Black Friday. Maybe a competitor raised prices. Maybe one of your ads ran better. A pure before/after comparison credits the video with everything that happened in the same window — including what the market would have done entirely without you.

That's not just academic. It's the difference between "I keep investing in video because it demonstrably works" and "I keep investing in video because it happened to coincide with the Christmas season".

The fix: a control group that lives through the same season

The clean answer comes from impact research and is called difference-in-differences (DiD). The idea is strikingly simple:

You don't only look at the listings with video, but in parallel at a comparable group without video — same category, same price level, same period. That control group experiences exactly the same season, the same weather, the same Black Friday as your listings with video. The only difference between the two groups is the video.

And now the trick:

• If both groups rise equally — it was the market. No video credit.
• If only the video group rises more — that extra gap is precisely the effect of the video.

You see it directly in the chart above: before the "video goes live" marker, both lines run almost on top of each other. Both ride the same little seasonal waves. Only afterward does the video line break upward — while the control group keeps going the way the market dictates. The green shaded area between them is the honest uplift: the difference of the differences.

Why this is uncomfortable — and exactly why it's right

A DiD measurement has a property no marketing promise has: it can report zero. Or minus.

If a video on a particular listing did nothing, then the video line simply isn't above the control group — and that's exactly what the dashboard says. That's uncomfortable, because it means not every video is a winner. But it's the only way to tell an instrument from an ad banner. A speedometer that can only show acceleration isn't a speedometer.

For you that's practically valuable: you learn which products and which categories actually respond to video — and can steer your budget there, instead of pouring it evenly across a catalog where half the videos move nothing.

The one measured case: +55% — with all the asterisks

In one concrete case we measured an uplift of +55% versus the control group at one shop. That's a strong number, and I'm happy to tell it — but honest means telling it with all the asterisks:

• It's a one-of-a-kind shop — every product exists only once, which makes the measurement harder and the spread larger.
• There was no clean holdout across the whole period, so no perfectly isolated control.
• It's one case. An impressive one, but not an average you can simply expect.

That's why we don't sell those 55% as a headline guarantee. It sits in the chart with exactly these caveats next to it. Buust calculates your own value live from your own order data — and that can be higher or lower.

What else you see honestly

The DiD uplift is the centerpiece, but it doesn't stand alone. In the insights dashboard several honest measurements come together:

• Per-video stats from YouTube, TikTok, and Instagram — views, likes, comments, shares, updated daily, per product video instead of as an account total.
• Google search, honestly — web impressions of your products with video versus those without, so you see whether video also moves visibility in search.
• Single-item velocity — how fast stock turns over after the video, without artificially distorting the conversion rate.
• Your Buust month — a monthly recap that only arrives when there's actually something positive to report, instead of reflexively sending a success email every month.

The common thread through all of it is the same: better a number that sometimes says zero than a number that always looks good. How the honest euro impact of a single measure surfaces right on the listing is shown by the Buust Score.

Why this changes your decision

When you know a number is honest, you make different decisions. You stop investing evenly in everything and start following the lever that measures up for you. You drop a category where video demonstrably does nothing without a guilty conscience — and double down where the gap to the control group is clear.

That's the real value of honest measurement: not the good feeling of a big number, but a better next decision.

How to start

1. Connect — link your shop or marketplace to Buust
2. Create video — on part of your catalog; the rest stays the control group for now
3. Wait — the measurement needs a few weeks of before and after data
4. Read — the honest uplift in the insights dashboard, including the cases where it's small

Start for free with three sales videos on the Free plan. Embed them on part of your listings, leave the rest unchanged for now — and see in a few weeks what's left for you once you subtract the season.