Trend or wobble? Reading week-to-week movement

AI answers vary from run to run, even when nothing in the world has changed. So every visibility percentage wobbles a little. The question every report needs to answer is whether this week’s movement is bigger than the wobble. Fortunately there is a simple way to tell, and it depends mostly on one number: how many answers sit behind the percentage.

A worked example

Made-up numbers, but a very common situation. A brand tracks 10 prompts on 3 platforms, once a week. That is 30 answers per week.

A ten-point drop sounds alarming. But with only 30 answers each week, two weeks can differ by more than that through chance alone. This drop is inside the wobble. It is worth watching, not worth an emergency meeting.

How big is the wobble?

For a percentage built from yes-or-no results (mentioned or not), the typical margin shrinks as the sample grows. Using the standard approximation for a 95% margin at a rate near 50%:

Quadruple the answers and the wobble halves. That is why the same tool can feel jumpy on a small prompt set and steady on a large one.

Getting more answers without paying more

When a small move is still worth checking

Statistics tells you whether a change could be chance. It doesn’t tell you whether something real happened. So always open the saved answers when:

• the brand disappears completely from a question where it was always present;
• a new rival or a new cited page appears in several answers at once;
• the change lines up with something you did, such as a launch, a page update or press coverage.

Those patterns can be real even when the headline percentage barely moves. The weekly routine builds this check into Monday’s triage.