I'm a business analyst. Two different tools in our company show two different numbers and the difference isn't small.
We're arguing about which number to use in management reports. This argument has been going on for three months and still hasn't ended.
I want to verify the measurement setup from scratch. Where should I start, what should I check?
First question: are you sure the two tools are measuring the same thing? Most arguments end here.
Different tools define "session", "user" and "visit" differently. Session timeout durations differ, bot filtering methods differ, source attribution rules differ. You shouldn't expect two tools to show the same number, in fact if they do, I'd be suspicious.
For verification, check these in order:
Is the tag loading once per page? A double-loaded tag doubles visits and artificially lowers bounce rate. It's a very common mistake.
Is internal traffic excluded? If your own team's, agency's, and test environments' traffic is included in measurements, your numbers are inflated.
Is the bot filter on and actually working? Check for traffic spikes at odd hours, single-page views, or traffic coming from a single source.
Is the conversion event firing in the right place? On the "Thank You" page, or when the button is clicked? These measure different things; someone who clicks the button but drops off at checkout shouldn't count as a conversion.
And finally: do a test purchase and verify it shows up in the tracking. One end-to-end check wraps up faster than three months of arguing.
I agree with Pınar's list, let me add one more question: what date range and time zone are used in the reports?
Even within the same tool, different reports can use different time zones. At daily cutoffs, this alone creates percentage-point differences.
Then there's the "updated data" issue: some tools show estimated data for the first 24-48 hours and then correct it. If the number you saw last night is different from today, the error might not be in the setup.
Also be skeptical of claims about huge discrepancies. If the gap is three times larger, it's a setup error; if it's 15%, it could be a definition difference and is normal.
Let me add a note from the product side, regarding a topic that intersects with financial reporting.
Revenue in the marketing tool and revenue in accounting will never match exactly, nor should they. Cancellations, refunds, failed payments, different currencies, and tax-inclusive/exclusive differences get in the way.
Our solution was this: we documented in writing which figure to use where. Marketing tool for marketing performance, accounting for official reporting. We stopped putting them in the same table and arguing about the difference.
This looks like a compromise, but it's not. This is the right way: the two tools answer two different questions.
I ran the checks, let me share the results with numbers.
The tag was double-loading on two pages, fixed. Internal traffic filter wasn't defined, added. The conversion event was firing on the payment page, moved to the thank you page.
The gap between the two tools narrowed significantly after these three fixes. The remaining difference is at the level of the definition difference you mentioned.
Three months of discussion ended with a one-day check. Glad I posted here.
The opposite happened to me, that's why I'm writing. A competitor's ranking might come from years of accumulation, not just their content.
If I were you, I'd go this route.
It's rare to find an explanation this clear. Discussing numbers without verifying the measurement setup is a waste of time.
Hope this helps.
Let me summarize the topic, since several different answers were given. When you try to change everything at once nothing settles.
Doki · Penetration test · 2026
I'm in the same situation, that's why I'm asking. Internal linking is the cheapest and most neglected task.
Everyone rushing into analytics gets stuck at the same point. I'm also curious if anyone does it differently.
Doki · Backup setup · 2023
My questions are cleared up, thanks. Discussing numbers without verifying the measurement setup is a waste of time.
Everything goes well for the first three months; problems arise in the fourth. If you post the result here, it will help others too.
There's a part I don't understand. A page with low traffic might be reaching the right people. Look at where sales come from.
thanks for posting. like mistakes made on the analytics side are usually reversible but expensive.
Doki · Log management setup · 2026
Let me summarize what's been said so far. Speed is a threshold issue; if you're already fast, making it faster changes nothing.
Of course, it varies if your situation is different.
We experienced almost the exact same thing last year. Discussing numbers without verifying the measurement setup is a waste of time.
If you have questions write them; I'll answer as best I can.
we experienced almost the exact same thing last year. when we decide without measuring, we always end up in the same place.
i'm also curious if anyone does it differently.
We experienced almost the exact same thing last year. Map listings bring more business than blog posts for most local businesses.
The answer varies greatly by industry; there is no one-size-fits-all rule. If you post the result here, it will help others too.