We’ve all done it before…
At some point in our lives, whether it’s related to marketing or something else, we’ve lied to ourselves.
It’s natural to want to feel good; the brain can distort truths to make you feel that way.
But lies get in the way of progress.
They can make you feel okay about not putting in the effort required for success.
The scariest part is that sometimes we don’t even know we’re doing it.
The cause of this, when it comes to marketing and business, is using metrics incorrectly.
Metrics are very important because they allow us to quantify our results.
However, not all metrics are useful; some might be useful but are hard to interpret.
A very realistic and common scenario involves marketers believing they are doing a great job (based on the metrics they track) when they aren’t producing much.
Other times, metrics might suggest that you change your marketing tactics and strategies. However, it might be that you are misinterpreting the meaning of those metrics, and then you make a change that actually makes your work less effective.
Any of these scenarios will diminish your chances of achieving the success you want so much.
And that’s why it’s crucial that you understand the ins and outs of metrics, which is exactly what we’re going to show you here.
After this post, you should know five different ways in which metrics can deceive you and how to protect yourself from that in the future.
1. Page views and emails do not equal sales
This first aspect of metrics is the most important.
Basically, there are two types of metrics:
- vanity metrics
- useful metrics
Care to guess what each means?
Vanity metrics sound nice but don’t mean much.
For example, a search engine could be reporting 1,000,000 searches per month.
But that could mean many things. Most importantly:
- You could have one really enthusiastic searcher
- You could have 1,000,000 single searchers
- You could be getting this many searches because the searcher couldn’t find the right result
It’s not that vanity metrics are necessarily bad; it’s just that they don’t tell you anything clearly or accurately.
Traffic is one of content marketers’ most commonly used metrics, and relying on it is a mistake.
Traffic is a vanity metric.
You could buy a million pageviews tomorrow from some low-quality ad network and get absolutely nothing from them.
While quality pageviews would be a decent metric, measuring something like that is very tough.
The same goes for the rate of opened emails or the number of email subscribers on your list.
We’ve seen some businesses make nearly zero revenue from a list of thousands of subscribers while others make thousands from a list of only a few hundred.
If you’re measuring email list growth, it doesn’t tell you a damn thing about how your business or marketing is performing.
This goes for all vanity metrics.
You can always find a few metrics in Google Analytics that are increasing monthly. Don’t fool yourself into thinking that everything is running perfectly—it might not be.
What makes a metric useful? The simplest way to recognize useful (sometimes called smart) metrics is to look for the three A’s:
- Actionable
- Accessible
- Auditable
This concept comes from the lean startup but can be easily applied to almost any business.
Let’s break down the signs of useful metrics individually, starting with determining whether a metric is actionable…
As you might have guessed, actionable metrics allow you to take action based on the information they provide. And we’re not talking about just any action, but one that actually improves your work.
The second A is for accessibility. This matters most if you work in a team.
If you decide on a key metric for a business, you want everyone in that business to understand what it is. More than that, they need to know how to find, understand, and use it.
Certain metrics can make sense to technical team members, but maybe not marketing or sales. A good metric should be easily understood by all.
The last A stands for auditable.
This relates to the concept of accessibility, and it means that any person on your team should be able to access any data in your business (related to the metric) and create a report with it.
If it can be tracked with Google Analytics, your problem is solved since all team members can easily be added to your website’s account. They can look up metrics and export reports as needed.
The goal comes before the metric: It’s important to remember why we need metrics in the first place.
Metrics allow us to measure things.
Useful metrics measure the things that show whether your marketing is producing acceptable growth or not.
To find these metrics, you can start with your main marketing or business goals.
Here are a few common ones that you might have:
- Make a profit (it may be a certain amount)
- Have a significant positive impact on your customers’ lives
- Do meaningful work
It usually doesn’t get much more complicated than that.
For each goal, you want to determine metrics showing your success.
Let’s look at a few example metrics.
Goal: Make a profit
Possible metrics: revenue, profit, costs of goods sold, current members, monthly churn (customers lost), retention rate, new customers, customers lost (if applicable).
Since most businesses want to maximize their profits or revenue, these metrics are usually the most important ones to track.
Usually, you’ll pick one to four of them to track regularly.
Every time you or anyone on your team does something, it should, in some way, improve at least one of your chosen metrics.
Some of these metrics depend on your type of business. Retention rates and churn apply only to recurring revenue businesses (e.g., subscription boxes).
You want to keep your choices as simple as possible.
If your main goal is profit, track profit first and foremost.
You won’t be able to track profits directly for some parts of your marketing.
That’s why you want other related metrics that could tell you when something’s not going right in your business.
For example, if you all of a sudden see a spike in the number of customers you lost, you can use that information to take action and figure out which recent change caused the loss.
Let’s look at one more goal…
Goal: Have a positive impact
Possible metrics: average time on page, customer survey satisfaction scores, percent of return visitors.
Many goals are qualitative, which, of course, makes them difficult to measure.
And while you won’t be able to find a perfect impact metric, you can find others who can guide you.
In this case, finding out how much customers love your products is difficult.
You’ll hear from those who had a great or bad experience but not the average customer. Surveys are usually your best option, but you will always have a sampling issue.
If your product is an online product, like a course or SAAS, it’s much easier to measure a metric like this. You can usually see how often your users return to your site or tool.
Some goals correspond to more metrics than others. As long as a metric gives you unique, actionable information, it’s worth tracking.
Finally, you could devise a way to regularly evaluate how satisfied you are with the work you’ve been doing, but that’s another tricky one to measure.
Some goals, particularly qualitative ones, don’t need to be tracked through metrics (do reviews on a regular basis). Otherwise, ensure that any metric you focus on fits the three A’s.
2. Metrics alone don’t always tell you the whole picture
You should always have justification for any action you take or the conclusion you make.
If you say your marketing is working well, you’d better have the metrics to back it up.
Most marketers understand this, which is a good thing.
However, many don’t back up their conclusions correctly. The most common error we see is that marketers back up their conclusions with metrics that don’t tell the whole picture.
Let us give you an example.
Say we have a marketer named Joe.
He tracks customer satisfaction as a metric. He observes that customer satisfaction went up last month and concludes that the business continues to grow due to the content he created.
Do you see the issue with concluding this based on this metric alone?
Joe’s boss, let’s call him Neil, isn’t quite convinced.
Neil digs into the business’s data and finds its customer retention rates. As it turns out, the retention rate decreased, meaning that the business lost more customers than usual.
Putting these two metrics together reveals a very different picture:
The average customer satisfaction likely went up because many unsatisfied customers left the business.
That’s a serious problem.
This is why you should ensure that the metrics you rely on don’t mask potential problems.
Selecting metrics that show you the whole picture: It’s never good to rely on a single metric to make a decision (in most situations) because they rarely give the whole picture independently.
At the same time, you don’t want to have 15 different metrics—it’ll make it hard to draw a clear conclusion.
Instead, aim to have as few metrics—that give you actionable, accurate information—as possible and base your decisions on those.
Scenario: You’re trying to assess the effectiveness of your current content marketing strategy.
In order to do that, we’ll need more than a single metric.
For reasons we reviewed earlier, traffic and email subscribers aren’t the best metrics here (although they may be the only choice for young blogs).
Instead, we’d rather focus on either qualified leads or actual sales if possible.
A qualified lead is different for every business. For example, it might be a webinar participant.
Someone who signs up and attends a webinar is obviously interested in the topics you cover and is likely a potential customer. This is enough to make them qualified.
This metric is useful because the more attendees you have, the more sales you should make. Unlike traffic, where more doesn’t always mean better, qualified leads correlate well with sales.
Therefore, our first metric is the # of webinar attendees.
But that’s not enough. It doesn’t tell us the whole picture.
The number of webinar attendees could increase, but that doesn’t mean the content marketing is succeeding.
Instead, it’s possible that most of those results are from your past work, unrelated to your current content marketing strategy.
Or it’s possible that you’ve learned to promote webinars more effectively through other channels than just content.
So, we need additional metrics.
The first one is to divide your webinar signups by source. You want to see which piece of content each signup initially landed on.
The ones that come from your recent content will tell you whether your current strategy is actually producing results.
Once you have this data over at least a few months, it will be clear which content drives your visitors through your sales funnel.
What about your promotional tactics?
You need some metric that standardizes your signups. After all, if you create a new pop-up twice as effective as your old opt-in, that doesn’t mean your new content is twice as effective.
Therefore, your final metric in this set must be scaling.
Before fully implementing a new tactic to get more webinar signups, do a split test against the old one.
Once you have a sufficient sample size, you’ll have results that’ll look like this:
Based on these results, with almost 100% certainty, we can tell that the new tactic is better.
However, the improvement has ranged from 177% to 323%.
Ideally, keep running the test until you have a tighter range, but the average number is usually the best choice.
Overall, you have a few options:
- Take the worst-case scenario (only improved by 177%)
- Take the average (250%)
- Take the best-case scenario (improved by 323%)
You could also take a combination.
Based on each of these, you get a scaling factor by dividing these numbers by 100 (to convert from percent to decimal):
- 177% becomes 1.7
- 250% becomes 2.5
- 323% becomes 3.23
Then, you need to multiply the number of webinar leads you previously had by the number you chose.
For example, pretend that these are your original results and that you implemented the new and more effective tactic in April:
| Feb | March | Apr | May | |
| Webinar leads | 100 | 120 | 325 | 360 |
| After 2.5x adjustment | 250 | 300 | 325 | 360 |
Notice that you adjust the values for the months that used the old, ineffective method by multiplying them by the scaling factor.
Now you can make a fair comparison.
In this case, a 2.5x adjustment shows a steady growth in the number of webinar leads.
After considering all possible factors that could skew our original metric, we now have a set of metrics that we can use to determine whether our hypothetical content marketing strategy is effective or not:
- Number of webinar leads (original metric)
- Webinar leads by source
- Scaling factor based on promotional methods (could be more than one)
How to come up with your own sets of metrics: We understand that this isn’t the easiest thing to do, but it will get easier with practice.
To simplify things, let’s break this process down into a procedure.
Take it step by step, and it won’t be very difficult.
- Clarify what you’re trying to determine (a goal of sorts).
- Determine your primary metric, the most important one directly related to your goal.
- Brainstorm situations where your primary metric could be positive but not indicative of the results (, content marketing not improving even if webinar leads increased).
- Come up with at least one metric that will help you determine whether those situations happened (they are essentially safeguards).
- Write down your final set of metrics, and monitor it on a continuous basis.
Now, when you need to decide or draw a conclusion based on your metrics, you can be confident that it’s right.
3. You can’t measure everything
Some things are easy to measure…
But others are extremely difficult.
Generally, quantitative things, like the number of customers, views, or dollars, will be straightforward to measure.
But what about qualitative things like customer satisfaction? Or if you want to measure how much of an impact your content makes.
You can’t just go into Google Analytics and find a customer satisfaction metric.
So, what do you do?
Your only choice is to find the best metrics representing what you are trying to quantify. It’s not perfect, but it gives you something concrete to base your decisions on.
Finding the next best thing: We’ve already looked at this to some extent. When you can’t measure something directly, you find other metrics that measure things that correspond with your main concern.
For example, you might not be able to measure sales directly. Sales may not occur for an extended time, and you want to ensure you’re on track.
So, you measure the next best thing: qualified leads.
These could be webinar attendees, like we mentioned earlier, or they could be email subscribers.
You need to be careful with this because they must be qualified leads. A random email address or one that you get, because the user wants a free bonus is not qualified.
However, they are likely potential customers if they request a demo or opt-in without any bonus.
The reason why this distinction is so important is because qualified leads will correspond to revenue. The more qualified leads you have, the more you will make fairly linearly.
However, unqualified leads may or may not correspond with revenue. It’s really difficult to determine how much more money, if any, additional leads will make you.
The takeaway here is to find a metric that corresponds closely with your goal.
This applies to both quantitative (like revenue) and qualitative aspects.
Consider customer satisfaction. What metrics are related to it? Here are a few possibilities:
- Results from surveys given to customers
- Return customer rate
- Complaint rate or number of complaints
None of these are perfect solutions, but if you combine them, you’ll get a pretty good idea of of whether your customers are happy.
Beware of sample bias: One of the biggest issues with this type of approach is that you have a sample bias.
For example, customers who’ve had a very negative or very positive experience are the most likely to fill out your surveys.
And while it’s good to hear from them, you also want to hear from the rest of your customers. Your average customer is arguably the most important one.
You’ll get a sample bias with many metrics describing your business’s qualitative aspects.
Take your return customer rate.
Customers who buy something else from you are probably pretty happy. Then again, just because someone doesn’t buy from you doesn’t mean they are unhappy.
Additionally, someone might not be very satisfied but still buy again from you because of some other reason like price or lack of other options.
What does this mean for you?
It means that none of these metrics are perfect. Taking multiple factors into account will help give you a more accurate picture, but even that’s not enough.
Understanding your sampling biases is the only effective way of dealing with this.
For example, when it comes to survey results, put the most weight on the ones that aren’t especially negative or positive. Each of these likely represents several other customers who didn’t complete a survey.
Likewise, put less weight on the extremely positive or negative surveys because you hear from a much larger proportion of these types of customers.
Consider the potential issues you might have with your samples, and emphasise those areas that don’t provide you with much information.
4. Metrics can be manipulated, so make sure you know how you track them
Judging work performance using metrics can be a very dangerous thing to do.
The clearest example of this can be found in fast-food restaurants and retail stores.
Managers and employees are told to meet certain quotas, e.g., food delivery times or number of sales, or else they risk being penalized or even fired.
When you take that approach, you shouldn’t be shocked to find out that employees are willing to manipulate metrics however they can.
They will start timers late or create fake accounts (to be cancelled later) to meet those quotas (yes, those kinds of things happen).
While you may not take that approach with your team, maybe you give out raises, promotions, or something else to those who meet a certain performance metric.
Metrics are thought to be a way to track employee performance.
But they are often easily manipulated.
The good news is that if you chose useful metrics (from part 1), you are tracking harder-to-manipulate metrics.
But consider vanity metrics such as social shares or traffic.
If you told a writer or social media manager to get a certain number of social shares on each post, many would create fake Twitter accounts and schedule them to share each post 10+ times.
Of course, this wouldn’t lead to real traffic for you, but it looks good on their metrics.
The same goes for traffic. It’s easy to buy hundreds of junk views for pennies even though they’re completely useless. You’ll see plenty of these gigs on Fiverr:
The best solution is to pick difficult-to-manipulate metrics, like profit, and not judge your team members solely on metrics. Metrics should primarily be used as feedback that guides how you spend your effort.
However, if you do decide to incorporate metrics into performance evaluations, you should know how to track them accurately.
For example, if you’re looking at social shares, you must specify a certain expectation. You could say that only one social share per social account counts towards the metric and that the account needs to have at least 50 followers.
You must create a simple tracking system to track something like this.
For views, you might only count the ones that don’t bounce or are from certain countries. If you suspect fake views might be a problem, you probably wouldn’t want to count traffic from countries like India, which is often used for view bot IP addresses.
5. Metrics don’t always lie, but they can easily be misinterpreted
Metrics are important, but they must be recorded and interpreted correctly, or you risk making big mistakes.
All marketers and business owners should have at least a basic understanding of statistics.
Most importantly, you need to understand concepts such as variance.
Variance measures how far results can deviate from the average expected result.
For example, you might use a specific email outreach template and track the number of backlinks it generates for your content.
Let’s say you get five links from the first 100 emails you send.
Does that mean that you’ll get five for every 100 emails you send from now on?
Not at all.
Depending on how big the variance is, sometimes you might only get one link, and other times you might get 10 links.
Imagine that the first time you sent 100 emails, knowing that you’d judge the results based on your links metric, you only got one link. If you judge your results immediately, you’d say this email template sucks.
But as you send more and more emails, your link percentage will rise to the average expected value.
In other words, you need to have a valid sample size before interpreting results; otherwise, they mean nothing.
When you go through an introductory stats course, you’ll learn about variance, sample size, and other related concepts.
The main takeaway here is to first learn about basic statistics and then to ensure that your metrics are accurate before you take them into account.
Conclusion
You should rarely make decisions concerning your business or marketing based on gut feeling alone.
Metrics give you confidence to make decisions because you know that you have numbers to back you up.
However, it’s crucial that you choose the right metrics and know how to track and understand them correctly. If you don’t, you’ll end up drawing incorrect conclusions, which are bad for your marketing and business as a whole.
We’ve shown you the five main ways that metrics can play tricks on you and ways to avoid making the wrong decisions based on them.