For those of you with good memories, you’ll recall that I have been blogging a series of startup tips. I’ve previously done tips 1-6 of twelve startup tips that I derived from my Techstars experiences.
This tip is about “core metrics.” I think most startups should have 2 or 3 core metrics that they use consistently to evaluate their business. If you have many more, then it’s hard to focus your efforts. Having just one probably oversimplifies things. So 2-3 core metrics is a good rule of thumb.
I’ll give you an example from last summer. Intense Debate is a company from Techstars 2007 that replaces the crappy built in comment system on most blogs. Subsequently, it drives subscriber engagement and page views. Early on in the life of the company, we often talked about the number of publishers (blogs) using the service. It was a metric everyone had in their heads. We also obsessed over “number of commenters per post” early on. We thought that improving engagement primarily meant getting new people into the conversation. At first glance, these seem like reasonable metrics. But we quickly learned that they’re lousy metrics, and certainly not metrics that we want to orient the business around.
Think about it for a minute. Should they go out and just get every tiny little publisher as a goal? Is Intense Debate really “about” number of publishers? Does that somehow increase the value they create? Sure, it’s nice to improve more and more blogs, but in the end they needed to monetize the service somehow. Number of publishers and commenters per post were quickly replaced as a core metrics for the company with core metrics like “total comments per post” (subtle difference – who cares how many commenters there are) and “page views per post.” If you’re a blogger, I’m sure you’ll recognize that comments per post and page views per post are good things to be focused on.
It turns out that Intense Debate has an enormous impact on both of these core metrics where substantial existing communities are present. We quickly learned that comment systems don’t (necessarily) create user engagement. Instead, where there is already user engagement, they enhance it greatly.
This meant that it was doubly important for us to focus on the new core metrics, not the original ones that we theorized might be true. It seems so obvious looking back. However, for many early stage web startups I meet, they appear to be obsessing over either a) nothing, or b) seemingly inappropriate core metrics.
So the first point here is: Obsess over the correct core metrics. Harder than it sounds.
The second point is to actually obsess over them. Everyone in the company should know the current values of these core metrics. Experiments should be undertaken with the goal of manipulating them.
One of the tactics that we regularly use with Techstars companies is that we insist that they build core metrics into the product very early on. In my experience, there’s a definite correlation between building measurements for these core metrics right into the product and long term success. It turns out that it’s very easy to build these sorts of measurement and reporting systems into the product early on. But it’s often surprisingly difficult to do it later on once the product is sufficiently complex. So the lesson is simply: Build in automated reporting systems for your core metrics very early on.
Most Techstars companies with products in alpha, beta, or launch phase have a daily email that goes around to the founders and mentors with detailed statistics relating to their core metrics. Those that don’t often send weekly updates with this information. They make their core metrics visible. When things change in a major way, they’re often asked what moved the needle. It’s like the old adage: If you don’t measure it, you can’t improve it. So stick them in everyone’s face!
In my opinion, the best startups have 2 or 3 metrics that represent true drivers of their business, and they literally obsess over understanding and improving those numbers on a day to day basis.
What are your core metrics? How do you report and communicate them?
