Want to measure organic traffic? Just take the number of Google Webmaster Tools clicks, average out the CTR by position across all of them, then take the broad match volume of all those terms (because that’s the only volume Google will give you), and then take your position and divide it by CTR and volume. And viola! There’s your traffic by keyword.

Sound kinda crazy? It is. But it doesn’t have to be that way.Follow Hashtags and Keywords

A Growing Darkness

If the above “crazy math” sounds a bit familiar, you aren’t alone. Many digital marketers are using similar methods as an SEO reporting solution now that Google has killed off organic keyword data.

In case you missed it, Google’s blackout on organic data started about two years ago. Back then, it began serving the search results pages over https, aka Secure Search. In doing so, it removed the referrer information from the headers, which, of course, wiped out the keyword-level data SEOs relied upon.

Soon, we started to see the appearance of (Not Provided) in our analytics platforms. And recently, Google quietly switched to 100% Secure Search. This move increased the percentage of (Not Provided) even further, and caused us to lose nearly all keyword-level data from Google. In fact, today some platforms are unable to get any organic data at all, or to measure the volume of organic traffic vs. other channels.

Chaos Has Arrived

Google’s blackout on organic data has left digital marketers scrambling for SEO reporting solutions. Now, established KPIs have to be reevaluated, and every SEO, agency, and tool company has had to develop their own unique approach to calculating and measuring organic traffic. In other words, they’re using their own form of crazy math.

Granted, the SEO industry has always been very creative about defining KPIs and measurements, but now it is happening at the micro-level. Measurements and methodologies are being established on an agency-by-agency — or even person-by-person — basis. For example, I was in a meeting the other day where keyword-specific traffic was calculated based on rankings and search volume.

Unfortunately, all this scrambling for working reporting solutions is creating chaos in the industry. For starters, I’ve found that many brands are panicking as they struggle to understand the implications of the change. Even brands that never ever used or looked at keyword-level data are panicked and asking “what will you do now?”

And of course, the tool vendors are scrambling, too. Many of them relied on their integration with analytics platforms to report and evaluate on keyword-level data. But given the change, they are now using rankings, average CTR, and volume to calculate potential current traffic.

The change has also seriously impacted SEO operations as data and reporting is one of the most time-consuming tasks in search. Agencies that have invested considerable time, resources and money developing reporting tools and platforms will now have to rebuild and establish new KPIs that align with each brand.

A Better Approach

I’ve heard some interesting workaround solutions to the blackout on organic data situation, such as substituting paid data or solely using Webmaster Tools data. And I applaud the creative efforts SEOs are putting forth to meet this new challenge. But I think it’s time for a different approach.

I think the future of SEO reporting needs a more uniform, industry-wide solution. I’d like to see the SEO industry come together to define SEO standards and measurements via SEMPO or another organization.

Having a central SEO authority would be a great step forward in establishing SEO as an official industry. I can see it playing a similar role to 4A’s or the IAB. It can establish standards, define roles and engagements more clearly, and regulate as a centralized voice. And maybe — just maybe — become the link to Google we all have been hoping for.

Moving Forward

As we muddle our way through this dark time without organic keyword data, keep the suggestions below in mind:

  • Differentiate: When using CTR data, make sure you are aware of the differences in CTR when using branded terms vs. unbranded, as they are dramatically different. If you want to leverage your CTR to get keyword traffic share, I suggest you do your own analysis based on Webmaster Tools data, and group results by intent or funnel position so you can get a more accurate number.
  • Realize: Trust me; there are no tricks or secrets to get around Google’s blackout on organic data. This is a limitation of SSL, or more accurately, a feature of SSL. There is no secret button or relationship with Google that could enable you to get access to your organic data. It’s a simple measure of hiding referral data for privacy reasons.
  • Leverage Paid: If you are looking for engagement by keyword data, then paid search is your best bet. Paid search still allows you to see the keyword-level page data. How? All the Google paid landing page URLs contain either the gclid or utm parameters, which contain the keyword data. And instead of a result being index.html, it is index.html?utm_term=keyword, etc.
  • Appeal to Google: The best thing Google could do is automatically attach a URL string to the landing page that contains that information (just like in paid search). This wouldn’t be hard for them to execute, and it wouldn’t have a negative effect on the user experience or security. But it would allow SEOs to get access again to that valuable data.
  • Focus on Content: Google has been making some big adjustments lately. This can be seen in Hummingbird and other changes such as SSL. But keep in mind that search is about intent, and intent engagement is based on the content. Given that, stop looking through the keyword lens. Instead, look through the content and intent lenses. Ask yourself what your users want and whether your content answers their questions.
  • Seek Alternate Insights: Considering Google’s propensity to take away data sources, I started looking at other signals and indicators a long time ago. Location data is a great example of an alternate source for insights. We recently starting talking to companies like Placed.com. They use massive panels that enable always-on location data. This can help you see what days and time your audiences shop, research, and engage in various activities. This could help you better understand consumer behavior and interest.

Time For Change

Historically, the SEO industry has shown great creativity in developing KPIs and measurements. I’m hopeful that it will see Google’s blackout on organic data as an opportunity to come together and define new standards and support for the future of SEO reporting. Perhaps we need to start an online petition for an industry-wide solution. Or at the very least, make this a top priority for discussion at upcoming SEO conferences.

How are you adapting to Google’s blackout on organic keyword data? Do you think the industry should come together for a uniform solution?

Opinions expressed in the article are those of the guest author and not necessarily Marketing Land.

Related Topics: Analytics & Marketing Column | Channel: Analytics

Sponsored


About The Author: is Director of SEO Operations for Catalyst, a leading search engine marketing firm that delivers digital marketing solutions for Fortune 500 and Fortune 1000 organizations. Spiegel defines the organic search process at Catalyst, creates and enhances the agency’s SEO offerings, and oversees teams of SEO practitioners who deliver strategic counsel and tactical input for SEO initiatives.



Sign Up To Get This Newsletter Via Email:  


Share

Other ways to share:

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. You can read more about our comments policy here.
  • Joshua Butler

    Thank you for these thoughts. We’ve taken the “Focus on Content” approach. With the updates of 100% (not provided) and Hummingbird, we’ve found that landing page entrances will be our closest substitute for keyword traffic reporting. However, along with Hummingbird, it’s going to be difficult to know if the head terms are performing better, or if the long tail is performing better. The way to tie this back together is to review Google Webmaster Tools landing pages reporting, and identify the top contributing keywords. Unfortunately Google Webmaster Tools is vague, and for websites with massive amounts of content and traffic GWT is much too blurry to provide specific insights.
    I’m really hoping that GWT is updated to have more specific reporting, and with a much longer archive history.

  • http://www.seo-theory.com/ Michael Martinez

    Just out of curiosity. how do you take the average of “-”, which is the CTR for “<10"?

  • disqus_Xaj08UB0Dl

    “I think the future of SEO reporting needs a more uniform, industry-wide
    solution. I’d like to see the SEO industry come together to define SEO
    standards and measurements via SEMPO or another organization.” AMEN!!! It boggles my mind why this hasn’t happened to date

  • http://blog.clayburngriffin.com/ Clayburn Griffin

    I think losing keyword data will be a good thing for the SEO industry, but I will miss the entertainment of looking through what crazy keywords people are using to find my blog.

  • Pel Abbott

    I tried to sign up for your e-newsletter and it told me my email wasn’t valid. Just sayin you might want to fix that.

  • Philip DiPatrizio

    You said that Keyword Planner gives broad match search volume but that’s incorrect. This is straight from Google’s support page on Keyword Planner:

    “With Keyword Tool, we showed you broad match statistics by default with the ability to get data for other match types, like phrase and exact match. But with Keyword Planner, you’ll get historical statistics only for exact match.”

  • http://www.benspiegel.com/ Benjamin Spiegel

    Hello Michael, there are a couple of different solutions for “interpreting” the data that is “<10". My favorite one is to leverage the Avg. Position.

    So lets say the Average position 2.5 and you had 100 Impressions and <10 clicks. In that case i would get the average CTR for Position 2 (keep in mind the difference for a Branded vs Unbranded Terms: http://www.catalystsearchmarketing.com/unbranded-queries-higher-click-rate-branded-queries/ ). That would give me an avg. CTR of 8.2 and 8 Clicks ;) makes sense?

 

Get Our News, Everywhere!

Daily Email:

Follow Marketing Land on Twitter @marketingland Like Marketing Land on Facebook Follow Marketing Land on Google+ Subscribe to Our Feed! Join our LinkedIn Group Check out our Tumblr! See us on Pinterest

 
 

Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States

Europe

Australia & China

Learn more about: SMX | MarTech


Free Daily Marketing News!

Marketing Day is a once-per-day newsletter update - sign up below and get the news delivered to you!