An Inside Look At What Google’s Search Quality Raters Do

google-logoOne of the long-standing myths about Google’s search results is that they’re completely computer-generated with no human input or involvement whatsover. But, since at least 2005, Google has had a program that involves regular searchers reviewing the quality of their search results.

There are several different job titles involved, but the people who get paid to review Google’s search results are commonly called Quality Raters.

Their work has largely been a mystery over the years, but over on Search Engine Land, we’ve just published what might be the first of its kind — an interview with a Google Search Quality Rater.

It’s a lengthy Q&A, but you’ll likely find it worth the time if you’re interested in search marketing. Some of the key takeaways:

  • Raters are only hired after passing two tests, the second of which includes rating more than 140 different Google search results and demands a 90 percent score in order to pass.
  • Each rating task is completed by multiple raters and, if they disagree in their ratings of Google’s search results, there’s a formal discussion and debate process that may involve higher-level moderators making the final decision on who’s correct.
  • Raters don’t only look at Google’s organic results, they may rate Google’s paid search results as well as search results from News, Maps and other Google “universal search” products.
  • Raters may also have tasks that involve grading the design and layout of specific web pages. One of the key considerations in those tasks involves the balance between content and ads on a page. (That’s reminiscent of Google’s new page layout algorithm that was just announced on Thursday.)
  • Tasks are not tailored to the Rater’s skills or interests.

That’s a taste of what the interview covers. You can read the entire piece on Search Engine Land: An Interview With A Google Search Quality Rater.

Related Topics: Channel: Search Marketing | Google: SEO | Search Marketing


About The Author: is Editor-In-Chief of Marketing Land. His news career includes time spent in TV, radio, and print journalism. His web career continues to include a small number of SEO and social media consulting clients, as well as regular speaking engagements at marketing events around the US. He blogs at Small Business Search Marketing and can be found on Twitter at @MattMcGee and/or on Google Plus. You can read Matt's disclosures on his personal blog.

Connect with the author via: Email | Twitter | Google+ | LinkedIn


SMX - Search Marketing Expo

Marketing Day:

Get the top marketing stories daily!  

Like This Story? Please Share!

Other ways to share:

Like Our Site? Follow Us!

Subscribe to Our Feed! Join our LinkedIn Group Check out our Tumblr! See us on Pinterest Get Marketing Land on your mobile device!
 

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. You can read more about our comments policy here.

Comments are closed.

Get Our News, Everywhere!

 
  • Advertise With Us
 

Learn a lot from reading Marketing Land and Search Engine Land? Attend our conferences!

Our SMX events deliver the most comprehensive educational and networking experiences for internet marketers, whether you're a seasoned expert or just starting out.

Click to watch SMX conference video

Join us at an upcoming SMX event: