Yes, Digg Was Dropped From Google Briefly, Back Now

digg-logo-144pxSome have noticed that pages from Digg were no longer appearing in Google today. Both the social media news site and Google confirm this was the case, due to mistaken malware issue. It’s now been solved.

Matt Sawyer tweeted that Digg seemed to be off Google earlier today, and it was picked up by State Of Search and even Hacker News.

Digg: We’re Not Malware

Digg told us that the cause seemed to be that pages from Digg’s previous life continue to link to content from across the web — some of which may become malware infected — which causes Digg itself to have issues with Google.

Digg president Andrew McLaughlin emailed to say:

Digg got de-indexed this morning, but that will get fixed shortly (we’re in active touch with Google’s indexing and malware teams).

The cause appears to be the fact that the new, relaunched Digg continues to provide link resolution for all the redirect links from the old, legacy Digg (circa 2004-2012), and occasionally one of the target webpages (i.e., a target that we don’t control) gets infected with malware. When that happens, we can get dinged as a link of redirection to malware.

We maintain the legacy Digg link resolution service essentially as a public service, even though it doesn’t relate to our current business at all.  We try to stay on top of the malware reports, but they aren’t automated and this morning there was evidently some kind of surge that triggered de-indexing by Google.

He added:

Not to minimize de-indexing, but nearly all of Digg’s current traffic comes direct, not from search. (Currently, the Digg site consists of our homepage and about 40 topic pages like http://www.digg.com/tag/cars)

Google: Our Mistake

While I was writing this up, I noticed a tweet from the head of Google’s web spam team, Matt Cutts, pointing to a statement he posted on Hacker News:

We were tackling a spammer and inadvertently took action on the root page of digg.com.

Here’s the official statement from Google:

“We’re sorry about the inconvenience this morning to people trying to search for Digg. In the process of removing a spammy submitted link on Digg.com, we inadvertently applied the webspam action to the whole site. We’re correcting this, and the fix should be deployed shortly.”

From talking to the relevant engineer, I think digg.com should be fully back in our results within 15 minutes or so. After that, we’ll be looking into what protections or process improvements would make this less likely to happen in the future.

It actually wasn’t just the root page of Digg. That was dropped, but so were all the pages from Digg when I (and others) checked earlier today.

At least Google didn’t mark the entire web as malware. Yep, it did that once, back in 2009: Google Gets Fearful, Flags Entire Internet As Malware Briefly.

FYI, for site owners suspected of being malware, Google launched a new help area last week. Our Search Engine Land article explains more: Google Launches Help Center For Hacked Sites

Postscript: That was fast. Digg is now back in Google, with over 1 million pages listed:

site_digg.com - Google Search

Related Topics: Channel: Social Media Marketing | Digg | Features & Analysis

Sponsored


About The Author: is Founding Editor of Marketing Land. He’s a widely cited authority on search marketing and internet marketing issues, who has covered the space since 1996. Danny also serves as Chief Content Officer for Third Door Media, which publishes Search Engine Land and produces the SMX: Search Marketing Expo conference series. He has a personal blog called Daggle (and keeps his disclosures page there). He can be found on Facebook, Google + and microblogs on Twitter as @dannysullivan.

Connect with the author via: Email | Twitter | Google+ | LinkedIn



Marketing Day:

Get the top marketing stories daily!  

Share

Other ways to share:
 

Read before commenting! We welcome constructive comments and allow any that meet our common sense criteria. This means being respectful and polite to others. It means providing helpful information that contributes to a story or discussion. It means leaving links only that substantially add further to a discussion. Comments using foul language, being disrespectful to others or otherwise violating what we believe are common sense standards of discussion will be deleted. You can read more about our comments policy here.
  • http://twitter.com/abhinavnarry abhinav narry

    good to see Digg indexed in search again.

  • http://www.cbil360.com/ Web Design Company

    Digg is one of the favorite social bookmarking websites among all where every SEO professional ready to submit their sites. Happy to see Digg index in search engine again.

Get Our News, Everywhere!

Daily Email:

Follow Marketing Land on Twitter @marketingland Like Marketing Land on Facebook Follow Marketing Land on Google+ Subscribe to Our Feed! Join our LinkedIn Group Check out our Tumblr! See us on Pinterest

 
 

Click to watch SMX conference video

Join us at one of our SMX or MarTech events:

United States

Europe

Australia & China

Learn more about: SMX | MarTech


Free Daily Marketing News!

Marketing Day is a once-per-day newsletter update - sign up below and get the news delivered to you!