The times is one of the most powerful websites for publishing news and content in the UK and today it disapeared from Google!
Many other internet explorers spotted this and commented as this could be a trial for when the paywall comes up. Murdoch wants Google to stop stealing his websites content.
Having looked at the website their was no obvious tags such as no index in the robots.txt or the METAs which would cause the site to not be crawled. I don't know what happened but this afternoon the times went from having no pages indexed to 250,000 pages indexed. This could be a technical blip, a trial for the paywall, or has Google spat it's dummy out and decided to show the Times how much they really need Google.
The funny thing was Google news was still picking up the stories and some of the subdomains were still getting cached and indexed.
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment