Google's new method to detect duplicate content

Welcome to the latest issue of the Search Engine Facts newsletter.

This week, we're taking a look at Google's new method to detect duplicate content.

In the news: paid search statistics, Yahoo updates its ranking algorithm, Google gets less paid clicks, how click fraud works in India and more.

Table of contents:

• Facts of the week
• Search engine news of the week
• Articles of the week
• Miscellaneous
• Win a $100 Amazon coupon
• Previous articles

We hope that you enjoy this newsletter and that it helps you to get more out of your website. Please pass this newsletter on to your friends.

Best regards,

1. Google's new method to detect duplicate content

Google doesn't like duplicate content. The reason for that is that the top 10 search results should offer users a choice of different web pages. Google's new patent application on near duplicate content describes a new method how Google tries to keep its users from finding redundant content in the result pages. Content may be duplicated for a variety of reasons There are many reasons why content is duplicated on more than one page, or why documents are very similar: The content of a web page is available in different formats: web page, printable page, PDF, mobile phone page, etc. The content of a web page is syndicated, for example news articles or blog posts. The content management system (CMS) displays the same content in different locations. For example, an item might be listed in a "Size" category and in a "Color" category. The website owner offers mirrors to make sure that a website does not slow down when many people want to access the same page at the same time. Someone stole the contents of a web page to reproduce it on other websites. To avoid showing the same content more than once in the search results, search engines try to detect these duplicate pages. What's in the patent application? The patent application describes how Google tries to detect duplicate or near duplicate content at different web addresses. It seems that Google might combine several existing methods for detecting new duplicate content to identify more duplicates on the Internet. The new patent application shows that Google is serious about detecting duplicate content issues. This new patent application is only the latest step in Google's attempts to detect duplicate content. For example, previous steps can be found here (PDF) and here. What does Google do when it detects duplicate content? It's hard to tell what Google will do when they find duplicate pages. There are many instances where duplicated content is used for a legitimate purpose. If Google only removes the duplicate pages from the search results for a certain query that might be okay. If Google penalized duplicate pages by removing them completely from the index, Google might risk not being relevant for very specific queries and it also might penalize the wrong pages. It's likely that Google will pick the web page with the best reputation and the best inbound links for the search results if it finds more than one page with the same content. What does this mean for your website? If you want to get high rankings, it is easier to do so with unique content. Try to use as much original content as possible on your web pages. If your website must use the same content as another website, make sure that your website has better inbound links than the other websites that carry the same content. Back to table of contents - Visit Axandra.com

2. Search engine news of the week

Feb '08 paid search market share: Google gains, Yahoo loses, economic slowdown not observed "From January 2008 to February 2008, Google picked up 2.3 points of ad spend share. Google’s growth came at the expense of Yahoo (down 1.6 points), Microsoft (down 0.6 points), and Ask (down 0.1 points). [...] Comparing February 2008 to February 2007, we did not observe evidence of an advertising or sales slow-down: median same-client Google ad-spend was up 22% year-over-year, and corresponding same-client resulting PPC sales were up 26%." Ask.com not planning to scrap search "Online search site Ask.com is not getting rid of its specialized search technology, a source familiar with the matter said on Friday, saying a blog report to that effect was incorrect." Yahoo updates its ranking algorithm "We're in the process of rolling out some changes to our crawling, indexing and ranking algorithms. While we expect the update will be completed soon, as you know, throughout this process you may see some ranking changes and page shuffling in the index." Search engine newslets Spammers invade Google Calendar. My stunted interview with Google's Eric Schmidt. Microsoft: Google is our only competitor in ad-platform game. Google formally announces Google Health. How Google is handling the UK earthquake. Back to table of contents - Visit Axandra.com

3. Articles of the week

Why Google's surprising paid click data are less surprising "Earlier this week, comScore released its January 2008 qSearch paid click report, which showed a 7% sequential decline vs. December ‘07, and a flat annual growth in paid clicks for Google. Moreover, the number of paid clicks per Google search query declined by 8% from December to January, suggesting that consumers are clicking less on search ads, possibly reflecting a weaker buying appetite." Related: Google to ComScore: You owe us $15-billion, Google: the hollow echo of a click, Google housecleaning explains ad drop AdSense click fraud in India - how the whole system works "A recent report on Click Fraud suggests that the maximum number of invalid clicks on Pay Per Click ads originate from India. And this is not the first time - its widely believed there there exists a large 'work from home' crowd in India who want to generate 'quick cash' by clicking Google AdSense ads." Yahoo set to open its search engine to third parties "Code-named 'Search Monkey,' the new open-source application programming interfaces (API) that Yahoo is slated to detail today will allow Web site owners to add information such as ratings and reviews, images, deep links and other data directly to the Yahoo Search results Web page." Back to table of contents - Visit Axandra.com

4. Miscellaneous

"IBP brought my website to number 1 on Google " "IBP brought my website hypermiling.com to number 1 on Google last December 2007, then after that my website became an authority hub on Google, for the search term hypermiling. As a result of IBP my site has been noticed by many TV news stations around the USA as well as times of london & the websites of slate & wired." Steve Chafe, Hypermiling.com "We are very happy with IBP and can recommend it to everyone." "IBP pushed our agency website within a few weeks on very high positions in google and yahoo. That's amazing. IBP is very easy to handle and helped us to save a lot of money for hiring an external SEO expert. We are very happy with IBP and can recommend it to everyone. We can already feel our increased sales due to our better positions. Great product!!!" Harald Eberl, Stockfood.com Back to table of contents - Visit Axandra.com

5. Tell us what you think about IBP 10 and win a $100 Amazon coupon

We're looking for feedback to IBP version 10. Tell us how IBP has helped to improve your online business.

The names of all participants will be entered into a raffle for a $100 Amazon coupon. Thank you for helping us make IBP the best SEO tool!

Back to table of contents - Visit Axandra.com