Get Free Quote
« Eyetracking Research... | Blog home | Friday Recap: Chasing... »
August 20, 2010

Duplicate content at Search Engine Strategies San Francisco

  • Print Friendly

Shari Thurrow, Founder and SEO Director at Omni Marketing Interactive is up again

Ok let’s get down to business: Search Engines hate duplicate content, because users hate duplicate content.

Website content should be findable via:

  1. Browsing (from the home pages)
  2. Querying (search engines, social sites, video sites)
  3. Asking (refers, friends, family)

When you put too many links on the page, the user is faced with too much choice and the important pages are hard to find. If you don’t put enough pages, search engines filter out duplicate content at multiple places through the crawling and indexing process. They filter out URLs at the shingles (word sets), if the word sets are the same on multiple pages they will be considered duplicate content – even if it’s out of order or totally scrambled.

Dealing with duplicate content:

  1. IA – make sure of your site navigation
  2. Robots.txt – are you preventing your site from being crawled? Shari was consulting on a job where the dev team was laid off, the last thing they did was to no index the entire site before taking redundancy – LOL.
  3. Robots meta tags
  4. Canonical tags – Shari recons it sucks. She thinks that the reasons the search engines want you to use the canonical tags is because they don’t know what to do with the PageRank – interesting idea. I think both have their place.

Up next is Kathleen Pitcher from Pogo.com about her experience with Duplicate Content

Sometimes, when you duplicate a particular item it can be a good thing (for example if you walk into a cup cake store you can’t just walk out with one – all the pretty options make you want to buy lots of them!)

Pogo.com is an online gaming site. The big question: is duplicate content good or bad for search engine optimisation?

There is naughty duplicate content, or nice duplicate content.

Examples of nice duplicate content include:

  • Blog RSS
  • Canonical issues
  • Print versions
  • Multiple products that belong to different categories

These are all legitimate (KG: but still possibly harming) examples of duplicate content.

Naughty duplicate content is black hat, for example taking the same content and spinning it out across multiple domains hoping to get some value from it all. Or even stealing content from another site and putting it up as if it is your own.

If you have duplicate content you might see some of the following symptoms:

  • Visibility decrease
  • Less desired version ranking
  • Content filtered
  • Content based algorithmic factors

Examples of Pogo duplicate content:

Pogo had duplicate content, particularly games appearing at different locations. They prevented this by means of user agent detection: if a bot appeared they sent it the clean URL, and if a user appeared they sent the URL with the tracking code. Pogo also used canonical meta tags to ‘fess up’ to search engines about their duplicate content.

Pogo also had loads of user pages where people didn’t enter their unique information; the only difference on thousands of pages was the avatar photo. In the end to remove all these highly similar pages, they put a block in the robots.txt file.

Pogo also had multiple games that were very similar pages. The games pages didn’t rank properly because they didn’t have proper descriptions. The solution: Pogo rolled up their sleeves and wrote unique pages of content for each of the games pages. And the results: excellent. 198% increase in traffic for the term ‘online games’.

Kathleen’s best practices

Do you have duplicate content?

  • Ask yourself is each page valuable?
  • Is it naughty or nice?

Leverage resources

  • Talk to your agency
  • Talk to your departments
  • Review webmaster forums
  • Talk to industry peers

Be proactive

  • Write unique page content
  • If you have duplicate content then find your authority pages

Manage syndicated content effectively

  • Give yourself lots of time to get your content indexed before your affiliates
  • Make sure you don’t let syndicators use your keyword rich meta data

Michael Gray of Graywolf

Michael starts out by saying that if you can’t get a link to your original content from your syndicator don’t worry too much. My ear’s prick up because this is not what I have heard from other trusted SEOs. You can link back to them and it will be ok, provided they are a more trustworthy site than you are.

If your content is on another site, just change the title and re-write a small section to get credit for both lots of content.

Graywolf’s black hat techniques:

  • It is possible to outrank someone for their own content: just grab their content, point links to it and make it more trusted than the original source
  • Most web scrapers are stupid: they leave the links in the content. As the little links from scrapers add up they start to count. Support them with good quality links. Mix up the anchor text and surrounding content.

That’s Michael all done, short and sweet.

  • Print Friendly




7 responses to “Duplicate content at Search Engine Strategies San Francisco”

  1. ale writes:

    nice article! who is the guy stretching ?
    :-)

  2. SubmitYOURArticle.com writes:

    Nice discussion about dealing with duplicate content. If you have an article, it would most probably be inevitable for it not to be copied by someone else. But what should be done to beat those using duplicate content?

  3. web marketing melbourne writes:

    While choosing an SEO company its equally important to analyze the SEO company’s website in terms of their Rankings, Yahoo links, Google index, Alexa ranking and similar such factors which indicates the company’s expertise in the field of SEO. So make sure you are doing enough research and smart work and shelter for duplicate contents…

  4. virginia seo writes:

    Posting duplicate content is a massive waste on crawling resources. And when crawling non-relevant stuff – the good content might not get indexed. If a website has no unique content at all – it should be penalized.

  5. vimax writes:

    I thought it was going to be some boring old post, but it really compensated for my time. I will post a link to this page on my blog. I am sure my visitors will find that very useful

  6. dodawanie writes:

    Excellent blog here! Also your web site loads up fast! What web host are you using? Can I get your affiliate link to your host? I wish my website loaded up as fast as yours lol

  7. Tijuana Stotko writes:

    Nice info



Learn SEO
Content Marketing Book
Free Executives Guide To SEO
By continuing to use the site, you agree to the use of cookies. AcceptDo Not Accept
css.php