How to fix duplicate content issues on your website or blog

Is Duplicate Content Hurting Your SEO

How to find and fix on-site Duplicate Content

Many of you may already know that having duplicate content on your blog is BAD. Search Engine’s (especially Google) penalise sites that have duplicate content and this will negatively affect your overall Search Engine Rankings. What you may not know is that you may be publishing duplicate content every time you hit the publish button your WordPress site.

How to fix duplicate content issues on your website or blog

Test your URL with and without the WWW prefix

Before we begin I am assuming you have not tackled this issue before and that no existing redirects have been setup on your site. If there are redirects in place or if you have modified files like “.htaccess” or “robots.txt”, this article is NOT for you.

Let’s begin: A very simple check will show if your blog is showing duplicate content to the Search Engines. Open your web browser and insert your blog or website site URL with the WWW prefix (eg. http://www.yourdomain.com). Does your website load? Now, do it again, without the WWW prefix (eg. http://yourdomain.com). If your site loads using both and you haven’t tinkered with redirect or preferred domains settings; you are probably publishing duplicate content.

If you are using HTTP and HTTPS protocols, then variants of this may also be causing duplicate content. (eg http://www.yourdomain.com and https://www.yourdomain.com). Another such situation is if you have a backslash at the end of your URLS (eg. www.yourdomain.com and www.yourdomain.com/).

All the variations above are seen as unique pages by the Search Engines and thus regarded as being duplicate content. There are more situations where duplicate content comes into play, but these are the basics for beginners to consider.

Should you use WWW prefix or not

A clean install of WordPress will automatically default to resolving your website to the NON-WWW version of the domain name (http://yourdomain.com). In the WordPress Dashboard, navigate to Settings >> General and choose whether you want your URL to contain the WWW prefix or not.

Should you use the WWW prefix for your domain URL?

I won’t go into detail as to which is better (i.e. WWW or non-WWW). You simply need to decide which you are going to use and stick to that indefinitely. You can change this later on, but doing so will have a major impact on your SEO & Website Traffic (It’s not recommended to change this unless you are prepared to take the knock).

Setting the Preferred Domain in Google Webmasters Tools

If you don’t already have a Google Webmasters Tools (Search Console) account, I highly suggest you get one. This post isn’t about the features of Webmasters Tools or how to use it, but I do share a little tip that makes all the difference with how Google indexes your URLs.

Google allows you to set your preferred URL in the Domain Settings section of any domain you have added and verified within the Search Console.  To do this; you first need to add both the WWW version and the non-WWW version of the domain name to the Search Console. Once both are validated follow the steps below:

  1. Login to Google Webmasters Tools
  2. Click on your preferred domain
  3. Click on the ‘cog icon’ (top right corner) and select the ‘Site Settings’ option
  4. Under the section ‘Preferred Domain’, select the option that suites you best
  5. That’s it; you will get a notification message to confirm the change [break]

Set your preferred domain in Google Webmasters Tools

For the vast majority of users this should be sufficient, since you are mostly targeting traffic from Google. However, if you want to take this further or wanting to define these settings for BING or any other Search Engine, you need to get your hands dirty and play with some code…

Edit your .htaccess file to redirect traffic

Messing around with your .htaccess file isn’t recommended unless you know what you are doing. Also, I highly recommend you make a backup of this file before attempting any changes. Again, I’m not giving lessons on how to use FTP in this post. If you want to edit your .htaccess file, you will need to download a copy of this file from your Web Server. Personally, I recommend you contact your Web Hosting Company and ask them to edit your .htaccess file to create the necessary redirects to or from WWW or non-WWW as per your requirements.

For those of you comfortable with editing the .htaccess file, here is a code snippet to create the necessary redirects from non-WWW to WWW.

[boxibt style=”info”]

# Ensure www on all URLs.
RewriteCond %{HTTP_HOST} ^example.com [NC]
RewriteRule ^(.*)$ http://www.example.com/$1 [L,R=301]

[/boxibt]

NOTE: The verdict is still out when it comes to using the WWW prefix or not. Some say it’s best to use WWW and other say it’s best without WWW. Personally, I have used the WWW for most sites simply because that’s what the majority of visitors are familiar with. If a domain name is relatively long, then I would consider going without the WWW purely to shorten the URL. [Update: See my comment about dropping WWW on future sites]

Tackling Duplicate Content in more detail

Using tools like Majestic or Ahrefs one can do a more detailed audit to find duplicate content that comes from varying URL strings, Categories and Taxonomies, but this falls outside the scope of this post. One last thing I will mention, which is rather complex to understand is Canonical Redirects. I mention this here, because while researching ‘how to tackle duplicate content’ I came across this post, which takes what I’ve discussed to another level.

[boxibt style=”info”]NOTE: There are plugins available which can help you with doing page/post redirects and some that can also edit your .htaccess file for you. I use the redirection plugin to do individual page/post redirects, but don’t like plugins that edit my .htaccess file.[/boxibt]

What measures do you take to prevent on-site duplicate content issues?

Please share this with your fiends
RSS
Twitter
Visit Us
Follow Me
Follow by Email
Tags: , , ,
Previous Post
run-a-succesful-blog
Blogging 101

What you need to know to run a successful blog

Next Post
Get Free Affiliate Marketing Training from Kevin Fahey
Make Money Online

How to Make Money Online with Affiliate Products

Comments

  1. Good notes, Duane! A little off topic, but is your “You May Also Be Interested In…” a plug-in as well?
    Barbara O’Toole recently posted…Big G Launches Google Domains BusinessMy Profile

    1. Hi Barbara – Thanks and nice seeing you on the blog again 🙂
      The ‘You May Also Be Interested In” feature on my site is part of my Theme; however, you do get plugins that provide this functionality.
      Have a look for ‘Related Posts’ type plugins

  2. Hello Duane,

    Great article. I tackled this early on and use my site without the www prefix.

    And that’s how I usually go to anysite, without the www. Now when that site doesn’t load up, but I know the site is correct, then I include it on the url bar.

    This article will help a lot of your readers, also learning how to get into the settings of their wordpress account.
    Carlos Cortez recently posted…Do Know What Your Customers Are Saying?My Profile

    1. Hi Carlos – Thanks!
      I’m considering dropping the www prefix on my next site. Again, it’s a personal ‘feeling’ that it is no longer necessary. I’ll do more research on the topic first, but my ‘feeling’ says, people and web-browsers easily identify website/blog URL’s by the fact that they contain a TLD (domain extension). eg. duanereeve.com has the .com TLD and is thus easily identified as being a website/blog

  3. Great info for us newbies, Duane.

    I just tried this out. My site comes up WITH the www prefix as well as WITHOUT the www prefix. My site (blog.webwizbox.com) loads using both, and being new to this, I’m sure I haven’t tinkered with redirect or preferred domains settings; so does this mean I am probably publishing duplicate content?

    In my WordPress General Settings, the WordPress Address URL as well as the Site Address URL do not have www before my site name.

    Thanks again for your advice. Appreciate it tremendously.

    Sue
    Susette recently posted…WMN – Wireless Mesh Network?My Profile

    1. Hi Susette – Alway good to know my content is helping people, thanks for the feedback.
      Your Blog is already established and you have backlinks from your blog commenting, so don’t change the non-WWW setting.
      However, I strongly recommend you setup the Preferred Domain Settings in Google Webmaster Tools & ask your web-hosts to edit the .htaccess file to redirect to the non-WWW version of your URLs.

  4. Thanks, Duane, for responding to my question.
    Will be definitely acting on your recommendation soon.
    Thanks again.
    Susette recently posted…WMN – Wireless Mesh Network?My Profile

  5. Hi Duane,

    This is a topic I have been wondering about! Thanks for all the detail. My domain came up both ways. My settings in wordpress do show the web address with the www and whenever I type it anywhere (for example when you ask for the website when posting a comment) I always put the www. Based on what you said above, I should set up the preferred domain settings in a Google Webmaster Account, right? I wouldn’t think of trying to do anything with the htaccess file…I would most certainly mess it up!
    Barbara Dowling recently posted…Plugins for ProfitMy Profile

    1. Hi Barbara
      You’re on the right track and yes, setup your Webmaster Tools preferred domain to default to the WWW version of your site.
      Always publicize your Blog with the WWW both online and offline on printed media.

Comments are closed.
RSS
Twitter
Visit Us
Follow Me
Follow by Email