To fix duplicate content, decide which URL should be the preferred version of each page, then 301-redirect duplicates you no longer need, add a rel="canonical" tag on duplicates that must stay live, and link internally only to the preferred URL. Find duplicates with Search Console's Page indexing report, a site crawl and site: searches.
This guide explains what counts as duplicate content, whether it can hurt you, how to find it, and which fix suits each situation.
Key takeaways
- Pick one preferred URL for each page, 301-redirect duplicates you no longer need and add a canonical tag to those that must stay.
- Google does not penalise accidental duplicate content, but it may choose the wrong URL and split your link signals.
- Find duplicates with the Page indexing report, URL Inspection, a site crawl and checks of your four hostname variants.
- Do not use robots.txt blocking or noindex to choose a canonical, as Google advises against both.
What is duplicate content?
Duplicate content is the same or very similar content available at more than one URL. On most sites it is accidental and technical rather than copied text. Common causes:
- Protocol and hostname variants:
http://,https://,wwwand non-wwwversions all loading. - Trailing slashes and case:
/services/and/services, or/Services. - URL parameters: tracking tags (
?utm_source=), sorting and filtering (?sort=price), session IDs. - Product variants: the same product at a different URL for each colour or size.
- CMS archives: WordPress tag, category, author and date archives listing the same posts.
- Printer-friendly or AMP versions, and staging sites left open to crawlers.
- Near-identical location pages with only the town name changed.
- Manufacturer descriptions used by you and every other stockist.
Will Google penalise me for duplicate content?
No, not in the normal sense. Google's SEO Starter Guide states: "Having duplicate content on your site is not a violation of our spam policies." What Google does is group duplicates and pick one URL, the canonical, to show in results.
The real problems are practical:
- Google may pick a URL you would not choose, such as a parameter version.
- Links and other signals are split between versions.
- Crawling is wasted on copies instead of new pages.
- Duplicates are often reported as "Duplicate without user-selected canonical" or left out of the index.
Deliberately scraping or copying other sites' content to manipulate rankings is a different matter, and that is covered by Google's spam policies.
How do I find duplicate content on my site?
- Search Console Page indexing report. Look for "Duplicate without user-selected canonical", "Duplicate, Google chose different canonical than user" and "Alternate page with proper canonical tag". Click each to see example URLs.
- URL Inspection. Inspect a URL and compare the user-declared canonical with the Google-selected canonical. If they differ, Google disagrees with your choice.
- Check your hostname variants. Type
http://example.com,http://www.example.com,https://example.comandhttps://www.example.com. All but one should redirect to the preferred version. - Crawl the site with a crawler and look for duplicate titles, duplicate meta descriptions and pages with identical content. Duplicate titles are a strong clue that pages overlap.
- Search Google for a distinctive sentence from your page in quotation marks. This reveals copies on your own site and on others.
MakeItFlow checks canonical tags, titles and meta descriptions when you run a free website audit, and its whole-site crawl on paid plans finds duplicate titles and descriptions across every page, which is usually where duplicates show up first.
Which fix should I use?
Google ranks the methods by strength: redirects are a strong signal, rel="canonical" is strong, and sitemap inclusion is weak. Combining them makes the signal stronger.
| Situation | Best fix |
|---|---|
| HTTP/HTTPS or www/non-www variants | Site-wide 301 redirect to one version |
| Old or retired page duplicating a newer one | 301 redirect to the newer page |
| Parameter URLs (tracking, sorting) that must keep working | rel="canonical" to the clean URL |
| Product variants on separate URLs | Canonical to the main product, or one URL with variant selectors |
| Two articles covering the same topic | Merge into one stronger page and 301 the other |
| Thin location pages | Rewrite with unique local detail, or consolidate |
| PDFs duplicating HTML pages | rel="canonical" sent as an HTTP header |
| Staging site indexed | Password-protect it, then remove URLs |
Fix 1: 301 redirect hostname and protocol variants
# nginx: send HTTP and non-www to https://www
server {
listen 80;
server_name example.com www.example.com;
return 301 https://www.example.com$request_uri;
}
# Apache .htaccess: force HTTPS and www
RewriteEngine On
RewriteCond %{HTTPS} off [OR]
RewriteCond %{HTTP_HOST} !^www\. [NC]
RewriteRule ^ https://www.example.com%{REQUEST_URI} [L,R=301]
After deploying, test all four variants again. MakeItFlow also confirms that HTTP redirects to HTTPS as part of its security scan.
Fix 2: Add canonical tags to duplicates that must stay
Place this in the <head> of the duplicate, pointing at the preferred URL, and add a self-referencing canonical to the preferred page too:
<link rel="canonical" href="https://www.example.com/oak-dining-table/">
Use absolute URLs. Our canonical tags guide covers common mistakes, such as pointing every page at the homepage.
Fix 3: Make internal links and sitemaps consistent
Every internal link, menu item and sitemap entry should use the preferred URL. If your navigation links to /services but the canonical says /services/, you are sending mixed signals. List only canonical URLs in your sitemap.
Fix 4: Merge overlapping pages
Two blog posts targeting the same question compete with each other. Combine the best parts into one page and redirect the weaker URL. If several pages are competing for the same keyword, our guide to keyword cannibalisation explains how to decide which to keep.
What should I not do?
Google specifically advises against these as canonicalisation methods:
- Blocking duplicates in robots.txt. Google cannot see the canonical tag on a blocked page, and the URL may still be indexed without its content.
- Using
noindexto choose a canonical. It removes the page from Search entirely rather than consolidating signals. - Using the URL removal tool, which hides all versions of the URL temporarily.
- Sending conflicting signals, such as a canonical in the HTML and a different one in the HTTP header.
What about other sites copying my content?
If someone scrapes your content, Google usually identifies the original. If a copy outranks you, make sure your page is indexed and well linked, ask the site owner to remove it, and if it infringes your copyright you can file a request through Google's legal removal process. If you syndicate your articles to partner sites, ask them to add a canonical pointing to your original or a noindex.
What to do next
Check your four hostname variants today and fix any that do not redirect. Then open the Page indexing report and work through the duplicate statuses, starting with pages that matter commercially. Finally, crawl your site for duplicate titles. If you are planning a redesign, read broken links and redirect chains so your redirects do not create new problems.
Frequently asked questions
How much duplicate content is too much?
There is no threshold. Some duplication, such as a shared footer, standard terms or a product spec table, is normal and Google handles it. Focus on cases where whole pages are duplicated or Google is choosing the wrong URL.
Is it fine to use manufacturer product descriptions?
It is not a penalty, but your page then offers nothing different from every other stockist, so it is unlikely to stand out. Add your own descriptions, photos, sizing advice, FAQs or reviews to give Google a reason to show your version.
Does Google always follow my canonical tag?
No. Google treats rel="canonical" as a strong signal, not a directive. If other signals conflict, such as internal links or sitemap entries pointing elsewhere, it may choose a different URL. URL Inspection shows which one it picked.
Do UK and US versions of my site count as duplicates?
They can look like duplicates if the content is nearly identical. Use hreflang annotations to tell Google which version is for which country or language so it shows the right one to each audience.
How long does it take for Google to update canonicals?
Google needs to recrawl the affected pages, which can take days to weeks. Requesting indexing on key URLs and keeping your sitemap accurate can help, and the Page indexing report will update as Google reprocesses them.
Related reading
- Chrome 154 Turns On HTTPS by Default: What Websites Must Fix: Chrome 154 now asks users before loading any public HTTP page. What the warning means for your website, plus a technical SEO checklist to fix it fast.
- Webflow SEO and Speed: Settings That Actually Matter: Webflow SEO and speed explained: page and CMS SEO fields, 301 redirects, sitemap, schema markup, image conversion, script weight, publishing and hosting.
Sources
More guides for your industry
Free checklist (PDF)
Free e-commerce brands website checklist
30 practical checks for e-commerce brands: website speed and mobile, Google Business Profile and reviews, email security, booking and enquiry handling, and AI search visibility. Each one says why it matters, and many link to a free tool that checks it.
Written by the MakeItFlow team
We build the website audit these guides are based on. Every fact is checked against the primary sources listed above and this guide was last reviewed on 25 October 2026 . How we research and check
Check your own site in 30 seconds
Run a free audit covering speed, SEO, DNS, email authentication and security headers — and get a prioritised fix list.
