Duplicate content is the same or very similar content reachable at more than one URL. Google does not usually punish it. It does something quieter: it picks one version to show and ignores the rest, which can split links across copies, waste crawl time, and sometimes pick the wrong URL. Fixing it means choosing the version you want ranked and making that choice obvious.
How duplicate content happens
Most duplication is accidental and technical, not copied from another writer. The usual sources are:
- The same page at http and https, or on the www and non-www versions of the domain.
- A trailing slash and a non slash version of every URL.
- Tracking parameters and session IDs added to links.
- Sorting and filter pages on shop and listing templates.
- Printer friendly versions and AMP style copies.
- Product pages repeated across categories with different paths.
- Pagination and tag or archive pages that repeat the same snippets.
- Manufacturer descriptions used word for word across many shops.
Content copied from your site by someone else is a separate problem. Our guide to scraped and duplicated content attacks covers it.
Does duplicate content cause a penalty?
Almost never. Google's documentation says duplicate content on a site is not a reason for action unless it is clearly meant to deceive or manipulate. What you usually lose is clarity: ranking signals divided between copies, and the wrong URL chosen. Our short answer on whether duplicate content causes a penalty sets out the exceptions.
How to find duplicate content
Run these checks
Finding duplicate URLs on your site
The Google selected canonical is the most useful clue. When it differs from the one you set, Google has decided your signals disagree, and that is where to start.
Six places to look
- Search Console Pages report: look for Duplicate without user-selected canonical and Duplicate, Google chose different canonical than user.
- Run a site crawl and group pages by identical or near identical titles and body text.
- Search a distinctive sentence from a page in quotes and see which of your URLs appear.
- Use the URL Inspection tool to compare your declared canonical with the Google selected canonical.
- Check how your site responds to http, https, www and non www versions of the homepage.
- Review the URLs in your sitemap for parameters, duplicates and redirected addresses.
Which fix to use
Different duplicates need different fixes. Pick by what the duplicate URL is for.
| Situation | Best fix | Why |
|---|---|---|
| Old or alternate URL that should not exist | 301 redirect to the main URL | Passes signals and removes the copy |
| Both URLs needed for users, such as filters | Canonical tag pointing to the main page | Keeps the page live, names the preferred version |
| http, https, www and non www versions | Site wide 301 redirects to one version | One canonical host for every URL |
| Near identical product or location pages | Merge into one page or rewrite each to be distinct | Gives each URL a reason to exist |
| Thin parameter or tag pages with no value | Noindex, or remove and redirect | Keeps junk out of the index |
| Pages that must not appear at all | Password protect or noindex | Robots.txt alone does not remove a URL |
Step by step duplicate content fixes
1. Pick the preferred URL
For every group of duplicates, decide which URL should rank. Choose the cleanest, most linked version, usually https, one host name, and a consistent trailing slash rule.
2. Redirect what should not exist
Set 301 redirects from the unwanted versions to the preferred one. Redirect each page to its direct match, not everything to the homepage. Avoid chains of redirects.
3. Add canonical tags where both URLs stay live
Place a self referencing canonical on every indexable page and point filtered or parameter versions to the main page. Make sure the canonical is not blocked, redirected, or pointing at a page that is itself noindexed. Common errors are in our guide to canonical tag mistakes.
4. Rewrite or merge near duplicates
If two pages answer the same question, merge them into one stronger page and redirect the other. If both are needed, rewrite each so it serves a distinct purpose and adds something the other does not.
5. Clean your internal signals
Update internal links, your sitemap and your hreflang tags to use the preferred URL only. Mixed signals are how a good canonical plan fails.
6. Recheck in Search Console
After changes are crawled, watch the Pages report. The duplicate counts should fall. Use URL Inspection on a sample to confirm the Google selected canonical now matches yours.
When to call for help
Get help when the site has thousands of parameter URLs, when Google keeps choosing a canonical you did not pick, or when a migration or platform change created a wall of duplicates. These are often tied to wider crawl and indexing problems, not just text.
We start by finding which duplicates are actually costing you traffic, then fix those first. Ask for a free SEO triage and see what our technical SEO fixes work would cover.
FAQ
Questions owners ask us
How much duplication is too much?
Google gives no percentage. Small overlaps like a shared footer or a short product spec are normal. The problem is whole pages that match, or many URLs that serve one page. Judge by whether a reader and a crawler could tell the pages apart.
Should I use a canonical tag or a 301 redirect?
Use a 301 redirect when the duplicate URL should not exist at all, such as an old or alternate version. Use a canonical tag when both URLs must stay live for users, such as a filtered product list. A redirect is the stronger signal.
Can I fix duplicate content by blocking it in robots.txt?
Usually not. A robots.txt block stops Google crawling the page, so it cannot see a canonical tag or redirect on it. The URL can still be indexed from links. Fix duplicates with redirects or canonicals instead. If you are stuck, request a free SEO triage.
Get started