Respect Canonical URLs

 

Syntax: select Yes or No button

This option enables respecting when pages indicate that there's a canonical version of themselves, expressed with <link rel="canonical">.

If Y (the default), then if a page has a <link rel="canonical"> that is different from the fetched URL, the original page will NOT be indexed and the canonical URL will instead be added to the index.

Note that if the canonical URL is not be allowed due to walking rules (matches exclusions, off-site, etc), then the canonical behavior does not apply and the original, non-canonical URL will be indexed.


Copyright © Thunderstone Software     Last updated: Dec 10 2018
Copyright © 2019 Thunderstone Software LLC. All rights reserved.