View Full Version : seomoz crawl test
Faevilangel
7th May 2010, 21:47
How accurate is it? Should I believe it's results?
It's saying google and other engines are indexing, the domain root and the index.html e.g.
domain.com and domain.com/index.html,
And seeing them as duplicate content! None of the search engines tools are displaying errors for crawling etc, but this tool is finding loads...
Should I believe the above, and redirect index.html traffic to the root? Or just leave it as it is?
Birmingham
8th May 2010, 08:30
tell me the domain and i'll check for u
Clinton
8th May 2010, 12:50
It's saying google and other engines are indexing, the domain root and the index.html e.g.
domain.com and domain.com/index.html,
And seeing them as duplicate content!
Irrespective of what other tools say, that is correct. Having multiple URIs to reach the same content is to be avoided.
domain.com
domain.com/index.html
www.domain.com/
www.domain.com/index.html and
www.domain.com/index.htm
are all duplicates of each other unless you have taken steps to ensure they are not.
Canonical Errors (http://www.google.co.uk/#hl=en&q=canonical+errors)
Faevilangel
8th May 2010, 15:46
Irrespective of what other tools say, that is correct. Having multiple URIs to reach the same content is to be avoided.
domain.com
domain.com/index.html
www.domain.com/ (http://www.domain.com/)
www.domain.com/index.html (http://www.domain.com/index.html) and
www.domain.com/index.htm (http://www.domain.com/index.htm)
are all duplicates of each other unless you have taken steps to ensure they are not.
Canonical Errors (http://www.google.co.uk/#hl=en&q=canonical+errors)
I have my non www. redirected to www. but never knew about the root and index.html ... would the folllowing work?
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteBase /
RewriteCond %{HTTP_HOST} ^garethgillman.co.uk [NC]
RewriteRule ^(.*)$ http://www.garethgillman.co.uk/$1 [L,R=301]
Options +FollowSymLinks
RewriteCond %{HTTP_HOST} ^www\.garethgillman\.co.uk$ [NC]
RewriteRule ^(.*)$ http://www.garethgillman.co.uk/index.html$1 [R=301,L]
</IfModule>
OldWelshGuy
8th May 2010, 17:31
go to the root domain check the cache. go to the ind3ex. page check the cache there. If the cache times are identical then all is well :)