Indexing Help?

Log in to reply
P

preciousbags

Free Member
Mar 20, 2010
694
18
  • #1
    Hi all

    I am having a problem with google indexing my website lately.

    Since 12 January webmasters tools has not updated although i have added lots of new pages since then and lots of blog posts.

    When i google some of the new pages - none are showing

    Google usually visits my site quite often.

    I am also getting the error on my robots.txt

    Crawl postponed because robots.txt was inaccessible.

    Does anyone have any solutions or advice?

    I am a little worried

    My hits havent been affect as they have increased and i am still indexed for all pages before the 12th.

    Thanks in advance
     
    Last edited:
    N

    Ninja Commerce

  • #3
    Hi there.

    It's impossible to say without looking at your site and the code etc... You certainly seem to have an error somewhere.

    There is an extension for chrome that tells you whenever you are on a page that has any sort of robot blocking (meta nofollow/noindex etc...)

    Try installing that and then look at your pages. You will probably find that they are noindex in some way.

    After that you need to figure out where the noindex tag is hiding. Your robots.txt is the obvious place to look, but also check your htaccess file and just your site template for anything that doesn't look right.

    Also, on webmaster tools try uploading a sitemap. You can create a site map as a txt file, which is the simplest way to test it. Get google to check the site map and if there are no noindex problems it should be able to find all of your pages no problem.
     
    Upvote 0
    C

    Clicky Leap

  • #4
    When did Google last cache your homepage? You should be able to find by clicking in the cache view in the Google search results.

    It could be that they have not indexed your site since the 12th and picked up the new pages.
     
    Upvote 0
    Log in to reply

    Latest Articles

    Join UK Business Forums for free business advice
    Top Bottom
    Community
    Articles
    Menu