How often does Google crawl a site?

Looked at cache of our site with google says was crawwled April 16th before the site went live, how long will it liekly be before ti crawls agian and we see what it picked up of our new site?
 
A

AuctionMan

There is no 'standard' when it comes to bot visits, as your site grows this will increase..remember se bots like content and as soon as they see this growing they will be all over you. For example, one of my sites stats showed over 25,000 bot hits last month and it isn't even my largest :)

Don't focus on the figures, focus on the optimisation of your pages (se and visitor) and develop your content and let the se's worry about themselves. Remember they are on their way..
 
Upvote 0
It also depends on your meta-tag, you can specify when you want the robots to crawl into your site.

Here is an example:
<META NAME="keywords" CONTENT="keywords here">
<META NAME="description" CONTENT="description here">
<META NAME="revisit-after" CONTENT="5 days">
<META NAME="robots" CONTENT="FOLLOW,INDEX">

Copy and paste the code in bold and place it where your meta tags are, change the days to how many days you'd like the robots to revisit.
 
Upvote 0

Rob Holmes

Free Member
Business Listing
Mar 23, 2005
3,600
23
Kent
theivybridgecollection.com
It depends on how many incoming links you have - the googlebots follow links - hence - no links in - no googlebots - 100000 links in and you'll probably have a few googlebots coming through to your site continuously.

It's not so easy to tell now we've changed forum formats but theres usually a googlebot or 2 trawling pages on here.

Rob
 
Upvote 0

Tin

Business Member
Nov 14, 2005
2,931
1,427
Herefordshire
www.tinsoldierdesign.co.uk
As Rob says, robot visits are heavily related to inbound links but there are other factors which have bearing. Robots work on a 'Disallow Protocol' and not of 'Include' so by default they follow all links and index all... unless told otherwise by a robots.txt.

Not all search robots obey the robots.txt file as instructed, even less bots read/obey Meta robot information so it's pointless adding those lines of code into the head area.
 
Upvote 0

Latest Articles

Join UK Business Forums for free business advice