How Search Engine Crawl the Site?

[davida]

How Search Engine Crawl the Site ?

 

[fisicx]

Everything you need to know is here:http://en.wikipedia.org/wiki/Web_crawler

And information on a recent patent here: http://patft.uspto.gov/netacgi/nph-...7,774,782.PN.&OS=pn/7,774,782&RS=PN/7,774,782

 

[trafficmystic]

through links from other sites.. so get yourself a twitter account and post your site links and they will be crawled in under 5 mins max

 

[seowebsculpt]

You have to submitted your web sites URL to all search engines.

 

[Spock]

You have to submitted your web sites URL to all search engines.

Rubbish. That's advice from the 90's

 

[seowebsculpt]

so you what is in 2011.....?

 

[cyberdesignz]

social media is the best option to crawl your site within minimum possible time, put your site link in the post and ll be crawled within minutes.

 

[OldWelshGuy]

the spider makes a request from its home server for a link (IP Based) it goes there, and sends the information back to its home server and requests another link. technically they no longer crawl, as this lead to spider traps, so now they request a fresh url after each page has been grabbed.

the content is then sent home to be quality graded, before being added to the index (indexed) or rejected for poor quality.