Creating a Rank Tracking tool

[Kingdingle22]

Hello all,



Me and my friends who is a very experienced asp.net developer are looking to create a tool that checks Google rankings - obviously there are lots of good ones out there that do this but we want to create our own for a project.

We're just beginning to look into this and I was wondering if anyone has done similar or knows what is involved?

Any advice would be much appreciated.

 

[ClicProject]

You need a big list of proxies with the ability to rotate them, variable delays between queries (human emulation) so as not to get blocked.

You have personalization and regionalization to take into account, plus you are going to have to randomize user agents in the headers so your bot doesn´t get detected and blocked.

You need to take into account all the different types of serp results now when you are scraping the pages (map results, video results, branded sitelink results, image results, social media resutls) as the type of results page you get varies greatly depending on the query.

Plus google seems to change how it displays its results on what seems like a weekly basis these days, which means your scraper will constantly be breaking.

Quite a big job, good luck with it.

 

[tommy]

Hi,

Are you wanting to just track the sites Page Rank or its position based on keywords?

Thanks,
Tom

 

[benhuntltd]

Are you going to use the Google API, or screen-scrape?

 

[davida]

Use addons rank checker it track Google, Yahoo & Bing Ranking free here is URL:http://tools.seobook.com/firefox/rank-checker/

 

[benhuntltd]

I've used SEOMoz's API recently, to get backlink data with PHP. It wasn't completely straightforward, but I figured it out in an hour or so.