Site audit with seo proxies?

LeglessPenguin

Free Member
Dec 17, 2019
7
2
Hi all, newbie here :) Still learning the ins and outs of seo and I've found that proxies can be used for seo purposes as well.

It's similar to webscraping (sending dozens of requests to a specific website - not to be confused with a DDoS attack), so it gives you lot's of insights, such as prices, offers etc. of your competitors.

I'm not getting in to this anytime soon, since it seems a bit too advanced for me, but I was just wondering, whether anyone has tried this technique. If so, what kind of software did you use? Even when looking up proxies on proxyway I've found dozens of different options, so I'm totally confused :)
 
  • Like
Reactions: Nityen Prakash

Birmingham

Free Member
Nov 14, 2006
2,012
179
UK
using proxies for scraping data, it's not seo in itself, it's just a data gathering method which can help to create unique content which of course can be beneficial to seo. personally i use a lot of cheap hosting accounts for this purpose, rather than bespoke proxy bundles because purpose-sold proxy bundles are usually detected as proxies and blocked by the servers whose hosted sites you're trying to monitor.

you mention site auditing... so as far as this relates to seo, this can be for checking uptime (there are plenty of tools dedicated to this, and i've built my own too) and checking for cloaking etc (i've built my own for this too - again on my own network of regular hosting accounts, coded within bespoke wordpress plugins). if you're just checking normal content and code issues, rather than cloaking and uptime, then you don't need proxies, just use a tool like ahrefs.

i'm not sure whether i've just confused you more, or clarified things a bit. please confirm your ultimate goal so we can see exactly what you need help with.
 
Upvote 0

Birmingham

Free Member
Nov 14, 2006
2,012
179
UK
i've just re-read your question and see it's for scraping prices and offers etc rather than checking for technical issues. the purpose of proxies for simple data scraping is to avoid getting blocked by making too many page requests in a short period of time, thus appearing like a ddos attack. still, i would use multiple cheap hosting accounts from unrelated hosting providers, as mentioned, to avoid your proxies being detected as proxies and blocked before any data scraping is achieved.
 
Upvote 0

Latest Articles

Join UK Business Forums for free business advice