Hello,
Not sure if this is the right forum on WF to ask, but I have a little technical question. I really like this tool called sescout.com and I am wondering how do they actually get Google (and Bing) ranking data. Do they scrape google search result pages ? If so then how ? Because I am sure Google easily ban bots even when using lots of proxies (they're just too smart).
Google search has an API which is pretty costly too. $5/1000 queries with a 10k query/day limit. The sescout plans are somewhat cheaper than these when you compare the number of searches they allow you to monitor with daily/weekly updates.
So anyway, It would be nice if someone could shed some light on how they achieve this. I ask this because I want to create an internal tool that requires data from google and another tool that'd somewhat do what these guys do. The reason I cant use sescout atm is that its costly for me, and also I can get some good knowledge if I do this myself.
Regards
Not sure if this is the right forum on WF to ask, but I have a little technical question. I really like this tool called sescout.com and I am wondering how do they actually get Google (and Bing) ranking data. Do they scrape google search result pages ? If so then how ? Because I am sure Google easily ban bots even when using lots of proxies (they're just too smart).
Google search has an API which is pretty costly too. $5/1000 queries with a 10k query/day limit. The sescout plans are somewhat cheaper than these when you compare the number of searches they allow you to monitor with daily/weekly updates.
So anyway, It would be nice if someone could shed some light on how they achieve this. I ask this because I want to create an internal tool that requires data from google and another tool that'd somewhat do what these guys do. The reason I cant use sescout atm is that its costly for me, and also I can get some good knowledge if I do this myself.
Regards
