Merry Christmas - free yellowpage scraper

DewChugr

Photoshop God
Jun 26, 2006
1,977
66
0
48.655139,-119.644032
I have a yellow page ripper and, like last year I thought that being the giving season I'd offer it up to Wickedfire members. YP changes their code now and then so I can't guarantee how long it will work.

I'm not going to charge for it, it's free, but there is a catch. This will be available for a limited time, until the 11th. Also, I am not giving this away to the newbies that can't follow simple guidelines and do things like post intro threads in the STS area or post only worthless shit. Therefore, the script is available to anyone that PMs or emails me as long as you have a minimum of 100 posts on WF. All I ask is that you do not re-distribute this.

If you are interested send me your email address by PM and I'll email this to you. I don't have time to send you a pm you asking for your email address.

Features and such below. For this version it also scrapes longitude and latitude when available. This could be useful for a web designer who wants to find businesses that may not have a website.

Here are the main features.

  • Search by keyword.
  • Optionally limit searches to name of business only.
  • If your search returns no results auto re-search for name match.
  • Grabs name, address, city, state, zip, phone and URL (if available).
  • If you rip a category the category name will be included in field one of the CSV.
  • Specify State and optionally city to search.
  • limit your search results to specific cities.
  • Output to screen or CSV file.
  • Get categories available in a city/state
  • Remove spammy yellow pages URLs
  • Config file with default state and array of categories.
  • Scrape 5,000 or more entries in one go.
  • Oh, did I mention it's FREE?
What it's not

  • It's not the fastest thing in the world, especially when ripping 4 or 5 hundred pages.
  • It does US yellow pages only.
  • No, it won't do Canada, Australia, the UK or Nigeria.
  • It won't rip the whole country at once.
  • It won't rip every category of a state at once.
  • It may or may not look right in IE. I use Firefox, you should too.
Questions you might be tempted to ask

  • Make this work for Canada, Australia, the UK or Nigeria, etc? No.
  • Add a feature? No.
  • Fix this problem? Maybe, but probably not.
  • Can you... No.
  • Why doesn't it work? You need Zend Optimizer on your server.
Have fun. :xmas-smiley-010:

Anyone else like to share a script, tip, piece of code etc?