Need: Script to scrape Ning sites

Status
Not open for further replies.
W

webrc1

Lurker
Dec 16, 2009
34
0
0
Rating - 100%
1   0   0
Hey guys, due to my lack of technical expertise, I'm putting out a feeler if anyone would be interested in putting together a script that would scrape Ning member profiles.

Almost every Ning site contains the same member profile layout, so I would think that this would be a fairly straightforward implementation, but I could be wrong.

I don't have a preference how it should be done, could even be with iMacros or something similar.

Requirements:
* Scrape all member profiles on a Ning site
* Export the data to CSV format
** Rows should be individual members
** Columns should be handle, URL, and profile fields (name, company, industry, etc.)
** The more data we can pull from a member profile, the better
** Each Ning community has its own set of member attributes, so the script should dynamically identify each and create columns accordingly
** I'd like to identify which Ning community to target and create a separate CSV file for each

Bonus:
* If I could filter through the CSV and select the members that I'd like to target, it would be nice to have the script go back through and add the selected members as friends with a custom message

Please PM me with details and a price.

Thanks!
 


Did I post this in the wrong forum? If a moderator could please move it to the proper place, I'd really appreciate it. Thanks!
 
Sounds like the perfect job for ubot, even with no programming knowledge you could create that scraper easily. Use code UBOTASTIC199 to get $50 off.
 
Last edited:
I can help you with it, I'm a great data miner. I don't get ning though, spent 10 minutes signing up and clicking little circles trying to find anything that lists any member data and it makes no sense to me at all, so you'd have to point out where the data you want scraped actually exists.

New member, read that new members can't PM, you can PM me.
 
web site scraping with biterscripting

You may need to use a tool such as biterscripting. Here is what you do.

1. Download and install biterscripting from http://www.biterscripting.com .

2. Open your browser, and find out the exact URL of the page that's showing the data you need. We will assume that URL is http://www.xxx.yyy/path/to/webpage.html .

3. Start biterscripting and enter the following commands.


cat "http://www.xxx.yyy/path/to/webpage.html" > "page.txt"
system start "page.txt"


You now have the input document from which you need to extract info. If you post the part of the page that contains the data (or email it to me), someone can help you put together a script quickly (including me). There are also some scripts posted on the net that can help you get started with a biterscript of your own.
 
Status
Not open for further replies.
Top Bottom