BluuueJammm Big Member Apr 19, 2008 830 12 0 England Jul 12, 2011 #1 I'm trying to get a list of all the pages in a site, it has about 14,000. Do I need to write a scraper, or is there a tool I can use for this?
I'm trying to get a list of all the pages in a site, it has about 14,000. Do I need to write a scraper, or is there a tool I can use for this?
Brandon Administrator Staff member Jun 26, 2006 902 19 18 Jul 12, 2011 #2 Scrape it with ubot or Web Extractor, Web Scraper, Web Scraping and Data Extraction Software, Web Ripper, Web Grabber
Scrape it with ubot or Web Extractor, Web Scraper, Web Scraping and Data Extraction Software, Web Ripper, Web Grabber
omgyams WF Premium Member Aug 18, 2008 1,888 25 0 Interwebs Jul 12, 2011 #3 There's always Xenu: Find broken links on your site with Xenu's Link Sleuth (TM)
