Scraping Amazon Reviews

[jackinthebox]

Any way to do this in bulk?

I want to scrape a shit load of product reviews to re-purpose for some projects I am working on.

Cheers.

 

[skank]

I'm not much of a developer, but I have been able to do similar things using iMacros. It's not the easiest solution, but it can work

 

[Khalil]

Hey, I have been building custom scrapers for any type of website for years. Whats your problem?

 

[jackinthebox]

I want to be able to enter a product/product URL and scrape all the user reviews for that product into a file.

 

[silentcrowd]

You can probably do this using their APIs.

 

[Crisp Flipper]

Do you still need help? Can't pm you right now.

 

[MarketingMall]

Every product has an URL that displays reviews and show pagination.
Each review has a class="a-row a-spacing-small review-data"
So if you create an Xpath for class that contains review-data, you will get reviews along with stars and user. Then you can iterate to get independent variables.

Finally, is obvious you have to navigate clicking next button until it doesnt exit.
Next button is a <li> tag with a class "a-last"