Comments (4)
Yep, what you'll need to do is iterate over rs
.
The reviews object only really parses the one page, it has a next_page
property that you can then pass into the function you mentioned above to get the next page.
The reviews functions only return the results for the page being parsed, hence 10 results.
There is an __iter__
function that lets you get the first page and then iterate over the reviews.
def __iter__(self):
page = self
while page:
for id in page.ids:
yield id
page = Reviews(URL=page.next_page_url) if page.next_page_url else None
rs = amzn.reviews(URL=p.reviews_url)
# print the review ids on this reviews page
print(rs.ids)
# print ALL review ids from this page onwards
for r in rs:
print(r.id)
I appreciate that this may not be intuitive.
from amazon_scraper.
I've added a small example to the README.
from amazon_scraper.
Thank you!
from amazon_scraper.
Glad to have helped =)
from amazon_scraper.
Related Issues (20)
- extract_asin doesn't work with all Amazon's links HOT 1
- Reviews not getting after review page HOT 5
- Only getting the last 10 reviews HOT 3
- Problem installing amazon_scraper HOT 3
- Average Review Rating HOT 1
- Page sometimes not loading? HOT 10
- Add captcha detection HOT 11
- help HOT 1
- How to get offer listings(all offer price by all merchants for single product) HOT 1
- Random stopping on multiples of 10 HOT 9
- Get Product Price HOT 1
- ImportError: No module named tests HOT 1
- GUI? HOT 1
- Problem with BeautifulSoup import HOT 1
- Add ability to set amazon_base HOT 2
- Can't parse review date for foreign Amazon regions
- Problem with InsecureRequest HOT 1
- AWS Accout HOT 1
- Problems with .text command HOT 3
- Install requirement contains invalid library name HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from amazon_scraper.