I'm using hap to sort through several hundred pages of Amazon search results for some data analysis.
However, if there are more results, this just returns the top four li's. I've checked and checked again, and I'm certain that this is correct. Am I doing something really wrong? I don't understand why there are just four results available. Example of typical page content: https://www.amazon.com/s/?url=search-alias%3Daps&field-keywords=100+percent+barstow
Using other search results pages results in the same issue and consistently yields results that are much inferior to those on the page.
Try this out:
No promises, however, since I'm simply relying on the URL you provided.