Pagination assistance | Apify & Crawlee | Page 1

wise wave Mar 21, 2024, 11:11 AM

#

Hey All,

Hope you are well! I am new here. I am trying to learn web-scraping and for the most part I think i am slowly figuring it out. I have been stuck for days on trying to work out how pagination works... Anyone able to help me? In my example script, I am trying to look for the next button, and if it exists click through it. Not sure what I am doing wrong...

CODE: https://codeshare.io/WLX0X8

umbral fjord Mar 21, 2024, 12:07 PM

#

Check this:
https://docs.apify.com/academy/api-scraping/general-api-scraping/handling-pagination

Handling pagination | Academy | Apify Documentation

Learn about the three most popular API pagination techniques and how to handle each of them when scraping an API with pagination.

wise wave Mar 23, 2024, 3:31 AM

#

umbral fjord Check this: https://docs.apify.com/academy/api-scraping/general-api-scraping/han...

thanks 🙂 ~ think I need to do some more study to understand... do you happen to have any 101 pagination tutorials for dummies haha.

primal rampart Mar 23, 2024, 9:37 PM

#