#CheerioCrawler only scrapes one url

1 messages · Page 1 of 1 (latest)

tropic fractal
#

Hi, I'm trying to scrape https://www.noom.com but it crawls only that url but not all urls available that are in this page, I added retryOnBlocked: true and played with all EnqueueStrategy but it still the same, it happens on this website only.

Is there a way to make it work? thank you

tropic fractal
#

Right I guess the CheerioCrawler doesn’t handle screenshots?

tropic fractal
#

It works fine now that I've replace CheerioCrawler with PlaywrightCrawler

dense ivyBOT
#

@tropic fractal just advanced to level 1! Thanks for your contributions! 🎉