#Suggestions for web scrapping?

4 messages · Page 1 of 1 (latest)

sage orbit
#

Hello all
I am interested in writing a program as a volunteer for a vegan organization to scrap information from many websites and compile specific info from each site to a file or spreadsheet

Do you recommend using Puppeteer? If so, what is the best way to host a Node/Puppeteer script since someone else far away will need to run the script regularly on a ongoing basis

Also it seems I will have to write a custom script for each site since each site has unique class names, structure, etc...

Thank you in advance!

obtuse ridge
#

puppeteer is overkill

#

Also it seems I will have to write a custom script for each site since each site has unique class names, structure, etc...
Correct, selectors will be different for every site