Have you tried using a JavaScript interval? It could look for some specific content on the page periodically and do whatever you want to do with it afterwards. If it's not on the right page so no content it found it just skips whatever you do with this data
#Help finiding shipping prices on a webscraping crome extension.
shut phoenix
That said, I have no idea if chrome limits those kind of events to prevent extension that would slow down pages so you will have to look into that
If you want more precise solutions you will have to share much more like your current solution and code, maybe the website or at least the precise flow of the website, etc. Please take a look at the #📄・posting-guidelines
trim arrow
Can i DM you?
shut phoenix
Nop. If you have to share things do it here.
shut phoenix
Sadly I can't see any magical solutions for that. Scrapping is pretty much limited to what the user can see. I believe Amazon has an API that you could use to fetch some information but I don't know how open this API is, meaning if it's free and easy to use or if it requires some kind of app registration/validation.
Another, perhaps simpler, solution is to try to calculate it yourself based on the current rate but that might now be super precise and will likely change somewhat often
In both cases you might have to make your user enter their zip code.
This whole thing feels a bit like the XYproblem so my big question is what is this extension for exactly?
I'd look into amazon's API
You might be able to simplify how you save things by saving only the product code and it's source then fetching the information through their API instead. But, I am unsure if you'll still be able to get the shipping info.
You can see examples of that on websites like https://rtings.com and https://pcpartpicker.com (pc park picker might be more like what you want to do)