#πŸ”’ How to scrape ALL of the news articles from Yahoo Finance News?

4 messages Β· Page 1 of 1 (latest)

dense lion
#

I’m trying to write a program that returns articles and their url link if the news article contains a specific key word. I tried using finance.yahoo.com/news/ but of course that only works for news articles that are being highlighted. There a tons of articles posted on Yahoo Finance News that never end up on that page or even on the latest news page. Does anyone know of a way I can get python to search ALL news articles? The goal is to set the code up to run a search every few minutes which will return any new articles, so ideally I will always be up to date and notified give or take a couple minutes on any articles containing that keyword from Yahoo Finance.

calm sphinxBOT
#

@dense lion

Python help channel opened

Remember to:

  • Ask your Python question, not if you can ask or if there's an expert who can help.
  • Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
  • Explain what you expect to happen and what actually happens.

:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.

calm sphinxBOT
#

@dense lion

Python help channel closed

This help channel has been closed and it's no longer possible to send messages here. If your question wasn't answered, feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.