#🔒 How can I properly scrape links from a site?

8 messages · Page 1 of 1 (latest)

neon willow
#

Made some code to scrape wikipedia for search results - while pretty much all of the data is retrieved fine, the link to the page that I want to return to the user only works if there's no spaces in the title. If there is, it doesn't properly format; how would I get the href to the site without some complex joining method?
My code is here - https://paste.pythondiscord.com/37GQ

slow parrotBOT
#

@neon willow

Python help channel opened

Remember to:

  • Ask your Python question, not if you can ask or if there's an expert who can help.
  • Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
  • Explain what you expect to happen and what actually happens.

:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.

Closes after a period of inactivity, or when you send !close.
random cedar
#

Use the official API instead of scraping it

neon willow
#

there's a wikipedia API? didn't know tbh

#

thanks, I'll check it out

#

!close

slow parrotBOT
#
Python help channel closed

This help channel has been closed and it's no longer possible to send messages here. If your question wasn't answered, feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.