🔒 web scraping from wikipedia

[silver iron]

https://paste.pythondiscord.com/R2VA
if you look at the wikipedia site, there is a table for land borders. Currently how far i got is printing both the country, and then the land borders, but i want is 1. first only check country or territory, and then after that get all the land neighbours of that country
thank you very much!

[tight orchid]

@silver iron

Python help channel opened

Remember to:

• Ask your Python question, not if you can ask or if there's an expert who can help.
• Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
• Explain what you expect to happen and what actually happens.

:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.

Closes after a period of inactivity, or when you send !close.

[steel forum]

I've done something similar
https://gitlab.com/offby1/smallest-enclosing-circle/blob/main/scrape_MTA_stations.py#L28

The gist is: search for the table you want

[silver iron]

ill look at this appreciate the help bro!

[steel forum]

💐

oh and apparently I'm using pandas.read_html too

[silver iron]

what does that mean exactly

[steel forum]

well, "pandas" is a library, just like "requests" or "beautifulsoup"

"read_html" is one of the functions that it provides

I'm using that function

[silver iron]

ahh i see, thats alright with me

if it works 😂

[steel forum]

works for me!

[quick hatch]

somehow, TIL this existed

i think i've manually parsed at least one HTML table in my age 🥴

[steel forum]

I will bet you you wind up with something similar, since I imagine all the tables in wikipedia follow the same structure

[civic gazelle]

why are u scraping wikipedia btw? they have a free rest api for use

[steel forum]

I am pretty sure I tried doing it by hand myself before I stumbled onto this

[steel forum]

I tried the API for my thing, and it wasn't useful

[quick hatch]

there's https://pypi.org/project/wikipedia/

[steel forum]

can't remember the details

[silver iron]

im new to programming so this was just the way i thought i could do it

[civic gazelle]

ah alright

[civic gazelle]

learning cool 👍

[steel forum]

Somehow, TIL this existed

(or else I tried it and gave up on it long ago and then forgot about it)

[tight orchid]

Python help channel closed

This help channel has been closed and it's no longer possible to send messages here. If your question wasn't answered, feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.