#πŸ”’ Impossible to scrape dynamic table

12 messages Β· Page 1 of 1 (latest)

delicate crown
#

Hi, I have a problem trying to scrape a url.

It's a table that uses selectors to go from one section to another and I'm finding it impossible.

The option I'm trying is to access the data for each player per match by player profile but it's going to be a much longer process and not very effective.

Example URL: https://fbref.com/en/matches/3a6836b4/Burnley-Manchester-City-August-11-2023-Premier-League

My idea is create a dataframe per table and join all together to get stats for each player for match

The two tables have class "table_wrapper tabbed" but you would have to go through each class inside the id "switcher_player_stats_...." which has as class "switcher_content".

midnight stirrupBOT
#

@delicate crown

Python help channel opened

Remember to:

  • Ask your Python question, not if you can ask or if there's an expert who can help.
  • Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
  • Explain what you expect to happen and what actually happens.

:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.

trail moon
#

you may not without our express written permission, use any automated means to access or use the Site, including scripts, bots, scrapers, data miners, or similar software, in a manner that adversely impacts site performance or access; or

midnight stirrupBOT
#

6. Do not post unapproved advertising.

trail moon
#

!rule 5

midnight stirrupBOT
#

5. Do not provide or request help on projects that may violate terms of service, or that may be deemed inappropriate, malicious, or illegal.

trail moon
#

Oh wait I didn't read the last clause

#

You're allowed to scrape lightly

delicate crown
#

Yes, it's allowed to scrape this page while you don't abuse too much

#

Impossible to scrape dynamic table (PAGE ALLOWED)

midnight stirrupBOT
#
Python help channel closed

This help channel has been closed and it's no longer possible to send messages here. If your question wasn't answered, feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.