🔒 Need Help Parsing NASA html | Python | Page 1

languid plover Apr 17, 2024, 1:50 AM

#

I am attempting to parse through the Mars weather report on NASA's website but whenever I use requests to get the html the information I'm looking for is no longer present. I've attached screenshots of what I see when inspecting, and what I see in the request I made. Any help would be appreciated thanks.

atomic shoreBOT Apr 17, 2024, 1:50 AM

#

languid plover I am attempting to parse through the Mars weather report on NASA's website but w...

#

@languid plover

Python help channel opened

Remember to:

Ask your Python question, not if you can ask or if there's an expert who can help.
Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
Explain what you expect to happen and what actually happens.

:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.

dry mulch Apr 17, 2024, 1:51 AM

#

i'm pretty sure nasa has a lt of APIs for a lot of stuff

wispy forge Apr 17, 2024, 1:51 AM

#

They do

languid plover Apr 17, 2024, 1:51 AM

#

I've tried looking online and every API is from Insight or another rover which are all offline or outdated

wispy forge Apr 17, 2024, 1:51 AM

#

https://api.nasa.gov/

midnight wren Apr 17, 2024, 1:52 AM

#

https://api.nasa.gov/

#

hah jinx

dry mulch Apr 17, 2024, 1:52 AM

#

https://api.nasa.gov/

#

hah jinx

midnight wren Apr 17, 2024, 1:52 AM

#

Yeah it's stupid easy to get API access for NASA

wispy forge Apr 17, 2024, 1:52 AM

#

Jinx

#

egp_cheers

languid plover Apr 17, 2024, 1:52 AM

#

the weather API linked on the website has been outdated for a few years

#

yeah, all data from insight stopped updating in 2020, I tried looking for an API that records Curiosity's data but I couldn't find one, which is why I attempted to parse through the html on the website

deep tide Apr 17, 2024, 1:56 AM

#

just out of curiosity what's the url that has different content in the browser vs requests?

languid plover Apr 17, 2024, 1:57 AM

#

deep tide just out of curiosity what's the url that has different content in the browser v...

https://mars.nasa.gov/msl/mission/weather/

NASA Mars Exploration

Curiosity Mars Weather at Gale Crater

The Curiosity rover sends back weather reports from Gale Crater, near the equator of Mars.

#

I'm just not capturing what's in between the <span class="marsDate"> and </span>

deep tide Apr 17, 2024, 1:58 AM

#

it looks like they use an api call to load the data

#

i assume this is a public api? it has the rss path https://mars.nasa.gov/rss/api/?feed=weather&category=msl&feedtype=json

languid plover Apr 17, 2024, 1:59 AM

#

oh neat, how'd you find that?

deep tide Apr 17, 2024, 2:00 AM

#

the network tab in the chrome dev tools

#

i filtered to fetch/xhr

languid plover Apr 17, 2024, 2:00 AM

#

wow, thank you!

atomic shoreBOT Apr 17, 2024, 2:03 AM

#

Python help channel closed

This help channel has been closed and it's no longer possible to send messages here. If your question wasn't answered, feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.

#

🔒 Need Help Parsing NASA html

#🔒 Need Help Parsing NASA html