🔒 Solar and Wind Turbine data generation on Python

[viscid pulsar]

Hello
I have a question

I want to take a weather data from a government website either past or present data. I want to add them to python and have even future data predicted based on the weather website. Then I want to make (equations) to calculate solar panels and wind turbines (energy generation) and how much voltage and current they are operating on. And then present all these algorithm generated data on Node red via dashboard. Is this possible or not?

Can you give some few guides or instructions to help me do if it's possible to do.

Tell me if you need more details
Thank you

[fallow apex]

@viscid pulsar

Python help channel opened

Remember to:

• Ask your Python question, not if you can ask or if there's an expert who can help.
• Show a code sample as text (rather than a screenshot) and the error message, if you've got one.
• Explain what you expect to happen and what actually happens.

:warning: Do not pip install anything that isn't related to your question, especially if asked to over DMs.

Closes after a period of inactivity, or when you send !close.

[fair geyser]

Does the gov website have the data available in API? If not, does the gov website allow you to scrape its contents automatically?

if also no, then you might try and get weather data elsewhere. Like OpenWeather. It has API

[viscid pulsar]

Openweather but I want all data throughout the whole day everyday to be recorded so I can calculate the energy I produce at any moment

Idk if that's possible or not

[fair geyser]

yea thats possible

[viscid pulsar]

Is it possible as well to read how much energy does the solar panels and wind turbines cost to operate knowing that everything is based on algorithms data only because my project is about making system without real hardware to calculate how much everything will cost and how everything will happen if the system get implemented

[fair geyser]

how much energy does the solar panels and wind turbines cost to operate
Where would you get the data on which solar panels and wind turbines?

[viscid pulsar]

Based on the weather data. I want to make equations based on certain type of solar panels and wind turbines to know so I will know the rate of absorption and stuff, then I want to make equations based on the amount of hardware that I have and all that stuff

[fair geyser]

I dont understand but what I think I understand is that you have the specs of the solar panels and wind turbines and use those as estimates instead of actual data but plug in the weather data into it, simulating how much power it generates per area of weather over time.

If thats the case, then yes, its all possible

[viscid pulsar]

Yeah I kinda understand what you are saying. Based on the weather data that I want python to generate and based on the specifications of solar panel and wind turbines, I want to make equations to calculate the generated powerfron them in python and have that data shown on Node red dashboard

[violet sparrow]

What you're wanting then is an end-to-end data ingestion pipeline where you can schedule regular updates

Here's an example of how I'd do it.

First, To answer your question: yes it's very possible but you're asking for a lot.

Here's an example breakdown of the tools I'd use to achieve this.

1. Data ingestion pipeline & scheduling tool: https://www.mage.ai/
2. Web framework: https://reflex.dev/
3. Docker Containers: Regardlless of whether you run this all locally or whether you want this running in the cloud, keeping things containerised will ensure that your tools can run regardless of platform. You can use AWS, Azure, Google, or search for cheaper options. Ask others for some suggestions

Mage would fetch data from api how you like, transform it and store it somewhere.
Reflex would build both your front end and back end.

This would be a full stack workflow, purely in python.

Now, you could do everything you asked without mage. Others may argue that what I've suggested is too complicated. I'd argue that taking the time to use something like that, or maybe airflow or similar, will decouple the ETL task from the task of building a dashboard.

If reflex is too complicated for you, there's other frameworks that are far more simple.

The simplest would probably be streamlit. Dash is another one. I'd say dash is easy to learn hard to master.

@viscid pulsar Any questions?

I will say though, regardless of what tech stack you use, you are asking for a lot and your wording makes me think that you think python is some miracle language, where you can just throw all these things together and expect it to work.

[viscid pulsar]

Thank you so much. I will try to understand and familiarise myself with it, so I can see what I can achieve and what I need. Thank you again

[violet sparrow]

Np.

For now, I would focus on just creating a python notebook, fetching some json data from an api and using pandas to explore that data. I don't know what level you're at but if you're new to python, start there.

[viscid pulsar]

Alright!!!

[fallow apex]

Python help channel closed

This help channel has been closed and it's no longer possible to send messages here. If your question wasn't answered, feel free to create a new post in #1035199133436354600. To maximize your chances of getting a response, check out this guide on asking good questions.