#Scrape data from local network
34 messages · Page 1 of 1 (latest)
just point at your internal system instead of an external one?
i tried that but it didnt work...
would be good if you explained exactly what your trying to do and what you have tried so far.
i have a Bitaxe miner thats mining. and on the devices IP is displays its info (obviously) and i want to pull the info and track it in home assistant.
i added scrape and used the "copy selector" and added that to the info and when i try to view the data nothing shows
have you tried this? - https://github.com/Schnitzel/hass-miner
custom integration. you can add it via a custom repo using hacs or manually install it
it looks like it supports bitaxe
installing now.. i was looking for AxeOS...
ok when i tried to install with custom repo it says its already in the store... added it from the store. now when i try to configure it i get this error "Config flow could not be loaded: {"message":"Invalid handler specified"}"
is your HA up to date? and did you restart after installing the integration?
pretty sure up to date, says no updates available in the updates section and yes i restarted
could try uninstalling it resttarting reinstalling restarting.
else maybe the integration is busted atm and might have to revert to your orginal plan. were you following a guide for that?
yea seen a guide on youtube able it. and they were referencing a website called try.jsoup.org but that wont work for me since im using an internal website
is the site definetly visible to the HA install at the link your providing to it?
i dont fully understand what your asking... but they are on the same network so there isnt a reason why it would be able to view it
usually but can depend how the network is set up. is the scrape failing entirily or is it getting invalid data?
just says unknown
anything in the log?
Logger: homeassistant.components.scrape.sensor
Source: components/scrape/sensor.py:185
integration: Scrape (documentation, issues)
First occurred: 1:50:32 PM (1 occurrences)
Last logged: 1:50:32 PM
Index '0' not found in sensor.web_scrape
i dont know how to find the index since its the internal network so that jsoup website wont work
and the other integration started to work but wont finish configuring it keeps giving me errors
i might be missunderstand here but...
that site looks like you just haste in html for it to parse?
why couldnt you open the local site in a browser pull the html and put it into the parser
can you link the guide you were following?
the more data you feed Home Assistant hub, the better automations you will have to help with mundane tasks. today i will show you how to scrape, pull data from almost any websites into HA such as stocks, gas prices, and even the lottery
link to codes seen: https://justpaste.it/geu1s
video time index
0:00 intro
0:44 set up in HA
...
this is how the website looks
what happens if you open the source of the page and copy the html and paste it into the input html on the jsoup site. instead of using the fetch?
depending on how the site is generated it may or may not work. are you looking to activly track/automate from the data or just see it?
ok right clicked on the page selected view source, copied and pasted that into the input HTML section. and when i paste the selector into the select box nothing shows... track data from it.
ok when i copied the data from using the inspect rather than the page source it shows the info in the select box with the index being 0
to be honest i am not sure i can be of much further help. my knowledge of scraping is limited. and this is a more a web issue then directly HA. maybe someone has a more specific guide somewhere for this exact job