#Scrape data from local network

34 messages · Page 1 of 1 (latest)

mint kindle
#

i have a device on my local network that i want to be able to pull data from and track/display it in home assistant. all the guides i can find are about pulling from websites. does anyone know how to do this from within the network?

balmy basin
#

just point at your internal system instead of an external one?

mint kindle
#

i tried that but it didnt work...

balmy basin
#

would be good if you explained exactly what your trying to do and what you have tried so far.

mint kindle
#

i have a Bitaxe miner thats mining. and on the devices IP is displays its info (obviously) and i want to pull the info and track it in home assistant.

#

i added scrape and used the "copy selector" and added that to the info and when i try to view the data nothing shows

balmy basin
#

it looks like it supports bitaxe

mint kindle
#

installing now.. i was looking for AxeOS...

#

ok when i tried to install with custom repo it says its already in the store... added it from the store. now when i try to configure it i get this error "Config flow could not be loaded: {"message":"Invalid handler specified"}"

balmy basin
#

is your HA up to date? and did you restart after installing the integration?

mint kindle
#

pretty sure up to date, says no updates available in the updates section and yes i restarted

balmy basin
#

could try uninstalling it resttarting reinstalling restarting.
else maybe the integration is busted atm and might have to revert to your orginal plan. were you following a guide for that?

mint kindle
#

yea seen a guide on youtube able it. and they were referencing a website called try.jsoup.org but that wont work for me since im using an internal website

balmy basin
#

is the site definetly visible to the HA install at the link your providing to it?

mint kindle
#

i dont fully understand what your asking... but they are on the same network so there isnt a reason why it would be able to view it

balmy basin
#

usually but can depend how the network is set up. is the scrape failing entirily or is it getting invalid data?

mint kindle
#

just says unknown

balmy basin
#

anything in the log?

mint kindle
#

Logger: homeassistant.components.scrape.sensor
Source: components/scrape/sensor.py:185
integration: Scrape (documentation, issues)
First occurred: 1:50:32 PM (1 occurrences)
Last logged: 1:50:32 PM

Index '0' not found in sensor.web_scrape

#

i dont know how to find the index since its the internal network so that jsoup website wont work

#

and the other integration started to work but wont finish configuring it keeps giving me errors

balmy basin
#

i might be missunderstand here but...
that site looks like you just haste in html for it to parse?
why couldnt you open the local site in a browser pull the html and put it into the parser

#

can you link the guide you were following?

mint kindle
#

this is how the website looks

balmy basin
#

what happens if you open the source of the page and copy the html and paste it into the input html on the jsoup site. instead of using the fetch?

#

depending on how the site is generated it may or may not work. are you looking to activly track/automate from the data or just see it?

mint kindle
#

ok right clicked on the page selected view source, copied and pasted that into the input HTML section. and when i paste the selector into the select box nothing shows... track data from it.

#

ok when i copied the data from using the inspect rather than the page source it shows the info in the select box with the index being 0

balmy basin
#

to be honest i am not sure i can be of much further help. my knowledge of scraping is limited. and this is a more a web issue then directly HA. maybe someone has a more specific guide somewhere for this exact job

mint kindle
#

ahhh ok well thank you for helping me as much as you were able to!

#

ok so i chaged the Value Template and now i have this error

Template variable error: 'None' has no attribute 'split' when rendering '{{ value.split("TH/s")[1] }}'