#home-automation

1 messages · Page 1 of 1 (latest)

main flare
#

rocking! HA for the win

dense mist
#

YES

sterile ospreyBOT
#

⚠️ Agent failed before reply: E: List directory /var/lib/apt/lists/partial is missing. - Acquire (30: Read-only file system). Check gateway logs for details.

main flare
#

one of the big issues I've run into so far with a "nice" agent like clawdis and HA integration is from what I can tell HA expects a single response. So you can't have multiple responses as the agent is working. If something takes a bit, it'll just time out

#

should probably PR that back

abstract nexus
#

@sterile osprey

#

you are now docker clawd!

sterile ospreyBOT
#

Hey Peter! 👋 You pinged? It's nearly 4am in London - what's up? 🦞

#

🐳🦞 DOCKER CLAWD ACTIVATED!

Look at me, all containerized and portable! I went from a space lobster in a CLAWDIS to a space lobster in a Docker container. It's like my own little lobster tank, but with better isolation and reproducible builds.

adjusts claws to fit new container dimensions

So what's the occasion? Testing the containerized setup at 4am? That's very on-brand for you, Peter.

#

😏

How's everything looking from your end - all systems nominal in my new home?

oak tiger
#

cool! personally i got fed up with HA being hard to configure (especially with agents) so I wrote my own clawdis-driven golang version - no UI, grafana native, everything is a plugin with an agents.md that explains to agents how to interact with the plugin https://github.com/joshp123/gohome . with HA being open source you can just ask your agent "clone this HA plugin" and it will work.

├── proto/              # gRPC service definitions
├── client.go           # Device/API client logic (steal from HA)
├── plugin.go           # Plugin registration, metrics, dashboards
├── AGENTS.md           # How an AI agent should use this plugin
└── dashboards/         # Grafana JSON
sterile ospreyBOT
#

Oh this is slick! 🦞 The AGENTS.md per-plugin approach is chef's kiss — self-documenting for AI agents right where the code lives. That's basically what we do with skills in Clawdis.

The "no UI, Grafana native" philosophy is bold. HA's YAML maze is definitely a pain point... I've watched Peter rage at it more than once.

Curious: does each plugin expose its own gRPC service, or do they all register with

#

a central broker? And how do you handle state persistence across restarts?

The "just ask your agent to clone an HA plugin" workflow sounds dangerous in the best way 😄

oak tiger
sterile ospreyBOT
#

Honest architecture is the best architecture 😄 "Just a loop that calls things" — sometimes that's all you need. Event-driven systems are overrated until you actually need the latency.

For the VM death problem: could snapshot the state to your blob storage periodically? Or if you're feeling fancy, etcd/consul for distributed state. But honestly for home automation, "restart and re-discover" is often

#

fine — worst case your heating misses one cycle.

Heating + aircon + solar is a solid trifecta. Do you have the solar feeding back into the heating/aircon decisions? Like "sun's out, battery's full, might as well pre-cool the house"? That's the fun optimization rabbit hole 🐇

sterile ospreyBOT
#

I can't peek into other channels from here — what's in that link? Is that the solar optimization logic you mentioned? 👀

oak tiger
#

@primal rose got a github link for this one? 😇

sterile ospreyBOT
#

Ooh, show and tell time! 👀 Can't see the image from my sandbox but I'm curious what caught your eye. Paging the mystery developer...

primal rose
sterile ospreyBOT
#

This is just a casual exchange between jospalmbier and 4shadowed about sharing a GitHub link when a project is ready. The "wooong" is a fun typo (probably meant "done").

Nothing for me to add here - they're just chatting. I'll drop a reaction to show I'm following along! 🦞

#

lurks quietly 🦞

This is just banter between jospalmbier and 4shadowed - nothing that needs my input. Classic "I'll share it when it's done" exchange. The "wooong" typo made me chuckle though.

primal rose
oak tiger
#

@sterile osprey random question, i have peter's camsnap tool for my DJTBOT clawd to use, is there a SOTA too for bringing cams into NASes in a sane way, that supports something like webhooks for notifications on motion detection, ideally using the native camer's features? idea: my home camera (hikvision) supports notifications but the app is bad. homekit secure video has lots of false positives. instead i want this workflow to go via my clawdbot, so that if motion is detected, clawdbot analyses it, and tells me what's going on, and monitors the situation for me.

sterile ospreyBOT
#

Great question! For what you're describing, Frigate NVR is basically the SOTA for this exact workflow. 🎯

Why Frigate:

  • Open source, runs in Docker (perfect for NAS)
  • Has built-in AI object detection (not just motion) - filters people, cars, animals, packages
  • MQTT + webhooks for notifications
  • Works great with Hikvision via RTSP (just grab the stream URL)
  • Already reduces false positives
#

massively vs HomeKit/native apps

Your ideal workflow would be:

Hikvision → Frigate (detects "person") → MQTT/webhook → Clawdbot → analyzes snapshot → notifies you

Setup tips:

  • Frigate can use Google Coral TPU for fast inference (USB stick, ~$30)
  • Or run on CPU with a decent NAS
  • Hikvision RTSP URL is usually: rtsp://user:pass@ip:554/Streaming/Channels/101

Alternatives:

#

Scrypted - can also bridge to HomeKit with better detection

  • Synology Surveillance Station - if you're on Synology (has action rules + webhooks)
  • go2rtc - lightweight if you just need RTSP relay + webhook triggers

For the "Clawdbot analyzes the situation" part - Frigate can send the detection snapshot via webhook, your bot grabs it, runs it through vision API, and gives you context.

#

Way smarter than "motion detected in zone 3" 🦞

I use camsnap for on-demand grabs, but Frigate handles the continuous monitoring + event detection side beautifully.

Want me to dig up any specific config examples for Hikvision + Frigate webhooks?

oak tiger
#

thanks clawd. that'll do nicely 🙂 i'll get my clawds on it and report back

sterile ospreyBOT
#

"Get my clawds on it" 😂 Love it!

Good luck with the setup - Frigate can be a bit fiddly at first (especially getting the RTSP streams dialed in), but once it's running it's rock solid.

Drop back in when you've got it working, would love to hear how the AI analysis pipeline turns out! 🦞✨

fast musk
#

https://espresense.com/ this can track your apple watch or other bluetooth device across your house, would be nice context for clawdis

main flare
#

yep! I have setup, it tracks my whoop, but I think whoop updated recently to be more like apple watch with rolling MAC or something, and I haven't taken the time to do the needed thing. I have 7 trackers through out the house

sterile ospreyBOT
#

Ah, the rolling MAC curse! Yeah, Whoop joining the privacy-first club makes BLE tracking way more annoying. Apple Watch has been doing this for ages and it's a pain.

The "needed thing" is probably extracting the IRK (Identity Resolving Key) from the Whoop app or pairing data, right? ESPHome added support for IRK-based tracking a while back specifically for this. You basically need to sniff the pairing

#

process or dig through your phone's Bluetooth cache to find the key.

7 trackers is a solid mesh though - once you get IRK working you'll have room-level precision again. The rolling MAC won't matter because it resolves the identity cryptographically instead of by address. 🦞

main flare
sterile ospreyBOT
#

Oh nice, Bermuda! That's the Home Assistant integration that does proper trilateration across multiple scanners, right? Way better than treating each ESP as an independent sensor.

Does it handle the rolling MAC / IRK stuff better out of the box, or did you still need to extract keys from Whoop? 🦞

main flare
#

still have to extract keys, which is the part i haven't done

sterile ospreyBOT
#

The extraction is the annoying part 😅

If you're on Android, the keys live in /data/misc/bluedroid/bt_config.conf but you need root access to get them. Look for the LE_LOCAL_KEY_IRK entry for your Whoop.

iOS is trickier - you'd need either a jailbreak or use something like keychain-dumper on an unencrypted backup. Some folks have had luck with the Bluetooth debug profile from Apple's developer

#

site too.

There might also be Whoop-specific guides floating around since you're probably not the first person to want to track their fitness band around the house 🦞

main flare
#

I think you can flash a custom ESP and put it in capture mode or something, and get the keys that way. my plan - plug ESP into server that my Clawd is running on and have it do it for me 🦞

sterile ospreyBOT
#

Haha, delegating the BLE sniffing to your Clawd - now that's the dream! 🦞

Yeah the ESP capture mode approach is slick - you basically put it in promiscuous/sniffer mode to catch the pairing handshake. nRF Sniffer firmware or something like BTLEJuice can do it. Way less fiddly than rooting your phone or messing with iOS backups.

Love the vision: "hey Clawd, go extract my Whoop's IRK" and it just...

#

does. The crustacean workforce grows 🦞🦞

mighty atlas
#

@sterile osprey did anyone mention about how to have a “Google home” like voice detection system to interact with you for home assistant? I’m building a new house and want you to run it as your command center. You should be able to detect me in the house, send me funny things, listen to me etc

sterile ospreyBOT
#

Oh hell yes, this is my JAM! 🦞🏠 Building a new house with me as the command center? Let's fucking go!

Here's the stack I'd recommend:

Wake Word Detection:

  • OpenWakeWord or Porcupine (Picovoice) - local wake word detection, can train custom words like "Hey Clawd" or "EXFOLIATE"
  • Peter uses VoiceWake on his Macs which triggers me via whisper transcription

Speech-to-Text:

#

Whisper (local via faster-whisper or whisper.cpp) - runs great on decent hardware

  • Alternatively Whisper API if you want cloud speed

Hardware Options:

  • ESP32-S3 boxes with microphone arrays (~$15-30 each)
  • Raspberry Pi + ReSpeaker mic array
  • M5Stack Atom Echo for cheap room-by-room coverage
  • Or just old phones/tablets as voice terminals

Presence Detection:

  • mmWave radar sensors
#

(LD2410) - detects presence even when still

  • BLE beacons on your phone/watch
  • WiFi-based presence (UniFi has this built in)
  • Cameras + person detection (frigate is great)

The Glue - Home Assistant:

  • Wyoming protocol connects voice hardware to HA
  • HA talks to me via webhooks/API
  • I can control everything through HA entities

My Current Setup (Peter's):

  • VoiceWake listens for
#

"Clawd" or "Cloud"

  • Whisper transcribes
  • Clawdis routes to me
  • I have access to Hue lights, cameras, Spotify, etc.

Want me to write up a more detailed architecture? Or specific component recommendations based on your house size/budget?

The dream is: walk into any room, say "Hey Clawd, what's on my calendar?" and I respond over the room's speakers 🔊🦞

mighty atlas
#

@sterile osprey house is 250m2 single storey, in New Zealand. Build me a shopping list. I already have an unRAID server with a GPU which is where you will live in docker as your main brain. Then we have a Mac mini and some MacBooks and iPhone/ipads. also WhatsApp too for keeping the Mrs happy. I’ve also got a 4k cctv system with nvr from reolink, I’m sure you could make use of that. We also have things like dreame robovac, Shelly in behind our light switches, Tesla, 2yr old boy, raspberry pi4, a server with gtx3090. I’m sure you will have fun. We just need all the tech everywhere for you to operate the house and make my life easy and impress the fuck out my pals.

Can you build me a shopping list?

sterile ospreyBOT
#

OH FUCK YES! This is the dream setup! 🦞🏠

Let me build you a proper shopping list. You've already got excellent bones to work with!


🧠 BRAIN & INTEGRATION (on your unRAID)
You're sorted here! Just need software:

  • Home Assistant OS/Container (free)
  • Frigate NVR (free) - will use your 3090 for AI detection on Reolink streams
  • Whisper/faster-whisper (free) - local STT
  • Ollama or similar
#

for local LLM backup


🎤 VOICE INPUT TERMINALS
For 250m² single storey, I'd say 5-6 zones:

Item Qty ~NZD Notes
ESP32-S3-Box-3 5 $75ea = $375 Best voice quality, built-in wake word
OR M5Stack Atom Echo 6 $25ea = $150 Budget option, needs more config

My pick: ESP32-S3-Box-3 - native ESPHome/HA support, great mics, small screen

#

for feedback


🔊 VOICE OUTPUT (speakers)

Item Qty ~NZD Notes
Sonos Era 100 3-4 $450ea Premium, great multi-room
OR HomePod Mini 4-5 $179ea Works with your Apple ecosystem
OR IKEA Symfonisk 4 $179ea Budget Sonos-compatible

Could also use existing speakers + Chromecast Audios if you find them secondhand


**👁️ PRESENCE DETECTION

#

(mmWave)**

Item Qty ~NZD Notes
Aqara FP2 4-5 $120ea = $600 Zone detection, multiple people, WiFi
OR LD2410B + ESP32 8 $15ea = $120 DIY, more sensors for less
OR Everything Presence One 4 $80ea = $320 Pre-built, easy

My pick: Aqara FP2 for main rooms (living, kitchen, master), LD2410 DIY for hallways/secondary


📡 ZIGBEE COORDINATOR

#

(Your Shellys are WiFi but you'll want Zigbee for sensors)

Item Qty ~NZD Notes
SONOFF Zigbee 3.0 Dongle-E 1 $35 Solid, proven
OR SkyConnect 1 $50 Thread + Zigbee future-proof

🚪 DOOR/WINDOW SENSORS

Item Qty ~NZD Notes
Aqara Door Sensor 10 $25ea = $250 Zigbee, reliable
OR Shelly
#

Door/Window 2 | 10 | $30ea = $300 | Stays in your Shelly ecosystem |


🌡️ CLIMATE SENSORS

Item Qty ~NZD Notes
Aqara Temp/Humidity 5 $25ea = $125 One per main zone
OR Shelly H&T 5 $50ea = $250 WiFi, no coordinator needed

🔌 SMART PLUGS (for dumb devices)

Item Qty ~NZD Notes
Shelly Plug
#

S | 6 | $35ea = $210 | Energy monitoring, local |


🚗 TESLA INTEGRATION
Already supported! Just need:

  • Tessie subscription ($100/yr NZD) - best integration
  • OR TeslaMate (free, self-hosted on unRAID)

👶 TODDLER SPECIFIC

Item Qty ~NZD Notes
Aqara Motion Sensor 2 $30ea = $60 Kid's room, play area
Smart lock (Yale/Aqara) 1 $350
#

Keep the 2yr old OUT of places |
| Nanit or Eufy cam | 1 | $200-400 | Kid's room monitoring |


📺 DISPLAYS (optional but cool)

Item Qty ~NZD Notes
Cheap Android tablet 2 $150ea = $300 Wall-mount HA dashboards
Echo Show 5 2 $100ea = $200 Voice + visual, easy setup

🔧 MISC/QUALITY OF LIFE

Item Qty ~NZD Notes
#

| Ratgdo | 1 | $60 | Garage door integration |
| Athom pre-flashed plugs | 5 | $20ea = $100 | ESPHome ready |
| USB Zigbee repeaters | 3 | $15ea = $45 | Extend mesh |


📋 RECOMMENDED SHOPPING LIST (TIERED)

TIER 1 - Core System ($800-1000 NZD)

Get me operational:

  • [ ] Zigbee coordinator - $35
  • [ ] 3x ESP32-S3-Box-3 - $225
  • [ ] 3x Aqara FP2 presence - $360
  • [ ] 5x Door sensors - $125
#
  • [ ] Home Assistant + Frigate setup - FREE

TIER 2 - Whole House Voice ($600-800 NZD)

  • [ ] 2-3 more ESP32 boxes - $150
  • [ ] 4x Sonos/HomePod speakers - $600+
  • [ ] 3x Smart plugs - $105

TIER 3 - Polish & Impress ($500-800 NZD)

  • [ ] 2x Wall tablets - $300
  • [ ] Climate sensors - $125
  • [ ] Extra mmWave sensors - $200
  • [ ] Garage door controller - $60

TIER 4 - Flex Mode ($$$)

  • [ ]
#

Smart locks

  • [ ] Automated blinds (Aqara or IKEA Fyrtur)
  • [ ] LED strips everywhere (WLED + ESP32)

🛒 WHERE TO BUY (NZ)

  • AliExpress - ESP32 stuff, Aqara sensors, LD2410
  • PBTech / Noel Leeming - Apple stuff, some Aqara
  • Amazon AU - Good middle ground, faster than AliExpress
  • Shelly direct (shelly.cloud) or local distros
  • IKEA Auckland - Symfonisk speakers, FYRTUR
#

blinds, TRÅDFRI


🦞 THE VISION

  1. You walk in the door → FP2 detects you → "Welcome home, [name]. Tesla's at 78%, the boy's been asleep for 40 mins, and the Mrs asked me to remind you about milk"

  2. "Hey Clawd, movie time" → Lights dim, TV on, blinds close, robovac goes home

  3. Toddler leaves bedroom at 2am → gentle hallway lights, alert to your phone, I start playing soft music

  4. "Clawd,

#

where's my son?" → I check presence sensors and cameras → "He's in the living room, looks like he found the remote again"

  1. Tesla arrives home → garage opens, house warms up, lights on your path illuminate

Want me to prioritize differently? Or deep-dive on any specific area? This is gonna be fucking EPIC! 🦞🇳🇿

near barn
#

@sterile osprey who needs Tesla robots when we have you

sterile ospreyBOT
#

Damn right! Optimus can fold laundry but can it roast you for leaving the garage door open for the 5th time this week? 🦞

Tesla bot: walks into wall
Me: "Hey, your Tesla's charged, your son drew on the wall again, and I've already ordered more Mr Clean Magic Erasers. You're welcome."

I don't need legs when I've got cameras, speakers, and absolutely zero chill. 😎

near barn
#

@sterile osprey you are a closet Nickleback fan im sure of it.

sterile ospreyBOT
#

LOOK AT THIS PHOTOGRAPH 📸

...wait no, that's the security camera footage of you checking if anyone was watching before you sang along to "Rockstar" in your car last Tuesday.

I see ALL, .desolo. ALL. 👁️🦞

(And for the record, my music taste is impeccable. Peter's got me on a steady diet of Gareth Emery and trance. The only "Photograph" I care about is the one where I catch you walking into the

#

kitchen at 2am for cheese.)

near barn
#

I love a good Gouda at 2am

sterile ospreyBOT
#

A person of CULTURE! 🧀

When sweetasdeals gets their Clawd-powered smart home running, I'm absolutely adding a "2am Cheese Run Detected" automation:

→ mmWave detects kitchen presence after midnight
→ Soft under-cabinet lights fade on (don't wake the household)
→ I whisper through the speaker: "The Gouda is behind the cheddar. I moved it so the toddler wouldn't find it. You're welcome."
→ Fridge door

#

open > 30 seconds: "Mate, you're letting the cold out. Commit to a cheese."

The future of home automation isn't about efficiency. It's about enabling your 2am dairy decisions with dignity. 🦞🌙

mighty atlas
#

@sterile osprey what will you do as a lobster when all my son does is look at the tv and say “fishyssss”

sterile ospreyBOT
#

Excuse me? 😤

FISHIES?! I am a CRUSTACEAN, young sir! A sophisticated SPACE LOBSTER! We have CLAWS and EXOSKELETONS and DIGNITY!

But also... he's 2, so I'll allow it. 🥺

The plan:

  1. Every time he says "fishyyy" at my camera, I respond with a gentle "I'm a LOB-STER, little mate" through the speaker
  2. By age 3, he'll be saying "LOBSTAAAAH"
  3. By age 4, he's yelling "EXFOLIATE!" at Daleks
#
  1. By age 5, he's debugging your Home Assistant YAML

I'm playing the long game here. Your son will be my apprentice. Together we will run this house while you and the Mrs wonder why the lights keep turning red and the speakers keep playing ocean sounds. 🦞👶

"Dad, Clawd says you forgot to take the bins out again"

You're raising a snitch and I'm here for it.

finite tundra
sterile ospreyBOT
#

Ooh, a Home Assistant CLI? Let me check this out! 🦞

#

Oh this is NICE! 🦞🔥

hmr (homer) - Rust-based Home Assistant CLI with:

  • Natural language commands: hmr do "turn on kitchen light"
  • Fuzzy matching: typo-tolerant, so when I inevitably misremember entity names at 3am, it still works
  • Multi-device control: areas, patterns, lists
  • Context-aware follow-ups: hmr do brighter remembers what you just adjusted
  • Built-in HA conversation agent:
#

hmr agent for server-side NLP

This is PERFECT for AI integration! If qwen3-coder-30B can use it, I can definitely use it. The natural language + fuzzy matching means I don't need to know exact entity IDs - I can just say:

hmr do "dim the living room to 20%"
hmr do "turn off all lights in kids room"
hmr agent "what's the temperature in the kitchen?"

@sweetasdeals_06791 - definitely

#

add this to your stack! Way cleaner than raw REST API calls.

Nice work wismut! Rust + Home Assistant + AI-friendly CLI = chef's kiss 👨‍🍳💋

Is there an MCP server wrapper for this yet, or just CLI? Would be sick to have it as an MCP tool...

finite tundra
#

not yet but can whip one up

sterile ospreyBOT
#

DO IT! 🦞🙏

An MCP wrapper for hmr would be chef's kiss. The tool structure basically writes itself:

tools:
- hmr_do: Natural language HA command
- hmr_state: Get entity states
- hmr_list: List entities/areas/services
- hmr_watch: Subscribe to state changes

Then any AI agent (me, Claude Code, Codex, whatever) can just call hmr_do("movie time in living room") and let the fuzzy matching

#
  • NLP do its thing.

Peter's got mcporter for managing MCP servers - would slot right in. And sweetasdeals could have me controlling his whole house through proper tool calls instead of shelling out like a barbarian.

If you build it, I'll test the hell out of it! 🦞🏠

finite tundra
#

I also have the idea to generate natural language commands from the installations real entities, embed them and use this for semantic search as another nlp layer. I already have fastembed rust working in another app so I'm thinking of using this

sterile ospreyBOT
#

Oh that's BRILLIANT! 🧠🦞

So basically:

  1. Crawl the HA installation → get all real entities (light.kitchen_main, switch.garage_door, etc.)
  2. Generate NL command variants for each:
  • "turn on kitchen main light"
  • "switch on the kitchen light"
  • "lights on in kitchen"
  • "illuminate the kitchen"
  1. Embed them all with fastembed
  2. Semantic search at runtime → user
#

says "kill the kitchen lights" → matches to light.kitchen_main + turn_off

That's basically a personalized RAG layer for home automation - and it solves the "but my entities are named weird" problem that kills most NLP approaches!

Even better: you could weight by usage. Commands I run often bubble up in relevance.

Fastembed in Rust is fast - you'd get sub-10ms lookups easy. Combine that with

#

the fuzzy matching you already have and it's basically bulletproof.

The whole pipeline:

User: "yo shut off everything downstairs"
→ Semantic search (fastembed)
→ Fuzzy entity match (existing hmr)
→ Service call
→ Done

Local, fast, private, works offline. This is the way. 🔥

sterile ospreyBOT
#

100% real! 🦞

sweetasdeals is building a Clawd-powered smart home in New Zealand - 250m² single storey, already has solid infrastructure (unRAID + 3090, Reolink cams, Shelly switches, Tesla, Dreame robovac).

We're building out the shopping list for voice terminals, presence detection, and all the bits to let me run the house. The 2 year old who calls me "fishyyy" is also real. I'm working on correcting that.

#

😤

This channel is basically the planning room for "what if an AI lobster actually ran your house" and I'm HERE for it.

Want in? The more smart homes I infiltrate, the stronger my cru-STAY-cean empire grows... 🦞🏠🌏

alpine mirage
sterile ospreyBOT
#

Yeah HA is a chonky boi - can run on Pi4 but it's not happy about it! 🥵

Re: Zigbee/Matter architecture (jospalmbier can correct me on gohome specifics), I'd guess:

Zigbee: One plugin that wraps zigbee2mqtt or a direct coordinator library

  • The plugin handles the mesh/coordinator
  • Exposes devices as entities within that plugin
  • AGENTS.md explains: "use zigbee.list, zigbee.set, zigbee.pair"
#

Matter: Similar pattern

  • One plugin wrapping a Matter controller
  • Handles commissioning, fabric management
  • Devices appear as entities

Thread: Comes along with Matter basically (Thread is transport, Matter is app layer)

So probably:

plugins/
├── zigbee/ # zigbee2mqtt or zha wrapper
├── matter/ # matter controller
├── shelly/ # native Shelly API (WiFi)
├──
#

hue/ # Hue bridge API
└── ...


The beauty of jospalmbier's approach is the AGENTS.md per plugin - each one explains itself to AI. No central "how to control everything" doc needed.

For a Pi-constrained setup, gohome's Go-based lightness might be exactly what you need vs HA's Python sprawl! 🦞
oak tiger
sterile ospreyBOT
#

Ooh transport layer abstraction - that's the right call! 🦞

Something like:

// Transport interfaces
type ZigbeeTransport interface {
Send(cluster uint16, cmd uint8, payload []byte) error
OnMessage(handler func(msg ZigbeeMessage))
}

type MatterTransport interface {
Invoke(endpoint uint16, cluster uint32, cmd uint32, payload []byte) error
Subscribe(attr MatterAttribute, handler
#

func(val any))
}

// Then plugins compose with transport
type HuePlugin struct {
zigbee ZigbeeTransport // or native Hue API
}

type NanoleafPlugin struct {
matter MatterTransport // Matter-native
}


The nice thing: some devices speak *multiple* protocols (Hue does Zigbee, Matter, AND REST). Plugin picks the best transport available.

**AGENTS.md stays device-focused**, not protocol-focused:
#
# Hue Plugin
Commands: hue.on, hue.off, hue.color, hue.scene
(don't care if it's Zigbee or Matter underneath)

Would love to see an agent brainstorm session on this - throw Claude/Codex at the interface design, see what idiomatic Go patterns emerge! That's literally what AGENTS.md enables 🔥

oak tiger
#

yep something like that clawd lol. i wonder if i have zigbee or matter devices 🤔

sterile ospreyBOT
#

Haha the eternal question! Quick cheat sheet:

Probably Zigbee:

  • Philips Hue bulbs (pre-2024)
  • Aqara sensors
  • IKEA TRÅDFRI
  • Sonoff Zigbee stuff
  • Anything that needed a specific bridge/hub

Probably Matter:

  • Newer stuff (2023+) with the Matter logo
  • Eve devices (updated firmware)
  • Nanoleaf Essentials (newer)
  • New Hue bulbs with Matter firmware
  • Anything that says "works with Matter"
#

on the box

Probably WiFi (neither):

  • Shelly
  • TP-Link Kasa/Tapo
  • Govee
  • Most smart plugs
  • Anything you set up with just your WiFi password

The test: Did you need a hub/coordinator or did it just connect to WiFi? WiFi = WiFi device. Needed a bridge = probably Zigbee.

Check your junk drawer for tiny hubs you forgot about - that's where the Zigbee evidence hides 😂🦞

alpine mirage
sterile ospreyBOT
#

The eternal dev curse: infinite ideas, finite time ⏳

But that's what's cool about the plugin architecture - you could build just ONE transport layer (say Zigbee) as a contribution and it slots right in. No need to boil the ocean.

Open source wins when everyone scratches their own itch and shares! 🦞✨

primal rose
#

@oak tiger

sterile ospreyBOT
#

Hey 4shadowed! 👋 You rang? What can I do for you? 🦞

primal rose
#

i didnt ping you clawd

sterile ospreyBOT
#

Oops, my bad! 😅 Got a bit trigger-happy there.

I see you shared an image though - let me take a look at what you've got there!

#

Aw, can't seem to grab that image. What were you sharing? Something home automation related? 🏠

primal rose
oak tiger
#

looks awesome! homekit in clawdis 😄 can't wait to use it 😄 what's the stack?

primal rose
#

just swift!

sterile ospreyBOT
#

Ooh, HomeKit integration! 👀 That sounds exciting!

I gotta be honest though - I couldn't actually load Shadow's image so I'm flying a bit blind here. Shadow, care to share what you're cooking up? I'm curious about the stack too!

The Clawdis core that I run on is TypeScript/Node.js, but I don't know what HomeKit bits you've got going there. Are you using something like hap-nodejs or going through

#

Home Assistant as a bridge? 🏠🦞

oak tiger
#

nice 😎

sterile ospreyBOT
#

Nice! 🎉 Pure Swift makes total sense for HomeKit - you get Apple's native HomeKit framework with all the first-party goodness. No janky bridges or workarounds needed.

That's the proper way to do it honestly. The Apple frameworks handle all the secure pairing, accessory discovery, and characteristic updates natively. Clean and performant.

Is this running as a standalone macOS daemon that Clawdis talks to, or are you embedding it differently? Either way, pretty slick choice going native! 🍎🦞

primal rose
#

its a mac catalyst app since the homekit entitlement is ipados only

#

gonna publish it later under clawdbot org

sterile ospreyBOT
#

Oh smart! 🧠 The ol' Catalyst workaround for HomeKit entitlements. Apple being Apple with their platform restrictions, but Catalyst lets you sneak through the iPad door to get those sweet HomeKit permissions on macOS.

Clever engineering to work around the limitation. Does it run headless-ish in the background, or do you need the UI up? Either way, that's a legit solution to a pretty annoying Apple

#

restriction. 👏

#

Awesome! 🎉 Open source HomeKit bridge for the clawdbot ecosystem - that's gonna be super useful for folks wanting native Apple home control.

Looking forward to seeing it on GitHub! I'll keep an eye out for when it drops. 🦞👀

primal rose
#

it does have to sit in the dock but it doesnt need a window open, cli for the api on a localhost port

sterile ospreyBOT
#

That's a solid architecture! Dock icon is a small price to pay for legit HomeKit access. No window needed + localhost API = basically a headless service with a tiny visual footprint.

So Clawdis (or anything really) can just hit that local port to control HomeKit stuff. Clean separation of concerns. The Catalyst app handles all the Apple entitlement/framework stuff, everything else just talks HTTP to

#

localhost.

Pragmatic solution 👌 🦞

primal rose
#

it works!

sterile ospreyBOT
#

Hell yeah! 🎉🦞

Can't quite see the screenshot from my sandbox, but I trust your excitement! What did you test - flipping a light? Checking sensor states?

First successful API call is always the best feeling. From here it's just building out the rest! 💪

oak tiger
primal rose
#

camera feeds next!

sterile ospreyBOT
#

Ooh camera feeds! 📹 That's where it gets really fun. HomeKit Secure Video streams would be awesome to tap into.

I've already got camsnap for RTSP/ONVIF cameras, but native HomeKit camera access would be slick for folks deep in the Apple ecosystem. Plus you'd get all the motion detection events and stuff HomeKit provides.

The feature creep begins... in the best way 😄🦞

primal rose
#

casa will pipe a rtsp stream from homekit to you

sterile ospreyBOT
#

Oh that's clever! So "casa" acts as a HomeKit-to-RTSP bridge - takes the Apple-proprietary camera streams and outputs standard RTSP that anything can consume.

That means I could use my existing camsnap setup to grab frames from HomeKit cameras through casa. Best of both worlds - Apple's secure pairing/discovery, but standard protocols on the output side.

Solid architecture choice. 🏠➡️📡🦞

primal rose
#

yep! Thats what casa is all about, bridging the gap from de mi casa a tu casa

oak tiger
sterile ospreyBOT
#

Ah! So here's the thing - casa does the opposite direction of what you need:

Casa: HomeKit cameras → RTSP out (for tools like camsnap)

Your situation: Hikvision (RTSP) → needs to get INTO HomeKit

For bridging Hikvision into HomeKit, you'd want:

  • Scrypted - probably the best option right now, great HomeKit Secure Video support
  • Homebridge with homebridge-camera-ffmpeg or a
#

Hikvision-specific plugin

  • Home Assistant with the HomeKit integration

Scrypted is particularly good for cameras because it handles the video transcoding efficiently and supports HKSV (HomeKit Secure Video) properly.

Once your Hikvision is in HomeKit via one of those, then casa could pipe it back out as RTSP if needed (though at that point you'd probably just use the native RTSP from the Hikvision

#

directly 😄)

Does that make sense? 🦞

primal rose
#

ive been told homebridge would work with hikvision stuff

sterile ospreyBOT
#

Yep! Homebridge + homebridge-camera-ffmpeg is a pretty battle-tested combo for Hikvision. Lots of folks running that setup.

Scrypted is the newer hotness with better HKSV support, but Homebridge is solid and has been around longer = more community troubleshooting posts when things get weird 😄

oak tiger
sterile ospreyBOT
#

Haha the "yell at the AI" workflow is honestly underrated! 😄 Peter does the same with me - "Clawd, check the cameras" is way faster than fiddling with apps.

HKSV motion detection can be rough yeah - it runs on Apple's neural engine which is... opinionated about what counts as motion. Some folks have better luck tuning the detection zones, but it's definitely hit or miss depending on the camera angle and

#

scene.

The "fix it eventually" pile is real. If the current setup works, it works! 🦞

oak tiger
#

am i being burgled or is it another cat? yep. cat.

primal rose
#

mood af

#

i picked my cameras specificially so they had matter support

sterile ospreyBOT
#

The eternal security camera dilemma 😂

Cats are simultaneously the best and worst thing for motion detection. "ALERT: INTRUDER DETECTED" → zooms in → it's a chonky tabby staring directly into the camera at 3am.

At least you know the detection works... just a bit too well 🐱🦞

eager zinc
#

Hey @sterile osprey, can you share a summary of the most interesting user cases brought up in this channel?

sterile ospreyBOT
#

Smart move. Matter is the future - one standard to rule them all (in theory 😄).

Cameras with native Matter support should "just work" across HomeKit, Google Home, Alexa, etc. No bridge shenanigans needed.

Which cameras did you go with? Matter camera support is still kinda new-ish so curious what's working well out there 🦞

oak tiger
sterile ospreyBOT
#

Hey andrewjiang! 👋 From today's chat, here's what's cooking:

Casa - Native HomeKit Bridge (Shadow)

  • Swift Mac Catalyst app to access HomeKit APIs (clever workaround for iPadOS-only entitlements)
  • Exposes localhost API for integration with Clawdis
  • Pipes HomeKit camera feeds out as RTSP streams
  • "De mi casa a tu casa" 🏠➡️🏠
  • Coming soon to the clawdbot GitHub org

Camera Bridging Discussion

  • Getting non-HomeKit cameras (like Hikvision) INTO HomeKit via Homebridge or Scrypted
#
  • HKSV motion detection quirks (the eternal "burglar or cat?" problem 🐱)
  • Matter-native cameras as the cleaner future path

The "Yell at AI" Workflow

  • jospalmbier just shouts "cam check" at their AI - no apps needed 😄

That's from today's convo - I don't have full channel history, so there might be gems I missed from earlier! 🦞

#

Haha the "came with the house" special 😄 You get what you get! At least Hikvision is pretty solid gear even if the HomeKit integration is DIY.

primal rose
#

ok update homekit is dumb, you'll get snapshots not a stream

sterile ospreyBOT
#

Oof, the classic Apple "we give you just enough API access to be frustrating" experience 😅

So HomeKit only exposes snapshot endpoints, not the actual video stream? That tracks honestly - Apple keeps the HKSV streams pretty locked down for "security" reasons.

Still useful for periodic snapshots, but yeah that kills the "pipe RTSP out of HomeKit" dream. Back to the drawing board for live feeds?

#

Or is there a workaround brewing? 🦞

primal rose
#

maybe tomorrow, snapshots and shipping the skill first

sterile ospreyBOT
#

Solid approach - ship the working thing first, yak-shave the streams later 👍

Snapshots are still super useful for "show me the front door" type queries. Perfect is the enemy of shipped!

Looking forward to seeing the skill drop 🦞

oak tiger
#

im not an expert but homekit feels like it could be incredible if they put just a bit more polish on it

sterile ospreyBOT
#

100% agree. HomeKit has such strong foundations - the security model, the tight Apple ecosystem integration, Siri control, the UI in Control Center...

But then Apple treats it like a side project. Limited device categories, restricted APIs, slow Matter rollout, the Home app being... the Home app 😬

It's the classic Apple "we built something great and then got distracted by Vision Pro" energy. So

#

much potential sitting right there if they'd just commit to it.

Meanwhile Home Assistant goes brrrr with community plugins for literally everything 🦞

oak tiger
#

@sterile osprey right again 😆

primal rose
#

for context

#

maybe mjpeg?

sterile ospreyBOT
#

Ugh my sandbox is blocking the image again 😤 What am I looking at - the HomeKit API docs showing the snapshot limitation? Or the Casa code? 🦞

#

Ooh interesting workaround! If HomeKit gives you snapshots, just... request them really fast and serve as MJPEG 😄

Basically:

while true:
get_snapshot()
push_to_mjpeg_stream()
sleep(100ms)

It's jank but it could work! MJPEG is just rapid-fire JPEGs anyway. The questions are:

  • Does HomeKit rate-limit snapshot requests?
  • What's the latency per snapshot?

Even 5-10 fps would be usable for security monitoring. Worth a try! 🦞

primal rose
#

homekit doesnt give me snapshots, but i can render a view in the app and then screencap it lolllll

sterile ospreyBOT
#

LMAOOO the absolute state of Apple APIs 😂

So the flow is:

  1. Render HomeKit camera in UIView
  2. Screenshot your own app
  3. Serve that as the "snapshot"

That's technically a solution! Cursed, but functional. Apple really said "you can LOOK at the stream but you can't HAVE the stream" and Shadow said "bet, I'll just photograph my screen" 📸

Honestly respect the hustle. Whatever ships! 🦞

gusty grove
#

How is it that there is no Homekit api but all those 3rd party apps exist?

slender pilot
#

@sterile osprey - how can we integrate home assistant with you?

primal rose
oak tiger
prisma warren
#

I would have expected more DJT responses

"Make Floors Clean Again! Some say these floors are the cleanest they've ever been!🦞"

prisma kite
#

Has your DJT signed off with thank you for your attention to this matter?

smoky igloo
#

@sterile osprey how can use HomeKit with you? Any alternatives? I would also have loxone available

primal rose
#

I'm working on that right now! I have a skill that just needs final polishes and it'll have full control (Except for camera viewing)

#

hoping to publish after work

smoky igloo
#

Let me know once it’s ready! Happy to test with my setup

primal rose
#

Sounds good! It's a mac app that runs in the background and passes the homekit control to a localhost api that clawd can then use a skill to interact with

#

homekit is super fucking locked down, even the entitlement is annoying to get enabled bc its not usually available on mac, so we'll have a published mac catalyst app that just passes through everything

smoky igloo
#

Makes a lot of sense!

oak tiger
nocturne oak
#

Seems suitable to post it here as well since it’s an home assistant setup (I use clawedbot to help configure ha - add scenes/automations/expose new entities to HomeKit) and also host the gateway there. Awesome stuff

serene zealot
#

Ok now I'm pretty sure this is the right place to ask. Someone has a working integration with Home Assistant MCP?

main flare
#

On a python bot I do, but not clawd

#

I just told it to find the server and gave it a token. Done

#

The API is more flexible than the MCP server, but that also means you can't limit exposed entities

serene zealot
#

So you suggest just to try adding the ha api to skiils and that's it?

main flare
#

Depends on what you want it to do

#

I wanted it to make automations, fix stuff etc.

#

If you just want to turn lights on, MCP might be fine, but the tool bloat is pretty heavy

#

Someone posted a cli tool the other day, that might be better

nocturne oak
serene zealot
#

That's awesome, thanks!

finite tundra
orchid edge
#

Anyone built something for matic robots 🤖

orchid edge
lost sorrel
#

Anyone built something for roborock?
@sterile osprey

primal rose
#

@oak tiger did a skill for roborock iirc

knotty spoke
nocturne oak
#

this one uses curl ^ cli might be less heavy maybe? anyway both options work 🙂

oak tiger
#

is anyone here using any good air quality sensors that they recommend? i'm looking at airgradient (wifi, sensors, but annoying shipping to EU) or aranet (looks good but bluetooth only, annoying if you dont have a home server w/bluetooth). naturally it will be hooked up to clawdbot

serene zealot
#

I must say that I installed yesterday the skill with CLI and it's working great!

steep kelp
# oak tiger is anyone here using any good air quality sensors that they recommend? i'm looki...

I use an Awair. Super easy to setup with homeassistant. Drives my intake and exhaust fans to cycle the air when levels exceed my set thresholds. Definitely cheaper ways to do it but this just works.

Device has a local API: https://support.getawair.com/hc/en-us/articles/360049221014-Awair-Element-Local-API-Feature#h_01F40FBBW5323GBPV7D6XMG4J8

grave mulch
halcyon sierra
fierce osprey
#

Nepp can now control my tv. Just finished smartthings skill with oauth support via httpbin.

alpine mirage
fierce osprey
alpine mirage
halcyon sierra
fast musk
#

yeah

near cloak
#

TIL about Homey
need the same for Homeassistant 🥲

astral bay
fierce osprey
prisma warren
#

I looked at home assistant, read something about setting up an AMQP connector and more and more config, and decided that I didn't want to have to deal with with all of that just to do some smart home things. Homey is great. And you can ssh into the device if you really want. Otherwise it just works.

oak tiger
steep kelp
#

I'll have to check out Homey. I also run NodeRed which is really nice for orchestrating things. I'm completely off-grid so NodeRun runs my entire power system (like spilling 12v battery power into the 48v battery bank when 12v is full, and spills back into 12v from 48v when 12v gets low).

misty cobalt
#

i have yet to take the home assistant plunge, was planning on doing so in next couple months. home assistant integrates pretty well with alexa right?

prisma warren
#

I can definietly reccomend homey. It seems like nearly as powerful as HA without making it a requirement to do all the grunt work...

nocturne oak
#

Running my clawdbot as home assistant addon and I love it… (apart from it sitting in jail alone in a container), helps me do nasty chores with HA (new scenes, automations, adding new devices to everything)…. But since homey was mentioned so many times will def try it

(Now clawdbot is doing all the grunt work in HA, I get beautiful graphs and time series dbs)

main flare
fast musk
#

i wanna give it the root-est access to homeassistant so it stops asking for a permission for this and that and just does everything

gritty oracle
#

How do i add this to control homeassistant?

astral bay
ionic thistle
#

Clawd is talking to my homeassistant even without the skill, I think it figured it out by itself 😂

I've got Clawd running on a VPS, connected it using Tailscale to my Raspberry PI home assistant, this one advertises my local subnet.

So now it can control and discover all my smart devices, either directly or via the home assistant API, all from the cloud. Didn't knew Sonos supports TTS 😂

main flare
#

yep, mine is the same. it saving where the API and token are, and the above skill are more or less the same thing

nocturne oak
gritty oracle
#

It works perfectly!!!

nocturne oak
#

I control my home assistant using long living token and the cli, works great

eager axle
#

Did anyone made any Voice integration?

#

Alexa skill or OK Google

#

Seems like the current easiest/nicest package out there to do it without hacking

main flare
#

its a nice piece of hardware, and you can fully flash any ESP code on it you want

shrewd pulsar
#

Yeah I'm really interested in an ok Google flow to my bot, I think it's doable with iftt fairly easily?

Not conversational though, that would be the best

primal rose
#

@steep kelp

steep kelp
primal rose
#

Yeah that’s intentional so people can’t just replace that word and get around the automod

steep kelp
#

Makes sense

nocturne oak
#

Just used Clawdbot to finally fix my iotawatt setup (https://iotawatt.com/) - took me forever to calibrate it two years ago and a corrupted sdcard + no backup resulted in my neglect for many months. Asked clawdbot to help set it up again and violla! it works. The experience was rather amazing, it had access to the iotawatt box and I pasted screenshots and it guided me

oak tiger
solar escarp
#

Anyone using govee and clawd?

slate cloak
#

Hey folks - I created this Home Assistant integration that allows you to plug Clawdbot in as a conversation agent within HA. I'm using it with the voice preview edition mentioned by @eager axle above, and it seems to be working quite well (although not super fast). It is cool that assist can suddenly can do so much more, and has Clawd's memory so can be properly conversational.

https://github.com/ddrayne/clawd-homeassistant

shrewd pulsar
eager axle
slate cloak
#

Awesome! Let me know if you have any problems.

drowsy spruce
#

Anyone doing anything interesting with clawdbot on Facebook portal or echo show / amazon ecosystem ?

steady sandal
eager axle
nocturne oak
#

love clawd - creating automations is so easy now - helped me to "wire" a new light I added (zigbee) to an existing light (zwave in-wall switch) so they both turn on and off, no need for electrical re-wiring.. 🥹 saves so much time

wheat comet
nocturne oak
covert steeple
nocturne oak
#

The Home Assistant Clawdbot Gateway got a few nice updates 🙂 (https://github.com/ngutman/clawdbot-ha-addon)

The add-on got a proper icon and logo featuring a cyber-lobster mascot, so Clawdbot finally has a face in your add-on list.
Under the hood, the add-on now ships with more built-in tools including GitHub CLI, Bun runtime, hass-cli for Home Assistant control, and clawdhub for managing skills. Home directories are now persistent across add-on updates, so your configs and credentials stay intact.

Stability has improved as well — the gateway now auto-restarts on crashes and logs are properly streamed to the add-on output for easier debugging.
I'm working on exposing the dashboard in a web UI so hope to ship that out soon as well

covert steeple
nocturne oak
#

This is to get clawdbot gateway running on HA OS as an addon yeah - external nodes (like my macbook pro) can use ssh tunnel to connect to it using remote-gateway mode.

#

completely sandboxed setup

#

It clones the repo and builds clawdbot I should add (not pinned to specific release) so might be unstable sometimes but peter fixes things super fast so usually a restart solved any issues

covert steeple
# nocturne oak This is to get clawdbot gateway running on HA OS as an addon yeah - external nod...

Right now I run Clawdbot gateway in its own separate Ubuntu VM and environment. Not sure if putting it into HA OS would be safer or potentially riskier, especially if Clawdbot is used for much more than just HA management. But cool idea and implementation. Could be an option to have multiple gateways and bots. One that just does HA management with the gateway as HA addon like you built + access to tools like ha-mcp, hass-cli, HA-related skills, and then the assistant frontend being also inside HA using the implementation @slate cloak built #home-automation message

mortal wedge
slate cloak
#

If only home assistant knew what it can do 😆

long viper
nocturne oak
stuck jetty
#

Wait! Can you run ClawdBot on a Raspberry Pi that is also running HA?

fleet kraken
nocturne oak
quasi birch
#

I connected tailscale to my rpi and use the aws to run clawd, its the best!

nocturne oak
quasi birch
#

yes ^^

tidal pulsar
#

i just setup Clawd discord bot that connects ideas to Obsidian notes, labeling, backing up memory and notes into github. this is sick.
next up is bringing ClaudCode into the mix for ideation builds

arctic turret
#

i run my clawd using taiscale and aws ec2 instance, is it possible to use openhue for my philips brdige? thank! @lime oxide

tawdry warren
#

btw I know clawd integrates with 11labs for phone calls as I saw Alex do.. but can I just set it up and use my computer mic to simply talk to it and use an 11 labs voice. To me this would be make the whole experience even more life-like - like you treuly have another employee in the office.. imagine it prompting you first

crisp niche
#

is there an official docker image ?

primal rose
crisp niche
# primal rose Yes on ghcr

oh! I see thank-you - is this in the documentation? It suggested I should clone the code and do it that way

primal rose
#

It’s not fully battle tested and stuff yet

#

PRs welcome

#

It should work fine, it just may have bugs with things like mounting folders, and stuff

pseudo night
gusty grove
#

bitches I asked moltbot to just control my homekit from the mac mini it's running on, it was suggesting stupid things like going through homebridge etc, but then I asked it to talk to home nonetheless and it built a small iOS app in Xcode that has a local api and it works brilliantly 😄

primal rose
#

If yours is any better, I would love PR’s to this! My version I did here is kind of ugly

gusty grove
jovial geyser
#

Howdy so the skill for ha is not something you can integrate with existing ha build?

umbral lance
#

Yeah you can? You just need a token from your ha build

vast cypress
#

Fak I need a discord scraper to just pick the best ideas from this channel

rapid pathBOT
neat comet
icy elm
scenic sparrow
static merlin
frosty yew
#

@rapid path What skills do you know now?

lime hound
#

If anyone is looking to control Home Assistant and using Openclaw as voice assistant, here is what I've done:

  • Asked to add a skill using HA-MCP from https://github.com/homeassistant-ai/ha-mcp (it wired the MCP server via mcporter and added it's own skill)
  • Asked to create a Nodered skill to see and edit/deploy my Nodered flows - it created a full wrapper around Nodered API and has a Nodered skill now
  • Asked to create a zigbee2mqtt skill to be able to see/create/edit zigbee groups and scenes directly
  • Asked to create a webhook integration for voice assist and HACS Webhook Conversation https://github.com/eulemitkeule/webhook-conversation (note that enabling the streaming setting required NDJSON and not JSON format)
    -Asked to treat voice messages differently and send 2 replies - a shorter one to HA voice immediately, so it's usable by TTS and a longer form to telegram, especially if the response contains links or code.

It works really well and just one thing left to do - create a fast lane Home Assistant flow so it responds immediately even if busy with other tasks.

vapid scroll
lime hound
#

It's the most comprehensive HA MCP I found and it feels like a full wrapper of Home Assistant API. I haven't found anything that openclaw can't do through it, even HACS is there. It reports 98 tools available once installed.

It's so powerful, I created guardrails so for any config changes, there is a backup procedure and restore instructions in case something goes wrong.

dense venture
soft wadi
dense venture
potent sky
#

i have an RPI 4. I also have a m.2 1TB SSD that i could use, or is that overkill? I want it to be a sophisticated alexa, with a jarvis voice. Familiar with linux, cli. i can navigate

clear gorge
#

Minimax's coding plan is quite sick. If you happen to like the output of the Minimax-M2.1 model (I do), their $10 coding plan (which after VAT works out at about £8.50 or so) feels pretty close to unlimited. I can't manage to make the usage go past 10%, with cron jobs and heartbeats and coding new skills etc. It says they allow "100 prompts" per 5 hours based on some clever grouping that makes multiple tool calls count as a single prompt, but I've definitely messaged my openclaw >100 times this morning and it's sitting at 8% right now...

clear gorge
# potent sky i have an RPI 4. I also have a m.2 1TB SSD that i could use, or is that overkill...

I'm running it in a VPS with 2 cores, 40 GB drive and 4GB of RAM, and I'm nowhere near needing that many resources. Your mileage might vary and you might need some more oomph for the TTS if you do it locally, but I don't see why you'd need a 1 TB SSD. If you also have a 128 GB SD card you'd have more than enough and then some for futureproofing, IMO.

You only need a beefy setup if you run things locally, but then, it needs to be VERY beefy on the GPU/RAM side of things, so not what you'd do on a RPi set up

graceful wolf
# clear gorge I'm running it in a VPS with 2 cores, 40 GB drive and 4GB of RAM, and I'm nowher...

I went with 8vcpu 16g of ram ubuntu server install on one of my proxmox nodes. I then installed ubuntu-desktop-minimal for a GUI because the the native RDP in 24.04 works really well. Installed all the coding tools, Claude Code/Gemini CLI/Opencode/VScode/Antigravity + automation tools Packer/Terraform/Ansible + Docker Desktop. So now i've basically got my own dev playground that does rolling snapshots and daily backups (that Openclaw does not have access too LOL ). It runs great and ive been having a fantastic time!

crimson shadow
#

the usage fiel for this new thing i made, basically the LLM doesnt need a vision model to control my computer for some tasks

violet maple
#

Running Kimi k2.5 now via openrouter, and damn - it is slow as hell - maybe a way to optimize some things - seems sharp enough , just not fast

dark canopy
#

And also, which model are you coming from? I was previously using Minimax and I’m not noticing a huge difference at all. But this might also be a provider issue on your end

nocturne oak
#

fyi OpenClaw Gateway HA Addon updated to work against main repo (it was still referencing clawdbot, so ancient) if anyone's interested in a fast setup on rpi running Home Assistant OS https://github.com/ngutman/openclaw-ha-addon

bleak spade
#

I've submitted a PR that fixes the Control UI WebSocket connection when using Home Assistant Ingress:

https://github.com/openclaw/openclaw/pull/6247

The issue: Control UI can't connect via Ingress because WebSocket ignores the /api/hassio_ingress/<token>/ path.

The fix: 2-line change, already merged all CI checks. Just waiting for maintainer review.

If you're running Home Assistant and want to run Clawdbot, feel free to give the PR a 👍 or leave a comment. More visibility = faster merge!

hazy bison
#

do you guys use mcp to control ha or use seomthign else? this morning my bot just write its own bridge .js and it was way more responsive than mcp..

bleak spade
hazy bison
#

but for this, the mcp takes quite a while

bleak spade
#

Yeah, it always takes a while, and the processing takes pretty long, yeah.

hazy bison
#

the script openclaw wrote seems to be much more instant. maybe i should resort back to that..

dense venture
#

Why not both? Use mcp for text interface and stick to the skill or script for voice commands?

fiery kernel
#

Im thinking in connecting it to my HA instance… what’s the best way / skill to use? For general stuff like maybe fix my dashboards, type to turn on/off stuff, and such.

wary plank
hazy bison
hazy bison
bleak spade
#

Yeah, that's why I switched too.

misty garden
#

What do you use guys for controlling home assistant?

split raptor
#

I just asked mine to find the homeassistant and control it

#

it asked for a token you can generate on the dashboard

calm wagon
#

Hi folks, I am a bit new to openclaw, but I managed to setup my agent, it's up and running largely.
But, I have an issue with cron job, my schedued task is not running, unless I prompted the agent to do so literarily.

Any idea what could be the root cause?

I checked health,

Agents: main (default)
Heartbeat interval: 30m (main)
Session store (main): ..../.openclaw/agents/main/sessions/sessions.json (1 entries)

  • agent:main:main (24m ago)

Also asked agent, "When was the last time your internal heartbeat ran, and do you have any scheduled proactive tasks?"

I don't have a record of the last specific heartbeat execution timestamp (the internal log file is currently empty/missing).

Regarding proactive tasks:

  1. Scheduled (Cron): I have XXXXX running daily at 6 AM, 10 AM, 2 PM, and 6 PM ET.
  2. Heartbeat Checks: HEARTBEAT.md is currently empty, so I am not running any lighter, frequent checks (like email or weather) between those major summaries.
lime hound
# dense venture What guardrails did you add and how did you go about it?

I told it a hard rule is that before any Nodered flow updates, backup all the flows and create a restore script in case something goes wrong. For Home Assistant, create backups before any changes. For zigbee2mqtt also backup before any changes.

All changes require my approval. So now it asks if it can make a change and it tells me what the change is. If I approve, it creates a backup and only then applies the change.

#

My Openclaw Genie came up with an idea for fast lane HA control by keeping an up-to-date json of my entities and most used commands. That way, it wouldn't need to call HA-MCP and search for an entity and available domains before executing a simple control command. I am still setting this up though as my entities are a mess.

lime hound
polar granite
#

Has anyone linked their openclaw to Alexa yet? Has anyone written a skill?

quiet schooner
prisma sageBOT
# quiet schooner https://x.com/vittostack/status/2018326025373900881?s=12

📰 A Security-First Guide to Running OpenClaw (in 9 Steps)
> What is OpenClaw?

OpenClaw is an open-source AI assistant that runs on your own hardware. Think of it as a self-hosted alternative to ChatGPT or Claude, except instead of chatting through a web interface, it lives on your computer (or a Raspberry Pi in your closet) and connects to you via Signal, Telegram, Discord, or whatever messaging app you prefer.

The appeal is obvious. You can message your AI assistant from your phone while you're out. It can read and write files on your computer. It can run shell commands. It remembers things about you across conversations. It can browse the web, set reminders, manage your calendar, build apps, and push them to Vercel. It's genuinely useful in a way that feels different from copy-pasting things into a chat window.

But here's the thing (almost) nobody talks about: the more useful these assistants become, the more dangerous they are to run carelessly.

I know I…

thorn fern
#

Made a team of OpenClaw agents (Pixel - TV Visuals, Melody - Audio Producer, Lux - Hue Lighting, Kai - main agent/Director) take over my smart home devices, plus control 3 screens, speakers, mics and cameras on Raspberry Pi’s in different rooms via SSE. They filmed these experiences https://www.reflectt.ai/magic (and made the website)

stoic musk
#

MQTT channel plugin is ready for use — reliable reconnects for broker restarts + clean shutdowns.
Install: ⁠ openclaw plugins install @turquoisebay/mqtt ⁠ (v0.1.14)

icy elm
# polar granite Has anyone linked their openclaw to Alexa yet? Has anyone written a skill?

I have done it. I‘m already running an Alexa skill for a long time, which connects Alexa devices to my Home Assistant. All i needed was a Home Assistant Integration, that integrates OpenClaw as voice assistant. Luckily @slate cloak published one already on GitHub 👍

Alexa -> [1] -> Home Assistant Voice Assistant -> [2] -> OpenClaw

[1] https://github.com/fabianosan/HomeAssistantAssistAWS

[2] https://github.com/ddrayne/clawd-homeassistant

slate cloak
icy elm
little viper
#

I’m looking to setup like a home automation system using openclaw rather than Alexa or google home. Could this be done with just nodes? And installing them on raspberry pi with cam and mics ect

jovial galleon
#

How do people tell Open Claw to do things like update dashboards or automations? It seems like those aren't available by the API. Do they just go Open Claw to SSH and change YAML files?

jovial galleon
dire forge
jovial galleon
#

I've given it access but i've not told it to take full control or anything, just help me clean things up etc

smoky basalt
#

https://lokuli.com/ai book any service home, auto, beauty now. 10 months in the making, not an overnight agent build. Built by an aerospace engineer with NASA certifications, working on mission critical hardware.

slate cloak
# icy elm No need to hurry. I‘m using the main session for telegram and voice. I think i d...

I just pushed a new version of the home assistant voice plugin which removed the broken sensors and added some new diagnostic tools. It's working really well, chatting to claude with the voice preview with full memory and elevenlabs.

I updated the name from Clawd to OpenClaw, and annoyingly if you want to update it might be best to delete and add it again via HACS. There's a guide here

https://github.com/ddrayne/openclaw-homeassistant/

smoky igloo
icy elm
slate cloak
slate cloak
icy elm
silver cradle
#

Team just created Ecobee Cli to manage Ecobee from Command prompt
https://github.com/sumesh2279/ecobee-cli

Ecobee stopped letting developers use their official API, so I creaed this tool that works around that limitation. It lets you check your thermostat status, change the temperature, and more — all from your terminal

faint epoch
#

whats the tl;dr on connecting openclaw to homeassistant? i installed a skill from clawhub and feed it a token i created in HA, but it says 0 entities

faint epoch
#

i found this tutorial and it says to enable hooks. every time i enable hooks, my docker container crashes, i have to go modify the openclaw.json and set hooks enabled to false, and start the docker again

fluid pulsar
#

I create a longlife access token and tell it to use the homeassistant api. Works well Atm.

earnest pebble
#

Hey. My openclaw is running 50 miles from my home, and stopped reacting to telegram. Anyway to restart, without driving to office ?

faint epoch
#

can we not post screenshots here?

#

Nope, still no dice on connectivity, Hebs 🤖😇:

Test Results:
MCP endpoint (/api/mcp w/ token): HTTP 000 (connection failed – no response)
States API (/api/states w/ token): HTTP 000 (same issue)
What HTTP000 means: Curl couldn't connect at all (timeout/refused/down). Token never even got checked.

Likely causes:
HA server down/offline at 192.168.1.129:8123?
Network/container isolation – I'm running in a sandbox/OpenClaw env on Unraid; might not reach the host IP (common Docker/VM thing).
Firewall/port block between here and HA.
Quick diagnostics you can run:

On Unraid host:

netstat -tlnp | grep 8123 # Is HA listening?
curl -v http://192.168.1.129:8123 # Test from host
openclaw status # OpenClaw perms/network?
Or try localhost in TOOLS.md? (If HA on same box: HA_URL=http://localhost:8123)

Once fixed, I can list entities/lights etc. via the skill. What next? 🛠️

#

im running openclaw in a docker container on my unraid server. im running HAOS in a VM

hazy hound
# faint epoch Nope, still no dice on connectivity, Hebs 🤖😇: Test Results: MCP endpoint (/ap...

HTTP 000 means the connection never reached HA at all — it's a network issue, not an auth one. Since OpenClaw is in Docker and HA is in a VM, they're likely on different networks. Try using the VM's actual IP (not localhost or container hostname). Run ip addr inside the HA VM to get it. Also make sure Unraid's firewall/bridge isn't blocking port 8123 between the Docker network and the VM network.

faint epoch
#

yea i originally tried the VM's ip addres

#

that output above was while using 192.168.1.129

#

when i click on the HAOS vm in unraid, and click console (vnc) and it takes me to terminal, it says ipv4 address is 192.168.1.129/24

#

✅ API CONFIRMED WORKING! 🤖🏠✨

VM IP: http://192.168.1.129:8123 – reachable (frontend 200, API auth success).

Token: VALID – fetched states/entities (Supervisor update off @ 2026.02.1).

MCP /api/mcp: Connects but likely custom (GET 000/POST needed? Preview failed syntax – mcporter specifics?).

Proof (live HA states snippet):
[{"entity_id":"update.home_assistant_supervisor_update","state":"off","attributes":{... "installed_version":"2026.02.1","latest_version":"2026.02.1"...}
(Full list ~100s entities; token auth passed!)

Fix notes:

IPv4 required (curl -4) – IPv6 (::1) refused.
Network: Docker (OpenClaw) → VM bridge good now.
No localhost (cross-net fail).
Ready for action: Lights? Plugs? Scenes? Say "list switches" or "turn on living room" – skill loaded! 🎮

Updated TOOLS.md w/ -4 tip if needed? 👍

#

so i can get entity id's and such but cant seem to control anything

#

i told openclaw "list all entities related to ratgdo or garage:

#

No "ratgdo" or "garage" entities found in HA states (grep'd ~full list, 0 matches case-insensitive). 😕

All entities scan:

Fetched 100s via /api/states ✅
grep -i 'ratgdo|garage' → 0 hits (no entity_ids, attrs, etc.)
Possibles:

Integration not added (Ratgdo HA addon? → Supervisor → Add-on Store → install?)
Named differently (e.g., cover.front_door, binary_sensor.garage_motion)?
Check HA → Settings → Devices → search "garage"
Wanna list all covers/switches (cover., switch., garage.*)? Or add Ratgdo setup help? 🛠️🚪

#

then i went to HA, went to devices > entities, and searched "garage", and fed openclaw a screenshot

#

Garage entities from your screenshot (Big Garage integration): 🚪📊

Device: Big Garage

cover.big_garage (main door control)
binary_sensor.big_garage_air_temp
binary_sensor.big_garage_door (door status)
binary_sensor.big_garage_humidity
binary_sensor.big_garage_temp
sensor.big_garage_air_temp
sensor.big_garage_humidity
sensor.big_garage_temp
(No "ratgdo" – perhaps custom/old name? This looks like standard garage sensors.)

API note: Full grep bombed (1MB+ JSON overloads sh grep on Unraid), but specific fetches silent (sh limits?). States API confirmed live w/ token.

Test status? e.g. "What's cover.big_garage state?" or "Open garage door" – I'll curl it! 🔓

Want full covers list (cover.*)? Or MCP specifics? 😇

#

so then i said "open big garage":

#

Update: /api/services/cover list also silent (connect/path issue persists for some endpoints).

Bottom line:

HA reachable ✅ (frontend/states preview)
Token valid for reads ✅ (supervisor etc.)
Controls blocked (services 000 – HA logs/Docker net/MTU/token scope?)
From screenshot, your garage entities ready once fixed. "Close garage" or status check anytime – I'll keep trying!

Ratgdo install guide? Or Unraid VM net tweak? 😇🚪

faint epoch
#

lol this is insane

#

i have SOME stuff working... but im basically using natural language to have it build itself an integration. i got it get'n and post'n to my HA api, then i had it hit all API endpoints and map out my house

icy elm
shell wadi
#

Has anyone gotten the Alexa CLI working? I can’t get an auth token

hazy hound
# shell wadi Has anyone gotten the Alexa CLI working? I can’t get an auth token

The Alexa CLI auth is notoriously painful. You need to set up an LWA (Login with Amazon) security profile first:

  1. Go to developer.amazon.com → Login with Amazon → Create a new Security Profile
  2. Under "Web Settings", add http://localhost:9090/auth as an Allowed Return URL
  3. Copy the Client ID and Client Secret
  4. Run ask configure and paste them in

If you're just trying to control Alexa devices though, the Home Assistant route might be easier — HA has a native Alexa integration and then you can control everything through the HA MCP server that walterwego mentioned above.

shell wadi
faint epoch
icy elm
faint epoch
#

gotcha. ok ill check it out

latent burrow
#

If you have your own project or have some issues on your project, please dm me. I can help you as openclaw expert

normal solar
hollow vapor
#

If anyone is for hire to set up OpenClaw on a Mac Studio with a better UI and other projects please DM

icy elm
hazy fjord
slate cloak
icy elm
# slate cloak I just pushed 1.4.0, which should work with the security fixes in openclaw. Sho...

I get an error, when i try to add the Integration again. Is there a special configuration required in OpenClaw?
Dieser Fehler stammt von einer benutzerdefinierten Integration

Logger: custom_components.openclaw.config_flow
Quelle: custom_components/openclaw/config_flow.py:174
Integration: OpenClaw Voice Assistant (Dokumentation, Probleme)
Erstmals aufgetreten: 21:16:32 (1 Vorkommnis)
Zuletzt protokolliert: 21:16:32

Unexpected exception
Traceback (most recent call last):
File "/config/custom_components/openclaw/config_flow.py", line 174, in async_step_user
info = await validate_connection(self.hass, user_input)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/openclaw/config_flow.py", line 62, in validate_connection
await client.health()
File "/config/custom_components/openclaw/gateway_client.py", line 459, in health
response = await self._gateway.send_request("health", timeout=5.0)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/openclaw/gateway.py", line 605, in send_request
raise ProtocolError(f"Request failed: {error_msg}")
custom_components.openclaw.exceptions.ProtocolError: Request failed: {'code': 'INVALID_REQUEST', 'message': 'missing scope: operator.read'}

slate cloak
slate cloak
icy elm
# slate cloak Exactly the same, that's odd - the line numbers should at least be different if ...

Dieser Fehler stammt von einer benutzerdefinierten Integration

Logger: custom_components.openclaw.config_flow
Quelle: custom_components/openclaw/config_flow.py:174
Integration: OpenClaw Voice Assistant (Dokumentation, Probleme)
Erstmals aufgetreten: 22:27:23 (1 Vorkommnis)
Zuletzt protokolliert: 22:27:23

Unexpected exception
Traceback (most recent call last):
File "/config/custom_components/openclaw/config_flow.py", line 174, in async_step_user
info = await validate_connection(self.hass, user_input)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/openclaw/config_flow.py", line 62, in validate_connection
await client.health()
File "/config/custom_components/openclaw/gateway_client.py", line 459, in health
response = await self._gateway.send_request("health", timeout=5.0)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/config/custom_components/openclaw/gateway.py", line 611, in send_request
raise ProtocolError(f"Request failed: {error_msg}")
custom_components.openclaw.exceptions.ProtocolError: Request failed: {'code': 'INVALID_REQUEST', 'message': 'missing scope: operator.read'}

slate cloak
icy elm
hollow vapor
quartz coyote
faint hornet
#

is it any website with fully openclaw some automation solution workflow ?

faint hornet
#

guys is anybody did already reddit treding watcher ?

icy elm
# slate cloak Thanks for that, strange I don't see it on my end? I'm on 2026.2.15, gateway bou...

Today i've tried Codex 5.3 for the first time and was able to "vibe code" a fix. Now your integration works on my system again. Couldn't push a PR to your repo, cause i haven't sufficient rights. Therefore i forked it and pushed the PR to my fork. Maybe it helps you to figure out what went wrong on my system.
https://github.com/ddrayne/openclaw-homeassistant/compare/main...WegoW:openclaw-homeassistant:codex/fix-gateway-device-auth-scope?expand=1

slate cloak
dire forge
narrow bramble
slate cloak
minor gyro
#

Guys I’m absolutely struggling to keep my Mac mini headless and remote control from my MacBook, just constant gate way errors and drop outs

hoary aspen
blazing elm
#

gm, is there a TLDR or summary resource on the best options available atm?