acoustic kindle
Since the upgrade failed, I tried to do a clean installation. Booted to Ubuntu, installed HAOS to the in the internal SSD...exactly as describes on the web site. Booting into HAOS still fails at the very same place.
[warn] Home Assistant CLI not starting. Jumping into emergency console.
How to proceed? I subscribe to Nabu Casa. So I have a backup, both local and in their cloud. How do I get access to the prior version of HAOS?
upbeat turret
There are quite a few experiencing problems with HAOS 15. Not sure how to get back, since you reinstalled.
acoustic kindle
It appears I may be on the path to a solution.
Booted to Ubuntu on ext USB drive
vocal fern
I have the same issue.
acoustic kindle
Installed HAOS 14.2
fetched from Github archive
After rebooting into HAOS 14.2 barren, started as if to config, but selected restore from backup
This failed.
Rebooted. Selecting restore from backup again. This time it showed the contents of the backup previously uploaded.
It is currently restoring.....
...and it's back to operational under 14.2
Only killed about 3 hours
vocal fern
Well . My system looks like it's up and running on 14.2, and it pings. But it still isn't quite up, as the webserver isn't running...
acoustic kindle
I was lucky to have a backup on my desktop system, to be able to restore.
vocal fern
It came up. It just took longer than I expected. I just selected a different slot in grub.
As an aside, why the F is grub so slow here? This laptop has run Linux and other OSs for years and grub doesn't take several seconds to scroll across the screen like a 2400 baud modem on them . But it does on haos
vocal fern
More info: it seems to ONLY affect upgrades-in-place. I downloaded and flashed the rpi for my just-came-today rpi5, and it boots just fine. Restoring a backup to os 15 as we speak...
terse bison
My Odroid is dead, no HDMI, no ping.
IDK what to do, i didn't restore to the eMMC so far. But at least i have nightly backup. 🙂
polar pendant
same on my system running on a futro s920
terse bison
Tried clean install 15.0. Brick.
Flashing with 14.2
terse bison
Well that is fucked as hell. Restored everything (seemingly), all dongles are in same ports - but hundreds of errors....
terse bison
Zigbee2MQTT lost all network.
Why didn't it restore from full backup?!
round tiger
Zigbee2MQTT lost all network.
Why didn't it restore from full backup?!
Try restoring again (from the running instance)
terse bison
Try restoring again (from the running instance)
I did. Tried 3 times, with different add-on state.
Coordinator is in place. Network is gone
round tiger
rip
round tiger
Zigbee2MQTT lost all network.
Why didn't it restore from full backup?!
Full backups have been broken for a while
If it's any help, this is the error the system gives
primal yacht
Pi 5 tried to upgrade and it failed. Here is a portion of the errors:
2025-03-18 01:35:12.244 homeassistant systemd[1]: Finished HassOS data resizing.
2025-03-18 01:35:12.253 homeassistant kernel: Unable to handle kernel paging request at virtual address ffffffc080d95f04
2025-03-18 01:35:12.253 homeassistant kernel: Mem abort info:
2025-03-18 01:35:12.257 homeassistant kernel: ESR = 0x0000000096000047
2025-03-18 01:35:12.257 homeassistant kernel: EC = 0x25: DABT (current EL), IL = 32 bits
2025-03-18 01:35:12.261 homeassistant kernel: SET = 0, FnV = 0
2025-03-18 01:35:12.261 homeassistant kernel: EA = 0, S1PTW = 0
2025-03-18 01:35:12.261 homeassistant kernel: FSC = 0x07: level 3 translation fault
2025-03-18 01:35:12.261 homeassistant kernel: Data abort info:
2025-03-18 01:35:12.261 homeassistant kernel: ISV = 0, ISS = 0x00000047, ISS2 = 0x00000000
2025-03-18 01:35:12.329 homeassistant kernel: CM
brave swallow
Can't get into my Pi5, I don't have physical access at the moment. It's definitely down though. And SSH just refuses connection. Fun times.
Is there a known process to recover the system once I do have physical access?
terse bison
I have ~70 devices left to reconnect. 🙂 part of them is in freaking hard-to-reach places.
terse bison
Is there a known process to recover the system once I do have physical access?
Flash SD card from scratch, roll out backup.
brave swallow
Flash SD card from scratch, roll out backup.
Oof... That's pretty unacceptable tbh. And a hassle, since I run mine off NVMe.
terse bison
Oof... That's pretty unacceptable tbh. And a hassle, since I run mine off NVMe.
Well... I don't think there will be other solution. From the cluttered logs some guys have, it looks like kernel problem.
But you can wait for couple days.
woven bear
You aren't really updating the existing OS, you are downloading the new one to the other slot and booting from it. The previous OS should be available which you can still choose to boot from.
ha os info
You should see slot A and slot B
brave swallow
If that's the case, it should be an easy fix to roll back at least. Suppose I'll see tomorrow when I get physical access.
round tiger
I run it in a VM so i was able to just drop in a full back up, but this is bizarre
has there been any announcement on what went wrong? I'm not gonna trust updates for a while, especially since Home Assistant's backups don't work either...
polar pendant
has there been any announcement on what went wrong? I'm not gonna trust updates ...
nope no announcement at all
terse bison
You aren't really updating the existing OS, you are downloading the new one to t...
On GitHub they found that it won't work, since it's the problem in the bootloader update, and that thing is single and is overwritten by the update.
terse bison
has there been any announcement on what went wrong? I'm not gonna trust updates ...
It's bootloader optimization, that has bug for some I/O devices, seemingly.
Why you're saying backups don't work tho?
I rolled back, and my only problem is Zigbee2MQTT - and now I know why. By default /share folder isn't backed up, and my Z2M add-on is old enough to have data there ... So this is why I'm doomed. There's tick in backup options "include /share folder", which I, of course, didn't turn on.... It's not good that it is switched off by default, but if I would have it turned on, everything would be okay.
round tiger
Home assistants' own backups don't work. I kept a backup of the whole disk of the vm
polar pendant
Home assistants' own backups don't work. I kept a backup of the whole disk of th...
interesting
wth
hmm
mild fox
My pi is also not starting up 😭
woven bear
HA backups do not include the OS and aren't supposed to
woven bear
My pi is also not starting up 😭
Did you remove power and then reconnect it?
mild fox
Did you remove power and then reconnect it?
Yes twice. It's tucked in a corner but neither external access, inter dns ie homeassistant.local or ip:port are working. Going to have to pull it out and hookup monitor keyboard I think.
It not coming up with a Lan connection it seems according to my loadbalancer so something quite low in the os must be stopping
polar pendant
well I've managed to get something back after a few reboots now
easily my worst update experience ever lol
makes a start at least
and everything is back
polar pendant
Yes twice. It's tucked in a corner but neither external access, inter dns ie hom...
try hard rebooting it a few times
that fixed it for me just now
warm totem
My Odroid is dead, no HDMI, no ping.
IDK what to do, i didn't restore to the eMM...
I’m in the same dead Odroid-N2 boat as you
warm totem
try hard rebooting it a few times
Lost count as to how many times I’ve tried rebooting. I plugged in a monitor & keyboard but nothing shows ¯_(ツ)_/¯
polar pendant
Lost count as to how many times I’ve tried rebooting. I plugged in a monitor & k...
ah no clue then
really hope they sort this soon though
sullen sphinx
Another data point...Broke my install on my Wyse 5020. x86-64 machine.
Got it to book into 14.2 again, tried the 15.0 update again, and now it's really hosed.
I get for 'Waiting for the Home Assistant CLI to be ready...', but then it bombs out to the emergency console with 'CLI not starting!'. Any ideas?
polar pendant
Got it to book into 14.2 again, tried the 15.0 update again, and now it's _reall...
no clue
I've thankfully managed to get back to a working state so I'm not touching anything lol
good luck though
polar pendant
Well, it _somehow_ rebooted into 14.2 again after several power-cycles.
nice
I just checked my console again and it's still showing this but the stuff is at least working lol
sullen sphinx
That's...What it should show? That's what mine has always shown on the console.
polar pendant
interesting
I don't remember waiting for supervisor to startup being there but I haven't logged in in a while I guess lol
woven bear
Well, it _somehow_ rebooted into 14.2 again after several power-cycles.
This is what it does if you interrupt the boot process 3 times: falls back to the OS version in the other slot
brave swallow
Got physical access, hard powered down my pi5, powered it back up and it booted 14.2. ha os info shows a bad slot A, but otherwise it seems fine. Hopefully they fix the update in a future revision and I can install it then.
polar pendant
This is what it does if you interrupt the boot process 3 times: falls back to th...
handy to know
I'll have to try and figure out how to fix the other slot eventually then at some point also
mild fox
This is what it does if you interrupt the boot process 3 times: falls back to th...
3 times, I need to do it at least once more 😅
spark night
Had the same issue. Connected to CLI and restored a full backup from before the update with backup restore {slug} . Took a few moments to process, but all is up and running again.
mild fox
got mine hooked up to a screen now and its ust sitting on a HAOS prompt
mild fox
interesting, maybe co-incidence but th sdcard is dead
vocal fern
Mine was installed on an SSD, and it still crashed during the 14.2 to 15 upgrade. The SSD is fine, however.
mild fox
I wonder if its too much for my pi now
trying to do a fresh install but its the new core, so I wonder if I should fresh from old
mild fox
Up and running, clean install and restore from google drive backup. Not touching this update till next version.
mild quest
I'm running on a Pi 4 8GB on an SD card. My HA is still running, but appears to be unable to communicate with the supervisor at all. No logs other than Home Assistant Core will load. I can't load the Add-Ons page. I can't load the terminal, file editor, or Studio Code Server. Backups aren't running or available, though luckily I have it backing up to Google Drive so I've at least got access to the backups themselves.
I can't even reboot. I've been trying to avoid it in case something gets worse, but I can't access the terminal or anything to try to downgrade. When I try a reboot it tells me communication with the supervisor timed out.
I guess I'll try a physical reboot. I've been considering moving it to another system so if it fails and I have to restore from backup maybe now is the time to go ahead with that.
terse bison
I'm running on a Pi 4 8GB on an SD card. My HA is still running, but appears to...
I had similar situation. Connected physical display and keyboard, still didn't even have signal at all. In the end i just re-flashed from scratch, and rolled the backup.
mild quest
I had similar situation. Connected physical display and keyboard, still didn't e...
Based on what you and others have said, that's what I'm suspecting will happen. So I'm not going to even try a physical reboot until this weekend when I have time to dedicate to it.
sour needle
Can someone confirm that HAOS 15 has been pulled back? It was showing as available on my system but has now disappeared. I haven't been able to find any official statements about all the issues it caused. Nothing on github.
woven bear
Can someone confirm that HAOS 15 has been pulled back? It was showing as availab...
depends on what "my system" is
but they are all showing 15.0 now. I think odroid n2 was showing 14.2 earlier yesterday
sour needle
Sorry, yes, mine=Home Assistant Blue / Hardkernel ODROID-N2/N2+
woven bear
so you should see 15.0 as an available update currently. I can boot mine and see how it goes, but the thinking was that an issue was related to the type or manufacturer of the emmc.
sour needle
I'm still on 14.2. v15 still not showing.
vocal fern
@woven bear it affected even systems without emmc. My generic x86-64 laptop with a 1tib SSD failed to update to 15....
Luckily, I had a pi5 coming in that day, and a fresh install of 15 l, plus restoring some backups got me running 15 with no other issues, but I did play around with it more on the laptop after taking it off the network. A fresh install of 15 worked on it, too.
Mine seemed to be AMD GPU weirdness related, according to things I've read.
woven bear
<@331814478238842882> it affected even systems without emmc. My generic x86-64 l...
this was specifically in regard to the Odroid N2
vocal fern
Ah, gotcha
sour needle
GitHub indicates v15 had an issue. As pointed out by @ginkage, in #3878 the eMMC patch was moved to a wrong path. Move it to uboot subfolder so it's correctly applied.
woven bear
@sour needle now that same link shows 14.2
Was I seeing things? Back to the coffee pot...
sour needle
14.2 is what I've been seeing. According to GitHub v15 will not change. The fix for the ODroid will come in 15.1.
No, 15.0 stays unchanged and if your eMMC was affected there would be no difference in installing it then or now. 15.1.dev20250318 and newer are fine. Eventually 15.1 will be almost same as this dev, minus the suffix, so you can as well update to it with ha os update --version 15.1.dev20250318.
harsh urchin
<@331814478238842882> it affected even systems without emmc. My generic x86-64 l...
from what i read, the x86-64 machines affected are amd socs
empty snow
Hi,
My HA deployed on a Raspberry Pi5 has issues updating HAOS from 14.2 to v15 as well.
I tried to deploy the update 3 times today but every time the RPi5 re-started, HA wouldn't start up (i had to look up my router to see if it was back up) and i'd have to disconnect and then reconnect the power to the RPi5 for it to start and log back onto my local network.
Has anyone figured out how to solve this?
vocal fern
Make a backup. Do a fresh install of 15. Restore the backup. That's how I got it working on my pi5
Be sure your backup is saved somewhere other than the drive/card you have haos installed on. Either a network drive, or external drive.
mild quest
Make a backup. Do a fresh install of 15. Restore the backup. That's how I got it...
Don't know about them, but I can't even access backup functions on mine, and automated backups stopped. When I have the time to restore to a new install this weekend I'm going to have to go back several days.
vocal fern
Don't know about them, but I can't even access backup functions on mine, and aut...
Upgrading anything without doing a backup first is just begging for trouble, tbh.
mild quest
I do have a backup from right before the upgrade. I just don't have any since.
vocal fern
So what changed between the backup and it not working .. nothing... So you can still do what I said. 🙂
mild quest
Nothing changed in the configuration, but I do lose a few days of data.
vocal fern
Yeah, and the longer it takes to either revert to your backup, or flash 15 then restore your backup, the more data you're going to not collect.
brave swallow
Hi,
My HA deployed on a Raspberry Pi5 has issues updating HAOS from 14.2 to v15...
The Pi5 issues seem to be from having an outdated bootloader, which HAOS can't upgrade. Best solution is to flash a flash drive or spare SD card with raspberry pi OS, then boot that on the Pi5 and run the following commands:
apt update
apt upgrade
rpi-eeprom-update -a
Once you've done that, the update to 15.0 -should- work. I haven't verified that part myself yet, because I don't have physical access to my Pi5 at all times.
sullen sphinx
from what i read, the x86-64 machines affected are amd socs
That's what mine is, so...Yeah?
covert valve
First time posting as HASS is normally rock solid, an update for HAOS was available today to v15. Pi4, applied update and now HASS is booting and is slow as hell, not loading integrations, and generally unusable. Is this a known issue? I've been seeing things mentioed about v15, but am unsure what to do next.....
woven bear
First time posting as HASS is normally rock solid, an update for HAOS was availa...
Did you have a failure updating or is it running with version 15 now?
Have you tried a system reboot (not a restart of HA)?
This is found by expanding the advanced options in the HA restart menu
covert valve
Yep, rebooted. It boots but is very laggy then goes offline.
I'm trying to roll back to 14.2
woven bear
Yep, rebooted. It boots but is very laggy then goes offline.
I'm trying to roll...
ha os update --version=14.2
actually, do ha os info first
if 14.2 is in the other slot you just boot from that slot
ha os boot-slot B for example
then you can compare directly from one to the other
mild fox
I'm on 15 now with the 3.4 core, seems alright, didnt install 3.3 when I restored, waited for the next.
near lantern
Hm, I had an x86 install fail after updating to 15. Tried a docker start homeassistant from the emergency cli, and i'm getting some interesting failures reading from https://wheels.home-assistant.io/musllinux-index/pyotp/
But network is definitely working.
Maybe docker is stopping DNS somehow?
Hmm, yeah, that seems to be it. docker exec -it homeassistant /bin/sh and then ping wheels.home-assistant.io fails.
So possibly a docker networking issues in HAOS?
hollow birch
I've tried 4 different times to get OS15 to work on my PC, I finally gave up and have gone back to 14.2
near lantern
How did you downgrade?
clever oar
How did you downgrade?
near lantern
https://discord.com/channels/330944238910963714/1351277065516617749/135306805964...
I tried that earlier, but without the homeassistant container running, the HA command doesn't work
near lantern
I'm on x86, not rpi
Oh, though scrolling back a bit more, looks like it's AMD SoC related. I'm on an AMD GX-217GA
tranquil oriole
Oh, though scrolling back a bit more, looks like it's AMD SoC related. I'm on an...
yeah, this got merged, https://github.com/home-assistant/operating-system/pull/3957 so fix incoming but may need a fresh install and restore from backup
harsh urchin
Oh, though scrolling back a bit more, looks like it's AMD SoC related. I'm on an...
if you want to go to haos 15, the dev build here has the fix for amd socs, i have the GX-415GA and this build is stable for me #1351277065516617749 message
brave swallow
Just dropping in to confirm that after updating my bootloader on my RPi5 8GB (bootloader was from 2023 before), HAOS 15 installed without a hitch.
misty jacinth
Actually it would be nice in case it's known that HAOS is not working on some devices not to advertise the update.
harsh urchin
or at least a warning in the release notes..yknow
silent sedge
Anyone tried OS15.1 already and knows if that fixes it for a HP Thin Client 620?
polar pendant
Anyone tried OS15.1 already and knows if that fixes it for a HP Thin Client 620?
haven't yet
been slight worried to lol
silent sedge
haven't yet
been slight worried to lol
I can confirm that OS15.1 runs fine on a HP T620 Thin Client! Thanks team!
sullen sphinx
haven't yet
been slight worried to lol
Same...Kinda waiting for more reports.
harsh urchin
Same...Kinda waiting for more reports.
yes i was on the 15.1 dev build before for a few weeks and now im on the standard 15.1 and everything is fine
sullen sphinx
yes i was on the 15.1 dev build before for a few weeks and now im on the standar...
Thank you. I'll fire off the update here in a bit.
...After Amy goes to bed, so if something breaks again I can have it sorted tonight and she'll never know. Heheh.
Eh, installed, rebooting now. Hold on to your butts...
Yay, this update worked! Nice job.
polar pendant
I can confirm that OS15.1 runs fine on a HP T620 Thin Client! Thanks team!
thanks
primal yacht
15.1 worked on my pi5. Previously it failed 15.0. I did update bootloader manually before attempting 15.1.
polar pendant
Same...Kinda waiting for more reports.
seems to work for me
currently shows 15.1
primal yacht
https://analytics.home-assistant.io/ is not yet showing 15.1 in the top 5. Is there a delay in the reporting update? Or is it really not yet installed by many?
tranquil oriole
https://analytics.home-assistant.io/ is not yet showing 15.1 in the top 5. Is t...
its not live, you gotta wait for the next time its regenerated.
lucid trench
I had the sam problem. I posted this on its own chat with heading "Loses Connection" last week Sunday, but nobody has responded.
Hi everyone. I dont know if this has been asked before, I have just joined the Discord server. For the last 2 weeks or so, Home Assistant runs smoothly for a few hours and then its like it just loses connection to everything. I can log into it on the app and web, but when trying to control anything it gives an "Failed to perfom the action switch /turn_on. network error:(-9999999) sign invalid. The automations also does not work when it goes into this "state". I am running it on UTM VM on a Mac Mini. Also, when trying to restart it in this state does nothing. I have to physically stop the VM an start it again. Then it works for a couple of hours and then does the same.
Specs:
Core 2025.3.4
Supervisor 2025.03.3
Operating System 15.0
Frontend 20250306.0
Any idea why this is happening and what the fix is?
Edit: I have loaded a backup version 14.1 back on the VM and it works perfectly. How does one report this bug to the developers?
harsh urchin
I had the sam problem. I posted this on its own chat with heading "Loses Connec...
Github
harsh urchin
How does one report this bug to the developers?
lucid trench
<https://github.com/home-assistant/operating-system/issues>
Thanks
empty snow
The Pi5 issues seem to be from having an outdated bootloader, which HAOS can't u...
Thanks.
This is a lot of work, i’ll try this when i have a full day available to do this. Till then i’ll just skip the updates.
round tiger
Is it fixed now?
I can see a 15.1 update and i don't care to brick my server again
😭
round tiger
what hardware are you using?
virtual machine on an intel 64 bit computer
tranquil oriole
it should be fine
round tiger
thanks
tranquil oriole
just be sure to take a backup before running the update. then if theres any issues you can fresh install with latest and restore
round tiger
do backups work now?
tranquil oriole
why wouldnt they?
tranquil oriole
yeah i think that was sorted
round tiger
splendid
tranquil oriole
and there was a fix that time anyway
woven bear
it's a virtual machine. like tissue paper. what is there to be bricked? it doesn't actually exist and can essentially be copied like a file.
empty snow
The Pi5 issues seem to be from having an outdated bootloader, which HAOS can't u...
Thanks for your response.
Quick question : Do i need to do this from a Raspberry pi OS or can I SSH into the installed HAOS and do this?
brave swallow
Thanks for your response.
Quick question : Do i need to do this from a Raspberr...
HAOS doesn't have the required utilities to do this. Gotta use raspi OS or alternatively flash the bootloader update micro-OS. The former can be done over wifi/SSH if you configure it through the pi flasher, the latter doesn't require any interaction but will only provide the latest stable, not necessarily the latest.