HPE ProLiant DL360 Gen9 wont boot into proxmox anymore | Linus Tech Tips | Page 1

broken hound Jan 19, 2023, 7:08 AM

#

Hey guys, me and my friend have been trying to debug this for a little while now but having no luck, we brought this server a year or so back and have been using to to host things for our free lancing company, unfornatly our colo provider had some issues recent and the server either had its power disconnected or something else happened where not too sure but the logs point to a power failure,

it shows these errors when booting and doesn't get past them at no matter what we do, does anyone know what might have happened?

mellow nova Jan 19, 2023, 1:50 PM

#

with a quick google I searched x64 exception type 0d and it shows that it could be caused by old firmware of BIOS/iLO or Smart Array Controller

#

it looks like you have access to ilo could you update firmware that way

broken hound Jan 19, 2023, 2:01 PM

#

Yep I have access to the Ilo, do you know where I can get the firmware? I tryed from HPEs site but it needs a login or something which neither of us have atm

mellow nova Jan 19, 2023, 2:02 PM

#

what ilo version is this

#

ilo 4?

broken hound Jan 19, 2023, 2:04 PM

#

yep ilo 4

mellow nova Jan 19, 2023, 2:07 PM

#

https://support.hpe.com/connect/s/product?language=en_US&kmpmoid=1009143853&tab=driversAndSoftware&driversAndSoftwareSubtype=9000213

#

im not a complete expert with ilo4

broken hound Jan 19, 2023, 2:09 PM

#

awesome ill check that out and try flashing it, and thats okay! im just thankful for your help honestly

mellow nova Jan 19, 2023, 2:10 PM

#

np

#

Just @ me if you need more help

broken hound Jan 19, 2023, 2:11 PM

#

will do!

mellow nova Jan 19, 2023, 2:12 PM

#

You have to click extract once you download the file and open it then you can send it through ilo i hope

broken hound Jan 19, 2023, 2:57 PM

#

@mellow nova tryed to update the firmware but just got this

#

doesnt seem to give any reason why it failed either

mellow nova Jan 19, 2023, 4:09 PM

#

If you google that error does anything pop up

mellow nova Jan 19, 2023, 7:25 PM

#

are you sure you extracted it and found the .bin file

#

this is the .bin file i got

#

📎 ilo4_281.bin

brisk rover Jan 19, 2023, 10:51 PM

#

Seems to be working so far

#

Hopefully iLO doesnt lose network connection again :D

#

time to see if itll boot

#

oo html5 console, way better than that Java applet stuff

#

@mellow nova getting the same error even now

#

My guess is something with the UEFI broke

mellow nova Jan 19, 2023, 11:04 PM

#

Can you get into the bios

brisk rover Jan 19, 2023, 11:04 PM

#

ya

mellow nova Jan 19, 2023, 11:04 PM

#

Maybe switch it to legacy boot

brisk rover Jan 19, 2023, 11:04 PM

#

call? i can screenshare

mellow nova Jan 19, 2023, 11:04 PM

#

I cant right now

brisk rover Jan 19, 2023, 11:04 PM

#

This?

mellow nova Jan 19, 2023, 11:05 PM

#

Yeah try that

brisk rover Jan 19, 2023, 11:05 PM

#

I saw one suggestion online to "try enabling/disabling UEFI optimized boot in BIOS configuration under Boot Options" so might try that

#

anyways, waiting to see if this works

mellow nova Jan 19, 2023, 11:06 PM

#

That was my next option if this doesnt work

brisk rover Jan 19, 2023, 11:06 PM

#

my colo provider is sus tbh, but it's cheap so 🤷

#

$45/mo with gigabit and 20 ips

mellow nova Jan 19, 2023, 11:06 PM

#

I have my server in a rack in my basement

brisk rover Jan 19, 2023, 11:06 PM

#

Ive been moving a lot, so wouldnt work for me

mellow nova Jan 19, 2023, 11:07 PM

#

Yeah makes sense

brisk rover Jan 19, 2023, 11:08 PM

#

#

boot drive is an internal sd card

mellow nova Jan 19, 2023, 11:08 PM

#

Your os is on your hdd right

#

Hmm

brisk rover Jan 19, 2023, 11:09 PM

#

2? lol

#

ig ill try them each

mellow nova Jan 19, 2023, 11:09 PM

#

2 might work

#

I doubt though

#

Before u try all of them try disabling uefi optimized boot

brisk rover Jan 19, 2023, 11:10 PM

#

i press 2 and nothing happens

mellow nova Jan 19, 2023, 11:10 PM

#

Weird

#

Exit and disable optimized uefi

brisk rover Jan 19, 2023, 11:11 PM

#

aight

mellow nova Jan 19, 2023, 11:13 PM

#

Why are you on a different account then before

#

On discord

brisk rover Jan 19, 2023, 11:20 PM

#

I own the server

#

@broken hound was just helping

#

cause i was busy

#

okay, UEFI optimized boot was disabled, i enabled it and tried to boot

#

same errors

#

it does get into grub btw

#

so if there is something currented, it seems like it's on the proxmox partition

#

Maybe i can try virtual boot to ubuntu and look at the partitions

#

unless you know uefi interactive shell commands or grub shell commands lol

#

https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=sf000074887en_us

#

hm

#

i did update the Linux distro before the power outage

#

#

https://support.hpe.com/hpesc/public/docDisplay?docLocale=en_US&docId=sf000050913en_us
😦

#

@mellow nova I think i need to update the BIOS firmware

#

https://support.hpe.com/connect/s/product?language=en_US&kmpmoid=7252838&tab=driversAndSoftware&driversAndSoftwareFilter=8000012

mellow nova Jan 19, 2023, 11:44 PM

#

If you can do that

#

Maybe linux got corrupted is my guess if that doesnt work

#

Do you have a backup

brisk rover Jan 19, 2023, 11:57 PM

#

no lol

mellow nova Jan 20, 2023, 12:21 AM

#

Would it be super bad if you reinstalled linux

brisk rover Jan 20, 2023, 12:25 AM

#

well the issue is it's in a different city from me, and the SD card might be bad. I'll try what I can, but I'd have to rebuild every vm and that's a pain

mellow nova Jan 20, 2023, 12:26 AM

#

Yeah

brisk rover Jan 20, 2023, 12:26 AM

#

I can do it remotely, but I want to try to recover the data

mellow nova Jan 20, 2023, 12:27 AM

#

It depends if it would be faster/easier to go there vs reinstall

mellow nova Jan 20, 2023, 3:22 AM

#

if you can make a backup of the sd card and then reinstall and see if that works

brisk rover Jan 20, 2023, 6:05 AM

#

Okay, i was able to find v2.94 of the bios

#

didnt fix the issue

mellow nova Jan 27, 2023, 4:07 PM

#

my thoughts is that if grub works that the os should work and since it doesnt that its a corrupted os

#

i was on vacation for the past 7 days so sorry for not responding sooner

#

if you could copy all the data from the os onto a different sd card and then reinstall the os

brisk rover Jan 30, 2023, 10:02 AM

#

same lol

#HPE ProLiant DL360 Gen9 wont boot into proxmox anymore