Okay so long post time. I pieced together a "cheap" sub $500 home lab setup thing with the following specs to try and run FUTOs self hosted guide and run HEXOS (I already have the key and got it installed onto the NAS, but that's where the first issues arise). Noise/electric isn't an issue for this.
I have a Tripp Lite SmartRack SR12UB 12u rack
Cisco sg300-52p Poe switch connected to my spectrum IPS router for now, I intend to replace this with a Pfsense box, eventually and keep it as a bridge.
2 gen 10 HPE servers with 128gb ram total (currently all in one system with a 1tb NVME) with dual Intel Xeon Silver 4208 CPUs
A 24tb I think supermicro x8dth 8bay server (6x4tb Hitachi drives, I intend to replace with 18tb drives by the end of the year)
I've got the switch connected to the router and everything else (including my windows 11 gaming PC) connected into the switch, and my MacBook on Wi-Fi as well as a raspi 3b+ and a zerow I believe to play with if needed.
I created a bootable USB drive with etcher to install hexOS to the NAS, but it isn't being detected by the network and it gives me an error. I've tried power cycling and rebooting several times and connected directly to the router itself versus the switch. I can occasionally see the NAS on the network and snag an IPV4 address from my ISPs app, but I'm such a beginner and out of my league I'm not sure where to go from here after two days of playing with it.
I switched over to the HPE server, and I cannot even figure out how to work the BIOS to enable the PCIe NVME card and install an OS, I was thinking proxmox and attempting to run PFsense and the rest of the self hosted guide on it and leave the 2nd one ram less and unplugged.
Long story short, I'm so lost on where to start with this stuff and keep googling different starting points and things to try that I'm coming to you guys to save the AI slop. Let me know what you need from me, and I'm sorry for being such a noob here, maybe I wasted my money.