#Homelab 2.0

83 messages · Page 1 of 1 (latest)

late pumice
#

Almost done with the cleanup, few things left to do 🥰

IMG_0405.jpg IMG_0406.jpg
willow mango
#

awesome, why NUCs in back?

#

space?

late pumice
#

The servers are flipped

#

So this view is the front just to make the cabling easier

willow mango
#

Nice!

ashen thicket
#

What kind of NUCs ya got?

smoky jackal
#

@late pumice is the 6 node nuc cluster worth it? What are you running on them?

late pumice
late pumice
smoky jackal
late pumice
#

I'm currently running 2.5Gbe on the NUCs

#

But if I need to I'll use thunderbolt 10G adapters

#

I have a lot of networking in rack, 10G switches, etc

late pumice
#

I have rook-ceph replicating storage, I'm in the process of getting in depth monitoring on it and checking utilization

smoky jackal
#

Interesting, I just bought a small unifi xg 10G switch and a few 2.5g adapters, I don’t feel like spending 600$ on 3 10g adapters yet

#

I will see how this performs!

late pumice
#

That's exactly why I went with the USW-Enterprise-24-PoE to use the 2.5Gbps ports for my access points and NUCs

#

And if monitoring dictates, I'll have to cry and buy adapters lol

smoky jackal
#

Hahaha yeah I can’t afford that switch yet either, aren’t they like 1k as well?

#

For now my 3 node cluster with that flex xg will do I believe may need to get the adapters too

#

But eventually I’d like to get 10gb networking for my whole home, but that’s a big project and costs lots of money 😂

late pumice
#

The switch is like $799 which is cheaper than getting 6 10Gbps thunderbolt devices for the NUCs

viral hamlet
#

What's with the Jesus amount of switches?

late pumice
#

Then there are two switches with 16 SFP+ interfaces with MLAG

#

So the Ubiquiti switch, the servers, the router all have dual bonded 10G connections, one in each switch

#

This allows me to update or reboot a switch without anything going offline

viral hamlet
#

Damn

#

That's awesome

#

What enclosure are you using?

late pumice
#

I try to deploy things at home like I would in production and I have services at home I really want to stay up

#

It’s a tripp lite rack

viral hamlet
#

Ah nice.

late pumice
#

Lots of gear built up over lots of years 🙂

fading spade
#

@late pumice how many watts does your rack consume? I'm about to buy new gear and just did a calculation, and it's kind of a dealbreaker since the yearly cost is almost as much as buying a new server

#

I'm in the 3rd most expensive state for electricty btw...

late pumice
#

I'm pulling about 930 W

#

For all servers and gear in the rack

#

620W of which is the dell servers

fading spade
late pumice
#

With the current load

fading spade
#

If I'm not wrong with my calc, mine was idle 800, perhaps I'm overshooting

#

it'll be 3 epyc servers

#

ram consumes a surprising amount

late pumice
#

For me the power consumption is worth the cloud savings for some of my services

#

My plan is to still migrate quite a few workloads on the kubernetes cluster

fading spade
#

yeah I absolutely undersand that, though I can't have symetric connection in my area... so it's a bummer, unless I move

late pumice
#

The only reason I'm hosting stuff at home is because I have 2 symmetric 1G services 🙂

fading spade
#

lucky you, my down is 1G up is 30M lol

late pumice
#

Cable modem?

fading spade
#

comcast cable yeah

late pumice
#

I'm in a newly built area and there is a lot of competition

#

So I have mediacom cable that is similar to yours

#

And then one local fiber company and frontier fiber

#

Just got super lucky where I ended up moving

fading spade
#

that's awesome

fading spade
#

Just found out that Switzerland has 25G internet for homes...

#

for $244

late pumice
#

One day 🙂

zinc swallow
#

Less than $10/mo for single gig ... 🤤

waxen cradle
#

How is the power bill? I have a r310 and a 610 and I would love to use both but I am not sure how crazy the power bill will be

late pumice
#

Less expensive than what I’m saving in cloud hosting 🙂

waxen cradle
#

wait really? lol

#

cloud hosting is more expense then the stuff you have? what specs are you running?

late pumice
#

Just based on what I'm currently hosting

#

Not talking about how much the servers cost, those were built up over quite a few years

#

Each of my R620 compute servers have 2 socket 8 core (32 threads) @3.30GHz and 192GB of RAM

#

So with dual internet connections and power consumption I'm still saving money vs equivalent VPS costs for the things I'm running

waxen cradle
#

Damn thats amazing. I might be fine then running my 3 servers with 2 of them being r310 and r610

late pumice
#

Definitely depends on what you are comfortable with, not leveraging a VPS means you are responsible for more technical burden

muted river
#

Where did you get the rack mount shelves for your NUCs? Very nice!

late pumice
waxen cradle
#

So if I am running game servers/website servers on my 610 then it would prob eat a lot of power but if I am using it as a NAS solution then it prob wouldn't eat too much power because it wouldn't be working crazy hard?

late pumice
#

The only real way to know is if you monitoring the power draw doing that workload for a few days and try to do some real math

#

When it comes to a NAS application it depends on how many drives are in the server and a handful of other things

waxen cradle
#

Gotcha

waxen cradle
#

Also how do you handle heat? I am slightly afraid to keep my r610 and r310 plugged in all the time because of a potential fire. Should I be worried? Or are they ok? I have a closet that they will he going into down the road

late pumice
#

Why would you have a fire? My rack is in the basement so it’s naturally cool

waxen cradle
#

Well the 3 machines get very hot I think and I sadly don't have room for a rack in my house so they would be in a closet wit the door taken off to let air flow coke in. So I guess they are ok

#

I am considering putting it in my shed but I am nervous about any kind of moisture that could form. But I guess if I patch a few things up and install some stuff to the shed it prob wont be an issue

inland fiber
#

Starting a fire just from ambient heat requires a lot of heat. Appart from dust clog taking fire with static electricity arc there are likely few reasons to take fire.