#NABox Prometheus data directory

1 messages · Page 1 of 1 (latest)

tiny lily
#

Hello, I'm Just seeing some issues with the Prometheus data directory being full, I'm not sure what I can delete, any idea or guidance on how to resize and expand or purge old data please?
vm01 ~# df -h
Filesystem Size Used Avail Use% Mounted on
devtmpfs 10M 0 10M 0% /dev
shm 5.9G 0 5.9G 0% /dev/shm
/dev/sda3 5.0G 441M 4.3G 10% /
tmpfs 2.4G 816K 2.4G 1% /run
/dev/sda1 92M 18M 68M 21% /boot
/dev/sdb 9.8G 3.0G 6.3G 32%. /opt
/dev/vg_data/lv_data 492G 470G 0 100% /data
cgroup_root 10M 0 10M 0% /sys/fs/cgroup

vm01:/data/prometheus/data# du -sh * |sort -n
1.2G wal
4.0K queries.active
7.0G 01HJHKBN3153XNW7DE5ZFDN3WS
7.1G 01HSKHQS3AGBD7286MNBJR5S5Q
9.1G 01GM393XKE01F83XY97AQQ4NBT
9.7G 01GM392ACHHQWB65V0JJVDYQ6S
9.8G 01GM395D9D212NZR2XV9BK2TNC
10G 01GM3974KKFC9J4WSNGCA6BESK
12G 01GM39A1EZFAB804PW0JQNYKGV
12G 01GM49404D2TVC1ZT4RZNYDY37
12G 01GXX4DCZVXE5SQ7N14QVRG3NV
12G 01H4DPKN53WPTNMVK8ANE9VJCB
12G 01H61V5AJ1NAF9CM3B7YK8391W
13G 01GNRDNJQ8YPMHXMZGZG55N3A3
13G 01GQCJ6WKS4Z5GBY4P9QCTFD8D
13G 01GS0PS739GG7GS1RZ5NXXXX73
13G 01GW8ZVT8EZYJASATWC2G7QR93
13G 01H7NZPJH3SQGDDY9H1HJX2C9Z
14G 01GTMVAG4QFZN62K47E44FPVHB
14G 01H156K4EF9TM6A0HY8V8HBP2R
15G 01GZH8XAAR4RK53TTY54VJPKY3
16G 01H9A48F41K7KZNE11BZ63YBDN
21G 01HHEV1D7FVZDVYFNZ6494YP31
21G 01HMQ44JMSV1ED89PNWNF436X8
21G 01HPB8P3R02Z51GSC17X9395GH
21G 01HQZD7QYHJ8NVZY874GGQQRE1
24G 01HAY8TG5N19Y1Z2RJ1RCWWY55
24G 01HCJDBZWJWY4ZEG9CC750EPZ3
24G 01HFTPFRY4BR84R25A9K6M773D
25G 01HE6HXHNF54WCMGK2KNRN3S04

Thanks in advance

limber cypress
tiny lily
#

Hi @limber cypress thanks for the prompt response, yes I can increase the disk size, however I am now sure if the VM will recognise the increase

limber cypress
#

should only require increasing the vmdk and rebooting nabox

tiny lily
#

Thanks @Chris Grindstaff, I will have a look in the morning and report back

wise elbow
tiny lily
#

Thanks for your guidance @wise elbow, @limber cypress in summary, this is what I had to do to get this working

I increased the disk from 300GB to 400GB and rebooted the vm , but the additional space wasn’t available to be used

vmperf01:~# pvdisplay
--- Physical volume ---
PV Name /dev/sdd
VG Name vg_data
PV Size <400.00 GiB / not usable 3.00 MiB

vmperf01:~# pvs
PV VG Fmt Attr PSize PFree
/dev/sdc vg_data lvm2 a-- <300.00g 0
/dev/sdd vg_data lvm2 a-- <400.00g 200.00g

vmperf01:~# vgs
VG #PV #LV #SN Attr VSize VFree
vg_data 2 1 0 wz--n- 699.99g 200.00g

vmperf01:~# lvresize -l +100%FREE /dev/vg_data/lv_data
Size of logical volume vg_data/lv_data changed from 499.99 GiB (127998 extents) to 699.99 GiB (179198 extents).
Logical volume vg_data/lv_data successfully resized.
vmperf01:~#

Then...

vmperf01:~# resize2fs /dev/vg_data/lv_data
resize2fs 1.46.6 (1-Feb-2023)
Filesystem at /dev/vg_data/lv_data is mounted on /data; on-line resizing required
old_desc_blocks = 63, new_desc_blocks = 88
The filesystem on /dev/vg_data/lv_data is now 183498752 (4k) blocks long.
vmperf01:~#

vmperf01:~# df -h /data
Filesystem Size Used Avail Use% Mounted on
/dev/vg_data/lv_data 688G 470G 189G 72% /data
vmperf01:~#

Rebooted and all looks to be working fine.

Thanks once again