keen herald Jun 7, 2024, 9:17 AM

#

dark ginkgo Jun 7, 2024, 11:10 AM

#

excellent. I'll try to do a new deployment this weekend and an upgrade of our existing 3.x as well. If we run into any issues I'll let you know.
Thanks for all the amazing work

plain geyser Jun 7, 2024, 1:22 PM

#

Hi Yann thanks for the GA version 😊 question about customer configs like the collection nfsv4 pool metric. Will these files also be migrated or we need to recreate them

hollow wave Jun 7, 2024, 2:33 PM

#

Hi Yann,

The migration failed for me from 3.5.1 to 4 with the output below:
Adding poller 10.141.172.142 OK
Adding poller dub105sgnsnasnet0.sg.viatel.net OK
Adding poller dub1scsdnasnet0.sg.viatel.net OK
Adding poller dub5scsdnasnet0.sg.viatel.net OK
Adding poller dub1sgnsnasnet0.sg.viatel.net OK
Adding poller 10.141.172.150 OK
Restarting Prometheus with admin API enabled... OK
Waiting for Prometheus OK
Taking snapshot... OK
Restarting Prometheus with admin API disabled... OK
Waiting for Prometheus OK
Unable to find image 'victoriametrics/vmctl:heads-master-0-g93a29fce4e' locally
heads-master-0-g93a29fce4e: Pulling from victoriametrics/vmctl
4abcf2066143: Pull complete
1fa950ee645b: Pull complete
936054e38e9e: Pull complete
Digest: sha256:b1b5a7b2acf89c2d285e19120b569b4da64179985f2562008e9211b8c891fe36
Status: Downloaded newer image for victoriametrics/vmctl:heads-master-0-g93a29fce4e
Prometheus import mode
2024/06/07 14:13:03 failed to create prometheus client: failed to open snapshot "/prometheus/data/snapshots/": opening the db dir: stat /prometheus/data/snapshots/: no such file or directory
2024/06/07 14:13:04 ERROR Failed to migrate metrics error="exit status 1"

keen herald Jun 7, 2024, 4:04 PM

#

Hey, might be a failed 3.5 update, try to re apply the latest 3.5.3

hollow wave Jun 7, 2024, 4:16 PM

#

once that is done, can i rerun the migrate script or should i reinstall the v4 vm?

keen herald Jun 7, 2024, 5:12 PM

#

No need you can just run the script again it’ll skip the already added system.

V4 should be collecting data actually.

hollow wave Jun 7, 2024, 6:57 PM

#

yes, v4 is collecting data and a rerun of the script kicked off the data transfer.

deep pumice Jun 9, 2024, 7:56 AM

#

Congratulations on another amazing release!!

hollow wave Jun 9, 2024, 10:39 AM

#

Hi Yann,

I have set grafana-default-email and sent test emails successfully.

Do you have any tips on getting the 'Mimir / Cortex / Loki' alerts to send emails in Nabox4?

keen herald Jun 9, 2024, 2:17 PM

#

Grafana itself isn’t sending emails, alert manager will do you don’t have to alter Grafana configuration.
In fact, all alerts are defined in alert manager configuration and Grafana is just displaying alerts and give you an interface to silent them (untested)

#

When you configure email in nabox admin, your are configuring Prometheus alerting configuration, which does handle all the rules visible in Grafana.

hollow wave Jun 10, 2024, 1:09 PM

#

Thanks Yann. I now have some emailed alerts coming in. I'm trying to create silences in Grafana but no luck so far.

maiden nimbus Jun 10, 2024, 2:25 PM

#

@keen herald - website (https://4.nabox.org/) is currently down - expected?
Also "Network settings" doesn't successfull save "Domain names" properly - it shows error with hostname, ip address, and gateway. How do we get around?

keen herald Jun 10, 2024, 2:45 PM

#

Hi ! Yes it moved over to nabox.org

#

Mmm, that should have been fixed. You have /subnet with two digit ?

maiden nimbus Jun 10, 2024, 4:07 PM

#

@keen herald - ahh yep sorry I missed the "IP Address in the form a.b.c.d/m" - added /subnet and it's now working successfully - thank you and appreciate it!

#

@keen herald - sorry a "cosmetic" thing - under ONTAP system hostname, cannot successfully change from IP to FQDN, error: Invalid host name. How to get around this?

keen herald Jun 10, 2024, 4:25 PM

#

Any chance you have uppercase letters in host name ?

#

Oh you have a «-» sorry about that

maiden nimbus Jun 10, 2024, 4:38 PM

#

Yes, our hostnames currently all have dashes "-" in them

keen herald Jun 10, 2024, 4:45 PM

#

https://dl.nabox.org/nabox/NAbox-4.0.0-fix-171.nbx You can apply this update

maiden nimbus Jun 11, 2024, 2:47 PM

#

@keen herald - still broken: Error while updating system
name query authentication failed

keen herald Jun 11, 2024, 3:01 PM

#

Mmm, that would be different. You sure about username and password ?

maiden nimbus Jun 11, 2024, 3:30 PM

#

Yes - it was incorrect password sorry about that. Put in the correct password and it's working now. Thank you!

lilac loom Jun 13, 2024, 4:09 AM

#

i need more than the 200gb for /data. so i shutdown the nabox4, added disk space to hard disk 2 and startup the VM again. still see the 200gb for data. i think that was the method for nabox 3 - ho do i extend the HD in nabox4?

EDIT: works with "resize2fs /dev/sdb", but is that the right way?

keen herald Jun 13, 2024, 6:57 AM

#

Yes that what nabox should have done

Can you show me the output of journalctl -u resize ?

lilac loom Jun 13, 2024, 9:37 AM

#

tried again a resize from 200gb to 300gb - no entries in journalctl:

journalctl -u resize

-- No entries --

lilac loom Jun 13, 2024, 12:36 PM

#

next failure while migrating the data from 3.5.3 to 4.0.0
Restarting Prometheus with admin API enabled... OK
Waiting for Prometheus.......... Failed
Taking snapshot...2024/06/13 12:22:10 ERROR Failed to take Prometheus snapshot error="Failed to parse snapshot response: invalid character 'S' looking for beginning of value"

keen herald Jun 13, 2024, 3:22 PM

#

Would you mind running it manually ? https://nabox.org/faq/#manual-migration

keen herald Jun 13, 2024, 3:52 PM

#

Or just try curl -k -x POST https://localhost/prometheus/api/v1/admin/tsdb/snapshot in nabox 3 appliance.

hollow wave Jun 13, 2024, 5:28 PM

#

hollow wave Thanks Yann. I now have some emailed alerts coming in. I'm trying to create sile...

FYI ... I could not get grafana silences to work at all but found that I can setup silences via the alertmanager UI here: https://<nabox fqdn>/am/#/alerts

keen herald Jun 14, 2024, 4:58 AM

#

hollow wave FYI ... I could not get grafana silences to work at all but found that I can set...

Thanks for checking, I’ll see how Grafana implementation works !

uneven sail Jun 14, 2024, 2:41 PM

#

Now I'm gonna migrate to NAbox 4. 🙂

keen herald Jun 14, 2024, 3:38 PM

#

You should start here 😄 https://dl.nabox.org/nabox/NAbox-4.0.0-10-g3f1073f.nbx

keen herald Jun 15, 2024, 11:29 AM

#

lilac loom tried again a resize from 200gb to 300gb - no entries in journalctl: # journalc...

Fixed in 4.0.1 thanks for reporting !

main sage Jun 23, 2024, 11:10 AM

#

I'm getting this error "Adding poller s01.bbaas.local2024/06/23 11:09:10 ERROR Failed add poller error="Failed to add poller: response=Post "https://admin:***@s01.bbaas.local/servlets/netapp.servlets.admin.XMLrequest_filer\": dial tcp: lookup s01.bbaas.local on 127.0.0.11:53: server misbehaving"
Adding poller 10.0.2.102024/06/23 11:09:10 ERROR Failed add poller error="Failed to add poller: response={"code":1001,"message":"poller already exists"}""

#

I upgraded to latest 3. release and I am using 4.0.2 as the target system...

keen herald Jun 23, 2024, 11:52 AM

#

Can you check dns configuration in NAbox 4?

main sage Jun 23, 2024, 1:09 PM

#

keen herald Can you check dns configuration in NAbox 4?

It's DHCP, but the DNS fields looks blank.. I will try to make it static and try again...

keen herald Jun 23, 2024, 1:10 PM

#

That's interesting, let me know if you think the DNS server is distributed through DHCP and for some reason NAbox is ignoring it

main sage Jun 23, 2024, 1:13 PM

#

keen herald That's interesting, let me know if you think the DNS server is distributed throu...

It's Processing blocks now.. (seems to take awhile) 🙂 Not sure why Nabox ignored the DNS servers, they are defined in the DHCP... I haven't seen this as an issue with other DHCP clients...

keen herald Jun 23, 2024, 1:13 PM

#

Ok I'll keep an eye on it and open an issue

main sage Jun 23, 2024, 1:16 PM

#

Maybe it would be a good idea to add more vCPUs before you start the migration? Does it start a worker per CPU core?

keen herald Jun 23, 2024, 1:17 PM

#

Unfortunately no, the default is to start 2 workers, but if you run the migration manually (https://nabox.org/faq/#manual-migration) you can set more workers

main sage Jun 23, 2024, 1:18 PM

#

keen herald Unfortunately no, the default is to start 2 workers, but if you run the migratio...

OK... I can just see that the CPU usage on the source VM is 100%...

keen herald Jun 23, 2024, 1:18 PM

#

How much data are we talking ?

#

https://docs.victoriametrics.com/vmctl/#migrating-data-from-prometheus show how to use --vm-concurrency and --prom-concurrency

vmctl

Documentation for VictoriaMetrics, VictoriaLogs, Operator, Managed VictoriaMetrics and vmanomaly

main sage Jun 23, 2024, 1:24 PM

#

keen herald How much data are we talking ?

Well we are at 15% now... 19 blocks.. I'll just keep it running..

#

good thing this is just a one time thing 😉

keen herald Jun 23, 2024, 1:25 PM

#

Yes, I wish there was a better way, and certainly think NAbox 4 has better foundation and will have a longer run !

keen herald Jun 23, 2024, 3:43 PM

#

@main sage I deployed a new instance, you wouldn't see the current DNS server in web ui, but it should be there in resolvectl status ens192

#It's here ! NAbox 4 is officially released !

journalctl -u resize