It should not really impact your front end that much, It does take time to be used to their usage, and honestly sometimes I just skip it in favor of backend validation. A lot of input validation isn't super strict, in fact I don't think that it ever really stops a form submission, except for maybe required fields and length. If you want to validate on the front end right before you send it you can also generally get the e.target.form and loop through formData values there. But at that point I'd say just wait for it on the backend.
What part of validation is impacting your UX with HTML? I also haven't used Chakra UI, mainly I've used material UI when it comes to libraries and you can basically boil them down to actual input elements. I don't use the built in FormControls or anything like that with UI libraries though. I find them to be too annoying to use and makes it harder to use standard submission