AMD drivers kinda suck tbh but shouldn't be bad for a 6700xt, that being said, are you sure its the gpu causing issues? have you checked logs to be sure?
#AMD GPU Infuriating freezing/crashing
pastel jungle
pastel jungle
Are you using arch? what kernel are you on?
Your kernel version might be the issue. Looking into it, last known good kernel version for reported architectures: RDNA2 (RX 6xxx), RDNA1 (RX 5xxx), Vega is 5.18 so using bleeding edge might be working against you
Might lack support for other hardware, might have security vulnerabilities but it's not like 5.18 is that old
Most likely it wouldn't cause you any problems
I don't think so but it wouldn't hurt to try.
Worst case scenario you have a fallback solution
you can have multiple kernels installed so testing should be relatively easy
just a matter of trying drivers and then pointing the bootloader to a different kernel if it doesn't work out
dense night