System fails to resume after suspension with NVRM errors

I have 22.04 LTS, and an nvidia 4070 card. I installed the driver via Cuda toolkit v12.3, and blacklisted nouveau (which doesn't even fully work with 4070 still). When I suspend the system, and try to resume, I get the following errors:

[41.212199] NVRM nbsiReadRegistryDword: osReadRegistryDword called in Sleep path can cause excess delays![41.212201] NVRM nvAssertFailedNoLog: Assertion failed: 0 @ nbsi_osrg.c:107

which repeat a bunch of times. And then the system doesn't resume and I have to force reboot the computer. How can I fix this?