I can't believe that no one has asked you this question yet (fucking fanboys...):
Do you mind losing access to most features on your GPU, including (but not limited to): RTX HDR, Shadowplay, the Nvidia App, the Nvidia Control Panel and everything it offers, including the 3D Settings page?
If any of this matters to you, you may want to consider switching to an AMD GPU first before you consider Linux. Nvidia does not support it nearly as well as they support Windows. You get a driver that lets you run games, and that's about it.