To setup CUDA, I highly recommend nvidia-docker. It makes it super easy, especially if you're familiar with docker. All you need is the official graphics drivers from the NVIDIA homepage.