GPU virtualization or vGPU enables GPU resources to be shared by multiple VMs or remote machines and is traditionally restricted to certain datacenter and high-end Quadro cards. Now, a relatively simple mod has appeared on GitHub that enables vGPU functionality even on consumer NVIDIA GPUs on a Linux host as long as they are based on the same physical GPU as a vGPU-compatible Tesla card.
https://www.notebookcheck.net/Hack-allows-unlocking-GPU-virtualization-functionality-on-consumer-NVIDIA-cards.531761.0.html
O wow. So on vast.ai(lunix docker host rental) I could run a Windows vm to use the hardware as an actual desktop/server with a gui. I will need to try this.
QuoteThe only instances where we find vGPU or SR-IOV running officially on consumer cards are online gaming platforms such as GeForce Now and Google Stadia, wherein a single card often services several connected players.
This is simply not true, both Stadia and GeForce Now utilize data center, non consumer cards.