nbd-vram

TL;DR

This utility tricks Linux into using your GPU's high-speed VRAM as extra system memory when you run out of actual RAM.

Who is this actually for?

Linux power users and local LLM enthusiasts with 24GB VRAM cards who are too cheap to buy another stick of DDR5.

The Good

• VRAM bandwidth is significantly faster than swapping to a standard NVMe SSD.
• It is a clever way to utilize expensive hardware that might otherwise sit idle during non-graphical workloads.

The Catch (Potential Downsides)

Your system will likely kernel panic and crash if the GPU driver hiccups or the NBD connection drops. There is also a non-zero chance of wearing out your hardware faster with constant swap thrashing.