If you still want/need 32 GB VRAM because of those useful SOTA[1](other models are also in the comparison) Qwen3.8-27B dense, Qwen3.6-35B MoE or other models in a similar size, on the most recent GPU architecture, your best bets would be:
- 2x 5060 Ti 16 GB
- 2x 5070 Ti (Super) 24 GB / 5080 (Super) 24 GB (not mentioned in this news and not released yet, but is rumored to replace the 5090, at least for the time being)
in tensor parallel mode (VRAM and memory speed add up and 2 GPUs act like 1) on a motherboard that has built-in bifurcation of the main PCIe 5.0 x16 slot into x8/x8[2], see also e.g. reddit.com/r/LocalLLaMa/search/?q=tensor parallel.
Strictly speaking you don't need such a motherboard if you are ok with not utilizing those GPUs to their fullest[3](someone actually did some testing).
Note: If you decide to go for bifurcated PCIe 5.0 x16 into x8/x8, make sure that the GPUs are also PCIe 5.0. On NVIDIA it's only recent RTX 50 series, and AMD's RDNA4 is still on GDDR6:
NVIDIA 128-bit: 5060 Ti (16GB): 448 GB/s (+39% faster token generation due to GDDR7 memory).
AMD 128-bit: 9060 XT (16GB): 322 GB/s.
[1] artificialanalysis.ai/models/open-source/small?models=qwen3-8-27b-medium%2Cqwen3-8-27b-low%2Ck2-horizon-mova-36b-a4b%2Cg9v3-39a5b%2Ck2-horizon-7b%2Cqwen3-8-27b-non-reasoning%2Cqwen3-6-35b-a3b%2Cmuse-glimmer%2Cgemma-4-26b-a4b%2Cqwen3-6-35b-a3b-non-reasoning%2Cgemma-4-31b%2Cqwen3-8-27b#artificial-analysis-intelligence-index (K2 Horizon has expensive KV cache and may reason above average
[2] geizhals.eu/?cat=mainboards&xf=2833_AMD+AM5~2873_ab+2&pagesize=30&promode=true
[3] reddit.com/r/LocalLLM/comments/1uqbk9k/comment/owof7gx/