News:

Willkommen im Notebookcheck.com Forum! Hier können Sie über alle unsere Artikel und allgemein über notebookrelevante Dinge diskutieren. Viel Spass!

Main Menu

Post reply

Other options
Verification:
Please leave this box empty:
Shortcuts: ALT+S post or ALT+P preview

Topic summary

Posted by that escalated quickly
 - Today at 14:01:26
A few notes:
1.
Quote from: that escalated quickly on August 28, 2026, 11:32:08or the cheaper X870E Taichi Lite
QuoteBeware Asrock boards are known to fry the Ryzen 9800X3D. r/pcmasterrace has quite a few stories.
..
So while I had the same experience with ASR that is often reported here, I'm not sure whether it's really an ASR issue or a general one.

2. Why dual GPU? Because not only for pipeline parallelism, but also tensor parallelism (note that tp is supposedly finicky and requires ideally the same GPUs and the PCIe lanes go to the CPU directly)

3.
Quote from: that escalated quickly on August 28, 2026, 11:32:08PCIe 5.0 x8
Note, the GPU itself also has to support PCIe 5.0, otherwise the connection will downgrade to whatever the GPU's generation is, e.g PCIe 4.0 x8.

4. PCIe 5.0 x16/x8x8 is only supported by Ryzen 7000 and 9000, Ryzen 8000 only supports PCIE 4.0 x16/x8x8.

5. PCIe 5.0 x8 = PCIe 5.0 x16, so the performance loss is only a few percent (search engine for: "PCIe scaling", TPU has an article)

Other relevancies: Club 3090 / 4090 / 5090, P2P driver patch, NCCL.

"I've done the homework, here are the latest generation AM5 motherboards with x8/x8 Gen 5 that can fit 2 GPUs with 3.5 slots thick GPUs ranked by me": reddit.com/r/LocalLLaMA/comments/1nx1nkv/comment/nhne8vv/

Use this sub to search: reddit.com/r/LocalLLaMA/search/?q=SEARCH TEXT
(e.g. pipeline parallelism vs tensor parallelism)
Posted by mrnotrobot
 - Today at 07:31:07
(un)popular opinion: Apple should become a hardware company and let everybody use any (read linux) software they want on this amazing hardware. how does it pull ahead of strix halo 395 so much in multithreaded benchmarks blows my mind.
Posted by Jesse
 - Yesterday at 16:10:24
For the price of this thing, I'd expect the weight to be 1.2 kg, not 2.1 kg.

Come on Apple, start using magnesium frames and cutting weight.   You appear to be at least 3 years behind Asus, LG and Samsung.
Posted by that escalated quickly
 - August 28, 2026, 11:32:08
2 used 3090 would give you 48 GB VRAM for about the same price of a used 4090, but the prompt processing, which is basically based on how many FPS in games a GPU scores, will be slower, because a 3090 has a lower gaming performance than a 4090.
It depends on the AI model you want to run and your task (if e.g. big inputs and you want them to be processed faster), but usually 48 GB VRAM are (much) preferred over faster prompt processing (aka prefill), for reasons like: You are able to fit a bigger AI model or a higher quant of same model and/or bigger context.

For 2 GPUs and a consumer motherboard you may want to see if using bifurcation (PCIe 5.0 x8 (GPU 1) + PCIe 5.0 x8 (GPU 2)), instead of the usual PCIe 5.0 x16 (GPU 1) + PCIe 5.0 x4 (GPU 2), would give you a performance boost. A hassle free solution is to get a motherboard that has bifurcation built-in, instead of getting a bifurcation card, like the Asus ProArt X870E-Creator WIFI or the cheaper X870E Taichi Lite. See reddit.com/r/LocalLLaMA for more.

As for a smaller and lower power server starting point, see AMD Epyc 8004 "Siena" DDR5 6-channel, 96 PCIe Gen5 lanes, platform. Except for Qwen 27B dense, all recent AI LLM model releases have been MoE models, which fit perfectly RAM setups (not everyone can afford 4 to 8 RTX PRO 6000s), so the faster your RAM is, the faster they will run and Siena looks like the perfect balance between size, power consumption and price (on the other end would be "Venice" (Zen 6 16-channel RAM)).
Posted by that escalated quickly
 - August 28, 2026, 11:31:48
For AI:
5700 bucks for only 48 GB RAM and no fast VRAM? For this kind of money you could get/build a much faster desktop/workstation/(even)server system.

Memory bandwidth comparison:
this: 614 GB/s
3090: 936.2 GB/s
4090: 1008 GB/s

An example -- Thank me later: Most/all B850 motherboards support up to 256 GB RAM and cost 180 bucks. A 64 GB DDR5 6400 MT/s CUDIMM 1.1V stick costs 1050 bucks. Add 2 sticks for dual channel and you have 128 GB RAM right there (yes, it won't be 9600 MT/s but you will be able to fit bigger AI LLM models). And to speed prompt processing and token generation/everything up, get a used 4090 for ~2500 bucks from a company so you can send it back, just in case (paying a bit less and getting it form a private individual would be too risky for me personally). Then use "nvidia-smi -q -d POWER" to see its "Min Power Limit" (the minimum power limit is usually 50% of its TBP and this is also where the power efficiency is the highest) and set the power limit: nvidia-smi -pl <YOUR_WATT_NUMBER>. You don't have to do -50% power necessarily, see e.g. "4090 almost no performance loss at 75% power limit sweet spot", there are many such tests. Search for e.g.: "4090 power scaling". Undervolting should give you better results still.
Posted by Hohoho
 - August 27, 2026, 22:26:48
I wish non-Apple computers had that single core performance. I only have the older M4 and it is a lot faster than my Thinkpad with an Arrow Lake in compute tasks.
Posted by Redaktion
 - August 27, 2026, 17:47:36
The MacBook Pro 16 handles the M5 Max SoC much better than the smaller 14-inch model. It is still a great multimedia laptop with a gorgeous Mini-LED screen, but the old design starts to show limitations and the 140W power adapter is insufficient.

https://www.notebookcheck.net/Apple-s-fastest-laptop-starts-to-show-its-age-Apple-MacBook-Pro-16-2026-M5-Max-Review.1250821.0.html