Quote from: 192 GB RAM+300B AI models on September 16, 2026, 11:11:24so by this argument, up to 512 GB RAM should be possible on Strix/Gorgon Halo, and even more, because the memory speed is up to 2x faster vs desktop's 5600 MT/s, too, so, like easily 768 GB RAM then.

Correction:
Strix Halo: 8000 MT/s / 5600 MT/s = 1.43 times.
Gorgon Halo: 8533 MT/s / 5600 MT/s = 1.52 times.
(ok, then let it be 512 GB, would be good enough given the memory speed)

But check this out:

Quote from: youtube.com/watch?v=Z26kN5VfyGAAMD and the industry are pushing the Ryzen AI Max+ 495 very hard as serious AI desktops, but the marketing is getting ahead of the actual performance. I own both a 128GB Framework Desktop and a 128GB HP Zbook laptop on this platform, so I know what they can do. Yes, the huge unified memory lets you load  large models, but in many cases you're running heavily quantized versions, which inevitably sacrifice model quality. And with only ~273 GB/s bandwidth versus around 1.2 TB/s on an M5 Ultra at about €10,500 for 256GB ram, inference is simply too slow for what they are now charging. Last year, the 128GB Framework Desktop with the Ryzen AI Max+ 395 was around €2,500 now we're talking about €8,500 for 192GB. If you're a developer, you'd be far better off paying €80–€200/month for a serious AI coding subscription and getting much stronger models. And if you're a company that absolutely needs local AI for data privacy, then spend more and buy genuinely high-performance hardware. These are interesting machines, but at €8,500 they are being massively oversold. 👎

Quote from: 192 GB RAM good for AI on September 13, 2026, 12:32:53so by this argument, up to 512 GB RAM should be possible on Strix/Gorgon Halo, and even more, because the memory speed is almost 2x faster vs desktop's 5600 MT/s, too, so, like easily 768 GB RAM then.

Correction:
Strix Halo: 8000 MT/s / 5600 MT/s = 1.43 times.
Gorgon Halo: 8533 MT/s / 5600 MT/s = 1.52 times.
(ok, then let it be 512 GB, would be good enough given the memory speed)

But check this out:

Quote from: youtube.com/watch?v=Z26kN5VfyGAAMD and the industry are pushing the Ryzen AI Max+ 495 very hard as serious AI desktops, but the marketing is getting ahead of the actual performance. I own both a 128GB Framework Desktop and a 128GB HP Zbook laptop on this platform, so I know what they can do. Yes, the huge unified memory lets you load  large models, but in many cases you're running heavily quantized versions, which inevitably sacrifice model quality. And with only ~273 GB/s bandwidth versus around 1.2 TB/s on an M5 Ultra at about €10,500 for 256GB ram, inference is simply too slow for what they are now charging. Last year, the 128GB Framework Desktop with the Ryzen AI Max+ 395 was around €2,500 now we're talking about €8,500 for 192GB. If you're a developer, you'd be far better off paying €80–€200/month for a serious AI coding subscription and getting much stronger models. And if you're a company that absolutely needs local AI for data privacy, then spend more and buy genuinely high-performance hardware. These are interesting machines, but at €8,500 they are being massively oversold. 👎

Quote from: 192 GB RAM is nice, bc on September 09, 2026, 10:47:18because the memory speed is up to 2x faster VS desktop's 5600 MT/s, too, so, like easily 768 GB RAM then.

Correction:
Strix Halo: 8000 MT/s / 5600 MT/s = 1.43 times.
Gorgon Halo: 8533 MT/s / 5600 MT/s = 1.52 times.
(ok, then let it be 512 GB, would be good enough given the memory speed)

But check this out:

Quote from: youtube.com/watch?v=Z26kN5VfyGAAMD and the industry are pushing the Ryzen AI Max+ 495 very hard as serious AI desktops, but the marketing is getting ahead of the actual performance. I own both a 128GB Framework Desktop and a 128GB HP Zbook laptop on this platform, so I know what they can do. Yes, the huge unified memory lets you load  large models, but in many cases you're running heavily quantized versions, which inevitably sacrifice model quality. And with only ~273 GB/s bandwidth versus around 1.2 TB/s on an M5 Ultra at about €10,500 for 256GB ram, inference is simply too slow for what they are now charging. Last year, the 128GB Framework Desktop with the Ryzen AI Max+ 395 was around €2,500 now we're talking about €8,500 for 192GB. If you're a developer, you'd be far better off paying €80–€200/month for a serious AI coding subscription and getting much stronger models. And if you're a company that absolutely needs local AI for data privacy, then spend more and buy genuinely high-performance hardware. These are interesting machines, but at €8,500 they are being massively oversold. 👎

What is the price of the top end model