Quote from: davidm on March 06, 2026, 16:03:07You can't say "of course" without any signs of in depth analysis. There are many different types of models, including sparse and MoE, some models run decently with "only" lots of fast VRAM. Prompt processing is a main factor. Apple has added matmul operations to the M5 so it can't be directly compared to previous generations.

Not sure who exactly you're quoting here (I never used the words "of course") but it wasn't difficult to see just how limiting M3-whatever (Apple seriously needs to ditch their obsession with using nonsense superlatives instead of actual product model numbers) was for the tasks it was egregiously over-equipped to do.
[/quote]

The article. "Of course, even with 256 GB of shared memory,"

Quote from: dr. max johnson on March 06, 2026, 16:52:52Conquering Hong Kong amidst the distraction of ongoing genocide or crushing the 'enemies' of the same nation state not much larger than New Jersey won't help prices either.

RAM is life.  If you can't afford it this is not your realm to play.

I see the crazies have come out to play 😅 conveniently forgetting that some of the enemies of their least favorite nation state are also regional menaces who have made enemies out of many of their neighbors too, not just small-hat country 🙄.

Quote from: davidm on March 06, 2026, 16:03:07You can't say "of course" without any signs of in depth analysis. There are many different types of models, including sparse and MoE, some models run decently with "only" lots of fast VRAM. Prompt processing is a main factor. Apple has added matmul operations to the M5 so it can't be directly compared to previous generations.

Not sure who exactly you're quoting here (I never used the words "of course") but it wasn't difficult to see just how limiting M3-whatever (Apple seriously needs to ditch their obsession with using nonsense superlatives instead of actual product model numbers) was for the tasks it was egregiously over-equipped to do.

Conquering Hong Kong amidst the distraction of ongoing genocide or crushing the 'enemies' of the same nation state not much larger than New Jersey won't help prices either.

RAM is life.  If you can't afford it this is not your realm to play.

You can't say "of course" without any signs of in depth analysis. There are many different types of models, including sparse and MoE, some models run decently with "only" lots of fast VRAM. Prompt processing is a main factor. Apple has added matmul operations to the M5 so it can't be directly compared to previous generations.

IIRC, It didn't have the processing power to effectively run those massive models, even if it supported them. So this move makes sense.