This, like many similar platforms (8-12 GB GPU + 32 GB RAM (upgraded to)), is superior to running AI models locally, that are usable only from a certain size and architecture upwards: 27B for dense models and 35B for MoE vs any 32 GB RAM iGPU-only devices:
Quote from: reddit.com/r/LocalLLaMA/comments/1sq94qx/is_anyone_getting_real_coding_work_done_with.. I've come to the conclusion that (1) 32768 is the biggest context I can get away with in an adequately smart model, and (2) it just ain't enough.
More about running AI models locally: notebookchat.com/index.php?topic=315954.0 ("Your own ChatGPT, offline: AI without the cloud on your laptop") and comments.
Quote from: PHVM_BR on Yesterday at 22:28:31Not a single mention of the 12GB of VRAM on this 5070?
So, finally upgraded the 2 GB per GDDR7 chip to 3 GB on the 128-bit memory interface, and not mentioned this main selling point anywhere? The obligatory: youtube.com/watch?v=ric7yb1VaoA ("Gaming Laptops are in Trouble - VRAM Testing w/ @Hardwareunboxed")
English
Español
Français
Italiano
Nederlands
Polski
Português
Русский
Türkçe
Svenska
Chinese
Magyar