News:

Willkommen im Notebookcheck.com Forum! Hier können Sie über alle unsere Artikel und allgemein über notebookrelevante Dinge diskutieren. Viel Spass!

Main Menu

Post reply

Other options
Verification:
Please leave this box empty:
Shortcuts: ALT+S post or ALT+P preview

Topic summary

Posted by 32GB total memory and AI
 - Yesterday at 11:02:57
Quoteand up to 32 GB of LPDDR5X-8533 RAM
If you plan using this laptop for AI (extensively):
Since the total memory (RAM + VRAM) in this laptop does not go above 32 GB: Know that with current SOTA AI LLM model Qwen3.6-35B-A3B[1] (in its size class) (only 3B parameters get activated per generated token -> perfect for RAM-only, no dGPU, devices), and its bang for the buck, 4-bit quant, you will be restricted to about this amount of context:
Quote from: reddit.com/r/LocalLLaMA/comments/1sq94qx/is_anyone_getting_real_coding_work_done_with.. I've come to the conclusion that (1) 32768 is the biggest context I can get away with in an adequately smart model, and (2) it just ain't enough.

In this memory sense, any upgradable RAM + 6-8 GB VRAM gaming laptop (used for 700-800 bucks) is superior and much cheaper, even if new. The additional 8 GB of memory/VRAM of the GPU make all the difference in being able to fit and run huggingface.co/unsloth/Qwen3.6-35B-A3B-MTP-GGUF/blob/main/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf.

It is possible to stream the 3B active parameters from a SSD, but you'd have to inform yourself on how many tokens per second you'd be getting (ask/search e.g. on /r/localllama, /r/localllm).

More about running AI models locally: notebookchat.com/index.php?topic=315954.0 ("Your own ChatGPT, offline: AI without the cloud on your laptop") and comments.

[1] artificialanalysis.ai/?models=nemotron-3-5-lightning%2Cmuse-glimmer%2Cqwen3-8-27b-medium%2Cqwen3-6-35b-a3b%2Cqwen3-8-27b%2Cg9v3-39a5b%2Cgemma-4-31b&intelligence=artificial-analysis-intelligence-index#intelligence (Qwen3.8-27B (dense architecture -> 27B active parameters per token) scores much higher, but it's much slower) (you can look up non-reasoning scores or other models in the table)
Posted by Meh
 - September 10, 2026, 19:49:16
Meh. It's just a fancy Raspberry Pi.
Posted by Redaktion
 - September 10, 2026, 19:26:34
Asus has released a new mini-PC internationally featuring the Qualcomm Snapdragon X2 Elite. Combining an 18-core processor with an 80 TOPS NPU, the Ascent QN10 also boasts 2.5 GbE LAN, three USB4 ports and up to 32 GB of LPDDR5X-8533 RAM.

https://www.notebookcheck.net/Asus-releases-new-mini-PC-internationally-with-Snapdragon-X2-Elite-and-32-GB-RAM.1396014.0.html