Recent posts
#1
Last post by Alex99 - Today at 11:44:33
Die chinesischen Hersteller machen es uns leider auch immer schwerer dort Geräte zu kaufen, ich bin aktuell auf einem vivo x200 pro unterwegs und würde es glaube ich nie wieder machen, weil man in Deutschland auch wenn es ein EU-Modell ist ganz schlecht an Displayschutz oder auch an Smartphone Hüllen kommt. Deswegen für den Preis sowieso nicht mehr, früher konnte man sicherlich noch gute Smartphones zu guten Preisen bei Oppo, Vivo und Co bekommen aber nun scheinbar nicht mehr.
#9
Last post by heffeque - Today at 10:29:34
LOL.
#10
Last post by ye idk - Today at 10:25:45
The AI models that are best suited for these ~300 GB/s APUs (Strix/Gorgon Halo, Spark N1X, APPLE's M Pro) are of MoE (as opposed to dense) architecture, see e.g.:
artificialanalysis.ai/?models=qwen3-5-122b-a10b-non-reasoning%2Cglm-5-3-flash%2Cqwen3-5-122b-a10b%2Cmimo-v2-5-0424%2Cnemotron-3-5-lightning%2Cqwen3-6-27b-non-reasoning%2Cminimax-m2-7%2Cmuse-glimmer%2Cnvidia-nemotron-3-super-120b-a12b%2Cqwen3-8-27b-medium%2Cqwen3-6-35b-a3b-non-reasoning%2Cstep-3-7-flash%2Cinkling-small%2Csolar-open2-250b%2Cqwen3-6-35b-a3b%2Cqwen3-6-27b%2Cqwen3-8-flash-next%2Cqwen3-8-27b%2Cmotif-3%2Chy3%2Cg9v3-39a5b%2Cgemma-4-31b%2Cgemma-4-31b-non-reasoning%2Cmistral-medium-3-5%2Cling-3-0-flash%2Cgpt-oss-120b%2Cdeepseek-v4-flash%2Cnemotron-3-5-bolt-74b-a9b%2Cnemotron-3-5-super-vl&intelligence=artificial-analysis-intelligence-index
Qwen3.8-Flash-Next is basically the winner overall (highest performance per size) and has only 6B active parameters, perfect for ~300 GB/s/Spark N1X devices.
NVIDIA also offers specific NVFP4 builds of Qwen3.8-Flash-Next for Spark specifically, since it also supports NVFP4:
huggingface.co/nvidia/Qwen3.8-Flash-Next-NVFP4 (133 GB but the n-gram may be streamed from the SSD (-> 133GB - 30% (streamed from a SSD) = 93 GB -> fits in a 128 GB unified memory Spark config)
huggingface.co/nvidia/Qwen3.8-Flash-Next-FP4-Local (this one is new and should definitely fit in a 128 GB unified memory config)