Quote5094
bucks
Let's compare that to an alternative that exists for over 1 year and 8 months: For AI and gaming:Let's say you already have a 32 GB RAM desktop PC, adding another 32 GB is a few hundred bucks, and selling your, say, 5070 and getting a 5070 Ti won't also be the full price of the Ti.
Now let's compare an AI score (memory size times memory speed):This 64 GB N1X Spark laptop:
- 19264 = 64 GB unified memory * 301 GB/s (= 256-bit * 9400 MT/s / 1000 / 8).
Desktop PC with 64 GB DDR5-6000 RAM + 5070 Ti:
- 20480 = 64 GB RAM * 96 GB/s (= 128-bit * 6000 MT/s / 1000 / 8) + 16 GB VRAM * 896 GB/s.
The score is similar, but it's 64 GB vs 80 GB. This means you can fit bigger (quants of) AI models or allow for a larger context.
Now let's compare GPU performances:3dmark.com/search -> Steel Nomad:
Spark N1X 6144-core: Average score: 2941 or "3134 Points" per this review.
5070 Ti: Average score: 6931.
Agreed, a desktop PC isn't as compact and you might even say that it misses the point, but it's ~1000 vs ~5000 bucks, you get additional 16 GB of the GPU and you'd have roughly over 2 times the FPS in games (2.35 = 6931/2941), and a desktop PC is upgradable and repairable, too.
Communities and more about running AI models locally and privately:
notebookchat.com/index.php?topic=315954.0 ("Your own ChatGPT, offline: AI without the cloud on your laptop")
reddit.com/r/LocalLlama/top
reddit.com/r/LocalLLM/top
artificialanalysis.ai/models/open-source