About hosting AI LLM models locally and privately:

Quote from: bustaa on Yesterday at 18:24:46Ok so it's basically crap ... but "good" ?!

Lenovo really gets a special treatment here 😉.

Let's quantify this a bit: If one considers this for AI, know:
32 GB RAM - 8 GB for the OS itself = 24 GB. The SOTA MoE for its size AI LLM model, huggingface.co/unsloth/Qwen3.6-35B-A3B-MTP-GGUF UD-Q4_K_XL quant (good for 80-120k unquantized context), is 22.9 GB. Context requires additional 2 GB for 32k and 8 GB for 128k context (linear). This means that the quant barely fits and there's pretty much almost or no space left for any context.

Quote from: reddit.com/r/LocalLLaMA/comments/1sq94qx/is_anyone_getting_real_coding_work_done_with.. I've come to the conclusion that (1) 32768 is the biggest context I can get away with in an adequately smart model, and (2) it just ain't enough.

The dense huggingface.co/unsloth/Qwen3.6-27B-MTP-GGUF UD-Q4_K_XL quant (17.9 GB) would run much slower (because it's dense 27B = 27B active parameters per token vs 3B active for the 35B model), but at least it does somewhat fit with some context.

Had this laptop/ThinkPad additional 8 GB VRAM dGPU, then it would be able to fit additional 128k[1] of context and have faster prompt processing and token generation speeds as well.

The good thing about this laptop is that its RAM is upgradable, so I would not exclude buying it for AI. But remember, for the same money a gaming laptop has additional 8 GB VRAM, which is kinda very necessary for running the mentioned 27B dense and 35B MoE SOTA models, especially if you need more than 32k of context. And the gaming laptop would probably have a better screen as well (full sRGB coverage, if not full DCI-P3 coverage).

[1] reddit.com/r/LocalLLaMA/comments/1tvluaj/how_much_vram_needed_for_qwen_36_27b_q8_with_262k

Quote from: Uwe W. on Yesterday at 20:49:21Leider ust die Akku-Laufzeit falsch.
Dank der Umstellung von der Fitbit App hin zu Google Health, beträgt die Akkulaufzeit weniger als 36 Stunden!!!
Vorher waren es etwas Mehr als 6 Tage

Bei meiner Uhr hat sich in Bezug auf die Akkulaufzeit nichts geändert.
Grüße

Hi everyone,

I'm in the early stages of planning a mobile app and trying to understand what I should expect when working with a mobile app development company. Besides development, do they usually help with UI/UX, testing, and app store submission?

I'd appreciate any advice or experiences you can share. Thanks!