Don't want to be tracked or whatever? Did you know that you can run AI locally (and privately)?
Ideally all you need minimally (it even rhymes, so it must be true), is a gaming laptop with 32 GB RAM and a 6-8 GB VRAM GPU and it can then fit a lot of context, too:
Calculating of available context tokens of existing frontier models (Qwen, as of this writing)[1], using an approx. minimum recommended Q4_K_M quants on 32 GB RAM+8 GB VRAM devices (16,384 [KV cache context tokens per GB[2]]*(32 [GB RAM] +
8 [GB VRAM] - 7 [GB for the OS[3]] - [GB quant filesize])):
- For Qwen3.6-35B-A3B (MoE) (eg huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF):
178,500 context tokens = 16,384*(32+8-7-22.1)
- For Qwen3.8-27B (dense) (eg huggingface.co/unsloth/Qwen3.8-27B-GGUF):
270,000 context tokens = 16,384*(32+8-7-16.5).
(If Qwen4 gets a reduction in KV cache context tokens memory requirements, like in [4], then the calculated context number will further increase.)
[1] artificialanalysis.ai/models/open-source/small
[2] reddit.com/r/Qwen_AI/comments/1vo8pjz/qwen3827b_kv_cache_works_out_to_64_kibtoken_so/
[3] techpowerup.com/353395/windows-11-26h2-update-lowers-ram-consumption
[4] huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash (see "Global KV Cache Per Token (Bytes)" image)
(due to anti-spam system, 2nd part is in next post)