Recent posts
#96
Last post by Reinhold Zeller - Today at 12:06:11
Warum machen die USA das? Weil Sie Angst vor China haben.
#98
Last post by Liam - Today at 12:00:16
I see, it's good old NAND memory, just stacked. I thought they did some ground research and invented a new memory cell.
Starting at 400 GB/s is ok.
You can "stack" NAND storage too to increase speed: Get a PCIe Gen5 RAID card and it can be a temporary alternative for RAM in especially this task: reddit.com/r/LocalLLaMA/comments/1ow0jj0/running_a_1_trillion_parameter_model_on_a_pc_with/