SK Hynix says the future of memory lies somewhere between HBM and SSDs

[Redaktion]

SK Hynix has unveiled the first standard specifications for High Bandwidth Flash (HBF), a new memory tier designed to sit between HBM and SSDs in AI systems. The open standard supports up to 512 GB capacities, bandwidth of up to 3 TB/s and UCIe connectivity.



https://www.notebookcheck.net/SK-Hynix-says-the-future-of-memory-lies-somewhere-between-HBM-and-SSDs.1359674.0.html

[Liam]

I see, it's good old NAND memory, just stacked. I thought they did some ground research and invented a new memory cell.

Starting at 400 GB/s is ok.

You can "stack" NAND storage too to increase speed: Get a PCIe Gen5 RAID card and it can be a temporary alternative for RAM in especially this task: reddit.com/r/LocalLLaMA/comments/1ow0jj0/running_a_1_trillion_parameter_model_on_a_pc_with/