Quote from: ksc on Today at 16:20:46Very fast CPUs are useful only for special applications like [...] AI [...]
Typical AI runs on dGPUs (or sometimes TPUs). The CPU is only a secondary factor. Higher single thread speed and more cores have slight impacts but the dGPU is the bottleneck, as I experience daily running AI. Only if one uses several dGPUs, many CPU cores in Threadripper and huge amounts of RAM can be useful. On servers with many dGPUs, as Huang tells us, also the network speeds for inter-dGPU communication matters. (Some kinds of AI, especially those with huge models, profit from fast inter-dGPU communication already for 2 dGPUs. For other kinds, it is immaterial for a small number of dGPUs. It can depend on how an AI is programmed.)
IMX, two dGPUs would double the speed. Higher CPU single thread speed might raise dGPU load by just a few percents and much more only ca. 5% of the time. More CPU cores would cope with even less frequent 100% dGPU load for several seconds, rarely for a longer time.