AMD has announced what it calls the world's fastest HPC GPU, the Instinct MI100 based on the CDNA architecture. The Instinct MI100 offers up to 11.5 TFLOPs of FP64 compute performance when paired with 2nd gen EPYC processors. The MI100 is slated to offer better performance per dollar compared to the NVIDIA A100 GPU along with support for the new ROCm 4.0 software platform.
https://www.notebookcheck.net/AMD-announces-CDNA-based-Instinct-MI100-GPU-with-120-CUs-for-HPC-promises-up-to-2-1x-more-performance-per-dollar-compared-to-the-NVIDIA-A100.504329.0.html