Intel unveiled its upcoming vision processing unit (VPU) for edge computing devices. Dubbed Keem Bay, the new chip offers major improvements over existing VPUs from Nvidia and Huawei. Additionally, Keem Bay offers better performance with a significantly lower power draw.
https://www.notebookcheck.net/Intel-unveils-Keem-Bay-VPU-for-improved-on-device-AI-vision-processing.442741.0.html
This is sort of an unfair comparison, GPU's work far better than CPU's for Neural Networks but they are far from perfect, a chip custom designed for inference will obviously perform better.
The TX2 and Xavier chips don't even have the Nvidia Tensor Cores introduced with Turing.
A more fair comparison would be to things like the Google Edge TPU.