Google has been bragging about its TPU chip since May of 2016 and has finally released it into GCP this past week. If you have any active TensorFlow workloads, you should absolutely experiment with it. Currently you have to actually request a quota—they're managing limited supply vs. large demand—so if you're interested, fill out the form ASAP.