By Rich Tong 10 February 2024
Here is a summary of some things going on with hardware. It’s a barbell, where on-device and clients are moving fast, but so is Nvidia at the data center. It seems like training is going one way and inference is going the other.