Inference is reshaping data center architecture, introducing a new and less forgiving set of network requirements.