Heterogeneous Federated Learning At Scale