Distributed Statistical Inference under Heterogeneity