Authors
Cong Xie, Oluwasanmi Koyejo, Indranil Gupta
Publication date
2018/2/27
Journal
arXiv preprint arXiv:1802.10116
Description
We propose three new robust aggregation rules for distributed synchronous Stochastic Gradient Descent~(SGD) under a general Byzantine failure model. The attackers can arbitrarily manipulate the data transferred between the servers and the workers in the parameter server~(PS) architecture. We prove the Byzantine resilience properties of these aggregation rules. Empirical analysis shows that the proposed techniques outperform current approaches for realistic use cases and Byzantine attack scenarios.
Scholar articles
C Xie, O Koyejo, I Gupta - arXiv preprint arXiv:1802.10116, 2018