Linear Stochastic Approximation Algorithms and Group Consensus over Random Signed Networks

TitleLinear Stochastic Approximation Algorithms and Group Consensus over Random Signed Networks
Publication TypeJournal Article
Year of Publication2018
AuthorsChen G., Duan X., Mei W., Bullo F.
JournalIEEE Transactions on Automatic Control
Date Published08/2018
Keywordsconsensus, linear systems, multiagent systems, signed network, stochastic approximation
Abstract

This paper studies linear stochastic approximation(SA) algorithms and their application to multi-agent systems in engineering and sociology. As main contribution, we provide necessary and sufficient conditions for convergence of linear SA algorithms to a deterministic or random final vector. We also characterize the system convergence rate, when the system is convergent. Moreover, differing from non-negative gain functions in traditional SA algorithms, this paper considers also the case when the gain functions are allowed to take arbitrary real numbers. Using our general treatment, we provide necessary and sufficient conditions to reach consensus and group consensus for first-order discrete-time multi-agent system over random signed networks and with state-dependent noise. Finally, we extend our results to the setting of multi-dimensional linear SA algorithms and characterize the behavior of the multi-dimensional Friedkin-Johnsen model over random interaction networks.

DOI10.1109/TAC.2018.2867257