This book presents the state of the art in distributed machine learning algorithms that are based on gradient optimization methods. …