Sökning: id:"swepub:oai:DiVA.org:su-196431" >
Distributed Newton ...
Distributed Newton Method Over Graphs : Can Sharing of Second-Order Information Eliminate the Condition Number Dependence?
-
- Berglund, Erik (författare)
- KTH,Reglerteknik
-
- Magnússon, Sindri (författare)
- KTH,Stockholms universitet,Institutionen för data- och systemvetenskap,Reglerteknik
-
- Johansson, Mikael (författare)
- KTH,Reglerteknik
-
(creator_code:org_t)
- Institute of Electrical and Electronics Engineers (IEEE), 2021
- 2021
- Engelska.
-
Ingår i: IEEE Signal Processing Letters. - : Institute of Electrical and Electronics Engineers (IEEE). - 1070-9908 .- 1558-2361. ; 28, s. 1180-1184
- Relaterad länk:
-
https://urn.kb.se/re...
-
visa fler...
-
https://doi.org/10.1...
-
https://urn.kb.se/re...
-
visa färre...
Abstract
Ämnesord
Stäng
- One of the main advantages of second-order methods in a centralized setting is that they are insensitive to the condition number of the objective function's Hessian. For applications such as regression analysis, this means that less pre-processing of the data is required for the algorithm to work well, as the ill-conditioning caused by highly correlated variables will not be as problematic. Similar condition number independence has not yet been established for distributed methods. In this paper, we analyze the performance of a simple distributed second-order algorithm on quadratic problems and show that its convergence depends only logarithmically on the condition number. Our empirical results indicate that the use of second-order information can yield large efficiency improvements over first-order methods, both in terms of iterations and communications, when the condition number is of the same order of magnitude as the problem dimension.
Ämnesord
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering (hsv//eng)
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Reglerteknik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Control Engineering (hsv//eng)
Nyckelord
- Signal processing algorithms
- Complexity theory
- Optimization
- Peer-to-peer computing
- Convergence
- Gradient methods
- Linear regression
- Distributed Algorithms
- optimization
Publikations- och innehållstyp
- ref (ämneskategori)
- art (ämneskategori)
Hitta via bibliotek
Till lärosätets databas