HyKKT: a hybrid direct-iterative method for solving KKT linear systems

  • Shaked Regev
  • , Nai Yuan Chiang
  • , Eric Darve
  • , Cosmin G. Petra
  • , Michael A. Saunders
  • , Kasia Świrydowicz
  • , Slaven Peleš

Research output: Contribution to journalArticlepeer-review

7 Scopus citations

Abstract

We propose a solution strategy for the large indefinite linear systems arising in interior methods for nonlinear optimization. The method is suitable for implementation on hardware accelerators such as graphical processing units (GPUs). The current gold standard for sparse indefinite systems is the LBLT factorization where (Formula presented.) is a lower triangular matrix and (Formula presented.) is (Formula presented.) or (Formula presented.) block diagonal. However, this requires pivoting, which substantially increases communication cost and degrades performance on GPUs. Our approach solves a large indefinite system by solving multiple smaller positive definite systems, using an iterative solver on the Schur complement and an inner direct solve (via Cholesky factorization) within each iteration. Cholesky is stable without pivoting, thereby reducing communication and allowing reuse of the symbolic factorization. We demonstrate the practicality of our approach on large optimal power flow problems and show that it can efficiently utilize GPUs and outperform LBLT factorization of the full system.

Original languageEnglish
Pages (from-to)332-355
Number of pages24
JournalOptimization Methods and Software
Volume38
Issue number2
DOIs
StatePublished - 2023
Externally publishedYes

Funding

This research was supported by the Exascale Computing Project (ECP), Project Number: 17-SC-20-SC, a collaborative effort of two DOE organizations (the Office of Science and the National Nuclear Security Administration) responsible for the planning and preparation of a capable exascale ecosystem–including software, applications, hardware, advanced system engineering, and early testbed platforms—to support the nation's exascale computing imperative. We thank Research Computing at Pacific Northwest National Laboratory (PNNL) for computing support. We are also grateful to Christopher Oehmen and Lori Ross O'Neil of PNNL for critical reading of the manuscript and for providing helpful feedback. Finally, we would like to express our gratitude to Stephen Thomas of National Renewable Energy Laboratory for initiating discussion that motivated Section 7.

Keywords

  • GPU
  • KKT systems
  • Optimization
  • interior methods
  • sparse matrix factorization

Fingerprint

Dive into the research topics of 'HyKKT: a hybrid direct-iterative method for solving KKT linear systems'. Together they form a unique fingerprint.

Cite this