A new scaling and squaring algorithm for the matrix exponential

Awad H. Al-Mohy, Nicholas J. Higham

    Research output: Contribution to journalArticlepeer-review

    Abstract

    The scaling and squaring method for the matrix exponential is based on the approximation eA ≈ (rm(2-sA))2s, where rm(x) is the [m/m] Padé approximant to ex and the integers m and s are to be chosen. Several authors have identified a weakness of existing scaling and squaring algorithms termed overscaling, in which a value of s much larger than necessary is chosen, causing a loss of accuracy in floating point arithmetic. Building on the scaling and squaring algorithm of Higham [SIAM J. Matrix Anal. Appl., 26 (2005), pp. 1179-1193], which is used by the MATLAB function expm, we derive a new algorithm that alleviates the overscaling problem. Two key ideas are employed. The first, specific to triangular matrices, is to compute the diagonal elements in the squaring phase as exponentials instead of from powers of rm. The second idea is to base the backward error analysis that underlies the algorithm on members of the sequence {∥Aκ∥ 1/κ} instead of ∥A∥, since for nonnormal matrices it is possible that ∥Aκ∥ 1/κ is much smaller than ∥A∥, and indeed this is likely when overscaling occurs in existing algorithms. The terms ∥Aκ∥ 1/κ are estimated without computing powers of A by using a matrix 1-norm estimator in conjunction with a bound of the form ∥Aκ∥ 1/κ ≤ max(∥Aρ∥ 1/ρ, ∥Aq∥) 1/q∥ that holds for certain fixed p and q less than κ. The improvements to the truncation error bounds have to be balanced by the potential for a large ∥A∥ to cause inaccurate evaluation of rm in floating point arithmetic. We employ rigorous error bounds along with some heuristics to ensure that rounding errors are kept under control. Our numerical experiments show that the new algorithm generally provides accuracy at least as good as the existing algorithm of Higham at no higher cost, while for matrices that are triangular or cause overscaling it usually yields significant improvements in accuracy, cost, or both. © 2009 Society for Industrial and Applied Mathematics.
    Original languageEnglish
    Pages (from-to)970-989
    Number of pages19
    JournalSIAM Journal on Matrix Analysis and Applications
    Volume31
    Issue number3
    DOIs
    Publication statusPublished - 2009

    Keywords

    • Backward error analysis
    • Expm
    • MATLAB
    • Matrix exponential
    • Matrix function
    • Matrix norm estimation
    • Overscaling
    • Padé approximation
    • Scaling and squaring method

    Fingerprint

    Dive into the research topics of 'A new scaling and squaring algorithm for the matrix exponential'. Together they form a unique fingerprint.

    Cite this