Pseudo-spectral method

Pseudo-spectral methods,[1] also known as discrete variable representation (DVR) methods, are a class of numerical methods used in applied mathematics and scientific computing for the solution of partial differential equations. They are closely related to spectral methods, but complement the basis by an additional pseudo-spectral basis, which allows representation of functions on a quadrature grid. This simplifies the evaluation of certain operators, and can considerably speed up the calculation when using fast algorithms such as the fast Fourier transform.

Motivation with a concrete example

Take the initial-value problem

${\displaystyle i{\frac {\partial }{\partial t}}\psi (x,t)={\Bigl [}-{\frac {\partial ^{2}}{\partial x^{2}}}+V(x){\Bigr ]}\psi (x,t),\qquad \qquad \psi (t_{0})=\psi _{0}}$

with periodic conditions ${\displaystyle \psi (x+1,t)=\psi (x,t)}$. This specific example is the Schrödinger equation for a particle in a potential ${\displaystyle V(x)}$, but the structure is more general. In many practical partial differential equations, one has a term that involves derivatives (such as a kinetic energy contribution), and a multiplication with a function (for example, a potential).

In the spectral method, the solution ${\displaystyle \psi }$ is expanded in a suitable set of basis functions, for example plane waves,

${\displaystyle \psi (x,t)={\frac {1}{\sqrt {2\pi }}}\sum _{n}c_{n}(t)e^{2\pi inx}.}$

Insertion and equating identical coefficients yields a set of ordinary differential equations for the coefficients,

${\displaystyle i{\frac {d}{dt}}c_{n}(t)=(2\pi n)^{2}c_{n}+\sum _{k}V_{n-k}c_{k},}$

where the elements ${\displaystyle V_{n-k}}$ are calculated through the explicit Fourier-transform

${\displaystyle V_{n-k}=\int _{0}^{1}V(x)\ e^{2\pi i(k-n)x}dx.}$

The solution would then be obtained by truncating the expansion to ${\displaystyle N}$ basis functions, and finding a solution for the ${\displaystyle c_{n}(t)}$. In general, this is done by numerical methods, such as Runge–Kutta methods. For the numerical solutions, the right-hand side of the ordinary differential equation has to be evaluated repeatedly at different time steps. At this point, the spectral method has a major problem with the potential term ${\displaystyle V(x)}$.

In the spectral representation, the multiplication with the function ${\displaystyle V(x)}$ transforms into a vector-matrix multiplication, which scales as ${\displaystyle N^{2}}$. Also, the matrix elements ${\displaystyle V_{n-k}}$ need to be evaluated explicitly before the differential equation for the coefficients can be solved, which requires an additional step.

In the pseudo-spectral method, this term is evaluated differently. Given the coefficients ${\displaystyle c_{n}(t)}$, an inverse discrete Fourier transform yields the value of the function ${\displaystyle \psi }$ at discrete grid points ${\displaystyle x_{j}=2\pi j/N}$. At these grid points, the function is then multiplied, ${\displaystyle \psi '(x_{i},t)=V(x_{i})\psi (x_{i},t)}$, and the result Fourier-transformed back. This yields a new set of coefficients ${\displaystyle c'_{n}(t)}$ that are used instead of the matrix product ${\displaystyle \sum _{k}V_{n-k}c_{k}(t)}$.

It can be shown that both methods have similar accuracy. However, the pseudo-spectral method allows the use of a fast Fourier transform, which scales as ${\displaystyle O(N\ln N)}$, and is therefore significantly more efficient than the matrix multiplication. Also, the function ${\displaystyle V(x)}$ can be used directly without evaluating any additional integrals.

Technical discussion

In a more abstract way, the pseudo-spectral method deals with the multiplication of two functions ${\displaystyle V(x)}$ and ${\displaystyle f(x)}$ as part of a partial differential equation. To simplify the notation, the time-dependence is dropped. Conceptually, it consists of three steps:

1. ${\displaystyle f(x),{\tilde {f}}(x)=V(x)f(x)}$ are expanded in a finite set of basis functions (this is the spectral method).
2. For a given set of basis functions, a quadrature is sought that converts scalar products of these basis functions into a weighted sum over grid points.
3. The product is calculated by multiplying ${\displaystyle V,f}$ at each grid point.

Expansion in a basis

The functions ${\displaystyle f,{\tilde {f}}}$ can be expanded in a finite basis ${\displaystyle \{\phi _{n}\}_{n=0,\ldots ,N}}$ as

${\displaystyle f(x)=\sum _{n=0}^{N}c_{n}\phi _{n}(x)}$

${\displaystyle {\tilde {f}}(x)=\sum _{n=0}^{N}{\tilde {c}}_{n}\phi _{n}(x)}$

For simplicity, let the basis be orthogonal and normalized, ${\displaystyle \langle \phi _{n},\phi _{m}\rangle =\delta _{nm}}$ using the inner product ${\displaystyle \langle f,g\rangle =\int _{a}^{b}f(x){\overline {g(x)}}dx}$ with appropriate boundaries ${\displaystyle a,b}$. The coefficients are then obtained by

${\displaystyle c_{n}=\langle f,\phi _{n}\rangle }$

${\displaystyle {\tilde {c}}_{n}=\langle {\tilde {f}},\phi _{n}\rangle }$

A bit of calculus yields then

${\displaystyle {\tilde {c}}_{n}=\sum _{m=0}^{N}V_{n-m}c_{m}}$

with ${\displaystyle V_{n-m}=\langle V\phi _{m},\phi _{n}\rangle }$. This forms the basis of the spectral method. To distinguish the basis of the ${\displaystyle \phi _{n}}$ from the quadrature basis, the expansion is sometimes called Finite Basis Representation (FBR).

Quadrature

For a given basis ${\displaystyle \{\phi _{n}\}}$ and number of ${\displaystyle N+1}$ basis functions, one can try to find a quadrature, i.e., a set of ${\displaystyle N+1}$ points and weights such that

${\displaystyle \langle \phi _{n},\phi _{m}\rangle =\sum _{i=0}^{N}w_{i}\phi _{n}(x_{i}){\overline {\phi _{m}(x_{i})}}\qquad \qquad n,m=0,\ldots ,N}$

Special examples are the Gaussian quadrature for polynomials and the Discrete Fourier Transform for plane waves. It should be stressed that the grid points and weights, ${\displaystyle x_{i},w_{i}}$ are a function of the basis and the number ${\displaystyle N}$.

The quadrature allows an alternative numerical representation of the function ${\displaystyle f(x),{\tilde {f}}(x)}$ through their value at the grid points. This representation is sometimes denoted Discrete Variable Representation (DVR), and is completely equivalent to the expansion in the basis.

${\displaystyle f(x_{i})=\sum _{n=0}^{N}c_{n}\phi _{n}(x_{i})}$

${\displaystyle c_{n}=\langle f,\phi _{n}\rangle =\sum _{i=0}^{N}w_{i}f(x_{i}){\overline {\phi _{n}(x_{i})}}}$

Multiplication

The multiplication with the function ${\displaystyle V(x)}$ is then done at each grid point,

${\displaystyle {\tilde {f}}(x_{i})=V(x_{i})f(x_{i}).}$

This generally introduces an additional approximation. To see this, we can calculate one of the coefficients ${\displaystyle {\tilde {c}}_{n}}$:

${\displaystyle {\tilde {c}}_{n}=\langle {\tilde {f}},\phi _{n}\rangle =\sum _{i}w_{i}{\tilde {f}}(x_{i}){\overline {\phi _{n}(x_{i})}}=\sum _{i}w_{i}V(x_{i})f(x_{i}){\overline {\phi _{n}(x_{i})}}}$

However, using the spectral method, the same coefficient would be ${\displaystyle {\tilde {c}}_{n}=\langle Vf,\phi _{n}\rangle }$. The pseudo-spectral method thus introduces the additional approximation

${\displaystyle \langle Vf,\phi _{n}\rangle \approx \sum _{i}w_{i}V(x_{i})f(x_{i}){\overline {\phi _{n}(x_{i})}}.}$

If the product ${\displaystyle Vf}$ can be represented with the given finite set of basis functions, the above equation is exact due to the chosen quadrature.

Special pseudospectral schemes

The Fourier method

If periodic boundary conditions with period ${\displaystyle [0,L]}$ are imposed on the system, the basis functions can be generated by plane waves,

${\displaystyle \phi _{n}(x)={\frac {1}{\sqrt {L}}}e^{-\imath k_{n}x}}$

with ${\displaystyle k_{n}=(-1)^{n}\lceil n/2\rceil 2\pi /L}$, where ${\displaystyle \lceil \cdot \rceil }$ is the ceiling function.

The quadrature for a cut-off at ${\displaystyle n_{\text{max}}=N}$ is given by the discrete Fourier transformation. The grid points are equally spaced, ${\displaystyle x_{i}=i\Delta x}$ with spacing ${\displaystyle \Delta x=L/(N+1)}$, and the constant weights are ${\displaystyle w_{i}=\Delta x}$.

For the discussion of the error, note that the product of two plane waves is again a plane wave, ${\displaystyle \phi _{a}+\phi _{b}=\phi _{c}}$ with ${\displaystyle c\leq a+b}$. Thus, qualitatively, if the functions ${\displaystyle f(x),V(x)}$ can be represented sufficiently accurately with ${\displaystyle N_{f},N_{V}}$ basis functions, the pseudo-spectral method gives accurate results if ${\displaystyle N_{f}+N_{V}}$ basis functions are used.

An expansion in plane waves often has a poor quality and needs many basis functions to converge. However, the transformation between the basis expansion and the grid representation can be done using a Fast Fourier transform, which scales favorably as ${\displaystyle N\ln N}$. As a consequence, plane waves are one of the most common expansion that is encountered with pseudo-spectral methods.

Polynomials

Another common expansion is into classical polynomials. Here, the Gaussian quadrature is used, which states that one can always find weights ${\displaystyle w_{i}}$ and points ${\displaystyle x_{i}}$ such that

${\displaystyle \int _{a}^{b}w(x)p(x)dx=\sum _{i=0}^{N}w_{i}p(x_{i})}$

holds for any polynomial ${\displaystyle p(x)}$ of degree ${\displaystyle 2N+1}$ or less. Typically, the weight function ${\displaystyle w(x)}$ and ranges ${\displaystyle a,b}$ are chosen for a specific problem, and leads to one of the different forms of the quadrature. To apply this to the pseudo-spectral method, we choose basis functions ${\displaystyle \phi _{n}(x)={\sqrt {w(x)}}P_{n}(x)}$, with ${\displaystyle P_{n}}$ being a polynomial of degree ${\displaystyle n}$ with the property

${\displaystyle \int _{a}^{b}w(x)P_{n}(x)P_{m}(x)dx=\delta _{mn}.}$

Under these conditions, the ${\displaystyle \phi _{n}}$ form an orthonormal basis with respect to the scalar product ${\displaystyle \langle f,g\rangle =\int _{a}^{b}f(x){\overline {g(x)}}dx}$. This basis, together with the quadrature points can then be used for the pseudo-spectral method.

For the discussion of the error, note that if ${\displaystyle f}$ is well represented by ${\displaystyle N_{f}}$ basis functions and ${\displaystyle V}$ is well represented by a polynomial of degree ${\displaystyle N_{V}}$, their product can be expanded in the first ${\displaystyle N_{f}+N_{V}}$ basis functions, and the pseudo-spectral method will give accurate results for that many basis functions.

Such polynomials occur naturally in several standard problems. For example, the quantum harmonic oscillator is ideally expanded in Hermite polynomials, and Jacobi-polynomials can be used to define the associated Legendre functions typically appearing in rotational problems.

References

1. Orszag, Steven A. (September 1972). "Comparison of Pseudospectral and Spectral Approximation". Studies in Applied Mathematics. 51 (3): 253–259. doi:10.1002/sapm1972513253.

• Orszag, Steven A. (1969). "Numerical Methods for the Simulation of Turbulence". Physics of Fluids. 12 (12): II-250. doi:10.1063/1.1692445.
• Gottlieb, David; Orszag, Steven A. (1989). Numerical analysis of spectral methods : theory and applications (5. print. ed.). Philadelphia, Pa.: Society for Industrial and Applied Mathematics. ISBN 978-0898710236.
• Hesthaven, Jan S.; Gottlieb, Sigal; Gottlieb, David (2007). Spectral methods for time-dependent problems (1. publ. ed.). Cambridge [u.a.]: Cambridge Univ. Press. ISBN 9780521792110.
• Jie Shen, Tao Tang and Li-Lian Wang (2011) "Spectral Methods: Algorithms, Analysis and Applications" (Springer Series in Computational Mathematics, V. 41, Springer), ISBN 354071040X.
• Trefethen, Lloyd N. (2000). Spectral methods in MATLAB (3rd. repr. ed.). Philadelphia, Pa: SIAM. ISBN 978-0-89871-465-4.
• Fornberg, Bengt (1996). A Practical Guide to Pseudospectral Methods. Cambridge: Cambridge University Press. ISBN 9780511626357.
• Boyd, John P. (2001). Chebyshev and Fourier spectral methods (2nd ed., rev. ed.). Mineola, N.Y.: Dover Publications. ISBN 978-0486411835.
• Funaro, Daniele (1992). Polynomial approximation of differential equations. Berlin: Springer-Verlag. ISBN 978-3-540-46783-0.
• de Frutos, Javier; Novo, Julia (January 2000). "A Spectral Element Method for the Navier--Stokes Equations with Improved Accuracy". SIAM Journal on Numerical Analysis. 38 (3): 799–819. doi:10.1137/S0036142999351984.
• Claudio, Canuto; M. Yousuff, Hussaini; Alfio, Quarteroni; Thomas A., Zang (2006). Spectral methods fundamentals in single domains. Berlin: Springer-Verlag. ISBN 978-3-540-30726-6.
• Press, WH; Teukolsky, SA; Vetterling, WT; Flannery, BP (2007). "Section 20.7. Spectral Methods". Numerical Recipes: The Art of Scientific Computing (3rd ed.). New York: Cambridge University Press. ISBN 978-0-521-88068-8.