In much of the literature on the solution of linear ill-posed operator equations, the operator equation is discretized and regularization methods are developed for the discretized problem so obtained, without discussing the ramification of these methods for the infinite-dimensional problem. In particular, these regularization methods may only be applicable to certain linear ill-posed operator equations. This paper discusses how regularization by a modified truncated singular value decomposition introduced in [21] for finite-dimensional problems can be extended to operator equations. In finite dimensions, this regularization method yields approximate solutions of higher quality than standard truncated singular value decomposition. Our analysis in a Hilbert space setting is of practical interest, because the solution method presented avoids introduction of discretization errors during the solution process. We discuss how to construct such problems with Chebfun.

We discuss discrete-time dynamical systems depending on a parameter μ. Assuming that the system matrix A(μ) is given, but the parameter μ is unknown, we infer the most-likely parameter μ_m≈μ from an observed trajectory x of the dynamical system. We use parametric eigenpairs (v_i(μ),lambda_i(μ) of the system matrix A(μ) computed with Newton's method based on a Chebyshev expansion. We then represent x in the eigenvector basis defined by the v_i(μ) and compare the decay of the components with predictions based on the lambda_i(μ). The resulting estimates for μ are combined using a kernel density estimator to find the most likely value for μ_m and a corresponding uncertainty quantification.

Linear ill-posed problems often are analyzed in function spaces using tools from functional analysis, while their numerical solution typically is computed by first discretizing the problem and then applying tools from finite-dimensional linear algebra. The Chebfun package makes it possible to solve linear ill-posed problems without explicit discretization. This work discusses the use of Tikhonov regularization with a fairly general linear regularization operator within the Chebfun framework.

The analysis of linear ill-posed problems often is carried out in function spaces using tools from functional analysis. However, the numerical solution of these problems typically is computed by first discretizing the problem and then applying tools from finite-dimensional linear algebra. The present paper explores the feasibility of applying the Chebfun package to solve ill-posed problems with a regularize-first approach numerically. This allows a user to work with functions instead of vectors and with integral operators instead of matrices. The solution process therefore is much closer to the analysis of ill-posed problems than standard linear algebra-based solution methods. Furthermore, the difficult process of explicitly choosing a suitable discretization is not required.

We discuss two approaches to solving the parametric (or stochastic) eigenvalue problem A(μ)λ(μ)=A(μ)v(μ). One of them uses a Taylor expansion and the other a Chebyshev expansion. The parametric eigenvalue problem assumes that the matrix A depends on a parameter μ, where μ might be a random variable. Consequently, the eigenvalues and eigenvectors are also functions of μ. We compute a Taylor approximation of these functions about μ₀ by iteratively computing the Taylor coefficients. The complexity of this approach is O(n³) for all eigenpairs, if the derivatives of A(μ) at μ₀ are given.  The Chebyshev expansion works similarly. We first find an initial approximation iteratively which we then refine with Newton's method.  This second method is more expensive but provides a good approximation over the whole interval of the expansion instead around a single point.
 
We present numerical experiments confirming the complexity and demonstrating that the approaches are capable of tracking eigenvalues at intersection points.  Further experiments shed light on the limitations of the Taylor expansion approach with respect to the distance from the expansion point μ₀.

Many problems in Science and Engineering give rise to linear integral equations of the first kind with a smooth kernel. Discretization of the integral operator yields a matrix, whose singular values cluster at the origin. We describe the approximation of such matrices by adaptive cross approximation, which avoids forming the entire matrix. The choice of the number of steps of adaptive cross approximation is discussed. The discretized right-hand side represents data that commonly are contaminated by measurement error. Solution of the linear system of equations so obtained is not meaningful because the matrix determined by adaptive cross approximation is rank-deficient. We remedy this difficulty by using Tikhonov regularization and discuss how a fairly general regularization matrix can be used. Computed examples illustrate that the use of a regularization matrix different from the identity can improve the quality of the computed approximate solutions significantly.

Recent advances in natural language processing have improved our understanding of what kind of linguistic knowledge is encoded in modern word representations. For example, methods for testing the ability to extract syntax trees from a language model architecture were developed by Hewitt and Manning (2019)—they project word vectors into Euclidean subspace in such a way that the corresponding squared Euclidean distance approximates the tree distance between words in the syntax tree. This work proposes a method for assessing whether embedding word representations in hyperbolic space can better reflect the graph structure of syntax trees. We show that the tree distance between words in a syntax tree can be approximated well by the hyperbolic distance between corresponding word vectors.

The Arnoldi process can be applied to inexpensively approximate matrix functions of the form f(A)v and matrix functionals of the form v∗(f(A))∗g(A)v, where A is a large square non-Hermitian matrix, v is a vector, and the superscript ∗ denotes transposition and complex conjugation. Here f and g are analytic functions that are defined in suitable regions in the complex plane. This paper reviews available approximation methods and describes new ones that provide higher accuracy for essentially the same computational effort by exploiting available, but generally not used, moment information.
Numerical experiments show that in some cases the modifications of the Arnoldi decompositions proposed can improve the accuracy of v∗(f(A))∗g(A)v about as much as performing an additional step of the Arnoldi process.