# Inner product

In mathematics, an **inner product** is an abstract notion on general vector spaces that is a generalization of the concept of the dot product in the Euclidean spaces. Among other things, the inner product on a vector space makes it possible to define the geometric operation of projection onto a complete subspace (in the metric topology induced by the inner product), just like how the dot product makes it possible to define, in the Euclidean spaces, the projection of a vector onto the subspace spanned by a set of other vectors. The projection operation is a powerful geometric tool that makes the inner product a desirable convenience, especially for the purposes of optimization and approximation.

## Contents |

## Formal definition of inner product

Let *X* be a vector space over a field đť”˝. In applications outside pure mathematics the field đť”˝ is usually the field of complex numbers â„‚ or its subfield of real numbers â„ť. The complex conjugate of a complex number *c* ∈ â„‚ is indicated by *cĚ…*. When a number *c* is real, its imaginary part is zero and *cĚ…* = *c*. Conversely, if *cĚ…* = *c* then *c* is real.

An **inner product** ⟨ ⋅ , ⋅ ⟩ on *X* is a map from the Cartesian product *X*×*X* to đť”˝ with the following properties:

1.
(in particular it means that ⟨ *x*, *x* ⟩ is real)

2. (inner product is non-degenerate).

3. and (linear in the first slot)

4. and (anti-linear in the second slot)

5.

6.

Properties 1 and 2 imply that if ⟨ *x*, *y* ⟩ = 0 ∀ *x* ∈ *X* (*x* in the first slot) that *y* = 0 (The inner product is non-degenerate in both slots).

Properties 3 and 4 are called *sesquilinear*.^{[1]} Note that some authors, especially those working in quantum mechanics, may define an inner product to be anti-linear in the first slot and linear in the second slot, this is just a matter of preference.

Properties 5 and 6 define the inner product to be *positive definite*. Vector spaces with positive definite inner product are sometimes called Euclidean. Some authors distinguish *proper* and *improper* Euclidean spaces. The former have a positive definite inner product and the latter have an indefinite, non-degenerate, inner product (lack property 5 and 6). An example of an improper Euclidean space is Minkowski space.

## Norm and topology induced by an inner product

The positive definite inner product induces a norm on *X* defined by |*x*|= ⟨ *x,x* ⟩^{½} ≥ 0. Therefore it also induces a metric topology on *X* via the metric *d(x,y)*= |*x* − *y*|. Note that *d(x,y)* = 0 if and only if *x* = *y*.

## Inner product on a finite-dimensional space

Consider a *n*-dimensional complex vector space *V* with a non-degenerate inner product ⟨ ⋅, ⋅⟩ that is not necessarily definite (properties 5 and 6 are not stipulated).
However, the inner product is conjugate-symmetric and non-degenerate (properties 1 and 2 above *do* hold, as do properties 3 and 4).
Often inner products are required to be positive definite, but since this excludes the Minkowksi metric, which plays an important role in special theory of relativity, this will not be required in this section.

Given a basis *e*_{i} the matrix **g** with elements *g*_{ij} = ⟨ *e*_{i} , *e*_{j} ⟩ is the metric tensor (also known as *fundamental tensor*) relative to the given basis. It will be shown that **g** can brought into the following form by a suitable choice of a basis of *V*:

where *n* = *r*+*s*. The pair (*r*, *s*) is the *signature* of the inner product.

In this section the inner product will be taken to be conjugate-symmetric in the *first* slot: ⟨ *c x*, *y* ⟩ = *cĚ…* ⟨ *x*, *y* ⟩ for complex number *c*. This will facilitate the notation.

The matrix **g** represents a second rank covariant tensor. That is, given a basis transformation with matrix **B**,

As an *n*×*n* matrix **g** is Hermitian and non-singular. If **g** were singular there would be a non-zero n-tuple of complex numbers (column vector) **k** in its kernel, and for an arbitrary n-tuple **â„“** it would follow that,

with

The requirement of non-degeneracy of inner product gives that vector *k* = 0, and then also its component vector **k** is zero, so there is a contradiction: **g** is non-singular.

As an *n*×*n* Hermitian matrix, **g** can be unitarily diagonalized and has real eigenvalues. That is, there is an *n*×*n* unitary matrix **U**, such that

Here **U**^{†} stands for the matrix **U** in which all elements are transposed and complex-conjugated. (If the inner product is defined to be conjugate-symmetric with respect the second slot, this equation must be suitably modified.)
None of the eigenvalues α_{k} is equal to zero. If one or more eigenvalues were zero the determinant det(**g**) = 0 and **g** is singular (a square matrix is singular if and only if its determinant vanishes), in contradiction to its non-degenerate character. So the following definition of a real diagonal matrix **D** is possible

Multiply the one but last equation on the left by **D**^{T} = **D**^{†} = **D** and on the right by **D**,

where it is used that

and it is assumed that the columns of the eigenvector matrix **U** are arranged such that the *r* positive eigenvalues precede the *s* negative eigenvalues.

Summarizing, there exist a basis *o*_{i} for *V*, defined by

with

The matrix ⟨ *o*_{i} , *o*_{j} ⟩ has the shape given at the beginning of this section.
This basis *o*_{i} is *orthonormal* with respect to the given inner product. When *s* = 0 (all *r* = *n* eigenvalues positive) the inner product is positive-definite and *V* is a proper *Euclidean* space. When *s* = 1 and *r* = 3 (or equivalently *s* = 3, *r* = 1), and the ground field of the space is â„ť ⊂ â„‚, the 4-dimensional space is a Minkowski space. Such a space is referred to as an *improper Euclidean* or *pseudo-Euclidean* space.

### Example

The simplest example of an indefinite metric tensor **g** is on real 2-dimensional space,

A non-zero vector (*x*_{1}, *x*_{2}) with zero length squared is obtained from

Hence there are two solutions **x**_{1,2}

In the theory of special relativity *x*_{2} = *c t*, where *c* is the speed of light and *t* the time, while *x*_{1} is the space-coordinate of an object. The zero-length vector satisfies

Hence *x*_{1}/*t* is the velocity of an object that moves with the speed of light.

## Reference

- â†‘ T. Kato,
*A Short Introduction to Perturbation Theory for Linear Operators*, Springer-Verlag, New York (1982), ISBN 0-387-90666-5 p. 49

Some content on this page may previously have appeared on Citizendium. |