Matrix and Operator Trace Inequalities
| Anna Vershynina et al. (2013), Scholarpedia, 8(4):30919. | doi:10.4249/scholarpedia.30919 | revision #137015 [link to/cite this article] |
In mathematics, there are many kinds of inequalities connected with matrices and linear operators on Hilbert spaces. This article reviews some of the most important operator inequalities connected with traces of matrices.
Basic definitions
Let \(\mathbf{H}_n\) denote the space of Hermitian \(n\times n\) matrices and \(\mathbf{H}_n^+\) denote the set consisting of positive semi-definite \(n\times n\) Hermitian matrices. For operators on an infinite dimensional Hilbert space we require that they be trace class and self-adjoint, in which case similar definitions apply, but we discuss only matrices, for simplicity.
For any real-valued function \(f\) on an interval \(I\subset \mathbb{R}\) one can define a matrix function \(f(A)\) for any operator \(A\in\mathbf{H}_n\) with eigenvalues \(\lambda \) in \(I\) by defining it on the eigenvalues and corresponding projectors \( P \) as \(f(A)=\sum_j f(\lambda_j)P_j,\) with the spectral decomposition \(A=\sum_j\lambda_j P_j. \)
Operator monotone
A function \(f:I\rightarrow \mathbb{R}\) defined on an interval \(I\subset\mathbb{R}\) is said to be operator monotone if for all \(n\), and all \(A,B\in \mathbf{H}_n\) with eigenvalues in \(I\), the following holds: \[ A \geq B \Rightarrow f(A) \geq f(B), \] where the inequality \(A\geq B\) means that the operator \(A-B\geq 0 \) is positive semi-definite.
Operator convex
A function \(f: I \rightarrow \mathbb{R}\) is said to be operator convex if for all \(n\) and all \(A,B\in \mathbf{H}_n\) with eigenvalues in \(I\), and \(0 < \lambda < 1\), the following holds \[ f(\lambda A + (1-\lambda)B) \leq \lambda f(A) + (1 -\lambda)f(B) . \] Note that the operator \(\lambda A + (1-\lambda)B \) has eigenvalues in \(I\), since \( A\) and \(B \) have eigenvalues in \(I\).
A function \(f\) is operator concave if \(-f\) is operator convex, i.e. the inequality above for \(f\) is reversed.
Joint convexity
A function \(g: I\times J \rightarrow \mathbb{R}\), defined on intervals \(I,J\subset \mathbb{R} \) is said to be jointly convex if for all \(n\) and all \(A_1, A_2\in \mathbf{H}_n\) with eigenvalues in \(I\) and all \(B_1,B_2\in \mathbf{H}_n\) with eigenvalues in \(J\), and any \( 0\leq \lambda\leq 1\) the following holds \[ g(\lambda A_1 + (1-\lambda)A_2,\lambda B_1 + (1-\lambda)B_2 ) \leq \lambda g(A_1, B_1) + (1 -\lambda)g(A_2, B_2). \]
A function \(g\) is jointly concave if \(-g\) is jointly convex, i.e. the inequality above for \(g\) is reversed.
Trace function
Given a function \(f : \mathbb{R} \rightarrow \mathbb{R}\), the associated trace function on \(\mathbf{H}_n\) is given by \[ A\mapsto {\rm Tr} f(A)=\sum_j f(\lambda_j),\] where \(A\) has eigenvalues \(\lambda \) and \({\rm Tr} \) stands for a trace of the operator.
Convexity and monotonicity of the trace function
Let \(f : \mathbb{R} \rightarrow \mathbb{R}\) be continuous, and let \(n\) be any integer.
Then if \(t\mapsto f(t)\) is monotone increasing, so is \(A \mapsto {\rm Tr} f(A)\) on \(\mathbf{H}_n\).
Likewise, if \(t \mapsto f(t)\) is convex, so is \(A \mapsto {\rm Tr} f(A)\) on \(\mathbf{H}_n\), and
it is strictly convex if \(f\) is strictly convex.
See proof and discussion in Carlen (2009), for example.
Löwner–Heinz theorem
For \(-1\leq p \leq 0\), the function \(f(t) = -t^p\) is operator monotone and operator concave.
For \(0 \leq p \leq 1\), the function \(f(t) = t^p\) is operator monotone and operator concave.
For \(1 \leq p \leq 2\), the function \(f(t) = t^p\) and operator convex.
Furthermore, \(f(t) = \log(t)\) is operator concave and operator monotone, while \(f(t) = t \log(t)\) is operator convex.
The original proof of this theorem is due to K. Löwner Löwner (1934), where he gave a necessary and sufficient condition for \(f\) to be operator monotone. An elementary proof of the theorem is discussed in Carlen (2009) and a more general version of it in Donoghue (1974).
Klein's inequality
For all Hermitian \(n\times n\) matrices \(A\) and \(B\) and all differentiable convex functions \(f : \mathbb{R} \rightarrow \mathbb{R}\) with derivative \(f' \), or for all positive-definite Hermitian \(n\times n\) matrices \(A\) and \(B\), and all differentiable convex functions \(f:(0,\infty)\rightarrow\mathbb{R}\) the following inequality holds \[ {\rm Tr}[f(A)- f(B)- (A - B)f'(B)] \geq 0.\]
In either case, if \(f\) is strictly convex, there is equality if and only if \(A = B\).
Proof
Let \(C = A - B\) so that for \(0 < t < 1\), \(B + tC = (1 -t)B + tA\). Define \(\phi(t) = {\rm Tr}[f(B + tC)]\). By convexity and monotonicity of trace functions, \(\phi\) is convex, and so for all \(0 < t < 1\), \[ \phi(1) = \phi(0) \geq \frac{\phi(t) - \phi(0)}{t},\]
and in fact the right hand side is monotone decreasing in \(t\). Taking the limit \(t \rightarrow 0\) yields Klein's inequality.
Note that if \(f\) is strictly convex and \(C \neq 0\), then \(\phi\) is strictly convex. The final assertion follows from this and the fact that \(\frac{\phi(t) -\phi(0)}{t}\) is monotone decreasing in \(t\).
Golden–Thompson inequality
In 1965, Golden (1965) and Thompson (1965) independently discovered that
For any matrices \(A, B\in\mathbf{H}_n\), \[{\rm Tr}\, e^{A+B}\leq {\rm Tr}\, e^A e^B.\]
This inequality can be generalized for three operators Lieb (1973): for non-negative operators \(A, B, C\in\mathbf{H}_n^+\), \[{\rm Tr} \, e^{\ln A -\ln B+\ln C}\leq \int_0^\infty dt\, {\rm Tr}\, A(B+t)^{-1}C(B+t)^{-1}.\]
Peierls–Bogoliubov inequality
Let \(R, F\in \mathbf{H}_n\) be such that \({\rm Tr}\, e^R=1\). Define \(f={\rm Tr}\, Fe^R\), then \[{\rm Tr}\, e^{F}e^R \geq {\rm Tr}\, e^{F+R}\geq e^f.\]
The proof of this inequality follows from Klein's inequality. Take \(f(x)=e^x\), \(A=R+F\) and \(B=R+fI\). See Ruelle (1969).
Gibbs variational principle
Let \(H\) be a self-adjoint operator such that \(e^{-H}\) is trace class. Then for any \(\gamma\geq 0 \) with \({\rm Tr}\,\gamma=1,\) \[{\rm Tr}\, \gamma H+{\rm Tr}\, \gamma\ln\gamma\geq -\ln {\rm Tr}\, e^{-H},\] with equality if and only if \(\gamma={\rm exp}(-H)/{\rm Tr}\, {\rm exp}(-H)\).
Lieb's concavity theorem
The following theorem was proved by Lieb (1973). It proves and generalizes a conjecture of Wigner, Yanase and Dyson (1964). Six years later other proofs were given by Ando (1979) and Simon (1979), and several more have been given since then.
For all \(m\times n\) matrices \(K\), and all \(q \) and \(r\) such that \(0 \leq q\leq 1\) and \(0\leq r \leq 1\), with \(q + r \leq 1\) the real valued map on \(\mathbf{H}^+_m \times \mathbf{H}^+_n\) given by \[ F(A,B,K) = {\rm Tr}(K^*A^qKB^r) \]
- is jointly concave in \((A,B)\)
- is convex in \(K\).
Here \(K^* \) stands for the adjoint operator of \(K.\)
Lieb's theorem
For a fixed Hermitian matrix \(L\in\mathbf{H}_n\), the function \[ f(A)={\rm Tr} \,\exp\{L+\ln A\} \] is concave on \(\mathbf{H}_n^+\).
The theorem and proof are due to Lieb (1973), Thm 6, where he obtains this theorem as a corollary of Lieb's concavity Theorem. The most direct proof is due to Epstein (1973); see Ruskai (2002), (2007) papers for a review of this argument.
Ando's convexity theorem
Ando's proof (1979) of Lieb's concavity theorem led to the following significant complement to it:
For all \(m \times n\) matrices \(K\), and all \(1 \leq q \leq 2\) and \(0 \leq r \leq 1\) with \(q-r \geq 1\), the real valued map on \(\mathbf{H}^+_m \times \mathbf{H}^+_n\) given by \[ (A,B) \mapsto {\rm Tr}(K^*A^qKB^{-r})\] is convex.
Joint convexity of relative entropy
For two operators \(A, B\in\mathbf{H}^+_n \) define the following map \[ R(A\|B):= {\rm Tr}(A\log A) - {\rm Tr}(A\log B).\]
For density matrices \(\rho\) and \(\sigma\), the map \(R(\rho\|\sigma)=S(\rho\|\sigma)\) is the Umegaki's quantum relative entropy.
Note that the non-negativity of \(R(A\|B)\) follows from Klein's inequality with \(f(x)=x\log x\).
Statement
The map \(R(A\|B): \mathbf{H}^+_n \times \mathbf{H}^+_n \rightarrow \mathbf{R}\) is jointly convex.
Proof
For all \(0 < p < 1\), \((A,B) \mapsto Tr(B^{1-p}A^p)\) is jointly concave, by Lieb's concavity theorem, and thus \[(A,B)\mapsto \frac{1}{p-1}({\rm Tr}(B^{1-p}A^p)-{\rm Tr}\, A)\] is convex. But \[\lim_{p\rightarrow 1}\frac{1}{p-1}({\rm Tr}(B^{1-p}A^p)-{\rm Tr}\, A)=R(A\|B),\] and convexity is preserved in the limit.
The proof is due to Lindblad (1974).
Jensen's operator and trace inequalities
The operator version of Jensen's inequality is due to Davis (1957).
A continuous, real function \(f\) on an interval \(I\) satisfies Jensen's Operator Inequality if the following holds \[ f\left(\sum_kA_k^*X_kA_k\right)\leq\sum_k A_k^*f(X_k)A_k, \] for operators \(\{A_k\}_k\) with \(\sum_k A^*_kA_k=1\) and for self-adjoint operators \(\{X_k\}_k\) with spectrum on \(I\).
See Hansen and Pedersen (2003), Davis (1957) for the proof of the following two theorems.
Jensen's trace inequality
Let \(f\) be a continuous function defined on an interval \(I\) and let \(m\) and \(n\) be natural numbers. If \(f\) is convex we then have the inequality \[ {\rm Tr}\Bigl(f\Bigl(\sum_{k=1}^nA_k^*X_kA_k\Bigr)\Bigr)\leq {\rm Tr}\Bigl(\sum_{k=1}^n A_k^*f(X_k)A_k\Bigr),\] for all \((X_1, \ldots , X_n)\) self-adjoin \(m\times m\) matrices with spectra contained in \(I\) and all \((A_1, \ldots , A_n)\) of \(m \times m\) matrices with \(\sum_{k=1}^nA_k^*A_k=1\).
Conversely, if the above inequality is satisfied for some \(n\) and \(m\), where \(n > 1\), then \(f\) is convex.
Jensen's operator inequality
For a continuous function \(f\) defined on an interval \(I\) the following conditions are equivalent:
- \(f\) is operator convex.
- For each natural number \(n\) we have the inequality
\[ f\Bigl(\sum_{k=1}^nA_k^*X_kA_k\Bigr)\leq\sum_{k=1}^n A_k^*f(X_k)A_k, \] for all \((X_1, \ldots , X_n)\) bounded, self-adjoint operators on an arbitrary Hilbert space \(\mathcal{H}\) with spectra contained in \(I\) and all \((A_1, \ldots , A_n)\) on \(\mathcal{H}\) with \(\sum_{k=1}^n A^*_kA_k=1\).
- \(f(V^*XV) \leq V^*f(X)V\) for each isometry \(V\) on an infinite-dimensional Hilbert space \(\mathcal{H}\) and
every self-adjoint operator \(X\) with spectrum in \(I\).
- \(Pf(PXP + \lambda(1 -P))P \leq Pf(X)P\) for each projection \(P\) on an infinite-dimensional Hilbert space \(\mathcal{H}\), every self-adjoint operator \(X\) with spectrum in \(I\) and every \(\lambda\) in \(I\).
Araki-Lieb-Thirring inequality
Lieb and Thirring (1976) proved the following inequality: For any \( A\geq 0 \), \(B\geq 0 \) and \(r\geq 1, \) \[{\rm Tr} (B^{1/2}A^{1/2}B^{1/2})^r\leq {\rm Tr} B^{r/2}A^{r/2}B^{r/2}.\]
Araki (1990) generalized the above inequality to the following one: For any \(A\geq 0 \), \(B\geq 0 \) and \(q\geq 0, \) \[{\rm Tr}(B^{1/2}AB^{1/2})^{rq}\leq {\rm Tr}(B^{r/2}A^rB^{r/2})^q,\] for \(r\geq 1, \) and \[{\rm Tr}(B^{r/2}A^rB^{r/2})^q\leq {\rm Tr}(B^{1/2}AB^{1/2})^{rq},\] for \(0\leq r\leq 1. \)
Effros's theorem
Effos (2009) proved the following theorem.
If \(f(x)\) is an operator convex function, and \(L\) and \(R\) are commuting bounded linear operators, i.e. the commutator \([L,R]=LR-RL=0\), the perspective \[g(L, R):=f(L/R)R \] is jointly convex, i.e. if \(L=\lambda L_1+(1-\lambda)L_2\) and \(R=\lambda R_1+(1-\lambda)R_2\) with \([L_i, R_i]=0\) (i=1,2), \(0\leq\lambda\leq 1\), \[g(L,R)\leq \lambda g(L_1,R_1)+(1-\lambda)g(L_2,R_2).\]
References
- Ando, T. (1979). Convexity of Certain Maps on Positive Definite Matrices and Applications to Hadamard Products. Lin. Alg. Appl. 26: 203–241. doi:10.1016/0024-3795(79)90179-4.
- Araki, H. (1990). On an Inequality of Lieb and Thirring. Lett. Math. Phys. 19: 167-170. doi:10.1007/bf01045887.
- Carlen, E. (2009). Trace Inequalities and Quantum Entropy: An Introductory Course. Contemp. Math. 529: .
- Davis, C. (1957). A Schwarz inequality for convex operator functions Proc. Amer. Math. Soc. 8: 42–44. doi:10.1090/s0002-9939-1957-0084120-4.
- Effros, E. (2009). A Matrix Convexity Approach to Some Celebrated Quantum Inequalities Proc. Natl. Acad. Sci. USA 106 (4): 1006–1008. doi:10.1073/pnas.0807965106.
- Epstein, H. (1973). Remarks on Two Theorems of E. Lieb. Comm. Math. Phys. 31: 317–325. doi:10.1007/bf01646492.
- Golden, S. (1965). Lower Bounds for Helmholtz Functions. Phys. Rev. 137 B: 1127–1128. doi:10.1103/physrev.137.b1127.
- Hansen(2003). Jensen's Operator Inequality. Bull. London Math. Soc. 35(4): 553–564. doi:10.1112/s0024609303002200.
- Lieb, E. H. (1973). Convex Trace Functions and the Wigner–Yanase–Dyson Conjecture. Advances in Math. 11: 267–288. doi:10.1007/978-3-642-55925-9_13.
- Lieb, E. H. (1979). Inequalities for the Moments of the Eigenvalues of the Schrödinger Hamiltonian and Their Relation to Sobolev Inequalities. Studies Math. Phys. Princeton University Press,: 269-303. doi:10.1007/978-3-642-55925-9_20.
- Lindblad, G. (1974). Expectations and Entropy Inequalities. Commun. Math. Phys. 39: 111–119. doi:10.1007/bf01608390.
- Löwner, K. (1934). Uber monotone Matrix funktionen. Math. Z. 38: 177–216. doi:10.1007/bf01170633.
- Thompson, C. J. (1965). Inequality with Applications in Statistical Mechanics. J. Math. Phys. 16: 1812–1813. doi:10.1063/1.1704727.
- Ruskai, M. B. (2002). Inequalities for Quantum Entropy: A Review With Conditions for Equality. J. Math. Phys. 43(9): 4358–4375. doi:10.1063/1.1497701.
- Ruskai, M. B. (2007). Another Short and Elementary Proof of Strong Subadditivity of Quantum Entropy. Reports Math. Phys. 60: 1–12. doi:10.1016/s0034-4877(07)00019-5.
- Wigner(1964). On the Positive Semi-Definite Nature of a Certain Matrix Expression. Can. J. Math. 16: 397–406. doi:10.4153/cjm-1964-041-x.
- Donoghue, Jr., W.F. (1974). Monotone Matrix Functions and Analytic Continuation. Springer, .
- Simon, B. (1979). Trace Ideals and their Applications. Cambridge Univ. Press, .
- Ruelle, D. (1969). Statistical Mechanics: Rigorous Results. World Scient., .
Recommended reading
- Carlen, E. (2009). Trace Inequalities and Quantum Entropy: An Introductory Course. Contemp. Math. 529: .
- Bhatia, R. (1997). Matrix Analysis , Springer.
- Simon, B. (1979). Trace Ideals and their Applications , Cambridge Univ. Press, Second edition. Amer. Math. Soc., Providence, RI, (2005).
- Ohya, M. and Petz, D. (1993). Quantum Entropy and Its Use , Springer.
