Abstract

For a representation of a connected compact Lie group G in a finite dimensional real vector space 𝒰 and a subspace 𝒱 of 𝒰, invariant under a maximal torus of G, we obtain a sufficient condition for 𝒱 to meet all G-orbits in 𝒰, which is also necessary in certain cases. The proof makes use of the cohomology of flag manifolds and the invariant theory of Weyl groups. Then we apply our condition to the conjugation representations of U(n), Sp(n), and SO(n) in the space of n × n matrices over , , and , respectively. In particular, we obtain an interesting generalization of Schur's triangularization theorem.