Algebra · real student question

Prove that a matrix of rank r can be written as a sum of r rank-one matrices, but not as a sum of fewer than r rank-one matrices.

Question

Let AA be an m×nm\times n matrix with rank(A)=r\operatorname{rank}(A)=r.

Prove that AA can be written as a sum of rr matrices of rank 11, and that it cannot be written as a sum of fewer than rr matrices of rank 11.

Step-by-step solution

  1. Split the claim into two independent statements. "Exactly rr works" is an existence claim needing a construction; "fewer than rr fails" is an impossibility claim needing an inequality. The two halves use completely different tools, and neither implies the other.

  2. Build a basis for the column space. Since rank(A)=r\operatorname{rank}(A)=r, the column space of AA has dimension rr, so rr linearly independent columns u1,,uru_1,\dots,u_r of AA span it. Every column aja_j of AA is then a combination

    aj=c1ju1+c2ju2++crjura_j=c_{1j}u_1+c_{2j}u_2+\cdots+c_{rj}u_r

  3. Package the combinations as a matrix product. Collecting the uiu_i into an m×rm\times r matrix UU and the coefficients into an r×nr\times n matrix CC gives the rank factorisation

    A=UCA=UC

    This is the whole construction in compressed form - the rest is just reading it correctly.

  4. Expand the product as outer products. Writing viTv_i^{T} for the ii-th row of CC, block multiplication gives

    A=UC=i=1ruiviTA=UC=\sum_{i=1}^{r}u_i v_i^{T}

    Each uiviTu_iv_i^{T} has every column a scalar multiple of uiu_i, so its column space is spanned by the single vector uiu_i and rank(uiviT)=1\operatorname{rank}(u_iv_i^{T})=1. That settles the first half.

  5. Invoke subadditivity of rank for the second half. For any matrices, rank(B+C)rank(B)+rank(C)\operatorname{rank}(B+C)\le\operatorname{rank}(B)+\operatorname{rank}(C), because the column space of B+CB+C is contained in the sum of the two column spaces. Iterating,

    rank(B1++Bk)i=1krank(Bi)\operatorname{rank}(B_1+\cdots+B_k)\le\sum_{i=1}^{k}\operatorname{rank}(B_i)

  6. Derive the contradiction. Suppose A=B1++BkA=B_1+\cdots+B_k with each rank(Bi)=1\operatorname{rank}(B_i)=1. Then

    r=rank(A)1+1++1k=kr=\operatorname{rank}(A)\le\underbrace{1+1+\cdots+1}_{k}=k

    so krk\ge r; no decomposition with k<rk<r can exist. Combined with the construction, the minimum number of rank-one summands is exactly rr. \blacksquare

Answer

A=i=1ruiviT with each rank(uiviT)=1, and k<r is impossible since rank(A)irank(Bi)=kA=\sum_{i=1}^{r}u_iv_i^{T}\ \text{with each }\operatorname{rank}(u_iv_i^{T})=1,\ \text{and }k<r\ \text{is impossible since }\operatorname{rank}(A)\le\sum_i\operatorname{rank}(B_i)=k

Need to solve a different problem like this? Open the solver →