He's talking from a mathematical perspective, not a compute graphics one.

(Unit) quaternions happens to work as rotations in 3D space. But quaternions' algebraic structure is indeed 4D, just like imaginary numbers' is 2D.