This paper proposes a novel methodology, based on the Common Principal Component analysis, allowing one to estimate the factors driving the term structure of interest rates, in the presence of time-varying covariance structure.