This paper employs concepts from information theory to choosing the dimension of a data set. We propose a relative information measure connected to Kullback-Leibler numbers. By ordering the series of the data set according to the measure, we are able to obtain a subset of a data set that is most...

This paper employs concepts from information to choosing the dimension of a data set. We calculate relative measures of information in the data in terms of eigenvalues and derive criteria to determine the ‘optimal’ size of the data set, in particular whether an extra variable adds...