mutual information called the excess entropy---an information theoretic measure of memory---serves to detect ordered, low … entropy density patterns. It is superior in many respects to other functions used to probe the structure of a configuration …

Entropy as a measure of complexity in the systems has been applied for ranking the words in the human written texts. We … features for word ranking in the text. This work recommend the entropy as a systematic measure in text mining. …

This study introduces the constrained forms of the Shannon information entropy and Kullback–Leibler cross-entropy … outcome or state relative to its local maximum entropy (or minimum cross-entropy) position, independently of the other states … of the system. The Shannon entropy and Kullback–Leibler cross-entropy functions do not possess this functionality. The …

in two sites and for the half-filled band on a one-dimensional lattice. We show that the form of the entropy depends on …