This paper discusses the problem of estimating aspiration or reference levels in criteria space from choices between alternatives characterized by multiple criteria. Several methods for such estimations are developed and compared, taking into account both solution quality and computational...