We consider eight problems in which we maximize or minimize threshold probabilities in discounted Markov decision processes with bounded reward set. We show that such problems are classified to two equivalence classes and give a relationship between optimal values and optimal policies of...

In this article, the theoretical aspects of union-soft sets by extending the notions of equivalence relations, partition, composition of relations, and function to the framework of union-soft sets are introduced. Further the Cartesian product, the relation between union-soft sets, induced...

This research examines state clustering in Markov Decision processes, specifically addressing the problem referred to as Markov Decision process with restricted observations. The general problem is a special case of a Partially Observable Markov Decision process where the state space is...

In this thesis, three procurement policies (Backup Policy, Blend Policy, and Partial Order Policy) are considered and evaluated using a Discrete Time Markov Decision Process. The following factors were analyzed: retailer's demand distribution, holding cost, purchasing cost and supplier's...

Telecommunications providers' market share risks stem from uncertainties due to overall market performance and competition strategies adopted by providers. In this paper, a framework that allows risk-adjusted forecasting of a provider's market share is presented. Two different stochastic...

The intensive care unit (ICU) is one of the most crucial and expensive resources in a health care system. While high fixed costs usually lead to tight capacities, shortages have severe consequences. Thus, various challenging issues exist: When should an ICU admit or reject arriving patients in...