A critical assumption in the vast literature on inventory management has been that the current level of inventory is known to the decision maker. Some of the most celebrated results such as the optimality of base-stock policies have been obtained under this assumption. Yet it is often the case...