Online grocers accept delivery bookings and have to deliver groceries to consumers' residences. Grocery stores operate on very thin margins. Therefore, a critical question that an online grocery store needs to address is the cost of home delivery operations. In this paper, we develop a Markov...