This book provides a self-contained and systematic treatment of stochastic processes and their applications. Having a ba- sic knowledge of mathematics at an undergraduate level, the reader can easily understand stochastic processes with dis- crete state space such as Poisson processes, renewal...