Stochastic processes serve as mathematical tools for precisely describing how sequences of random events interact and evolve over time. The sheet Sheet(pdf) covers some key elements in Markov chains operating in both discrete and continuous time, Poisson processes, and renewal theory.