This course is the second part of a series of operations research courses. The first part was about deterministic models in operations research. Topics of this course include Markov Chains, Queuing models including exponential models, Simulating real life problems that involve stochastic behavior.