Markov Chains:Analytic and Monte Carlo Computations