Markov Decision Processes with Their Applications