“…Markov chains have been used for infrastructure deterioration predictions of bridges (Fu and Debraj, 2008;Ranjith et al, 2011), roads (Abaza and Ashur, 1999;Hudson et al, 1998;Lethanh and Adey, 2012;Li, 1997;Li and Haas, 1998;Madanat et al, 1995;Ortiz-Garcia et al, 2006;Panthi, 2009;Tack and Chou, 2002;Wang et al, 1994), waste water (Hyeon-shik et al, 2006), rail (Ferreira and Murray, 1997;Shafahi and Hakhamaneshi, 2009) and pipelines (Sinha and Mark, 2004). …”