a b s t r a c tUsing a concept of random fuzzy variables in credibility theory, we formulate a credibilistic model for unichain Markov decision processes under average criteria. And a credibilistically optimal policy is defined and obtained by solving the corresponding nonlinear mathematical programming. Also we give a computational example to illustrate the effectiveness of our new model.