Linear systems with M-matrices often occur in a wide variety of areas including scientific computing, operations research, stochastic analysis and economics. In this paper, we use a new preconditioner for solving such a kind of system by the preconditioned conjugate gradient (PCG) method. We show that our preconditioner can obtain a fast convergence rate. A numerical example is also given.