Appendix A: power of a sub-stochastic matrix