Markov Process

On Markov processes for shocks, see [Simulating DSGE with Markov switching process). As you seem to be referring to a Markov regime-switching model, they are not yet supported in Dynare.