Is capacity utilization non-stationary?

Yes, the Lagrange multipliers also have trends. Take the Lagrange multiplier on the budget constraint. It is equal to marginal utility of wealth. With CRRA you have

lambda=c^(-sigma)

Consumption will grow with the rate of output along the BGP. The Lagrange multiplier therefore grows with the rate of output raised to the power of -sigma.