We consider forward rate rate models of HJM type, as well as more general infinite dimensional SDEs, where the volatility/diffusion term is stochastic in the sense of being driven by a separate hidden Markov process. Within this framework we use the previously developed Hilbert space realization...