Hi,
Thank you for a great and helpfull forum.
I would like to calculate the RMSEs in order to compare two models, however I am a bit unsure whether I have to do it manually or I can use the dynare_sensitivity function.
I do a recursive forecasting procedure in the estimation with nobs and forecast=, and I find the forecast mean for each variable in the folder oo_RecursiveForecast.Mean.
If I calculate the RMSEs manually, do I then have to calculate the RMSE for each variable and horizon (1 step ahead, 2 step ahead, etc) according to the following formula:
RMSE_x^h = (1/T*sum((x_actual_t - x_forecast^h_t)^2))^(1/2) ?
where h is the horizon for the forecast, x_actual is the actual observed data, x_forecast^h_t is the forecasted value, T is the recursive forecast period.
I have tried to use the function dynare_sensitivity to calculate the RMSEs with the following code:
dynare_sensitivity(datafile=data_mean_div100, ppost=1, first_obs=1, nobs=[85:87], rmse=1);
However, it gives me the following error:
"Error using : (line 38)
dates::colon: In an expression like A:B, A and B must be dates objects!
Error in makedataset (line 252)
DynareDataset = DynareDataset(FIRSTOBS:lastobs);
Error in dynare_estimation_init (line 538)
[dataset_, dataset_info, newdatainterfaceflag] = makedataset(options_,
options_.dsge_var*options_.dsge_varlag, gsa_flag);
Error in dynare_sensitivity (line 124)
[dataset_,dataset_info,xparam1,hh, M_, options_, oo_,
estim_params_,bayestopt_]=dynare_estimation_init(M_.endo_names,fname_,1, M_,
options_, oo_, estim_params_, bayestopt_);
Error in Gali_estimation_2_baseline2 (line 403)
dynare_sensitivity(options_gsa);
Error in dynare (line 223)
evalin(‘base’,fname) ;
"
I have searched the forum without finding concrete help, so I hope someone have the time to answer my question.
I have attached my code and data (I have set a small number of MH-draws and nobs so it won’t take too long to calculate, while I am still unsure of the procedure).
Code data.zip (6.9 KB)
Thanks,
// Anna