Any chance we could see a CUDA implementation of Dynare in the future? Or has anybody done this to run in Matlab already? I am looking to do this myself if I had to, just wanted to save myself the trouble if it had been done by someone already or might be implemented soon.
Thanks
ldx00
Hi,
As far as I know, Dynare has no support for CUDA. This would require MATLAB itself to take advantage of it, and we don’t have any control over MATLAB development.
However there is a prototype of parallelization of Dynare codes, developped by Marco Ratto. See dynare.org/DynareWiki/ParallelDynare
Note that this works only with the snapshot, not with version 4.0.
Best,
Sébastien,
Thanks for the reply. It is true that this would require Matlab to run, at least the way I describe it. I am going to try compiling the C++ binaries already available, to run on the GPU through Matlab. I can produce a walkthrough if you want (assuming I get it working and it does genuinely provide a speed boost). The steps should not be too different with different versions of Matlab or CUDA. At the moment, things are taking far too long to process, even on a quad core (I’m trying to do Metropolis-Hastings iterations).
Thanks
ldx00
Hi,
What do you mean by recompiling C++ binaries? Actually, to take advantage of CUDA, my understanding is that it is not only a matter of recompiling: you first need to identify the pieces of code which can take advantage of parallelization, and then modify the C++ source code by introducing calls to the CUDA primitives at those places.
So this is not a straightforward task, and furthermore there are at this time not many places in the C++ code where you can take advantage of parallelization (the only relevant places at this time are the two kronecker product DLLs, where we have already tried some parallelization optimizations using OMP).
In the future we hope to provide the full estimation chain in C++: this will be the right place to introduce parallel optimizations, especially in the metropolis hastings.
Best,