Compiling NNET examle about mshadow

[siemanko]

ok adding:

template class NNet<cpu>;
template class NNet<gpu>;

Under the definition of NNet class in nnet_ps resolves this issue for me. I think my compiler is not very happy with instantiation of nested templated classes...

Also when I run the code on 4 cpus I barely get any speedup (only about 30% faster than single CPU) - is that expected here? I know that Hogwild code normally scales linearly, but this is not hogwild is it?

Thank you,
Szymon

[tqchen]

Yes, I think it is normal. This was mainly because the synchronization cost and it is not pure hogwild. When you are running multiple GPUs, you could not freely write to a shared memory region. The demo is mainly for demonstration purpose of mshadow-ps

You will find great speedup for larger problems and real neuralnet that you work on in cxxnet