BTW, if you have examples that you've shared in public repositories, please let me know. I love seeing what you are doing.

These are new features:

OpenCL based Convolution: on tiny images 32x32x3 or 28x28x1, you won't get much improvement against the well made AVX code. But you'll find impressive improvement on large input volumes. OpenCL can be enabled by calling:

As pascal is easy to teach and learn (in my opinion), pascal might be perfect for teaching/learning neural networks.

Actually, that has been the case since a very long time, in the early 80's it was pretty much the standard. That's the way I learned some of the basics and taught some of the basics at university back in the 80's.(Basically I learned it, wrote examples and taught it - almost - in the same week, writing the curriculum on the go... <hmm..> )We used it in teaching for problems like Traveling Salesman and Knapsack. Lot's of fun. I must still have some line printed code from those days...The green/white line stuff with holes on both sides.Let's see if I can put it into your way more advanced software form... Great job.