This set of slides goes over the recent article that tries to tie together the idea of predictive coding and deep learning. The main point of the article is that a generative system trained on sequential data to predict the future samples learns more “useful” representation than the usual autoencoder. The result resonates with the fact that our brain is probably using predictive mechanisms.

Post navigation

I have worked on various projects in machine learning and computer science, neuroscience and brain-computer interfaces, reinforcement learning and robotics. Currently I am focusing on two things: leading machine learning team at OffWorld Inc. to train robots for space exploration, and finishing my PhD in neuroscience and artificial intelligence at University of Tartu.