Adversarial Intelligence

Welcome to my research blog.

This page collects assorted insights that I stumbled upon in my daily research and found worth sharing. I plan to post on topics ranging from elegant, curious or useful mathematical identities to interesting techniques in online learning. There is no set schedule; I only post when I have something to say. Subscribe to learn when that happens.

2018-06-11A Dynamical System view of some Exponential Update
We consider a natural mapping from the simplex to itself, similar to but different from the well-known exponential weights scheme. We investigate the limit behaviour when iterating this mapping.

2017-01-21The Advantage of Full AdaGrad
AdaGrad, an adaptive version of Online Gradient Descent, is often used in its diagonal version. In this post we take a look at the full matrix version to understand the benefit of its additional adaptive power.

2016-11-10Matrix iProd and Matrix Squint
We look at extending two recent adaptive online learning strategies, iProd and Squint, to the matrix Hedge setting. The extension is straightforward up to a point, but we end with a nice open problem.

2015-05-13Unknown Games
We investigate what happens to simple matrix games and their solutions if we either randomly or strategically choose between two games.

2015-03-29Convex Duality Illustrated
Convex duality is an important tool in machine learning. Here I present an insightful arrangement of the graphs of a convex function, its dual and their derivatives.