Search

Information Theory

So I was recently reading about Kullback-Leibler divergence in the hopes of finding something to help me with the problem I'm working on (I have a feeling my next presentation will need the subtitle "My descent into statistics") when I found a passage on wikipedia that resonated quite well with me (appropriate links mostly added by me):