Lossless compression frequently involves some form of entropy
encoding and are based in information theoretic techniques, Shannon is
father of information theory and we briefly summarise information theory below
before looking at specific entropy encoding methods.