LOG_BASE

public static double LOG_BASE

Method Detail

calculateEntropy

public static double calculateEntropy(double[] dataVector)

Calculates the univariate entropy H(X) from a vector.
Uses histograms to estimate the probability distributions, and thus the entropy.
The entropy is bounded 0 ≤ H(X) ≤ log |X|, where log |X| is the log of the number
of states in the random variable X.

Parameters:

dataVector - Input vector (X). It is discretised to the floor of each value before calculation.

calculateJointEntropy

Calculates the joint entropy H(X,Y) from two vectors.
The order of the input vectors is irrelevant.
Uses histograms to estimate the probability distributions, and thus the entropy.
The joint entropy is bounded 0 ≤ H(X,Y) ≤ log |XY|, where log |XY| is the log of
the number of states in the joint random variable XY.

Parameters:

firstVector - Input vector. It is discretised to the floor of each value before calculation.

secondVector - Input vector. It is discretised to the floor of each value before calculation.