information theory formula. shannon entropy.

abstract average background base class communication concept data definition design education elements entropy equation event formula gain graphic icon information isolated length logarithm math mathematics maths number probability random science shannon sign sum symbol theory values variable vector white formula entropy scientific background