Abstract

The Minimum Description Length principle is the modernformalisation of Occam's razor. It has been extensively and successfullyused in machine learning, especially for noisy and long sources ofdata. However, the MDL principle presents some paradoxes andinconveniences. After discussing all these, we address two of the mostrelevant: lack of explanation and lack of creativity. We present newalternatives to address these problems. The first one, intensionalcomplexity, avoids extensional parts in a description, so distributingcompression ratio in a more even way than the MDL principle. The secondone, information gain, forces that the hypothesis is informative wrt. the evidence, so giving a formaldefinition of what is to discover.