A pdf of paper comparing Classifiers using Gambling Strategies - A Markov Decision Process. This may be another rediscovery of reinforcement learning.
The key result needs rigorous testing both empirically in Machine Learning and via a well trained Probabilist.