I stumbled across two very interesting books this summer (both available for free online):
David MacKay, Information Theory, Inference and Learning Algorithms (available here)
James P. Sethna, Entropy, Order Parameters and Complexity (here)
They remind me of the program that Graham postulated in How To Do Philosophy: start with the useful and crank up the generality. For what [...]