Truth from Trash

How Learning Makes Sense

This study of learning in autonomous agents offers a bracing intellectual adventure. Chris Thornton makes the compelling claim that learning is not a passive discovery operation but an active process involving creativity on the part of the learner. Although theorists of machine learning tell us that all learning methods contribute some form of bias and thus involve a degree of creativity, Thornton carries the idea much further. He describes an incremental process, recursive relational learning, in which the results of one learning step serve as the basis for the next. Very high-level recodings are then substantially the creative artifacts of the learner's own processing. Lower-level recodings are more "objective" in that their properties are more severely constrained by the source data. Thornton sees consciousness as a process at the outer fringe of relational learning, just prior to the onset of creativity. According to this view, we cannot assume consciousness to be an exclusively human phenomenon, but rather the expected feature of any cognitive mechanism able to engage in extended flights of relational learning.

Thornton presents key background material in an entertaining manner, using extensive mental imagery and a minimum of mathematics. Anecdotes and dialogue add to the text's informality.

Table of Contents

  1. Preface
  2. 1. The Machine That Could Learn Anything
  3. 2. Consider Thy Neighbor
  4. 3. Kepler on Mars
  5. 4. The Information Chicane
  6. 5. Fence-and-Fill Learning
  7. 6. Turing and the Submarines
  8. 7. The Relational Gulf
  9. 8. The Supercharged Learner
  10. 9. David Hume and the Crash of '87
  11. 10. Phases of Compression
  12. 11. Protorepresentational Learning
  13. 12. The Creativity Continuum
  14. References
  15. Index