*237*
*89*
*7MB*

*English*
*Pages 307
[320]*
*Year 1991*

LOGIC AND INFORMATION

LOGIC AND INFORMATION

Keith Devlin Carter Professor of Mathematics, Colby College, Maine

111 Cambridge UNIVERSITY PRESS

Published by the Press Syndicate of The University of Cambridge The Pitt Building, Trumpington Street, Cambridge CB2 1RP 40 West 20th Street, New York, NY 10011-4211, USA 10 Stamford Road, Oakleigh, Victoria 3166, Australia © Cambridge University Press 1991 First published 1991 Reprinted 1992 Printed in the United States of America A catalogue record for this book is available from the British Library

Library o f Congress Cataloguing in Publication Data Devlin, Keith J. Logic and Information/ Keith Devlin p. cm. "August 1990" Includes bibliographical references and index. Contents: v. 1. Situation theory ISBN 0-521-41030-4 (v.l) 1. Information theory - Mathematics. 2. Logic. 3. Situation (Philosophy) I. Title. 003\54-dc20 91-27183 CIP ISBN 0-521-41030-4 hardback

for Jon, who made it happen

CONTENTS

Acknowledgements Preface 1 Information 2 Information, Situations, and Infons 3 Situation Theory 4 Meaning and Constraints 5 Some Logical Issues 6 Mental States 7 Perception and Action Situation Semantics 8 Topics in Situation Semantics 9 Retrospect and Prospect 10

vii ix 1 14 49 86 111 145 187 216 252 295

References

302

Index

304

Index o f symbols

308

It is therefore quite possible that we are not too far from the limits which can be achieved in artificial automata without really fundamental insights into a theory of information, although one should be very careful with such statements because they can sound awfully silly in five years. — John von Neumann, 1949

ACKNOWLEDGEMENTS

Amongst those whose conversations and suggestions proved invaluable in the preparation of this book are Jon Barwise, Mark Crimmins, John Etchemendy, Pat Hayes, David Israel, John Perry, Stanley Peters, and other members of the STASS Research Group at CSLI, Stanford Univer sity. David Tranah, my editor at Cambridge University Press, was always very supportive, and it was he who persuaded me that I should abandon the strictly ‘textbook’ style I had originally adopted, in order to make the book accessible to the much wider audience he felt would be interested in the issues I raise. Particular thanks go to Jon Barwise. Though I began to work on the material presented here in 1985, the initial development was severely hampered by the traumas resulting from the rapid contraction forced upon the British university system by the government. Trying to feel one’s way forward into uncharted territories at a time when all pressures were towards the pursuit of ‘useful research’ (measured in terms of how many bucks will it earn by the weekend) was not easy. There was considerable pressure to abandon work regarded as ‘unproductive’ (read ‘$’). ‘Pure’ research was looked upon with disdain as a luxury bought at others’ expense. In my own case, my then university, Lancaster, blocked any further career advancement for me there and advised (and subsequently pressured) me to seek my future elsewhere. All in all, it was not a happy time and, without Barwise’s invitation for me to spend the period 1987-9 at CSLI, it is unlikely that this book would ever have been written. The final version of the book was completed after I had taken up the position of Carter Professor of Mathematics at Colby College in Maine, and I am particularly indebted to President Bill Cotter and Dean of Faculty Bob McArthur, who facilitated the continuation of my research after I left Stanford.

viii

Acknowledgements

Most of all, I owe an immense debt to my wife, Jan, and daughters, Naomi and Melissa, who twice suffered the trauma of being uprooted from their home and friends, first in England and then in California, as I sought to find a means by which I could pursue my work. Should it ever come about (and I think it will) that some of the ideas developed in these pages turn out to be of real ‘use’, I would hope that this book serves as a testament to the stupidity, even in those very terms o f ‘usefulness’ that were foisted on the British university system, of judging any intellectual pursuit in terms of its immediate cash value. Keith Devlin Waterville, Maine January 1991

PREFACE

Towards a mathematics of information In Mathematics, as anywhere today, it is becoming more difficult to tell the truth ........ Telling the truth is not quite the same thing as reciting a rosary o f facts. Jose Ortega y Gasset, in an admirable lesson summarised by Antonio Machado’s three-line poem, prophetically warned us that

the reason people so often lie is that they lack imagination: they don't realize that the truth, too, is a matter of invention. Sometime, in a future that is knocking at our door, we shall have to retrain ourselves or our children to properly tell the truth. The exercise will be particularly painful in mathematics. The enrapturing discoveries o f our field systematically conceal, like footprints erased in the sand, the analogical train of thought that is the authentic life o f mathematics. Shocking as it may be to a conservative logician, the day will come when currently vague concepts such as motivation and purpose will be made formal and accepted as constituents of a revamped logic, where they will at last be allotted the equal status they deserve, side-by-side with axioms and theorems.

The above two paragraphs were not written by me, but by GianCarlo Rota.1 The words were penned on 7 February 1985, as part of the preface to the book Discrete Thoughts [11], a collection of articles on mathematics and computing assembled by Rota together with Jacob Schwartz and Mark Kac. Rota’s words provide a particularly apt opening to this book. And, it is to be hoped, add weight to what I believe to be the importance to the future of mathematics, of enterprises such as the one presented in this volume. Without a continued supply of new areas of application, mathematics would start to grow inwards, and eventually die. But fleshing 1 Professor o f Applied Mathematics and Philosophy at the Massachussetts Institute of Technology, Fellow o f the Los Alamos National Laboratory, the editor of the journal Advances in Mathematics, and a member o f the United States National Academy o f Sciences.

X

Preface

out and developing new mathematical tools is no easy matter, and the fumbling beginnings are all too easily dismissed as futile. The eloquent words of Professor Rota can remind us all, both the outside sceptics and the committed researchers (who also, let it be said, experience periodic doubts about the outcome of their work), that it is only by dreaming, and then striving to turn those dreams into reality, that mankind progresses. None of which is to say that we can get it right first time. The theory outlined in these pages marks an attempt to develop some new mathe matics, a mathematics of information, but only time will tell whether or not this is the ‘right’ way to do the job. It is always difficult to stride out into something new. Rota has something to say about this as well. In Chapter 1 of the same volume, he begins: O f some fields it is difficult to tell whether they are sound or phony. Perhaps they are both. Perhaps the decision depends on the circumstances, and it changes with time. At any rate, it is not an objective fact like ‘the moon is made of green cheese’. Some subjects start out with impeccable credentials, catastrophe theory, for instance, and then turn out to resemble a three-dollar bill. Others, like dynamic programming, have to overcome a questionable background before they are reluctantly recognized to be substantial and useful. It’s a tough world, even for the judgement pronouncers.

What then, of the ideas set out (in a fumbling, embryonic form) in this essay? Where do they lie in Rota’s spectrum: sound or phony? Obviously, it is my belief that the ideas are (or rather will evolve to be) both sound and (profoundly) useful. But I cannot claim to know this for a fact. The territory is uncharted, with only a handful of travellers making those first few tentative steps. But then, is that not the very nature of true research? One further quote, this time from the great English mathematician J. E. Littlewood [6, p. 144): Most o f the best work starts out in a hopeless muddle and floundering, sustained on the ‘smell’ that something is there. ... In a new subject (or new to oneself) there can be a long preliminary process o f getting to the essential core. At this process a first-rate mathematician is little, if at all, better than a PhD student. ... With a collection o f really difficult problems, nothing happens in a year; much happens in ten years.

After reading this essay, the reader may judge for herself2 how far we

2 At the present time, there is always the vexing issue of how to represent the third-person singular in a gender-neutral way. In this book I take the approach of using both ‘he’ and ‘she’ interchangably in a more or less random manner.

Preface

xi

have progressed towards the goal outlined in Chapter 1. And how much further we have still to go. What this book is not

This book is perhaps a little out of the ordinary — certainly for a book written by a mathematician, intended to be a ‘mathematics book’. (Where are the pages of symbolic expressions?) If you have picked up the book and got this far, you will, I hope, be sufficiently intrigued to proceed further. What are you likely to find? Just what nature of book do you have in your hands? The best way to answer that is to sit down and read it. But here, for the impatient, it a brief guide to what the book is not, and what it is. This book is not intended to be a work of scholarship. That is, I did not set out to examine other work in this general area, or to compare the theory developed here with any other theories. Others are free to do that if they wish. That was not my intention. This book is not a ‘philosophy text’. True enough, a lot of the topics dealt with are regular fayre on the philosopher’s table, and I pay considerable attention to many philosophical issues. But as an attempt to develop a tolerably useful piece of mathematics, the treatment of many deep philosophical issues is of necessity a ‘naive’ one. This book is not a ‘linguistics text’. Despite the large amount of space dedicated to natural language semantics, my interest in natural lan guage is its great power, versatility, and robustness as a vehicle for conveying information. As with the philosophy, so too is the linguistics you will find here essentially ‘naive’. This book is not a ‘computer science text’. Though the issues dealt with are all central to computer science (especially the information processing side of the subject), and though I utilize a number of concepts from computer science and occasionally use computer science examples to illustrate various points, no attention is paid to questions of implementation or computational tractibility. This book does not pretend to present a completed body of work. It is very much an account of work in progress, work that has a long way to go until its (hoped for) completion. What this book is

So now you know what this book is not. What then, is it?

Xl l

Preface

It is a mathematics book, or at least a ‘pre-mathematics’ book that covers issues of crucial importance to philosophers, linguists, computer scientists, and cognitive scientists. Accordingly, it has been written in a fashion that, I hope, makes it accessible to workers in all of these areas, and possibly other fields as well. It is applied mathematics. More precisely the book describes an instance of the important (applied) mathematical activity of modeling. It is a ‘research monograph’ in the spirit of mathematical research. That is to say, the goal is the development of a mathematical theory, a piece of mathematics. And very much in the spirit of present-day mathematical research, little (in fact no) attempt has been made to turn it into a work of scholarship. The overall goal is to provide the mathematics required for a science of information. I start the process of fleshing out a mathematical framework that will (I hope) form the backbone of such a science in the same way that parts of present-day mathematics support, say, physics. It is a challenge. By sending this volume out into the world at this early stage in the development, I hope that others will be able to progress still further.

1 Information

1.1

What is information?

Imagine yourself suddenly transported back in time to (say) the Iron Age. You meet a local ironsmith and you ask him “ What is iron?” What kind of answer are you likely to get? Very likely your craftsman would point to various artifacts he has made and inform you that each of those was iron. But this is not what you want. What you want to know is just what it is that makes iron iron (and not some other substance that may or may not look quite like iron). What then does your Iron Age man do in response to your persistent questioning? He is an acknowledged expert on ironship, his products sell well, and he knows a good piece of iron when he sees it. And yet he is unable to supply you with the kind of answer you are seeking. Indeed, he has no frame o f reference within which to even begin to understand what it is you are asking! To give the kind of answer that would satisfy you, he would need to know all about the molecular structure of matter — for that surely is the only way to give a precise definition of iron. (Or maybe there are other ways, ways that require theories we ourselves are not aware of? This possibility merely strengthens the point I am trying to make.) But not only is your man not familiar with molecular theory, he probably does not even conceive o f the possibility o f such a theory! To anyone trying to understand the nature of information in today’s Information Age, the situation must surely seem not unlike that'facing your Iron Age man. That there is such a thing as information cannot be disputed, can it? After all, our very lives depend upon it, upon its gathering, storage, manipulation, transmission, security, and so on. Huge amounts of money change hands in exchange for information. People talk about it all the time. Lives are lost in its pursuit. Vast commercial empires are created in order to manufacture equipment to handle it. Surely then it is there. But what exactly is it? The difficulty in trying to find an answer to this question lies in the absence of an agreed, underlying

2

1 Information

theory upon which to base an acceptable definition. Like the Iron Age man and his stock in trade, Information Age Man can recognize and manipulate ‘information’, but is unable to give a precise definition as to what exactly it is that is being recognized and manipulated. Perhaps information should be regarded as (or maybe is) a basic prop erty of the universe, alongside matter and energy (and being ultimately interconvertible with them). In such a theory (or suggestion for a theory, to be more precise), information would be an intrinsic measure of the structure and order in parts or all of the universe, being closely related to entropy (and in some sense its inverse). This approach would, of course, fit in quite well with the classic work of Shannon [29] on amounts of information. Or perhaps you can suggest a better theory. In any event, this kind of speculation does not directly affect the discussion in this essay. What I am concerned about here is not so much the nature of information per se, but rather information processing and the manner in which information flows from one agent (or situation — see presently) to another, with a particular interest in the role language and ‘logic’ play in this. For this aim there is no need to pin ourselves down in advance as to the exact nature of information itself — just as it is possible to develop and study the differential calculus without having an exact conceptualization of a real number. (Indeed, historically the development of the differential calculus preceded (by some two centuries) the evolution of a rigorous theory of the real numbers, and if we pursue this analogy between a study of information flow and the development of the calculus just a little further, we might speculate that investigations such as the present one could eventually lead to an all-embracing theory of the nature of information.) So the aim here is not to answer the question ‘What is information?’ but rather to investigate the nature of information flow and the mechanisms that give rise to such flow; in short, to develop a science of information. The approach I shall take is in many ways a completely traditional one: namely to start with an empirical study of the phenomenon, develop a mathematical framework that seems appropriate for such a study, and then use that framework in order to construct a theoretical account that can carry the empirical study further. The question is: just what kind of mathematical framework do we adopt in order to study information? Do we take some existing mathe matical theory ‘off the peg’, make a few minor alterations, and then use that, or do we have to go back to basics and develop some completely

1.2 A mathematical theory o f information

3

new mathematics? The sensible approach is to start off with what is already available, and see if that measures up to the requirements of the task at hand. If it does not, try to see why not, and proceed from there. Maybe we will be able to get by with a few minor alterations; or perhaps more substantial changes are required; or failing that we may be forced to develop some quite new mathematics, building on the insights we gain from investigating the failure of existing mathematics. In this essay I start with the mathematical framework most commonly used both to study information (in the sense of the ‘meaning’ of the information, not the information-bearing signal that formed the object of the well-known Shannon study [29]) and to design artificial systems to process information; namely mathematical logic. 1.2

A mathematical theory of information

As outlined above, the aim of this book is to develop a ‘mathematical theory of information’. Another way to describe it would be as the development of a ‘mathematical model of information flow’. But what exactly do I mean by these expressions? In general by a mathematical theory, is meant a scientific treatment of certain real-world phenomena, carried out within the framework of mathematics, using (and developing, when required) mathematical tech niques. Examples of such theories are fluid mechanics, signal processing theory, many parts of theoretical chemistry, and most branches of what is generally known as theoretical physics. By and large, I conceive of the present study as falling into this category. Thus, in particular, I regard the study of information flow as very largely a rationalist (i.e. ‘scientific’), empirical investigation, albeit one where the nature of the subject provides a less firm observational and experimental base upon which to build than is the case in the other disciplines just mentioned. (Though work in linguistics, psychology, computer science, robotics, and artificial intelligence can, and does, provide data on which to base and judge our progress.) It should be noted that this approach is quite counter to that hitherto adopted by most mathematicians in attempting to tackle the fundamental problems of information processing. By and large, the common approach has been to take the standard, formal development of mathematical logic — known variously as classical logic, predicate logic, or predicate calculus — and extend or modify it in various ways in order to cope with whatever issues are at hand. Thus various formal logics have been developed and

4

1 Information

studied: modal logic, temporal logic, relevance logic, deontic logic, non monotonic logic, infmitary logic, generalized-quantifier logic, and more. However, in almost every case, the development has been approached as a strictly mathematical enterprise, lying clearly within the existing pure mathematics paradigm. That is to say, the emphasis has been on the specification of a formal language, the writing down of axioms, and the proof of theorems. The result of such an approach has been, to my mind, some very interesting mathematics but, at best, only modest advancement in our ability to say much about information. My own view is that a completely different strategy is called for. Rather than starting with the formal mathematics and then trying to reach the target domain (i.e. the flow of information), we should begin by making an empirical study of information, and then attempt to for mulate an appropriate mathematical model of that phenomenon. Such an approach would, of course, make the enterprise far more like physics or chemistry or any of the other natural sciences, rather that traditional mathematics. In particular, the familiar, comforting, absolute certainty of formal mathematical proof will be replaced by the more general kinds of scientific reasoning characteristic of the natural sciences. To paraphrase the quotation from Rota given at the start of the preface to this book, such an approach might well be “shocking to a conservative logician,” but I think it is absolutely unavoidable if we are to make any significant progress in the development of a mathematical theory of information (in the ‘meaning’ sense I indicated earlier). In the concluding remarks of his address to the American Mathematical Society Meeting in San Fransisco, California, in January 1991, the mathematician and physicist Sir Michael Atiyah emphasized, in reference to some startling recent work in geometry by Donaldson, Witten, and others, that it had been a historical mistake to completely separate the study of geometry from that of the physics of space, and that the deep insights that can lead to totally new developments in geometry can only come when geometry is thought of as the geometry o f space, not just as ‘abstract geometry’. In my opinion, an analogous remark applies to logic: the development of a genuinely new ‘logic’, which is what this book sets out to achieve, can only come about if we approach it as the development of a mathematical theory (or a mathematically-based theory, if you prefer) of information (flow) as it occurs in the world around us. As with practically any new scientific discipline, an empirically-based study of information of the kind just outlined turns out to require both the application of existing mathematical techniques and the development

1.3 Logic ^ logic

5

(and subsequent application) of new mathematical tools, tailor-made for the task in hand. Now, as is generally the case, the development of the new tools required is best carried out in an abstract (‘pure mathematical’) setting, removed from the complexities of the real world phenomena under examination. (A classic example of this phase is Newton’s development of the differential calculus in order to provide a tool to deal with real world problems of mechanics and physics.) It is this process that is referred to as mathematical modeling. A precisely defined, abstract (and necessarily simplistic) ‘model’ of the world is set up in order to develop the mathematics in an unencumbered and rigorous fashion. Typically, such a development is carried out using abstract mathe matical ‘objects’ (pure sets, abstract surfaces, numbers, etc.), specified axiomatically, their properties being established by way of rigorously proved theorems. By an accident of history, this particular aspect of the mathematical enterprise has come to be identified with ‘mathematics’ by the vast majority of contemporary, practicing mathematicians. But of course, it is just that: an accident of history. An equally impor tant part of mathematics is the initial, largely empirical work that leads to the development of new mathematical models. Indeed, in the long term this is the essential life-blood that ensures the continuation of the entire mathematical enterprise. The age of global exploration required the development of a suitable mathematics (in particular, geometry and trigonometry) in order to build ships and navigate and chart the Earth; the development of mechanical engineering and then electrical engineer ing each required their own particular brands of mathematics (notably, the calculus), and so too did the more recent fields of electronics and communications engineering. The information age is no different. So this volume may not ‘look’ like a ‘mathematics book’ in the normal, present-day sense (though a planned sequel volume will), but that is purely a reflection of the early stage of the enterprise. In the sense explained above, it does constitute the beginnings of what is meant by the phrase a mathematical theory. Time then to get down to business. As already mentioned, the starting point is the branch of mathematics known as logic. 1.3

Logic f 2 logic

The rapid growth of computer technology over the past three decades or so has brought to the forefront of research an area of mathematics

6

1 Information

that had hitherto been regarded as on the very edge of the subject: logic. The apparent contradiction in the title of this section should indicate that there is more to this particular word than meets the eye. Indeed, the inequality may be taken as a dramatic illustration of what is called the ‘situatedness (or context dependency) of language’, a topic of considerable importance in this book. The two uses of the word ‘logic’ in the title have quite different semantic content, as the remainder of this book makes clear. All computers and computer languages depend, to a greater or lesser extent, on formal logic. Often this dependence is hidden, buried in either the internal circuitry of the machine or the design of the computer language being used. Occasionally the ‘logic’ is explicit, as occurs with the programming language Prolog (the name being an acronym for ‘programming with logic’). The present trend is a rapid one towards an even stronger linkage between computing and formal logic, with the evolution of so-called ‘formal methods’ — techniques for systematically developing and proving correct (for the intended application) computer programs and complex computer systems. Unfortunately, logic as it stands at present was not designed to han dle the demands made of it by the computer designer or the software engineer. Computers are used to process information. Current ‘logic’ was developed to deal with the concepts of truth and mathematical proof, and makes no attempt to cope with information. With the only available tool not equipped for the job at hand, it is scarcely to be wondered at that ambitious aims such as the search for artificial intelligence (AI) run into such horrendous difficulties. Genuinely intelligent systems such as Man do not operate using clas sical, formal logic; rather they rely upon far more sophisticated mecha nisms for processing information. (Indeed, it could be argued that such is the nature of the way Man operates that the very use of the phrase ‘processing information’, carrying with it the computing connotations it does, is not at all appropriate to describe human mental processes.) So if there is to be any significant advance in AI (or related areas), the key surely is to be found in an analysis both of the concept of ‘information’ and the manner in which intelligent organisms such as Man handle and respond to information picked up from their environment.1 What this 1 In this connection the reader might like to read the quote from von Neumann (the socalled ‘father o f the automatic computer’) given on page vi. Though as Joseph Goguen has remarked, in using the phrase theory o f information back in 1949, von Neumann is

1.4 What is logic?

1

amounts to (at least according to my present viewpoint) is the devel opment of a ‘logic’ that is far more general (and correspondingly more powerful) than that currently available. 1.4

What is logic?

But should the kind of theory asked for in the previous section be described as ‘logic’? According to the definition given in the Oxford English Dictionary it should. Logic, says this source, is the science o f reasoning, proof thinking, or inference. And this, I maintain, is precisely what the present enterprise is all about. Disagreement with this claim can only arise, I would think, from an over-exposure to the hitherto ruling doctrine that ‘logic’ is the study of the properties of certain kinds of formal systems, and in particular the properties of the ‘logical connectives’ and (A ), or (V ), not (->), implies (—► ) and the ‘quantifiers’ for all (V), there exists (3), when used in conjunction with various finitary predicates and a collection of individual variables. This was not always the case. The ‘logic’ developed by the Greeks, often referred to as Aristotelean logic after one of its more famous early pioneers, and an early precursor of present-day, ‘classical’ (i.e. first-order, predicate) logic, was very clearly intended to analyze rational argument, as becomes clear when we read Plato’s accounts of Socrates. Aristotle’s logic attempts to reduce all rational argument to basic deductive units called syllogisms, the paradigm example of such a unit being: All men are mortal Aristotle is a man Aristotle is mortal Though patently inadequate for the analysis of all rational argument (at least to present-day eyes), the study of the syllogism formed the core of logic for over a thousand years. Indeed, so entrenched did syllogistic logic become in academia that as late as the fourteenth century we find in the statutes of the University of Oxford the rule “Bachelors and Masters of Arts who do not follow Aristotle’s philosophy are subject to a fine of five shillings for each point of divergence, as well as for infractions of the rules of the Organon. (Traces of this kind of obstinate adherence to an inadequate and outmoded logical framework can be unlikely to have had in mind the kind o f (relatively) sophisticated semantic analysis of cognitive processes that is being attempted here.

8

1 Information

found in some present-day university philosophy departments, where inordinate amounts of time are sometimes spent studying formal systems of propositional logic. In this case I am only objecting to the devotion of excess time to this topic, not to the topic itself.) Logic took a step closer to mathematics with the work of George Boole in the 19th Century. The algebraic framework Boole developed in order to study the Aristotelean syllogism not only served to highlight the essential triviality of the syllogistic approach, it established logic as a branch of mathematics in the formal sense. Thus Boole’s own work was published (in 1847) under the title Mathematical Analysis o f Logic, and starting from Boole’s framework, the American mathematician Schroder developed the algebraic system known as ‘Boolean algebra’, a system now used extensively in various parts of mathematics and computer science. By the time of Frege, Cantor, Hilbert, Whitehead and Russell, not only was logic firmly embedded in mathematics, it was clear that the principal focus of the study was logic applied to mathematics. The analysis of mathematical truth and the notion of proof was the goal, with Hilbert’s program to reduce all of mathematics to formal logic one of the main driving forces. This thrust proved to be enormously successful. Coupled with Cantor’s set theory, the predicate logic introduced by Frege provides a rigorous mathematical framework for the formulation of large parts, if not all, of mathematics. (It is all a question of how far you are prepared to stretch matters, allowing ugly circumlocutions and the like.) Moreover, predicate logic can be precisely formulated and axiomatized, and is amenable to a detailed and precise development as a mathematical discipline. It provides a rigorous definition of the notion of mathematical proof (albeit a definition whose idealistic nature means that it is only in principle that any typical, everyday mathematical proof could be made to fit its rigid strictures). And it gives rise to a highly structured and elegant study of the formal semantics (i.e. meaning) of mathematical statements (Model Theory), leading to the famous Completeness and Incompleteness Theorems of Godel, the work of Tarski on truth, and Robinson’s solution to the centuries old problem concerning the nature of infinitesimals. In short, mathematical logic (as it came to be known) is one of the great success stories of modern mathematics. Faced with such credentials, few indeed would wish to rock the boat by pointing to deficiences in this particular approach to the ‘science of reasoning, proof, thinking, or inference’. But deficiences there are for all that. Leaving aside the question as to whether or not first-order logic is

1.4 What is logic?

9

really adequate for the formulation of every mathematical statement, it is clear to anyone who has ever studied first-order logic that there are fundamental problems at the most basic level, in connection with the way the logical connectives and, or, not, implies are defined in terms of truth values. For instance, the standard formal definition of logical implication (i.e. the material conditional) renders p ->■ q equivalent to -ipVg. Besides classifying the implication p —►q as being true in all cases where p is false, this approach also declares that statements such as 1 there is a prime number between n and 2n. are true. Whilst the truth of an implication p —►q in the case where p is false, though worrying to most people (this author included), can be argued away on the grounds that implications with false antecedents are of no real concern in mathematics (at least), a sentence such as d> is not so easily disposed of. Both the antecedent and the consequent are true in this case (the consequent, known as Bertrand's Conjecture, having been established by Chebychef in 1850). Consequently the standard definition renders the entire implication O true. But is this really what we want? Does anyone really believe that O expresses a genuine implication, relating the triviality 2 + 2 = 4 with a deep result of number theory? It should be obvious by now that the standard classical-logic ‘escape’ that d> is logically equivalent to its consequent will not suffice to evade the issue I am trying to flesh out here, namely the meaning of the implication itself. Does 0 in fact have any meaning (other than that it is ‘true’)? For another, quite different sort of deficiency with classical logic, take any piece of simple, everyday reasoning of the sort human beings perform automatically every day, such as the reasoning process involved in understanding the following sequence of actions: 1. Jon walked into the restaurant. 2. He saw that the waitress had dirty hands. 3. So Jon left immediately. Though you might feel that Jon’s behavior here was unnecessarily fussy, 1 doubt very much that you would regard it as at all illogical. Indeed, the ‘logical’ path that leads from the circumstances described by 1 and 2 to Jon’s action in 3 seems perfectly clear. In everyday, human terms, the passage from 1 and 2 to 3 is a sound, logical train. But it clearly transcends first-order logic. Unless, that is, you regard sentences 1, 2, and 3 as simply shorthand for a much longer chain of individual implications, involving various other matters, that leads from 1 and 2 to 3 via the usual rules of classical logic. That this can always be done

1 Information

IO

is not in dispute (at least by me). But this is not how ordinary people regularly perform such ‘deductions’, and by retreating hurriedly to the seeming comfort of classical logic in this manner, the real issue is simply being evaded. Most of this book will amount to an argument to support this viewpoint. There are then at least two sorts of major problem with classical logic: the first, which affects both mathematical and everyday uses of logic, arising from the total dependence upon truth as the basic, underlying notion; the second, perhaps not so significant as far as mathematics is concerned (though I am not so sure about even this) stemming from the inadequacy of classical logic to capture ordinary, everyday, ‘people logic’. Whatever else may be said either for or against classical logic, it certainly does not fulfill the demands put upon ‘logic’ by the dictionary definition of the word. Whereas this deficiency might not seem so important as far as mathe matical applications of logic are concerned, when first-order logic is used both to design and to operate information processing devices (and, for that matter, to analyze the use of ordinary language in human-to-human communication), it is hardly surprising that it proves woefully inadequate for the task. For purposes such as these, a ‘logic’ based on truth (such as classical logic) is not appropriate; what is required is a ‘logic’ based on information. It is the aim of this book to develop just such a ‘logic’. 1.5

The strategy

Here, briefly, is the approach I shall adopt in trying to develop an appropriate ‘logic’, a science o f reasoning, proof thinking, or inference as the dictionary would have it. Information, and more specifically the flow of information, is taken as the basic, underlying (though to some extent ‘undefined’) concept. Inference is an activity whereby certain facts (items of information) about the world are used in order to extract additional information (information that is in some sense implicit in those facts). A sound inference is one whose logical structure is such as to support the role of that inference as a link in an informational chain. Truth will be a secondary notion. Classical first-order logic will be a highly restrictive, special case of our theory. Notice that no mention was made of language in the above. This is quite different from the case of classical logic, in which language (i.e. first-order predicate language) plays a pre-eminent role. In terms of

1.5 The strategy

11

our new, dictionary-driven interpretation of the word ‘logic’, language is important, but by no means all-embracing. People make non-linguistic inferences every day. As you prepare to leave for work in the morning you notice the dark clouds in the sky and reach for your raincoat, having (correctly) inferred that (a) there is a strong possibility of rain, and (b) if you do not take your raincoat you may get wet. No use of language is involved in making these inferences (except subsequently, perhaps, should you have cause to reflect upon why you acted as you did). Indeed, similar kinds of inference are made routinely all the time by animals and organisms that do not have any linguistic capacities. It should be stressed that I am not claiming that people do not sometimes think in a linguistic fashion. But I do maintain that thought is not fundamentally linguistic, and I reject the necessity of positing some form of internal language (often referred to as Mentalese by adherents to that school) as an underpinning of mental activity. Two distinctive features of the present enterprise will be the concepts of an infon and of a situation. In due course I shall give a proper analysis of what is meant by these terms, but for the time being an ‘infon’ may be thought of as a discrete item of information and the word ‘situation’ may be understood in its normal, everyday sense, to refer to some part of the activity of the world, such as the situation that is taking place right here and now as I sit at my desk and enter these words at the keyboard. Or the situation that has you reading these same words. Or the larger and considerably more complex situation that comprises my writing these words, the internal circuitry converting each keystroke into an electrical impulse that is conveyed into the computer’s memory, together with all the other steps that are involved in the transmission of this text from me to you. In passing, notice that this last example is one that involves an explicit information flow — indeed, an information flow in which language plays a major role. As such it gives some indication as to how we may make use of situations in the study of such flow. But beware of reading too much into this remark. Though there is undoubtedly a flow of information involved, it is not at all clear just what information it is that is being conveyed — at least it is not obvious to me as I sit here writing. If the ‘logic’ of my argument is convincing, as I hope is the case, then the information conveyed to you will be the ideas about logic I am trying to put across. But the actual information you obtain may be quite different. After reading these words you may, for instance, conclude that I am confused or that what I am proposing is a hopeless dream. This

12

1 Information

information is, of course, not at all the same as that which I am striving to make explicit in my words. (Clearly, if it is to succeed in its stated aims, the theory of ‘logic’ I develop here should at the very least be capable of handling these various kinds of informational transfer. It will.) Information flow is made possible by certain (what will be called) constraints that link various types of situation. Constraints may be natural laws, conventions, analytic rules, linguistic rules, empirical, law like correspondences, or whatever. Their role in the information chain is quite well conveyed by the use of the word means. For instance, consider the statement smoke means fire. This expresses a constraint (of the natural law variety). What it says is that there is a lawlike relation that links situations where there is smoke to situations where there is fire. If S is the class of all situations where there is smoke present, and S' is the class of all situations where there is a fire, then an agent (e.g. a person) can pick up the information that there is a fire by observing that there is smoke and being aware of, or (to use a suggestive term to be defined later) attuned to, the constraint S => S’ that links the two kinds of situation. It should be noted that his use of the symbol => is not at all the same as its usage in classical logic, where it is sometimes used to denote the material conditional (i.e. truth-value implication) for which I use the symbol — Here the expression S => S' means that there is a systematic, informational link between situations in the class S and situations in the class S'. A more complete explanation of this notion will be given in due course. Note that the above example did not depend upon language. Indeed, that particular constraint is one that holds regardless of the presence or absence of any cognitive agent. For an example of a constraint that does involve language, consider the assertion F ire means fire.

(Here and throughout I use the linguist’s convention whereby capital letters indicate the word itself, rather than its meaning.) This assertion describes the constraint

S' => S' that links situations (of type S') where someone yells the word f ir e to situations (of type S') where there is a fire. Awareness of this constraint involves knowing the meaning of the word f ir e and being familiar with

1.5 The strategy

13

the rules that govern the use of language. Because these rules may be broken (a person might yell f ir e when there is no fire), this constraint is not as reliable as the one before. Misuse of constraints can result in the conveyance of misinformation. Logic, in our sense, is the study of such constraints. As such it may be regarded not as an alternative to classical, first-order, predicate logic, but as an extension of it, with first-order logic being the study of just those particular constraints established by the axioms of first-order logic. Just how far this extension can be taken within the framework of a mathematical study is an interesting question. One that can only be answered by making the attempt.

2 Information, Situations, and Infons

2.1

The nature of information

I start off with the assumption that there is such a thing in the world as information. Cognitive agents (people, various kinds of organism, certain mechanical or material devices — see later for a discussion of just what is meant by the term ‘cognitive agent’) generally make their way in the world by being able to pick up certain of that information and react accordingly. A human being, on seeing flames all around, will take flight, having extracted the information that there is a fire and being already in possession of the previously acquired information that fires are lifethreatening; a cat, on seeing a mouse, will pounce, knowing that there is fun to be had, if not food; a flower, on detecting the sun’s rays in the morning, will open; a thermostat, on sensing a drop in temperature, will switch on the heating; and so on. Already these few examples indicate one significant factor that we shall have to consider right at the outset: the fact that different agents are capable of extracting different information from the same source (situation). A person can pick up a great deal of information about the surrounding air — its cleanliness, the presence or absence of any smells, whether it is stationary or moving, whether it is warm or cool, how humid it is, and so on. A simple, mechanical thermostat on the other hand can only pick up one piece of information, though it is a piece of information that few humans are capable of picking up in all circumstances: namely the information whether the temperature is above or below the value set, say 21 °C. Just what kind of information may be picked up depends upon just what kind of device the agent is, and in particular upon the state of that agent vis a vis the extraction of information. For a richer example, consider Barwise’s tree stump as described in [1]. You come across a tree stump in the forest. What information can you pick up from your find? Well, if you are aware of the relationship between the number of rings in a tree trunk and the age of the tree, the

2.1 The nature o f information

15

stump can provide you with the age of the tree when it was felled. To someone able to recognize various kinds of bark, the stump can provide the information as to what type of tree it was, its probable height, shape, leaf pattern, and so on. To someone else it could yield information about the weather the night before, or the kinds of insects or animals that live in the vicinity; and so on. (As an exercise, you might like to think of, say, three further items of information the tree stump may be capable of providing.) What the above examples indicate above all is that the acquisition of information from a situation depends upon those constraints of which the agent is aware, or to which the agent is attuned. Constraints? Attunement? Proper definitions will be given in due course. In the meantime, the discussion of Section 1.5 will suffice to indicate what a constraint is, and attunement to a constraint may be understood as systematically acting in accordance with that constraint. Information is obtained from a situation by means of some constraint, and awareness of, or attunement to, that constraint is what enables the agent to acquire that information. Thus the simple thermostat is, by its construction, attuned to a certain physical relationship between temperature and the expansion rates of various metals, whilst the forest ranger is aware of the relationship between the number of rings in a tree trunk and the age of the tree. (But note that this is not to say that the thermostat is in any sense ‘aware’ of how and why it operates the way it does. Nor does the forest ranger need to have a deep knowledge of tree biology. ‘Attunement’

16

2 Information, Situations, and Infons

to, or behavior-guiding awareness of, a particular constraint may be an essentially empirical phenomenon.) The example of the tree stump also highlights another aspect of information acquisition: there is never just a single item of information to be obtained from a given situation. For one thing, different constraints will give rise to different (kinds of) information being picked up. And, besides that, there is the phenomenon of ‘nested’ information. (See Dretske [8, p.71].) Given the possession of prior information and/or attunement to other constraints, the acquisition by an agent of an item of information O can also provide the agent with an additional item of information ¥ . For instance, if I tell you that a certain geometric figure (hidden from your view) is a square, then you also gain the (different) information that the figure is a rectangle. (This is by virtue of the ‘analytic’ constraint that all squares are rectangles.) You also learn that the figure is a parallelogram, that all its internal angles are 90 degrees, that it is a planar figure, and so on. Each of these additional items of information is nested (by way of certain constraints) in the information that the figure is a square. Thus information, when it comes, tends to do so in large, structured amounts. The acquisition of certain specific items of information from the mass available is part of the process known as cognition. 2.2

Cognition

Information, as we usually encounter it, is not unlike a ‘bottomless pit’, seemingly capable of further and further penetration. To borrow a term from another fairly new area of mathematics, we might say that information has what appears to be a fractal nature.1 On the other hand, cognitive agents deal (at any one moment) with a relatively small collection of specific items of information extracted from that fractal-like environment. The acquisition of information from the environment by a cognitive agent is a process analogous to, though not necessarily the same as, going from the infinite and continuous to the finite and discrete. 1 Both o f these analogies have a potentially misleading aspect, in so far as they might suggest that information is capable o f endless refinement. Whether this is in fact the case — and for the record 1 myself think that it is not — is not an issue that needs to be decided for the present study. Rather the distinction to be drawn in this section is between information in the world, which to the agent has the appearance of further and further penetrability and/or refinability, and the discrete items of information that the agent acquires from that available mass in order to function in a cognitive manner.

2.2 Cognition

17

Dretske [8, pp. 135-141] has used the terms analog and digital coding to facilitate discussion of this process.2 Consider the most basic kind of informational item: the possession or otherwise by an object s of a property P. Such an item of information will be conveyed to an agent by means of some kind of signal. That signal is said to carry the information that the object s has the property P in digital form, if that signal carries no additional information about s other than that which is nested in s being P. Otherwise the signal is said to carry the information that s is P in analog form. Thus if I tell you that Jon is taller than Fred, that piece of information is conveyed to you in digital form. You learn nothing more about Jon and Fred other than that one single fact (plus anything nested therein, such as Jon’s being able to reach a higher shelf in the library than Fred, and so on). You do not, for instance, pick up the information that Jon has a beard and Fred does not. If, on the other hand, I show you a photograph of Jon and Fred standing side by side, that photograph will also convey to you the information th„t Jon is taller than Fred, but it does so in analog form. By looking at the photograph, you are able to pick up all kinds of information about these two characters, information more specific than the mere fact as to who is the taller. For instance, you learn something about the extent by which Jon is taller than Fred, something that my simple utterance does not convey to you. Information received in analog form is always capable of yielding more specific details. Information received in digital form is not capable of such refinement. (It should be noted that all of this is relative to the item of information concerned. The terms analog and digital are not ‘absolute’ as used here. The photograph conveys in analog form the information that Jon is taller than Fred, but it stores in digital form the information of what the photographer saw through the camera lens at the time the picture was taken.) Now, what Dretske is concerned with when he makes the analog/digital

2 It should be stressed that I am using the analogy with Dretske’s work here in order to motivate a particular approach to the development of a mathematical framework within which to study information. This is not Dretske’s intention. Rather he makes the analog-digital distinction in a formal way, within a theory of information, whereas I am taking it to guide the step from an intuitive, pre-theoretic notion to a formal, theory-defined notion. This point has also been observed by Seligman and Chater [28], Another difference between my motivation and Dretske’s, is that he is not attempting to give an ontological definition o f information in the way that our theory does — see presently — but rather is concerned with the flow and utilization o f information, accessed using Shannon’s ideas o f ‘surprisal value’.

18

2 Information, Situations, and Infons

distinction, is the representation of information, whereas in this essay I am taking information itself as the basic entity under consideration. More precisely, I am seeking a specific conceptualization of ‘information’ as a theoretical ‘commodity’ that we can work with, analogous to (say) the numbers that the number-theorist works with or the points, lines and planes the geometer works with. At the moment, all we have is a name: ‘information’. This name may mean something to us, but it is not a formally defined mathematical concept that can form the basis of a scientific study. I shall use Dretske’s ideas in order to obtain the kind of precisely defined conceptualization of information we need. We may regard the extraction of information from the environment by an agent as taking place in two separate stages, corresponding to the analog/digital distinction. The first stage is perception, where the information in the environment becomes directly accessible to the agent by way of some form of sensor (seeing, feeling, smelling, hearing, etc. in the case of a person or animal, or by the molecular agitation of the air impinging on the bimetallic strip in the case of a thermostat). At this stage the information flow is analog, relative to whatever information we are concerned with. The second stage, if there is one, involves the extraction of a specific item (or items) of information from that perceived ‘continuum’; that is to say, it involves the conversion from analog to digital information. This stage is cognition. In the case of a person, this could be the recognition from the photograph of the fact that Jon is taller than Fred; for a thermostat, it is the discrete behavior between open and closed. A cognitive agent is an agent that has the capacity of cognition in this sense; i.e. the ability to make the analog to digital conversion. It should be emphasized that the last sentence above is not intended to constitute a definition of a cognitive agent. Rather it enunciates one of the attributes an agent must possess in order to justify the description cognitive. My only aim at this stage in the proceedings is to motivate intuitively the model of the world I intend to work with. (A more detailed investigation of the notion of cognition is presented in Chapter 6.) The ‘cognitive agent’ I have at the back of my mind is Man, though it seems clear that much, if not all, of what I say will have much wider application. For the undecided, Dretske has something to say on both sides of the matter. On page 142 of [8] he says, apropos cognition: It is the successful conversion of information into (appropriate) digital form that constitutes the essence o f cognitive activity ... Cognitive activity is the conceptual mobilisation of incoming information, and this conceptual treatment

2.3 Schemes o f individuation

19

is fundamentally a matter of ignoring differences (as irrelevant to an underlying sameness) ... It is, in short, a matter of making the analog-digital conversion.

This much would appear to support use of analog-digital conversion as a working definition of ‘cognition’. But in a footnote to the above quoted passage, Dretske goes on to say: It is not merely the conversion of information from analog to digital form that qualifies a system as a perceptual-cognitive system ...To qualify as a genuine perceptual system, it is necessary that there be a digital-conversion unit in which the information can be given a cognitive embodiment, but the cognitive embodiment of information is not simply a matter of digitalization.

Basically, the point Dretske is making is that, provided the agent has the means of manipulating and utilizing the information it obtains, then the digitalization of perceived information is the essence of cognitive activity [9]· Notice that the process of cognition (i.e. at the very least an analogdigital conversion) involves a loss (often a huge loss) of information. But this is compensated for by a very definite gain, in that there occurs a classification of the perceived information. A thermometer simply registers the temperature (analog coding of information) and hence is a perceiving agent but not a cognitive agent (in even the most minimal sense suggested above); the thermostat classifies the temperature into two classes (‘warm’ and ‘cold’), and thus exhibits a form of cognition. A suggestive term to use in this discussion would be concept. The thermometer has no concept of warm and cold, the thermostat does. It is by the use of concepts to classify perceived (i.e. incoming) information that such information becomes available for (semantic)3 processing. And it is with such conceptual information in digital form that I shall be primarily concerned in this essay. 2.3

Schemes of individuation

Having sketched the considerations that are both to motivate and guide the development of a proposed mathematical theory o f information flow, the next step is to try to flesh out just what kind of framework will support such a study. As a first step, we need to have available some formally defined, standard way to represent conceptual information — 3 The parenthesized adjective is to distinguish between the kind of content-oriented manipulation usually referred to as ‘information processing’, which is what is meant here, as opposed to some kind o f quantitive signal manipulation such as volume or frequency control.

20

2 Information, Situations, and Infons

a way that should correspond tolerably (and consistently) well to what we feel is actually involved in the acquisition, storage, and manipulation of information by an agent (and which is at the same time amenable to a precise, mathematical development and study). In this chapter and the next, I shall set about this task in a fairly naive fashion, making a number of simplifying assumptions along the way. Later on, as our study progresses, we shall encounter a number of issues that require modification to the way I set things up initially. Consider an agent, si, that has sophisticated cognitive abilities; call it Man. Later on I shall consider the case of more simple agents. As Man goes about in the world, he extracts information from the environment, that is, he makes the basic analog to digital conversion of perceived information as discussed in the previous section. What cognitive abilities does he need in this regard? One of the most important (and fundamental) cognitive abilities pos sessed by Man is the facility to individuate ‘objects’, that is to say, to see objects as objects. For example, when you see a table before you, you recognize it as a table, that is, as a single object, not as some huge collection of molecules or (on a different scale) an assembly of wood, steel, glue, and whatever; when I look at the computer screen in front of me as I type these words, I see (recognize) a single object, a terminal; and so on. Of course, this is not to say that you or I are at all unaware that these individual objects are made up of many other, smaller objects. To you as you eat your lunch, the table is a single object. To the worker who made it, the single, individuated objects that mattered were not only the table, but also its various components, the legs, the top, the screws that hold it together, and so forth. And though I never regard my computer terminal as anything other than a single, incomprehensible entity, I realize that to the computer engineer it has a fascinating and complex structure, involving many component objects. It is, by and large, a matter of the agent’s purpose (and to some extent of scale) just what parts of the world are individuated as ‘single objects’. But whichever way the cake is cut, it seems clear that in order to make its way in the world, a cognitive agent such as Man makes constant use of the ability to individuate ‘objects’. The notion of individuation will occur frequently in my account, this being the way the agent carves up the world. But for many of our purposes, the somewhat less restrictive notion of discrimination turns out to be more appropriate. To explain what this means, consider my dog, Sam. As a result of observing Sam’s behavior, it seems reasonable to

2.3 Schemes o f individuation

21

assume he has a number of individuation capacities; for instance he appears to individuate balls, sticks, our two cats, his water bowl, and many other objects. Far less clear is whether he individuates our house or the local wood. And yet his behavior varies in a systematic way according to whether he is in the house, outside the house in the garden, or in the local wood. That is to say, he discriminates (by his behavior) the house, the garden, and the wood. Thus in describing the dog’s cognitive behavior, it seems appropriate to classify his actions in terms of the house, the garden, and the wood, and yet there seems no reason to suppose that he individuates these objects the way he does (it seems) his ball, sticks, the cats, and his water bowl. There is of course an act of individuation going on here: we as theorists studying the dog’s behavior individuate the house, the wood, etc. Our theory can treat these as single entities. But there seems to be no reason to assume that Sam, the agent, has similar individuation capacities. Enitities that are individuated (by the agent or the theorist) as ‘objects’ will be referred to as individuals, denoted by a,b,c,... Our theory takes these individuals as given. That is to say, among the objects discussed by the theory there are individuals. A formal mathematical development might wish to model these individuals by means of mathematical objects of some form or other. Exactly what mathematical objects are chosen for such a task is not important. If a set-theoretic development were followed, there is a rich structure of abstract objects available. For instance, any collection of ‘pure sets’ may be taken to represent the individuals. Alternatively, the formal ‘individuals’ may be taken as a collection of (unanalysed) ur-elements or atoms that form (part of) the ground level of some set theory with ur-elements. This issue will only be of relevance when it comes to dealing with the mathematical modeling of our theory. For the rest of the present development, individuals are just that: individuals, as individuated, either by the agent or the theorist. It should be noted that individuation of individuals does not at all require them to be atomic entities, incapable of subdivision within the scheme of individuation. For instance, both the table and the com puter terminal mentioned a moment ago, are individuals that have other individuals as components. In addition to the individuation of individuals, an agent such as Man will be able to recognize that various properties hold or fail to hold of some or all of those individuals, and that various relations hold or fail to hold between some of those individuals.

22

2 Information, Situations, and Infons

I shall use P ,Q ,R ,... in order to denote the properties and relations the agent recognizes or discriminates. Just which properties and relations these are is determined by the agent or species of agent. This is not an issue that greatly affects the development of our calculus of information flow. I shall assume that each property or relation has a fixed, finite number of argument places that may be filled by objects of appropriate kinds. (The issue of the appropriateness of the objects that fill the various argument roles of a property or relation will be considered at length in due course, when we investigate the nature of properties and relations more fully.) Again, a formal mathematical development might require these properties and relations to be modeled by certain sets. These need not be properties and relations in the set-theoretic sense, but they should be distinct from the objects used to model individuals. The notion of information that I shall adopt in our study is: objects a i,...,a n do/do not stand in the relation P. Here P is some property in the ontology (about which more later) that applies to n or more objects of certain kinds (see later), and are objects in the ontology that are appropriate (see later) for the respective argument places of the relation P. The identification of the objects a \,...,a n is not assumed to be part of the information. That is to say, information is taken to be in an itemized, conceptual form, and each item of information pertains to certain given objects. If P is an n-place relation and a \,...,a n are objects appropriate for the respective argument places of P, then I shall write < P ,a \,...2an, 1 > to denote the informational item that a \,...,a n stand in the relation P, and < P ,tfi,...,a „ ,0 > to denote the informational item that a \,...,a n do not stand in the relation P. Noting that these objects represent the basic informational unit of our theory, I adopt the word infon4 to denote an object of the form

4 Our subsequent analysis will reveal that only in a restricted sense are these the basic informational units o f the theory, and accordingly I shall have cause to modify this definition o f the word infon as our development proceeds, but the present definition will suffice for now.

2.3 Schemes o f individuation

23

where P is an n-place relation (for some n), aly...,a n are objects appro priate for the respective argument places of P, and / is equal to 0 or 1. The notation and the name are intended to emphasize the fact that ‘infons’ are semantic objects, not syntactic representations. The ‘truth value’ i is called the polarity of the infon. In Dretske’s terminology, an infon is a digitalization of information. An infon that corresponds to the way things actually are in the world is called a fact. More on this later. Again, for a set-theoretic development it would not matter just what kinds of set-theoretic object were taken to represent infons. The notation used is suggestive of an ordered (n + 2)-tuple for an infon that involves an n-place predicate, with the use of the double angular brackets as simply a notational device to emphasise the particular usage for an infon. (Readers unfamiliar with the mathematical notion of a ‘tuple’ can simply ignore this remark. It plays no role in the development presented in this book.) Examples of infons are: