The following study departs from the lecture, entitled “Creative thinking”, delivered by Claude Shannon in 1952 at the Bell Laboratories. This paper includes an interpretive and critical account of the necessary conditions, as well as the desirable procedures, which must be satisfied in the scientific and technological invention, within the frame of the so-called scientist’s spontaneous philosophy.

Depuis une vingtaine d'années, l'oeuvre de C. E. Shannon semble être l'objet d'un relatif oubli dans l'ensemble disciplinaire nommé en France « Sciences de l'information et de la communication ». Cet article essaie d'en saisir les raisons, après en avoir rappelé le succès. Il plaide pour une relecture épistémologique du fameux schéma de la mesure d'information de Shannon. C'est ainsi que le « nombre de bits », terme à peu près incompréhensible du côté des sciences humaines, peut se (...) voir donner un sens et être appréhendé comme le nombre de questions pour identifier un objet. Ceci permet alors de considérer que l'élaboration shannonienne pourrait constituer un matériau fondamental pour la cyberculture, entendue comme réflexion sur notre rapport informationnel au monde physique et social.For twenty years, the work of CE Shannon seems to be the subject of a relatively neglected in all disciplinary named in France "Information Science and Communication." This article tries to understand the reasons, after having recalled the success. He argues for a reinterpretation of the famous epistemological schema information measure of Shannon. Thus the "number of bits", a term almost incomprehensible side humanities, can be given a meaning and be understood as the number of questions to identify an object. This then allows to consider the development shannonienne could be a fundamental material for cyberculture, understood as a reflection of our informational report to physical and social world. (shrink)

A typescript by Claude Shannon, ‘Theorems on statistical sequences’, is examined to shed light on the development of information theory. In particular, it appears that Shannon was still working out the mathematical details of his theory in the spring of 1948, just before he published ‘A mathematical theory of communication’. This is contrasted with evidence from a declassified cryptography report that Shannon’s theory was intuitively worked out in its essentials by the time he filed the report (...) in 1945. Previous interviews with Shannon, and a recent interview with a colleague of his, Brockway McMillan, confirm this picture.Keywords: History of science; History of technology; Claude Shannon; Information theory; Ergodic theory; Electrical engineering. (shrink)

I respond herein to reviews of my recent book by Ann Pederson and Stuart Kurtz. With respect to Pederson's concerns, a constructive theology formulated from the ideas of communication theory need not necessarily neglect pressing historical issues of the poor and powerless. The potential for such relevance remains strong. This is true as well for the application of the system to particular myths and rituals. Also, while I speak positively of computers as instruments of disclosure and the theories upon with (...) they are based as resources for theological construction, this should not be construed as an endorsement of just any application of information technology in a world that tends to distort all good things. With respect to Kurtz's concerns, while thermodynamics plays a role in discussions of the primordial chaos, notions from communication theory are far more central. Also, the use of the language of the theory for theology does not necessarily require theological relevance for all of Claude Shannon's technical conclusions. My uses of infinity are taken from traditional theology and analytic geometry rather than from pure mathematics, although fruitful development along those lines is entirely possible. Pederson and Kurtz are generous with both their praise and concerns. The praise will encourage me to further this project along lines provided by the concerns. (shrink)

There are many approaches to human communication that deal with its multiple aspects at various levels of abstraction and delimit what has become the field of information and communication sciences. Telegraphic communication and orchestral communication are two terms introduced by Y. Winkin to contrast the Shannonian (“telegraphic”) and Batesonian (“orchestral”) theories of communication. The Batesonian theory of information, communication and learning remains qualitative. This chapter presents the pioneering model presented by the engineer Claude Shannon at the end of (...) the 1940s and that proposed by the anthropologist Gregory Bateson and his successors from the 1970s onwards. G. Bateson argues that any continuous learning process involves at least two levels: primary learning, where the subject receives simple information in a given context and responds conditionally to it, and deutero‐learning, where the subject shows an increasing ability to treat given contexts as if they were to be expected in their universe. (shrink)

The primordial chaos of Genesis 1 may be understood as the Pandemonium Tremendum (or PT), the infinite field of variety or abundance within God. The concept of variety is taken from Claude Shannon's theory of communication. Especially significant is Shannon's notion that communication is the limitation of variety through decision processes. In one model of the divine life suggested by the theory, the PT is the boundless source of potential reaped by an agential God in the act (...) of creation as a communication process. Other models for creation include the PT in a biased mode and creatures themselves as decision agents. (shrink)

ArgumentIn this comparative historical analysis, we will analyze the intellectual tendency that emerged between 1946 and 1956 to take advantage of the popularity of communication theory to develop a kind of informational epistemology of statistical mechanics. We will argue that this tendency results from a historical confluence in the early 1950s of certain theoretical claims of the so-called English School of Information Theory, championed by authors such as Gabor (1956) or MacKay (1969), and from the attempt to extend the profound (...) success of Shannon’s ([1948] 1993) technical theory of sign transmission to the field of statistical thermal physics. As a paradigmatic example of this tendency, we will evaluate the intellectual work of Léon Brillouin (1956), who, in the mid-fifties, developed an information theoretical approach to statistical mechanical physics based on a concept of information linked to the knowledge of the observer. (shrink)

This book presents an attempt to develop a theory of knowledge and a philosophy of mind using ideas derived from the mathematical theory of communication developed by Claude Shannon. Information is seen as an objective commodity defined by the dependency relations between distinct events. Knowledge is then analyzed as information caused belief. Perception is the delivery of information in analog form for conceptual utilization by cognitive mechanisms. The final chapters attempt to develop a theory of meaning by viewing (...) meaning as a certain kind of information-carrying role. (shrink)

Prominent views about representation share a premise: that mathematical communication theory is blind to representational content. Here I challenge that premise by rejecting two common misconceptions: that Claude Shannon said that the meanings of signals are irrelevant for communication theory (he didn't and they aren't), and that since correlational measures can't distinguish representations from natural signs, communication theory can't distinguish them either (the premise is true but the conclusion is false; no valid argument can link them).

The information age can be dated to the work of Norbert Wiener and Claude Shannon in the 1940s. Their work on cybernetics and information theory, and many subsequent developments, had a profound influence on reshaping the field of psychology from what it was prior to the 1950s. Contemporaneously, advances also occurred in experimental design and inferential statistical testing stemming from the work of Ronald Fisher, Jerzy Neyman, and Egon Pearson. These interdisciplinary advances from outside of psychology provided the (...) conceptual and methodological tools for what is often called the cognitive revolution but is more accurately described as the information-processing revolution. Cybernetics set the stage with the idea that everything ranging from neurophysiological mechanisms to societal activities can be modeled as structured control systems with feedforward and feedback loops. Information theory offered a way to quantify entropy and information, and promoted theorizing in terms of information flow. Statistical theory provided means for making scientific inferences from the results of controlled experiments and for conceptualizing human decision making. With those three pillars, a cognitive psychology adapted to the information age evolved. The growth of technology in the information age has resulted in human lives being increasingly interweaved with the cyber environment, making cognitive psychology an essential part of interdisciplinary research on such interweaving. Continued engagement in interdisciplinary research at the forefront of technology development provides a chance for psychologists not only to refine their theories but also to play a major role in the advent of a new age of science. (shrink)

This paper traces the application of information theory to philosophical problems of mind and meaning from the earliest days of the creation of the mathematical theory of communication. The use of information theory to understand purposive behavior, learning, pattern recognition, and more marked the beginning of the naturalization of mind and meaning. From the inception of information theory, Wiener, Turing, and others began trying to show how to make a mind from informational and computational materials. Over the last 50 years, (...) many philosophers saw different aspects of the naturalization of the mind, though few saw at once all of the pieces of the puzzle that we now know. Starting with Norbert Wiener himself, philosophers and information theorists used concepts from information theory to understand cognition. This paper provides a window on the historical sequence of contributions made to the overall project of naturalizing the mind by philosophers from Shannon, Wiener, and MacKay, to Dennett, Sayre, Dretske, Fodor, and Perry, among others. At some time between 1928 and 1948, American engineers and mathematicians began to talk about `Theory of Information' and `Information Theory,' understanding by these terms approximately and vaguely a theory for which Hartley's `amount of information' is a basic concept. I have been unable to find out when and by whom these names were first used. Hartley himself does not use them nor does he employ the term `Theory of Transmission of Information,' from which the two other shorter terms presumably were derived. It seems that Norbert Wiener and Claude Shannon were using them in the Mid-Forties. (shrink)

Biologists rely heavily on the language of information, coding, and transmission that is commonplace in the field of information theory developed by Claude Shannon, but there is open debate about whether such language is anything more than facile metaphor. Philosophers of biology have argued that when biologists talk about information in genes and in evolution, they are not talking about the sort of information that Shannon’s theory addresses. First, philosophers have suggested that Shannon’s theory is only (...) useful for developing a shallow notion of correlation, the so-called causal sense of information. Second, they typically argue that in genetics and evolutionary biology, information language is used in a semantic sense, whereas semantics are deliberately omitted from Shannon’s theory. Neither critique is well-founded. Here we propose an alternative to the causal and semantic senses of information: a transmission sense of information, in which an object X conveys information if the function of X is to reduce, by virtue of its sequence properties, uncertainty on the part of an agent who observes X. The transmission sense not only captures much of what biologists intend when they talk about information in genes, but also brings Shannon’s theory back to the fore. By taking the viewpoint of a communications engineer and focusing on the decision problem of how information is to be packaged for transport, this approach resolves several problems that have plagued the information concept in biology, and highlights a number of important features of the way that information is encoded, stored, and transmitted as genetic sequence. (shrink)

This article uses the work of Friedrich Kittler to address the ways in which media technologies underpin and structure the basis of ‘human’ existence and understanding. Kittler’s ‘media materialism’ is explored through four main influences: the information theory of Claude Shannon and Warren Weaver, the media analysis of Marshall McLuhan, the psychoanalytic theory of Jacques Lacan, and Michel Foucault’s work on power and discourse. These figures are used, in turn, to draw into question the materiality of information technology, (...) and, following this, to develop a post-human approach to media analysis. The final section of this article considers the challenges such an approach poses to the humanistic bias of mainstream sociology and media studies. (shrink)

The consolidation of the informational paradigm in molecular biology research concluded on a system to convert the epistemic object into an operational technological object and a stable epistemic product. However, the acceptance of the informational properties of genetic acids failed to clarify the meaning of the concept of information. The “information”’ as a property of the genetic molecules remained as an informal notion that allows the description of the mechanism of inheritance, but it was not specified in a logic–semantic structure. (...) The metaphorical implications associated with the idea of genes as molecules with meaning, questioned the linguistics that seemed too foreign to molecular biology. A reformulation of the concept of information in molecular biology was developed upon the theory of Claude Shannon. The node for the structural coupling between biology, physics and information theory was the identification of an analog structure between the coded messages of Shannon’s theory. (shrink)

The article focuses on the status of the transmission approach to communication. The approach is derived from Claude Shannon’s and Warren Weaver’s mathematical theory of communication, and is primarily used for the analysis of telecommunications processes. Within the model a metaphorical conceptualisation of communication is adopted, as conveying (transmission) of information (thoughts, emotions) from the mind of a subject A to the mind of a subject B. Despite the great popularity of the transmission approach, it is subjected to (...) multilateral criticism. Alternative approaches were formulated in which the transmission metaphor is exceeded, extended or even overcome (e.g., the constitutive, transactional, or the ritual approaches). This paper discusses such criticism. The doubts are raised primarily by the characteristic reductionism and the postulated exclusivity of the transmission approach. A question ariseswhether all the possible types of communication activities can be represented within the transmission approach as a transfer of information. In this context, the dispute between the supporters of the universalistic and the relativistic attitudes to the transmission metaphor is discussed. The polemic also concerns the psychologism elements which are present in the transmission models. Wittgenstein's criticism of psychologism conducted within the framework of his everyday language philosophy is of particular importance. The philosophy may applied to the problem of interpersonal communication. In conclusion it is assumed that the transmission metaphor is important as a tool for the study of many, but not all the aspects of communication. Its importance also lies in the fact that it is the first scientific approach to communication. The exclusivity claims of the transmission model, however, have several limitations, inter alia, it hinders research on the history of communication practices, although the model itself is embedded in a specific historical context. (shrink)

In the last decade, we have observed a continuous increase of interest in eye movement research. According to a recent investigation, eye movements are discussed in over one million publications. The number of publications with eye movement in the title or abstract has been steadily increasing over the years, with over 1,200 papers published alone in 2013. The last decade has also witnessed the emergence of many new sub-disciplines in the field of neuroscience and cognition - one of them is (...) neuroaesthetics, which refers to the [neuro-]science of aesthetic perception of art.The title and contents of our book have been inspired by a very influential research article. It is one of the most cited scientific papers of all time, published in 1959 by a team of neurophysiologists and engineers, Lettvin, McCulloch and Pitts who are considered to be the founders of modern cybernetics. Their article, "What the Frog's Eye Tells the Frog's Brain," refers to the role of internal cortical models in the communication or interfacing of the information in the outside world with the practical contextual task of the viewer. It shows how eye movements are the modality of this communication. The same duality between eye movements and internal models plays a fundamental role in humans. When we look, for example, at art, it explains those neurological processes involved in neuroaesthetics. Our book undertakes this innovative approach to neuroaesthetics. It explains this duality and discusses the communication between the artist and the viewer's aesthetic perception. It is structured into five chapters.Chapter One discusses the neurology of aesthetics, the idea of art as a form of communication, and explains perception as an active matching between a "top" (the viewer's mind) and a "down" (the viewer's sensorial machinery). It goes deep into the philosophical quandary of what beauty is in terms of art. Chapter Two is about eye movements and the scanpath theory of vision perception. It discusses the role of visual attention for controlling active vision, the meaning of mental binding and the analysis of eye movements as the key to understanding aesthetic processes. Chapter Three introduces Claude Shannon's information theory using it as a matrix into which to embed the top down active vision scanpath theory. The authors explain the main concept of neuroaesthetics as a form of communication mediated by the sequence of eye fixations. Chapter Four discusses art critique: The role of the viewer's training and expectation, the dilemma of the aesthetics of art versus non-art and how all of this affects the viewing mode. Finally, Chapter Five treats the intimacy of the artistic process, showing the unique implementation of the communicative experience between the artist and the viewer - the relation between a pictorial representation defined by the artist and modes of AWE generated in the viewer during active looking. (shrink)

El presente artículo busca ofrecer un análisis conceptual de la noción de información, a partir del modo en que es definida por las teorías formales de Claude Shannon y de Benjamin Schumacher. Contra la postura según la cual existen dos tipos de información de naturalezas diferentes, una información clásica y una información cuántica, aquí argumentamos que no hay razones suficientes para sostener la existencia de la información cuántica como un nuevo tipo sustancialmente distinto de información. Afirmamos así que (...) existe un único tipo de información que puede ser codificado de diversas maneras, en particular, mediante sistemas clásicos o sistemas cuánticos. Esta posición nos conducirá a concebir un concepto unificado y abstracto de información, en un contexto donde la teoría de Shannon resulta neutral e independiente de las teorías físicas utilizadas para describir las partes involucradas en el proceso de transmitir información, y la teoría de Schumacher no define un nuevo tipo de entidad informacional, sino una manera alternativa de codificar la información mediante estados cuánticos. The aim of this article is to offer a conceptual analysis of the notion of information, on the basis of the way in which it is defined by the theories of Claude Shannon and of Benjamin Schumacher. Against the position according to which there are two kinds of information of different natures, a classical information and a quantum information, here we argue that there are not sufficient reasons to maintain the existence of quantum information as a new and substantially different kind of information. So we claim that there is only one kind of information, which can be encoded in different ways, in particular, by means of classical or quantum systems. This position will lead us to conceive an unified and abstract concept of information in a context where Shannon's theory is neutral and independent from the physical theories used to describe the stages involved in the process of transmitting information, and Schumacher's theory does not define a new kind of informational entity, but a alternative way of coding information by means of quantum states. (shrink)

The grandest unification theory of them all got its start in 1948, when two remarkable publications appeared. Claude Shannon's paper ''A Symbolic Analysis of Relay and Switching Circuits" and Norbert Wiener's book ''Cybernetics'' brought to the world's attention an idea that had been bubbling beneath the surface for years: information, like matter and energy, can be considered a thing in itself -- a fundamental building block of reality. Ever since, there has been a growing effort to explain the (...) brain, the body, civilization and, most recently, the universe itself as information processors. (shrink)

This essay introduces the philosophy of legal information (PLI), which is a response to the radical changes brought about in philosophy by the information revolution. It reviews in some detail the work of Luciano Floridi, who is an influential advocate for an information turn in philosophy that he calls the philosophy of information (PI). Floridi proposes that philosophers investigate the conceptual nature of information as it currently exists across multiple disciplines. He shows how a focus on the informational nature of (...) traditional philosophical questions can be transformative for philosophy and for human self-understanding. The philosophy of legal information (PLI) proposed here views laws as a body of information that is stored, manipulated, and analyzed through multiple methods, including the computational methodologies. PLI offers resources for evaluating the ethical and political implications of legal infomatics (also known as "legal information systems"). -/- This essay introduces PLI. Parts I and II describe Floridi's philosophy of information. First, Part I introduces the transformation in the concept of information that occurred in the twentieth century through the work of Alan Turning and Claude Shannon. Part II describes Floridi's approaches to traditional questions in epistemology, ontology, and ethics. Part III applies PI to the analysis of legal positivism. It suggests that PLI is a viable project that has potential for transforming the understanding law in the information age. -/- . (shrink)

This article attempts to develop a theoretical approach to exploration of the environment, of intra-environmental information processes and mutually determinative relationships, and mode of being. Relying on the theoretical postulates of Gregory Bateson, the information theory of Claude Shannon, the concept of predictive processing, and Nikolai Ladovsky’s principle of economy of perception in architecture, the author seeks to show that the environment can act as an alternative mode to the subject for organizing experience. This interpretation of the concept (...) of environment can serve as a foundation for constructing an optics of inquiry that is not human-centric but at the same time could remain an optics of human inquiry. (shrink)

The class of recursive functions over the reals, denoted by , was introduced by Cristopher Moore in his seminal paper written in 1995. Since then many subsequent investigations brought new results: the class was put in relation with the class of functions generated by the General Purpose Analogue Computer of Claude Shannon; classical digital computation was embedded in several ways into the new model of computation; restrictions of were proved to represent different classes of recursive functions, e.g., recursive, (...) primitive recursive and elementary functions, and structures such as the Ritchie and the Grzergorczyk hierarchies.The class of real recursive functions was then stratified in a natural way, and and the analytic hierarchy were recently recognised as two faces of the same mathematical concept.In this new article, we bring a strong foundational support to the Real Recursive Function Theory, rooted in Mathematical Analysis, in a way that the reader can easily recognise both its intrinsic mathematical beauty and its extreme simplicity. The new paradigm is now robust and smooth enough to be taught. To achieve such a result some concepts had to change and some new results were added. (shrink)

A brief personal history is given about how information theory can be applied to binding sites of genetic control molecules on nucleic acids. The primary example used is ribosome binding sites in Escherichia coli. Once the sites are aligned, the information needed to describe the sites can be computed using Claude Shannon’s method. This is displayed by a computer graphic called a sequence logo. The logo represents an average binding site, and the mathematics easily allows one to determine (...) the components of this average. That is, given a set of binding sites, the information for individual binding sites can also be computed. One can go further and predict the information of sites that are not in the original data set. Information theory also allows one to model the flexibility of ribosome binding sites, and this led us to a simple model for ribosome translational initiation in which the molecular components fit together only when the ribosome is at a good ribosome binding site. Since information theory is general, the same mathematics applies to human splice junctions, where we can predict the effect of sequence changes that cause human genetic diseases and cancer. The second example given is the Pribnow “box,” which, when viewed by the information theory method, reveals a mechanism for initiation of both transcription and DNA replication. Replication, transcription, splicing, and translation into protein represent the central dogma, so these examples show how molecular information theory is contributing to our knowledge of basic biology. (shrink)

World War II research into cryptography and computing produced methods, instruments and research communities that informed early research into artificial intelligence and semi-autonomous computing. Alan Turing and Claude Shannon in particular adapted this research into early theories and demonstrations of AI based on computers’ abilities to track, predict and compete with opponents. This formed a loosely bound collection of techniques, paradigms, and practices I call crypto-intelligence. Subsequent researchers such as Joseph Weizenbaum adapted crypto-intelligence but also reproduced aspects of (...) its antagonistic precepts. This was particularly true in the design and testing of chat bots. Here the ability to trick, fool, and deceive human and machine opponents was a premium, and practices of agent abuse were admired and rewarded. Recognizing the historical genesis of this particular variety of abuse can help researchers develop less antagonistic methodologies. (shrink)

Although there has long been a division in studies of consciousness between a focus on neuronal processes or conversely an emphasis on the ruminations of a conscious self, the long-standing split between mechanism and meaning within the brain was mirrored by a split without, between information as a technical term and the meanings that messages are commonly thought to convey. How to heal this breach has posed formidable problems to researchers. Working through the history of cybernetics, one of the historical (...) sites where Claude Shannon’s information theory quickly became received doctrine, we argue that the cybernetic program as it developed through second-order cybernetics and autopoietic theory remains incomplete. In this article, we return to fundamental questions about pattern and noise, context and meaning, to forge connections between consciousness, narrative and media. The thrust of our project is to reintroduce context and narrative as crucial factors in the processes of meaning-making. The project proceeds along two fronts: advancing a theoretical framework within which context plays its properly central role; and demonstrating the importance of context by analyzing two fictions, Stanislaw Lem’s His Master’s Voice and Joseph McElroy’s Plus, in which context has been deformed by being wrenched away from normal human environments, with radical consequences for processes of meaning-making. (shrink)

World War II research into cryptography and computing produced methods, instruments and research communities that informed early research into artificial intelligence and semi-autonomous computing. Alan Turing and Claude Shannon in particular adapted this research into early theories and demonstrations of AI based on computers’ abilities to track, predict and compete with opponents. This formed a loosely bound collection of techniques, paradigms, and practices I call crypto-intelligence. Subsequent researchers such as Joseph Weizenbaum adapted crypto-intelligence but also reproduced aspects of (...) its antagonistic precepts. This was particularly true in the design and testing of chat bots. Here the ability to trick, fool, and deceive human and machine opponents was a premium, and practices of agent abuse were admired and rewarded. Recognizing the historical genesis of this particular variety of abuse can help researchers develop less antagonistic methodologies. (shrink)

Until the late 19th century scientists almost always assumed that the world could be described as a rule-based and hence deterministic system or as a set of such systems. The assumption is maintained in many 20th century theories although it has also been doubted because of the breakthrough of statistical theories in thermodynamics (Boltzmann and Gibbs) and other fields, unsolved questions in quantum mechanics as well as several theories forwarded within the social sciences. Until recently it has furthermore been assumed (...) that a rule-based and deterministic system was also predictable if only the rules were known, but this assumption has now been undermined by modern chaos-theory describing rule-based and deterministic, but unpredictable systems, while catastrophe-theory delivers a set of types describing various kinds of instability and conditions for the stability of a given system. Hence the main trait in the theoretical development in the 20th-century science can be described as a basic modification and limitation of some of the fundamental and strong assumptions forwarded in the previous epochs of modern science. Ironically, the very same process has been a process in which the human capacity to intervene in nature has expanded dramatically and mainly with the help of the very same theories, and not least because they allow nature to be described and made manipulable on a lower level and a more fine-grained scale. While the overall theoretical consistency between the various theories has gone, the reach of human intervention in nature has increased based on quite new dimensions whether in the area of physics (e.g.: energy technologies, chemical technologies, nanotechnologies etc.) or biology (ge¬netic manipulation) or in the area of psychology, sociology and culture (artificial simulations of mental processes, new means of communication, implying changes in the social infrastructure and cultural behaviour etc.). While some of these changes and new conditions can be reflected from within the conceptual framework of rule-based systems, albeit more complex than formerly recognized, others seem to give rise to the question of whether there are »systems« and relations between different systems in the world which are not rule-based? For instance, it seems to be obvious that the notion of instability represents a major conceptual break with former theories of rule-based systems, as the stability of the latter is an axiomatically given property implied in the very notion of rule-based systems, while instability can only be the result of external influence which should be explained as the result of another rule-based sy¬stem. While there are no difficulties implied concerning the stability of rule-based systems, the notion of unstable states of a system raises the question of how there can be a system at all if there are no invariant stabilising principles? This is the first question which I will address. And I shall do so by taking two examples of such systems as my point of departure. The first example will be the computer and the second will be ordinary language. In both cases I will argue that the stability of these systems (which are both defined by the existence/presence of human intentions) are provided by the help of - differently organised - redundancy functions which both allow the maintenance of systems in unstable macro-states, suspension of previous rules, underdetermination and overdetermination and generation/emergence/creation of new rules more or less independent of previous rules by the help of optional recursions to the permanently accessible underlying levels as for instance the level of binary representation in computers. Since the notion of redundancy is both controversial as such and often avoided, the concept is discussed (as defined in Claude Shannon's mathematical theory of information and in the semiotic framework of J. J. Greimas) and leading to a more general definition in which the redundancy functions serve to overcome noisy conditions, but at the cost of rule-based stability, determination, and predictability. A second question will be how the notion of rule-generating systems relates to the notion of anticipatory systems and it will be argued that rule-generating systems share some features with an¬ticipatory systems and that the former from a certain viewpoint can be seen as a subclass of the latter, although anticipative features are not necessarily a part of the definition of rule-generating systems. On the other hand, it will be discussed whether anticipatory systems which are not rule-generating systems can exist and it will be argued that the capacity to anticipate is strongly limited if it is not part of a rule-generating system. Therefore, it is concluded that the most powerful anticipatory systems need to be rule-generating systems. (shrink)

A new logic of partitions has been developed that is dual to ordinary logic when the latter is interpreted as the logic of subsets of a fixed universe rather than the logic of propositions. For a finite universe, the logic of subsets gave rise to finite probability theory by assigning to each subset its relative size as a probability. The analogous construction for the dual logic of partitions gives rise to a notion of logical entropy that is precisely related to (...) Claude Shannon's entropy. In this manner, the new logic of partitions provides a logico-conceptual foundation for information-theoretic entropy or information content. (shrink)

The 20th Century is the starting point for the most ambitious attempts to extrapolate human life into artificial systems. Norbert Wiener’s Cybernetics, Claude Shannon’s Information Theory, John von Neumann’s Cellular Automata, Universal Constructor to the Turing Test, Artificial Intelligence to Maturana and Varela’s Autopoietic Organization, all shared the goal of understanding in what sense humans resemble a machine. This scientific and technological movement has embraced all disciplines without exceptions, not only mathematics and physics but also biology, sociology, psychology, (...) economics etc. New terms were developed, such as “information”, “organization”, “entropy”, “communication”, “encryption”, “computation” and “algorithmics” to mention a few, all which had an enormous impact on artificial systems. Our work follows this historical track but with a reversed order of priorities. Instead of deducing a reduced group of human acts into an artificial environment, we deduce the human aspects of machines by extrapolating algorithmic methodologies into everyday life acts. The present informational theories were insufficiently powered to achieve this objective without developing a new theoretical approach. Hence, our research is directed towards an expansion of the current informational theories. (shrink)

World War II research into cryptography and computing produced methods, instruments and research communities that informed early research into artificial intelligence and semi-autonomous computing. Alan Turing and Claude Shannon in particular adapted this research into early theories and demonstrations of AI based on computers’ abilities to track, predict and compete with opponents. This formed a loosely bound collection of techniques, paradigms, and practices I call crypto-intelligence. Subsequent researchers such as Joseph Weizenbaum adapted crypto-intelligence but also reproduced aspects of (...) its antagonistic precepts. This was particularly true in the design and testing of chat bots. Here the ability to trick, fool, and deceive human and machine opponents was a premium, and practices of agent abuse were admired and rewarded. Recognizing the historical genesis of this particular variety of abuse can help researchers develop less antagonistic methodologies. (shrink)

A brief personal history is given about how information theory can be applied to binding sites of genetic control molecules on nucleic acids. The primary example used is ribosome binding sites in Escherichia coli. Once the sites are aligned, the information needed to describe the sites can be computed using Claude Shannon’s method. This is displayed by a computer graphic called a sequence logo. The logo represents an average binding site, and the mathematics easily allows one to determine (...) the components of this average. That is, given a set of binding sites, the information for individual binding sites can also be computed. One can go further and predict the information of sites that are not in the original data set. Information theory also allows one to model the flexibility of ribosome binding sites, and this led us to a simple model for ribosome translational initiation in which the molecular components fit together only when the ribosome is at a good ribosome binding site. Since information theory is general, the same mathematics applies to human splice junctions, where we can predict the effect of sequence changes that cause human genetic diseases and cancer. The second example given is the Pribnow “box,” which, when viewed by the information theory method, reveals a mechanism for initiation of both transcription and DNA replication. Replication, transcription, splicing, and translation into protein represent the central dogma, so these examples show how molecular information theory is contributing to our knowledge of basic biology. (shrink)

In recent years noise seems to have become an interdisciplinary concept par excellence, apt to capturing important dynamics at work whether in technological, scientific, social, or aesthetic domains. But when economists, biologists, psychologists, and musicians speak of noise, are they really all referring to the same thing? In An Epistemology of Noise Cecile Malaspina takes this dispersion of the notion of noise as a starting point, and moreover accepts that, when removed from its mathematical formulation in information theory and spread (...) into diverse disciplines, noise takes on a metaphorical ambiguity. Yet rather than aiming to eliminate this ambiguity, Malaspina sets out to account for it. The key problem in An Epistemology of Noise is not to identify the legitimate usage of the concept of noise, but rather to examine what happens when noise moves between disciplines, and what the ‘noisiness’ of this movement tells us about the conditions for interdisciplinary knowledge. Noise here is both an object (or many objects) of inquiry and a condition for that inquiry, and presents us with the problem of how knowledge can find its ground in these ‘shifting sands’ (9). (shrink)