lecture 6 Informatics luis rocha 2017 I501 introduction to informatics INDIANA UNIVERSITY

Transcription

1 Informatics lecture 6

2 Readings until now Presentations Piantadosi, S. T.,et al (2011). Word lengths are optimized for efficient communication. PNAS, 108(9), Malic, Vincent Gauvrit et al (2017). Human behavioral complexity peaks at age 25. PLOS Computational Biology, 13(4), e Kresnye, Cassie Schmälzle et al (2017). Brain connectivity dynamics during social interaction reflect social network structure. PNAS, 114(20), Wong, Vincent This week Klir, G.J. [2001]. Facets of systems Science. Springer. Chapters: 1,2,3 Optional Klir, G.J. [2001]. Facets of systems Science. Springer. Chapters: 8, 11 Lecture notes The Nature of Information Formalizing and Modeling the World Available and listed at Also check out Links and notes at

3 The Black Box: Due October 11 th, 2017 Q1 Q3 Q2 Assignment I Due October 11 th Focus on uncovering quadrants using data collection and induction. Herbert Simon: Law discovery means only finding pattern in the data; whether the pattern will continue to hold for new data that are observed subsequently will be decided in the course of testing the law, not discovering it. The discovery process runs from particular facts to general laws that are somehow induced from them; the process of Propose a formal model or algorithm of what each quadrant is doing. testing discoveries runs from the laws to predictions of particular facts Q4 from them [...] To explain why the patterns we extract from observations frequently lead to correct predictions (when they do) requires us to face again the problem of induction, and perhaps to make some hypothesis about the uniformity of nature. But that hypothesis is neither required for, nor relevant to, the theory of discovery processes. [ ] By separating the question of pattern detection from the question of prediction, we can construct a true normative theory of discovery-a logic of discovery. Analyze, using deduction, the behavior of this algorithm.

4 Hertzian modeling paradigm Using computation to model the World The most direct and in a sense the most important problem which our conscious knowledge of nature should enable us to solve is the anticipation of future events, so that we may arrange our present affairs in accordance with such anticipation. (Hertz, 1894) Model Symbols (Images) Initial Conditions Formal Rules (syntax) Logical Consequence of Model Predicted Result???? Observed Result (Pragmatics) Encoding (Semantics) Measure Measure World 1 Physical Laws World 2 See: Modeling the World Lecture Notes

5 at the Macy meetings other key concepts Norbert Wiener and Arturo Rosenblueth Goal-directed behavior and negative feedback (control) Homeostasis and circular causality In machines and biology Automata Theory (Von Neumann) Communication and Information The fundamental idea is the message, even though the message may not be sent by man and the fundamental element of the message is the decision (Norbert Wiener) Shannon s Information and Wiener s Communication Theory Natural semiotics (McCulloch and others later get into Peircean Semiotics) functional equivalence of systems (general systems) Bio-inspired mathematics and engineering and computing/mechanism-inspired biology and social science

6 at the Macy meetings Gregory Bateson and Margaret Mead Homeostasis and circular causality in society Transvestite ceremony to diffuse aggressive action in Iatmul culture Learning and evolution Can a computer learn to learn? A new organizing principle for the social sciences (control and communication) As much as evolution was for Biology Lawrence Frank The new interdisciplinary concepts needed a new kind of language Higher generality than what is used in single topic disciplines A call for a science of systems Yehoshua Bar-Hillel Optimism of a new (cybernetics and information) age A new synthesis [ ] was destined to open new vistas on everything human to help solve many of the disturbing open problems concerning man and humanity. other key concepts

7 As a discipline and its impact? cybernetics Norbert Wiener s book had huge impact Coined the term Cybernetics from the Greek Κυβερνήτης (kybernētēs, steersman, governor, pilot, or rudder the same root as government). Overoptimism? Those of us who have contributed to the new science of cybernetics, stand in a moral position which is, to say the least, not very confortable. We have contributed to the initiation of a new science which, as I have said, embraces technical developments with great possibilities for good and for evil. [1948] Was huge impact a premature delivery (Ralph Gerard)? excessive optimism and a misunderstanding of the nature of scientific achievement. (Gregory Bateson)? Success meant adoption by many fields But not a highly successful discipline in itself Most practitioners became marginal in their original disciplines The price of interdisciplinary research in Academia? Successful descendents in more interdisciplinary settings outside of academia Government labs (e.g. Los Alamos National Laboratory) Private Institutes (e.g. Santa Fe Institute) What about informatics as a field? Finally academia accepting the reality of the information age in society?

8 Informatics cybernetics As a discipline and its impact? Norbert Wiener s book had huge impact Coined the term Cybernetics Overoptimism? The price of interdisciplinary research in Academia? Successful descendents in more interdisciplinary settings outside of academia But not a highly successful discipline in itself Most practitioners became marginal in their original disciplines Those of us who have contributed to the new science of cybernetics, stand in a moral position which is, to say the least, not very confortable. We have contributed to the initiation of a new science which, as I have said, embraces technical developments with great possibilities for good and for evil. [1948] Was huge impact a premature delivery (Ralph Gerard)? excessive optimism and a misunderstanding of the nature of scientific achievement. (Gregory Bateson)? Success meant adoption by many fields from the Greek Κυβερνήτης (kybernētēs, steersman, governor, pilot, or rudder the same root as government). Government labs (e.g. Los Alamos National Laboratory) Private Institutes (e.g. Santa Fe Institute) What about informatics as a field? Finally academia accepting the reality of the information age in society?

9 The language lives on cybernetics Learning and cognition as information transmission Brain and mind as mechanism Computer as prevalent analogy/model for understanding life and cognition Feedback has come to mean information about the outcome of any process or activity No word existed previously in English to convey that concept Interaction everywhere Attention shifted from individualism and cause & effect, to circular causation and social interaction Programmed behavior Society and organisms as systems Wiener s prediction of a second industrial revolution centered on communication, control, computation, information, and organization was correct Abundance of technology and mass production of communication devices Grew out of the ideas first reported by the cyberneticians Informatics is an offspring of cybernetics

10 The language lives on cybernetics Learning and cognition as information transmission Brain and mind as mechanism Computer as prevalent analogy/model for understanding life and cognition Feedback has come to mean information about the outcome of any process or activity No word existed previously in English to convey that concept Interaction everywhere Attention shifted from individualism and cause & effect, to circular causation and social interaction Programmed behavior Society and organisms as systems Wiener s prediction of a second industrial revolution centered on communication, control, computation, information, and organization was correct Abundance of technology and mass production of communication devices Grew out of the ideas first reported by the cyberneticians Informatics is an offspring of cybernetics

11 The language lives on cybernetics Learning and cognition as information transmission Brain and mind as mechanism Computer as prevalent analogy/model for understanding life and cognition Feedback has come to mean information about the outcome of any process or activity No word existed previously in English to convey that concept Interaction everywhere Attention shifted from individualism and cause & effect, to circular causation and social interaction Programmed behavior Society and organisms as systems Wiener s prediction of a second industrial revolution centered on communication, control, computation, information, and organization was correct Abundance of technology and mass production of communication devices Grew out of the ideas first reported by the cyberneticians Informatics is an offspring of cybernetics

12 post-war science Created new focused fields Mostly analytical in methodology Mostly produced concepts useful for other fields cybernetics and the information turn Social and Psychological Sciences Mathematics & Engineering Biological Sciences Cybernetics Social sciences (economics, Poli Sci, etc.) AI CS Complex systems and networks OR biology

13 By Erik Stolterman a possible parsing of informatics towards problem solving beyond computing into the natural and social synthesis of information technology Functionalequivalence of systems via computing and information HCID Data & Search X-Informatics or Computational X Informatics Computer Science STS, CCS, Social Informatics Security Complex Systems Data Mining Music- Health- Archaeo- Bio- Chem- Geo-

14 readings (available in Canvas and online) Lecture next classes Klir, G.J. [2001]. Facets of Systems Science. Springer. Chapters: 1,2,3. Optional: Chapters 8, 11 Klir, G.J. and D. Elias [2003]. Architecture of Systems Problem Solving. Springer. Chapters: 1,2, 3.1, 3.2, 3.10, 4.1, 4.2 Optional: Chapters: 3, 4 Lecture Notes Formalizing and Modeling the World Presentations & Discussion Markov, Igor L Limits on Fundamental Limits to Computation. Nature 512 (7513) (August 13): Sher, Stephen Loreto, Vittorio, et al. "Dynamics on expanding spaces: modeling the emergence of novelties." Creativity and Universality in Language. Springer International Publishing, Yang, Kaicheng