Evoking Claude Shannon. José Francisco Rodrigues (CMAF&IO_F Ciências_U Lisboa) Amílcar Sernadas (CMAF&IO_I S Técnico_U Lisboa)

Similar documents
Claude Elwood Shannon 30 April 1916 February 2001

Smart Cities. SESSION I : Lecture 2: Turing s s Legacy. Michael

Information & Communication

Claude E. Shannon. Tina Jayroe. University of Denver

Title? Alan Turing and the Theoretical Foundation of the Information Age

A Brief History of Computer Science and Computing

Introduction. Reading: Chapter 1. Courtesy of Dr. Dansereau, Dr. Brown, Dr. Vranesic, Dr. Harris, and Dr. Choi.

From Turing Machines to Building a Brain

001K1985_KP_LE_B_en.doc DEVELOPMENT OF COMMUNICATION AND COMPUTING, AND MY HOBBY. Claude E. Shannon

Introduction to Digital Communications. Vitaly Skachek

Chapter 1 An Introduction to Computer Science. INVITATION TO Computer Science 1

10/4/10. An overview using Alan Turing s Forgotten Ideas in Computer Science as well as sources listed on last slide.

Chapter 6: DSP And Its Impact On Technology. Book: Processor Design Systems On Chip. By Jari Nurmi

Backgrounder. From Rock n Roll to Hafnium The Transistor turns 60. Background Summary

State Research Award Goes to KIT Scientist Professor Jürg Leuthold Gets Award for His Groundbreaking Development of an Optical Silicon Chip

Communications II. Mohammad Fathi Text book: J.G. Proakis and M. Salehi, Communication System Engineering (2 nd Ed) Syllabus

Click here to have this read to you

How Is New Mathematics Changing. YOUR Life Today and In the Future?

A Brief History of IT

Bell Labs celebrates 50 years of Information Theory

Aim. Lecture 1: Overview Digital Concepts. Objectives. 15 Lectures

Course Outline. Textbook: G. Michael Schneider and Judith L. Gersting, "Invitation to Computer Science C++ Version," 3rd Edition, Thomson, 2004.

Books. Foundations of Computer Science, 2 nd edition, Behrouz Forouzan and Firouz Mosha rraf, Thomson Learning, UK, ( 歐亞書局,(02) )

EENG 444 / ENAS 944 Digital Communication Systems

Reading. Lecture 17: MOS transistors digital. Context. Digital techniques:

BUSINESS HISTORY REVIEW

James West Inventor, Entrepreneur, Physicist, Renowned Professor of Engineering at Johns Hopkins -His highest degree is his high school diploma!

Zolt-Gilburne Imagination Seminar. Knowledge and Games. Sergei Artemov

In this lecture: Lecture 3: Basic Logic Gates & Boolean Expressions

The American University. College of Arts and Sciences. Department of Computer Science and Information Systems. Fall 2001

Part 1: Unit Overview. Unit Aims. Unit Abstract. Unit Outcomes. Unit Outcomes

Introduction to Computer Science

SCIENCE. Paving the way for a healthier future

Integrating Information Systems: Technology, Strategy, and Organizational Factors

THE UNICYCLING GENIUS WHO INVENTED INFORMATION THEORY: A REVIEW OF A MIND AT PLAY, BY JIMMY SONI

IDK0310 AUTOMATED AND SYSTEMATISED LEGAL PROCESS. Ermo Täks

detection; creative industrial design systems; sophisticated computer games in which the non-player characters are driven

Chapter 19 Study Questions Name: Class:

Alan Turing: Codebreaker

In Praise of Dr John Vincent Atanaso, UF Class of 1925 Pierre Ramond

Information Theory: the Day after Yesterday

White Paper Unlocking the Potential of LDPC, New FlexLDPC Coding from. Datum Systems. for PSM-500, 500L & 500LT Series Modems

Introduction to Coding Theory

Simulink Modelling of Reed-Solomon (Rs) Code for Error Detection and Correction

The Information Age. STSC 160 Fall 2007

Convolutional Coding Using Booth Algorithm For Application in Wireless Communication

ENSC327/328 Communication Systems Course Information. Paul Ho Professor School of Engineering Science Simon Fraser University

EE40 Lecture 35. Prof. Chang-Hasnain. 12/5/07 Reading: Ch 7, Supplementary Reader

DIGITAL LOGIC CIRCUITS

Electronics From Wikipedia, the free encyclopedia

Lecture 1 What is AI? EECS 348 Intro to Artificial Intelligence Doug Downey

Bachelor of Science Program

Review of Electronic,Digital Computers

The Hungarian Ljapunov: Dr. Tihamér NEMES ( ) He started his activity as a mechanical engineer on 1917.

Digital Integrated Circuits

A TRIBUTE TO ALEXEY AND TATIANA. by Ivan Pogildiakov

SIGNALS AND SYSTEMS LABORATORY 13: Digital Communication

S Coding Methods (5 cr) P. Prerequisites. Literature (1) Contents

The Jet Engine Inventions that Shook the World Series

EE107 Communication Systems. Introduction

ECE 4400:693 - Information Theory

6.450: Principles of Digital Communication 1

EMINENT & ENIGMATIC. 10 aspects of Alan Turing

Introduction to the Communication Process. Digital Transmission MEEC

PHYSICS 330 LAB Operational Amplifier Frequency Response

Lesson 10. Linear Integrated Circuits

A celebration of Alan Turing s achievements in the year of his centenary

Goals of this Course. CSE 473 Artificial Intelligence. AI as Science. AI as Engineering. Dieter Fox Colin Zheng

Lecture #1. Course Overview

Foundations of Computing and Communication Lecture 4. The Mechanical Age

1.Introduction 2.A Remarkable Career 3.Communications 4.Johnson-Nyquist Noise 5.Stability Theory 6.Summary

Microwave And Radar Engineering

Introduction to Digital Logic Missouri S&T University CPE 2210 Electric Circuits

GEORGE FRICK

ECE Digital Logic Lecture 2. Digital Design Circuit Types: Combinational vs. Sequential

Lecture 1 What is AI?

Digital Communications Overview, ASK, FSK. Prepared by: Keyur Desai Department of Electrical Engineering Michigan State University ECE458

DATA COMMUNICATION. Channel and Noise

Error Correcting Code

Lecture #2. EE 471C / EE 381K-17 Wireless Communication Lab. Professor Robert W. Heath Jr.

Lecture 1 Introduction

Emerging Frontiers of Science of Information

Overview of Theoretical Aeroacoustics: Compiled Mathematical Derivations of Fereidoun Feri Farassat

6.004 Computation Structures Spring 2009

The ENIAC at 70. Details of the Euler-Heun Computation

Progress due to: Feature size reduction - 0.7X/3 years (Moore s Law). Increasing chip size - 16% per year. Creativity in implementing functions.

Welcome to Engr 1202

Electrical, Computer and Software Engineering - a historical perspective -

Enabling Greater Research Achievements by Transforming the Inception Phase

100 Years of Shannon: Chess, Computing and Botvinik

GENETIC PROGRAMMING. In artificial intelligence, genetic programming (GP) is an evolutionary algorithmbased

Belief-based rational decisions. Sergei Artemov

2018 Delaware Science Olympiad Wonders of Electricity Workshop (Basic of OpAmp and Digital Logic)

Chapter 1 Coding for Reliable Digital Transmission and Storage

Task talk notes Gaming

A Balanced Introduction to Computer Science, 3/E

SIDNEY DARLINGTON

Aspects of Game Theory & John Nash

Pearls of Computation: Joseph Carl Robnett Licklider Man Computer Symbiosis on the Intergalactic Computer Network

The Historical Context

Transcription:

Evoking Claude Shannon José Francisco Rodrigues (CMAF&IO_F Ciências_U Lisboa) Amílcar Sernadas (CMAF&IO_I S Técnico_U Lisboa)

Evoking Claude Shannon 1916-2001 [a] playful genius who invented the bit, separated the medium from the message, and laid the foundations for all digital communications.... [He] single-handedly laid down the general rules of modern information theory, creating the mathematical foundations for a technical revolution. Without his clarity of thought and sustained ability to work his way through intractable problems, such advances as e-mail and the World Wide Web would not have been possible. Something of a loner throughout his working life, he was individually responsible for two of the great breakthroughs in understanding which heralded the convergence of computing and communications. To colleagues in the corridors at the Massachusetts Institute of Technology who used to warn each other about the unsteady advance of Shannon on his unicycle, it may have seemed improbable that he could remain serious for long enough to do any important work. Yet the unicycle was characteristic of his quirky thought processes, and became the topsy-turvy symbol of unorthodox progress towards unexpected theoretical insights. Anonymous obituary in The Times newspaper on 12 March 2001

Evoking Claude Shannon 1916-2001 1916 Born and educated in Gaylord, Michigan, USA 1932 Studied Mathematics (M) and Electrical Engineering (EE), University of Michigan 1936 Joined the EE Dep. at MIT where he worked with on Vannevar Bush s differential analyzer, an early analog computer. 1938 In his remarkable master s thesis entitled An analysis of relay and switching circuits, at Math Dep., he established how Boole s logical symbols can be regarded as a series of on off switches so that binary arithmetic can be performed by electrical circuits and he developed mathematical techniques for building a network of switches and relays to realize a specific logical function. The work was made independently of the similar earlier theory of Victor Shestakov, which was published in 1941. 1939 Alfred Noble Prize of the combined American engineering societies. 1940 PhD thesis An algebra for theoretical genetics, also at MIT; He was awarded with a fellowship to do research at the Institute for Advanced Study in Princeton, under Hermann Weyl, where he met John von Neumann.

Evoking Claude Shannon 1916-2001 His results overlapped with some of the early work by J. B. S. Haldane on population genetics, of which he seemed to be unaware. It was published in 1993, when most of his results were obtained independently by others.

Evoking Claude Shannon 1916-2001 1942 Already at Bell Labs, where he was a research mathematician for fifteen years, during the World War he worked in fire-control systems for anti-aircraft artillery and in cryptography; in 1943 he met Alan Turing and also developed a mathematical theory of cryptography published, in 1949, as A Communication Theory of Secrecy Systems. 1948 Shannon published his most important work, A mathematical theory of communication, that was explained in the book, co-authored by W. Weaver, The mathematical theory of communication, developing the concept of entropy to measure uncertainty in a message and laying the basis of the mathematical theory of information. 1958 Appointed Donner Professor of Science at MIT, until his retirement in 1978, having been awarded of several prizes, including the National Medal of Science (1966), the Kyoto Prize (1983) and the National Inventors Hall of Fame (2004). 2016 Bell Labs Web exhibit at https://www.bell-labs.com/claude-shannon/

Evoking Claude Shannon 1916-2001 So wide were its repercussions that the theory was described as one of humanity s proudest and rarest creations, a general scientific theory that could profoundly and rapidly alter humanity s view of the world. Few other works of the twentieth century have had a greater impact; he altered most profoundly all aspects of communication theory and practice. Ioan James (2014)

Evoking Claude Shannon 1916-2001

Evoking Claude Shannon 1916-2001 The growth of both communication and computing devices has been explosive in the last century. It was about a hundred years ago that the telephone and phonograph were invented, and these were followed by radio, motion pictures and television. We now have vacuum tubes, transistors, integrated circuits, satellite communication and microwave cable. We have even talked to astronauts on the moon. Our life style has been totally changed by advances in communication. On the computing side we started the twentieth century with slide rules and adding machines. These were followed in quantum jumps by Bush analog computers, Stibitz and Aiken relay computers, Eckert and Mauchly vacuum tube machines..., transistor computers and, finally, the incredibly compact integrated circuit and chip computers. At each step the computers became faster, cheaper and more powerful. These hardware revolutions were matched by equally impressive developments in programming. Shannon (1983) References I. James, Claude Elwood Shannon 1916 2001 Bull. London Math. Soc. 46 (2014) 435 440 S. W. Golomb, E. Berlekamp, T. M. Cover, R. G. Gallager, J. L. Massey and A. J. Viterbi, Claude Elwood Shannon (1916 2001), Notices American Math. Soc. 49 (2002) 9-16