CPE/EE 427, CPE 527 VLSI Design I L01: Introduction, Design Metrics Aleksandar Milenkovic ( www.ece.uah.edu/~milenka ) www.ece.uah.edu/~milenka/cpe527-05f What is this course all about? Introduction to digital integrated circuits. CMOS devices and manufacturing technology. CMOS inverters and gates. Propagation delay, noise margins, and power dissipation. Sequential circuits. Arithmetic, interconnect, and memories. Design methodologies. What will you learn? Understanding, designing, and optimizing digital circuits with respect to different quality metrics: cost, speed, power dissipation, and reliability 8/31/2005 VLSI Design I; A. Milenkovic 2 VLSI Design I; A. Milenkovic 1
Digital Integrated Circuits Introduction: Issues in digital design The CMOS inverter Combinational logic structures Sequential logic gates Design methodologies Interconnect: R, L and C Timing Arithmetic building blocks Memories and array structures 8/31/2005 VLSI Design I; A. Milenkovic 3 Why does it matter? 8/31/2005 VLSI Design I; A. Milenkovic 4 VLSI Design I; A. Milenkovic 2
A Brief History 1947: First Transistor at Bell Lab [John Bardeen and Walter Brattain] 1958: First Integrated circuit at Texas Instruments [Jack Kilby] 1965: Moore s Law, Intel [Gordon Moore] 1994: Integrated circuits became $100B/year business 2003: Industry manufactured 10 18 (one quintillion) transistors (200M per human being) 8/31/2005 VLSI Design I; A. Milenkovic 5 The First Computer The Babbage Difference Engine (1832) 25,000 parts cost: 17,470 8/31/2005 VLSI Design I; A. Milenkovic 6 VLSI Design I; A. Milenkovic 3
ENIAC - The first electronic computer (1946) Vacuum tube based digital computer The Giant Brain as labeled by the press ENIAC facts Occupied 1,800 sq. feet Weighted 30 tons 18000 vacuum tubes Application: calculate firing tables for World War II artillery guns 8/31/2005 VLSI Design I; A. Milenkovic 7 The Transistor Revolution First transistor Bell Labs, 1948 8/31/2005 VLSI Design I; A. Milenkovic 8 VLSI Design I; A. Milenkovic 4
The First Integrated Circuits Bipolar logic 1960 s ECL 3-input Gate Motorola 1966 8/31/2005 VLSI Design I; A. Milenkovic 9 IC Evolution SSI Small Scale Integration (early 1970s) contained 1 10 logic gates MSI Medium Scale Integration logic functions, counters LSI Large Scale Integration first microprocessors on the chip VLSI Very Large Scale Integration now offers 64-bit microprocessors, complete with cache memory (L1 and often L2), floating-point arithmetic unit(s), etc. 8/31/2005 VLSI Design I; A. Milenkovic 10 VLSI Design I; A. Milenkovic 5
IC Evolution Bipolar technology TTL (transistor-transistor logic), 1962; higher integration density ECL (emitter-coupled logic), 1974; high-performance MOS (Metal-oxide-silicon) although invented before bipolar transistor (1925, 1935), was initially difficult to manufacture nmos (n-channel MOS) technology developed in late 1970s required fewer masking steps, was denser, and consumed less power than equivalent bipolar ICs => an MOS IC was cheaper than a bipolar IC and led to investment and growth of the MOS IC market. aluminum gates for replaced by polysilicon by early 1980 CMOS (Complementary MOS): n-channel and p-channel MOS transistors => lower power consumption, simplified fabrication process 8/31/2005 VLSI Design I; A. Milenkovic 11 Intel 4004 Introduction date: November 15, 1971 Clock speed: 108 KHz Number of transistors: 2,300 (10 microns) Bus width: 4 bits Addressable memory: 640 bytes Typical use: calculator, first microcomputer chip, arithmetic manipulation 8/31/2005 VLSI Design I; A. Milenkovic 12 VLSI Design I; A. Milenkovic 6
0.18-micron process technology (2, 1.9, 1.8, 1.7, 1.6, 1.5, and 1.4 GHz) Introduction date: August 27, 2001 (2, 1.9 GHz);...; November 20, 2000 (1.5, 1.4 GHz) Level Two cache: 256 KB Advanced Transfer Cache (Integrated) System Bus Speed: 400 MHz SSE2 SIMD Extensions Transistors: 42 Million Typical Use: Desktops and entrylevel workstations 0.13-micron process technology (2.53, 2.2, 2 GHz) Introduction date: January 7, 2002 Level Two cache: 512 KB Advanced Transistors: 55 Million Pentium 4 8/31/2005 VLSI Design I; A. Milenkovic 13 Introduction date: Mid 2002 Caches: 32KB L1, 256 KB L2, 3MB L3 (on-chip) Clock: 1GHz Transistors: 221 Million Area: 464mm 2 Typical Use: High-end servers Future versions: 5GHz, 0.13-micron technology Intel s McKinley 8/31/2005 VLSI Design I; A. Milenkovic 14 VLSI Design I; A. Milenkovic 7
Moore s Law In 1965, Gordon Moore noted that the number of transistors on a chip doubled every 18 to 24 months. He made a prediction that semiconductor technology will double its effectiveness every 18 months 8/31/2005 VLSI Design I; A. Milenkovic 15 Moore s Law LOG 2 OF THE NUMBER OF COMPONENTS PER INTEGRATED FUNCTION 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 1959 1960 1961 1962 1963 1964 1965 1966 1967 1968 1969 1970 1971 1972 1973 1974 1975 Electronics, April 19, 1965. 8/31/2005 VLSI Design I; A. Milenkovic 16 VLSI Design I; A. Milenkovic 8
Evolution in Complexity 8/31/2005 VLSI Design I; A. Milenkovic 17 Transistor Counts 1,000,000 K 1 Billion Transistors 100,000 10,000 1,000 100 10 Pentium III Pentium II Pentium Pro i486 Pentium i386 80286 8086 1 1975 1980 1985 1990 1995 2000 2005 2010 Courtesy, Intel Projected Source: Intel 8/31/2005 VLSI Design I; A. Milenkovic 18 VLSI Design I; A. Milenkovic 9
Moore s law in Microprocessors Transistors (MT) 1000 100 10 1 0.1 0.01 0.001 2X growth in 1.96 years! 286 386 8085 8086 4004 8008 8080 P6 Pentium proc 486 1970 1980 1990 2000 2010 Year Transistors on Lead Microprocessors double every 2 years Courtesy, Intel 8/31/2005 VLSI Design I; A. Milenkovic 19 Die Size Growth 100 Die size (mm) 10 8080 8085 8008 4004 8086 286386 P6 486 Pentium proc ~7% growth per year ~2X growth in 10 years 1 1970 1980 1990 2000 2010 Year Die size grows by 14% to satisfy Moore s Law Courtesy, Intel 8/31/2005 VLSI Design I; A. Milenkovic 20 VLSI Design I; A. Milenkovic 10
Frequency Frequency (Mhz) 10000 1000 100 10 1 0.1 Doubles every 2 years P6 Pentium proc 486 8085 386 8086 286 8080 8008 4004 1970 1980 1990 2000 2010 Year Lead Microprocessors frequency doubles every 2 years Courtesy, Intel 8/31/2005 VLSI Design I; A. Milenkovic 21 Power Dissipation 100 Power (Watts) 10 1 8085 8080 8008 4004 8086 286 386 486 P6 Pentium proc 0.1 1971 1974 1978 1985 1992 2000 Year Lead Microprocessors power continues to increase Courtesy, Intel 8/31/2005 VLSI Design I; A. Milenkovic 22 VLSI Design I; A. Milenkovic 11
Power will be a major problem Power (Watts) 100000 10000 1000 100 10 1 8085 8086286 386 486 4004 80088080 Pentium proc 18KW 5KW 1.5KW 500W 0.1 1971 1974 1978 1985 1992 2000 2004 2008 Year Power delivery and dissipation will be prohibitive Courtesy, Intel 8/31/2005 VLSI Design I; A. Milenkovic 23 Power density Power Density (W/cm2) 10000 1000 100 10 1 4004 8008 8080 Rocket Nozzle Nuclear Reactor 8086 Hot Plate 8085 286 386 486 P6 Pentium proc 1970 1980 1990 2000 2010 Year Power density too high to keep junctions at low temp Courtesy, Intel 8/31/2005 VLSI Design I; A. Milenkovic 24 VLSI Design I; A. Milenkovic 12
Technology Directions: SIA Roadmap Year 1999 2002 2005 2008 2011 2014 Feature size (nm) 180 130 100 70 50 35 Logic trans/cm 2 6.2M 18M 39M 84M 180M 390M Cost/trans (mc) 1.735.580.255.110.049.022 #pads/chip 1867 2553 3492 4776 6532 8935 Clock (MHz) 1250 2100 3500 6000 10000 16900 Chip size (mm 2 ) 340 430 520 620 750 900 Wiring levels 6-7 7 7-8 8-9 9 10 Power supply (V) 1.8 1.5 1.2 0.9 0.6 0.5 High-perf pow (W) 90 130 160 170 175 183 8/31/2005 VLSI Design I; A. Milenkovic 25 Not Only Microprocessors Cell Phone Small Signal RF Power RF Units Digital Cellular Market (Phones Shipped) 1996 1997 1998 1999 2000 48M 86M 162M 260M 435M Power Management Analog Baseband Digital Baseband (DSP + MCU) (data from Texas Instruments) 8/31/2005 VLSI Design I; A. Milenkovic 26 VLSI Design I; A. Milenkovic 13
Why Scaling? Technology shrinks by 0.7/generation With every generation can integrate 2x more functions per chip; chip cost does not increase significantly Cost of a function decreases by 2x But How to design chips with more and more functions? Design engineering population does not double every two years Hence, a need for more efficient design methods Exploit different levels of abstraction 8/31/2005 VLSI Design I; A. Milenkovic 27 Design Abstraction Levels SYSTEM + MODULE GATE CIRCUIT S n+ G DEVICE D n+ 8/31/2005 VLSI Design I; A. Milenkovic 28 VLSI Design I; A. Milenkovic 14
Microscopic issues ultra-high speeds power dissipation and supply rail drop growing importance of interconnect noise, crosstalk reliability, manufacturability clock distribution Major Design Challenges Macroscopic issues time-to-market design complexity (millions of gates) high levels of abstractions design for test reuse and IP, portability systems on a chip (SoC) tool interoperability Year Tech. Complexity Frequency 3 Yr. Design Staff Size Staff Costs 1997 0.35 13 M Tr. 400 MHz 210 $90 M 1998 0.25 20 M Tr. 500 MHz 270 $120 M 1999 0.18 32 M Tr. 600 MHz 360 $160 M 2002 0.13 130 M Tr. 800 MHz 800 $360 M 8/31/2005 VLSI Design I; A. Milenkovic 29 Productivity Trends 10,000,000 10,000 1,000,000 1,000 100,000 100 10,000 10 1,0001 100 0.1 0.01 10 Logic Tr./Chip Tr./Staff Month. x x x x x x x x 58%/Yr. compounded Complexity growth rate 21%/Yr. compound Productivity growth rate 100,000,000 10,000,000 1,000,000 100,000 10,000 1,0001 100 0.1 0.001 1 10 0.01 1981 1983 1985 1987 1989 1991 1993 1995 1997 1999 2001 2003 2005 2007 2009 Complexity Logic Transistor per Chip (M) Productivity (K) Trans./Staff - Mo. Source: Sematech Complexity outpaces design productivity Courtesy, ITRS Roadmap 8/31/2005 VLSI Design I; A. Milenkovic 30 VLSI Design I; A. Milenkovic 15
Fundamental Design Metrics Functionality Cost NRE (fixed) costs - design effort RE (variable) costs - cost of parts, assembly, test Reliability, robustness Noise margins Noise immunity Performance Speed (delay) Power consumption; energy Time-to-market 8/31/2005 VLSI Design I; A. Milenkovic 31 Cost of Integrated Circuits NRE (non-recurring engineering) costs Fixed cost to produce the design design effort design verification effort mask generation Influenced by the design complexity and designer productivity More pronounced for small volume products Recurring costs proportional to product volume silicon processing also proportional to chip area assembly (packaging) test Cost per IC = Variable cost per IC + Fixed cost Volume 8/31/2005 VLSI Design I; A. Milenkovic 32 VLSI Design I; A. Milenkovic 16
NRE Cost is Increasing 8/31/2005 VLSI Design I; A. Milenkovic 33 Cost per Transistor cost: -per-transistor 1 0.1 0.01 0.001 0.0001 0.00001 0.000001 Fabrication capital cost per transistor (Moore s law) 0.0000001 1982 1985 1988 1991 1994 1997 2000 2003 2006 2009 2012 8/31/2005 VLSI Design I; A. Milenkovic 34 VLSI Design I; A. Milenkovic 17
Silicon Wafer Single die Wafer From http://www.amd.com Going up to 12 (30cm) 8/31/2005 VLSI Design I; A. Milenkovic 35 Recurring Costs Variable cost = Die cost + Testing cost + Packaging cost Final test yield Cost of Cost of wafer die = Dies per wafer Die yield 8/31/2005 VLSI Design I; A. Milenkovic 36 VLSI Design I; A. Milenkovic 18
Dies per Wafer Dies per wafer = π (Wafer diameter/2) Die area 2 π Wafer diameter 2 Die area 8/31/2005 VLSI Design I; A. Milenkovic 37 Yield Defects per unit area Die area Die yield = Wafer yield 1+ α α is approximately 3 α die cost = f 4 (die area) 8/31/2005 VLSI Design I; A. Milenkovic 38 VLSI Design I; A. Milenkovic 19
Examples of Cost Metrics (1994) Chip 386DX 486DX2 PowerPC 601 HP PA 7100 DEC Alpha Super SPARC Pentium Metal layers 2 3 4 3 3 3 3 Line width 0.90 0.80 0.80 0.80 0.70 0.70 0.80 Wafer cost $900 $1200 $1700 $1300 $1500 $1700 $1500 Defects /cm 2 1.0 1.0 1.3 1.0 1.2 1.6 1.5 Area (mm 2 ) 43 81 121 196 234 256 296 Dies/ wafer 360 181 115 66 53 48 40 Yield 71% 54% 28% 27% 19% 13% 9% Die cost $4 $12 $53 $73 $149 $272 $417 8/31/2005 VLSI Design I; A. Milenkovic 39 Yield Example Example #1: 20-cm wafer for a die that is 1.5 cm on a side. Solution: Die area = 1.5x1.5 = 2.25cm2. Dies per wafer = 3.14x(20/2)2/2.25 3.14x20/(2x2.5)0.5=110. Example #2 wafer size of 12 inches, die size of 2.5 cm2, 1 defects/cm2, α = 3 (measure of manufacturing process complexity) 252 dies/wafer (remember, wafers round & dies square) die yield of 16% 252 x 16% = only 40 dies/wafer die yield! Die cost is strong function of die area proportional to the third or fourth power of the die area 8/31/2005 VLSI Design I; A. Milenkovic 40 VLSI Design I; A. Milenkovic 20
Functionality and Robustness Prime requirement IC performs the function it is designed for Normal behavior deviates due to variations in the manufacturing process (dimensions and device parameters vary between runs and even on a single wafer or die) presence of disturbing on- or off-chip noise sources Noise: Unwanted variation of voltages or currents at the logic nodes 8/31/2005 VLSI Design I; A. Milenkovic 41 Reliability Noise in Digital Integrated Circuits i(t) v(t) V DD Inductive coupling Capacitive coupling Power and ground noise from two wires placed side by side inductive coupling current change on one wire can influence signal on the neighboring wire capacitive coupling voltage change on one wire can influence signal on the neighboring wire cross talk from noise on the power and ground supply rails can influence signal levels in the gate 8/31/2005 VLSI Design I; A. Milenkovic 42 VLSI Design I; A. Milenkovic 21
Example of Capacitive Coupling Signal wire glitches as large as 80% of the supply voltage will be common due to crosstalk between neighboring wires as feature sizes continue to scale Crosstalk vs. Technology Pulsed Signal 0.12m CMOS 0.16m CMOS Black line quiet Red lines pulsed Glitches strength vs technology 0.25m CMOS 0.35m CMOS From Dunlop, Lucent, 2000 8/31/2005 VLSI Design I; A. Milenkovic 43 Static Gate Behavior Steady-state parameters of a gate static behavior tell how robust a circuit is with respect to both variations in the manufacturing process and to noise disturbances. Digital circuits perform operations on Boolean variables x {0,1} A logical variable is associated with a nominal voltage level for each logic state 1 V OH and 0 V OL V(x) V(y) V OH =! (V OL ) V OL =! (V OH ) Difference between V OH and V OL is the logic or signal swing V sw 8/31/2005 VLSI Design I; A. Milenkovic 44 VLSI Design I; A. Milenkovic 22
DC Operation Voltage Transfer Characteristic V(y) V OH = f (V IL ) f V(x) V(y) V OH = f(v OL ) V OL = f(v OH ) V M = f(v M ) V(y)=V(x) V M Switching Threshold V OL = f (V IH ) V IL V IH V(x) 8/31/2005 VLSI Design I; A. Milenkovic 45 Mapping between analog and digital signals The regions of acceptable high and low voltages are delimited by VIH and VIL that represent the points on the VTC curve where the gain = -1 (dvout/dvin) 1 V OH V out V OH Slope = -1 V IH Undefined Region V IL Slope = -1 0 V OL V OL V IL V IH V in 8/31/2005 VLSI Design I; A. Milenkovic 46 VLSI Design I; A. Milenkovic 23
Definition of Noise Margins For robust circuits, want the 0 and 1 intervals to be as large as possible V DD V DD V OH Noise Margin High Noise Margin Low V OL Gnd Gnd Gate Output NM H = V OH -V IH NM L = V IL -V OL Gate Input "1" V IH Undefined Region V IL "0" Gnd Large noise margins are desirable, but not sufficient 8/31/2005 VLSI Design I; A. Milenkovic 47 The Regenerative Property A gate with regenerative property ensure that a disturbed signal converges back to a nominal voltage level v 0 v 1 v 2 v 3 v 4 v 5 v 6 5 v 2 V (volts) 3 1 v 0 v 1-1 0 2 4 6 8 10 t (nsec) 8/31/2005 VLSI Design I; A. Milenkovic 48 VLSI Design I; A. Milenkovic 24
Conditions for Regeneration v 0 v 1 v 2 v 3 v 4 v 5 v 6 v 1 = f(v 0 ) v 1 = finv(v 2 ) v 3 f(v) finv(v) v 1 v 1 finv(v) v 3 f(v) v 2 v 0 v 0 v 2 Regenerative Gate Nonregenerative Gate To be regenerative, the VTC must have a transient region with a gain greater than 1 (in absolute value) bordered by two valid zones where the gain is smaller than 1. Such a gate has two stable operating points. 8/31/2005 VLSI Design I; A. Milenkovic 49 Noise Immunity Noise margin expresses the ability of a circuit to overpower a noise source noise sources: supply noise, cross talk, interference, offset Absolute noise margin values are deceptive a floating node is more easily disturbed than a node driven by a low impedance (in terms of voltage) Noise immunity expresses the ability of the system to process and transmit information correctly in the presence of noise For good noise immunity, the signal swing (i.e., the difference between V OH and V OL ) and the noise margin have to be large enough to overpower the impact of fixed sources of noise 8/31/2005 VLSI Design I; A. Milenkovic 50 VLSI Design I; A. Milenkovic 25
Directivity A gate must be undirectional: changes in an output level should not appear at any unchanging input of the same circuit In real circuits full directivity is an illusion (e.g., due to capacitive coupling between inputs and outputs) Key metrics: output impedance of the driver and input impedance of the receiver ideally, the output impedance of the driver should be zero input impedance of the receiver should be infinity 8/31/2005 VLSI Design I; A. Milenkovic 51 Fan-In and Fan-Out Fan-out number of load gates connected to the output of the driving gate gates with large fan-out are slower N Fan-in the number of inputs to the gate gates with large fan-in are bigger and slower M 8/31/2005 VLSI Design I; A. Milenkovic 52 VLSI Design I; A. Milenkovic 26
( V ) V o u t The Ideal Inverter The ideal gate should have infinite gain in the transition region a gate threshold located in the middle of the logic swing high and low noise margins equal to half the swing input and output impedances of infinity and zero, resp. V out R i = R o = 0 g = - Fanout = NM H = NM L = VDD/2 8/31/2005 VLSI Design I; A. Milenkovic 53 V in 5.0 An Old-time Inverter 4.0 NM L 3.0 2.0 V M 1.0 NM H 0.0 1.0 2.0 3.0 4.0 5.0 V in (V) 8/31/2005 VLSI Design I; A. Milenkovic 54 VLSI Design I; A. Milenkovic 27
Delay Definitions V in V out V in input waveform Propagation delay? t V out output waveform signal slopes? t 8/31/2005 VLSI Design I; A. Milenkovic 55 Delay Definitions V in V out input waveform V in 50% Propagation delay t p = (t phl +t plh )/2 t phl t plh t V out output waveform 50% 90% signal slopes t f 10% t r t 8/31/2005 VLSI Design I; A. Milenkovic 56 VLSI Design I; A. Milenkovic 28
Modeling Propagation Delay Model circuit as first-order RC network v out (t) = (1 e t/τ )V R v out where τ = RC v in C Time to reach 50% point is t = ln(2) τ = 0.69 τ Time to reach 90% point is t = ln(9) τ = 2.2 τ Matches the delay of an inverter gate 8/31/2005 VLSI Design I; A. Milenkovic 57 Power and Energy Dissipation Power consumption: how much energy is consumed per operation and how much heat the circuit dissipates supply line sizing (determined by peak power) P peak = V dd i peak battery lifetime (determined by average power dissipation) p(t) = v(t)i(t) = V dd i(t) P avg = 1/T p(t) dt = V dd /T i dd (t) dt packaging and cooling requirements Two important components: static and dynamic E (joules) = C L V dd 2 P 0 1 + t sc V dd I peak P 0 1 + V dd I leakage f 0 1 = P 0 1 * f clock P (watts) = C L V dd2 f 0 1 + t sc V dd I peak f 0 1 + V dd I leakage 8/31/2005 VLSI Design I; A. Milenkovic 58 VLSI Design I; A. Milenkovic 29
Power and Energy Dissipation Propagation delay and the power consumption of a gate are related Propagation delay is (mostly) determined by the speed at which a given amount of energy can be stored on the gate capacitors the faster the energy transfer (higher power dissipation) the faster the gate For a given technology and gate topology, the product of the power consumption and the propagation delay is a constant Power-delay product (PDP) energy consumed by the gate per switching event An ideal gate is one that is fast and consumes little energy, so the ultimate quality metric is Energy-delay product (EDP) = power-delay 2 8/31/2005 VLSI Design I; A. Milenkovic 59 Summary Digital integrated circuits have come a long way and still have quite some potential left for the coming decades Some interesting challenges ahead Getting a clear perspective on the challenges and potential solutions is the purpose of this course Understanding the design metrics that govern digital design is crucial Cost, reliability, speed, power and energy dissipation 8/31/2005 VLSI Design I; A. Milenkovic 60 VLSI Design I; A. Milenkovic 30