ECE-517 Reinforcement Learning in Artificial Intelligence
|
|
- Caitlin Parks
- 5 years ago
- Views:
Transcription
1 ECE-57 Reinforcemen Lerning in Arificil Inelligence Lecure 7: Finie Horizon MDPs, Dynmic Progrmming Sepember 0, 205 Dr. Imr Arel College of Engineering Deprmen of Elecricl Engineering nd Compuer Science The Universiy of Tennessee Fll 205
2 Ouline Finie Horizon MDPs Dynmic Progrmming ECE 57 - Reinforcemen Lerning in AI 2
3 ECE 57 - Reinforcemen Lerning in AI 3 Finie Horizon MDPs lue Funcions The durion, or expeced durion, of he process is finie Le s consider he following reurn funcions: The expeced sum of rewrds The expeced discouned sum of rewrds sufficien condiion for he bove o converge is r < r mx ) ( lim lim ) ( 0 s E s s r E s 0 lim ) ( 0 s s r E s expeced sum of rewrds for seps
4 Reurn funcions If r < r mx holds, hen rmx rmx noe h his bound is very sensiive o he vlue of The expeced verge rewrd M lim E r s0 lim s oe h he bove limi does no lwys exis! ECE 57 - Reinforcemen Lerning in AI 4
5 Relionship beween (s) nd (s) Consider finie horizon problem where he horizon is rndom, i.e. E E r s0 Le s lso ssume h he finl vlue for ll ses is zero Le be geomericlly disribued wih prmeer, such h he probbiliy of sopping he h sep is Pr n n s Lemm: we ll show h under he ssumpion h r < r mx ECE 57 - Reinforcemen Lerning in AI 5
6 ECE 57 - Reinforcemen Lerning in AI 6 Relionship beween nd (con.) (s) ) (s ) ( ) ( s r E r E r E r E s n n n n n Proof:
7 Ouline Finie Horizon MDPs (con.) Dynmic Progrmming ECE 57 - Reinforcemen Lerning in AI 7
8 Exmple of finie horizon MDP Consider he following se digrm: {5,0.5} {5,0.5} S S {-,) 2 {0,} ECE 57 - Reinforcemen Lerning in AI 8
9 Why do we need DP echniques? Explicily solving he Bellmn Opimliy equion is hrd Compuing he opiml policy solve he RL problem Relies on he following hree ssumpions We hve perfec knowledge of he dynmics of he environmen We hve enough compuionl resources The Mrkov propery holds In reliy, ll hree re problemic e.g. Bckgmmon gme: firs nd ls condiions re ok, bu compuionl resources re insufficien Approx se In mny cses we hve o sele for pproxime soluions (much more on h ler ) ECE 57 - Reinforcemen Lerning in AI 9
10 Big Picure: Elemenry Soluion Mehods During he nex few weeks we ll lk bou echniques for solving he RL problem Dynmic progrmming well developed, mhemiclly, bu requires n ccure model of he environmen Mone Crlo mehods do no require model, bu re no suible for sep-by-sep incremenl compuion Temporl difference lerning mehods h do no need model nd re fully incremenl More complex o nlyze Lunched he revisiing of RL s prgmic frmework (988) The mehods lso differ in efficiency nd speed of convergence o he opiml soluion ECE 57 - Reinforcemen Lerning in AI 0
11 Dynmic Progrmming Dynmic progrmming is he collecion of lgorihms h cn be used o compue opiml policies given perfec model of he environmen s n MDP DP consiues heoreiclly opiml mehodology In reliy ofen limied since DP is compuionlly expensive Imporn o undersnd reference o oher models Do jus s well s DP Require less compuions Possibly require less memory Mos schemes will srive o chieve he sme effec s DP, wihou he compuionl complexiy involved ECE 57 - Reinforcemen Lerning in AI
12 Dynmic Progrmming (con.) We will ssume finie MDPs (ses nd cions) The gen hs knowledge of rnsiion probbiliies nd expeced immedie rewrds, i.e. P R ss' ss' Pr s s' s s, E r The key ide of DP (s in RL) is he use of vlue funcions o derive opiml/good policies We ll focus on he mnner by which vlues re compued Reminder: n opiml policy is esy o derive once he opiml vlue funcion (or cion-vlue funcion) is ined s s,, s s' ECE 57 - Reinforcemen Lerning in AI 2
13 Dynmic Progrmming (con.) Employing he Bellmn equion o he opiml vlue/ cion-vlue funcion, yields Q * * ( s, ) mx s' s' P ss' P ss' R ss' ( s') DP lgorihms re obined by urning he Bellmn equions ino upde rules These rules help improve he pproximions of he desired vlue funcions We will discuss wo min pproches: policy ierion nd vlue ierion R ss' * mx Q * ( s', ') ECE 57 - Reinforcemen Lerning in AI 3
14 Mehod #: Policy Ierion Technique for obining he opiml policy Comprises of wo complemening seps Policy evluion upding he vlue funcion in view of curren policy (which cn be sub-opiml) Policy improvemen upding he policy given he curren vlue funcion (which cn be sub-opiml) The process converges by bouncing beween hese wo seps 2 * *, 2 ECE 57 - Reinforcemen Lerning in AI 4
15 Policy Evluion We ll consider how o compue he se-vlue funcion for n rbirry policy Recll h 0 (ssumes h policy is lwys followed) The exisence of unique soluion is gurneed s long s eiher < or evenul erminion is gurneed from ll ses under he policy The Bellmn equion rnsles ino S simulneous equions wih S unknowns (he vlues) Assuming we hve n iniil guess, we cn use he Bellmn equion s n upde rule ECE 57 - Reinforcemen Lerning in AI 5
16 Policy Evluion (con.) We cn wrie k The sequence { k } converges o he correc vlue funcion s k In ech ierion, ll se-vlues re upded.k.. full bckup ( s, ) Pss' Rss' k ( s' A similr mehod cn be pplied o se-cion (Q(s,)) funcions An underlying ssumpion: ll ses re visied ech ime Scheme is compuionlly hevy Cn be disribued given sufficien resources (Q: How?) In-plce schemes use single rry nd upde vlues bsed on new esimes Also converge o he correc soluion s' Order in which ses re bcked up deermines re of convergence ) ECE 57 - Reinforcemen Lerning in AI 6
17 Ierive Policy Evluion lgorihm A key considerion is he erminion condiion Typicl sopping condiion for ierive policy evluion is mx ( s) ss k k 0 ECE 57 - Reinforcemen Lerning in AI 7
18 Policy Improvemen Policy evluion dels wih finding he vlue funcion under given policy However, we don know if he policy (nd hence he vlue funcion) is opiml Policy improvemen hs o do wih he bove, nd wih upding he policy if non-opiml vlues re reched Suppose h for some rbirry policy,, we ve compued he vlue funcion (using policy evluion) Le policy be defined such h in ech se s i selecs cion h mximizes he firs-sep vlue, i.e. def '( s) rg mx P R s' I cn be shown h is les s good s, nd if hey re equl hey re boh he opiml policy. ss' ss' ( s') ECE 57 - Reinforcemen Lerning in AI 8
19 Policy Improvemen (con.) Consider greedy policy,, h selecs he cion h would yield he highes expeced single-sep reurn ' Then, by definiion, rg mx rg mx Q Q s' ( s, ) his is he condiion for he policy improvemen heorem. The bove ses h following he new policy one sep is enough o prove h i is beer policy, i.e. h P ss' R ss' s, ' ' ( s') ECE 57 - Reinforcemen Lerning in AI 9
20 Proof of he Policy Improvemen Theorem 0 ECE 57 - Reinforcemen Lerning in AI 20
21 Policy Ierion 0 ECE 57 - Reinforcemen Lerning in AI 2
ECE-517 Reinforcement Learning in Artificial Intelligence
ECE-517 Reinforcemen Learning in Arificial Inelligence Lecure 11: Temporal Difference Learning (con.), Eligibiliy Traces Ocober 8, 2015 Dr. Iamar Arel College of Engineering Deparmen of Elecrical Engineering
More informationLecture #7: Discrete-time Signals and Sampling
EEL335: Discree-Time Signals and Sysems Lecure #7: Discree-ime Signals and Sampling. Inroducion Lecure #7: Discree-ime Signals and Sampling Unlike coninuous-ime signals, discree-ime signals have defined
More informationGo over Quizzes 2 and 4. Introduction to pipelining Maybe hazards
Pipelining 1 Tody Go over Quizzes 2 nd 4. Inroduion o pipelining Mybe hzrds 2 Pipelining Cyle 1 10n (10ns) Cyle 2 20n (10ns) Cyle 3 30n (10ns) Wh s he leny for one uni of work? Wh s he hroughpu? Pipelining
More informationDC electrical circuits
D elecicl cicuis hpe 8 lecomoive Foce Poenil Diffeences esisos in pllel nd seies icuis wih pcios Beies nd Geneos uen is poduced y pplying poenil diffeence coss conduco (V/). This poenil diffeence is se
More information4.5 Biasing in BJT Amplifier Circuits
4/5/011 secion 4_5 Biasing in MOS Amplifier Circuis 1/ 4.5 Biasing in BJT Amplifier Circuis eading Assignmen: 8086 Now le s examine how we C bias MOSFETs amplifiers! f we don bias properly, disorion can
More informationEE 330 Lecture 24. Amplification with Transistor Circuits Small Signal Modelling
EE 330 Lecure 24 Amplificaion wih Transisor Circuis Small Signal Modelling Review from las ime Area Comparison beween BJT and MOSFET BJT Area = 3600 l 2 n-channel MOSFET Area = 168 l 2 Area Raio = 21:1
More informationMarch 13, 2009 CHAPTER 3: PARTIAL DERIVATIVES AND DIFFERENTIATION
March 13, 2009 CHAPTER 3: PARTIAL DERIVATIVES AND DIFFERENTIATION 1. Parial Derivaives and Differeniable funcions In all his chaper, D will denoe an open subse of R n. Definiion 1.1. Consider a funcion
More informationEXPERIMENT #4 AM MODULATOR AND POWER AMPLIFIER
EXPERIMENT #4 AM MODULATOR AND POWER AMPLIFIER INTRODUCTION: Being able o ransmi a radio frequency carrier across space is of no use unless we can place informaion or inelligence upon i. This las ransmier
More informationCommunications II Lecture 7: Performance of digital modulation
Communicaions II Lecure 7: Performance of digial modulaion Professor Kin K. Leung EEE and Compuing Deparmens Imperial College London Copyrigh reserved Ouline Digial modulaion and demodulaion Error probabiliy
More information10. The Series Resistor and Inductor Circuit
Elecronicsab.nb 1. he Series esisor and Inducor Circui Inroducion he las laboraory involved a resisor, and capacior, C in series wih a baery swich on or off. I was simpler, as a pracical maer, o replace
More informationMATLAB/SIMULINK TECHNOLOGY OF THE SYGNAL MODULATION
J Modern Technology & Engineering Vol2, No1, 217, pp76-81 MATLAB/SIMULINK TECHNOLOGY OF THE SYGNAL MODULATION GA Rusamov 1*, RJ Gasimov 1, VG Farhadov 1 1 Azerbaijan Technical Universiy, Baku, Azerbaijan
More informationPointwise Image Operations
Poinwise Image Operaions Binary Image Analysis Jana Kosecka hp://cs.gmu.edu/~kosecka/cs482.hml - Lookup able mach image inensiy o he displayed brighness values Manipulaion of he lookup able differen Visual
More informationMAXIMUM FLOWS IN FUZZY NETWORKS WITH FUNNEL-SHAPED NODES
MAXIMUM FLOWS IN FUZZY NETWORKS WITH FUNNEL-SHAPED NODES Romn V. Tyshchuk Informtion Systems Deprtment, AMI corportion, Donetsk, Ukrine E-mil: rt_science@hotmil.com 1 INTRODUCTION During the considertion
More informationLab 3 Acceleration. What You Need To Know: Physics 211 Lab
b Lab 3 Acceleraion Wha You Need To Know: The Physics In he previous lab you learned ha he velociy of an objec can be deermined by finding he slope of he objec s posiion vs. ime graph. x v ave. = v ave.
More informationEECE 301 Signals & Systems Prof. Mark Fowler
EECE 3 Signals & Sysems Prof. Mark Fowler Noe Se #8 C-T Sysems: Frequency-Domain Analysis of Sysems Reading Assignmen: Secion 5.2 of Kamen and Heck /2 Course Flow Diagram The arrows here show concepual
More informationNotes on the Fourier Transform
Noes on he Fourier Transform The Fourier ransform is a mahemaical mehod for describing a coninuous funcion as a series of sine and cosine funcions. The Fourier Transform is produced by applying a series
More information5 Spatial Relations on Lines
5 Spaial Relaions on Lines There are number of useful problems ha can be solved wih he basic consrucion echniques developed hus far. We now look a cerain problems, which involve spaial relaionships beween
More informationEXPERIMENT #9 FIBER OPTIC COMMUNICATIONS LINK
EXPERIMENT #9 FIBER OPTIC COMMUNICATIONS LINK INTRODUCTION: Much of daa communicaions is concerned wih sending digial informaion hrough sysems ha normally only pass analog signals. A elephone line is such
More informationFigure A linear pair? Explain. No, because vertical angles are not adjacent angles, and linear pairs are.
Geomery Review of PIL KEY Name: Parallel and Inersecing Lines Dae: Per.: PIL01: Use complemenary supplemenary and congruen o compare wo angles. 1) Complee he following definiion: Two angles are Complemenary
More informationEE201 Circuit Theory I Fall
EE1 Circui Theory I 17 Fall 1. Basic Conceps Chaper 1 of Nilsson - 3 Hrs. Inroducion, Curren and Volage, Power and Energy. Basic Laws Chaper &3 of Nilsson - 6 Hrs. Volage and Curren Sources, Ohm s Law,
More informationThe University of Melbourne Department of Mathematics and Statistics School Mathematics Competition, 2013 JUNIOR DIVISION Time allowed: Two hours
The Universiy of Melbourne Deparmen of Mahemaics and Saisics School Mahemaics Compeiion, 203 JUNIOR DIVISION Time allowed: Two hours These quesions are designed o es your abiliy o analyse a problem and
More informationLecture September 6, 2011
cs294-p29 Seminar on Algorihmic Game heory Sepember 6, 2011 Lecure Sepember 6, 2011 Lecurer: Chrisos H. Papadimiriou Scribes: Aloni Cohen and James Andrews 1 Game Represenaion 1.1 abular Form and he Problem
More informationComparing image compression predictors using fractal dimension
Comparing image compression predicors using fracal dimension RADU DOBRESCU, MAEI DOBRESCU, SEFA MOCAU, SEBASIA ARALUGA Faculy of Conrol & Compuers POLIEHICA Universiy of Buchares Splaiul Independenei 313
More informationOSTROWSKI TYPE FRACTIONAL INTEGRAL INEQUALITIES FOR MT-CONVEX FUNCTIONS
Miskolc Mhemicl Noes HU e-issn 787-43 Vol. 6 (5), No., pp. 49 56 OSTROWSKI TYPE FRACTIONAL INTEGRAL INEQUALITIES FOR MT-CONVEX FUNCTIONS WENJUN LIU Received Ferury, 4 Asrc. Some inequliies of Osrowski
More information(This lesson plan assumes the students are using an air-powered rocket as described in the Materials section.)
The Mah Projecs Journal Page 1 PROJECT MISSION o MArs inroducion Many sae mah sandards and mos curricula involving quadraic equaions require sudens o solve "falling objec" or "projecile" problems, which
More informationMEASUREMENTS OF VARYING VOLTAGES
MEASUREMENTS OF ARYING OLTAGES Measuremens of varying volages are commonly done wih an oscilloscope. The oscilloscope displays a plo (graph) of volage versus imes. This is done by deflecing a sream of
More informationEE Controls Lab #2: Implementing State-Transition Logic on a PLC
Objective: EE 44 - Controls Lb #2: Implementing Stte-rnsition Logic on PLC ssuming tht speed is not of essence, PLC's cn be used to implement stte trnsition logic. he dvntge of using PLC over using hrdwre
More informationAn endogenous bio-economic optimization algorithm to evaluate recovery plans: an application to southern hake
n endogenous bio-economic opimizion lgorihm o evlue recovery plns: n pplicion o souhern hke José-Mrí D Roch* Snigo Cerviño** nd Mrí-José Guiérrez*** *Universidde de Vigo **Insiuo Ocenográfico de Vigo IEO
More informationSolid-state Timer H3CT
Solid-sae Timer H3CT DIN 48 x 48-mm Sandard Size Analog Timer Wide ime range (for 4 series of models); 0.1 s o 30 hrs. Wih H3CT-8H models, he oupu ype can be swiched beween ime limi DPDT and ime limi SPDT
More informationECMA st Edition / June Near Field Communication Wired Interface (NFC-WI)
ECMA-373 1 s Ediion / June 2006 Near Field Communicaion Wired Inerface (NFC-WI) Sandard ECMA-373 1 s Ediion / June 2006 Near Field Communicaion Wired Inerface (NFC-WI) Ecma Inernaional Rue du Rhône 114
More informationSolution of ECE 342 Test 2 S12
Soluion of ECE 342 Tes 2 S2. All quesions regarding superheerodyne receivers refer o his diagram. x c () Anenna B T < B RF < 2 f B = B T Oher Signals f c Mixer f Baseband x RFi RF () x RFo () () () x i
More informationLecture 5: DC-DC Conversion
1 / 31 Lecure 5: DC-DC Conversion ELEC-E845 Elecric Drives (5 ECTS) Mikko Rouimo (lecurer), Marko Hinkkanen (slides) Auumn 217 2 / 31 Learning Oucomes Afer his lecure and exercises you will be able o:
More informationCHAPTER 2 LITERATURE STUDY
CHAPTER LITERATURE STUDY. Introduction Multipliction involves two bsic opertions: the genertion of the prtil products nd their ccumultion. Therefore, there re two possible wys to speed up the multipliction:
More informationDomination and Independence on Square Chessboard
Engineering nd Technology Journl Vol. 5, Prt, No. 1, 017 A.A. Omrn Deprtment of Mthemtics, College of Eduction for Pure Science, University of bylon, bylon, Irq pure.hmed.omrn@uobby lon.edu.iq Domintion
More informationSignals and the frequency domain ENGR 40M lecture notes July 31, 2017 Chuan-Zheng Lee, Stanford University
Signals and he requency domain ENGR 40M lecure noes July 3, 07 Chuan-Zheng Lee, Sanord Universiy signal is a uncion, in he mahemaical sense, normally a uncion o ime. We oen reer o uncions as signals o
More information16.5 ADDITIONAL EXAMPLES
16.5 ADDITIONAL EXAMPLES For reiew purposes, more examples of boh piecewise linear and incremenal analysis are gien in he following subsecions. No new maerial is presened, so readers who do no need addiional
More informationOPERATION MANUAL. Indoor unit for air to water heat pump system and options EKHBRD011AAV1 EKHBRD014AAV1 EKHBRD016AAV1
OPERAION MANUAL Indoor uni for air o waer hea pump sysem and opions EKHBRD011AAV1 EKHBRD014AAV1 EKHBRD016AAV1 EKHBRD011AAY1 EKHBRD014AAY1 EKHBRD016AAY1 EKHBRD011AAV1 EKHBRD014AAV1 EKHBRD016AAV1 EKHBRD011AAY1
More informationMATH 118 PROBLEM SET 6
MATH 118 PROBLEM SET 6 WASEEM LUTFI, GABRIEL MATSON, AND AMY PIRCHER Section 1 #16: Show tht if is qudrtic residue modulo m, nd b 1 (mod m, then b is lso qudrtic residue Then rove tht the roduct of the
More informationTHE OSCILLOSCOPE AND NOISE. Objectives:
-26- Preparaory Quesions. Go o he Web page hp://www.ek.com/measuremen/app_noes/xyzs/ and read a leas he firs four subsecions of he secion on Trigger Conrols (which iself is a subsecion of he secion The
More informationSystemC-AMS Hands-On Lab Part 2
SysemC-AMS Hands-On Lab Par 2 Markus Damm, Chrisoph Grimm Compuer Technology Vienna Universiy of Technology, Ausria François Pecheux Laboraoire d Informaique de Paris 6 Universié Pierre & Marie Curie Compuer
More informationOPERATION MANUAL. Indoor unit for air to water heat pump system and options EKHBRD011ADV1 EKHBRD014ADV1 EKHBRD016ADV1
OPERAION MANUAL Indoor uni for air o waer hea pump sysem and opions EKHBRD011ADV1 EKHBRD014ADV1 EKHBRD016ADV1 EKHBRD011ADY1 EKHBRD014ADY1 EKHBRD016ADY1 EKHBRD011ADV1+Y1 EKHBRD014ADV1+Y1 EKHBRD016ADV1+Y1
More informationEE368/CS232 Digital Image Processing Winter Homework #1 Released: Monday, January 8 Due: Wednesday, January 17, 1:30pm
EE368/CS232 Digial Image Processing Winer 207-208 Lecure Review and Quizzes (Due: Wednesday, January 7, :30pm) Please review wha you have learned in class and hen complee he online quiz quesions for he
More informationLecture 4. EITN Chapter 12, 13 Modulation and diversity. Antenna noise is usually given as a noise temperature!
Lecure 4 EITN75 2018 Chaper 12, 13 Modulaion and diversiy Receiver noise: repeiion Anenna noise is usually given as a noise emperaure! Noise facors or noise figures of differen sysem componens are deermined
More informationDisribued by: www.jameco.com 1-800-831-4242 The conen and copyrighs of he aached maerial are he propery of is owner. 16K-Bi CMOS PARALLEL E 2 PROM FEATURES Fas Read Access Times: 200 ns Low Power CMOS
More informationECE 274 Digital Logic. Digital Design. Datapath Components Shifters, Comparators, Counters, Multipliers Digital Design
ECE 27 Digitl Logic Shifters, Comprtors, Counters, Multipliers Digitl Design..7 Digitl Design Chpter : Slides to ccompny the textbook Digitl Design, First Edition, by Frnk Vhid, John Wiley nd Sons Publishers,
More informationAutomatic Power Factor Control Using Pic Microcontroller
IDL - Inernaional Digial Library Of Available a:www.dbpublicaions.org 8 h Naional Conference on Advanced Techniques in Elecrical and Elecronics Engineering Inernaional e-journal For Technology And Research-2017
More information3: Microscopic imaging
Ouline 3: Microscopic imaging Microscope layou Three limis o resoluion Diracion Pixel size Aberraions Comparison o elescopes and microscopes Rober R. McLeod, Universiy o Colorado 35 Microscope layou Anaomy
More information6.003: Signals and Systems
6.3: Signals and Sysems Lecure 4 March 3, 6.3: Signals and Sysems Fourier Represenaions Mid-erm Examinaion # Wednesday, April 7, 7:3-9:3pm. No reciaions on he day of he exam. Coverage: Lecures 5 Reciaions
More informationNoise Reduction/Mode Isolation with Adaptive Down Conversion (ADC)
Page 1 Noise Reducion/Mode Isolaion wih Adapive Down Conversion (ADC) Abel B. Diaz, Thomas W. Tunnell NSTec Los Alamos Operaions Presened o PDV Workshop 8-16-2007 Page 2 Summary Adapive down conversion
More informationPhase-Shifting Control of Double Pulse in Harmonic Elimination Wei Peng1, a*, Junhong Zhang1, Jianxin gao1, b, Guangyi Li1, c
Inernaional Symposium on Mechanical Engineering and Maerial Science (ISMEMS 016 Phase-Shifing Conrol of Double Pulse in Harmonic Eliminaion Wei Peng1, a*, Junhong Zhang1, Jianxin gao1, b, Guangyi i1, c
More informationHow to Shorten First Order Unit Testing Time. Piotr Mróz 1
How o Shoren Firs Order Uni Tesing Time Pior Mróz 1 1 Universiy of Zielona Góra, Faculy of Elecrical Engineering, Compuer Science and Telecommunicaions, ul. Podgórna 5, 65-246, Zielona Góra, Poland, phone
More informationVariation Aware Cross-Talk Aggressor Alignment by Mixed Integer Linear Programming
ariaion Aware Cross-alk Aggressor Alignmen by Mixed Ineger Linear Programming ladimir Zoloov IBM. J. Wason Research Cener, Yorkown Heighs, NY zoloov@us.ibm.com Peer Feldmann D. E. Shaw Research, New York,
More informationTeacher Supplement to Operation Comics, Issue #5
eacher Supplemen o Operaion Comics, Issue #5 he purpose of his supplemen is o provide conen suppor for he mahemaics embedded ino he fifh issue of Operaion Comics, and o show how he mahemaics addresses
More informationInvestigation and Simulation Model Results of High Density Wireless Power Harvesting and Transfer Method
Invesigaion and Simulaion Model Resuls of High Densiy Wireless Power Harvesing and Transfer Mehod Jaber A. Abu Qahouq, Senior Member, IEEE, and Zhigang Dang The Universiy of Alabama Deparmen of Elecrical
More informationEEO 401 Digital Signal Processing Prof. Mark Fowler
EEO 40 Digial Proceing Pro. Mark Fowler Noe Se #3 Baic Sampling heory Reading Aignmen: Sec. 6. o Proaki & Manolaki /9 Sampling i Key o Much o oday echnology Analog Elecronic ADC DSP Compuer DAC C- C- Syem
More informationMemorandum on Impulse Winding Tester
Memorandum on Impulse Winding Teser. Esimaion of Inducance by Impulse Response When he volage response is observed afer connecing an elecric charge sored up in he capaciy C o he coil L (including he inside
More information7 th International Conference on DEVELOPMENT AND APPLICATION SYSTEMS S u c e a v a, R o m a n i a, M a y 27 29,
7 h Inernaional Conference on DEVEOPMENT AND APPICATION SYSTEMS S u c e a v a, o m a n i a, M a y 27 29, 2 0 0 4 THEE-PHASE AC CHOPPE WITH IGBT s Ovidiu USAU 1, Mihai UCANU, Crisian AGHION, iviu TIGAEU
More informationErrata and Updates for ASM Exam MLC (Fourteenth Edition) Sorted by Page
Erraa for ASM Exam MLC Sudy Manual (Foureenh Ediion) Sored by Page 1 Erraa and Updaes for ASM Exam MLC (Foureenh Ediion) Sored by Page Pracice Exam 7:25 (page 1386) is defecive, Pracice Exam 5:21 (page
More informationSquare Waves, Sinusoids and Gaussian White Noise: A Matching Pursuit Conundrum? Don Percival
Square Waves, Sinusoids and Gaussian Whie Noise: A Maching Pursui Conundrum? Don Percival Applied Physics Laboraory Deparmen of Saisics Universiy of Washingon Seale, Washingon, USA hp://faculy.washingon.edu/dbp
More informationRevision: June 11, E Main Suite D Pullman, WA (509) Voice and Fax
2.5.3: Sinusoidal Signals and Complex Exponenials Revision: June 11, 2010 215 E Main Suie D Pullman, W 99163 (509) 334 6306 Voice and Fax Overview Sinusoidal signals and complex exponenials are exremely
More informationP. Bruschi: Project guidelines PSM Project guidelines.
Projec guidelines. 1. Rules for he execuion of he projecs Projecs are opional. Their aim is o improve he sudens knowledge of he basic full-cusom design flow. The final score of he exam is no affeced by
More informationInstalling remote sites using TCP/IP
v dc Keypad from nework Whie/ 3 Whie/ 4 v dc Keypad from nework Whie/ 3 Whie/ 4 v dc Keypad from nework Whie/ 3 Whie/ 4 +v pu +v pu +v pu v dc Keypad from nework Whie/ 3 Whie/ 4 v dc Keypad from nework
More information2.6 Special Angles on Parallel Lines Objectives: I CAN define angle pairs made by parallel lines. I CAN solve problems involving parallel lines.
2.6 Special Angles on Parallel Lines Objecives: I CAN define angle pairs made by parallel lines. I CAN solve problems involving parallel lines. 1 coplanar: poins on he same plane ransversal: a line ha
More informationAN303 APPLICATION NOTE
AN303 APPLICATION NOTE LATCHING CURRENT INTRODUCTION An imporan problem concerning he uilizaion of componens such as hyrisors or riacs is he holding of he componen in he conducing sae afer he rigger curren
More informationA1 K. 12V rms. 230V rms. 2 Full Wave Rectifier. Fig. 2.1: FWR with Transformer. Fig. 2.2: Transformer. Aim: To Design and setup a full wave rectifier.
2 Full Wave Recifier Aim: To Design and seup a full wave recifier. Componens Required: Diode(1N4001)(4),Resisor 10k,Capacior 56uF,Breadboard,Power Supplies and CRO and ransformer 230V-12V RMS. + A1 K B1
More informationWIDE-RANGE 7-SWITCH FLYING CAPACITOR BASED DC-DC CONVERTER FOR POINT-OF-LOAD APPLICATIONS
WIDE-RANGE 7-SWITCH FLYING CAPACITOR BASED DC-DC CONVERTER FOR POINT-OF-LOAD APPLICATIONS By Parh Jain A hesis submied in conformiy wih he requiremens for he degree of Maser of Applied Science Graduae
More informationLecture 20. Intro to line integrals. Dan Nichols MATH 233, Spring 2018 University of Massachusetts.
Lecture 2 Intro to line integrls Dn Nichols nichols@mth.umss.edu MATH 233, Spring 218 University of Msschusetts April 12, 218 (2) onservtive vector fields We wnt to determine if F P (x, y), Q(x, y) is
More informationTransmit Beamforming with Reduced Feedback Information in OFDM Based Wireless Systems
Transmi Beamforming wih educed Feedback Informaion in OFDM Based Wireless Sysems Seung-Hyeon Yang, Jae-Yun Ko, and Yong-Hwan Lee School of Elecrical Engineering and INMC, Seoul Naional Universiy Kwanak
More informationELEG 3124 SYSTEMS AND SIGNALS Ch. 1 Continuous-Time Signals
Deparmen of Elecrical Engineering Universiy of Arkansas ELEG 3124 SYSTEMS AND SIGNALS Ch. 1 Coninuous-Time Signals Dr. Jingxian Wu wuj@uark.edu OUTLINE 2 Inroducion: wha are signals and sysems? Signals
More informationCS 135: Computer Architecture I. Boolean Algebra. Basic Logic Gates
Bsic Logic Gtes : Computer Architecture I Boolen Algebr Instructor: Prof. Bhgi Nrhri Dept. of Computer Science Course URL: www.ses.gwu.edu/~bhgiweb/cs35/ Digitl Logic Circuits We sw how we cn build the
More informationEECE 301 Signals & Systems Prof. Mark Fowler
EECE 301 s & Sysems Prof. Mark Fowler Noe Se #1 Wha is s & Sysems all abou??? 1/9 Do All EE s & CoE s Design Circuis? No!!!! Someone has o figure ou wha funcion hose circuis need o do Someone also needs
More informationEE 40 Final Project Basic Circuit
EE 0 Spring 2006 Final Projec EE 0 Final Projec Basic Circui Par I: General insrucion 1. The final projec will coun 0% of he lab grading, since i s going o ake lab sessions. All oher individual labs will
More informationECMA-373. Near Field Communication Wired Interface (NFC-WI) 2 nd Edition / June Reference number ECMA-123:2009
ECMA-373 2 nd Ediion / June 2012 Near Field Communicaion Wired Inerface (NFC-WI) Reference number ECMA-123:2009 Ecma Inernaional 2009 COPYRIGHT PROTECTED DOCUMENT Ecma Inernaional 2012 Conens Page 1 Scope...
More informationORDER INFORMATION TO pin 320 ~ 340mV AMC7150DLF
www.addmek.com DESCRIPTI is a PWM power ED driver IC. The driving curren from few milliamps up o 1.5A. I allows high brighness power ED operaing a high efficiency from 4Vdc o 40Vdc. Up o 200KHz exernal
More informationECE-517: Reinforcement Learning in Artificial Intelligence
ECE-517: Reinforcemen Learning in Arificial Inelligence Lecure 12: Generalizaion and Funcion Approximaion Ocober 13, 2015 Dr. Iamar Arel College of Engineering Deparmen of Elecrical Engineering and Compuer
More informationLECTURE 9: QUADRATIC RESIDUES AND THE LAW OF QUADRATIC RECIPROCITY
LECTURE 9: QUADRATIC RESIDUES AND THE LAW OF QUADRATIC RECIPROCITY 1. Bsic roerties of qudrtic residues We now investigte residues with secil roerties of lgebric tye. Definition 1.1. (i) When (, m) 1 nd
More informationEQ: What are the similarities and differences between matrices and real numbers?
Unit 4 Lesson 1 Essentil Question Stndrds Objectives Vocbulry Mtrices Mtrix Opertions Wht re the similrities nd differences between mtrices nd rel numbers? M.ALGII.2.4 Unit 4: Lesson 1 Describe how you
More informationSoftware solutions to mitigate the EM emission of power modules
Sofware soluions o miigae he EM emission of power modules Franco Fiori Elecronics and Telecom Dp. (DET), Poliecnico di Torino, Ialy franco.fiori@polio.i Ouline An inroducion o EMI filering in power modules
More informationMODELING OF CROSS-REGULATION IN MULTIPLE-OUTPUT FLYBACK CONVERTERS
MODELING OF CROSS-REGULATION IN MULTIPLE-OUTPUT FLYBACK CONVERTERS Dragan Maksimovićand Rober Erickson Colorado Power Elecronics Cener Deparmen of Elecrical and Compuer Engineering Universiy of Colorado,
More informationAn off-line multiprocessor real-time scheduling algorithm to reduce static energy consumption
An off-line muliprocessor real-ime scheduling algorihm o reduce saic energy consumpion Firs Workshop on Highly-Reliable Power-Efficien Embedded Designs Shenzhen, China Vincen Legou, Mahieu Jan, Lauren
More informationSection 17.2: Line Integrals. 1 Objectives. 2 Assignments. 3 Maple Commands. 1. Compute line integrals in IR 2 and IR Read Section 17.
Section 7.: Line Integrls Objectives. ompute line integrls in IR nd IR 3. Assignments. Red Section 7.. Problems:,5,9,,3,7,,4 3. hllenge: 6,3,37 4. Red Section 7.3 3 Mple ommnds Mple cn ctully evlute line
More informationA Study on Data Aggregation and Reliability in Managing Wireless Sensor Networks
A Sudy on Da Aggregion and Reliabiliy in Managing Wireless Sensor Neworks S Brown Deparmen of Compuer Science Nional Universiy of Ireland, Maynooh sephenbrown@nuimie C J Sreenan Mobile & Inerne Sysems
More informationDriver Modeling and Alignment for Worst-Case Delay Noise
Drier Modeling and Alignmen for Wors-Case Noise Supamas Sirichoiyakul, Daid Blaauw, Chanhee Oh, Rafi Ley*, Vladimir Zoloo, Jingyan Zuo Moorola Inc. Ausin, TX, *Moorola Semiconducor Israel Ld. Tel Ai, Israel
More informationTo Relay or Not to Relay: Learning Device-to-Device Relaying Strategies in Cellular Networks
To Relay or No o Relay: Learning Device-o-Device Relaying Sraegies in Cellular Neworks Nicholas Masronarde, Viral Pael, Jie Xu, Lingia Liu, and Mihaela van der Schaar Absrac- We consider a cellular nework
More informationLECTURE 1 CMOS PHASE LOCKED LOOPS
Lecure 01 (8/9/18) Page 1-1 Objecive LECTURE 1 CMOS PHASE LOCKED LOOPS OVERVIEW Undersand he principles and applicaions of phase locked loops using inegraed circui echnology wih emphasis on CMOS echnology.
More informationTest 1 Review. Test 1 Review. Communication Systems: Foundational Theories. Communication System. Reference: Sections and
Tes 1 Review Tes 1 Review Proessor Deepa Kundur Universiy o Torono Reerence: Secions 2.2-2.7 and 3.1-3.6 o S. Haykin and M. Moher, Inroducion o Analog & Digial Communicaions, 2nd ed., John iley & Sons,
More informationMobile Robot Localization Using Fusion of Object Recognition and Range Information
007 IEEE Inernaional Conference on Roboics and Auomaion Roma, Ialy, 10-14 April 007 FrB1.3 Mobile Robo Localizaion Using Fusion of Objec Recogniion and Range Informaion Byung-Doo Yim, Yong-Ju Lee, Jae-Bok
More informationSection 16.3 Double Integrals over General Regions
Section 6.3 Double Integrls over Generl egions Not ever region is rectngle In the lst two sections we considered the problem of integrting function of two vribles over rectngle. This sitution however is
More informationDECEMBER 15-18, 1997 ADELAIDE, SOUTH AUSTRALIA. Department of Mechanical Engineering, Hanyang University. Haeng Dang-Dong, Seong Dong-Ku, Seoul, KOREA
FIFTH INTERNATIONAL w CONGRESS ON SOUND DECEMBER 15-18, 1997 ADELAIDE, SOUTH AUSTRALIA AND VIBRATION A design echnique for reducing he inake noise of a vehicle Jae-Eung Oh, Kwang-Hee Han Deparmen of Mechanical
More informationAlgorithms for Memory Hierarchies Lecture 14
Algorithms for emory Hierrchies Lecture 4 Lecturer: Nodri Sitchinv Scribe: ichel Hmnn Prllelism nd Cche Obliviousness The combintion of prllelism nd cche obliviousness is n ongoing topic of reserch, in
More informationDirect Analysis of Wave Digital Network of Microstrip Structure with Step Discontinuities
Direc Analysis of Wave Digial Nework of Microsrip Srucure wih Sep Disconinuiies BILJANA P. SOŠIĆ Faculy of Elecronic Engineering Universiy of Niš Aleksandra Medvedeva 4, Niš SERBIA MIODRAG V. GMIROVIĆ
More informationNCTM Content Standard/National Science Education Standard:
Tile: Logarihms Brief Overview: In his Concep Developmen Uni, he concep of logarihms is discussed. The relaionship beween eponenial equaions and logarihmic equaions is eplored. The properies of logs are
More informationProgrammable DC Electronic Load 8600 Series
Daa Shee Programmable DC Elecronic Load The programmable DC elecronic loads provide he performance of modular sysem DC elecronic loads in a compac benchop form facor. Wih fas ransien operaion speeds and
More informationECE3204 Microelectronics II Bitar / McNeill. ECE 3204 / Term D-2017 Problem Set 7
EE3204 Microelecronics II Biar / McNeill Due: Monday, May 1, 2017 EE 3204 / Term D-2017 Problem Se 7 All ex problems from Sedra and Smih, Microelecronic ircuis, 7h ediion. NOTES: Be sure your NAME and
More informationREADING ASSIGNMENTS LECTURE OBJECTIVES. Problem Solving Skills. x(t) = cos(αt 2 ) ELEG-212 Signal Processing and Communications
ELEG- Signal Processing and Communicaions Lecure 5 Periodic Signals, Harmonics & ime-varying Sinusoids READING ASSIGNMENS his Lecure: Chaper 3, Secions 3- and 3-3 Chaper 3, Secions 3-7 and 3-8 Lab sars
More informationKnowledge Transfer in Semi-automatic Image Interpretation
Knowledge Transfer in Semi-auomaic Image Inerpreaion Jun Zhou 1, Li Cheng 2, Terry Caelli 23, and Waler F. Bischof 1 1 Deparmen of Compuing Science, Universiy of Albera, Edmonon, Albera, Canada T6G 2E8
More informationTEST OF THE NOVAERUS AIR CLEANING SYSTEM IN THE DEPARTMENT OF CLINICAL MEDICINE.
TEST OF THE NOVAERUS AIR CLEANING SYSTEM IN THE DEPARTMENT OF CLINICAL MEDICINE. Performed by he Laboraory of Infecion Hygiene, Deparmen of Clinical Microbiology, Danish Naional Hospial. Responsible: Chief
More informationFASER: Fast Analysis of Soft Error Susceptibility for Cell-Based Designs
FASER: Fas Analysis of Sof Error Suscepibiliy for Cell-ased Designs Absrac This paper is concerned wih saically analyzing he suscepibiliy of arbirary combinaional circuis o single even upses ha are becoming
More informationOptimal Response to Burstable Billing under Demand Uncertainty
1 Opimal Response o Bursable Billing under Demand Uncerainy Yong Zhan, Suden Member, IEEE, Mahdi Ghamkhari, Suden Member, IEEE, Hossein Akhavan-Hejazi, Suden Member, IEEE, Du Xu, Member, IEEE, and Hamed
More informationExperiment 6: Transmission Line Pulse Response
Eperimen 6: Transmission Line Pulse Response Lossless Disribued Neworks When he ime required for a pulse signal o raverse a circui is on he order of he rise or fall ime of he pulse, i is no longer possible
More information