Learning from Evaluation when Context Matters
|
|
- Joshua Fitzgerald
- 5 years ago
- Views:
Transcription
1 Learning from Evaluation when Context Matters Lant Pritchett Harvard Kennedy School and Center for Global Development At Evidence on a silver platter: Evaluation results for policy making in Development Cooperation, November
2 Four big problems with the RCT revolution or randomistas It is not good science experiments without theory cannot have external validity It is not a good theory of organizational learning about implementation intensive programs (which is most everything) It is not able to focus on development and hence is mainly useful for charity work It is not based on a realistic positive model or theory of change of policy adoption
3 Every bubble has a transition from we to they : We have to get in on this to What were they thinking?
4 Getting over the hype cycle about RCTs to slope of enlightenment
5 Doing science via RCTs embedded as independent impact evaluation of projects Stage of hype cycle Peak of inflated expectations Trough of disillusionment Slope of enlightenment Doing science with RCTs Build RCTs into donor/ngo financed projects which create treatments to look at the impact of interventions. After many RCTs are done do a systematic review of what works to guide policy If doing experiments were science there would be a Nobel Prize for alchemy This is not science it is the parody of science. This cannot work (and we knew that) This does not work (we can now show that) All methods have to be more embedded in a theory that provides a notion of context and hence invariance laws that are able to encompass all empirical findings.
6 Cannot work and does not work Cannot work as a method because if the bad studies have heterogeneity (e.g. impacts differ across contexts) then good studies cannot logically be expected to reduce that heterogeneity Does not work: Eva Vivalt s survey of 600 RCT studies Evans on education Bold, et al on replication Pritchett and Sandefur (2015)
7 Cannot work: No claim to external validity is coherent because the gap between observational and RCT results is the result of behavior Distribution of the impact on test scores of reduced class size from non-observational studies (about the non- RCT literature) Typical 2σ β OLS(j)=0 β OLS(i)=.2 β RCT(i)=.3 β OLS(k)=.4 Zero Gold standard RCT from one specific context (country, region, grade, range of class sizes)
8 Does not work: Rigorous evidence isn t Vivalt 2015 shows the evaluations of impacts of similar programs have very high variance Bold et al show context includes implementing organization Evans shows systematic reviews are not so systematic Pritchett and Sandefur (2015) shows OLS from context beats RCT from another context to predict impact Muralidharan (2015) shows even lots of zero estimated impacts do reveal why they failed
9 Not a good model of how organizations actually learn to do things better Stage of hype cycle Peak of inflated expectations Trough of disillusionment Slope of enlightenment Forcing organizations to acknowledge failure Introduce rigorous independent evaluation into programs and organizations (donor and other) will learn what works Organizations resist evaluations that come anywhere near core beliefs/practices Without organizational cooperation what works gets subverted Learning during implementation can be enhanced by with implementing organizations but only at the expense of the independence of the evaluation
10 Example: Cameras in classrooms Duflo, Hanna et al show cameras in classrooms of a small NGO in Rajasthan work to increase teacher attendance and raise learning performance of students Duflo et al (2008) show introducing better biometrics (and pay incentives) in Rajasthan reduces presence of ANMs in health sub-centers Dhaliwal and Hanna (2013) show biometrics in Karnataka India to increase attendance doesn t change attendance of doctors and reduces PHC use
11 A study of implementing biometrics to track attendance of medical personnel at PHCs in Karnataka 0-0,05-0,1-0,15-0,2 Treatment impact on patient perceptions Staff availability Staff Quality Knowledge of entitlements Source: Dhaliwal and Hanna 2013 Use of biometrics to track attendance in treatment with some threat of docking days missed Attendance of doctors tracked was around 30 percent Program made patient perception worse The program had positive effects on health status because they used the PHC less 0,2 0,1 0-0,1-0,2-0,3 Percentage change in place of delivery PHC Large Hospital (Public or Private)
12 Learning when the fitness function is rugged and contextual over a hyperdimensional design pace
13 Not a good model of to do better development (as opposed to charity mitigating the consequences of lack of development) Stage of hype cycle Peak of inflated expectations Trough of disillusionment Slope of enlightenment Evaluating what is possible to be evaluated The RCT would improve evidence and lead to better development outcomes Most program evaluations want large N do generate statistical power and hence focus on individualized treatments (e.g. CCTs, deworming, livelihood programs) Most deep causes of development are ontologically at the social/political/economic level, not individual so national development ultimately matters more for all outcomes than program design RCTs are only a small part of the development agenda
14
15 Trillion dollar questions versus million dollar questions The gain from India s growth performance after an incipient crisis in 1991 (for which policy response appeared to matter and the policy response was influenced by donor action) cumulative added trillions of dollars to Indian output The latest Science magazine paper show replication of an approach to livelihood programs in six countries saw gains in per capita consumption of PPP$54 per year and that is gross not net even applied to all billion extreme poor on that planet that is a gross not net gain of 54 billion.
16 Not a good model of to do better development (as opposed to charity mitigating the consequences of lack of development) Stage of hype cycle Peak of inflated expectations Trough of disillusionment Slope of enlightenment Political economy of policy making and policy adoption By providing unambiguously rigorous and easy to understand information to policy makers they will adopt new programs Many government mistakes are due to deeply embedded ideas and interests. The idea that policy makers are simply waiting for new evidence is a fanciful view of political process RCTs can be built into the experimentation and scaling of policies and programs that policy makers otherwise want to adopt but this is more experiential learning than impact evaluation
17 Don t get me wrong There should be enormously more not less use of randomization but to achieve this requires not RCTs used for independent evaluation of impact (from inputs to outcomes) but making randomization inside organizations possible to explore a hyper-dimensional and rugged design space using within treatment variation to achieve organizational goals (with some small use of impact evaluation)
Why Randomize? Dan Levy Harvard Kennedy School
Why Randomize? Dan Levy Harvard Kennedy School Course Overview 1. What is Evaluation? 2. Outcomes, Impact, and Indicators 3. Why Randomize? 4. How to Randomize 5. Sampling and Sample Size 6. Threats and
More informationWhy Randomize? Jim Berry Cornell University
Why Randomize? Jim Berry Cornell University Session Overview I. Basic vocabulary for impact evaluation II. III. IV. Randomized evaluation Other methods of impact evaluation Conclusions J-PAL WHY RANDOMIZE
More informationThe Returns to Public Investment in Human Capital and Infrastructure Lee Branstetter
The Returns to Public Investment in Human Capital and Infrastructure Lee Branstetter Professor of Economics and Public Policy Carnegie Mellon University Nonresident Senior Fellow Peterson Institute for
More informationSustainable Development Education, Research and Innovation
Sustainable Development Education, Research and Innovation Vision for Knowledge Economy Professor Maged Al-Sherbiny Assistant Minister for Scientific Research Towards Science, Technology and Innovation
More informationRandomized Evaluations in Practice: Opportunities and Challenges. Kyle Murphy Policy Manager, J-PAL January 30 th, 2017
Randomized Evaluations in Practice: Opportunities and Challenges Kyle Murphy Policy Manager, J-PAL January 30 th, 2017 Overview Background What is a randomized evaluation? Why randomize? Advantages and
More informationThe Sustainable Tourism Programme of the 10-Year Framework of Programmes on Sustainable Consumption and Production
The Sustainable Tourism Programme of the 10-Year Framework of Programmes on Sustainable Consumption and Production Generating collective impact Scaling up and replicating Programmatic implementation Helena
More informationThe Modern Design Organization. Leah Buley, UX London May 2016
The Modern Design Organization Leah Buley, UX London May 2016 Projected 10-year growth rate of user experience jobs: 16% Source: CNNMoney/Payscale / US Bureau of Labor Statistics 4 Amount earmarked by
More informationSIXTH REGIONAL 3R FORUM IN ASIA AND THE PACIFIC, AUGUST 2015, MALE, MALDIVES
Discussion paper issued without formal editing FOR PARTICIPANTS ONLY 13 AUGUST 2015 ENGLISH ONLY UNITED NATIONS CENTRE FOR REGIONAL DEVELOPMENT In collaboration with Ministry of Environment and Energy
More informationHOW THE PACE OF CHANGE AFFECTS THE OUTCOMES YOU GET:
HOW THE PACE OF CHANGE AFFECTS THE OUTCOMES YOU GET: T H E C A S E O F P H A R M A C E U T I C A L I N S U R A N C E I N C A N A D A, T H E U K A N D A U S T R A L I A CHEPA Seminar, April 2011 Katherine
More informationMarc Shotland. J-PAL Global TRANSLATING RESEARCH INTO ACTION
Marc Shotland J-PAL Global TRANSLATING RESEARCH INTO ACTION Course Overview 1. What is evaluation? 2. Measuring impacts (outcomes, indicators) 3. Why randomize? 4. How to randomize? 5. Sampling and sample
More informationDigital Reality TM changes everything
F E B R U A R Y 2 0 1 8 Digital Reality TM changes everything Step into the future What are we talking about? Virtual Reality VR is an entirely digital world that completely immerses the user in an environment
More informationDevelopment Economics: Microeconomic issues and Policy Models
MIT OpenCourseWare http://ocw.mit.edu 14.771 Development Economics: Microeconomic issues and Policy Models Fall 2008 For information about citing these materials or our Terms of Use, visit: http://ocw.mit.edu/terms.
More informationHIGHLIGHTS OF THE LATIN AMERICAN AND CARIBBEAN REGIONAL WORKSHOP ON SCIENCE AND TECHNOLOGY FOR SUSTAINABLE DEVELOPMENT (Santiago, Chile, 5-75
HIGHLIGHTS OF THE LATIN AMERICAN AND CARIBBEAN REGIONAL WORKSHOP ON SCIENCE AND TECHNOLOGY FOR SUSTAINABLE DEVELOPMENT (Santiago, Chile, 5-75 7 March 2002) Gilberto Gallopín Synthesis Workshop on Science
More informationCourse Overview J-PAL HOW TO RANDOMIZE 2
How to Randomize Course Overview 1. What is Evaluation? 2. Measurement & Indicators 3. Why Randomize? 4. How to Randomize? 5. Sampling and Sample Size 6. Threats and Analysis 7. Generalizability 8. Project
More informationAlexa, What s the Internet of Things. Karen M. Waddill M.A. CCC-SLP ATP
Alexa, What s the Internet of Things Karen M. Waddill M.A. CCC-SLP ATP consulting@cotting.org Alexa, What is the Internet of Things (IoT) In simple terms, The Internet of Things (IoT) refers the plethora
More informationEHR Optimization: Why Is Meaningful Use So Difficult?
EHR Optimization: Why Is Meaningful Use So Difficult? Tuesday, March 1, 2016, 8:30-9:30 Elizabeth A. Regan, Ph.D. Department Chair Integrated Information Technology Professor Health Information Technology
More informationChaloemphon Meechai 1 1
A Study of Factors Affecting to Public mind of The Eastern University of Management and Technology in Faculty Business Administration students Chaloemphon Meechai 1 1 Office of Business Administration,
More informationGame Theory. Department of Electronics EL-766 Spring Hasan Mahmood
Game Theory Department of Electronics EL-766 Spring 2011 Hasan Mahmood Email: hasannj@yahoo.com Course Information Part I: Introduction to Game Theory Introduction to game theory, games with perfect information,
More informationIs SBCC the secret sauce in clean cooking interventions? From global review to randomized controlled trial in Bangladesh
? Is SBCC the secret sauce in clean cooking interventions? From global review to randomized controlled trial in Bangladesh Dr Nicholas Goodwin Director, Tulodo Research Associate, School of Public Health,
More informationMOVING FROM R&D TO WIDESPREAD ADOPTION OF ENVIRONMENTALLY SOUND INNOVATION
MOVING FROM R&D TO WIDESPREAD ADOPTION OF ENVIRONMENTALLY SOUND INNOVATION Session 2.1: Successful Models for Clean and Environmentally Sound Innovation and Technology Diffusion in Developing Countries
More information15: Ethics in Machine Learning, plus Artificial General Intelligence and some old Science Fiction
15: Ethics in Machine Learning, plus Artificial General Intelligence and some old Science Fiction Machine Learning and Real-world Data Ann Copestake and Simone Teufel Computer Laboratory University of
More informationHealth Informaticians Drive Innovation from Bench to Bedside
VIEW FROM THE TOP Health Informaticians Drive Innovation from Bench to Bedside Please tell us about the professionals supported by AMIA: health informatics experts. The professionals in health informatics
More informationBoundaryless Hospital - Rethink and Redefine Health Care Management. New Chains of Value Creation
Boundaryless Hospital - Rethink and Redefine Health Care Management New Chains of Value Creation Sören T. Eichhorst, MD PhD Partner and Head of McKinsey Hospital Institute Cologne, Germany PROPRIETARY
More informationLecture 4: Chapter 4
Lecture 4: Chapter 4 C C Moxley UAB Mathematics 19 September 16 4.2 Basic Concepts of Probability Procedure Event Simple Event Sample Space 4.2 Basic Concepts of Probability Procedure Event Simple Event
More informationThe Digital Doctor: Hope, Hype & Harm at the Dawn of Medicine s Computer Age
The Digital Doctor: Hope, Hype & Harm at the Dawn of Medicine s Computer Age Robert M. Wachter, MD Professor and Chair, Department of Medicine University of California, San Francisco @Bob_Wachter Disclosures
More informationThe Contribution of the Social Sciences to the Energy Challenge
Hearings: Subcommittee on Research & Science Education September 25, 2007 The Contribution of the Social Sciences to the Energy Challenge U.S. HOUSE OF REPRESENTATIVES COMMITTEE ON SCIENCE AND TECHNOLOGY
More informationMachine Learning and Decision Making for Sustainability
Machine Learning and Decision Making for Sustainability Stefano Ermon Department of Computer Science Stanford University April 12 Overview Stanford Artificial Intelligence Lab Fellow, Woods Institute for
More informationMeasurement for Generation and Dissemination of Knowledge a case study for India, by Mr. Ashish Kumar, former DG of CSO of Government of India
Measurement for Generation and Dissemination of Knowledge a case study for India, by Mr. Ashish Kumar, former DG of CSO of Government of India This article represents the essential of the first step of
More informationTHE MACROECONOMICS OF THE GLOBAL TECHNOLOGY ECONOMY. Howard A. Rubin
THE MACROECONOMICS OF THE GLOBAL TECHNOLOGY Howard A. Rubin well surpassing such investment by the United States and every other country. The Dow Jones Industrial index no longer exists, replaced by a
More information14 th Berlin Open Access Conference Publisher Colloquy session
14 th Berlin Open Access Conference Publisher Colloquy session Berlin, Max Planck Society s Harnack House December 04, 2018 Guido F. Herrmann Vice President and Managing Director Wiley s perspective and
More informationAdjusting your IWA for Global Perspectives
Adjusting your IWA for Global Perspectives Removing Stimulus Component: 1. When you use any of the articles from the Stimulus packet as evidence in your essay, you may keep this as evidence in the essay.
More informationFive-year strategy. Harnessing the power of evidence and ideas. Evidence. Ideas. Change. Evidence. Ideas. Change.
ODI 203 Blackfriars Road London SE1 8NJ +44 (0)20 7922 0300 odi.org Evidence. Ideas. Change. Five-year strategy Harnessing the power of evidence and ideas Evidence. Ideas. Change. Follow us on Twitter
More informationScience and Technology for Human Development: State-Citizen Synergy. Shahid Najam Zain Azeem
BIPP Policy Brief 31/2016 Science and Technology for Human Development: State-Citizen Synergy By Shahid Najam Zain Azeem The Shahid Javed Burki Institute of Public Policy at NetSol 1 Science and Technology
More informationThe Relationship Between Annual GDP Growth and Income Inequality: Developed and Undeveloped Countries
The Relationship Between Annual GDP Growth and Income Inequality: Developed and Undeveloped Countries Zeyao Luan, Ziyi Zhou Georgia Institute of Technology ECON 3161 Dr. Shatakshee Dhongde April 2017 1
More informationHow machines learn in healthcare
ADVANCES IN DATA SCIENCE How machines learn in healthcare Machine learning is transforming every facet of healthcare, as computer systems are being taught how to use Big Data to derive insights and support
More informationUnit 1: The Economic Fundamentals Weeks How does scarcity impact the decisions individuals and societies must make?
Economics Teacher: Vida Unit 1: The Economic Fundamentals Weeks 1-4 Essential Questions 1. How does scarcity impact the decisions individuals and societies must make? 2. What roles do individuals and businesses
More informationCompute P(X 4) = Chapter 8 Homework Problems Compiled by Joe Kahlig
141H homework problems, 10C-copyright Joe Kahlig Chapter 8, Page 1 Chapter 8 Homework Problems Compiled by Joe Kahlig Section 8.1 1. Classify the random variable as finite discrete, infinite discrete,
More informationAI use in European healthcare
Artificial Intelligence (AI) AI use in European healthcare www.himss.eu/analytics Results, May 2018 1 TABLE OF CONTENT Introduction & methodology page 3 Survey questions page 4 Results Key Findings page
More informationA Comprehensive Statewide Study of Gambling Impacts: Implications for Public Health
A Comprehensive Statewide Study of Gambling Impacts: Implications for Public Health Rachel A. Volberg 2 nd Annual Maryland Conference on Problem Gambling June 13, 2014 Acknowledgement We would like to
More informationClimate Change, Energy and Transport: The Interviews
SCANNING STUDY POLICY BRIEFING NOTE 1 Climate Change, Energy and Transport: The Interviews What can the social sciences contribute to thinking about climate change and energy in transport research and
More informationCorrelation of regional innovation policy and private enterprise independent innovation capability Ying-jie Zhang
3rd International Conference on Science and Social Research (ICSSR 2014) Correlation of regional innovation policy and private enterprise independent innovation capability Ying-jie Zhang College of Economics
More informationMainstreaming PE in Horizon 2020: perspectives and ambitions
CASI/PE2020 Conference Brussels, 16-17 November 2016 Mainstreaming PE in Horizon 2020: perspectives and ambitions Giuseppe BORSALINO European Commission DG RTD B7.002 'Mainstreaming RRI in Horizon 2020
More informationAustralia and Japan: a View from Asia Kevin Sneader October 13th 2014
Australia and Japan: a View from Asia Kevin Sneader October 13th 2014 The world s economic centre of gravity has come back to Asia Locations weighted in 3D space by GDP 1980 2000 2010 1950 1940 1820 1500
More informationJapan Lagging in Scientific Research
Japan Lagging in Scientific Research By Takashi Kitazume Japan's Asian neighbors are catching up quickly in terms of technological innovations, and Japan should start investing more in basic scientific
More informationBOLD: Exponential Growth and the Democratization of the World
BOLD: Exponential Growth and the Democratization of the World Excerpts crafted from NY Times bestseller Bold-How to go big, create wealth and impact the world, written by Steven Kotler and Dr. Peter Diamandis
More informationZOLO Healthcare Solutions All Rights Reserved
Everyone has their list of change principles. Newton s Laws 10 Principles of Change Management More Change Management Principles Our list of Change Ingredients 25-year humanitarian project by non-governmental
More informationHarvesting from pan-european experiences. Marco d Angelantonio Health Information Management
2 Harvesting from pan-european experiences Marco d Angelantonio Health Information Management Table of contents 3 The context Barriers for the large scale deployment of ICT in support of care The human
More informationGrand Challenges for Systems and Services Sciences
Grand Challenges for Systems and Services Sciences Brian Monahan, David Pym, Richard Taylor, Chris Tofts, Mike Yearworth Trusted Systems Laboratory HP Laboratories Bristol HPL-2006-99 July 13, 2006* systems,
More informationArtWorks Scotland! !!! Research Summary Quality Perspectives, Artists and Partners: Research Background and Key observations
ArtWorks Scotland Research Summary Quality Perspectives, Artists and Partners: Research Background and Key observations Prepared by: Dr Fiona Dean Freelance Researcher ArtWorks Scotland, November, 2013
More informationKen Buetow, Ph.D. Director, Computation Science and Informatics, Complex Adaptive ASU Professor, School of Life Science
COMPLEX ADAPTIVE SYSTEMS Ken Buetow, Ph.D Director, Computation Science and Informatics, Complex Adaptive Systems @ ASU Professor, School of Life Science Kenneth.Buetow@ASU.edu 1 4 th Paradigm Science
More informationThe Benefits of Broadband Expansion to America's Economy, Education, and Health
The Benefits of Broadband Expansion to America's Economy, Education, and Health A Policy Brief by Common Sense Kids Action June 2015 www.commonsensemedia.org/kids- action 1 The Benefits of Broadband Expansion
More informationVirtual Model Validation for Economics
Virtual Model Validation for Economics David K. Levine, www.dklevine.com, September 12, 2010 White Paper prepared for the National Science Foundation, Released under a Creative Commons Attribution Non-Commercial
More informationStudy on Fuzzy Comprehensive Evaluation of Regional Technological Innovation Ability of China Changzhutan 3 +5 Urban Agglomeration Based on AHP
Proceedings of the 7th International Conference on Innovation & Management 545 Study on Fuzzy Comprehensive Evaluation of Regional Technological Innovation Ability of China Changzhutan 3 +5 Urban Agglomeration
More informationDraft Plan of Action Chair's Text Status 3 May 2008
Draft Plan of Action Chair's Text Status 3 May 2008 Explanation by the Chair of the Drafting Group on the Plan of Action of the 'Stakeholder' Column in the attached table Discussed Text - White background
More informationTelecoms and Tech Week
Telecoms and Tech Week STREAM 1: THE NEW DIGITAL ECONOMY A week of learning about the new digital economy and tech exploration at Google LONDON 2-6 JULY 2018 The Academy a Google space 123 Buckingham Palace
More informationTechnology Transfer Principles: Methods, Knowledge States and Value Systems Underlying Successful Technological Innovation
Technology Transfer Principles: Methods, Knowledge States and Value Systems Underlying Successful Technological Innovation Joseph P. Lane, Director Center on Knowledge Translation for Technology Transfer
More informationBotswana - Botswana AIDS Impact Survey III 2008
Statistics Botswana Data Catalogue Botswana - Botswana AIDS Impact Survey III 2008 Statistics Botswana - Ministry of Finance and Development Planning, National AIDS Coordinating Agency (NACA) Report generated
More informationTest at a Glance. Updated June 2017
GACE Engineering and Technology Education Assessment Test at a Glance Updated June 2017 See the GACE Engineering and Technology Assessment Study Companion for practice questions and preparation resources.
More informationA New Energy Efficiency Center
A New Energy Efficiency Center Presentation for Emerging Technologies Summit Energy Efficiency in Consumer Electronics November, 2010 G. P. Li, Director California Institute for Telecommunications and
More informationOutline of Presentation
Understanding Information Seeking Behaviors and User Experience: How to Apply Research Methodologies to Information Technology Management and New Product Design By Denis M. S. Lee Professor of Computer
More informationHazard Perception Training for Young Drivers. Anuj K. Pradhan, PhD University of Michigan Transportation Research Institute
Hazard Perception Training for Young Drivers Anuj K. Pradhan, PhD University of Michigan Transportation Research Institute Outline The Young Driver issue Identified risk factors Hazard Perception Age differences
More informationCEOCFO Magazine. Pat Patterson, CPT President and Founder. Agilis Consulting Group, LLC
CEOCFO Magazine ceocfointerviews.com All rights reserved! Issue: July 10, 2017 Human Factors Firm helping Medical Device and Pharmaceutical Companies Ensure Usability, Safety, Instructions and Training
More informationFormal Model for e-healthcare Readiness Assessment in Developing Country Context
Formal Model for e-healthcare Readiness Assessment in Developing Country Context Ojo S.O. 1, Olugbara O.O. 2, Ditsa G. 3, Adigun M. O. 2 and Xulu S.S. 2 1 Department of Computer Science, University of
More informationTechnology, Social Entrepreneurs and the Global Crisis
Technology, Social Entrepreneurs and the Global Crisis 1 Abstract Technology is no longer a mere enabler, it is now central to the way we work, live and play. Actually, a New Economy has evolved 1, with
More informationMr. Peter Felten Launching Event IFRC Forecast-based Action by the DREF 07. Mai 2018, 10.30h-13.15h CICG, Geneva. Keynote Speech
Mr. Peter Felten Launching Event IFRC Forecast-based Action by the DREF 07. Mai 2018, 10.30h-13.15h CICG, Geneva Keynote Speech Dear Secretary General As Sy, Excellencies, Ladies and Gentlemen, Dear colleagues,
More informationThe Digital Doctor: Hope, Hype, and Harm at the Dawn of Medicine s Computer Age
The Digital Doctor: Hope, Hype, and Harm at the Dawn of Medicine s Computer Age Robert Wachter, MD Professor & Chair of the Department of Medicine, University of California, San Francisco Author, The Digital
More informationAP Statistics S A M P L I N G C H A P 11
AP Statistics 1 S A M P L I N G C H A P 11 The idea that the examination of a relatively small number of randomly selected individuals can furnish dependable information about the characteristics of a
More informationStats: Modeling the World. Chapter 11: Sample Surveys
Stats: Modeling the World Chapter 11: Sample Surveys Sampling Methods: Sample Surveys Sample Surveys: A study that asks questions of a small group of people in the hope of learning something about the
More informationSystem and Network Administration
System and Network Administration 1 What is network & system administration A branch of engineering that concern the operational management of human-computer systems. Its address both technology of computer
More informationTranslational scientist competency profile
C-COMEND Competency profile for Translational Scientists C-COMEND is a two-year European training project supported by the Erasmus plus programme, which started on November 1st 2015. The overall objective
More information(PDF) ORGANIZATIONAL BEHAVIOR 11TH ED
DOWNLOAD OR READ : ANIMAL BEHAVIOR DESK REFERENCE A DICTIONARY OF ANIMAL BEHAVIOR ECOLOGY AND EVOLUTION THIRD EDITIONTHE ANIMAL DIALOGUES UNCOMMON ENCOUNTERS IN THE WILDANIMAL KINGDOM PDF EBOOK EPUB MOBI
More informationImproving Productivity: Private, Social and Public Sector Perspectives
Improving Productivity: Private, Social and Public Sector Perspectives Remarks by Steven J. Davis faculty.chicagobooth.edu/steven.davis/ The University of Chicago Center in Delhi 29 March 2014 World Management
More informationTowards a Software Engineering Research Framework: Extending Design Science Research
Towards a Software Engineering Research Framework: Extending Design Science Research Murat Pasa Uysal 1 1Department of Management Information Systems, Ufuk University, Ankara, Turkey ---------------------------------------------------------------------***---------------------------------------------------------------------
More informationMacroeconomics: Principles, Applications, and Tools
Macroeconomics: Principles, Applications, and Tools NINTH EDITION Chapter 8 Why Do Economies Grow? Learning Objectives 8.1 Calculate economic growth rates. 8.2 Explain the role of capital in economic growth.
More informationSurveillance and Calibration Verification Using Autoassociative Neural Networks
Surveillance and Calibration Verification Using Autoassociative Neural Networks Darryl J. Wrest, J. Wesley Hines, and Robert E. Uhrig* Department of Nuclear Engineering, University of Tennessee, Knoxville,
More informationDate. Probability. Chapter
Date Probability Contests, lotteries, and games offer the chance to win just about anything. You can win a cup of coffee. Even better, you can win cars, houses, vacations, or millions of dollars. Games
More informationCritical and Social Perspectives on Mindfulness
Critical and Social Perspectives on Mindfulness Day: Thursday 12th July 2018 Time: 9:00 10:15 am Track: Mindfulness in Society It is imperative to bring attention to underexplored social and cultural aspects
More informationArmy Research Laboratory -Orlando TSIS 2017
Army Research Laboratory -Orlando TSIS 2017 COL Harold Buhl, Jr. Army Science and Technology (S&T) Timeframe Near Mid Far Window Quick Reaction: 1-2 Years Experimental Prototyping: 2-4 Years Innovate Technology
More informationA brief introduction to... Human-centred design and behavioural science. A brief introduction to... Human-centred design and behavioural science
A brief introduction to... Human-centred design and behavioural science 1 Human-centred design and behavioural science Putting the human at the centre Photography by Jessica Podraza What are Human-centred
More informationTrieste Forum. Impact of Science and Technology on Society and Economy
Message from Mr. Kassym-Jomart Tokayev United Nations Under-Secretary-General Director-General of the United Nations Office at Geneva Trieste Forum Impact of Science and Technology on Society and Economy
More informationThe communication dimension of wind energy: Challenges and opportunities
The communication dimension of wind energy: Challenges and opportunities OPPORTUNITIES 1. Pew Research Center for the People and the Press, 2009 2. Pew Research Center for the People and the Press, 2009
More informationTowards a Consumer-Driven Energy System
IEA Committee on Energy Research and Technology EXPERTS GROUP ON R&D PRIORITY-SETTING AND EVALUATION Towards a Consumer-Driven Energy System Understanding Human Behaviour Workshop Summary 12-13 October
More informationAccelerated Inclusive Growth. through. Inclusive Innovation
Accelerated Inclusive Growth through Inclusive Innovation R.A.Mashelkar 20 March 2014 Inclusive Innovation Drivers Emerging Economies Rising Incomes & Aspirations Rising Inequalities Rising Social Disharmony
More informationFactors influencing the adoption of building information modeling in the AEC Industry
icccbe 2010 Nottingham University Press Proceedings of the International Conference on Computing in Civil and Building Engineering W Tizani (Editor) Factors influencing the adoption of building information
More informationCorporate Social Responsibility Practices among Small and Medium Enterprises in Sri Lanka. W. M. H. Piumali and R. M. C. Kumari
Corporate Social Responsibility Practices among Small and Medium Enterprises in Sri Lanka W. M. H. Piumali and R. M. C. Kumari Department of Marketing Management, Faculty of Management, University of Peradeniya,
More informationTransformation of Power Distribution
Technology: Enabling the Transformation of Power Distribution Roadmap & Reforms 30 th October 2008 1 This Is An Update To The 2002 IT Task Force Report 2002: Laid out a roadmap on role of IT Limited implementation
More informationGECC Assessment of TECH Technology in World Civilization
GECC Assessment of TECH 393 - Technology in World Civilization Winter Quarter 2010 Section 01 Facilitated by: William Loendorf Section 02 Facilitated by: Dan Sisson Section 85 Facilitated by: Terence Geyer
More informationTHE STATE OF THE SOCIAL SCIENCE OF NANOSCIENCE. D. M. Berube, NCSU, Raleigh
THE STATE OF THE SOCIAL SCIENCE OF NANOSCIENCE D. M. Berube, NCSU, Raleigh Some problems are wicked and sticky, two terms that describe big problems that are not resolvable by simple and traditional solutions.
More informationExecutive Summary Industry s Responsibility in Promoting Responsible Development and Use:
Executive Summary Artificial Intelligence (AI) is a suite of technologies capable of learning, reasoning, adapting, and performing tasks in ways inspired by the human mind. With access to data and the
More informationMany people dream of starting a business - but are hesitant to start a business of
Starting a Business Quiz Question 1 Question: You enjoy making decisions and being in charge. A. Definitely B. Most of the time C. Sometimes D. Not at all Wrong Answer Sorry, that's an incorrect answer.
More informationInnovation in the Energy Sector: Which Technologies do we need after 2030 and which policies do we need now?
15th IAEE European Conference 2017 Heading Towards Sustainable Energy Systems: Evolution or Revolution? 3rd to 6th September 2017, Hofburg Congress Center, Vienna, Austria Innovation in the Energy Sector:
More informationMeasuring well-being and progress
Measuring well-being and progress For many years, the OECD has been looking beyond the functioning of the economic system to consider the diverse experiences and living conditions of people and households.
More informationDigital Transformation towards Society /09/07 Shigetoshi SAMESHIMA Research & Development Group, Hitachi, Ltd.
Digital Transformation towards Society 5.0 2017/09/07 Shigetoshi SAMESHIMA Research & Development Group, Hitachi, Ltd. 1. Changes of Macro-Environment 2. Society 5.0: Society Vision of Japan 3. Autonomous
More informationOverview of Research toward Realization of Intelligent Society
Overview of Research toward Realization of Intelligent Society Hirotaka Hara Kazushi Ishigaki Fujitsu Laboratories carries out research and development for the realization of Intelligent Society, which
More informationI S S U E N O. 1 / / V O L U M E N O. 1 / / S E P THE ROAD TO SUCCESS Y O U R J O U R N E Y S T A R T S T O D A Y
I S S U E N O. 1 / / V O L U M E N O. 1 / / S E P 2 0 1 7 THE ROAD TO SUCCESS Y O U R J O U R N E Y S T A R T S T O D A Y HOW TO WRITE A GOOD CV? TIPS AND TRICKS! PINAR SOLAKARI When it comes to write
More informationImplementation of Systems Medicine across Europe
THE CASyM ROADMAP Implementation of Systems Medicine across Europe A short roadmap guide 0 The road toward Systems Medicine A new paradigm for medical research and practice There has been a data generation
More informationEncouraging SME Participation in Public Procurement Markets in MENA
Encouraging SME Participation in Public Procurement Markets in MENA LEBANON IOF PALESTINE BIRZEIT UNIVERSITY iegovern Impact Evaluation Workshop Istanbul, Turkey January 27-30, 2015 : #iegovern What is
More informationBusiness angels Published on Innovation Policy Platform (https://www.innovationpolicyplatform.org)
This section explores the role of business angels in financing prototype development and market demonstrations. It provides a full characterization of business angels (types, motivations, activities they
More informationChanneling Facebook into checkbook: Zuckerbergs to donate billions
Channeling Facebook into checkbook: Zuckerbergs to donate billions By Washington Post, adapted by Newsela staff on 12.07.15 Word Count 814 In this undated photo provided by Mark Zuckerberg (left), Max
More informationHow U.S. Employment Is Changing
December 1, 211 How U.S. Employment Is Changing Stephen P. A. Brown and Hui Liu During the most recent recession, U.S. employment fell by 7,49 million jobs (5.4 percent). During the first 8 months of the
More information