Impact for Social Sciences and the Handbook for Social Scientists Jane Tinkler LSE Public Policy Group 21 June 2011
Structure of this talk Defining research impacts o PPG s view of impact o HEFCE s view of impact External impacts o How do they happen? o How can you measure them? o How do you contextualise them? o What constrains them? Top tips for increasing impact
Defining research impacts A research impactis a recorded or otherwise auditable occasion of influence from academic research on another actor or organization. a. Academic impacts from research are influences upon actors in academia or universities, e.g. as measured by citations in other academic authors work. b. External impacts are influences on actors outside higher education, that is, in business, government or civil society, e.g. as measured by references in the trade press or in government documents, or by coverage in mass media.
PPG view of impact Primary impacts observable occasions of influence A c a d e m i c w o r k Academic impacts e.g. citations External impacts e.g. influence counts Dynamic knowledge inventory Academic/ university outputs Economic/ public policy/ civil society outputs Academic work and external impacts: allowing for time lags and cumulation/ delay effects
HEFCE view of impact needs firstly evidence of changed outputs Primary impacts observable occasions of influence Changes in organizational activities or outputs A c a d e m i c w o r k Academic impacts e.g. citations External impacts e.g. influence counts Dynamic knowledge inventory Economic/ public policy/ civil society outputs Multiple other factors Demonstrated, controlling for other influences
HEFCE view of impact needs secondly evidence of changed outcomes Primary impacts observable occasions of influence Changes in organizational activities or outputs Changes in societal outcomes A c a d e m i c w o r k Academic impacts e.g. citations External impacts e.g. influence counts Dynamic knowledge inventory Economic/ public policy/ civil society outputs Multiple other factors Economic/ public policy/ civil society outputs Controlling for other influences
HEFCE view of impact needs thirdly proof of positive social benefits Primary impacts observable occasions of influence Changes in organizational activities or outputs Changes in societal outcomes Evaluations of outcome changes against societal values A c a d e m i c w o r k Academic impacts e.g. citations External impacts e.g. influence counts Dynamic knowledge inventory Economic/ public policy/ civil society outputs Multiple other factors Economic/ public policy/ civil society outputs +? -
External impacts: how do they happen? 6a. Insider, elite reputation 6b. Public, media reputation 6. External reputation 7. Experience 8. Track record 5. Interaction expertise 1. Academic credibility 4. Personal communication capacity 2. Dispositional and sub-field constraints 3. Networking skills Key: Low Medium High
How the impacts interface shapes external impacts Single discipline processes Joined-up scholarship Impacts interface Wider society Renewal Discovery Integration Bridging University - local integration Media Specialist Media Professions Corporations Entrepreneurs Consultants Media, cultural and civil society systems Economic and business systems Application Academic Service Think tanks Policy communities NGOs Public policy systems
External impacts: How do you measure them? Six metrics of academic/university involvements with external impact o External funding linkages, especially businessto-sciences/ technology departments o Media and specialist media presence o Government website presence o Academic service in government o Reported knowledge transfer activities o Academics perceptions of impacts
Universities key interactions with business in the UK 2007-08 2008-09 Change % Change Collaborative research ( 000s) 697,030 731,734 34,704 5 Contract research Total number of contracts 27,051 28,111 1,060 4 Total value of contracts ( 000s) 834,627 937,373 102,746 11 Consultancy Total number of contracts 64,292 64,025-267 0 Total income ( 000s) 334,768 331,541-3,227-1 of which, number with SMEs 22,802 20,596-2,206-11 number with large business 10,499 10,360-139 -1 Patents Number of new patent applications 1,898 2,097 199 9 Number of patents granted in year 590 653 63 10 Intellectual property income Total revenues ( 000s) 66,271 124,368 58,097 47 Total costs ( 000s) 21,003 27,794 6,791 24 Spin-off companies Number created 2,223 2,289 66 3 Estimated external investment received ( 000s) 89,497 154,451 64,954 42
Proportion of research found in UK national press from different disciplines (2008) Health and Medicine Science and Technology Politics Economics Business and Finance Psychology Law History Sociology Philosophy English Communication and Media Architecture Education Arts Humanities* Computer science Anthropology Languages Geography 0 10 20 30 40 50 60 Number of items
Proportion of research found on UK government websites from different disciplines Social policy and anthropology Medicine HSS Medical sciences Law and legal Health policy and public health Mixed Criminology and criminal policy Employment and work Psychology and psychiatry Development Education Public policy and policy studies Transport policy Politics and democracy Management and media studies Technology Science and engineering Economics Geography Design Creative and arts Archeology 0 5 10 15 20 25 Percentage of all research projects found
Academic Service: University staff involved in UK central government quasi-government agencies University funding bodies Wider government bodies All bodies Top academics (managing universities) 28 21 24 Heads of department 15 12 13 Professors 58 57 57 Lecturers 0 11 7 Total 101% 100% 100% Number of academics 80 131 232 Source: Griffiths, 2010
Academics reporting of knowledge transfer activities - top 11 activities Knowledge transfer practice % academics involved 2009 % academics involved 2008 type of academic activity Attending conferences 87 56 general Informal advice to business 57 35 application External lectures 65 34 application Networks 67 32 integration Joint publication 46 26 application Advisory boards 38 22 service Student projects/placements 33 20 renewal External visits 19 application Formed/run consultancy 14 18 application Contract research 37 18 application Undertaken consultancy 43 17 application
Social science and humanities academics perceptions of external impacts (2008) Area of external impacts Level of impact Social scientists only Academics spanning social sciences and humanities All respondents (including academics across all social science and humanities) Public policy Actual 4.6 3.6 3.4 Potential 6.0 5.5 5.1 Civil society Actual 4.5 4.1 4.1 Potential 5.6 5.3 5.1 Public debates and Actual 3.9 5.0 4.6 culture Potential 5.4 5.9 5.6 Economy and Actual 3.6 3.1 3.0 business Science and technology Potential 4.7 4.0 3.8 Actual 3.1 3.4 2.9 Potential 4.5 4.1 3.9
External impacts: How do you contextualise them? Positions: early-years researcher, senior lecturer, professor Academic roles: research, teaching, academic citizenship, academic management, dissemination Disciplines: subject areas are more linked in to particular external groups
External impacts: Differences by discipline Mentions to Economists Think Tank 35 Mentions to Political Scientists Think Tank 30 Society Group or Indiv 30 25 20 15 10 5 0 Government Press Group or Indiv Society 25 20 15 10 5 0 Government Press Business Library Business Library Other/NA Other/NA Mentions to Geographers Think Tank 30 Group or Indiv 25 20 15 Government 10 Society 5 0 Press Business Library Other/NA
External impacts: What constrains them? Higher Education Institution Lack of time Bureaucracy and inflexibility of HEI administration Difficulties in identifying partners Insufficient rewards and lack of awareness of the benefits from the interactions Lack of understanding by academics of the process Capacity and capability of the KE system still developing / evolving Private / public / third sector organisation Lack of resources within external organisations to fund the KE engagement Insufficient benefits from the interaction Lack of interest by external organisations and lack of demand for KE Intellectual property agreements as a barrier to some, albeit minority of, KE engagement Source: PACEC/CBR Survey of Academics (2008); PACEC/CBR Survey of Enterprise Offices (2010); CBR Survey of Enterprises (2008)
Top tips for increasing academic impacts Pick as distinctive a version of your author name as possible and stick with it Write informative article titles, abstracts and book blurbs Work with colleagues to produce multi-authored outputs Consider cross-disciplinary research projects Build communication and dissemination plans into research projects early on Always put a version of any output on the open web
Top tips for increasing external impacts for academics Most importantly, create an impact file to collect information on all your external interactions Consider alternative methods of disseminating research outputs that are tailored to particular audience groups Research mediators such as think tanks or community groups are a good way to link into networks of interest Use all available dissemination resources e.g. online depositories, seminar series, multi-author blogs, knowledge transfer schemes
Top tips for increasing external impacts for universities and departments Provide an overall steer on the value of dissemination and impact for all academic staff Incentivise this through promotion and advancement processes Factor dissemination and impact into calculations of academic workload and time burdens Re-evaluate event /conference programmes Host online depositories or other dissemination opportunities such as blogs Facilitate collaboration and linking to dedicated expert teams/consultancies
For more details see: Maximising the Impacts of your Work handbook Impact of Social Science blog: http://blogs.lse.ac.uk/impactofsocialsciences/ Email: impactofsocialsciences@lse.ac.uk Twitter: @lseimpactblog Facebook: Impact of Social Sciences