ITACOSM 2017 WHO ARE THE USERS? AND WHAT SHOULD THEY KNOW? European Social Survey. Bologna, 15 th June 2017

Transcription

1 European Social Survey WHO ARE THE USERS? AND WHAT SHOULD THEY KNOW? ITACOSM 2017 Bologna, 15 th June 2017 Luca Salini, Researcher, ESS ERIC HQ City, University of London ESS is a European Research Infrastructure Consortium (ESS ERIC)

2 Part 1 WHO ARE THE ESS USERS? 2

3 A bit of history Biennial cross-national social survey established in 2001 Data collected since (Round 1) / Round 8 in First ever ESS data release: 22 Sep 2003 Access to data: non-privileged and free for non-commercial use Descartes Prize for Research & Science Communication (2005) ERIC status (2013) ESFRI Landmark (2016) 3

4 Key figures 105,942 registered data users on the ESS website (April 2017) 73,949 of these have downloaded data for offline analysis (April 2017) 3,140 ESS publications and citations based on ESS data recorded in the period (Google Scholar analysis) 2,704 outputs and publications registered in the ESS online bibliography (March 2017) 4

5 ESS users as producers of impact (linear model) ESS data ESS data use Research New knowledge gained Teaching impact Outputs Policy/practice development Research users Intermediaries Non academic dissemination Academic dissemination Non-academic impact Academic impact Source: Technopolis, ESS Impact Case Study (preliminary findings), April

6 ESS user groups Main user groups: Students: 63.7% Academics (faculty / research & PhD): 26.8% Others (private, NGOs, policy, etc.): 9.5% Proportions between user types vary between countries Largest countries tend to have the most users Adjusted for population, very different pictures emerge Many countries are strong in some user types and weaker in others 7

7 Registered ESS users by country Germany Belgium United Kingdom Netherlands United States Spain Norway Poland Slovenia Italy Source: ESS ERIC data, May

8 Academic affiliation of users Rank Institution Country Count Rank Institution Country Count 1 Universiteit Antwerpen BE HINT NO University of Ljubljana SI University of Copenhagen DK KU Leuven BE University of Helsinki FI University of Amsterdam NL University of Tartu EE University of Bergen NO LSE GB Sciences Po FR University of Geneva CH ULG BE Aarhus University DK NTNU NO Radboud Universiteit Nijmegen NL University of Vienna AT ISCTE PT NRU HSE RU University of Oslo NO UCD IE University of Exeter GB Univ. Pompeu Fabra ES University of Turku FI Bocconi University IT University of Duisburg-Essen DE Warsaw School of Econ. PL University of Lausanne CH University of Mannheim DE University of Oxford GB 271 Estimates based on freeform-entry by users (Jul 2016); may exclude less common misspellings and abbreviations 9

9 User growth over time Total registered users Net yearly increase in registered users Source: Technopolis analysis on ESS ERIC data, April

10 Some active users are new, but many are long-term 12% 10% 11% 9% 9% 9% 8% 6% 4% 4% 4% 3% 4% 4% 6% 4% 6% 5% 5% 7% 6% 3% 2% 1% 0% Item from survey of ESS data users: In what year did you first access ESS data or information? (Please give us your best estimate) Source: Technopolis, ESS Impact Case Study (preliminary findings), April

11 Country-level trends Switzerland - net yearly increase in registered users on ESS data portal : creation of FORS; ability to better promote (growth of other int l surveys!) Austria - net yearly increase in registered users on ESS data portal : Round 6 missed; problems with timely data collection prior to that. From Round 7: back in; new coordination regime Source: Technopolis, ESS Impact Case Study (preliminary findings), April

12 ESS-based outputs (online bibliography) Source: Technopolis analysis on ESS ERIC data, March

13 Beyond the ivory tower: non-academic outputs Source: Technopolis, ESS Impact Case Study (preliminary findings), April

14 ESS-based outputs over time (Google Scholar) Source: ESS bibliographic monitoring report 2016 Brina Malnar, University of Ljubljana and ESS ERIC 16

15 Research topics of ESS-based outputs Source: ESS bibliographic monitoring report 2016 Brina Malnar, University of Ljubljana and ESS ERIC 17

16 Affiliation of first authors of ESS-based outputs 18 Source: ESS bibliographic monitoring report 2016 Brina Malnar, University of Ljubljana and ESS ERIC

17 Part 2 WHAT SHOULD THE ESS USERS KNOW? 19

18 Additional ESS data sources Cumulative data (used in ~40% ESS-based publications) Multilevel data (used in ~50% ESS-based publications) Media claims (events during fieldwork) Contact form data Interviewer questionnaire data Sample design data files Test variables (MTMM) 20

19 Usage of multilevel data Source: ESS bibliographic monitoring report 2016 Brina Malnar, University of Ljubljana and ESS ERIC 21

20 Standards of methodological reporting in ESS-based outputs Source: ESS bibliographic monitoring report 2016 Brina Malnar, University of Ljubljana and ESS ERIC 22

21 Standards of methodological reporting in ESS-based outputs Item from survey of ESS data users: In relation to any outputs you have produced using ESS data or information, how frequently have you cited the ESS? 40% 35% 30% 25% 36.7% 37.4% 20% 15% 10% 16.4% 8.7% 5% 0% 0.5% 0.3% Never Occasionally Usually Always Not applicable (no outputs) (blank) Source: Technopolis, ESS Impact Case Study (preliminary findings), April

22 ESS documentation availability (1) ESS website Methodology section Overview of ESS life cycle and ongoing lines of methodological research Summary of information, guidelines and methodological documents (e.g. Weighting Guidelines) on each stage, as well as related publications 24 Source: ESS ERIC, 2016

23 ESS documentation availability (2) Module-specific documentation (chapters on development of core modules, Question Design Templates for rotating modules) Item-specific documentation (appendices, syntax files, working papers) Comprehensive Data Documentation Reports and National Technical Summaries for each country and round Fieldwork Summary and Deviations from ESS Specifications for each country and round 25

24 Conclusions Increasing audience and volume of publications increased responsibility of engaging in high quality communication on ESS methods Challenges and opportunities for improvement are manifold e.g. communicating better to the general public, bridging the gap between survey methodologists and substantive users Combine different sources of information to better target efforts Bibliographic monitoring and online bibliography Impact case study Website analytics Other avenues of feedback (e.g. International ESS Conference) Best practices from official statistics and other RIs 26

25 CONTACT