Altmetric. Ben McLeish

Transcription

1 Altmetric Ben McLeish

2 What we ll cover Altmetric s Unique Data and Data Gathering Items with scholarly Identifiers Items without scholarly Identifiers Article/Author/Department/Institutional Data analysis Questions and Answers

3 Global, multi-industry customer base

4 Altmetric s Unique Data and Data Gathering Items with an Identifier

5 Altmetric s Unique Data and Data Gathering Items with an Identifier DOIs PubMed ID arxiv ID + ASD General Health Sciences Physics, Mathematics & Computer Sciences, Astrophysics data system ISBN SSRN ID RePEC ID Handles ClinicalTrials.gov Records (NCT) URN Books, Book Chapters, Reports Social Sciences Economics General Medicine/biomedical European Data Repositories

6 Altmetric s Unique Data and Data Gathering Items with an Identifier

7 Data Mining: Mainstream News in Full 2.5 million stories scanned every week Track links to research (Short and Long) Data Mining Author + title detection Journal Title Detection Links to each mention 2,100 weekly stories mention research

8 Data Mining: Discovering coverage that doesn t directly cite research

9 Data Mining: Discovering coverage that doesn t directly cite research

10 Data Mining: Discovering coverage that doesn t cite research AT ALL No Links. No clear mentions of the research

11 Data Mining: Discovering coverage that doesn t cite research AT ALL

12

13 Policy Document Data Mining 44 Sources, 50,000 documents British Thoracic Society Guidelines AWMF - Association of Scientific Medical Societies European Food Safety Authority (EFSA) Food and Agriculture Organization GOV.UK - Policy papers, Research & Analysis International Committee of the Red Cross (ICRC) CARE International - CARE Insights Centers for Disease Control and Prevention (CDC) Mental Health Foundation Medicins Sans Frontieres UK, American, International National Institute for Health and Care Excellence NICE Evidence Services The Food and Drug Administration (FDA) The Microbiology Society UK Parliament Briefing Notes World Bank International Monetary Fund

14 Example: Research buried in PDF without identifer used

15 Differing citations, no identifier, author name permutations...

16 The oldest policy items go back 68 years Oldest item: 1948 (FAO policy document)

17 Critical Alerting on Critical Attention Sources PubPeer, Publons, Faculty of 1000

18 Critical Alerting on Critical Attention Sources PubPeer, Publons, Faculty of 1000

19 Comprehensive Social Media Tracking Facebook Wall Posts Mention, Context, Links to Originals

20 Altmetric s Unique Data and Data Gathering Items without an Identifier

21 Altmetric s Unique Data and Data Gathering Items without a scholarly Identifier

22 A Data Firehose 38 million total mentions of research 8 million outputs tracked (articles, data sets,code, book chapters etc) 2 million news stories in 33 languages 50,000 policy papers indexed in fulltext and data mined 150,000 new outputs are mentioned every month...one mention every 2 seconds...

23 Here s how fast it happens

24 Institutional Analysis Putting the Data to Work

25 By audiences beyond researchers General public Government agencies/ngos/non-profits Users Professional practitioners (lawyers, legislators, faculty, etc) Interested parties (patients)

26 Uses and Evaluations: Article-Level How does an article compare to other items? - from the same publication/source? - from the same time period - combination of the above - overall in comparison to the entire Altmetric database Article Timeline: where did it first get traction? Social media? Policy? Set Alerts: any new mention of the item by /data via CSV download

27 Uses and Evaluations: Author-Level What s the strongest source of attention? News? Wikipedia? Policy? What positive/negative attention is the author receiving? PubPeer, F1000 Set alerts: any new mention of author s work at the institution/csv download Social impact: Policy, Wikipedia, News Networking with Unexpected communities, new collaborators

28 Uses and Evaluations: Department/Institution What s the highest scoring item at the institution? Trend of attention increasing/decreasing? - Eg: Maastricht: PubPeer mentions have doubled in Why? - Benchmark PR and comms strategy Group of items which had press releases vs. items without - Set Alerts: any new research attention for all data

29 Press, Media, Communications Incoming attention: Altmetric + Pure: New publications, New Attention Vivo (or similar) and combine with Altmetric badges Media knows who to contact, sees existing attention PR and Comms access to Altmetric allows for interdisciplinary reactivity Outgoing attention: Kudos provides tools for improving reach Also allows for Explanation of Data

30 Discover how research influences teaching Data from Open Syllabus Project Geographic Data from Grid.ac

31 Funders are noticing - Broader Dissemination Broader Impact Grant funders looking for proof of broader impacts often defined as an effect, change, or benefit to the economy, society, culture, public policies, health, the environment, etc. Research Excellence Framework, Broaden dissemination to enhance scientific and technological understanding, for example, by presenting results of research and education projects in formats useful to students, scientists and engineers, members of Congress, teachers, and the general public.

32 Funders are noticing - Broader Dissemination Broader Impact The primary aim of SEP assessments is to reveal and confirm the quality and the relevance of the research to society and to improve these where necessary. Royal Netherlands Academy of Arts and Sciences H2020 s 'Impact Criterion [E]nhancing innovation capacity and integration of new knowledge, to strengthening the competitiveness and growth of companies by developing and delivering innovations meeting market needs, and to other environmental or social impacts[ ]

33 What the World is Saying About Your Research

34 Brief interlude: How do the colors/weightings work? Mention type Points News 8 Blogs 5 Twitter 1 Facebook 0.25 Sina Weibo 1 Wikipedia 3 Policy Documents (per source) 3 Q&A 0.25 F1000/Publons/ Pubpeer 1 YouTube 0.25 Reddit/Pinterest 0.25 More info at: - About altmetrics The donut and score LinkedIn 0.5