More Than Citations and Impact Factor: Altmetric.com Terri E. Moffitt - Alyson Williams - Sara Rouhi - Duke University Inter-American Development Bank Altmetric.com November 12, 2014 #alctsce
Our Presenters Sara Rouhi Altmetric.com Terrie Moffitt Duke University Alyson Williams Inter-American Development Bank
ALCTS Webinar Logistics All attendees are muted. To comment on today s presentation, you may wish to use Twitter: #alctsce If you have questions for our presenter(s), please type them into the question box on your screen. This webinar is being recorded and all will receive an email with links to the recording, the presentation slides, and an evaluation.
Today we ll cover Overview of Altmetric Sara Rouhi, Product Specialist, Altmetric Case study: Principal Investigator/Lab Dr. Terrie Moffitt, Professor of Psychology, Duke University Case study: Special Library/Bank Alyson Williams, Knowledge and Learning Specialist at Inter- American Development Bank Hosted by ALCTS, the Association for Library Collections & Technical Services
Researchers talk: Let s listen. An introduction to #altmetrics and Altmetric.com Sara Rouhi November 12, 2014 sara@altmetric.com @RouhiRoo Hosted by ALCTS, the Association for Library Collections & Technical Services
The conversation is moving online... 35K online mentions of scholarly articles every day. 1 mention every 2.5 seconds! 137K unique articles are shared each week. >2M articles with tracked attention data. Source: Altmetric internal data, June 2014
Traditional metrics lag behind
Funders are noticing Grant funders looking for proof of broader impacts often defined as an effect, change, or benefit to the economy, society, culture, public policies, health, the environment, etc. Research Excellence Framework, http://www.ref.ac.uk/panels/assessmentcriteriaandleveldefinitions/ Broaden dissemination to enhance scientific and technological understanding, for example, by presenting results of research and education projects in formats useful to students, scientists and engineers, members of Congress, teachers, and the general public. http://www.nsf.gov/pubs/2007/nsf07046/nsf07046.jsp
Our definition An alternative, more immediate measure of impact Not a replacement but a complement Policy documents, blogs, mainstream news, social media From nontraditional sources To provide a larger context #altmetrics can help provide a broader view
Who are we? Altmetric is a data science company that tracks attention to research outputs, delivering article level metrics via visually engaging, intuitive interfaces. In other words, we help give credit where credit is due.
Science of data: high quality, highly relevance sources News outlets Post-pub peer review Reference managers Social media and blogs Other sources
Other sources: policy documents ASHA Practice Policy AWMF - Association of Scientific Medical Societies European Food Safety Authority (EFSA) Food and Agriculture Organization GOV.UK - Policy papers, Research & Analysis Intergovernmental Panel on Climate Change (IPCC) International Committee of the Red Cross (ICRC) International Monetary Fund (IMF) (Tracking working papers) Medicins sans Frontieres (MSF) Mental Health Foundation (UK) NICE Evidence UNESCO World Health Organization (WHO) And more being added each week
Intuitive interfaces: details, donut, score
Wait, what s that donut?
Demographics Tab Demographic data is about providing CONTEXT. Who is reading your work? Where are they? What stage of their career are they in?
The score: Benchmarking
Telling a story: What can the data tell you? What type of attention is this research receiving? Where has this article received the most traction? Which countries are engaging most with the content? Has this article influenced policy, spurred new research, or engaged a new audience? Are reactions to this article positive or negative?
What the data doesn t tell you The quality of the paper The quality of the researchers The whole story Context matters!
Who uses Altmetric data? Institutions Research institutes Government agencies Top research universities Corporations Think tanks
How have Institutions used the data Institutional repository badge embeds Badge integration with discovery systems Altmetric for Institutions
Introducing Altmetric for Institutions
Thank you! altmetric.com @altmetric
Principal Investigator Case Study: Demonstrating broader impacts Terrie Moffitt, PhD Nannerl O. Keohane Professor Professor, Duke Psychology and Neuroscience Psychiatry & Behavioral Sciences Duke University Professor of Psychiatry Kings College London 12 November 2014 Hosted by ALCTS, the Association for Library Collections & Technical Services
Try the bookmarklet, it s ultra cool
Article by article wasn t enough
Article by article wasn t enough
Article by article wasn t enough
Making the case for demonstrating broader impact How well does the activity advance discovery and understanding while promoting teaching, training, and learning? How well does the proposed activity broaden the participation of underrepresented groups (e.g., gender, ethnicity, disability, geographic, etc.)? To what extent will it enhance the infrastructure for research and education, such as facilities, instrumentation, networks, and partnerships? Will the results be disseminated broadly to enhance scientific and technological understanding? What may be the benefits of the proposed activity to society? http://www.nsf.gov/pubs/2007/nsf07046/nsf07046.jsp NSF Broader Impacts Criterion
Here s what the Altmetric for Institutions showed me about my own data
Policy documents? Who knew?
Demonstrating broader impact with International News coverage = 60% Data from Article Details Pages 40 38 35 30 Total No. of stories Total No. of outlets 25 25 No. Interna onal outlets 20 15 12 12 10 6 5 3 3 2 6 2 2 2 2 2 0 Ar cle 1 Ar cle 2 Ar cle 3 Ar cle 4 Ar cle 5 Ar cle 6 Ar cle 7 Ar cle 8 Ar cle 9 Ar cle 10
Demonstrating broader impact with International Blog coverage = 40% Data from Article Details Pages
New communities, new conversations From Article Details Pages
Many many more eyeballs my T10 4,500,000 Twitter reach by article - Total upward bound: 5,630,639 4,000,000 3,941,227 3,500,000 3,000,000 2,500,000 Even if 1% click on the article, that s 56,000 eyes that never would have seen it before Twitter. 2,000,000 1,500,000 1,000,000 500,000 0 634,343 190,593 263,719 187,480 70,617 137,926 115,455 84,158 5,121 Article 1 Article 2 Article 3 Article 4 Article 5 Article 6 Article 7 Article 8 Article 9 Article 10 Data from Article Details Pages
Bottom line? #altmetrics make me look better From NIH Program Manager [This altmetric data is] fantastic information for [our] budget report. I save a tremendous amount time for my lab and me having to demonstrate evidence of impact to various funders via researchfish.
And we re always learning No idea that our methods papers were getting so much attention Too boring for news Long time to get citations But young researchers care and are tweeting extensively! Altmetrics can help me teach undergraduates Students will be asked to find top papers (in terms of attention) in different areas See first hand the impact of the internet and online media in disseminating important, life changing research
Thank you! Terrie Moffitt, PhD Nannerl O. Keohane Professor Professor, Duke Psychology and Neuroscience Psychiatry & Behavioral Sciences Duke University Professor of Psychiatry Kings College London
Hosted by ALCTS, the Association for Library Collections & Technical Services
http://www.iadb.org The Inter-American Development Bank Discussion Papers and Presentations are documents prepared by both Bank and non-bank personnel as supporting materials for events and are often produced on an expedited publication schedule without formal editing or review. The information and opinions presented in these publications are entirely those of the author(s), and no endorsement by the Inter-American Development Bank, its Board of Executive Directors, or the countries they represent is expressed or implied. This presentation may be reproduced with prior written consent of the author.
IDB Background Leading lender to Latin America & the Caribbean Focus on development in the region 48 member countries 26 borrowing members
Felipe Herrera Library & the Institutional Repository Bank Repository of Institutional Knowledge Manage Publications Process
IDB & Altmetric: the beginning
IDB & Altmetric: the story so far
IDB & Altmetric: the story so far
IDB & Altmetric: the story so far
IDB & Altmetric: the present & the future Presentations to department Up to 300 publications Exploring New Sources Interest from specialists just beginning
QUESTIONS? PREGUNTAS? Alyson Williams alysonw@iadb.org @alysonkwilliams
Upcoming ALCTS CE Opportunities http://www.ala.org/alcts/confevents Webinars November 19 December 3 December 10 December 17 Authority Records and Copyright Determination Can I Copyright My Data? Use of Social Media in the Library How to Host a Preservation Week Event ComingSpring 2015: Series on Continuing Resources, Transforming MARC Using XSLT, LibGuides in TS, Time Management, etc.
Upcoming ALCTS CE Opportunities http://www.ala.org/alcts/confevents Web Courses Scheduled throughout the year Acquisitions Cataloging Collection Assessment Collection Development and Management Electronic Resource Acquisitions e-forums Being scheduled Submit a proposal: https://alctsprogram.wufoo.com/forms/p7x3x5/