Article value, quality and innovation. Philippe Terheggen, Elsevier

Transcription

1 Article value, quality and innovation Philippe Terheggen, Elsevier

2 The E-journal revolution Introduction Article access and value of information Article quality and peer review The article of the future Mapping out the research landscape

3 Introduction WHAT PUBLISHERS DO WHEN ELSEVIER STARTED THE PUBLICATION CYCLE

4 Core tasks of publishing houses Registration of new findings Quality assurance through peer review Global dissemination Archiving in perpetuity

5 Article Share Share of Journal Articles Published 26% Elsevier Our Scientific Disciplines Environmental Sciences Earth Sciences Life sciences Social Sciences Others Wiley-Blackwell Springer Maths & computer science Physics Materials Science & Engineering IEEE Taylor & Francis APS ACS AIP Wolters Kluwer ~1.2 million English language research articles published globally Chemistry & Chemical Engineering 220,000+ English language research articles published with Elsevier S&T Journals 5

6 What do journal publishers do? 5,000 new editors per year 500 new journals launched per year Organise editorial boards Launch new specialist journals 40 million articles available digitally, back to early 1800s Archive and promote Solicit and manage submissions 3 Million+ article submissions per year 2.5 million+ referees 3.75 million+ referee reports per year 50%+ of submissions rejected Manage peer review 12 million researchers 4,500+ institutions 180+ countries 1 billion+ downloads/year 10 million+ printed pages/year Publish and disseminate Production Edit and prepare 125,000 editors 350,000 editorial board members 30 million+ author/publisher communications per year 1.5 million new articles produced per year 180 years of back issues scanned, processed and datatagged Note: industry estimates based on known numbers for a subset of the industry that are then scaled to 100% based on the article share of the known subset. 6

7 Publishers have invested heavily to digitise since 2000 Organize editorial boards Launch new specialist journals Electronic Platforms, e.g. ScienceDirect Wiley InterScience Highwire Scopus > 1500 million Electronic Warehousing > 60 million Archive and promote Publish and disseminate Solicit and manage submissions Other support and related systems > 300 million Production Production Tracking Systems > 50 million Manage peer review Edit and prepare The STM industry has invested an estimated 2+ billion since Author Submission & Editorial Systems > 70 million ejournal Backfiles ereference Works > 150 million Figures in current (2009) UK pounds using gdp deflators 7

8 Elsevier has a long history of scientific publishing The Publishing House of Elzevir was first established in 1580 by Lowys (Louis) Elzevir at the University of Leiden, Holland Keeping to the tradition of publishing established by Lowys Elzevir, Jacobus George Robbers established the modern Elsevier Company in 1880 Among those authors who published with Elsevier are, Galileo, Erasmus, Descartes, Alexander Fleming, Julius Verne 8

9 In 1638 Elzevir published Galileo Galilei s greatest work Galileo published his Discorsi e dimostrazioni matematiche, intoro a due nuoue scienze - his last work with Elzevir despite being banned by the Inquisition and is recognized as the first important work of modern physics The publication of Gray s Anatomy in 1858 was a landmark for the study of the human anatomy and in many ways for the whole of medicine The publication of the book, edited by Sir Alexander Fleming, about a revolutionary new antibiotic, Penicillin: Its Practical Application in

10 Some of our brands 10

11 Core tasks of publishing houses Registration of new findings Quality assurance through peer review Global dissemination Archiving in perpetuity

12 Article access and value of information INFORMATION ACCESS ACCESS AND COSTS INFORMATION AND VALUE RETURNED

13 Why do journal publishers exist? First peer reviewed journal founded in 1665 by Royal Society. Journal publishing has evolved dramatically since, but its core functions remain: Registration of new research findings Quality assurance through peer-review Dissemination globally Archiving in perpetuity Researchers: which publishing objectives are most important to you? Publishers exist to provide highly valued services to researchers Sources: NOP/Elsevier surveys 2005 and

14 STM publishing is driven by R&D outputs Growth in total journals, global R&D workers and STM articles Growth in number of peer reviewed journals Number of titles launched and still extant CAGR= 3.54% R² = % annual growth in R&D funding annually drives 3-4% annual growth in number of R&D workers drives 3-4% growth in number of articles and journals published From , number of articles published by 113 UK universities increased by 5% per year Source: Ulrich s, UNESCO, ThomsonReuters, SCONUL data [Charts updated from: Mabe & Amin( 1991) Scientometrics, 51, ; and Mabe (2003), Serials, 16, ] 14

15 Publishers evolved pricing models to expand electronic access Print-only (pre 1999) Core collections of institutional print journal subscriptions Annual price increases driven by 3-4% annual growth in articles, higher in expanding subject fields 3-4% annual inflation P+E and E-only (post 1999) Core collection plus fee for Electronic access to subscribed titles Annual price increases driven by 3-4% annual growth in articles, higher in expanding subject fields 3-4% annual inflation 20%+ annual usage growth Major volume discounts to access previously unsubscribed-to titles Additional discounts for E-only 15

16 As a result, most customers now access journals electronically Benefits For researchers Remote, desktop access Fast search Interlinked articles efunctions, eg alerts Links to datasets For librarians Easier collection management Usage data per journal Reduced storage space Staff efficiencies Source: E-journals, their use, value and impact, 2009 RIN/Ciber 16

17 UK university researchers are highly satisfied with access to journals Ease of access to research content C linical guidelines Vendo r white papers P atent info rmatio n Legislative / R egulato ry info P atient details M arket research repo rts C M E/ Educatio nal co ntent T echnical repo rts fro m go v't Scient ific/ tech stds D o cto ral theses/ dissertatio ns T echnical info P ro fessio nal/ T rade pubs R eview papers in jo urnals R eference wo rks C o nference pro ceedings Original research articles in jo urnals Average importance to success of organisation PRC study: Survey of access to professional and academic information in the UK, August 2009 companion report 17

18 Globally researchers are highly satisfied with access to journals PRELIMINARY STUDIES NOT YET RELEASED n=3759 n=2940 Access to research articles by region n=1262 n=1653 n=2989 North America 97% Western Europe 94% Eastern Europe 84% n=2118 n=1294 n=2565 n=1868 n=2273 Latin America 88% Middle East 85% APAC 91% Africa 78% n=841 n=2362 Source: PRC global study (forthcoming) 18

19 UK universities access more titles and pay less per title accessed than in 2004 What UK universities get Number of journals accessed Average journals per institute What UK universities pay Amount paid per journal accessed In constant 07/08 currencies (I2004=100) 8,391 9,022 +7% per year 9,601 10,61511, % per year UK universities now access 32% more journals than in 2004, and pay 11% less per journal accessed Source: Based on SCONUL data (Ciber analysis of 113 UK Universities) 19

20 As usage has exploded, effective price paid per article downloaded has fallen Full text article downloads Average per institute 432,693 What UK universities get 632, % CAGR 772, ,415 1,134,165 What UK universities pay Effective price paid / article downloaded GBP (in constant 07/08 currencies ) % CAGR UK universities downloaded > 120 M articles in 2008, 160% more than in The effective mean price paid per article downloaded in 2008 was 70 pence Source: Based on SCONUL data (Ciber analysis of 113 UK Universities) 20

21 UCL study shows e-journal usage drives researcher productivity Doubling in downloads, from 1 to 2 million, is statistically associated with dramatic - but not necessarily causal - increases in research productivity Papers up 207% PhD awards up 168% Research grants and contract income up 324% Even stronger as downloads increase further Source: E-journals, their use, value and impact, 2009 RIN/Ciber 21

22 As a result, UK university researchers punch well above their weight Source: Royal Society, the Scientific Century

23 Publishers are evolving licensing models to extend access to non-university constituents further Corporations, SMEs Hospitals and medical schools Customised access and pricing mechanisms Corporate editions Article choice Pay per view Sponsored articles Customised access and pricing mechanisms Medical collections Article choice Pay per view Sponsored articles Research institutes Individuals Customised access and pricing mechanisms Article choice Sponsored articles Customised access and pricing mechanisms Basic functionality pay per view, e.g. Patient Research, Deep Dyve Article sponsorship 23

24 Information philanthropy is further broadening access globally PatientINFORM provides patients with access to summaries of journal articles and links to full-text: 19 different publishers and STM and PSP organisations with annual cost of $110k. PatientResearch provides patients and carers access to articles in 100+ medical journals for a minimal processing fee. Research4Life provides developing countries with free / low cost access to peerreviewed content to over 8,100 scientific journals, books, and databases. Across three programmes, over 350 publishers provide free / low cost access to over 3,000 institutions across 108 countries Publishers engage with visually impaired and disabled users to make accessibility enhancements to products and websites AccessText Network, supplies resources to support the use of textbooks and this is supported by publishers including Elsevier, Wiley-Blackwell, McGraw-Hill Education and Pearson Education. 24

25 Publishers are continuing to invest: 3. Anti-Plagiarism and Ethics Enforcement Cross-publisher initiative with CrossRef to detect instances of plagiarism in scientific articles Annual investment from publishers of membership and article processing fees Provides online forum for publishers or journal editors to discuss issues regarding scientific and peer review integrity Publishers have introduced the Rightslink reprints and permission system to enable authors to have permissions for content use to be enabled online and receive instant permissions. 25

26 Key issue: university library funding outpaced by R&D outputs Source: SCONUL Average University & Library spend Other O/H 14% Research & Overhead 68% Staff 50% Instruction 29% Library 2.7% 2.3% University Other info 8% Books 9% Journals 19% Library Libraries in 2008 received only 2.7% (net 2.4%) of UK universities budgets, down from 3% in 2004 Library funding is outstripped by R&D funding and outputs, and by total university expenditures 26 26

27 Summary - access and value of information Journal publishers provide an essential and much valued service to researchers Growth in STM publishing is driven by R&D outputs, which increase by 3% annually Library funding is outpaced by the growth in R&D outputs Journal publishers have invested more than 2bn in digital technologies in the 21 st century, delivering massive benefits for: Access for university and non-university researchers Quality of content Productivity of researchers Unit prices for article downloads Publishers are facilitating alternative access models Publishing is a key enabler of leadership positions in R&D 27

28 Article quality, peer review ARTICLE QUALITY AND JOURNAL REPUTATION HOW WE FUND AND ASSIST PEER REVIEW PROCESS HOW WE INNOVATE PEER REVIEW WITH OUR CUSTOMERS SOME OF OUR PEER REVIEW PILOTS HOW WE STIMULATE PUBLICATION ETHICS

29 Driving quality Geology Engineering Tetrahedron Journals Organic & Inorganic Chemistry Atmospheric, Planetary and Petroleum Sc Geochemistry & Geophysics Energy 2 Chemistry 1 Aquatic & Hydrology Energy 1 Physical & Theoretical Chemistry 1 Chemical Eng: General Chem Eng: Catalysis & Envirnm Chem Eng: Minerals & Sep. Mech Engineering: Solid Mech Physical & Theoretical Chemistry 2 Civil Engineering Aerospace, Marine, Comp. Mech Engineering: Fluids & Therm Analytical Chemistry & Sensors Agriculture 1 Aquatic Sciences Agriculture 2 Environmental Science and Ecology 1 Environmental Science and Ecology 2 Rejection Rates % 10% 20% 30% 40% 50% 60% 70% 80%

30 Article quality main driver Elsevier S&T Year Sum of Impact factor Growth % 4% 13% 8%

31 Elsevier s S&T Journal Publishing Cycle 1,000 new editors per year 18 new journals per year Organise editorial boards Launch new specialist journals 800,000+ article submissions per year Solicit and manage submissions 300,000 referees 1.6 million referee reports per year 9 million articles now available Archive and promote Manage peer review 40%-90% of articles rejected 10 million researchers 4,500+ institutions 180+ countries 480 million+ downloads per year 2.5 million print pages per year Publish and disseminate Production Edit and prepare 7,000 editors 70,000 editorial board members 6.5 million author/publisher communications per year 220,000+ new articles produced per year 180 years of back issues scanned, processed and data-tagged 31

32 Peer Review Key author needs: Certification of research Continuation of funding and employment Recognition and career Reviewer Editor To fulfil needs author chooses journal which scores best on key factors Author Article validation Publisher registration, distribution, archive Key factors in journal choice: Impact factor Research Output Data Journal branding / certification Reputation Editorial standard Publication speed etc. Access to audience 32

33 How Elsevier helps editors and reviewers Elsevier organizes and supports the journals editorial boards, ensuring the highest standards of editorial review 7,000 editors and 300,000 reviewers handle more than 0.8M submissions per year (1.6M review reports) Over120 dedicated publishers collaborate with a network of editors, board members, and other prominent scientists, ensuring that the best scientists are connected to the journal as editors or supporters Provision of financial support to editorial offices to enable them to conduct the peer review process (for both accepted and rejected papers) Organization of dozens of editor and reviewer workshops per year at institutes around the world EES connects world wide editorial community with authors Innovation in peer review Our Editor and Reviewer Feedback Programs keep track of satisfaction and points of improvement Our Editor and Reviewer Update newsletters inform editors and reviewers on developments in peer review and the ways we support them The average rejection rate is consistently high (63% in 2008), also for developed countries 33

34 Technology and services to support peer review Elsevier facilitates and improves the peer review process through advanced technology and services EES our online editorial platform, facilitating a web-based peer review process that is transparent and measurable 3,500,000 authors, reviewers and editors use EES 64,000 new submissions are handled each month 24/7 Customer Support is available, handling 200,000 queries per year Online customer support provides training modules, demos, FAQs, and help functions Reference Linking allowing editors and reviewers to access the articles in the reference list of submitted articles with one click Technical Screening pre-screening 157k articles per year (>250 journals) on a set number of criteria (e.g. language), relieving burden from editors and reviewers (24% of screened articles never reaches editors) Free Scopus access for editors (unlimited) and reviewers (one month) Reviewer Finder a tool for editors to find suitable reviewers (in development) 34

35 Peer review pilots Peer review is dedicated feedback in a secure, trusted environment Peer review pilots aiming : A. To increase transparency of peer review to authors, readers B. To increase peer review efficiency or speed C. To allow collaboration between journals D. To increase article relevancy to reviewers E. To stimulate more scientists joining peer review F. To engage readers in the evaluation of science

36 Peer review pilots by Elsevier 1. Reviewer Mentorship Programme 2. Peer Review Consortium 3. Peer Choice 4. Reviewer incentives 36

37 Peer review pilots by Elsevier Pilots 1. Reviewer Mentorship 2. Peer Review Consortium 3. Peer Choice 4. Reviewer incentives Benefits aimed A. To increase transparency B. To increase efficiency or speed C. Collaboration between journals D. To increase article relevance E. More scientists joining peer review F. To engage readers, scientists 37

38 Elsevier peer review experiments (2) 1. Reviewer Mentorship Programme An educational programme for postgraduate students to become certified article reviewers, based on a proven need for more reviewers, guidance on reviewing papers, and a common reviewing standard Programme consists of three phases Reviewer workshop (local or virtual) Traineeship in which trainee performs a number of reviews for an editor, under the supervision of a mentor Graduation and certification Pilot will run in the first half of 2010 in biology and pharmacology areas 2. Peer Review Consortium Enable the sharing of review reports between journals (at the author s request) to run a more efficient and fast peer review process overall 37 journals in neuroscience across publishers and societies participate Current uptake low (1-2%), pilot continues Assign mss Feedback Host & monitor Submit reviews Copy of assignments Keep informed Guidance Signal end 38

39 Elsevier peer review experiments (3) 3. PeerChoice Reversal of the Traditional Model of Reviewer Selection, where the Editors select the Reviewers, by allowing Reviewers to select themselves 3-month pilot in Chemical Physics Letters 40 reviewers Regular alerts 39

40 Elsevier peer review experiments (4) 4. Reviewer Incentives 4. Reviewer incentives (or stimulation) 1.Control Group. 2.Monetary Incentive (or Cash ) Group US$ 100 if review completed < 28 days 3.Shorter deadline (or 4week ) Group Asks for review within 28 days 4.Social Encouragement (or Social ) group Invitation letter describes that refereeing times per referee will be posted online 40

41 Publishers are continuing to invest: Anti-Plagiarism and Publication Ethics Cross-publisher initiative with CrossRef to detect instances of plagiarism in scientific articles Annual investment from publishers of membership and article processing fees Provides online forum for publishers or journal editors to discuss issues regarding scientific and peer review integrity 41

42 Summary - Article quality and peer review Our strategy: Publishing the best articles Attracting best authors, contracting best editors Reviewers make essential contribution to quality Peer review processed enhanced, funded, innovated Core values of peer review remain unchanged Contribution to publishing ethics 42

43 The Article of the Future WHAT IS OUR VISION? WHY WE INNOVATE WHAT WE DO SOME EARLY RESULTS

44 Beyond the traditional: Content Innovation What is content innovation? Content Innovation is an initiative in Journal Publishing that is about moving beyond today s one-dimensional (top-left to bottom-right) and mostly textual content. It uses modern technology to provide an optimal user experience to our scientists in communicating (as authors) and digesting (as readers) scientific results. For this it heavily focuses on new content types, formats, and scientific partnerships. Article of the Future one of the Content Innovation initiatives The Article of the Future initiative aims at a redefinition of the structure of the traditional article as we know it. It focuses on the easy digestion of scientific research, providing both task- and domain-dependent access points, like a graphical abstract and advanced figure browsing for quick digestion, and special tabs for quick access to those article elements that are most relevant to a certain domain. As such, it increases the uniqueness, usability, and added value of our content. Traditional article structure Article of the Future 44

45 The article of the future The stepwise creation of a less-linear article format, that reduces time for the researcher. This is an article that is optimally interlinked, and integrated with applications 1.Graphical, video and interactive enhancements 2.Linking to articles, structures, datasets. 3-dimensional viewing 3.Non-linear article structuring, customized by reader Central notion for our innovation is saving time and increasing knowledge transfer

46 3. The article of the future (a) 7 Am I linked to related scientists? 1 Where do I find the right article? 6 Which articles are cited or otherwise relevant? 5 Do I need software or tools? Article innovation 4 Where are supplemental data? 2 What is the outline of the article, what is the core message? 3 Can I see the original data sets?

47 3. The article of the future (b) Social media Cite Alert 7 Am I linked to related scientists? 1 Where do I find the right article? Semantic searching Linking to cited articles Contextual linking Embedded applications 6 Which articles are cited or otherwise relevant? 5 Do I need software or tools? Database linking Article innovation 4 Where are supplemental data? Research highlights 2 What is the outline of the article, what is the core message? 3 Can I see the original data sets? Supplemental data Video abstracts Graphical abstracts

48 Beyond the traditional: Content Innovation What is content innovation? Content Innovation is an initiative in Journal Publishing that is about moving beyond today s one-dimensional (top-left to bottom-right) and mostly textual content. It uses modern technology to provide an optimal user experience to our scientists in communicating (as authors) and digesting (as readers) scientific results. For this it heavily focuses on new content types, formats, and scientific partnerships. Article of the Future one of the Content Innovation initiatives The Article of the Future initiative aims at a redefinition of the structure of the traditional article as we know it. It focuses on the easy digestion of scientific research, providing both task- and domain-dependent access points, like a graphical abstract and advanced figure browsing for quick digestion, and special tabs for quick access to those article elements that are most relevant to a certain domain. As such, it increases the uniqueness, usability, and added value of our content. Traditio nal article structur e Article of the Future 48

49 Publishers are continuing to invest: 1. Enriching and enhancing articles Article Enhancement (e.g. Article of the Future) Visualisation Graphical abstracts with main message of the paper. Hierarchical presentation of text and figures. Alternate views to hide or show experiment details. Real-time reference analyses for citation exploration. Interactive to assist in navigating the article Peer reviewed video journals Searchable Image databases using semantic linking In-line video to enhance article content (techniques and demonstrations) Multiple platform support Social Networking Mobile Technology Online community sites facilitating discussion and sharing research findings, techniques and methods Linked in journal and book content into community Supports continuous learning, CME and virtual conferences Journal, book and database content on mobile devices Search and browse articles Create alerts and citation analysis Save favourite articles information and add notes Share result information via or Twitter News feeds and RSS technology 49

50 Publishers are continuing to invest: 2. Tools to derive insights across all articles Text Mining Tools Publishers are developing data and text mining tools with partners to extract semantic connections within journal and book content. Working with partner to link to datasets, e.g. EMBL, Pangaea Researchers want to save time searching and spend more time analyzing and experimenting Solutions help to discover ideas and new uses for technologies PANGAEA Research Performance Measurement Tools Products that helps decision makers in institutions and governments analyse research performance and emerging areas of science Identifies drivers of competitive research positions and strengths. Data derived from publication and citation analysis Matching of output by authors and institutions Intuitive application of article-level classification and bibliometrics, through partnership with industry researchers 50

51 MAPPING OUT THE RESEARCH LANDSCAPE HOW WE HELP INSTITUTES TO MAP THEIR COMPETENCES EXAMPLE BASED ON WATER SCIENCES

52 Governments are actively guiding their national research agendas Research Program Sponsor Description Assess the quality of research in universities and colleges in the UK Enable funding bodies to determine how to allocate grants across research projects Detail by institution and by discipline those areas that are internationally competitive Identify emerging areas where there are opportunities for development and further investment Identify thematic domains for future European support Part of EU s strategy to become the most dynamic competitive knowledge-based economy in the world 52

53 Elsevier s New Mission Supplier of publishing solutions New Mission Statement: Provide information and workflow solutions that help institutional decision-makers and researchers create significant value by building insights, enabling advancement in research, and improving research-driven returns-on-investment Partner in research productivity 53

54 Scopus at a Glance Comprehensive Global Coverage Scopus is the largest multidisciplinary abstract and citation database with peerreviewed research literature, quality web sources, patents and more. Scopus covers over 18,000 titles from more than 5,000 global publishers. Scopus coverage is global by design: Scopus content originates from outside North America representing various countries Europe, Latin America and the Asia Pacific region. 54

55 Article-level co-citation analysis as a foundation for better analysis of interdisciplinary fields SciVal Spotlight provides unique value in three areas: 1. Comprehensive, multi-disciplinary and global content, based on Scopus abstracts and citation data 2. High-quality matching of output by authors and institutions, based on Scopus author and affiliation profiles 3. Bottom-up aggregation of research activity using article-level classification, through partnership with industry thought leaders

56 Wheel of Science MIT s Research Strengths

57 MIT Distinctive Competency Top Authors

58 MIT Distinctive Competency Top Institutions

59 MIT Distinctive Competency Treemap

60 US National Map

61 Chinese National Map 61

62 Elsevier publishes some of the top journals in the fields of water research and 30% of the articles Fisheries Category Marine and Freshwater Biology Total # journals Elsevier # journals Market share (%) Influence 5year IF Relative IF Market growth in % (04-08) ELS Growth in % Oceanography Water Resources Total and averages Elsevier publishes the number one cited journal Water Research and other essential publication outlets like Journal of Hydrology, Advances in Water Resources, Agricultural and water management, etc. Jj

63 IK1 Steady article output growth ( ) Number of Articles 3,500 YEARLY ARTICLE OUTPUT - TITLE-ABS-KEY ("water resources") 3,000 2,500 2, % 1,500 1, Source: Scopus Year

64 幻灯片 63 IK1 Include Growth Rate Kisjes, Iris (ELS-AMS),

65 Water resources is a multi-disciplinary field (water resources ) Articles / Year Output per subject field Envir SC Earth and PL SC Eng. AGR and BIOL Soc. Sc. Chem. Eng. Energ y Computer Sci Medicin e Math s Mater SC Phys. and Astr. Bioch, Gen, Mol B Busines s Chemistr y Economic s Source: Scopus ,206

66 The field is becoming more and more multi-disciplinary (water resources ) Annual Growth Rate Percent Economics Maths Annual article growth rate Computer science Chemistry Bioch, Mol B Mater SC Energy Phys & Astr Social Science Business Medicine Chem Eng AGR & Biol Eng Earth & PL Sc Envir Sc -20 Article / Year ,000 Source: Scopus

67 The field is highly international USA and China leading in article output (water resources ) ,000 TH A D K R U E G P T B E M X C H S E I L G R K R IR N T W T R B R Z A E S I T N L J P I N F R C A D E A U U K C N U S Articles / Year Country output Country Source: Scopus

68 Denmark, Russia, Iran, Mexico, Portugal and Taiwan are growing at great rates (water resources ) Annual Growth Rate Percent DK IRN 50 RU MX PT BE GR IL SE EG THA CH TW BR ZA KR TR IT ES JP NL IN FR CA DE UK AU CN US ,000 Article / Year ( ) Source: Scopus Annual percentage growth per average annual article output

69 Overview of article growth, US and China (water resources Number 8) of publications US 1,944-16% China % Source: Scopus

70 Switzerland and Sweden show highest citation impact per paper (water resources ) 10 Cites / Article SE CH IL NL BE FR DK ZA ES PT GR IT THA TR JP MX IRN TW BR RU KR EG CA IN DE AU UK CN US ,000 Article / Year Source: Scopus Country citation impact per paper

71 Institutes with highest article output or cites per article (water resources ) Cites / Article 25 Tel Aviv Produced <25 papers where one received >150 citations, Natl more Ctr than Atm half R its total citations 20 Princeton Pacific NW Lab Source: Scopus Stanford Cape Town Berkeley Natl Lab Potsdam Wisconsin Paris 6 Harvard NASA Washington Oxford Calif-B NOAA Wageningen CSIRO USGS Colorado St Arizona Delft Calif-D Texas A&M Illinois US EPA Beijing Normal Wuhan CN I Water R Tsinghua Hohai USDA USDA Produced >250 papers with less than 2.6 cpp, due to local focus of papers Articles / Year CAS

72 CSIRO (Australian Commonwealth Scientific Research Organization) Source: Spotlig

73 Source: Spotlig Princeton

74 Source: Spotlight USDA

75 Introducing the Reed Elsevier Environmental Challenge Competition to encourage innovative ideas that advance access to safe and sustainable water supply $50,000 first place and $25,000 for second place Access to relevant Reed Elsevier products (1 July 31 October 2010) Winning projects will be featured in Water Research and other relevant Reed Elsevier publications and websites Submission deadline 1 November 2010 Winners announced June htm or EnvironmentalChallenge@reedelsevier.com 74

76 Summary Research in Water Resources is increasing 27% above average research growth, with China leading in research output. The field is increasingly multidisciplinary which makes it challenging to comprehend by simply looking at the research output in journal categories. Technological solutions help us understand the field, where it is moving and where we might want to offer incentives to drive it. 75