Reproducible Research in Computational Science
|
|
- Margaret Shepherd
- 5 years ago
- Views:
Transcription
1 Reproducible Research in Computational Science IPOL, a Research Journal for Image Processing Algorithms and Software Facultad de Ingeniería Universidad de la República Montevideo, UY, April 11th, 2013 Nicolas Limare CMLA, ENS Cachan, FR Image Processing On Line IPOL REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 1
2 A Researcher's Story Let's do research on... REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 2
3 A Researcher's Story Let's do research on... maté REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 3
4 Road to HPMDS (High-Perf Maté Dynamics Simulation) Review past research and state of the art theories and methods Create new measurement tools, models and simulation software Compare with existing works Present, publish Drink high-performance maté REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 4
5 Error 404 How do you compute?? Marcin Wichary REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 5
6 Ask the author? Code not available Code not usable secret, lost binary-only, not for your OS, obsolete Code not compilable won't debug 2000 obscure lines Code not meant to be read by others Not the exact version used for the article REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 6
7 Rewrite? Might take some time, days, weeks, months... You won't get much credit for this work Everything is not explained in the article No way to verify that the implementation is correct [...] software is the specification for how the software is supposed to work. Anything less [...] doesn t really tell you anything about how it s ultimately going to behave. And that just makes software really, really hard. Douglas Crockford REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 7
8 No Software Can not verify Can not reuse Can not reproduce Can not extend Can not compare Can not do science REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 8
9 Beyond Maté Simulations Sometimes more than a missing code: Misleading performance reports Manipulated figures 2000 retractions in biomedical, 43% for fraud Clinical trials based on wrong assumptions Climategate Public policies based on wrong expectations David Bailey, Twelve ways to fool the masses when giving performance results on parallel computers, Supercomputing Review (1991). Nicholas Wade, It May Look Authentic; Here's How to Tell It Isn't, The New York Times (2006). Ferric C. Fang, R. Grant Steen, and Arturo Casadevall, Misconduct accounts for the majority of retracted scientific publications, PNAS (2012). Kevin R. Coombes, Jing Wang, and Keith A. Baggerly, Irreproducibility of NCI60 Predictors of Chemotherapy, Bill Chameides, Climategate Redux, Scientific American (2010). REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 9
10 But... We can make better science. We are trying with IPOL. REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 10
11 Scientific Method REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 11
12 Scientific Method 1200 ~ 1800 Roger Bacon, Francis Bacon, Galileo Galilei, Robert Boyle, René Descartes, Science needs to be reproduced. REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 12
13 Reproducible Research? Research is reproducible if other researchers can independently obtain the same results from the published material. Theoretical scientists share demonstrations Experimental scientists share procedures Computational scientists (usually) share no software, no full description, no data Ø cf. Claerbout 1992, Donoho 1995, Stonned 201X, Vandewalle 201X REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 13
14 Reproducible (Computational) Research 1990 ~ Jon Claerbout, David Donoho Serguei Fomel, Randy Leveque, David Bailey, Victoria Stodden, Juliana Freire, The science is in the software, data and process. An article about computational science in a scientific publication is not the scholarship itself, it is merely advertising of the scholarship. The actual scholarship is the complete software development environment and the complete set of instructions which generated the figures. D. Donoho REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 14
15 Computation Everywhere particle physics fluid dynamics econometrics signal processing quantum chemistry LIDAR archeology MRI analysis climate & weather geophysics CERN, rafael grompone, mario stefanutti, REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 15
16 ScienceCodeManifesto.org Code: All source code written specifically to process data for a published paper must be available to the reviewers and readers of the paper. Copyright: The copyright ownership and license of any released source code must be clearly stated. Citation: Researchers who use or adapt science source code in their research must credit the code s creators in resulting publications. Credit: Software contributions must be included in systems of scientific assessment, credit, and recognition. Curation: Source code must remain available, linked to related materials, for the useful lifetime of the publication. REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 16
17 Why not Share the Code? Code not ready for public view no time/motivation to cleanup, simplify and document Prevent Incorrect Use documentation and explanations again Keep competitive advantage better not publish at all? REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 17
18 Revisit Objectives of Publishing Articles KEY: lure researchers into sharing their code vs Impact Factor rare picture of an utopian community in the act of sharing their research code freeclipartnow.com REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 18
19 Revisit Objectives of Publishing Articles Researcher Cite Publish Code Publish Article Community Cite Researcher Community traditional research articles source code Step 1 make the code a publication by itself REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 19
20 Revisit Objectives of Publishing Articles Researcher Cite Publish Code Publish Article Community Cite Researcher Community traditional research articles source code Step 2 guide the community to use and cite the code REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 20
21 IPOL REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 21
22 IPOL IPOL is a research journal of image processing and image analysis. Each article contains a text describing an algorithm and source code, with an online demonstration facility and an archive of online experiments. The text and source code are peer-reviewed and the demonstration is controlled. IPOL follows the Open Access and Reproducible Research models. article = manuscript + software REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 22
23 IPOL IPOL is a research journal of image processing and image analysis. Each article contains a text describing an algorithm and source code, with an online demonstration facility and an archive of online experiments. The text and source code are peer-reviewed and the demonstration is controlled. IPOL follows the Open Access and Reproducible Research models. article = manuscript + software (+ demo + archive) REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 23
24 REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 24
25 Publishing Software IPOL wants to provide reference implementations of image processing algorithms. For every article, the implementation is reviewed and published under GPL/BSD license can be tested online in real time on free data Everything is online, free, reusable. REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 25
26 Reviewing Software Software is reviewed like a manuscript: manually, by selected reviewers must match the description of the algorithm follows editorial guidelines for correctness, portability, documentation, style This is already a lot asked to image processing researchers. REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 26
27 IPOL Not a prototype, publishing since 2010 Research journal, self-published ISSN, DOI, editorial policy and int'l board, indexed Partnership with SIAM journal for dual articles + IPOL publishes algorithms, not software; code is here to provide all details to study the algorithm IPOL exists because we need it and no other journal did it REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 27
28 Reproducible Research Initiatives Journals Science requires that all data and code is available to any reader Math Programming Computation requires the code Biostatistics stamps reproducible articles JMLR publishes software Geophysics has some software guidelines Source Code for Biology and Medicine publishes software, Journal of Open Research Software will too Computing in Science and Engineering reviews software MetaJournals publish articles about software and data REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 28
29 More Reproducible Research Initiatives Publishers SIAM updated its supp. material policies to include software ACM reformed its supp. material copyright policy Elsevier experiments with executable papers and post-pdf Tools and Services RunMyCode hosts executable research software FLOSShub, mloss/mldata host software DataDryad, Figshare host data Conferences and Workshops ICERM Workshop Dec SINTEF Winter School Jan SIAM CiSE13 Conference track Feb NYU Workshops May 2013 REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 29
30 IPOL Article: Manuscript+Software Manuscript: description and study of an algorithm Software: complete and documented implementation REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 30
31 IPOL Article: +Demo Manuscript: description and study of an algorithm Software: complete and documented implementation Demo: universal www interface, test and explore REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 31
32 IPOL Article: +Archive Manuscript: description and study of an algorithm Software: complete and documented implementation Demo: universal www interface, test and explore Archive: shared test data REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 32
33 Activity 40 articles published with code and demo since articles under review, 10+ public preprints 100+ citations (cf. Google Scholar) visits code/data downloads demo runs, on original data (archived) REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 33
34 Results Reference implementations of algorithms Verifiable claims on performances and results Algorithms described and analyzed Algorithms improved by mass-testing Implementations improved by review More than reproducible. Reusable and open. REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 34
35 Challenges Still the work of a small community join and spread the word spin-off to other research areas (next: audio) Competition from less stringent journals and conferences they can evolve by peer-review pressure Reusable is more complex than reproducible software project derived from IPOL Conservative community habits must learn to cite software, article PDF Substantial effort to prepare good code computation at center of computational sciences cursus templates? other ideas? REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 35
36 Collaboration Work funded by and in collaboration with New participants are welcome! REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 36
37 Follow-up to @IPOL_journal and also interested in more authors, editors, reviewers, readers and users productive relations with new researchers assistance and collaboration to new similar projects REPRODUCIBLE RESEARCH IN COMPUTATIONAL SCIENCE 37
The Reproducible Research Movement in Statistics
The Reproducible Research Movement in Statistics Victoria Stodden Department of Statistics Columbia University 59th ISI World Statistics Congress Sharing Data, Code and Publications - Making Research Reproducible
More informationComputational Reproducibility in Medical Research:
Computational Reproducibility in Medical Research: Toward Open Code and Data Victoria Stodden School of Information Sciences University of Illinois at Urbana-Champaign R / Medicine Yale University September
More informationEnabling FAIR Data in the Earth, Space, and Environmental Sciences
Enabling FAIR Data in the Earth, Space, and Environmental Sciences Data Matters: Ethics, Data, and International Research Collaboration in a Changing World March 15, 2018 Shelley Stall AGU Director, Data
More informationDisseminating Numerically Reproducible Research
Disseminating Numerically Reproducible Research Victoria Stodden Department of Statistics Columbia University Centre mathématiques et leurs applications École normale supérieure de Cachan Paris, France
More informationOpen Methodology and Reproducibility in Computational Science
Open Methodology and Reproducibility in Computational Science Victoria Stodden Department of Statistics Columbia University Numerical Cosmology 2012 Centre of Theoretical Cosmology DAMTP, University of
More informationScientific Transparency, Integrity, and Reproducibility
Scientific Transparency, Integrity, and Reproducibility Victoria Stodden School of Information Sciences University of Illinois at Urbana-Champaign Data for the Public Good: Responsibilities, Opportunities
More informationReproducibility Interest Group
Reproducibility Interest Group co-chairs: Bernard Schutz; Victoria Stodden Research Data Alliance Denver, CO September 16, 2016 Agenda Introductory comments Presentations: Andi Rauber, others? Conclusions
More informationWriting for Publication [Video]
Writing for Publication [Video] The University Writing Center has published a video of the recent Graduate Writing Series by Bruce Thompson, Distinguished Professor of Educational Psychology and of Library
More informationElements of Scholarly Discourse in a Digital World
Elements of Scholarly Discourse in a Digital World Victoria Stodden Graduate School of Library and Information Science University of Illinois at Urbana-Champaign Center for Informatics Research in Science
More informationPLOS. From Open Access to Open Science : a publisher s perspective. Véronique Kiermer Executive Editor, PLOS Public Library of Science.
PLOS From Open Access to Open Science : a publisher s perspective Véronique Kiermer Executive Editor, PLOS Public Library of Science Brussels November 2017 @verokiermer Disclaimers Employed by PLOS Previously
More informationLaw & Ethics of Big Data Research Dissemination
Law & Ethics of Big Data Research Dissemination Victoria Stodden School of Information Sciences University of Illinois at Urbana-Champaign Using Big Data: The Ethics, Dilemmas, and Possibilities for Educational
More informationApplying the Creative Commons Philosophy to Scientific Innovation
Applying the Creative Commons Philosophy to Scientific Innovation Victoria Stodden Information Society Project @ Yale Law School Acesso Livre à Informação Científica Reitoria UNL - Campolide,
More informationThe Importance of Scientific Reproducibility in Evidence-based Rulemaking
The Importance of Scientific Reproducibility in Evidence-based Rulemaking Victoria Stodden School of Information Sciences University of Illinois at Urbana-Champaign Social and Decision Analytics Laboratory
More informationJournal Policy and Reproducible Computational Research
Journal Policy and Reproducible Computational Research Victoria Stodden (with Peixuan Guo and Zhaokun Ma) Department of Statistics Columbia University International Association for the Study of the Commons
More informationScientific Reproducibility and Software
Scientific Reproducibility and Software Victoria Stodden Information Society Project @ Yale Law School Institute for Computational Engineering and Sciences The University of Texas at
More informationConservation Biology as an Example of the Dilemmas Facing Scholarly Society Publishing
Conservation Biology as an Example of the Dilemmas Facing Scholarly Society Publishing David W. Lewis December 2018 2018 David W. Lewis. This work is licensed under a Creative Commons Attribution- NonCommercial
More informationPLOS. Open Science at PLOS. Open Access Week, October Nicola Stead, Senior Editor, PLOS ONE
PLOS Open Science at PLOS Open Access Week, October 2017 Nicola Stead, Senior Editor, PLOS ONE Who We Are: Public Library of Science PLOS is a nonprofit publisher and advocacy organization with a mission
More informationEnhancing Reproducibility for Computational Methods
Enhancing Reproducibility for Computational Methods Victoria Stodden School of Information Sciences University of Illinois at Urbana-Champaign Toward an Open Science Enterprise National Academies of Science,
More informationWhen Should We Trust the Results of Data Science?
When Should We Trust the Results of Data Science? Victoria Stodden Department of Statistics Columbia University! Data, Society, and Inference Seminar UC Berkeley, CA April 14, 2014 Agenda 1. Creating Reliable
More informationEach copy of any part of a JSTOR transmission must contain the same copyright notice that appears on the screen or printed page of such transmission.
Editor's Note Author(s): Ragnar Frisch Source: Econometrica, Vol. 1, No. 1 (Jan., 1933), pp. 1-4 Published by: The Econometric Society Stable URL: http://www.jstor.org/stable/1912224 Accessed: 29/03/2010
More informationThe Impact of Computational Science on the Scientific Method
The Impact of Computational Science on the Scientific Method Victoria Stodden MIT Sloan School, Innovation and Entrepreneurship Group vcs@stanford.edu Scientific Software Days The University of Texas at
More informationReproducible Research for Scientific Computing: Tools and Strategies for Changing the Culture
R e p r o d u c i b l e R e s e a r c h f o r S c i e n t i f i c C o m p u t i n g Reproducible Research for Scientific Computing: Tools and Strategies for Changing the Culture This article considers
More informationProgress in computational science
N e w s Reproducible Research Addressing the Need for Data and Code Sharing in Computational Science By the Yale Law School Roundtable on Data and Code Sharing Roundtable participants identified ways of
More informationReproducibility in Computational Science: Opportunities and Challenges
Reproducibility in Computational Science: Opportunities and Challenges Victoria Stodden Department of Statistics Columbia University! CSIRO Computational and Simulation Sciences & eresearch Annual Conference
More informationNew forms of scholarly communication Lunch e-research methods and case studies
Agenda New forms of scholarly communication Lunch e-research methods and case studies Collaboration and virtual organisations Data-driven research (from capture to publication) Computational methods and
More informationOpen Data, Open Science, Open Access
Open Data, Open Science, Open Access Presentation by Sara Di Giorgio, Crete, May 2017 1 The use of Open Data and Open Access is an integral element of Open Science. Like an astronaut on Mars, we re all
More informationHow Science is Different: Digitizing for Discovery
How Science is Different: Digitizing for Discovery Victoria Stodden Department of Statistics Columbia University! Information, Interaction, and Influence Digital Science Workshop on Research Information
More informationThe modern global researcher:
The modern global researcher: How can libraries support today s technological community? CONCERT Taipei, November 12, 2018 Rachel Berrington, MLIS Director, IEEE Client Services If we understand how research
More informationTutorial: Open Data. Open Source EHR Summit & Workshop October 17-18, 2012 National Harbor, MD
Open Source EHR Summit & Workshop October 17-18, 2012 National Harbor, MD Tutorial: Open Data Fred Prior, Ph.D. Dir. Electronic Radiology Laboratory Dir. Center for High Performance Computing Co-Dir. Center
More informationScience Speaks. Nicholas McCarty University of Iowa. Latham Science Communication Project Copyright 2016 Nicholas McCarty
Latham Science Communication Project 4-1-2016 Science Speaks Nicholas McCarty University of Iowa Copyright 2016 Nicholas McCarty Hosted by Iowa Research Online. For more information please contact: lib-ir@uiowa.edu.
More informationResearch Data and Integrity
Research Data and Integrity IT S A MATTER OF PUBLIC TRUST Gretchen Brodnicki, JD Dean for Faculty and Research Integrity Harvard Medical School June 14, 2018 Faculty Disclosure Pfizer (through my husband)*
More informationDocument Downloaded: Wednesday September 16, June 2013 COGR Meeting Afternoon Presentation - Victoria Stodden. Author: Victoria Stodden
Document Downloaded: Wednesday September 16, 2015 June 2013 COGR Meeting Afternoon Presentation - Victoria Stodden Author: Victoria Stodden Published Date: 06/10/2013 On Public Access Policy: Data, Code,
More informationAcademies outline principles of good science publishing
Journal of Radiological Protection NEWS AND INFORMATION Academies outline principles of good science publishing Recent citations - World Association of Medical Editors (WAME) statement on Predatory Journals
More informationOpen Licensing and Science Policy
Open Licensing and Science Policy Victoria Stodden Department of Statistics Columbia University! Guest Lecture Columbia University April 16, 2014 Agenda 1. Creating Reliable Computational Science: Updating
More informationAdvancing Data Science through a Lifecycle Approach
Advancing Data Science through a Lifecycle Approach Victoria Stodden School of Information Sciences University of Illinois at Urbana-Champaign ECE Seminar Rice University September 4, 2018 Agenda 1. Framing
More informationTwo Ideas for Open Science (forget Open Data!)
Two Ideas for Open Science (forget Open Data!) Victoria Stodden Postdoctoral Associate in Law and Kauffman Fellow in Law and Innovation Yale Law School Open Science Summit UC Berkeley, California July
More informationScienceDirect: Empowering researchers at every step. Presenter: Lionel New Account Manager, Elsevier Research Solutions
ScienceDirect: Empowering researchers at every step Presenter: Lionel New Account Manager, Elsevier Research Solutions l.new@elsevier.com Elsevier is a leading Science & Health Information Provider CONTENT
More informationGlobal Trends in Physics Publishing Background and Developments
Global Trends in Physics Publishing Background and Developments Presented by: Steve Watson, Executive Publisher Surfaces and Interfaces Date: 15 September 2009 Presentation created by James Milne 2007
More informationTools for Academic Research: Resolving the Credibility Crisis in Computational Science
Tools for Academic Research: Resolving the Credibility Crisis in Computational Science Victoria Stodden Department of Statistics Columbia University Computer Science and Engineering Colloquia University
More informationThe Scholarly Work of Reliable and Well-Designed Mathematical Software
1 The Scholarly Work of Reliable and Well-Designed Mathematical Software A personal perspective Tim Davis July 9, 2014 2 The Scholarly Work of Reliable and Well-Designed Mathematical Software Outline:
More informationSEMINAR: Preparing research data for open access
Facilitate Open Science Training for European Research SEMINAR: Preparing research data for open access December 10th 2014, Social Science Data Archives, Faculty of Social Sciences, University of Ljubljana
More informationHSS Scholars & Scientists Workgroup Report
, issn: 2473-6236 doi: http://dx.doi.org/10.13021/g8osi.1.2017.1920 HSS Scholars & Scientists Workgroup Report Shira Eller, William Gunn, Diane Scott Lichter, Joan Lippincott, Aimee Nixon, Concetta Seminara,
More informationKeynote Address: "Local or Global? Making Sense of the Data Sharing Imperative"
University of Massachusetts Medical School escholarship@umms University of Massachusetts and New England Area Librarian e-science Symposium 2012 e-science Symposium Apr 4th, 9:30 AM - 10:30 AM Keynote
More informationPublishing in academic journals. Tips to help you succeed
Publishing in academic journals Tips to help you succeed Today Today s publishing environment 1. Choosing the Right Journal 2. Writing for a journal 3. The Peer Review Process Group discussion: How to
More informationSTM Response to Science Foundation Ireland (SFI) Policy Relating to the Open Access Repository of Published Research
Science Foundation Ireland openaccess@sfi.ie 2 nd Floor, Prama House 267 Banbury Road OXFORD, OX2 7HT, UK 11 June 2008 Dear Sir/Madam STM Response to Science Foundation Ireland (SFI) Policy Relating to
More informationSteps toward reproducible research
Steps toward reproducible research Karl Broman Biostatistics & Medical Informatics Univ. Wisconsin Madison kbroman.org github.com/kbroman @kwbroman Slides: bit.ly/jsm2016 These are slides for a talk I
More informationSteps toward reproducible research
Steps toward reproducible research Karl Broman Biostatistics & Medical Informatics Univ. Wisconsin Madison kbroman.org github.com/kbroman @kwbroman Slides: bit.ly/jax2017-05 These are slides for a talk
More informationReproducibility in Computational Science: A Computable Scholarly Record
Reproducibility in Computational Science: A Computable Scholarly Record Victoria Stodden School of Information Sciences University of Illinois at Urbana-Champaign Center for Research Computing Seminar
More informationWhy hasn t the journal changed more as a result of the internet?
Why hasn t the journal changed more as a result of the internet? Michael A Mabe CEO, STM & Visiting Professor, Information Science, University College, London Head in the sand Complacent Luddite Not alone
More informationGlobal Trends in Neuroscience Publishing Background and Developments
Global Trends in Neuroscience Publishing Background and Developments Presented by: Paul Carton PhD, Senior Publisher Elsevier S&T Journals Date: July 2008 Presentation created by James Milne 2007 / 2008
More informationA Journal for Human and Machine
EDITORIAL James Hendler 1, Ying Ding 2 & Barend Mons 3 1 Rensselaer Institute for Data Exploration and Applications, Rensselaer Polytechnic Institute, Troy, NY12180, USA 2 School of Informatics, Computing,
More informationComputer Science at James Madison University
Computer Science at James Madison University Dr. Sharon Simmons, Department Head Dr. Chris Mayfield, Assistant Professor CHOICES 2016 1 What is Computer Science? 2 What is Computer Science? CS is posing
More informationWhat Is That Patent Really Worth? Courts Take a Hard Look at the "Reasonable Royalty" Calculation Jonathan D. Putnam Competition Dynamics
What Is That Patent Really Worth? Courts Take a Hard Look at the "Reasonable Royalty" Calculation Jonathan D. Putnam Competition Dynamics Silicon Valley Advanced Patent Law Institute December 6-7, 2012
More information14 th Berlin Open Access Conference Publisher Colloquy session
14 th Berlin Open Access Conference Publisher Colloquy session Berlin, Max Planck Society s Harnack House December 04, 2018 Guido F. Herrmann Vice President and Managing Director Wiley s perspective and
More informationThe 2018 Publishing Landscape: Technological Horizons. Lyndsey Dixon Editorial Director, APAC Journals Taylor & Francis Group
The 2018 Publishing Landscape: Technological Horizons Lyndsey Dixon Editorial Director, APAC Journals Taylor & Francis Group Today Waves of innovation Publishing advancements through innovation Artificial
More informationA new Journal in the field of Innovation Management Editorial Kick-off CERN 31 st May 2016
A new Journal in the field of Innovation Management Editorial Kick-off meeting @ CERN 31 st May 2016 Agenda for the day 0830-0900 Breakfast-coffee 0900-1030 Official launch of the CIJ Welcome to IdeaSquare/CERN
More informationEthical, Epistemological, Methodological, Social and Other
Ethical, Epistemological, Methodological, Social and Other Issues in Web/Social Media Mining Marko M. Skoric Department of Communication PhD Student Workshop Web Mining for Communication Research April
More informationThe Five R s for Developing Trusted Software Frameworks to increase confidence in, and maximise reuse of, Open Source Software
The Five R s for Developing Trusted Software Frameworks to increase confidence in, and maximise reuse of, Open Source Software Ryan Fraser 1, Lutz Gross 2, Lesley Wyborn 3, Ben Evans 3 and Jens Klump 1
More informationPublishing in academic journals. Tips to help you succeed
Publishing in academic journals Tips to help you succeed Taylor & Francis Publisher of scholarly journals since 1798 Work in partnership with societies and universities Publish across Science, Social Sciences,
More informationOn the Monty Hall Dilemma and Some Related Variations
Communications in Mathematics and Applications Vol. 7, No. 2, pp. 151 157, 2016 ISSN 0975-8607 (online); 0976-5905 (print) Published by RGN Publications http://www.rgnpublications.com On the Monty Hall
More informationHow to get published. C. H. Juang, PhD, PE Glenn Professor of Civil Engineering Clemson University Co-EIC, Engineering Geology
How to get published C. H. Juang, PhD, PE Glenn Professor of Civil Engineering Clemson University Co-EIC, Engineering Geology 1 http://www.elsevier.com/journalauthors/publishing-process 2 How To Get Published
More informationStructural Biology EURO STRUCTURAL BIOLOGY Theme: Exploring the Future Advancements in Structural and Molecular Biology. 15 th World Congress on
15 th World Congress on Structural Biology November 19-20, 2018 Paris, France Theme: Exploring the Future Advancements in Structural and Molecular Biology Invitation Dear Attendees, We are glad to announce
More informationResource Review. In press 2018, the Journal of the Medical Library Association
1 Resource Review. In press 2018, the Journal of the Medical Library Association Cabell's Scholarly Analytics, Cabell Publishing, Inc., Beaumont, Texas, http://cabells.com/, institutional licensing only,
More informationFinal Program for HiPerNav Workshop on Image Quality Assessment Paris la Défense, 6-7 December 2018
Final Program for HiPerNav Workshop on Image Quality Assessment Paris la Défense, 6-7 December 2018 Time 6th December 2018 7th December 2018 09 :00 09 :30 Welcome, Breakfast & Announcement of ESRs Working
More informationHow to write a paper and get it published in a refereed journal
How to write a paper and get it published in a refereed journal C. H. Juang, PhD, PE, F.ASCE Glenn Professor, Clemson University Editor in Chief, Engineering Geology 1 Acknowledgments Part of the material
More informationWomen into Engineering: An interview with Simone Weber
MECHANICAL ENGINEERING EDITORIAL Women into Engineering: An interview with Simone Weber Simone Weber 1,2 * *Corresponding author: Simone Weber, Technology Integration Manager Airbus Helicopters UK E-mail:
More informationDecember 10, Why HPC? Daniel Lucio.
December 10, 2015 Why HPC? Daniel Lucio dlucio@utk.edu A revolution in astronomy Galileo Galilei - 1609 2 What is HPC? "High-Performance Computing," or HPC, is the application of "supercomputers" to computational
More informationTestimony of Dr. Victoria Stodden Columbia University. Before the House Committee on Science, Space and Technology Subcommittee on Research
Testimony of Dr. Victoria Stodden Columbia University Before the House Committee on Science, Space and Technology Subcommittee on Research Hearing On Scientific Integrity & Transparency March 5, 2013 Thank
More informationDIGITAL SCHOLARSHIP INNOVATION AND DIGITAL LIBRARIES: A SURVEY IN ITALY. Anna Maria Tammaro IRCDL, Firenze 4-5 febbraio 2016
DIGITAL SCHOLARSHIP INNOVATION AND DIGITAL LIBRARIES: A SURVEY IN ITALY Anna Maria Tammaro IRCDL, Firenze 4-5 febbraio 2016 Digital scholarship outline As scholars use new digital tools and resources to
More informationLibraries on the Cutting Edge: The Evolution of The Journal of escience Librarianship
University of Massachusetts Medical School escholarship@umms Library Publications and Presentations Lamar Soutter Library 3-20-2017 Libraries on the Cutting Edge: The Evolution of The Journal of escience
More informationA CyberInfrastructure Wish List for Statistical and Data Driven Discovery
A CyberInfrastructure Wish List for Statistical and Data Driven Discovery Victoria Stodden School of Information Sciences University of Illinois at Urbana-Champaign Workshop on Learning Tools to Promote
More informationIntroduction. amy e. earhart and andrew jewell
Introduction amy e. earhart and andrew jewell Observing the title and concerns of this collection, many may wonder why we have chosen to focus on the American literature scholar; certainly the concerns
More informationELSEVIER SOLUTIONS TO SUPPORT RESEARCH ACTIVITIES IN REPUBLIC OF KAZAKHSTAN
ELSEVIER SOLUTIONS TO SUPPORT RESEARCH ACTIVITIES IN REPUBLIC OF KAZAKHSTAN AYHAN AKANAY SARACOGLU Account Manager Turkey and Central Asia E-mail : a.saracoglu@elsevier.com AGENDA REPUBLIC OF KAZAKHSTAN
More informationUniversity of Southern California Guidelines for Assigning Authorship and for Attributing Contributions to Research Products and Creative Works
University of Southern California Guidelines for Assigning Authorship and for Attributing Contributions to Research Products and Creative Works Drafted by the Joint Provost-Academic Senate University Research
More informationMINI GUIDE YOU RE NEW TO BUSINESS, AND YOU NEED SOME QUICK, EASY, FUNCTIONAL BRANDING, AND A WEBSITE. HERE S MY TOP TIPS!
MINI GUIDE YOU RE NEW TO BUSINESS, AND YOU NEED SOME QUICK, EASY, FUNCTIONAL BRANDING, AND A WEBSITE. HERE S MY TOP TIPS! INTRO Whenever I get Design Inquiries from people about creating a Brand + Website
More informationWhat (Exactly) Are Patents Worth at Trial? The Smartphone War Example Jonathan D. Putnam Charles River Associates
What (Exactly) Are Patents Worth at Trial? The Smartphone War Example Jonathan D. Putnam Charles River Associates Patent Infringement Damages Making the Most of the End Game! AIPLA Spring Meetings, May
More informationOpen Science policy and infrastructure support in the European Commission. Joint COAR-SPARC Conference. Porto, 15 April 2015
Open Science policy and infrastructure support in the European Commission Joint COAR-SPARC Conference Porto, 15 April 2015 Jarkko Siren European Commission DG CONNECT einfrastructure Author s views do
More informationINTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING IMPACT FACTOR
INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING IMPACT FACTOR page 1 / 5 page 2 / 5 international journal for numerical pdf International Journal of Mechanical Engineering and Applications
More informationJAMES becomes an AGU Journal
JAMES becomes an AGU Journal &'()*!&+) New AGU Journal on Earth Systems Modeling The American Geophysical Union is pleased to announce that effective immediately, it is the new publisher of the Journal
More informationA blog is a type of website or part of a website. Blogs are usually maintained by an individual with regular entries of commentary, descriptions of
Blog It! A blog is a type of website or part of a website. Blogs are usually maintained by an individual with regular entries of commentary, descriptions of events, or other materials such as graphics
More informationHow CRISs are key to the future of research libraries INCONECSS April 2016 Berlin
How CRISs are key to the future of research libraries INCONECSS 19-20 April 2016 Berlin, Assistant Director (Digital Research) University Library, University of St Andrews @annakclements Executive Board
More informationDaniel R. Cahoy Smeal College of Business Penn State University VALGEN Workshop January 20-21, 2011
Effective Patent : Making Sense of the Information Overload Daniel R. Cahoy Smeal College of Business Penn State University VALGEN Workshop January 20-21, 2011 Patent vs. Statistical Analysis Statistical
More informationThe AIAA and its Use of Genre
The AIAA and its Use of Genre ALEC O CONNOR Produced in Kathleen Bell s Fall 2012 ENC1101 The generation in which we live happens to be unlike any generation before us; the turn of the century has brought
More informationROBERT HOOKE'S CONTRIBUTION S TO MECHANICS
ROBERT HOOKE'S CONTRIBUTION S TO MECHANICS ROBERT HOOKE'S CONTRIBUTIONS TO MECHANICS A STUDY IN SEVENTEENTH CENTUR Y NATURAL PHILOSOPHY by F. F. CENTORE, PH. D. U. Springer-Science+Business Media, B.V.
More informationThe Early-Career Researcher
The Early-Career Researcher Challenges ahead for the researcher, the publisher, and the literature Presented by: Donald Samulack, PhD President, U.S. Operations Editage / Cactus Communications Dr. Eddy
More information1) Evaluating Internet Resources
(1) Evaluating Internet Resources: Most of what is posted on the Internet has never been subjected to the rigors of peer review common with many traditional publications. Students must learn to evaluate
More informationFINDING & CITING IMAGES IN PAPERS & PRESENTATIONS
FINDING & CITING IMAGES IN PAPERS & PRESENTATIONS If you wish to use images that you did not create yourself in a paper or presentation, you must be sure you have the right to reuse the image. There are
More informationIntroducing Elsevier Research Intelligence
1 1 1 Introducing Elsevier Research Intelligence Stefan Blanché Regional Manager Elsevier September 29 th, 2014 2 2 2 Optimizing Research Partnerships for a Sustainable Future Elsevier overview Research
More informationCRAFTING A RESEARCH PROPOSAL
CRAFTING A RESEARCH PROPOSAL Research proposals follow a set format. Proposal writing is its own genre, and just like you wouldn t write a short story and wait to introduce the main character until the
More informationSoftware Patents as a Barrier to Scientific Transparency: An Unexpected Consequence of Bayh-Dole
Software Patents as a Barrier to Scientific Transparency: An Unexpected Consequence of Bayh-Dole Victoria Stodden & Isabel Reich Department of Statistics Columbia University Works in Progress Intellectual
More informationArtificial Intelligence and Robotics Getting More Human
Weekly Barometer 25 janvier 2012 Artificial Intelligence and Robotics Getting More Human July 2017 ATONRÂ PARTNERS SA 12, Rue Pierre Fatio 1204 GENEVA SWITZERLAND - Tel: + 41 22 310 15 01 http://www.atonra.ch
More informationGraduate Studies in Computational Science at U-M. Graduate Certificate in Computational Discovery and Engineering. and
Graduate Studies in Computational Science at U-M Graduate Certificate in Computational Discovery and Engineering and PhD Program in Computational Science Eric Michielssen and Ken Powell 1 Computational
More informationInterface Design V: Beyond the Desktop
Interface Design V: Beyond the Desktop Rob Procter Further Reading Dix et al., chapter 4, p. 153-161 and chapter 15. Norman, The Invisible Computer, MIT Press, 1998, chapters 4 and 15. 11/25/01 CS4: HCI
More informationResearchers and new tools But what about the librarian? mendeley.com
Researchers and new tools But what about the librarian? mendeley.com Recap: What is Mendeley? End-user targeted product Productivity (storing, organizing, reading, annotating, etc.) Collaboration (sharing,
More informationJOURNAL PUBLISHING IN ASTRONOMY
Future Professional Communication in Astronomy (Eds. A. Heck & L. Houziaux, Mém. Acad. Royale Belgique, 2007) JOURNAL PUBLISHING IN ASTRONOMY DAVID CLARK Elsevier BV Radarweg 29 NL-1043 NX Amsterdam, Netherlands
More informationThis list supersedes the one published in the November 2002 issue of CR.
PERIODICALS RECEIVED This is the current list of periodicals received for review in Reviews. International standard serial numbers (ISSNs) are provided to facilitate obtaining copies of articles or subscriptions.
More informationENABLING REPRODUCIBLE RESEARCH: OPEN LICENSING FOR SCIENTIFIC INNOVATION
ENABLING REPRODUCIBLE RESEARCH: OPEN LICENSING FOR SCIENTIFIC INNOVATION Victoria Stodden * ABSTRACT There is a gap in the current licensing and copyright structure for the growing number of scientists
More informationEnabling Reproducibility in Computational and Data-enabled Science
Enabling Reproducibility in Computational and Data-enabled Science Victoria Stodden School of Information Sciences University of Illinois at Urbana-Champaign EPFl Seminar October 25, 2018 Agenda 1. Framing
More informationReproducibility in Computationally-Enabled Research: Integrating Tools and Skills
Reproducibility in Computationally-Enabled Research: Integrating Tools and Skills Victoria Stodden School of Information Sciences University of Illinois at Urbana-Champaign METRICS Seminar Stanford University
More informationNew Jersey Core Curriculum Content Standards for Science
A Correlation of to the New Jersey Core Curriculum Content Grades K -6 O/S-56 Introduction This document demonstrates how Scott Foresman Science meets the New Jersey Core Curriculum Content. Page references
More information