World Digital Library OSI WEB SERVICES.

Transcription

1 World Digital Library OSI WEB

2 World Digital Library OSI WEB Train the Trainer Hands-on Workshop for Arab Peninsula Regional Group Doha, Qatar June 11-12, 2013

3 Agenda (Day One) Introduction WDL Standards New Introductions and Changes Participants Introduction Content Identification and Selection The Do s and Don ts File Management and Transfer of Files to WDL Metadata Creation for various formats Expert Descriptions Preparing Expert Descriptions for Arab Heritage Resources WDL Perspective

4 Agenda (Day Two) Digitization, Processing and Quality Control Theoretical Session Digitization, Processing and Quality Control Hands-on Training (at Barzan Villa Lab) Preparation of Metadata Records, Descriptions, Files, and Transfer (Interactive Q&A Session) Concluding Session: Feedback Survey Summarization and Closing Address Distribution of Certificates and Photographs

5 WDL Trainers: Kaleena Black, WDL Description Coordinator Sandy Bostian, WDL Content Manager Chris Masciangelo, WDL Digital Conversion Specialist Jason Yasner, WDL Operations Manager

6 WDL Standards New Introductions and Changes Jason Yasner WDL Operations Manager

7 World Digital Library World Digital Library: Mission and Objectives Mission: Digitize and make freely available over the Internet, in multilingual format, primary source materials that tell the stories and highlight the achievements of all countries Objectives: Promote international and intercultural understanding and awareness Expand multilingual and culturally diverse content on the Internet Provide resources to educators and contribute to scholarly research Build knowledge and capacity in the developing world; help narrow the digital divide

8 World Digital Library Key Features of the WDL Website Multilingualism Interface in seven (7) languages Content in more than seventy-five (75) languages High quality content of cultural and historical importance Consistent, high-quality metadata to allow searching and browsing across cultures and time periods Item-level descriptions, curator videos to enhance user understanding of the content Speed and performance Web 2.0 features

9 World Digital Library Partners and User Statistics (As of May 7, 2013) 171 partners from 79 countries launched on April 21, 2009 Usage since launch: More than 21.9 million visitors Top countries by number of visitors: Spain, Mexico, United States, Brazil, Argentina, China, France, Colombia, Portugal, Russian Federation Links from other sites to WDL: 5.5 million Visitors from the Arab World: 691,777 (454,390 last time)

10 World Digital Library project.wdl.org

11 Content Identification and Selection The Do s and Don ts Jason Yasner WDL Operations Manager

12 Overview of WDL Production Process Content Selection Content Transfer Content Processing Cataloging Consistent Metadata Descriptions Translation Publishing

13 World Digital Library WDL Themes Top Treasures that Represent National Culture Arabic Scientific Manuscripts Chinese Language Content Meso-American Codices Holy Texts (Qu rans, Bibles, Torahs, etc.) project.wdl.org/content/contentguidelines.html

14 File Management and Transfer of Files to WDL Sandy Bostian WDL Content Manager

15 WDL Standards: Why? Your images are what people see. Deep Zoom shows flaws. Put your best foot forward. Your metadata runs the display.

16 WDL Standards: What is a digital object? Digital Content Partner Metadata Relationships Behavior WDL

17 WDL Standards: One vs. Many Books, Manuscripts Single Volume 1 object Multi-Volume 1 object Newspapers Each Issue 1 object Journal Each Issue 1 object Photographs Single Photograph 1 object Photo Album??? Maps Single Map 1 object Atlas???

18 WDL Standards: Digital Object 1 Record = 1 Object Make Sure the Numbers Match Before Sending Put the Digital Identifier in the Record!!! Connect your media to your metadata Most standards have a place for this: MARC: 856 $f Dublin Core: <identifier> MODS: <identifier> WDL Spreadsheet: image_directory/filename

19 WDL Standards: Real Life Example 806 Records 316 Files + 55 Directories = 371 Objects No Digital Identifiers in Records

20 World Digital Library OSI WEB WDL Standards: Filenaming ASCII characters, preferably numbers Case matters (my_file vs. My_file vs. my_file) Three-letter file extensions (wdl.tif NOT wdl.tiff) Do not use these characters: < " * Space > : ( /? ) \ Leading zeroes 0001.tif 1.tif 0002.tif 10.tif 0003.tif 11.tif 0004.tif 12.tif 0010.tif 2.tif

21 World Digital Library OSI WEB Transfer File Corruption Checksums (md5) Bagger desktop tool BagIt Library (BIL) command line tool

22 World Digital Library OSI WEB Transfer Physical Media: CD/DVD (prone to errors & corruption) Hard Drive (preferred) Network: We FTP/HTTP from your server You deliver to our new S3 dropbox

23 World Digital Library OSI WEB Transfer Contact us We'll send you S3 login information You upload materials We download to our landing zone

24 World Digital Library OSI WEB Transfer Unlimited space for uploading Your box isn't shared with others Many tools Command Line GUI S3 protocol vs. FTP

25 Metadata Creation for Various Formats Your metadata runs the display! Kaleena Black WDL Description Coordinator Sandy Bostian WDL Content Manager

26 World Digital Library OSI WEB Metadata Preparation: Abbreviations Please do not use them, unless one is absolutely necessary (for example, in the original title). If an abbreviation is used, please send us a glossary defining it. Our translators are not librarians and it can be very time-consuming to understand what abbreviations mean, particularly, in languages other than English.

27 Metadata Preparation: Identifiers (IDs) WDL Identifier Record Identifier Digital Identifier

28 Metadata Preparation: Title Information Original Title Original Title Language Title vs. Work English Title (if available)

29 Metadata Preparation: Contributors Contributor Name Birth/Death Dates (if known) Role Author Scribe/Copyist Calligrapher Photographer Editor/Compiler Architect

30 Metadata Preparation: Publication Info Date Created Start End Created vs. Copied CE and/or Hijri (but please indicate which) Publisher Place of Publication

31 Metadata Preparation: Subjects Place Hierarchical Controlled Vocabularies Time Publication vs. Subject Time CE and/or Hijri (but please indicate which) Dewey Decimal Classification (DDC) Additional Subjects (keywords)

32 Metadata Preparation: Type of Item Controlled Vocabulary Books Journals Manuscripts Maps Motion Pictures Newspapers Prints, Photographs Sound Recordings

33 Metadata Preparation: Descriptions Description/Abstract Physical Description Notes Language

34 Metadata Preparation: Additional Info Collection Series Institution URL

35 World Digital Library OSI WEB Metadata Preparation: Resources and Authorities Virtual International Authority File (VIAF) Contributor names MARC Code List for Relators Contributor roles Library of Congress Authorities Subject headings Dewey Decimal Classification (DDC) Topics Getty Thesaurus of Geographic Names (TGN) Place names ISO Language codes All resources can be found on the WDL Project page (

36 Preparing Expert Descriptions for Arab Heritage Resources Mr. Mohammed Hammam Fikri Senior Heritage Specialist Cultural Advisor Office, Qatar Foundation

37 Expert Descriptions: Nominal Process What is an Expert Description on the WDL? It is a summary that explains each item and highlights its significance. It illuminates the material in a way that is accurate, succinct, and engaging. It is developed by working with information provided by partners, subject specialists, and other authoritative resources. It should answer the question: What is this object and why does it matter? Kaleena Black WDL Description Coordinator Jason Yasner WDL Operations Manager

38 Expert Descriptions: Preparation We count primarily on the Partner to provide quality descriptions. As a description writer, you should: Remember that you are dealing with digitized versions of real objects, many rare and unique. In addition to answering the basic questions on the items, try to highlight their significance and provide context. Consider that WDL s audience is diverse (in age, level of expertise, education, etc.) and international.

39 Expert Descriptions: Additional Resources If the initial description and metadata supplied are inadequate to create a quality WDL description, they can be supplemented by: Additional information on the Partner s website, if available, directly linked to the item being described. Existing, authoritative source(s) online or in hard copy for example, Library of Congress collections, JSTOR, Oxford Dictionary of National Biography, National Library of Medicine (NIH). (Other free resources are available at

40 Expert Descriptions: Last Resort Strategies If no description is provided at all, the WDL team must produce an original description. This can either be done by: Going back to the Partner and asking them to produce a description. Engaging WDL staff and expert contractors to do the description, if the Partner cannot (because of limited staff or language expertise, for example). We will then ask the Partner for comment/approval. (Examples of research strategies used by WDL.)

41 Digitization, Processing and Quality Control Chris Masciangelo WDL Digital Conversion Specialist

42 Agenda Technology Hardware Software Pre-capture Set Up Information Capture / Scanning File Formats Storage Quality Review / Post Processing Problems Audio and Video Other Considerations

43 Technology Hardware - Flatbed scanner - Overhead/Planetary scanner - V-shaped book scanner - Large Format scanning system - Monitor - Computer

44 Hardware Flatbed Scanners

45 Hardware Overhead/Planetary Scanners

46 Hardware V-shaped Book Scanners - Manual [Atiz BookDrive Pro] - Automatic [Kirtas KABIS III]

47 Hardware Large Format Scanning System

48 Hardware Large Format Scanning System - Camera - Digital Back - Lighting - Platform/Easel

49 Hardware Monitor - CRT - LCD Calibration colorimeter / spectrophotometer

50 Software Computer/Operating System - Windows - Mac

51 Software Scanning software/driver Image Editing software - Adobe Photoshop Creative Suite - Adobe Photoshop Elements - Capture One - Aperture - GIMP (GNU Image Manipulation Program) Validation software [JHOVE] Metadata Editing [ExifTool, Adobe Bridge]

52 Pre-capture Set Up Examine materials to be scanned for issues/problems Identify balance between adequate informational capture and quality, physical item size, file format and compression, resolution and bit depth, and master file size Ensure equipment is properly focused, has capture profile set (including no auto-sharpening), and that the monitor is calibrated Ensure proper and equal distribution of lighting Good practice to shoot with a commercial color bar or grayscale

53 Pre-capture Set Up Risks during imaging - Physical damage - Exposure to light - Exposure to heat - Disassociation

54 Information Capture / Scanning Targets, color bars, and grayscales

55 Information Capture / Scanning Bit Depth [informational and artifactual value]

56 Information Capture / Scanning Color Modes - RGB [red, green, blue] - CMYK [cyan, magenta, yellow, key (black)]

57 Information Capture / Scanning Color Space and Profile - srgb srgb is the only appropriate choice for images uploaded to the web since most web browsers don't support any color management. - srgb IEC Adobe RGB (1998) Adobe RGB images that are uploaded to websites without conversion to srgb will generally appear dark and muted. - Grayscale - Gray Gamma 2.2

58 Information Capture / Scanning Resolution [PPI/DPI] ppi (slides) ppi (archival) [300 ppi = 118 pixels per cm] - 72/96 ppi (on screen/download) Rule of thumb: Longest side of the image should be 3000 pixels 4 inch x 5 inch 600 ppi = 2400 x 3000 pixels Deep Zoom shows flaws File size = (width pixels x height pixels x bit depth)/8 (2400 x 3000 x 24)/8 = 21,600,000 bytes or 21.6 MB

59 < ~~~~~~~~~~~ 3400 ~~~~~~~~~~~~~> < ~~~~ 1700 ~~~~> World Digital World Digital Library Library Information Capture / Scanning 400 pixels per inch in Photoshop 50% (effectively 200 pixels per inch) 100%

60 File Formats Master [archival] - RAW - TIF - JPEG2000 Access [derivatives] - JPG - PNG - PDF Compression - LZW - JPEG ZIP

61 Storage Media - CD - DVD - Hard Drive - Tape - Cloud Backups Issues - Capacity - Transfer errors - Bit rot - Sustainability, obsolescence, data migration

62 Quality Review / Post-Processing Identify digital issues Image validation Color correction Sharpening

63 Problems Noise Artifacting Vignetting Chromatic aberration Over-sharpening Depth of field Color reproduction Lens distortion Clipping - Overexposure / Underexposure

64 Problems Noise

65 Problems Artifacting

66 Problems Vignetting

67 Problems Chromatic aberration

68 Problems Over-sharpening

69 Problems Depth of Field

70 Problems Color Reproduction

71 Problems Lens Distortion

72 Problems Clipping - Overexposure / Underexposure

73 Audio and Video The format should be publicly and openly documented. The format is not proprietary. The format is in widespread use. The format can be opened, read, and accessed using readily-available tools. WAV or AIFF files [uncompressed] MP4 or MOV

74 Other Considerations Copyright Funding Staffing

75 Preparation of Metadata Records, Descriptions, Files, and Transfer (Interactive Q&A Session)

76 Summarization and Closing Jason Yasner WDL Operations Manager

77 Overview of WDL Production Process Content Selection Content Transfer Content Processing Cataloging Consistent Metadata Descriptions Translation Publishing

78 Improve Communication and Collaboration Increase Partner Collaboration Enable more Self-Service via online tools to: Increase online content transfers Track transfers with inventory integration Improve content processing and validation Allow Partner access and review of descriptions, metadata, and translations Get more people in the process where needed Improve Detailed Standards and Guidelines Content guidelines (digitization, file-naming, object structure) Metadata guidelines (mapping from MARC, MODS, Dublin Core) Improve Integration with Authority Files Metadata controlled vocabularies, authority files Translation controlled vocabularies, authority files

79 Improve Communication and Collaboration Improve User Interface (UI) and User Experience (UX) Richer user interface and experience New Book Viewer Full-Text Search (FTS) Mobile Optimizations Enhanced Web 2.0 Sharing features Capacity Building Continue support of digitization centers in Egypt, Uganda, and Iraq Plan meetings and training workshops Use these workshops in Doha, Qatar, as a Please follow

80 project.wdl.org

81 Contact Information Kaleena Black, WDL Description Coordinator Sandy Bostian, WDL Content Manager Chris Masciangelo, WDL Digital Conversion Specialist Jason Yasner, WDL Operations Manager

82 Thank you!

83 World Digital Library OSI WEB