Data Integration Projects

Transcription

1 Data Integration Projects

2 The First Microdata: The 1960 Census Samples Cover, 1960 Census Microdata Codebook Distributed on 13 Univac Tapes (or 18,000 punchcards)

3 The 1970 Public Use Samples 60 times the size of 1960 Much more detail (especially geography) 1960 sample expanded 10-fold Same format and coding as 1970 Led to an explosion of research on change

4 Historical Data Samples of censuses created between 1976 and 2004 Complete-count census data for created between 2003 and 2018

5 1991: Eight Census Years All Incompatible (except 1960 and 1970)

6 0 P03 REL RELATIONSHIP TO HEAD COLS 9-11 Relationship Variable (part): 1900 Public Use Sample 72 categories 100 HEAD OF HOUSEHOLD PARTNER / COHEAD WIFE OF HEAD WIFE OF PARTNER/COHEAD SECOND OR THIRD WIFE OF HEAD CHILD OF HEAD STEP-CHILD OF HEAD ADOPTED CHILD OF HEAD SON/DAUGHTER-IN-LAW FOSTER CHILD / FOUNDLING HUSBAND / NOT HEAD RELATIVE - UNSPECIFIED PARENT OF HEAD STEP-PARENT OF HEAD PARENT-IN-LAW OF HEAD BROTHER/SISTER OF HEAD STEP/HALF BROTHER/SISTER BROTHER/SISTER-IN-LAW NIECE/NEPHEW ADOPTED NIECE/NEPHEW NIECE/NEPHEW-IN-LAW GRAND NIECE/NEPHEW COUSIN COUSIN-IN-LAW SECOND COUSIN AUNT/UNCLE OF HEAD AUNT/UNCLE-IN-LAW GRANDPARENT OF HEAD STEP-GRANDPARENT GRAND-PARENT-IN-LAW GRANDCHILD OF HEAD STEP-GRANDCHILD ADOPTED GRANDCHILD 1.001

7 Relationship Variables: 1980 Public Use Sample 2 Variables, 20 categories

8 1991 IPUMS proposal: An integrated database for 1880, 1900, 1910, 1940, 1950, 1960, 1970, 1980, 1990 Harmonized codes Consistent record layout Integrated documentation No loss of information.

9 IPUMS Graph from A Century of Women in Science and Engineering, History Day project by Abby Norling-Ruggles, age Percent Female; Scientists and Engineers Percent Female Scientists Engineers Year

10 U.S. public use microdata available for research, (number of person records) 1,000,000, ,000, ,000, ,000,000 Microdata digitized from historical manuscripts 200,000,000 0 Public-use microdata from Census Bureau

11 Decennial censuses Components of IPUMS-USA Decennial First release Censuses Decennial Censuses census years American Community Survey (ACS) F American Community Survey (ACS) First First IPUMS Period Period Number Number of IPUMS Data coveredcovered of Periods of data Release periods questions Annual Social and Economic Supplement of the Current Population Survey (ASEC) Monthly Current Population Surveys (CPS)

12 Decennial censuses Components of IPUMS-USA Decennial First release Censuses Decennial Censuses census years American Community Survey (ACS) Surveys (ACS) American Community Survey (ACS) F First First IPUMS Period Period Number Number of IPUMS Data coveredcovered of Periods of data Release periods questions Annual Social and Economic Supplement of the Current Population Survey (ASEC) Monthly Current Population Surveys (CPS)

13 Decennial censuses Components of IPUMS-USA First First IPUMS Period Period Number IPUMS Data coveredcovered of data Release periods Surveys (ACS) American Community Survey Annual F Social (ACS) and Economic Supplement of the Current Population Annual Social Survey and (ASEC) Economic Supplement of the Current Population Survey (ASEC) Number of Periods of questions Decennial First release Censuses Decennial Censuses census years American Community Survey (ACS) ~ Monthly Current Population Surveys (CPS)

14 Decennial censuses Components of IPUMS-USA First First IPUMS Period Period Number IPUMS Data coveredcovered of data Release periods Surveys (ACS) American Community Survey Annual F Social (ACS) and Economic Supplement of the Current Population Annual Social Survey and (ASEC) Economic Supplement of the Current Population Basic Monthly Survey Current (ASEC) Population Survey Number of Periods of questions Decennial First release Censuses Decennial Censuses census years American Community Survey (ACS) ~ ~ Monthly Current Population Surveys (CPS)

15 Decennial censuses Components of IPUMS-USA First First IPUMS Period Period Number IPUMS Data coveredcovered of data Release periods Surveys (ACS) American Community Survey Annual F Social (ACS) and Economic Supplement of the Current Population Annual Social Survey and (ASEC) Economic Supplement of the Current Population Basic Monthly Survey Current (ASEC) Population Survey Number of Periods of questions Decennial First release Censuses Decennial Censuses census years American Community Survey (ACS) ~ ~ Monthly Current Population Current Population Survey Surveys (CPS) Topical Supplements ~

16

17 IPUMS-International Over 100 Collaborating National Statistical Agencies

18 Khartoum, CBS-Sudan

19

20

21 1973 Sudan Census Tapes arrive

22 Dhaka, Bangladesh Bureau of Statistics

23

24

25

26 International public use microdata accessible for research, (number of person records) 1,000,000, ,000,000 Historical microdata 600,000, ,000, ,000,000 McCaa goes to work Microdata from international statistical agencies

27 25,000 Annual Requests for IPUMS-International Data, ,000 Online Analysis 15,000 10,000 5,000 Data Extracts

28 Disseminating integrated public-use data describing over 2 Billion individuals by ,000,000,000 1,500,000,000 Microdata digitized from historical sources 1,000,000, ,000,000 Microdata from international statistical agencies Microdata from U.S. Census Bureau Number Number of person of IPUMS records Person in MPC Records public-use microdata

29 Gigabytes per week 5,000 4,500 4,000 3,500 3,000 2,500 2,000 1,500 1, Five Terabytes distributed each week IPUMS Data Dissemination,

30 Number of users 200, , , , ,000 75,000 50,000 25, ,000 Registered IPUMS Users Registered IPUMS data users,

31 Annual citations 2,000 1,500 Annual citations of IPUMS Data (Google Scholar) 1, A new paper every four hours

32 Next Step: International data for frequent intervals (annual or quarterly)

33 Thank You!