// DATA README Compiled: Sharat Ganapati - Georgetown University - sg1390@georgetown.edu Acknowledgments: Serena Sampler for Research Assistance Released Date: Jun 12, 2020 Citation: Sharat Ganapati (2020) "Aggregated US Census Concentration Data" Data used in Ganapati, Sharat (2020) "Oligopolies, Prices, Output, and Productivity" Conditionally Accepted at American Economic Journal: Microeconomics Previous Appears as: Census Working Paper CES-WP-18-48 // WHAT IS THIS? All available data from 1972-2012 on national market concentration available from the US Census Bureau // WHERE DOES THIS COME FROM? This is complied from publicly available US Census Bureau data and publications including paper publications (see full list below). This data comes from a mix of digitized paper documents, CD-ROMS/Floppy discs, now-discontinued FTP servers, and the US Census Bureau website (accessed 2017-2019). Employment, Sales, and Payroll data for manufacturing sectors is amended using the NBER-CES manufacturing database (with 2012 data using the NBER's 2011 data). Some data is missing due to either confidentiality issues, or has not been released by the US Census Bureau. // WHAT DOES THIS COVER? This data originates from the US Census Bureau's Economic Censuses, which is now conducted every 5-years in years ending in 2 and 7. All available data is compiled for 1972, 1977, 1982, 1987, 1992, 1997, 2002, 2007, and 2012. This data is not a complete sample of the US economy. See Ganapati (2020) for full details on coverage from 1972-2012. Additional partial data on the manufacturing sector is available for 1935, 1947, 1954, 1958, 1963, 1966, 1967 and 1970. However this early data on the manufacturing sector is poorly documented within Census Bureau documentation and should only be used with caution. // HOW IS THE DATA ORGANIZED Each year of data has a folder. Within the folder we've included both the raw underlying data as well as any supporting files. The data is organized by different industry classification systems over the years. Prior to 1997, the US Census used various vintages of the SIC classification system. Following 1997, the US Census used various vintages of the NAICS classification system. See Ganapati (2020) for further documentation and an example of comparing industries across time. A partially cleaned and organized list appears in "Aggregated/All Data - Partially Cleaned.xlsx" // Full Source List 1) Public-Use Census Files from the Census HTTP/FTP servers $DATA/*/Web $DATA/*/FTP All downloaded from the HTTP/FTP Servers: As the Census website is constantly in a state of flux, here are some current links (The original links no longer work, due to a change in the Census website layout. Files do go missing from this website. As these files are all public use, I present the original files themselves (unzipped)) https://www.census.gov/programs-surveys/economic-census/data/tables.2002.html https://www.census.gov/programs-surveys/economic-census/data/tables.2007.html https://www.census.gov/programs-surveys/economic-census/data/tables.2012.html 2) Public-Use Census Files from legacy media (Floppy/CD) available at Federal Depository Libraries (Copied by author's team) $DATA/*/CD-ROM I present the call codes for the Dartmouth University Library. They may be requested though inter-library loans. These files are often in depreciated formats. The extraction software may need an older machine. I used an old Windows 95 machine with a working version of MS-DOS to read these files and convert them to TSV versions. For some of the files, I've further converted them into Excel files using Microsoft Excel for Mac 16.16. Extracted from this CD-ROM/Floppy Disk Set: 1987 economic census. United States. Bureau of the Census. Data User Services Division. Washington, DC : U.S. Department of Commerce, Bureau of the Census, Data User Services Division, 1995- CD-ROM C 3.277:EC 7/987/CD/ GOVDOC : C 3.277:EC 7/987/CD/V.1- GOVDOC : C 3.277:EC 7/987/DOC./V.1- GOVDOC : C 3.277:EC 7/987/FLOPPY GOVDOC : C 3.277:EC 7/987/FLOPPY 1-3 Extracted from this CD-ROM Set: 1992 economic census. United States. Bureau of the Census. Data User Services Division. Washington, DC : U.S. Department of Commerce, Bureau of the Census, Data User Services Division, 1995- CD-ROM C 3.277:CD-EC 92-1 J OCLC : (OCoLC)ocm38436610 GOVDOC : C 3.277:CD-EC 92-1 J Extracted from this CD-ROM Set: 1997 economic census. United States. Bureau of the Census. Data User Services Division. Washington, DC : U.S. Department of Commerce, Bureau of the Census, Data User Services Division, 1995- CD-ROM C 3.277:CD-EC 97-1/DISC.1 A OCLC : (OCoLC)ocm42930117 GOVDOC : C 3.277:CD-EC 97-1/DISC.1 A- 5) Public-Use Census Files available in print, available at Federal Depository Libraries (Digitized by author's team) $DATA/*/Print These documents are easily available in hard-copy at most university libraries. They may be requested though inter-library loans. Additionally there are often available as scanned PDFs on archive.org. The census does not host these files online, this is their account: "Collections of hard-copy printed reports are maintained at certain major libraries; and individual reports may be accessible through interlibrary loan. The Census Bureau Library has print volumes of the economic census starting with the 1935 Census of Business through the 1997 Economic Census. The library is able to provide scans of selected pages. The library also has print copies of the County Business Patterns for 1948-1997. Reference librarians are available to consult with users by phone (301-763-2511) and e-mail (library@census.gov)." Extracted from the following documents: 1972 Economic Census (published 1973-196): Mini-guide to the 1972 Economic Censuses Census of Selected Service Industries, US Department of Census Census of Retail Trade, US Department of Census Census of Wholesale Trade, US Department of Census 1977 Economic Census (published 1977-1981) Economic Censuses: Publication program Mini-guide to the 1977 Economic Censuses Census of Service Industries, US Department of Census Census of Retail Trade, US Department of Census Census of Wholesale Trade, US Department of Census 1987 Economic Census Census of Service Industries, US Department of Census Census of Retail Trade, US Department of Census Census of Wholesale Trade, US Department of Census 1992 Economic Census Census of Service Industries, US Department of Census 1997 Economic Census (published 200) Subject Series: Establishment and Firm Size (Including Legal Form of Organization) 6) NBER-CES Database; For manufacturing firms; wage and output data is pulled directly from the NBER-CES database. Available here: http://data.nber.org/nberces/ $DATA/NBER See further documetnation here: Becker, Randy, Wayne Gray, and Jordan Marvakov. "NBER-CES manufacturing industry database: Technical notes." NBER Working Paper 5809 (2013).