Archive for the 'Data & Methods' Category

Page 2 of 34

The Undercover Historian

blog header
[Link to Undercover Historian blog]

The Undercover Historian
Beatrice Cherrier | blog
since 2011

This is a blog by Beatrice Cherrier, an historian of economics. It has been in existence since 2011 and has a wealth of information about the history of the field of economics. And, no I don’t know what her quote about “pig-headed” is referencing.

Weighting Makes a Difference

How One 19-Year-Old Illinois Man Is Distorting National Polling Averages
New York Times | Nate Cohn @Nate_Cohn
October 12, 2016

Trump support

[Link to NYT article]

This is a nice illustration of the decisions polls make when they weight their respondents. The authors disagree with the decisions of the USC/LA-Times pollsters, but applaud them for transparency:

It’s worth noting that this analysis is possible only because the poll is extremely and admirably transparent: It has published a data set and the documentation necessary to replicate the survey.

The article has multiple illustrations of what the trend of national Trump support would have been with different weighting decisions. Check it out.

Creating Cartograms

Nathan Yau at Flowing Data points out two tools for making cartograms. One from Pitch Interactive, which allows you to upload state-by-state data and the tool creates the map. Another from Bhaskar V. Karambelkar at RPubs lets you create the map in R.

Big Data is not about the Data

Gary King, Director for the Institute for Quantitative Social Science at Harvard University spoke at a recent Michigan Institute for Data Science (MIDAS) symposium. Below are links to the slides and a video of the presentation.
Slides | Video

For those who don’t want to watch the entire presentation, here are links to specific papers and/or software he mentions in the presentation.

Automated Text Analysis
VA: Verbal Autopsy [software]
Evaluating U.S. Social Security Administration Forecasts
Learning Catalytics [commercial start-up]
Crimson Hexagon: Social Media Insights [commercial start-up]
Perusall [commercial start-up, e-book platform to increase student engagement]

And, it might be more productive to just go through King’s personal website to find the content yourself. The above is just a fraction of his productivity.

ICPSR Data Fair 2016: Navigating the Data (R)Evolution

ICPSR is uploading videos from it’s 2016 data fair to YouTube. Videos include:

…And many more!

Mapping the Spread of Obesity

Nathan Yau at Flowing Data has an interactive graphic showing the growth of obesity rates by state, year (since 1985) and gender.

Data Mining and Predictors of Physical Activity in Older Urban Adults

A post by Sunmoo Yoon in the NIH OBSSR blog looks at the potential of data mining to offer insights into predictors of physical activity in older urban adults:

Only two out of ten older adults meet the national guidelines for physical activity in the United States. Little is known about interrelationships of many socio-ecological factors to improve physical activity behavior among Hispanic older adults. As we move towards a precision medicine approach, we need innovative strategies to discover precisely tailored targets and accurate interventions. Data mining has the potential to offer such insights.

Data Sleuths at the Census Bureau

The Census Bureau gathered data on fertility by asking a “children ever born” question from 1940 to 1990 in the decennial census. The 2000 Census did not ask a fertility question at all. With the advent of the American Community Survey, fertility was covered but with a different question. It asked if a woman had given birth to a child in the past year. This allows researchers to compute a total fertility rate. It performs reasonably well against the measure produced from the vital statistics system. And, given that geography is not readily available with the natality detail files anymore, this is a welcome solution. The main drawback to the ACS question is that the reference year will not span the calendar year that the vital statistics system is based on. Only the December respondents are referencing a January to December calendar year. See the Background section below for a further discussion of this.

However, recently, the Census Bureau noticed some anomalies in the data for selected areas and determined that some interviewers had been sloppy and asked “Have you given birth” rather than “Have you given birth in the last year.” Many more women will answer yes to the former and inflate the numerator. This is a good illustration of how much effort the Census Bureau goes to for producing accurate and robust statistics.

Data Sleuthing
Addressing Data Collection Errors in the Fertility Question in the American Community Survey
Tavia Simmons | Census Bureau
August 2016

In recent years, a few geographic areas in the American Community Survey (ACS) data had unusually high percentages of women reported as giving birth in the past year, quite unlike what was seen in previous years for those areas. This paper describes the issue that was discovered, and the measures taken to address it.

Indicators of Marriage and Fertility in the United States from the American Community Survey: 2000 to 2004
T. Johnson and J. Dye | Census Bureau
May 2005

Slides 23 to 26 discuss and illustrate how the ACS and Vital Statistics estimates diverge from each other.

IRS Migration Data Report Tool

IRS map

This is a nice tool for getting net migration reports based on IRS tax return data. Note that because these data are based on tax returns, one can also tell whether, on average, a state is losing/gaining wealthier residents. One can generate reports for counties by state or for states. The former is really tedious because one has to generate the county reports one by one.

Tool Link
Counties | States

And here’s the link to raw data for those who find widgets tedious. Note that the site has nice explanations for the methodology, including changes over time in how these files are created: SOI Tax Stats – Migration Data

And, do you want to know how to make something like the map above? Here’s a link from Flowing Data on how to make a similar map based on 5-years of county-to-county IRS data:
Article | How To Guide

Census Bureau Retires Easy Stats

As of 9/30/2016, Easy Stats will no longer be available. To access data from the American Community Survey, use American FactFinder or QuickFacts. You can provide feedback here.

According to Data Detectives, “The retirement of the application is a result of a CEDSCI data tools assessment from earlier this year. The assessment looked at consolidating data tools to eliminate redundancy and also streamline our data dissemination offerings on”