Listwise deletion
In statistics, listwise deletion is a method for handling missing data. In this method, an entire record is excluded from analysis if any single value is missing.[1]:6
Example
For example, consider the following questionnaire, as answered by 10 subjects:
| Subject | Age | Gender | Income |
|---|---|---|---|
| 1 | 29 | M | $40,000 |
| 2 | 45 | M | $36,000 |
| 3 | 81 | M | --missing-- |
| 4 | 22 | --missing-- | $16,000 |
| 5 | 41 | M | $98,000 |
| 6 | 33 | F | $60,000 |
| 7 | 22 | F | $24,000 |
| 8 | --missing-- | F | $81,000 |
| 9 | 33 | F | $55,000 |
| 10 | 45 | F | $80,000 |
A researcher is hoping to model income (dependent variable) based on age and gender (independent variables). Using listwise deletion, the researcher would remove subjects 3, 4, and 8 from the sample before performing any further analysis.
Problems with listwise deletion
Listwise deletion affects statistical power of the tests conducted.[2][3] Statistical power relies in part on high sample size. Because listwise deletion excludes data with missing values, it reduces the sample which is being statistically analysed.
Listwise deletion is also problematic when the reason for missing data may not be random (i.e., questions in questionnaires aiming to extract sensitive information.[3] Due to the method, much of the subjects' data will be excluded from analysis, leaving a bias in data findings. For instance, a questionnaire may include questions about respondents drug use history, current earnings, or sexual persuasions. Many of the subjects in the sample may not answer due to the intrusive nature of the questions, but may answer all other items. Listwise deletion will exclude these respondents from analysis. This may create a bias as participants who do divulge this information may have different characteristics than participants who do not. Multiple imputation is an alternate technique for dealing with missing data that attempts to eliminate this bias.
Compared to other methods
While listwise deletion does have its problems, it is preferable to many other methods for handling missing data.[1]:7 In some cases, it may even be the least problematic method.[1]:6 The following table provides some comparisons of listwise deletions to other methods:
| Method | Comparison |
|---|---|
| Pairwise deletion | Ambiguous definition of sample size causes bias in estimated standard errors and test statistics.[1]:9 |
| Dummy variable adjustment | Produces biased estimates of coefficients.[4] |
References
- Allison, P. D. (2001). Missing Data. Sage University Papers Series on Quantitative Applications in the Social Sciences. 07–136. Thousand Oaks, CA: Sage.
- Roth, P. L. (1994). "Missing data: A conceptual review for applied psychologists". Personnel Psychology. 47 (3): 537–559. doi:10.1111/j.1744-6570.1994.tb01736.x.
- Olinsky, A.; Chen, S.; Harlow, L. (2003). "The comparative efficacy of imputations methods for missing data in structural equation modeling". European Journal of Operational Research. 151 (1): 53–79. doi:10.1016/S0377-2217(02)00578-7.
- Jones, M. P. (1996). "Indicator and stratification methods for missing explanatory variables in multiple linear regression". J. Amer. Statist. Assoc. 91 (433): 222–230. doi:10.1080/01621459.1996.10476680. As cited by Allison (2001), p. 10.