Research Repository

Estimating mode effects from a sequential mixed-mode experiment using structural moment models

Clarke, Paul and Bao, Yanchun (2022) 'Estimating mode effects from a sequential mixed-mode experiment using structural moment models.' The Annals of Applied Statistics, 16 (3). pp. 1563-1585. ISSN 1932-6157 (In Press)

Mixed_modes_AoAS_accepted_.pdf - Accepted Version

Download (390kB) | Preview
Supplementary Information Part A - AoAS.pdf - Supplemental Material

Download (671kB) | Preview
SupplementaryInformation_PartB.pdf - Supplemental Material

Download (288kB) | Preview


Until recently, the survey mode of the household panel studyUn-derstanding Societywas mainly face-to-face interview but it has nowadopted a mixed-mode design where individuals can selfcomplete thequestionnaire via the web. As mode is known to affect survey data,a randomized mixed-mode experiment was implemented during thefirst year of the two-year Wave 8 fieldwork period to assess the im-pact of this change. The experiment involved a sequential design thatpermits the identification of mode effects in the presence of nonig-norable nonrandom mode selection. While previous studies have usedinstrumental variables regression to estimate the effects of mode onthe means of the survey variables, we set up a more general framework based on novel structural moment models to characterize the effect of mode on the distribution of the survey variables by its effect on the moments of the joint distribution. We adapt our estimation procedure to account for nonresponse and complex sampling designs, and to include suitable auxiliary data to improve inferences and relax key assumptions. Finally, we demonstrate how to estimate the effects of mode on the parameter estimates from generalized linear and other exponential family models when both outcomes and predictors are subject to mode effects. This framework is used to investigate the impact of the move to web mode on Wave 8 of Understanding Society.

Item Type: Article
Uncontrolled Keywords: Causal inference; generalized method of moments; encouragement design; instrumental variable; potential outcomes
Divisions: Faculty of Social Sciences
Faculty of Social Sciences > Institute for Social and Economic Research
Faculty of Science and Health
Faculty of Science and Health > Mathematical Sciences, Department of
SWORD Depositor: Elements
Depositing User: Elements
Date Deposited: 25 Feb 2022 16:25
Last Modified: 18 Aug 2022 08:48

Actions (login required)

View Item View Item