Research Repository

Using motivational statements in web-instrument design to reduce item-missing rates in a mixed-mode context

Al Baghal, T and Lynn, P (2015) 'Using motivational statements in web-instrument design to reduce item-missing rates in a mixed-mode context.' Public Opinion Quarterly, 79 (2). 568 - 579. ISSN 0033-362X

[img]
Preview
Text
Albaghal.Lynn.POQ.GreenAccess.pdf - Accepted Version

Download (91kB) | Preview
[img]
Preview
Text
poq_14_0049_File003.pdf - Supplemental Material

Download (612kB) | Preview

Abstract

© The Author 2015. Published by Oxford University Press on behalf of the American Association for Public Opinion Research. Web questionnaires, including those used in mixed-mode surveys, generally produce higher levels of item nonresponse than intervieweradministered questionnaires. Item nonresponse is generally seen as having a detrimental impact on data quality. The current study examines using motivational statements to reduce item nonresponse in a web survey component of a mixed-mode design. The effects of alternative implementations are compared, both for web surveys and for mixed-mode surveys. In addition, the mixed-mode results are compared to a face-to-face survey. The current study adds to the literature on the use of motivational statements by using a unique large-scale randomized experiment to examine the impact of the timing of the motivational statement, and to compare with the same survey in an interviewer-administered context. Findings show that a motivational statement following immediately after an item is left unanswered greatly outperforms either the control or a motivational statement at a later point in the survey. Using this immediate reactive prompt reduces item nonresponse to levels equivalent to a face-to-face version. Conversely, the control (no statement) and later placed motivational statement lead to significantly greater item nonresponse. Point estimates for the tested variables are not affected by the additional responses obtained. The results suggest practical design implications to reduce item nonresponse when using a web design, specifically the use of a reactive motivational prompt in a planned way.

Item Type: Article
Subjects: H Social Sciences > H Social Sciences (General)
H Social Sciences > HA Statistics
Divisions: Faculty of Social Sciences > Institute for Social and Economic Research
Depositing User: Jim Jamieson
Date Deposited: 02 Jul 2015 12:29
Last Modified: 05 Feb 2019 11:15
URI: http://repository.essex.ac.uk/id/eprint/14209

Actions (login required)

View Item View Item