Names from Nowhere? Fictitious Country Names in Survey Vignettes Affect Experimental Results

There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

Abstract

Using fictitious country names in hypothetical scenarios is widespread in experimental international relations research. We survey sixty-four peer-reviewed articles to find that it is justified by reference to necessary “neutralization” compared to real-world scenarios. However, this neutralization effect has not been independently tested. Indeed, psychology and toponymy scholarship suggest that names entail implicit cues that can inadvertently bias survey results. We use a survey experiment to test neutralization and naming effects. We find not only limited evidence for neutralization, but also little evidence for systematic naming effects. Instead, we find that respondents were often more willing to support using force against fictitious countries than even adversarial real-world countries. Real-world associations may provide a “deterrent” effect not captured by hypothetical scenarios with fictitious country names. In turn, fictionalization may decrease the stakes as experienced by respondents. Researchers should therefore carefully explain rationales for and expected effects of fictitious country names, and test their fictitious names independently.

Related collections

Most cited references 82

Record: found
Abstract: found
Article: not found

Validating vignette and conjoint survey experiments against real-world behavior.

Jens Hainmueller, Dominik Hangartner, Teppei Yamamoto (2015)

Survey experiments, like vignette and conjoint analyses, are widely used in the social sciences to elicit stated preferences and study how humans make multidimensional choices. However, there is a paucity of research on the external validity of these methods that examines whether the determinants that explain hypothetical choices made by survey respondents match the determinants that explain what subjects actually do when making similar choices in real-world situations. This study compares results from conjoint and vignette analyses on which immigrant attributes generate support for naturalization with closely corresponding behavioral data from a natural experiment in Switzerland, where some municipalities used referendums to decide on the citizenship applications of foreign residents. Using a representative sample from the same population and the official descriptions of applicant characteristics that voters received before each referendum as a behavioral benchmark, we find that the effects of the applicant attributes estimated from the survey experiments perform remarkably well in recovering the effects of the same attributes in the behavioral benchmark. We also find important differences in the relative performances of the different designs. Overall, the paired conjoint design, where respondents evaluate two immigrants side by side, comes closest to the behavioral benchmark; on average, its estimates are within 2% percentage points of the effects in the behavioral benchmark.

0 comments Cited 231 times – based on 0 reviews      Review now

Bookmark

Record: found
Abstract: found
Article: not found

Public Opinion and the Democratic Peace

JESSICA L. P. WEEKS, MICHAEL R. TOMZ (2013)

One of the most striking findings in political science is the democratic peace: the absence of war between democracies. Some authors attempt to explain this phenomenon by highlighting the role of public opinion. They observe that democratic leaders are beholden to voters and argue that voters oppose war because of its human and financial costs. This logic predicts that democracies should behave peacefully in general, but history shows that democracies avoid war primarily in their relations with other democracies. In this article we investigate not whether democratic publics are averse to war in general, but whether they are especially reluctant to fight other democracies. We embedded experiments in public opinion polls in the United States and the United Kingdom and found that individuals are substantially less supportive of military strikes against democracies than against otherwise identical autocracies. Moreover, our experiments suggest that shared democracy pacifies the public primarily by changing perceptions of threat and morality, not by raising expectations of costs or failure. These findings shed light on a debate of enduring importance to scholars and policy makers.