Huber, Christoph and Dreber, Anna and Huber, J and Johannesson, M and Kirchler, M and Weitzel, U and Abellán, M and Adayeva, X and Ay, FC and Barron, K and Berry, Z and Bönte, W and Brütt, K and Bulutay, M and Campos-Mercade, P and Cardella, E and Claassen, MA and Cornelissen, G and Dawson, IGJ and Delnoij, J and Demiral, EE and Dimant, E and Doerflinger, JT and Dold, M and Emery, C and Fiala, L and Fiedler, S and Freddi, E and Fries, T and Gasiorowska, A and Glogowsky, U and M. Gorny, P and Gretton, JD and Grohmann, A and Hafenbrädl, S and Handgraaf, M and Hanoch, Y and Hart, E and Hennig, M and Hudja, S and Hütter, M and Hyndman, K and Ioannidis, K and Isler, O and Jeworrek, S and Jolles, Daniel and Juanchich, Marie and Pratap KC, R and Khadjavi, M and Kugler, T and Li, S and Lucas, B and Mak, V and Mechtel, M and Merkle, C and Meyers, EA and Mollerstrom, J and Nesterov, A and Neyse, L and Nieken, P and Nussberger, A and Palumbo, H and Peters, K and Pirrone, A and Qin, X and Rahal, RM and Rau, H and Rincke, J and Ronzani, P and Roth, Y and Saral, AS and Schmitz, J and Schneider, F and Schram, A and Schudy, S and Schweitzer, ME and Schwieren, C and Scopelliti, I and Sirota, Miroslav and Sonnemans, J and Soraperra, I and Spantig, Lisa and Steimanis, I and Steinmetz, J and Suetens, S and Theodoropoulou, Andriana and Urbig, D and Vorlaufer, T and Waibel, Joschka and Woods, D and Yakobi, O and Yilmaz, O and Zaleskiewicz, T and Zeisberger, S and Holzmeister, F (2023) Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs. Proceedings of the National Academy of Sciences, 120 (23). e2215572120-. DOI https://doi.org/10.1073/pnas.2215572120
Huber, Christoph and Dreber, Anna and Huber, J and Johannesson, M and Kirchler, M and Weitzel, U and Abellán, M and Adayeva, X and Ay, FC and Barron, K and Berry, Z and Bönte, W and Brütt, K and Bulutay, M and Campos-Mercade, P and Cardella, E and Claassen, MA and Cornelissen, G and Dawson, IGJ and Delnoij, J and Demiral, EE and Dimant, E and Doerflinger, JT and Dold, M and Emery, C and Fiala, L and Fiedler, S and Freddi, E and Fries, T and Gasiorowska, A and Glogowsky, U and M. Gorny, P and Gretton, JD and Grohmann, A and Hafenbrädl, S and Handgraaf, M and Hanoch, Y and Hart, E and Hennig, M and Hudja, S and Hütter, M and Hyndman, K and Ioannidis, K and Isler, O and Jeworrek, S and Jolles, Daniel and Juanchich, Marie and Pratap KC, R and Khadjavi, M and Kugler, T and Li, S and Lucas, B and Mak, V and Mechtel, M and Merkle, C and Meyers, EA and Mollerstrom, J and Nesterov, A and Neyse, L and Nieken, P and Nussberger, A and Palumbo, H and Peters, K and Pirrone, A and Qin, X and Rahal, RM and Rau, H and Rincke, J and Ronzani, P and Roth, Y and Saral, AS and Schmitz, J and Schneider, F and Schram, A and Schudy, S and Schweitzer, ME and Schwieren, C and Scopelliti, I and Sirota, Miroslav and Sonnemans, J and Soraperra, I and Spantig, Lisa and Steimanis, I and Steinmetz, J and Suetens, S and Theodoropoulou, Andriana and Urbig, D and Vorlaufer, T and Waibel, Joschka and Woods, D and Yakobi, O and Yilmaz, O and Zaleskiewicz, T and Zeisberger, S and Holzmeister, F (2023) Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs. Proceedings of the National Academy of Sciences, 120 (23). e2215572120-. DOI https://doi.org/10.1073/pnas.2215572120
Huber, Christoph and Dreber, Anna and Huber, J and Johannesson, M and Kirchler, M and Weitzel, U and Abellán, M and Adayeva, X and Ay, FC and Barron, K and Berry, Z and Bönte, W and Brütt, K and Bulutay, M and Campos-Mercade, P and Cardella, E and Claassen, MA and Cornelissen, G and Dawson, IGJ and Delnoij, J and Demiral, EE and Dimant, E and Doerflinger, JT and Dold, M and Emery, C and Fiala, L and Fiedler, S and Freddi, E and Fries, T and Gasiorowska, A and Glogowsky, U and M. Gorny, P and Gretton, JD and Grohmann, A and Hafenbrädl, S and Handgraaf, M and Hanoch, Y and Hart, E and Hennig, M and Hudja, S and Hütter, M and Hyndman, K and Ioannidis, K and Isler, O and Jeworrek, S and Jolles, Daniel and Juanchich, Marie and Pratap KC, R and Khadjavi, M and Kugler, T and Li, S and Lucas, B and Mak, V and Mechtel, M and Merkle, C and Meyers, EA and Mollerstrom, J and Nesterov, A and Neyse, L and Nieken, P and Nussberger, A and Palumbo, H and Peters, K and Pirrone, A and Qin, X and Rahal, RM and Rau, H and Rincke, J and Ronzani, P and Roth, Y and Saral, AS and Schmitz, J and Schneider, F and Schram, A and Schudy, S and Schweitzer, ME and Schwieren, C and Scopelliti, I and Sirota, Miroslav and Sonnemans, J and Soraperra, I and Spantig, Lisa and Steimanis, I and Steinmetz, J and Suetens, S and Theodoropoulou, Andriana and Urbig, D and Vorlaufer, T and Waibel, Joschka and Woods, D and Yakobi, O and Yilmaz, O and Zaleskiewicz, T and Zeisberger, S and Holzmeister, F (2023) Competition and moral behavior: A meta-analysis of forty-five crowd-sourced experimental designs. Proceedings of the National Academy of Sciences, 120 (23). e2215572120-. DOI https://doi.org/10.1073/pnas.2215572120
Abstract
Does competition affect moral behavior? This fundamental question has been debated among leading scholars for centuries, and more recently, it has been tested in experimental studies yielding a body of rather inconclusive empirical evidence. A potential source of ambivalent empirical results on the same hypothesis is design heterogeneity?variation in true effect sizes across various reasonable experimental research protocols. To provide further evidence on whether competition affects moral behavior and to examine whether the generalizability of a single experimental study is jeopardized by design heterogeneity, we invited independent research teams to contribute experimental designs to a crowd-sourced project. In a large-scale online data collection, 18,123 experimental participants were randomly allocated to 45 randomly selected experimental designs out of 95 submitted designs. We find a small adverse effect of competition on moral behavior in a meta-analysis of the pooled data. The crowd-sourced design of our study allows for a clean identification and estimation of the variation in effect sizes above and beyond what could be expected due to sampling variance. We find substantial design heterogeneity?estimated to be about 1.6 times as large as the average standard error of effect size estimates of the 45 research designs?indicating that the informativeness and generalizability of results based on a single experimental design are limited. Drawing strong conclusions about the underlying hypotheses in the presence of substantive design heterogeneity requires moving toward much larger data collections on various experimental designs testing the same hypothesis.
| Item Type: | Article |
|---|---|
| Uncontrolled Keywords: | competition; moral behavior; metascience; generalizability; experimental design |
| Divisions: | Faculty of Science and Health Faculty of Social Sciences Faculty of Science and Health > Psychology, Department of Faculty of Social Sciences > Economics, Department of |
| SWORD Depositor: | Unnamed user with email elements@essex.ac.uk |
| Depositing User: | Unnamed user with email elements@essex.ac.uk |
| Date Deposited: | 02 Jun 2023 10:04 |
| Last Modified: | 30 Oct 2024 21:22 |
| URI: | http://repository.essex.ac.uk/id/eprint/35715 |
Available files
Filename: pnas.2215572120.pdf
Licence: Creative Commons: Attribution 4.0