Latest News
Check out and contribute to the literature review of response scale characteristics.
At the General Online Research 2020, Hannah Schwarz presented,
- Do previous survey experience and being motivated to participate by an incentive affect response quality? Evidence from the CRONOS panel, with Melanie Revilla and Bella Struminskaya.
- What is the measurement quality of questions on environmental attitudes and supernatural beliefs in the GESIS Panel? Long or fully labelled? Measurement Quality and Response scale characteristics, a poster with Wiebke Weber, Isabella Minderop and Bernd Weiß. See the virtual poster presentation here: https://youtu.be/JhJxl1Kg3t8. And for an update see here.
Wiebke Weber and Jorge Cimentada, presented tools for correction for measurement and sampling errors at the ESRA conference, 15-19 July 2019. See the poster.
Recent Relevant Research
Papers published in 2021
Melanie Revilla, Carlos Poses, Oriol Serra, Marc Asensio, Hannah Schwarz & Wiebke Weber (2020) "Applying the Estimation Using Pooled Data approach to the multitrait-multimethod experiments of the European Social Survey (Rounds 1 to 7)", Structural Equation Modeling: A Multidisciplinary Journal, 28:3, 463-474, DOI: 10.1080/10705511.2020.1807988
Bosch, Oriol J. & Revilla, Melanie (2021). “The Quality of Survey Questions in Spain: A CrossNational Comparison”. Revista Española de Investigaciones Sociológicas, 175: 3-26. http://dx.doi. org/10.5477/cis/reis.175.3
DeCastellarnau, A. & Saris , W. (2021) Correcting correlation and covariance matrices for measurement errors before further analysis. Structural Equation Modeling: A Multidisciplinary Journal. https://doi.org/10.1080/10705511.2020.1870229
Papers published in 2020
Höhne, J.K., Revilla, M. & Schlosser S. (2020). “Motion Instructions in Surveys: Compliance of Respondents, Acceleration of Smartphones, and Quality of Responses”. International Journal of Market Research, 62(1): 43-57. https://doi.org/10.1177/1470785319858587
Revilla, M. & Höhne, J.K. (2020). "How long do respondents think online surveys should be? New evidence from two online panels in Germany". International Journal of Market Research. First Published Online.
https://doi.org/10.1177/1470785320943049
Revilla, M., Couper, M.P., Bosch, O. & Asensio M. (2020). “Testing the use of voice input in a mobile web survey”. Social Science Computer Review, 38(2): 207-224. https://doi.org/10.1177/0894439318810715
Saris, W., & Gallhofer, I. (2020). Designing Better Questions for Complex Concepts with Reflective Indicators. Survey Research Methods, 14(3), 253-266. https://doi.org/10.18148/srm/2020.v14i3.7613
Schwarz, H., Revilla, M., & Weber, W. (2020). Memory Effects in Repeated Survey Questions: Reviving the Empirical Investigation of the Independent Measurements Assumption. Survey Research Methods, 14(3), 325-344. https://doi.org/10.18148/srm/2020.v14i3.7579
Weber, W., Gallhofer, I., & Saris, W. (2020). Survey Questions, Design of. In P. Atkinson, S. Delamont, A. Cernat, J.W. Sakshaug, & R.A. Williams (Eds.), SAGE Research Methods Foundations.
http://dx.doi.org/10.4135/9781526421036889614
Papers published in 2019
Saris, W. & Satorra, A. (2019). Comparing BSEM and EUPD estimates for 2-Groups SB-MTMM experiments. Structural Equation Modeling: A Multidisciplinary Journal, Published online: 28 Mar 2019.
DOI: https://doi.org/10.1080/10705511.2019.1576046
Liao, P.-S., Saris, W.E. & Zavala-Rojas, D.(2019). Cross-National Comparison of Equivalence and Measurement Quality of Response Scales in Denmark and Taiwan. Journal of Official Statistics, 35(1), 117-135. DOI: http://dx.doi.org/10.2478/JOS-2019-0006
Revilla, M. Couper, M. P. & Ochoa, C. (2019) Willingness of online panelists to perform additional tasks. methods, data, analyses, 13(2), p. 223-252. DOI: https://doi.org/10.12758/mda.2018.01
Höhne, J. K. Revilla, M. & Schlosser, S. (2019). Motion instructions in surveys: Compliance, acceleration, and response quality. International Journal of Market Research. DOI: https://doi.org/10.1177/1470785319858587
Revilla, M., Bosch, O. J. & Weber, W. (2019) Unbalanced 3-Group Split-Ballot Multitrait–Multimethod Design?, Structural Equation Modeling: A Multidisciplinary Journal, 26:3, 437-447, DOI: https://doi.org/10.1080/10705511.2018.1536860
Bosch, O. J., Revilla, M., DeCastellarnau, A., & Weber, W. (2019). Measurement Reliability, Validity, and Quality of Slider Versus Radio Button Scales in an Online Probability-Based Panel in Norway. Social Science Computer Review, 37(1), 119–132. DOI: https://doi.org/10.1177/0894439317750089
Melanie Revilla, Carlos Poses, Oriol Serra, Marc Asensio, Hannah Schwarz & Wiebke Weber (2020) "Applying the Estimation Using Pooled Data approach to the multitrait-multimethod experiments of the European Social Survey (Rounds 1 to 7)", Structural Equation Modeling: A Multidisciplinary Journal, 28:3, 463-474, DOI: 10.1080/10705511.2020.1807988
Bosch, Oriol J. & Revilla, Melanie (2021). “The Quality of Survey Questions in Spain: A CrossNational Comparison”. Revista Española de Investigaciones Sociológicas, 175: 3-26. http://dx.doi. org/10.5477/cis/reis.175.3
DeCastellarnau, A. & Saris , W. (2021) Correcting correlation and covariance matrices for measurement errors before further analysis. Structural Equation Modeling: A Multidisciplinary Journal. https://doi.org/10.1080/10705511.2020.1870229
Papers published in 2020
Höhne, J.K., Revilla, M. & Schlosser S. (2020). “Motion Instructions in Surveys: Compliance of Respondents, Acceleration of Smartphones, and Quality of Responses”. International Journal of Market Research, 62(1): 43-57. https://doi.org/10.1177/1470785319858587
Revilla, M. & Höhne, J.K. (2020). "How long do respondents think online surveys should be? New evidence from two online panels in Germany". International Journal of Market Research. First Published Online.
https://doi.org/10.1177/1470785320943049
Revilla, M., Couper, M.P., Bosch, O. & Asensio M. (2020). “Testing the use of voice input in a mobile web survey”. Social Science Computer Review, 38(2): 207-224. https://doi.org/10.1177/0894439318810715
Saris, W., & Gallhofer, I. (2020). Designing Better Questions for Complex Concepts with Reflective Indicators. Survey Research Methods, 14(3), 253-266. https://doi.org/10.18148/srm/2020.v14i3.7613
Schwarz, H., Revilla, M., & Weber, W. (2020). Memory Effects in Repeated Survey Questions: Reviving the Empirical Investigation of the Independent Measurements Assumption. Survey Research Methods, 14(3), 325-344. https://doi.org/10.18148/srm/2020.v14i3.7579
Weber, W., Gallhofer, I., & Saris, W. (2020). Survey Questions, Design of. In P. Atkinson, S. Delamont, A. Cernat, J.W. Sakshaug, & R.A. Williams (Eds.), SAGE Research Methods Foundations.
http://dx.doi.org/10.4135/9781526421036889614
Papers published in 2019
Saris, W. & Satorra, A. (2019). Comparing BSEM and EUPD estimates for 2-Groups SB-MTMM experiments. Structural Equation Modeling: A Multidisciplinary Journal, Published online: 28 Mar 2019.
DOI: https://doi.org/10.1080/10705511.2019.1576046
Liao, P.-S., Saris, W.E. & Zavala-Rojas, D.(2019). Cross-National Comparison of Equivalence and Measurement Quality of Response Scales in Denmark and Taiwan. Journal of Official Statistics, 35(1), 117-135. DOI: http://dx.doi.org/10.2478/JOS-2019-0006
Revilla, M. Couper, M. P. & Ochoa, C. (2019) Willingness of online panelists to perform additional tasks. methods, data, analyses, 13(2), p. 223-252. DOI: https://doi.org/10.12758/mda.2018.01
Höhne, J. K. Revilla, M. & Schlosser, S. (2019). Motion instructions in surveys: Compliance, acceleration, and response quality. International Journal of Market Research. DOI: https://doi.org/10.1177/1470785319858587
Revilla, M., Bosch, O. J. & Weber, W. (2019) Unbalanced 3-Group Split-Ballot Multitrait–Multimethod Design?, Structural Equation Modeling: A Multidisciplinary Journal, 26:3, 437-447, DOI: https://doi.org/10.1080/10705511.2018.1536860
Bosch, O. J., Revilla, M., DeCastellarnau, A., & Weber, W. (2019). Measurement Reliability, Validity, and Quality of Slider Versus Radio Button Scales in an Online Probability-Based Panel in Norway. Social Science Computer Review, 37(1), 119–132. DOI: https://doi.org/10.1177/0894439317750089
Relevant papers published earlier
|
Papers about estimation of 2 groups
SB-MTMM experiments Saris, Willem & Albert Satorra (2018): The Pooled Data Approach for the Estimation of Split-Ballot Multitrait–Multimethod Experiments, Structural Equation Modeling: A Multidisciplinary Journal, 25(5), 659-672. DOI: https://doi.org/10.1080/10705511.2018.1431543 Helm, J. L., Castro-Schilo, L., Zavala-Rojas, D., DeCastellarnau, A. & Oravecz, Z. (2017). Bayesian Estimation of the True Score Multitrait–Multimethod Model with a Split-Ballot Design. Structural Equation Modeling: A Multidisciplinary Journal, 25:1, 71-85. DOI: https://doi.org/10.1080/10705511.2017.1378103 For a short summary click here Papers on general issues concerning
web surveys Revilla, M. (2017). "Are there differences depending on the device used to complete a web survey (PC or smartphone) for order-by-click questions?" Field Methods, First Published Online February 16, 2017. DOI: https://doi.org/10.1177/1525822X16674701 Revilla, M. and C. Ochoa (2017). "Ideal and maximum length for a web survey." International Journal of Market Research, 59 (5), 557-565. DOI: https://doi.org/10.2501/IJMR-2017-039 Revilla, M., Ochoa, C., and A. Turbina (2017). "Making use of Internet interactivity to propose a dynamic presentation of web questionnaires." Quality and Quantity, 51(3), 1321-1336. DOI: https://doi.org/10.1007/s11135-016-0333-2 Revilla, M., Ochoa, C., and G. Loewe (2017). "Using passive data from a meter to complement survey data in order to study online behavior." Social Science Computer Review, 35(4) : 521-536. DOI: https://doi.org/10.1177/0894439316638457 |
Papers about the quality of questions in web surveys
Bosch, O.J., Revilla, M., DeCastellarnau, A. and W. Weber (2018). "Measurement reliability, validity and quality of slider versus radio button scales in an online probability-based panel in Norway." Social Science Computer Review. First Published March 15, 2018. DOI: https://doi.org/10.1177/0894439317750089 DeCastellarnau, A., & Revilla, M. (2017). Two Approaches to Evaluate Measurement Quality in Online Surveys: An Application Using the Norwegian Citizen Panel. Survey Research Methods, 11(4), 415–433. DOI: http://dx.doi.org/10.18148/srm/2017.v11i4.7226 Revilla, M. et al., 2015. Can a non-probabilistic online panel achieve question quality similar to that of the European Social Survey? International Journal of Market Research, 57(3), pp.395–412. DOI: https://doi.org/10.2501/IJMR-2015-034 Revilla, M. & Ochoa, C., 2015a. Quality of Different Scales in an Online Survey in Mexico and Colombia. Journal of Politics in Latin America, 7(3), pp.157–177. https://journals.sub.uni-hamburg.de/giga/jpla/article/view/903 Revilla, M. & Ochoa, C., 2015b. What are the links in a web survey between response time, quality and auto-evaluation of the efforts done? Social Science Computer Review, 33(1), pp.97–114. DOI: https://doi.org/10.1177/0894439314531214 Effect of question formulation in web surveys
Revilla, M., and M.P. Couper (2017). "Comparing grids with vertical and horizontal item-by-item formats for PCs and Smartphones." Social Science Computer Review. Published Online First on June 22, 2017. DOI: https://doi.org/10.1177/0894439317715626 Revilla, M., Toninelli, D., and C. Ochoa (2017). "An experiment comparing grids and item-by-item formats in web surveys completed through PCs and smartphones". Telematics and Informatics, 34(1): 30-42, February 2017. First published online: April 20, 2016. DOI:10.1016/j.tele.2016.04.002. |
