Latest News
Upcoming at the online ESRA conference 2021:
Keynote speech by Melanie Revilla “How to enhance web survey data and get better insights”. 16 July, 12:00 CEST
When Does it Make Sense to Ask Respondents for Images? Insights for (Mobile) Web Surveys
Patricia Iglesias & Melanie Revilla. Friday 2 July, 15:00 CEST
An overview of the size of measurement errors of a subset of questions of the European Social Survey
Carlos Poses, Melanie Revilla, Marc Asensio, Hannah Schwarz & Wiebke Weber. Friday 9 July, 15:00 - 16:30 CEST
Estimating measurement quality in Round 9 of the European Social Survey - Results of a Split-Ballot Multitrait Multimethod experiment
Carlos Poses, Hannah Schwarz & Wiebke Weber. Thursday 16 July, 15:00 - 16:30 CEST
Participating due to Monetary Incentives and Measurement Quality: Is There a Link? Evidence From MTMM Experiments in the GESIS Panel
Hannah Schwarz, Wiebke Weber, Isabella Minderop & Bernd Weiß. Thursday 16 July, 15:00 - 16:30 CEST
Track me but not really: device undercoverage and its consequences when tracking online behaviours
Oriol J. Bosch & Melanie Revilla. Thursday 16 July, 16:45 - 18:00 CEST
When survey science met online tracking: presenting an error framework for metered data
Oriol J. Bosch & Melanie Revilla. Thursday 16 July, 16:45 - 18:00 CEST
Check out and contribute to the literature review of response scale characteristics.
Keynote speech by Melanie Revilla “How to enhance web survey data and get better insights”. 16 July, 12:00 CEST
When Does it Make Sense to Ask Respondents for Images? Insights for (Mobile) Web Surveys
Patricia Iglesias & Melanie Revilla. Friday 2 July, 15:00 CEST
An overview of the size of measurement errors of a subset of questions of the European Social Survey
Carlos Poses, Melanie Revilla, Marc Asensio, Hannah Schwarz & Wiebke Weber. Friday 9 July, 15:00 - 16:30 CEST
Estimating measurement quality in Round 9 of the European Social Survey - Results of a Split-Ballot Multitrait Multimethod experiment
Carlos Poses, Hannah Schwarz & Wiebke Weber. Thursday 16 July, 15:00 - 16:30 CEST
Participating due to Monetary Incentives and Measurement Quality: Is There a Link? Evidence From MTMM Experiments in the GESIS Panel
Hannah Schwarz, Wiebke Weber, Isabella Minderop & Bernd Weiß. Thursday 16 July, 15:00 - 16:30 CEST
Track me but not really: device undercoverage and its consequences when tracking online behaviours
Oriol J. Bosch & Melanie Revilla. Thursday 16 July, 16:45 - 18:00 CEST
When survey science met online tracking: presenting an error framework for metered data
Oriol J. Bosch & Melanie Revilla. Thursday 16 July, 16:45 - 18:00 CEST
Check out and contribute to the literature review of response scale characteristics.
Poster presentations
Hannah Schwarz presented What is the measurement quality of questions on environmental attitudes and supernatural beliefs in the GESIS Panel? Long or fully labelled? Measurement Quality and Response scale characteristics, a poster with Wiebke Weber, Isabella Minderop and Bernd Weiß at the General Online Research 2020, 8-10 September 2020. See the virtual poster presentation here: https://youtu.be/JhJxl1Kg3t8. And for an update of the poster see here.
Wiebke Weber and Jorge Cimentada, presented Tools for correction for measurement and sampling errors at the ESRA conference, 15-19 July 2019. See the poster.
Wiebke Weber and Jorge Cimentada, presented Tools for correction for measurement and sampling errors at the ESRA conference, 15-19 July 2019. See the poster.
Recent Relevant Research
Papers published in 2021
Melanie Revilla, Carlos Poses, Oriol Serra, Marc Asensio, Hannah Schwarz & Wiebke Weber (2020) "Applying the Estimation Using Pooled Data approach to the multitrait-multimethod experiments of the European Social Survey (Rounds 1 to 7)", Structural Equation Modeling: A Multidisciplinary Journal, 28:3, 463-474, DOI: 10.1080/10705511.2020.1807988
Bosch, Oriol J. & Revilla, Melanie (2021). “The Quality of Survey Questions in Spain: A CrossNational Comparison”. Revista Española de Investigaciones Sociológicas, 175: 3-26. http://dx.doi. org/10.5477/cis/reis.175.3
DeCastellarnau, A. & Saris , W. (2021) Correcting correlation and covariance matrices for measurement errors before further analysis. Structural Equation Modeling: A Multidisciplinary Journal. https://doi.org/10.1080/10705511.2020.1870229
Papers published in 2020
Höhne, J.K., Revilla, M. & Schlosser S. (2020). “Motion Instructions in Surveys: Compliance of Respondents, Acceleration of Smartphones, and Quality of Responses”. International Journal of Market Research, 62(1): 43-57. https://doi.org/10.1177/1470785319858587
Revilla, M. & Höhne, J.K. (2020). "How long do respondents think online surveys should be? New evidence from two online panels in Germany". International Journal of Market Research. First Published Online.
https://doi.org/10.1177/1470785320943049
Revilla, M., Couper, M.P., Bosch, O. & Asensio M. (2020). “Testing the use of voice input in a mobile web survey”. Social Science Computer Review, 38(2): 207-224. https://doi.org/10.1177/0894439318810715
Saris, W., & Gallhofer, I. (2020). Designing Better Questions for Complex Concepts with Reflective Indicators. Survey Research Methods, 14(3), 253-266. https://doi.org/10.18148/srm/2020.v14i3.7613
Schwarz, H., Revilla, M., & Weber, W. (2020). Memory Effects in Repeated Survey Questions: Reviving the Empirical Investigation of the Independent Measurements Assumption. Survey Research Methods, 14(3), 325-344. https://doi.org/10.18148/srm/2020.v14i3.7579
Weber, W., Gallhofer, I., & Saris, W. (2020). Survey Questions, Design of. In P. Atkinson, S. Delamont, A. Cernat, J.W. Sakshaug, & R.A. Williams (Eds.), SAGE Research Methods Foundations.
http://dx.doi.org/10.4135/9781526421036889614
Melanie Revilla, Carlos Poses, Oriol Serra, Marc Asensio, Hannah Schwarz & Wiebke Weber (2020) "Applying the Estimation Using Pooled Data approach to the multitrait-multimethod experiments of the European Social Survey (Rounds 1 to 7)", Structural Equation Modeling: A Multidisciplinary Journal, 28:3, 463-474, DOI: 10.1080/10705511.2020.1807988
Bosch, Oriol J. & Revilla, Melanie (2021). “The Quality of Survey Questions in Spain: A CrossNational Comparison”. Revista Española de Investigaciones Sociológicas, 175: 3-26. http://dx.doi. org/10.5477/cis/reis.175.3
DeCastellarnau, A. & Saris , W. (2021) Correcting correlation and covariance matrices for measurement errors before further analysis. Structural Equation Modeling: A Multidisciplinary Journal. https://doi.org/10.1080/10705511.2020.1870229
Papers published in 2020
Höhne, J.K., Revilla, M. & Schlosser S. (2020). “Motion Instructions in Surveys: Compliance of Respondents, Acceleration of Smartphones, and Quality of Responses”. International Journal of Market Research, 62(1): 43-57. https://doi.org/10.1177/1470785319858587
Revilla, M. & Höhne, J.K. (2020). "How long do respondents think online surveys should be? New evidence from two online panels in Germany". International Journal of Market Research. First Published Online.
https://doi.org/10.1177/1470785320943049
Revilla, M., Couper, M.P., Bosch, O. & Asensio M. (2020). “Testing the use of voice input in a mobile web survey”. Social Science Computer Review, 38(2): 207-224. https://doi.org/10.1177/0894439318810715
Saris, W., & Gallhofer, I. (2020). Designing Better Questions for Complex Concepts with Reflective Indicators. Survey Research Methods, 14(3), 253-266. https://doi.org/10.18148/srm/2020.v14i3.7613
Schwarz, H., Revilla, M., & Weber, W. (2020). Memory Effects in Repeated Survey Questions: Reviving the Empirical Investigation of the Independent Measurements Assumption. Survey Research Methods, 14(3), 325-344. https://doi.org/10.18148/srm/2020.v14i3.7579
Weber, W., Gallhofer, I., & Saris, W. (2020). Survey Questions, Design of. In P. Atkinson, S. Delamont, A. Cernat, J.W. Sakshaug, & R.A. Williams (Eds.), SAGE Research Methods Foundations.
http://dx.doi.org/10.4135/9781526421036889614
Relevant papers published earlier
|
Papers about the quality of questions in web surveys
Bosch, O.J., Revilla, M., DeCastellarnau, A. and W. Weber (2018). "Measurement reliability, validity and quality of slider versus radio button scales in an online probability-based panel in Norway." Social Science Computer Review. First Published March 15, 2018. DOI: https://doi.org/10.1177/0894439317750089 DeCastellarnau, A., & Revilla, M. (2017). Two Approaches to Evaluate Measurement Quality in Online Surveys: An Application Using the Norwegian Citizen Panel. Survey Research Methods, 11(4), 415–433. DOI: http://dx.doi.org/10.18148/srm/2017.v11i4.7226 Revilla, M. et al., 2015. Can a non-probabilistic online panel achieve question quality similar to that of the European Social Survey? International Journal of Market Research, 57(3), pp.395–412. DOI: https://doi.org/10.2501/IJMR-2015-034 Revilla, M. & Ochoa, C., 2015a. Quality of Different Scales in an Online Survey in Mexico and Colombia. Journal of Politics in Latin America, 7(3), pp.157–177. https://journals.sub.uni-hamburg.de/giga/jpla/article/view/903 Revilla, M. & Ochoa, C., 2015b. What are the links in a web survey between response time, quality and auto-evaluation of the efforts done? Social Science Computer Review, 33(1), pp.97–114. DOI: https://doi.org/10.1177/0894439314531214 Papers on general issues concerning
web surveys Revilla, M. Couper, M. P. & Ochoa, C. (2019) Willingness of online panelists to perform additional tasks. methods, data, analyses, 13(2), p. 223-252. DOI: https://doi.org/10.12758/mda.2018.01 Höhne, J. K. Revilla, M. & Schlosser, S. (2019). Motion instructions in surveys: Compliance, acceleration, and response quality. International Journal of Market Research. DOI: https://doi.org/10.1177/1470785319858587 Revilla, M. (2017). "Are there differences depending on the device used to complete a web survey (PC or smartphone) for order-by-click questions?" Field Methods, First Published Online February 16, 2017. DOI: https://doi.org/10.1177/1525822X16674701 Revilla, M. and C. Ochoa (2017). "Ideal and maximum length for a web survey." International Journal of Market Research, 59 (5), 557-565. DOI: https://doi.org/10.2501/IJMR-2017-039 Revilla, M., Ochoa, C., and A. Turbina (2017). "Making use of Internet interactivity to propose a dynamic presentation of web questionnaires." Quality and Quantity, 51(3), 1321-1336. DOI: https://doi.org/10.1007/s11135-016-0333-2 Revilla, M., Ochoa, C., and G. Loewe (2017). "Using passive data from a meter to complement survey data in order to study online behavior." Social Science Computer Review, 35(4) : 521-536. DOI: https://doi.org/10.1177/0894439316638457 |
Papers about the quality and cross-national comparability of survey questions
Liao, P.-S., Saris, W.E. & Zavala-Rojas, D.(2019). Cross-National Comparison of Equivalence and Measurement Quality of Response Scales in Denmark and Taiwan. Journal of Official Statistics, 35(1), 117-135. DOI: http://dx.doi.org/10.2478/JOS-2019-0006 Papers about estimation of SB-MTMM experiments Saris, W. & Satorra, A. (2019). Comparing BSEM and EUPD estimates for 2-Groups SB-MTMM experiments. Structural Equation Modeling: A Multidisciplinary Journal, (26)5, 745-749. DOI: https://doi.org/10.1080/10705511.2019.1576046 Revilla, M., Bosch, O. J. & Weber, W. (2019) Unbalanced 3-Group Split-Ballot Multitrait–Multimethod Design?, Structural Equation Modeling: A Multidisciplinary Journal, 26(3), 437-447, DOI: https://doi.org/10.1080/10705511.2018.1536860 Saris, Willem & Albert Satorra (2018): The Pooled Data Approach for the Estimation of Split-Ballot Multitrait–Multimethod Experiments, Structural Equation Modeling: A Multidisciplinary Journal, 25(5), 659-672. DOI: https://doi.org/10.1080/10705511.2018.1431543 Helm, J. L., Castro-Schilo, L., Zavala-Rojas, D., DeCastellarnau, A. & Oravecz, Z. (2017). Bayesian Estimation of the True Score Multitrait–Multimethod Model with a Split-Ballot Design. Structural Equation Modeling: A Multidisciplinary Journal, 25:1, 71-85. DOI: https://doi.org/10.1080/10705511.2017.1378103 For a short summary click here Effect of question formulation in web surveys
Bosch, O. J., Revilla, M., DeCastellarnau, A., & Weber, W. (2019). Measurement Reliability, Validity, and Quality of Slider Versus Radio Button Scales in an Online Probability-Based Panel in Norway. Social Science Computer Review, 37(1), 119–132. DOI: https://doi.org/10.1177/0894439317750089 Revilla, M., and M.P. Couper (2017). "Comparing grids with vertical and horizontal item-by-item formats for PCs and Smartphones." Social Science Computer Review. Published Online First on June 22, 2017. DOI: https://doi.org/10.1177/0894439317715626 Revilla, M., Toninelli, D., and C. Ochoa (2017). "An experiment comparing grids and item-by-item formats in web surveys completed through PCs and smartphones". Telematics and Informatics, 34(1): 30-42, February 2017. First published online: April 20, 2016. DOI:10.1016/j.tele.2016.04.002. |
