Zusammenfassung
Aufgrund der Klumpung von Interviews in Interviewern können Designeffekte auftreten, die die Umfrageergebnisse maßgeblich beeinträchtigen können. Dabei ist grundlegend davon auszugehen, dass die Varianz eines Messwertes umso größer wird, je ungleicher die Verteilung der Interviews über die Interviewer und je größer die Zahl der Interviews je Interviewer ist.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Literatur
AAPOR. (2016). Standard Definitions - Final Dispositions of Case Codes and Outcome Rates for Surveys. 9th edition. American Association of Public Opinion Research. Retrieved from http://www.aapor.org/AAPOR_Main/media/publications/Standard-Definitions20169theditionfinal.pdf
ADM. (2016). Richtlinie für telefonische Befragungen. Berlin: Arbeitskreis Deutscher Markt- und Sozialforschungsinstitute e.V. https://www.adm-ev.de/index.php?eID=tx_nawsecuredl&u=0&file=fileadmin/user_upload/PDFS/R04_D.pdf&t=1516356317&hash=d5073f2820a9048ba817e90197e01460acc40817
Bailar, B., Bailey, L., & Stevens, J. (1977). Measures of Interviewer Bias and Variance. Journal of Marketing Research 14 (3), 337–343. https://doi.org/10.2307/3150772
Biemer, P. P., Chen, P., & Wang, K. (2013). Incorporating Level of Effort Paradata in the NSDUH Nonresponse Adjustment Process. Research Triangle Park, NC. Retrieved from https://www.samhsa.gov/data/sites/default/files/NSDUHCallbackModelReport2013/NSDUHCallbackModelReport2013.pdf
Biemer, P. P. & Lyberg, L. E. (2003). Introduction to Survey Quality. Hoboken, NJ: Wiley. https://doi.org/10.1002/0471458740
Brunton-Smith, I., Sturgis, P., & Leckie, G. (2016). Detecting and understanding interviewer effects on survey data by using a cross-classified mixed effects location-scale model. Journal of the Royal Statistical Society. Series A: Statistics in Society, (October). https://doi.org/10.1111/rssa.12205
Brunton-Smith, I., Sturgis, P., & Williams, J. (2012). Is success in obtaining contact and cooperation correlated with the magnitude of interviewer variance? Public Opinion Quarterly 76 (2), 265–286. https://doi.org/10.1093/poq/nfr067
Cantor, D., Allen, B., Schneider, S. J., Hagerty-Heller, T., & Yuan, A. (2004). Testing an Automated Refusal Avoidance Training Methodology. In 59th annual Conference of the American Association for Public Opinion Research. Phoenix.
Conrad, F. G., Broome, J. S., Benkí, J. R., Kreuter, F., Groves, R. M., Vannette, D., & Mcclain, C. (2013). Interviewer speech and the success of survey invitations. Journal of the Royal Statistical Society. Series A: Statistics in Society 176 (1), 191–210. https://doi.org/10.1111/j.1467-985X.2012.01064.x
Couper, M. P., Singer, E., & Tourangeau, R. (2004). Does Voice Matter? An Interactive Voice Response (IVR) Experiment. Journal of Official Statistics 20 (3), 551–570. Retrieved from http://www.websm.org/uploadi/editor/Couper_2004_Does_voice_matter.pdf
Davis, R. E., Couper, M. P., Janz, N. K., Caldwell, C. H., & Resnicow, K. (2010). Interviewer effects in public health surveys. Health Education Research 25 (1), 14–26. https://doi.org/10.1093/her/cyp046
Deming, W. E. (1960). Sample Design in Business Research. New York, USA: Wiley.
Dijkstra, W. & Smit, J. H. (2002). Persuading reluctant recipients in telephone surveys. In R. M. Groves, D. A. Dillman, J. L. Eltinge, & R. J. A. Little (Eds.), Survey Nonresponse (S. 121-134). New York: John Wiley & Sons.
Durand, C. (2005). Measuring interviewer performance in telephone surveys. Quality and Quantity 39 (6), 763-778. https://doi.org/10.1007/s11135-004-6781-0
Durand, C. (2008). Assessing the usefulness of a new measure of interviewer performance in telephone surveys. Public Opinion Quarterly 72 (4), 741-752. https://doi.org/10.1093/poq/nfn044
Durrant, G. B., D’Arrigo, J., & Steele, F. (2011). Using paradata to predict best times of contact, conditioning on household and interviewer influences. Journal of the Royal Statistical Society. Series A: Statistics in Society 174 (4), 1029-1049. https://doi.org/10.1111/j.1467-985X.2011.00715.x
Durrant, G. B., D’arrigo, J., Steele, F., & Steele (2013). Analysing Interviewer Call Record Data by Using a Multilevel Discrete Time Event History Modelling Approach. Journal of the Royal Statistical Society. Series A (Statistics in Society) 176 (1), 251–269. https://doi.org/10.1111/j.1467-985X.2012.01073.x
Durrant, G. B., Groves, R. M., Staetsky, L., & Steele, F. (2010). Effects of interviewer attitudes and behaviors on refusal in household surveys. Public Opinion Quarterly 74 (1), 1–36. https://doi.org/10.1093/poq/nfp098
Durrant, G. B., & Steele, F. (2009). Multilevel modelling of refusal and noncontact nonresponse in household surveys: evidence from six UK government surveys. Journal of the Royal Statistical Society 172 (2), 361–381. https://doi.org/10.1111/j.1467-985X.2008.00565.x
Eckman, S., Sinibaldi, J., & Möntmann-Hertz, A. (2013). Can interviewers effectively rate the likelihood of cases to cooperate? Public Opinion Quarterly 77 (2), 561–573. https://doi.org/10.1093/poq/nft012
Edwards, T. P., Suresh, R., & Weeks, M. F. (1998). Automated call scheduling: current systems and practices. In R. P. Baker (Ed.), Computer Assisted Survey Information Collection (S. 285–306). Hoboken, NJ: Wiley.
Elliott, M. R. & West, B. T. (2015). “Clustering by Interviewer”: A Source of Variance That is Unaccounted for in Single-Stage Health Surveys. American Journal of Epidemiology 182 (2), 118–126. https://doi.org/10.1093/aje/kwv018
Ganninger, M. (2010). Design effects: model-based versus design-based approach. GESIS - Leibniz-Institut für Sozialwissenschaften, Bonn.
Groves, R. M. (2004). Survey Errors and Survey Costs. In R. M. Groves, G. Kalton, J. N. K. Rao, N. Schwarz, & C. Skinner (Eds.). Hoboken, New Jersey: Wiley Series in Probability and Statistics. https://doi.org/10.16373/j.cnki.ahr.150049
Groves, R. M., Cialdini, R. B., & Couper, M. P. (1992). Understanding the decision to participate in a survey. Public Opinion Quarterly 56 (4), 475-495. https://doi.org/10.1086/269338
Groves, R. M., Fowle, F., Couper, M. P., Siger, E., & Tourangeau, R. (2004). Survey Methodology. In R. M. Groves, G. Kaftan, J. N. K. Rao, N. Schwarz, & C. Skinner (Eds.). Hoboken, New Jersey: Wiley Series in Survey Methodology. https://doi.org/10.1093/poq/nfi018
Groves, R. M. & Fultz, N. H. (1985). Gender effects among telephone interviewers in a survey of economic attitudes. Sociological Methods & Research 14 (1), 31-52. https://doi.org/10.1177/0049124185014001002
Groves, R. M. & Magilavy, L. J. (1986). Measuring and Explaining Interviewer Effects in Centralized Telephone Surveys.The Public Opinion QuarterlyPublic Opinion Quarterly 50, 251–266. https://doi.org/10.1017/CBO9781107415324.004
Groves, R. M. & McGonagle, K. A. (2001). A Theory-Guided Interviewer Training Protocol Regarding Survey Participation. Journal of Official Statistics 17 (2), 249.
Groves, R. M., O’Hare, B. C., Gould-Smith, D., Benki, J., & Maher, P. (2008). Telephone interviewer voice characteristics and the survey participation decision. In J. M. Lepkowski, N. C. Tucker, J. M. Brick, E. de Leeuw, L. Japec, P. J. Lavrakas, … R. L. Sangster (Eds.), Advances in Telephone Survey Methodology (S. 385-400). Hoboken, NJ: John Wiley & Sons. https://doi.org/10.1002/9780470173404.ch18
Häder, S. (2000). Telefonstichproben (ZUMA How-to-Reihe No. 6). Mannheim. Retrieved from https://www.gesis.org/fileadmin/upload/forschung/publikationen/gesis_reihen/howto/how-to6sh.pdf
Häder, S., Gabler, S., & Heckel, C. (2009). Stichprobenziehung für die CELLA-Studie. In M. Häder & S. Häder (Eds.), Telefonbefragungen über das Mobilfunknetz (S. 21–49). Wiesbaden: VS Verlag für Sozialwissenschaften. https://doi.org/10.1007/978-3-531-91490-9_3
Hess, J., Singer, E., & Bushery, J. (1999). Predicting Test-Retest Reliability from Behavior Coding. International Journal of Public Opinion Research 11 (4), 346–360. https://doi.org/10.1093/ijpor/11.4.346
Houtkoop-Steenstra, H. & van den Bergh, H. (2000). Effects of Introductions in Large-Scale Telephone Survey Interviews. Sociological Methods & Research 28 (3), 281–300. https://doi.org/10.1177/0049124100028003002
Hox, J. J. (1994). Hierarchical Regression Models for Interviewer and Respondent Effects. Sociological Methods & Research 22 (3), 300–318. https://doi.org/10.1177/1056492611432802
Hox, J. J., de Leeuw, E., Couper, M. P., Groves, R. M., De Heer, W., Kuusela, V., Japec, L. (2002). The Influence of Interviewers’ Attitude and Behavior on Household Survey Nonresponse: An International Comparison. In R. M. Groves, D. A. Dillman, & J. L. Eltinge (Eds.), Survey Nonresponse (S. 103–120). New York: Wiley.
Hox, J. J., de Leeuw, E. D., & Kreft, I. G. G. (1991). The Effect of Interviewer and Resondent Characteristics on the Quality of Survey Data. In P. P. Biemer, R. M. Groves, L. E. Lyberg, N. A. Mathiowetz, & S. Sudman (Eds.), Measurement Errors in Surveys (S. 439–461). Hoboken, NJ: John Wiley & Sons. https://doi.org/10.1177/0049124101029004004
Hughes, A., Chromy, J., Giacoletti, K., & Odom, D. (2002). Impact of Interviewer Experience on Respondent Reports of Substance Use. In J. Gfroerer, J. Eyerman, & J. Chromy (Eds.), Redesigning an Ongoing National Household Survey: Methodological Issues (S. 161–184). Rockville, MD: Department of Health and Human Services.
Ilgen, D. R. & Schneider, J. (1991). Performance measurement: A multi-discipline view. International Review of Industrial and Organizational Psychology 6 (1), 71–108.
Jäckle, A., Lynn, P., Sinibaldi, J., & Tipping, S. (2013). The Effect of Interviewer Experience, Attitudes, Personality and Skills on Respondent Co-operation with Face-to-Face Surveys. Survey Research Methods 7 (1), 1–15.
Jans, M., Sirkis, R., & Morgan, D. (2013). Managing Data Quality Indicators With Paradata-Based Statistical Quality Control Tools: The Keys to Survey Performance. In F. Kreuter (Ed.), Improving Surveys with Paradata: Analytic Uses of Process Information (S. 191–229). Thousand Oaks: Sage Publications. https://doi.org/10.1002/9781118596869.ch9
Johnson, T. P. & Moore, R. W. (1993). Gender interactions between interviewer and survey respondents: Issues of pornography and community standards. Sex Roles 28 (5–6), 243–261. https://doi.org/10.1007/bf00289884
Juran, J. M. & Godfrey, A. B. (1998). Juran’s Quality Handbook. McGrawHill (5. Auflage). New York: McGraw-Hill. https://doi.org/10.1108/09684879310045286
Kane, E. W. & Macaulay, L. J. (1993). Interviewer Gender and Gender Attitudes. Public Opinion Quarterly 57 (1), 1–28. https://doi.org/10.1086/269352
Kish, L. (1962). Studies of interviewer variance for attitudinal variables. Journal of the American Statistical Association 57 (297), 92-115. https://doi.org/10.1080/01621459.1962.10482153
Kreuter, F. (2013). Improving surveys with Paradata: Analytic Uses of Process Information. (M. P. Couper, G. Kalton, J. N. K. Rao, N. Schwarz, C. Skinner, & R. M. Groves, Eds.). New York, London: Wiley. https://doi.org/10.1017/CBO9781107415324.004
Kreuter, F., Couper, M., & Lyberg, L. E. (2010). The use of paradata to monitor and manage survey data collection. In Section on Survey Research Methods – JSM 2010 (S. 282–296).
Laflamme, F. & St-Jean, H. (2011). Proposed Indicators to Assess Interviewer Performance in CATI Surveys. Section on Survey Research Methods – JSM, 118–128. Retrieved from https://ww2.amstat.org/sections/srms/Proceedings/y2011/Files/300092_64606.pdf
Lavrakas, P. J. (1993). Telephone survey methods: Sampling, selection, and supervision. London: Sage Publications, Inc.
Lemay, M. & Durand, C. (2002). The Effect Of Interviewer Attitude on Survey Cooperation. Bulletin of Sociological Methodology 76 (1), 27-44. https://doi.org/10.1177/075910630207600102
Lipps, O. (2007). Interviewer and Respondent Survey Quality Effects in a CATI Panel. Bulletin of Sociological Methodology/Bulletin de Methodologie Sociologique 95 (2007), 5-25. https://doi.org/10.1177/075910630709500103
Lipps, O. (2008). A Note on Interviewer Performance Measures in Centralised CATI Surveys. Survey Research Methods 2 (2), 61-73.
Lipps, O. (2009). Cooperation in centralised CATI household panel surveys - A contact-based multilevel analysis to examine interviewer, Respondent, and fieldwork process effects. Journal of Official Statistics 25 (3), 323–338.
Lohr, S. L. (2010). Sampling: Design and Analysis. Boston: Brooks/ Cole. https://doi.org/10.1002/1521-3773(20010316)40:6%3c9823::AID-ANIE9823%3e3.3.CO;2-C
Lyberg, L. E. (2012). Survey Quality. Survey Methodology 38 (2), 107–130.
Lyberg, L. E., Biemer, P. P., Collins, M., De Leeuw, E., Dippo, C., Schwarz, N., Trewin, D. (1997). Survey Measurement and Process Quality. New York: Wiley Series in Probability and Statistics. https://doi.org/10.1002/9781118490013
Mahalanobis, P. C. (1946). Recent Experiments in Statistical Sampling in the Indian-Statistical-Institute. Journal of the Royal Statistical Society. Series A: Statistics in Society 109 (4), 325–378.
Maitland, A., Casas-Cordero, C., & Kreuter, F. (2009). An Evaluation of Nonresponse Bias Using Paradata from a Health Survey. In JSM 2009 (S. 370-378). Retrieved from https://ww2.amstat.org/sections/srms/Proceedings/y2009/Files/303004.pdf
Maynard, D. W. & Schaeffer, N. C. (2002). Standardization and its Discontents. In R. M. Groves, G. Kalton, J. N. K. Rao, N. Schwarz, & C. Skinner (Eds.), Standardization and Tacit Knowledge: Interaction and Practice in the Survey Interview (S. 3-45). New York: Wiley Interscience. https://doi.org/10.4135/9781412984492.n11
Morton-Williams, J. (1993). Interviewer Approaches. London: Dartmouth Publishing Co Ltd.
O’Brien, E. M., Mayer, T. S., Groves, R. M., & O’Neill, G. E. (2002). Interviewer training to increase survey participation. In Proceedings of the Annual Meetings of the American Statistical Association (S. 5202-5207).
O’Muircheartaigh, C. & Campanelli, P. (1998). The relative impact of interviewer effects and sample design effects on survey precision. Journal of the Royal Statistical Society. Series A (Statistics in Society) 161 (1), 63–77. https://doi.org/10.1111/1467-985X.00090
O’Muircheartaigh, C. & Campanelli, P. (1999). A multilevel exploration of the role of interviewers in survey non-response. Journal of the Royal Statistical Society: Series A (Statistics in Society) 162 (3), 437–446. https://doi.org/10.1111/1467-985x.00147
Olson, K. M. (2013). Paradata for Nonresponse Adjustment. The Annals of the American Academy of Political and Social Science 645 (1), 142–170. https://doi.org/10.1177/0002716212459475
Olson, K. M. & Groves, R. M. (2012). An examination of within-person variation in response propensity over the data collection field period. Journal of Official Statistics 28 (1), 29–51.
Olson, K. M., Kirchner, A., & Smyth, J. (2016). Do Interviewers with High Cooperation Rates Behave Differently? Interviewer Cooperation Rates and Interview Behaviors. Survey Practice 9 (2), 1–11.
Olson, K. M. & Peytchev, A. (2007). Effect of interviewer experience on interview pace and interviewer attitudes. Public Opinion Quarterly 71 (2), 273–286. https://doi.org/10.1093/poq/nfm007
Olson, K. M., Smyth, J. D., & Wood, H. M. (2012). Does giving people their preferred survey mode actually increase survey participation rates? an experimental examination. Public Opinion Quarterly 76 (4), 611–635. https://doi.org/10.1093/poq/nfs024
Pickery, J. & Loosveldt, G. (2002). A multilevel multinomial analysis of interviewer effects on various components of unit nonresponse. Quality and Quantity 36 (4), 427–437. https://doi.org/10.1023/A:1020905911108
Robert-Koch-Institut (RKI). (2012). Daten und Fakten: Ergebnisse der Studie »Gesundheit in Deutschland aktuell 2010«. Beiträge zur Gesundheitsberichterstattung des Bundes 32 (2), 56. https://doi.org/10.1016/j.khinf.2010.03.002
Schaeffer, N. C., Dykema, J., & Maynard, D. W. (2010). Interviewers and Interviewing. In P. V. Marsden & J. D. Wright (Eds.), Handbook of Survey Research (S. 437-470). Bingley: Emerald Group Publishing Limited.
Schlinzig, T. & Schneiderat, G. (2009). Möglichkeiten zur Erhöhung der Teilnahmebereitschaft bei Telefonumfragen über Festnetz und Mobilfunk. In Umfrageforschung (S. 21-43). Wiesbaden: VS Verlag für Sozialwissenschaften. https://doi.org/10.1007/978-3-531-91852-5_2
Schnell, R. (2012). Survey-Interviews: Methoden standardisierter Befragungen. Wiesbaden: VS, Verlag für Sozialwissenschaften. https://doi.org/10.1007/978-3-531-94208-7
Schnell, R. & Kreuter, F. (2005). Separating Interviewer and Sampling-Point Effects. Journal of Official Statistics 21 (3), 389–410.
Sinibaldi, J. & Eckman, S. (2015). Using call-level interviewer observations to improve response propensity models. Public Opinion Quarterly 79 (4), 976–993. https://doi.org/10.1093/poq/nfv035
Snijkers, G. & de Leeuw, D. (1999). Interviewers’ tactics for fighting survey nonresponse. Journal of Official Statistics 15 (2), 185.
Sodeur, W. (2007). Entscheidungsspielräume von Interviewern bei der Wahrscheinlichkeitsauswahl - Ein Vergleich von ALLBUS-Erhebungen. MDA - Methoden Daten Analysen 1 (2), 107–130.
Steinkopf, L., Bauer, G., & Best, H. (2010). Nonresponse und Interviewer-Erfolg im Telefoninterview. Methoden - Daten - Analysen 4 (1), 3–26.
Tarnai, J. & Moore, D. L. L. L. (2008). Measuring and Improving Telephone Interviewer Performance and Productivity. In J. M. Lepkowski, C. Tucker, J. M. Brick, E. D. de Leeuw, L. Japec, P. J. Lavrakas, … R. L. Sangster (Eds.), Advances in Telephone Survey Methodology (S. 359–384). New York: Wiley Interscience. https://doi.org/10.1002/9780470173404.ch17
Van der Vaart, W., Ongena, Y., Hoogendoorn, A., & Dijkstra, W. (2006). Do interviewers’ voice characteristics influence cooperation rates in telephone surveys? International Journal of Public Opinion Research 18 (4), 488–499. https://doi.org/10.1093/ijpor/edh117
Van Tilburg, T. (1998). Interviewer Effects in the Measurement of Personal Network size a Nonexperimental Study. Sociological Methods & Research 26 (3), 300–328. https://doi.org/10.1177/0049124198026003002
Vehre, H. (2012). “Sie wollen mir doch was verkaufen!” Analyse der Umfrageteilnahme in einem offline rekrutierten Access Panel. Wiesbaden: VS Verlag für Sozialwissenschaften. https://doi.org/10.1007/978-3-531-94236-0
Wagner, J., Valliant, R., Hubbard, F., & Jiang, L. (2014). Level-of-Effort Paradata and Nonresponse Adjustment Models for a National Face-to-Face Survey. Journal of Survey Statistics and Methodology 2 (4), 410–432. https://doi.org/10.1093/jssam/smu012
Wagner, J., West, B. T., Kirgis, N., Lepkowski, J. M., Axinn, W. G., & Ndiaye, S. K. (2012). Use of Paradata in a Responsive Design Framework to Manage a Field Data Collection. Journal of Official Statistics 28 (4), 477–499.
Weinberg, E. (1983). Data collection: Planning and Management. In P. Ross, J. Wright, & A. Anderson (Eds.), Handbook of Survey Research (S. 329–358). New York, London: Academic Press.
West, B. T. (2011). Paradata in Survey Research. Survey Practice 4 (4).
West, B. T. & Groves, R. M. (2013). A Propensity-Adjusted Interviewer Performance Indicator. Public Opinion Quarterly 77 (1), 352–374. https://doi.org/10.1093/poq/nft002
West, B. T. & Olson, K. M. (2010). How much of interviewer variance is really nonresponse error variance? Public Opinion Quarterly 74 (5), 1004–1026. https://doi.org/10.1093/poq/nfq061
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Fachmedien Wiesbaden GmbH, ein Teil von Springer Nature
About this chapter
Cite this chapter
von Hermanni, H. (2019). Rolle und Einfluss von Interviewern in telefonischen Umfragen. In: Häder, S., Häder, M., Schmich, P. (eds) Telefonumfragen in Deutschland. Schriftenreihe der ASI - Arbeitsgemeinschaft Sozialwissenschaftlicher Institute. Springer VS, Wiesbaden. https://doi.org/10.1007/978-3-658-23950-3_10
Download citation
DOI: https://doi.org/10.1007/978-3-658-23950-3_10
Published:
Publisher Name: Springer VS, Wiesbaden
Print ISBN: 978-3-658-23949-7
Online ISBN: 978-3-658-23950-3
eBook Packages: Social Science and Law (German Language)