College of Public Health and Health Professions



College of Public Health and Health Professions

Chris McCarty

ufchris@ufl.edu

(352) 392-2908 x101

PHC 6716: Survey Research Methods. 3 credit hours

Description: This course provides an introduction to population surveys typical in descriptive (surveillance) and analytic epidemiologic research. The course has a strong emphasis on telephone questionnaire methods, but also includes other data collection modes and their relative advantages and disadvantages. Survey sampling, survey planning and data collection, computer interviewing and data management techniques for research surveys are emphasized. The course includes generalized methods and didactic materials as well as case studies drawn from the experiences of the course instructor and other University researchers.

Prerequisites: Students are recommended to have completed PHC 6001 and STA 6207 or PHC 6052 or the equivalent.

Course Objectives: Students will be able to:

• Understand and choose among data collection methods for surveillance and research

• Apply survey methods to real-life examples

• Understand sampling for research and the applicability of various analytic techniques depending on sampling

• Prepare data reports from surveys

• Prepare data collection plans with scheduling and financial estimates

• Apply quality assurance procedures in survey research

Course Schedule: The course will meet Wednesdays from 9:30-12:30 at the University of Florida Survey Research Center (summer C). The UFSRC is located in the Ayers Building at 720 SW 2nd Ave. Suite 156. The class will meet in the conference room.

Text/Readings:

Readings will be assigned from scientific and survey literature. These will be posted weekly at:



Students will be assigned articles each week that they are expected to read. Selected students will be required to critique an article and lead a discussion. The format for this will be explained in class.

Grading: The grading scale for this course consists of the standard scale below:

90% - 100% = A

85% -89.9% = B+

80% -84.9% = B

75% -79.9% = C+

70% -74.9% = C

65% -69.9% = D+

60% - 64.9% = D

Below 60% = E

Grading Methods: The assessment will include homework assignments, quizzes, an individual course paper and associated class presentation, and class participation.

Homework assignments = 10%

Individual project = 20% (Based on oral presentation)

Quizzes = 30% (Three quizzes at 10% each)

Class Survey Project = 20%

Class participation = 20% (Based on in class dialogue and summaries of articles)

Class Attendance: Class attendance is mandatory for students. Excused absences follow the criteria of the UFL Graduate Catalogue (e.g., illness, serious family emergency, military obligations, religious holidays), and should be communicated to the instructor prior to the missed class day when possible. UFL rules require attendance during the first two course sessions, and students also must attend the final two course sessions of student presentations for this class. Missing three scheduled sessions will result in a failure. Regardless of attendance, students are responsible for all material presented in class and meeting scheduled due dates for class assignments. Finally, students should read the assigned readings prior to the class meetings, and be prepared to discuss the material except for the first class session.

Homework: Students will be assigned a homework project at the end of selected classes that will be due at the beginning of the next class.

Individual Projects: To be discussed in class.

Survey Project: Students will be trained to conduct telephone survey research per the protocols of the UF Survey Research Center. A portion of each class will be devoted to the development of a survey questionnaire, telephone calls to potential respondents and analysis of the data.

Policy on Make-Up Work: Students are allowed to make up work as the result of illness or other unanticipated circumstances warranting a medical excuse and resulting in the student missing a homework or project deadline, consistent with College policy. Documentation from a health care provider is required. Work missed for any other reason will receive a grade of zero.

Accommodations for Students with Disabilities: Students requiring accommodations must first register with the Dean of Students' Office. The Dean of Students' Office will provide documentation to the student who must then provide this documentation to the faculty member when requesting accommodation. The College is committed to providing reasonable accommodations to assist students in their coursework.

Structure of Class:

Each class will consist of three parts. The first will be a presentation on a fundamental aspect of the survey research process. I will present a PowerPoint on the topic for about an hour. This will be followed by student-led discussion of the assigned articles for about an hour. The remainder of each class will be devoted to the development of the telephone survey project the class will conduct throughout the semester.

Course Outline:

May 11: Course Introduction

• Overview of Course and syllabus

• Overview of UF Survey Research Center

• Discussion of survey topic

Readings for May 18 PDF files located at

• Scott Fricker, Mirta Galesi, Roger Torangeau, TingYan (2005) An Experimental Comparison of Web and Telephone Surveys. Public Opinion Quarterly 69(3):370-392

• Don A. Dillman, Glenn Phelps, Robert Tortora, Karen Swift, Julie Kohrell, Jodi Berck, Benjamin L. Messer (2009) Response rate and measurement differences in mixed-mode surveys using mail, telephone, interactive voice response (IVR) and the Internet. Social Science Research 38:1–18

• Allyson L. Holbrook, Melanie C. Green, Jon A. Krosnick (2003) Telephone Versus Face-To-Face Interviewing of National Probability Samples With Long Questionnaires Comparisons of Respondent Satisficing And Social Desirability Response Bias. Public Opinion Quarterly Volume 67:79–125.

• Linchiat Chang, Jon A. Krosnick (2009) National Surveys via RDD Telephone Interviewing Versus the Internet Comparing Sample Representativeness and Response Quality. Public Opinion Quarterly, 73: 641–678.

May 18: Survey Modes – Telephone, Mail, Web, Face-to-Face

• Defining the population

• Units of analysis

• Survey Modes (Telephone, Mail, Web, Face-to-face)

• Random Digit versus Listed Samples for telephone surveys

• Options from Sample Vendors (GENESYS and Survey Sampling)

• Case Study – Medicaid Reform and Web of Knowledge

Readings for May 25 PDF files located at

• Link, Michael W.; Battaglia, Michael P.; Frankel, Martin R.; Osborn, Larry; and Ali H. Mokdad. “A Comparison of Address-Based Sampling (ABS) Versus Random-Digit Dialing (RDD) for General Population Surveys.” Public Opinion Quarterly 72 (2008): 6-27

• Michael W. Link, Michael R Battaglia, Martin R. Frankel, Larry Osborn, Ali H. Mokdad (2007) Reaching The U.S. Cell Phone Generation Comparison of Cell Phone Survey Results With An Ongoing Landline Telephone Survey. Public Opinion Quarterly 71: 814-39.

• De Leeuw, Edith, D. (2005). “To Mix or Not to Mix Data Collection Modes in Surveys.” Journal of Official Statistics (JOS), 21, 233-255.

• Vicente, P., Reis, E., & Santos, M. (2009). Using mobile phones for survey research. International Journal of Market Research, 51, 613-633.

• Kumar Rao, Olena Kaminska, Allan L. Mccutcheon (2010) Recruiting Probability Samples for a Multi-Mode Research Panel With Internet And Mail Components Public Opinion Quarterly, 74 (1) 68–84

May 25: Survey Modes – New Challenges

• Cell phone problem

• Mixed modes

• Address based sampling

• Internet Panels

• Mobile Phone Survey Designs

• Case Study – Child Trust

Readings for June 1 PDF files located at

• Gaziano, C. (2005) Comparative analysis of within-household respondent selection techniques. Public Opinion Quarterly 69: 124-157.

• Jennifer Hess, Jeffrey Moore, Joanne Pascale, Jennifer Rothgeb, Catherine Keeley (2001) The Effect of Person-level versus Household-level Questionnaire Design on Survey Estimates and Data Quality. Public Opinion Quarterly 65: 574-584.

• Frederick G. Conrad and Michael F. Schober (2000) Clarifying Question Meaning In A Household Telephone Survey. Public Opinion Quarterly. 64: 1-28.

• Elena M. Andresen, C. Renea Machuga, Mary Ellen Van Booven, John Egel, John T. Chibnall, Raymond C. Tait (2008) Effects And Costs Of Tracing Strategies On Nonresponse Bias In A Survey Of Workers With Low-Back Injury. Public Opinion Quarterly. 72: 40–54.

June 1: Margin of Error, Sample Size and Sample Design

• Calculation of margin of error

• Power analyses for determining sample size

• Predicting and planning for attrition from sampling frames, fixed lists

• Respondent selection

• Case Study – FHIS and Tallahassee Project

• Homework 1

Readings for June 8 PDF files located at

• Scott Keeter; Carolyn Miller; Andrew Kohut; Robert M Groves; Stanley Presser (2000) "Consequences of reducing nonresponse in a national telephone survey" Public Opinion Quarterly. 64: 125-148

• Christopher McCarty (2003) "Differences in response rates using most recent versus final dispositions in telephone surveys." Public Opinion Quarterly. 67: 396-406.

• Christopher McCarty, Mark House, Jeffrey Harman, Scott Richards (2006) Effort in Phone Survey Response Rates: The Effects of Vendor and Client-Controlled Factors. Field Methods, 20: 1-17.

• Richard Curtin; Stanley Presser; Eleanor Singer (2000) The effects of response rate changes on the index of consumer sentiment. Public Opinion Quarterly. 64: 413-428.

• Hoonakker, Peter andCarayon, Pascale(2009) Questionnaire Survey Nonresponse: A Comparison of Postal Mail and Internet Surveys, International Journal of Human-Computer Interaction, 25: 5, 348 — 373

• Lee S, Brown ER, Grant D, Belin TR, Brick JM. Exploring nonresponse bias in a health survey using neighborhood characteristics. Am J Public Health. 2009;99(10):1811-1817.

June 8: Response rates, Disposition Coding

• What is a response rate and what should it be used for?

• Overview of AAPOR and CASRO disposition coding

• Review of different ways to calculate response rates

• Issues in improving response and quality assurance

• Case study – BRFSS Cell and CCI

• Homework 2

Readings for June 15 PDF files located at

• Nancy D. Brener, Laura Kann and Tim McManus (2003) A Comparison Of Two Survey Questions On Race And Ethnicity Among High School Students. Public Opinion Quarterly 67:227–236.

• Jon A. Krosnick, Allyson L. Holbrook, Matthew K. Berent, Richard T. Carson, W. Michael Hanemann, Raymond J. Kopp, Robert Cameron Mitchell, Stanley Presser, Paul A. Ruud, V. Kerry Smith, Wendy R. Moody, Melanie C. Green, And Michael Conaway (2002) The Impact Of “No Opinion” Response Options On Data Quality: Non-Attitude Reduction Or An Invitation To Satisfice? Public Opinion Quarterly. 66: 371-403.

• Jennifer M. Stewart, Eamon O’Shea, Cam Donaldson, Phil Shackley (2002) Do ordering effects matter in willingness-to-pay studies of health care? Journal of Health Economics 21: 585-599.

• Bärbel Knäuper (1998) Filter Questions and Question Interpretation: Presuppositions at Work. Public Opinion Quarterly. 62:70-78.

• George D. Gaskell, Daniel B. Wright, Colm A. O’Muircheartaigh (2000) Telescoping Of Landmark Events: Implications For Survey Research. Public Opinion Quarterly 64:77–89.

• Kristiina Manderbacka, Ingemar Kareholt, Pekka Martikainen, Olle Lundberg (2003) The effect of point of reference on the association between self-rated health and mortality. Social Science & Medicine 56: 1447–1452.

June 15: Questionnaire Design, Question Wording and Incentives

• Quiz 1

• Categorical (nominal) questions

• Ordinal questions

• Interval questions

• Open-ended questions

• Order Effects

• Case study – Web of Knowledge versus Elder Affairs Survey

Readings for June 29th PDF files located at

• David A. Asch, Nicholas A. Christakis, Peter A. Ubel (1998) “Conducting Physician Mail Surveys on a Limited Budget: A Randomized Trial Comparing $2 Bill versus $5 Bill Incentives” Medical Care 36 (1) :95-99.

• Ulrich, C. M., Danis, M., Koziol, D., Garrett-Mayer, E., Hubbard, R., & Grady, C. (2005). “Does It Pay to Pay? A Randomized Trial of Prepaid Financial Incentives and Lottery Incentives in Surveys of Nonphysician Healthcare Professionals.” Nursing Research, 54(3): 178–183.

• Juan D. Baron, Robert V. Breunig, Deborah Cobb-Clark, Tue Gørgens and Anastasia Sartbayeva (2009) Does the Effect of Incentive Payments on Survey Response Rates Differ by Income Support History? Journal of Official Statistics, 25 (4), 2009, pp. 483–507.

• Thorpe C, Ryan B, McLean SL, Burt A, StewartM, Brown JB, Reid GJ and Harris S. (2009) “How to obtain excellent response rates when surveying physicians”. Family Practice 26: 65–68.

• Ian A. Harris, Oliver K. Khoo, Jane M. Young, Michael J. Solomon, Hamish Rae (2008) “Lottery incentives did not improve response rate to a mailed survey: a randomized controlled trial.” Journal of Clinical Epidemiology 61:609-610.

• Daniel R. Petrolia, Sanjoy Bhattacharjee (2009) “Revisiting Incentive Effects Evidence From A Random-Sample Mail Survey On Consumer Preferences For Fuel Ethanol.” Public Opinion Quarterly, 73 (3): 537–550.

• Curtin R, Singer E, Presser S. Incentives in RDD telephone surveys: a replication and extension. J Off Stat. 2007;23(1):91-105.

• Trussell, Norm and Paul J. Lavrakas. “The Influence of Incremental Increases in Token Cash Incentives on Mail Survey Response: Is There an Optimal Amount?” Public Opinion Quarterly  68.3 (2004): 349-367.

June 29: Existing health survey data sets and Incentives

• Quiz 2

• Widely used Epidemiology modules (e.g. CAHPS)

• BRFSS, NHIS, NIS, ADD HEALTH

• Estimating Cost

• Things to include in a Contract

• Incentives

Readings for July 13th PDF files located at

• Makela, P. (2003). "Impact of correcting for nonresponse by weighting on estimates of alcohol consumption." Journal of Studies on Alcohol 64(4): 589-596.

• Nordholt, E. S. (1998). "Imputation: Methods, simulation experiments and practical examples." International Statistical Review 66(2): 157-180.

• Ciol, M. A., J. M. Hoffman, et al. (2006). "Understanding the use of weights in the analysis of data from multistage surveys." Archives of Physical Medicine and Rehabilitation 87(2): 299-303.

• Patrician, P. A. (2002). "Multiple imputation for missing data." Research in Nursing & Health 25(1): 76-84.

• Andrew Kmetic, Lawrence Joseph, Claudie Berger, and Alan Tenenhouse (2002) Multiple Imputation to Account for Missing Data in a Survey: Estimating the Prevalence of Osteoporosis. Epidemiology. 13:437-444.

July 6: Interviewing Shift

July 13: Analyzing Survey Data

• Quiz 3

• Analyzing Data

• What is Weighting and How to Do It

• Stratified and quota samples

• Imputation for Missing Values

• Case Study -- Hurricane

Readings for July 20 PDF files located at

• Ware JE, Gandek B (1998) Overview of the SF-36 Health Survey and the International Quality of Life Assessment (IQOLA) Project. Journal of Clinical Epidemiology 51(11) 903-912

• Deron C. Burton, Brendan Flannery, Bernard Onyango, Charles Larson, Jane Alaii, Xingyou Zhang, Mary J. Hamel, Robert F. Breiman, and Daniel R. Feikin, (2011) Healthcare-seeking Behaviour for Common Infectious Disease-related Illnesses in Rural Kenya: A Community-based House-to-house Survey. Journal of Health, Population and Nutrition. 29(1)-61-70.

• Caraceni A, Portenoy RK (1999) An international survey of cancer pain characteristics and syndromes. Pain. 82(3): 263-274

• DHSIII Sampling Manual

• H Russell Bernard, Tim Hallett, Alexandrina Iovita, Eugene C Johnsen, Rob Lyerla, Christopher McCarty, Mary Mahy, Matthew J Salganik, Tetiana Saliuk, Otilia Scutelniciuc, Gene A Shelley, Petchsri Sirinirund, Sharon Weir, Donna F Stroup. “Counting hard-to-count populations: the network scale-up method for public health” Sexually Transmitted Infections, 2010 86: ii11-ii15. (2010)

• Salganik MJ, Heckathorn DD (2004) Sampling and estimation in hidden populations using respondent-driven sampling Sociological Methodology. 34: 193-239

• Zhang D, Wang L, Lv F, et al. (2007) Advantages and challenges of using census and multiplier methods to estimate the number of female sex workers in a Chinese city AIDS Care-Psychological And Socio-Medical Aspects Of AIDS/HIV 19(1): 17-19

July 20: Doing Surveys Internationally, hard-to-count populations

• International surveys (DHS),

• Surveys in developing countries

• Capture-Recapture

• Mutliplier Method

• Respondent Driven Sampling

• Network Scale-up

Readings for July 27th PDF files located at

• Stephen P. Borgatti, Ajay Mehra, Daniel J. Brass, Giuseppe Labianca (2009) Network Analysis in the Social Sciences, Science 323: 892-895

• Peter Marsden (1990) Network data and measurement Annual Review of Sociology 16:435-463

July 27: Social Network Analysis and the IRB

• IRB

• Introduction to social networks

• Whole networks versus personal networks

• One-mode versus two-mode

August 3: Student Presentations

................
................

In order to avoid copyright disputes, this page is only a partial summary.

Google Online Preview   Download