Survey Design and Analysis
Students can work individually or in a group of two to design an original survey on a public policy topic, collect primary data from at least 30 respondents, analyze the results, and communicate findings through a brief report (or infographic) and oral presentation. This assignment provides hands-on experience with survey methodology, including questionnaire design, data collection, descriptive analysis, and effective communication of research findings.
Evaluation Criteria:
- Survey Design Quality (30%): (1) Questions are clear and appropriate to achieve the research objective. (2) Survey includes at least five different question types with logical flow and ordering. (3) Survey design demonstrates understanding of survey methodology principles covered in class. (4) Survey duration does not exceed 10 minutes.
- Data Collection and Analysis (25%): (1) Met minimum response requirement (30+ respondents). (2) Appropriate descriptive statistics are calculated and presented. (3) Data are accurately interpreted and analyzed. (4) Limitations in sampling or response rate are acknowledged.
- Communication and Visualization (25%): (1) Report/infographic is visually appealing, professionally formatted, and easy to read. (2) Data visualizations effectively tell the fullest story and apply visualization principles. (3) Content is accessible to a non-expert audience. (4) Writing is clear, concise, and free of grammatical errors. (5) All required submission materials are provided in correct formats.
- Policy Relevance and Implications (20%): (1) Survey addresses a meaningful public policy issue relevant to North Carolina. (2) Findings are connected to policy implications in a thoughtful and specific manner. (3) Recommendations or conclusions are supported by the data collected.
There are four components of this assignment.
1. Survey Design
Students will submit the link to their survey two weeks before the scheduled survey result presentation. The survey itself will be reviewed and graded based on its quality, so it is essential to ensure that it is well-designed and adheres to the guidelines provided during class lectures.
All surveys must be created using Qualtrics. Each survey should incorporate at least five different question types, such as multiple choice, Likert scale, slider, ranking, and matrix questions, to demonstrate a range of survey design techniques. Students may include only one open-ended question, which may be designated as optional for respondents.
The target population for your survey should be defined such that your classmates would be able to respond meaningfully to the questions. For example, your survey might explore topics that local governments, state governments, or universities would be interested in understanding, ensuring that the subject matter is relevant and accessible to your peers.
2. Survey Completion
Survey links will be made available on Moodle two weeks before the presentation. Within three days of this release, you will need to complete your classmates' surveys. This is a participation grade. The number of surveys you did not complete will be prorated from your final grade.
3. Brief Report
Students will produce a report or infographic in PDF format (approximately 600–1,500 words) presenting their survey findings. The document should be tailored for a non-expert audience, such as policymakers or community stakeholders, emphasizing clarity, relevance, and actionable insights.
The report must include a minimum of three and a maximum of nine data visualizations (either charts or tables). Visualizations should be clearly labeled, appropriately formatted, and directly tied to a key finding or analytical question discussed in the text. Visualizations should be selected to communicate insights effectively rather than to exhaustively display all results.
Example reports and infographics are available here: Google Drive folder.
The report should include (but not limited to):
- A statement of the issue, question and research objectives
- A brief description of the survey design and sampling approach
- The response rate achieved
- Descriptive statistics with data visualizations sufficient to tell the fullest story while applying data visualization principles covered in class
- Findings and/or implications of the analysis
Students should discuss the survey findings' relevance for policy decisions or recommendations and acknowledge any limitations in sampling, response rate, or methodology.
Required Submission Materials: The survey instrument as a PDF export from Qualtrics and the raw dataset as an Excel file exported from Qualtrics. An AI use statement is required.
Presentation
Each student will deliver a 8–14 minute presentation with slides, including Q&A, clearly communicating the survey purpose, methods, key findings, and policy implications to the intended audience.
The suggested presentation structure includes:
- Introduction (1–2 minutes): Cover the policy issue, research purpose, and target population
- Methods (approximately 1 minute): Describe the survey design and data collection approach
- Findings (3–4 minutes): Present key results with data visualizations
- Implications (1–2 minutes): Discuss policy implications, recommendations, and limitations
- Q&A (2–3 minutes): Address audience questions
Students are encouraged to rehearse their presentations to ensure effective time management and clear delivery. You must submit your presentation slides before the presentation. Reading speaking notes or scripts verbatim will result in a very low grade. An AI use statement is required.