Research a quantitative tool or design a tool that you can use to help you answer your evaluation question?((Are the program services/groups beneficial to the target population)) (( Questionnaire)) Discuss what stakeholders you engaged to identify these quantitative measures. How will these tools help you answer your evaluation question?
**Refer to susonc.org for more info about the organization**
**Example #1: This week I researched measures that Post Adoption is already using for before and after their weekly group therapy sessions, Learning and Empowerment for Adoptive Families (LEAF). I engaged the stakeholders who designed this questionnaire, Dr. Kate Murray, the director of Post Adoption, and the program coordinator, Breanna Williams.
The measures use a Likert scale to determine the participants’ comfort level with talking about adoption with their children, discussing feelings of loss with their child around their adoption, and dealing with their child’s difficult emotions surrounding their adoption. The questionnaire also measures the parent’s perspective of their child using a Likert scale, and measures whether they feel that their child holds back their true feelings about adoption, has coping skills to calm themselves, feels shame or pride around their adoption, and whether the parent is confident that they can respond effectively to their child. A second measure gauges how comfortable parents feel in general about their child’s feelings around their adoption, such as ignoring their child’s sadness, or trying to push them into a more cheerful mood, or their comfort level with their child feeling angry or sad. These measures help us understand how their family responds to stress in general, and both how their child feels about their adoption and how the parent responds to those feelings.
The next LEAF session is in the underrepresented region. I would like to add some other questions to understand the unique challenges to the people in that region and our services. If I was doing a quantitative survey, my additional questions would be:
How comfortable are you accessing the services of Post Adoption?
Very comfortable, comfortable, not comfortable
How does distance affect your interest in accessing Post Adoption services?
Very important, important, not important
Are there other services in your community that you use as Post Adoption support?
There are many services to choose from, there are some services, there are services but I rarely use them, there are no services
In general, I feel good about the support (LEAF, therapy, assessments, medication management) that Post Adoption provides:
Very good, Good, Ok, Not great
I feel that the Likert method will tell me more about why this region is underrepresented. My hypothesis is that it is due to geographical distance from the Center for Child and Family Health, or that there are other services in the community that people feel comfortable using, such as an adoption ministry. It is my hope that we can shape our programming based on the responses.
Example #2: Quantitative methods in evaluation are concerned with “what”, “who”, and “when”, generating data that quantifies impact and provides the “bottom line” (W.K. Kellogg Foundation, 2017, p. 145). The W.K. Kellogg Foundation (2017) emphasizes that it is best to use quantitative methods when inquiring on who participates and benefits from the program, what they learned or got from the program, what changes were brought about by the program, and when those changes occurred (p. 145). The most common types of quantitative tools for evaluation include surveys, tests, and assessments. Types of survey methods include by mail, telephone, internet or web-based, handouts, and face-to-face. By using a quantitative internet or web-based survey, I will be able to use closed-ended questions to help answer the evaluation question of “Do daily huddle meetings improve service delivery and morale within the Case Management Department of Duke Raleigh Hospital?”. These surveys will serve the purpose of getting the department staff to elaborate on their feelings of the effectiveness of the daily huddle meetings and provide stakeholders with data that can be used to improve the meetings. Administering an internet or web-based survey will also allow me to receive results quickly. Stakeholders that were engaged to identify which quantitative measure would be the most successful were the program manager, program director, and a few of the staff members. They believe that this method could be successful being that the participants are computer savvy and the survey will be relatively short. I would like to use Qualtrics to administer the survey and evaluate results. A few of the items that will be included in the survey are as follows:
I enjoy the daily huddle meetings.
The purpose of the daily huddle meetings has been explained to me
The daily huddle meetings are held consistently every working day
The daily huddle meetings have improved my service delivery with clients
The daily huddle meetings have improved morale among the department staff
Response choices for the survey will be based on an Agreement Likert scale. Responses will include choices such as:
Neither agree or disagree