Program Evaluation Worksheet

Name of Student: Dawn Ahrens

Names of Group Members: N/A

 
Read the following case study, review the data sets, and answer the subsequent questions.
Case Study
Steven is a Licensed Professional Counselor who works for a community mental health center providing a psychoeducation group on stress management and anxiety reduction. The goals of the program are for members to increase coping strategies for daily life stressors and reduce their current level of anxiety. Steven holds weekly psychotherapy group meetings on Wednesdays at noon in a conference room at the mental health center. The therapy group is a closed group that runs continuously in 8-week intervals. Clients are referred to the group by therapists, physicians, and clergy. Inclusion criteria to participate in the group include formal referral and a Beck Anxiety Inventory Score of 22 or higher.
In an effort to determine whether the services are meeting the needs of the clients, Steven has conducted a Program Evaluation and collected pre- and post-test program data from three sets of group participants. His findings will be used to determine renewal of his program. Analyze the following quantitative and qualitative data and determine whether enough evidence exists to rule the program as effective and make one recommendation regarding the future of the program.
Pre-Test Data
Beck Anxiety Inventory (BAI) Pre-Intervention Scores

Group 1		Group 2	Group 3
1	25	22	31
2	24	24	30
3	22	24	30
4	22	27	29
5	27	22	28
6	28	33	24
7	25	36	24
8	25	33	22
9	29	32	27
10	24	27	28

 
Post-Test Data
Beck Anxiety Inventory (BAI) Post Intervention Scores

Group 1		Group 2	Group 3
1	25	21	30
2	16	20	20
3	21	22	19
4	20	18	24
5	21	20	22
6	19	23	21
7	22	34	21
8	24	33	20
9	28	30	20
10	24	22	18

 
Post-Intervention Qualitative Survey Responses
Question: Do you feel that participating in this group helped you feel better prepared to cope with daily life stressors?

Group 1		Group 2	Group 3
1	Y	Y	Y
2	N	N	Y
3	Y	Y	Y
4	Y	Y	Y
5	Y	Y	Y
6	N	Y	N
7	N	Y	Y
8	Y	Y	N
9	Y	N	N
10	Y	Y	Y

 

What is the purpose of Steven’s Program Evaluation?	The goals of the program are for members to increase coping strategies for daily life stressors and reduce their current level of anxiety. The purpose of Steven’s study was to determine if his psychoeducation group on stress management and anxiety reduction meets the needs of the clients.
What is the population of interest and who are the stakeholders for this Program Evaluation?	The population of interest are the clients. The potential stakeholders are the clients, therapists/clinician, physicians, and clergy and administration
Compute the mean BAI scores pre- and post-intervention.	Pre-Intervention			Post-Intervention
	G 1	G2	G3	G1	G2	G3
	25	24	21	22	24	21
	Total Pre-Test Mean			Total Post-Test Mean
What is the median BAI score pre- and post-intervention?	Pre-Intervention Median			Post-Intervention Median
	G1	G2	G3	G1	G2	G3
	Total Pre Test Median			Total Post Test Median

1.    Quantitative: According to the scoring criteria for the BAI, a score of 21 or below indicates very low anxiety. What percentage of each group’s scores falls below that clinical cutoff?     2.    Qualitative: Based on the qualitative responses, what percentage of the participants articulated a feeling of improvement?	Group 1		Group 2			Group 3
	Pre	Post	Pre	Post		Pre	Post
	0%		0%			0%
	Mean of Total Percentage of Improvement for all 3 Groups
	1		2		3
What trends to you observe when you compare the quantitative data with the qualitative data?
Based on the information provided, was the intervention effective for reducing anxiety? Why or why not? What was the most critical data that informed your decision?
Describe one recommendation that you would make for the assessing program effectiveness going forward and explain your rationale.(An improvement for the evaluation, not the program.)
Based on your data analysis, describe one recommendation that you would make for the design of the intervention program going forward and explain your rationale.(An improvement for the therapy group, not the program.)