Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter March 1, 2013

Evaluation of project P.A.T.H.S. by the program implementers: findings based on the extension phase

Daniel T.L. Shek and Rachel C.F. Sun

Abstract

A total of 236 schools participated in the Project P.A.T.H.S. in the 2010/2011 school year. After completion of the Tier 1 Program, subjective outcome evaluation data were collected from 3275 program implementers. Based on the consolidated findings based on schools as units, results showed that participants had positive perceptions of the program, implementers, and benefits of the program. More than four-fifths of the implementers regarded the program as helpful to the program participants. Multiple regression analysis revealed that perceived qualities of the program and the program implementers predicted perceived effectiveness of the program. Grade differences were not significant. The present study provides additional support for the effectiveness of the Tier 1 Program of the Project P.A.T.H.S. in Hong Kong.


Corresponding author: Professor Daniel T.L. Shek, PhD, FHKPS, BBS, JP, Chair Professor of Applied Social Sciences, Faculty of Health and Social Sciences, Department of Applied Social Sciences, The Hong Kong Polytechnic University, Room HJ407, Core H, Hunghom, Hong Kong, P.R. China, E-mail:

The preparation of this paper and the Project P.A.T.H.S. were financially supported by The Hong Kong Jockey Club Charities Trust.

References

1. Holcomb WR, Adams NA, Ponder HM, Reitz R. The development and construction validation of a consumer satisfaction questionnaire for psychiatric patients. Eval Program Plann 1989;12:189–94.10.1016/0149-7189(89)90010-4Search in Google Scholar

2. Lebow JL. Research assessing consumer satisfaction with mental health treatment: a review of findings. Eval Program Plann 1982;6:211–36.10.1016/0149-7189(83)90003-4Search in Google Scholar

3. Lebow JL. Assessing consumer satisfaction in mental health treatment settings: a guide for the administrator. Adm Ment Health 1984;12:3–14.10.1007/BF00818533Search in Google Scholar

4. McMurty SL, Hudson WW. The Client Satisfaction Inventory: results of an initial validation study. Res Soc Work Pract 2000;10:644–63.10.1177/104973150001000506Search in Google Scholar

5. Sultan P, Wong HY. Service quality in higher education – a review and research agenda. Int J Qual Serv Sci 2010;2:259–72.10.1108/17566691011057393Search in Google Scholar

6. Casas F, Cornejo JM, Colton M, Scholte E. Perceptions of stigmatization and satisfaction with services received, among users of social welfare services for the child and the family in 3 European regions. Soc Indic Res 2000;51:287–308.10.1023/A:1007026228053Search in Google Scholar

7. Roberts MC, Steele RG. Program evaluation approaches to service delivery in child and family mental health. In: Steel RG, Roberts MC, editors. Handbook of mental health services for children, adolescents, and families. New York: Kluwer Academic/Plenum, 2005:351–69.Search in Google Scholar

8. Jimmieson NL, Griffin MA. Linking client and employee perceptions of the organization: a study of client satisfaction with health care services. J Occup Organ Psychol 1998;71: 81–96.10.1111/j.2044-8325.1998.tb00664.xSearch in Google Scholar

9. Lazicki TA, Vernberg EM, Roberts MC, Benson ER. Satisfaction with components of the therapeutic model: perspectives of consumers and professionals. J Child Fam Stud 2008;17: 264–76.10.1007/s10826-007-9152-3Search in Google Scholar

10. Rapee RM, Wignall A, Sheffield J, Kowalenko N, Davis A, et al. Adolescents’ reactions to universal and indicated prevention programs for depression: perceived stigma and consumer satisfaction. Prev Sci 2006;7:167–77.10.1007/s11121-006-0035-4Search in Google Scholar

11. Lippman LH, Moore KA, MeIntosh H. Positive indicators of child well-being: a conceptual framework, measures, and methodological issues. Appl Res Qual Life 2011;6:425–49.10.1007/s11482-011-9138-6Search in Google Scholar

12. Collins ME, Lemon C, Street E. A consumer view of teen living programs: teen parents’ satisfaction with program components and services. Fam Soc 2000;81:284–93.10.1606/1044-3894.1019Search in Google Scholar

13. Viale-Val G, Rosenthal RH, Curtiss G, Marohn RC. Dropout from adolescent psychotherapy: a preliminary study. J Am Acad Child Psychiatry 1984:23:562–8.10.1016/S0002-7138(09)60347-2Search in Google Scholar

14. Garland AF, Saltzman MD, Aarons GA. Adolescent satisfaction with mental health services: development of a multidimensional scale. Eval Program Plann 2000;23:165–75.10.1016/S0149-7189(00)00009-4Search in Google Scholar

15. Shek DTL, Siu AMH, Lee TY. Subjective outcome evaluation of the Project P.A.T.H.S.: findings based on the perspective of the program implementers. ScientificWorldJ 2007;7:195–203.10.1100/tsw.2007.43Search in Google Scholar

16. Patton MQ. Utilization-focused evaluation: the new century text. Thousand Oaks, CA: Sage, 1997.Search in Google Scholar

17. Osterman KF, Kottkamp RB. Reflective practice for educators. Thousand Oaks, CA: Corwin Press, 2004.Search in Google Scholar

18. Taggart GL, Wilson AP. Promoting reflective thinking in teachers: 44 action strategies. Thousand Oaks, CA: Corwin Press, 1998.Search in Google Scholar

19. Shek DTL, Ma HK, Merrick J. Effectiveness of the Project P.A.T.H.S. in Hong Kong: evaluation based on different strategies and different studies over time. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/427801. Accessed on March 10, 2012.10.1100/2012/427801Search in Google Scholar

20. Shek DTL, Sun RCF. Epilogue: The Project P.A.T.H.S. in Hong Kong: lessons learned and implications for positive youth development programs. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/687536. Accessed on March 10, 2012.10.1100/2012/687536Search in Google Scholar

21. Catalano RF, Berglund ML, Ryan JAM, Lonczak HS, Hawkins JD. Positive youth development in the United States: research findings on evaluations of positive youth development programs. Available at: http://aspe.hhs.gov/hsp/PositiveYouthDev99/. Accessed on June 21, 2012.Search in Google Scholar

22. Shek DTL, Ma CMS. Impact of the Project P.A.T.H.S. in the junior secondary school years: objective outcome evaluation based on eight waves of longitudinal data. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/170345. Accessed on March 10, 2012.10.1100/2012/170345Search in Google Scholar

23. Shek DTL, Yu L. Longitudinal impact of the Project P.A.T.H.S. on adolescent risk behavior: what happened after five years. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/316029. Accessed on March 10, 2012.10.1100/2012/316029Search in Google Scholar

24. Shek DTL, Sun RCF. Participants’ evaluation of the Project P.A.T.H.S.: are findings based on different datasets consistent? ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/187450. Accessed on March 10, 2012.10.1100/2012/187450Search in Google Scholar

25. Shek DTL, Ma CMS. Program implementers’ evaluation of the Project P.A.T.H.S.: findings based on different datasets over time. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/918437. Accessed on March 10, 2012.10.1100/2012/918437Search in Google Scholar

26. Shek DTL. Secondary data analyses of subjective outcome evaluation data based on nine databases. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/346369. Accessed on March 10, 2012.10.1100/2012/346369Search in Google Scholar

27. Law BMF, Shek DTL. Process evaluation of a positive youth development program in Hong Kong based on different cohorts. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/736730. Accessed on March 10, 2012.10.1100/2012/736730Search in Google Scholar

28. Shek DTL, Yu L. Interim evaluation of the Project P.A.T.H.S.: findings based on different datasets. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/132826. Accessed on March 10, 2012.10.1100/2012/132826Search in Google Scholar

29. Shek DTL. Qualitative evaluation of the Project P.A.T.H.S.: an integration of findings based on program implementers. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/591816. Accessed on March 10, 2012.10.1100/2012/591816Search in Google Scholar

30. Shek DTL, Sun RCF. Qualitative evaluation of Project P.A.T.H.S.: an integration of findings based on program participants. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/528483. Accessed on March 10, 2012.10.1100/2012/528483Search in Google Scholar

31. Shek DTL, Sun RCF. Evaluation of the Project P.A.T.H.S. based on students’ weekly diaries: findings from eight datasets. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/354254. Accessed on March 10, 2012.10.1100/2012/354254Search in Google Scholar

32. Shek DTL. Evaluation of a positive youth development program based on the repertory grid test. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/372752. Accessed on March 10, 2012.10.1100/2012/372752Search in Google Scholar

33. Shek DTL, Lee TY. Helping adolescents with greater psychosocial needs: subjective outcome evaluation based on different cohorts. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/694018. Accessed on March 10, 2012.10.1100/2012/694018Search in Google Scholar

34. Shek DTL, Ma CMS. Subjective outcome evaluation of the project P.A.T.H.S. in different cohorts of students. ScientificWorldJ 2013. Available at: http://dx.doi.org/10.1100/2012/493957.10.1100/2012/493957Search in Google Scholar

35. Shek DTL, Sun RCF. Evaluation of the Project P.A.T.H.S. (Extension Phase) based on the perspective of the program participants. Int J Adolesc Med Health 2013;25:405–13.10.1515/ijamh-2013-0038Search in Google Scholar

36. Peterson A, Esbensen FA. The outlook is G.R.E.A.T. What educators say about school-based prevention and the Gang Resistance Education and Training (G.R.E.A.T.) Program Eval Rev 2004;28:218–45.10.1177/0193841X03262598Search in Google Scholar

37. Shek DTL, Sun RCF. Subjective outcome evaluation of the Project P.A.T.H.S.: qualitative findings based on the experiences of program implementers. ScientificWorldJ 2007;7: 1024–35.10.1100/tsw.2007.161Search in Google Scholar

38. Shek DTL, Ma CMS, Tang CYP. Predictors of subjective outcome evaluation findings in a positive youth development program in Hong Kong. Int J Disabil Hum Dev 2011;10:249–55.10.1515/ijdhd.2011.040Search in Google Scholar

39. Shek DTL, Sun RCF, Merrick J. Training programs and implementation process of positive youth development programs. Int J Adolesc Med Health 2011;23:303–4.10.1515/IJAMH.2011.025Search in Google Scholar

40. Shek DTL. Quality of life research: responses to emerging issues in a changing world. Soc Indic Res 2011;100:371–4.10.1007/s11205-010-9628-1Search in Google Scholar

Received: 2012-5-10
Accepted: 2012-6-10
Published Online: 2013-03-01
Published in Print: 2013-12-01

©2013 by Walter de Gruyter Berlin Boston