Jump to ContentJump to Main Navigation
Show Summary Details
More options …

Journal of Official Statistics

The Journal of Statistics Sweden

4 Issues per year

IMPACT FACTOR 2016: 0.411
5-year IMPACT FACTOR: 0.776

CiteScore 2016: 0.63

SCImago Journal Rank (SJR) 2016: 0.710
Source Normalized Impact per Paper (SNIP) 2016: 0.975

Open Access
See all formats and pricing
More options …

Evaluating the Efficiency of Methods to Recruit Asian Research Participants

Hyunjoo Park
  • Corresponding author
  • Center for Survey Methodology, Survey Research Division at RTI International, 351 California Street, Suite 500, San Francisco, CA 94104, U.S.A.
  • Email
  • Other articles by this author:
  • De Gruyter OnlineGoogle Scholar
/ M. Mandy Sha
Published Online: 2014-05-08 | DOI: https://doi.org/10.2478/jos-2014-0020


Few empirical studies have evaluated the efficiency of recruitment methods to recruit non- English-speaking research participants. We attempt to fill this research gap by conducting a systematic evaluation using recruitment data from a large cognitive testing study that pretested the translations of the American Community Survey. In our study we contacted 1,084 Chinese and Korean speakers to identify those who spoke little or no English. We measured the efficiency of the recruitment methods (newspaper advertisements, flyers, online communication, and word of mouth) using four criteria: time spent, outreach capacity, screener completion, and eligibility rate. We also examined differences in recruitment efficiencies by recruiters and sublanguage groups. Among the recruitment methods examined, newspaper advertisements were most efficient in reaching a larger number of Asians while using the least amount of recruiters’ time. For recruiting non-English speakers, word of mouth by recruiters with strong ties to the ethnic community worked best.

Keywords: Community-based recruitment; recruitment efficiency; cognitive interview


  • Appel, L.J., Vollmer, W.M., Obarznek, E., Aicher, K.M., Conlin, P.R., Kennedy, B.M., Chaleston, J.B., Reams, P.M., and the DASH Collaborative Research Group (1999). Collaborative Research Group Recruitment and Baseline Characteristics of Participants in the Dietary Approaches to Stop Hypertension Trial. Journal of the American Dietetic Association, 99, S69-S75, DOI: http://www.dx.doi.org/10.1016/ S0002-8223(99)00419-8.CrossrefGoogle Scholar

  • Area´n, P.A., and Gallagher-Thompson, D. (1996). Issues and Recommendations for the Recruitment and Retention of Older Ethnic Minority Adults into Clinical Research. Journal of Consulting and Clinical Psychology, 64, 875-880.Google Scholar

  • Berrigan, D., Forsyth, B.H., Helba, C., Levin, K., Norberg, A., and Willis, G. (2010).Google Scholar

  • Cognitive Testing of Physical Activity and Acculturation Questions in Recent and Long-Term Latino Immigrants. BioMed Central Public Health, 10(481). Available at: http://www.biomedcentral.com/content/pdf/1471-2458-10-481.pdf (accessed March 2012).Web of ScienceGoogle Scholar

  • Bistricky, S.L., Mackin, R.S., Chu, J.P., and Arean, P.A. (2010). Recruitment of African Americans and Asian Americans with Late Life Depression and Mild Cognitive Impairment. American Journal of Geriatric Psychiatry, 18, 734-742.CrossrefGoogle Scholar

  • Coleman, E.A., Tyll, L., LaCroix, A.Z., Allen, C., Leveille, S.G., Wallace, J.I., Buchner, D.M., Grothaus, L.C., and Wagner, E.H. (1997). Recruiting African- American Older Adults for a Community Based Health Promotion Intervention: Which Methods Are Effective? American Journal of Preventive Medicine, 13, 51-56.PubMedGoogle Scholar

  • Flanagin, A.J., and Metzger, M.J. (2000). Perceptions of Internet Information Credibility. Journalism and Mass Communication Quarterly, 73, 515-540.Google Scholar

  • Forsyth, B.H., Kudela, M.S., Levin, K., Lawrence, D., and Willis, G. (2007). Methods for Translating an English-Language Survey Questionnaire on Tobacco Use into Mandarin, Cantonese, Korean and Vietnamese. Field Methods, 19, 264-283.Google Scholar

  • Fujimoto, W.Y. (1998). Community Involvement and Minority Participation in Clinical Research. Diabetes Spectrum, 11, 161-166.Google Scholar

  • Gilliss, C.L., Lee, K.A., Gutierrez, Y., Taylor, D., Beyene, Y., Neuhaus, J., and Murrell, N. (2001). Recruitment and Retention of Healthy Minority Women into Community-based Longitudinal Research. Journal of Women’s Health Gender Based Medicine, 10, 77-85, DOI: http://www.dx.doi.org/10.1089/152460901750067142.CrossrefGoogle Scholar

  • Gorelick, P.B., Richardson, D., Hudson, E., Perry, C., Robinson, D., Brown, N., and Harris, Y. (1996). Establishing a Community Network for Recruitment of African Americans into a Clinical Trial. The African American Antiplatelet Stroke Prevention Study (AAASPS) Experience. Journal of the National Medical Association, 88, 701-704.Google Scholar

  • Harris, K.J., Ahluwalia, J.S., Catley, D., Okuyemi, K.S., Mayo, M.S., and Resnicow, K. (2003). Successful Recruitment of Minorities into Clinical Trials: The Kick It at Swope Project. Nicotine Tobacco Research, 5, 575-584.CrossrefGoogle Scholar

  • Holcombe, R.F., Jacobson, J., Li, A., and Moinpour, C.M. (1999). Inclusion of African Americans in Oncology Clinical Trials. American Journal of Clinical Oncology, 22, 18-21.CrossrefGoogle Scholar

  • Hughes, C., Peterson, S., Ramirez, A., Gallion, K., McDonald, P.G., Skinner, C.S., and Bowen, D. (2004). Minority Recruitment in Hereditary Breast Cancer Research. Cancer Epidemiology Biomarkers Prevention, 13, 1146-1155.Google Scholar

  • Kim, J., and Zapata, J. (2012). 2010 Census Language Program Assessment Report. 2010 Census Planning Memoranda Series, No. 204. Washington, DC: U.S. Census Bureau. Available at: http://www.census.gov/2010census/pdf/2010_Census_Language_Program_Assessment.pdf (accessed March 2013).Google Scholar

  • Koo, M., and Skinner, H. (2005). Challenges of Internet Recruitment: A Case Study with Disappointing Results. Journal of Medical Internet Research, 7, E6, DOI: http://www.dx.doi.org/10.2196/jmir.7.1.e6.Google Scholar

  • Lau, A., and Gallagher-Thompson, D. (2002). Ethnic Minority Older Adults in Clinical and Research Programs: Issues and Recommendations. The Behavior Therapist, 25, 10-11.Google Scholar

  • Lai, G.Y., Gary, T.L., Tilburt, J., Bolen, S., Baffid, C., Wilson, R.F., Howerton, M.W., Gibbson, M.C., Tanpitukpongsee, T.P., Powe, N.R., Bass, E.B., and Ford, J.G. (2006). Effectiveness of Strategies to Recruit Underrepresented Populations into Cancer Clinical Trials. Clinical Trials, 3, 133-141. DOI: http://dx.doi.org/10.1191/1740774506cn143oa.CrossrefGoogle Scholar

  • Liu, L., Sha, M., and Park, H. (2013). Exploring the efficiency and utility of methods to recruit non-English speaking qualitative research participants. Survey Practice, 6(3), 1-8. Available at: http://www.surveypractice.org/index.php/SurveyPractice (accessed December 2013).Google Scholar

  • Markus, H.R., and Kitayama, S. (1991). Culture and the Self: Implications for Cognition, Emotion, and Motivation. Psychological Review, 20, 568-579.Google Scholar

  • Maxwell, A.E., Bastani, R., Vida, P., and Warda, S. (2005). Strategies to Recruit and Retain Older Filipino-American Immigrants for a Cancer Screening Study. Journal of Community Health, 30, 167-179. DOI: http://www.dx.doi.org/10.1007/s10900-004-1956-0.CrossrefGoogle Scholar

  • McLean, C., and Campbell, C. (2003). Locating Research Informants in a Multi-ethnic Community: Ethnic Identities, Social Networks and Recruitment Methods. Ethnicity and Health, 8, 41-61.Google Scholar

  • Pan, Y., Landreth, A., Hinsdale, M., Park, H., and Schoua-Glusberg, A. (2007). Methodology for Cognitive Testing of Translations in Multiple Languages. In Proceedings of the Section on Survey Research Methods, Annual Conference of the American Association, 3801-3808 (Alexandria, VA, July 29-August 2, 2007).Google Scholar

  • Park, H., Liu, L., and Sha, M. (2011). Do Different Recruitment Methods Reach Different People? Annual Conference of the American Association (Phoenix, AZ, May 12-15, 2011).Google Scholar

  • Reed, P.S., Foley, K.L., Hatch, J., and Mutran, E.J. (2003). Recruitment of Older African Americans for Survey Research: A Process Evaluation of Community and Church-based Strategy in the Durham Elders Project. The Gerontologist, 43, 52-61. DOI: http://www.dx.doi.org/10.1093/geront/43.1.52.CrossrefGoogle Scholar

  • Sha, M., McAvinchey, G., Reed, L., Rodriguez, S., and Carter, G. (2010). Respondent Recruitment, Interviewing, and Training: Lessons Learned From a Spanish Language Cognitive Interviewing Project. In Proceedings of the Section on Survey Research Methods, Annual Conference of the American Association, 6372-6381 (Alexandria VA, May 13-16, 2010).Google Scholar

  • Stoy, D.B., Curtis, R.C., Dameworth, K.S., Dowdy, A.A., Hegland, J., Levin, J.A., and Sousoulas, B.G. (1995). The Successful Recruitment of Elderly Black Subjects in a Clinical Trial: The CRISP Experience. Cholesterol Reduction in Seniors Program. Journal of the National Medical Association, 87, 280-287.Google Scholar

  • The DPP Research Group (2002). The Diabetes Prevention Program: Recruitment Methods and Results. Controlled Clinical Trials, 23, 157-171. DOI: http://www.dx.doi.org/10.1016/S0197-2456(01)00184-2.CrossrefGoogle Scholar

  • Wellens, T. (1994). The Cognitive Evaluation of the Nativity Questions for the Current Population Survey. In Proceedings of the Section on Survey Research Methods, Annual Conference of the American Association, 1204-1209 (Alexandria, VA, May 11-15, 1994).Google Scholar

  • Wisdom, K., Neighbors, K., Williams, V.H., Havstad, S.L., and Tilley, B.C. (2002). Recruitment of African Americans with Type 2 Diabetes to a Randomized Controlled Trial Using Three Sources. Ethnic Health, 7, 267-278. Google Scholar

  • Yancey, A.K., Ortega, A.N., and Kumanyika, S.K. (2006). Effective Recruitment and Retention of Minority Research Participants. Annual Review of Public Health, 27, 1-28, DOI: http://www.dx.doi.org/10.1146/annurev.publhealth.27.021405.102113.CrossrefWeb of ScienceGoogle Scholar

  • Yuan, Y.M., Wake, V., Park, H., and Nguyen, L. (2009). Conducting Cognitive Interviews with Linguistically Isolated Asian Populations. Presented in the 43rd International Field Directors and Technologies conference (Delray Beach, FL, May 17-20, 2009). Google Scholar

About the article

Received: 2013-02-01

Accepted: 2013-11-01

Published Online: 2014-05-08

Published in Print: 2014-06-01

Citation Information: Journal of Official Statistics, Volume 30, Issue 2, Pages 335–354, ISSN (Online) 2001-7367, DOI: https://doi.org/10.2478/jos-2014-0020.

Export Citation

© by Hyunjoo Park . This article is distributed under the terms of the Creative Commons Attribution Non-Commercial License, which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited. BY-NC-ND 3.0

Citing Articles

Here you can find all Crossref-listed publications in which this article is cited. If you would like to receive automatic email messages as soon as this article is cited in other publications, simply activate the “Citation Alert” on the top of this page.

Joanna T. W. Chu, Alice Wan, Sunita M. Stewart, Kwok Tung Ng, Tai Hing Lam, and Sophia S. Chan
Frontiers in Public Health, 2018, Volume 6
Hyunjoo Park, M. Mandy Sha, and Gordon Willis
Field Methods, 2016, Volume 28, Number 4, Page 415

Comments (0)

Please log in or register to comment.
Log in