Fidelity monitoring across the seven studies in the Consortium of Hospitals Advancing Research on Tobacco (CHART)
More details
Hide details
Ohio State University, College of Nursing, Columbus, USA
VA Center for Clinical Management Research, HSR&D Center of Excellence, Ann Arbor, USA
Department of Family Medicine and Public Health, University of California, La Jolla, USA
Kaiser Permanente Center for Health Research, Portland, USA
Division of Pulmonary Medicine, University of Alabama at Birmingham, Birmingham, USA
Moores Cancer Center, University of California, La Jolla, USA
Department of Population Health, New York University School of Medicine, New York, USA
Department of Preventive Medicine and Public Health, University of Kansas Medical Center, Kansas City, USA
Department of Medicine, Vanderbilt University School of Medicine, Nashville, USA
University of Michigan, Internal Medicine, Brehm Tower, Ann Arbor, USA
Submission date: 2015-04-15
Acceptance date: 2015-08-20
Publication date: 2015-09-03
Corresponding author
Sonia A. Duffy   

Ohio State University, College of Nursing, Newton Hall, 1585 Neil Ave, Columbus, OH 43210, USA
Tobacco Induced Diseases 2015;13(September):29
This paper describes fidelity monitoring (treatment differentiation, training, delivery, receipt and enactment) across the seven National Institutes of Health-supported Consortium of Hospitals Advancing Research on Tobacco (CHART) studies. The objectives of the study were to describe approaches to monitoring fidelity including treatment differentiation (lack of crossover), provider training, provider delivery of treatment, patient receipt of treatment, and patient enactment (behavior) and provide examples of application of these principles.

Conducted between 2010 and 2014 and collectively enrolling over 9500 inpatient cigarette smokers, the CHART studies tested different smoking cessation interventions (counseling, medications, and follow-up calls) shown to be efficacious in Cochrane Collaborative Reviews. The CHART studies compared their unique treatment arm(s) to usual care, used common core measures at baseline and 6-month follow-up, but varied in their approaches to monitoring the fidelity with which the interventions were implemented.

Treatment differentiation strategies included the use of a quasi-experimental design and monitoring of both the intervention and control group. Almost all of the studies had extensive training for personnel and used a checklist to monitor the intervention components, but the items on these checklists varied widely and were based on unique aspects of the interventions, US Public Health Service and Joint Commission smoking cessation standards, or counselor rapport. Delivery of medications ranged from 31 to 100 % across the studies, with higher levels from studies that gave away free medications and lower levels from studies that sought to obtain prescriptions for the patient in real world systems. Treatment delivery was highest among those studies that used automated (interactive voice response and website) systems, but this did not automatically translate into treatment receipt and enactment. Some studies measured treatment enactment in two ways (e.g., counselor or automated system report versus patient report) showing concurrence or discordance between the two measures.

While fidelity monitoring can be challenging especially in dissemination trials, the seven CHART studies used a variety of methods to enhance fidelity with consideration for feasibility and sustainability.

Trial registration:
- Dissemination of Tobacco Tactics for hospitalized smokers. Clinical Trials Registration No. NCT01309217. - Smoking cessation in hospitalized smokers. Clinical Trials Registration No. NCT01289275. - Using “warm handoffs” to link hospitalized smokers with tobacco treatment after discharge: study protocol of a randomized controlled trial. Clinical Trials Registration No. NCT01305928. - Web-based smoking cessation intervention that transitions from inpatient to outpatient. Clinical Trials Registration No. NCT01277250. - Effectiveness of smoking-cessation interventions for urban hospital patients. Clinical Trials Registration No. NCT01363245. - Comparative effectiveness of post-discharge interventions for hospitalized smokers. Clinical Trials Registration No. NCT01177176. - Health and economic effects from linking bedside and outpatient tobacco cessation services for hospitalized smokers in two large hospitals. Clinical Trials Registration No. NCT01236079.

Korda H. Bringing evidence-based interventions to the field: the fidelity challenge. Journal of Public Health Management and Practice. 2013;19(1):1–3.
Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, et al. Enhancing treatment fidelity in health behavior change studies: Best practices and recommendations from the NIH behavior change consortium. Health Psychol. 2004;23(5):443–51.
Stein KF, Sargent JT, Rafaels N. Intervention research - Establishing fidelity of the independent variable in nursing clinical trials. Nurs Res. 2007;56(1):54–62.
Campbell BK, Manuel JK, Manser ST, Peavy KM, Stelmokas J, McCarty D, et al. Assessing fidelity of treatment delivery in group and individual 12-step facilitation. J Subst Abus Treat. 2013;44:169–76.
Guydish J, Campbell BK, Manuel JK, Delucchi KL, Le T, Peavy M, et al. Does treatment fidelity predict client outcomes in 12-Step Facilitationfor stimulant abuse? Drug Alcohol Depend. 2014;134:330–6.
Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41(3–4):327–50.
Santacroce SJ, Maccarelli LM, Grey M. Intervention fidelity. Nurs Res. 2004;53(1):63–6.
Elliott DS, Mihalic S. Issues in disseminating and replicating effective prevention programs. Prev Sci. 2004;5(1):47–53.
Borrelli B, Sepinwall D, Ernst D, Bellg AJ, Czajkowski S, Breger R, et al. A new tool to assess treatment fidelity and evaluation of treatment fidelity across 10 years of health behavior research. J Consult Clin Psychol. 2005;73(5):852–60.
Borrelli B. The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials. J Public Health Dent. 2011;71:S52–63.
McHugh RK, Murray HW, Barlow DH. Balancing fidelity and adaptation in the dissemination of empirically-supported treatments: The promise of transdiagnostic interventions. Behav Res Ther. 2009;47(11):946–53.
Spillane V, Byrne MC, Byrne M, Leathem CS, O’Malley M, Cupples ME. Monitoring treatment fidelity in a randomized controlled trial of a complex intervention. J Adv Nurs. 2007;60(3):343–52.
Moncher FJ, Prinz RJ. Treatment fidelity in outcome studies. Clin Psychol Rev. 1991;11(3):247–66.
Riley WT, Stevens VJ, Zhu S-H, Morgan G, Grossman D. Overview of the consortium of hospitals advancing research on tobacco (chart). Trials. 2012;13:122.
Duffy SA, Ronis DL, Titler MG, Blow FC, Jordan N, Thomas PL, et al. Dissemination of the nurse-administered Tobacco Tactics intervention versus usual care in six Trinity community hospitals: study protocol for a comparative effectiveness trial. Trials. 2012;13:125.
Cummins S, Zhu S-H, Gamst A, Kirby C, Brandstein K, Klonoff-Cohen H, et al. Nicotine patches and quitline counseling to help hospitalized smokers stay quit: study protocol for a randomized controlled trial. Trials. 2012;13:128.
Grossman E, Shelley D, Braithwaite RS, Lobach I, Goffin A, Rogers E, et al. Effectiveness of smoking-cessation interventions for urban hospital patients: study protocol for a randomized controlled trial. Trials. 2012;13:126.
Harrington KF, McDougal JA, Pisu M, Zhang B, Sadasivam RS, Houston TK, et al. Web-based smoking cessation intervention that transitions from inpatient to outpatient: study protocol for a randomized controlled trial. Trials. 2012;13:123.
Fellows JL, Mularski R, Waiwaiole L, Funkhouser K, Mitchell J, Arnold K, et al. Health and economic effects from linking bedside and outpatient tobacco cessation services for hospitalized smokers in two large hospitals: study protocol for a randomized controlled trial. Trials. 2012;13:129.
Reid ZZ, Regan S, Kelley JHK, Streck JM, Ylioja T, Tindle HA, et al. Comparative effectiveness of post-discharge strategies for hospitalized smokers: study protocol for the Helping HAND 2 randomized controlled trial. BMC Public Health. 2015;15(109):1484.
Richter KP, Faseru B, Mussulman LM, Ellerbeck EF, Shireman TI, Hunt JJ, et al. Using “warm handoffs” to link hospitalized smokers with tobacco treatment after discharge: study protocol of a randomized controlled trial. Trials. 2012;13:127.
Rigotti NA, Clair C, Munafo MR, Stead LF. Interventions for smoking cessation in hospitalised patients. The Cochrane Database of Systematic Reviews. 2012;5:CD001837.
Rigotti NA, Regan S, Levy DE, Japuntich S, Chang Y, Park E, et al. Sustained care intervention and postdischarge smoking cessation among hospitalized adults: A randomized clinical trial. JAMA. 2014;312(7):719–28.
Duffy SA, Karvonen-Gutierrez C, Ewing LA, Smith PM. Veterans Integrated Services Network (VISN) 11 Tobacco Tactics Team. Implementation of the Tobacco Tactics Program in the Department of Veterans Affairs. J Gen Intern Med. 2010;25 Suppl 1:3–10.
Fore A, Karvonen-Gutierrez C, Talsma A, Duffy SA. Nurses’ delivery of the Tobacco Tactics intervention at a Veterans Affairs Medical Center. J Clin Nurs. 2014;23(15–16):2162–9.
Joint Commission on Accreditation of Healthcare Organizations. Tobacco Treatment Measures (TTM). 2011; Accessed 2 February 2012.
United States Public Health Service Commissioned Corps. Tobacco Smoking Cessation. 2011; Accessed 23 March 2015.
Campbell BK, Buti A, Fussell HE, Srikanth P, McCarty D, Guydish JR. Therapist predictors of treatment delivery fidelity in a community-based trial of 12-step facilitation. Am J Drug Alcohol Abuse. 2013;39(5):304–11.
Katz DA, Holman JE, Johnson SR, Hillis SL, Adams SL, Fu SS, et al. Implementing best evidence in smoking cessation treatment for hospitalized veterans: results from the VA-BEST Trial. The Joint Commission Journal on Quality and Patient Safety. 2014;40(11):493–503.
Leventhal H, Friedman MA. Does establishing fidelity of treatment help in understanding treatment efficacy? Comment on Bellg et al. (2004). Health Psychol. 2004;23(5):452–6.
Addis ME, Krasnow AD. A national survey of practicing psychologists’ attitudes toward psychotherapy treatment manuals. J Consult Clin Psychol. 2000;68(2):331–9.
Barlow DH, Levitt JT, Bufka LF. The dissemination of empirically supported treatments: a view to the future. Behav Res Ther. 1999;37:S147–62.
Backer T. Finding the balance: program fidelity and adaptation in substance abuse prevention: A state-of-the-art review. Rockville, MD: Center for Substance Abuse Prevention; 2001.
Positive Thinking Training Intervention for Caregivers of Persons with Autism: Establishing Fidelity
Abir K. Bekhet
Archives of Psychiatric Nursing
Referring Hospitalized Smokers to Outpatient Quit Services
Jeffrey L. Fellows, Richard A. Mularski, Michael C. Leo, Charles J. Bentz, Lisa A. Waiwaiole, Melanie C. Francisco, Kimberly Funkhouser, Catherine M. Stoney
American Journal of Preventive Medicine
Feasibility of Implementing a Hospital-Based “Opt-Out” Tobacco-Cessation Service
Georges J. Nahhas, Dianne Wilson, Vince Talbot, Kathleen B. Cartmell, Graham W. Warren, Benjamin A. Toll, Matthew J. Carpenter, K. Michael Cummings
Nicotine & Tobacco Research
Implementation of the Tobacco Tactics intervention versus usual care in Trinity Health community hospitals
Sonia A. Duffy, David L. Ronis, Lee A. Ewing, Andrea H. Waltje, Stephanie V. Hall, Patricia L. Thomas, Christine M. Olree, Kimberly A. Maguire, Lisa Friedman, Sue Klotz, Neil Jordan, Gay L. Landstrom
Implementation Science
Comprehensive evaluation of interventions: eight vital parameters
Jaclene A Zauszniewski, Abir Bekhet, Kayla Herbell
Nurse Researcher
Protocol for the ROSE sustainment (ROSES) study, a sequential multiple assignment randomized trial to determine the minimum necessary intervention to maintain a postpartum depression prevention program in prenatal clinics serving low-income women
Jennifer E. Johnson, Shannon Wiltsey-Stirman, Alla Sikorskii, Ted Miller, Amanda King, Jennifer L. Blume, Xuan Pham, Tiffany A. Moore Simas, Ellen Poleshuck, Rebecca Weinberg, Caron Zlotnick
Implementation Science
Addressing fidelity within complex health behaviour change interventions: A protocol of a scoping review of intervention fidelity frameworks and models.
Rebekah Roy, Heather Colquhoun, Molly Byrne, Fabiana Lorencatto, Karen Matvienko-Sikar, Nicola McCleary, Nicole Nathan, Elaine Toomey
HRB Open Research
Mustafa ÜNAL, Mustafa Ünal
Konuralp Tıp Dergisi
Who Opted Out of an Opt-Out Smoking-Cessation Programme for Hospitalised Patients?
Georges Nahhas, K. Cummings, Vince Talbot, Matthew Carpenter, Benjamin Toll, Graham Warren
Journal of Smoking Cessation
Overcoming Challenges in Multisite Trials
Laureen Smith, Alai Tan, Janna Stephens, David Hibler, Sonia Duffy
Nursing Research
Incorporating intervention fidelity components into randomized controlled trials promoting exercise adherence in heart failure patients
Rita McGuire, Kathleen Duncan, Bunny Pozehl
Research in Nursing & Health
Translating a walking intervention for health professional delivery within primary care: A mixed‐methods treatment fidelity assessment
Stefanie Williams, Jennifer McSharry, Claire Taylor, Jeremy Dale, Susan Michie, David French
British Journal of Health Psychology
Psychoeducational Interventions for Problematic Anger in Chronic Moderate to Severe Traumatic Brain Injury: A Study of Treatment Enactment
Tessa Hart, Monica Vaccaro, Jesse Fann, Roland Maiuro, Shira Neuberger, Steven Sinfield
Journal of the International Neuropsychological Society
Study protocol of a multiphase optimization strategy trial (MOST) for delivery of smoking cessation treatment in lung cancer screening settings
Jamie Ostroff, Donna Shelley, Lou-Anne Chichester, Jennifer King, Yuelin Li, Elizabeth Schofield, Andrew Ciupek, Angela Criswell, Rashmi Acharya, Smita Banerjee, Elena Elkin, Kathleen Lynch, Bryan Weiner, Irene Orlow, Chloé Martin, Sharon Chan, Victoria Frederico, Phillip Camille, Susan Holland, Jessica Kenney
Journals System - logo
Scroll to top