1932

Abstract

We present a detailed argument for how to integrate, or bridge, systems science thinking and methods with implementation science. We start by showing how fundamental systems science principles of structure, dynamics, information, and utility are relevant for implementation science. Then we examine the need for implementation science to develop and apply richer theories of complex systems. This can be accomplished by emphasizing a causal mechanisms approach. Identifying causal mechanisms focuses on the “cogs and gears” of public health, clinical, and organizational interventions. A mechanisms approach focuses on how a specific strategy will produce the implementation outcome. We show how connecting systems science to implementation science opens new opportunities for examining and addressing social determinants of health and conducting equitable and ethical implementation research. Finally, we present case studies illustrating successful applications of systems science within implementation science in community health policy, tobacco control, health care access, and breast cancer screening.

Loading

Article metrics loading...

/content/journals/10.1146/annurev-publhealth-060922-040205
2024-05-20
2024-05-23
Loading full text...

Full text loading...

/deliver/fulltext/publhealth/45/1/annurev-publhealth-060922-040205.html?itemId=/content/journals/10.1146/annurev-publhealth-060922-040205&mimeType=html&fmt=ahah

Literature Cited

  1. 1.
    Aarons GA, Hurlburt M, Horwitz SM. 2011.. Advancing a conceptual model of evidence-based practice implementation in public service sectors. . Adm. Policy Ment. Health 38:(1):423
    [Crossref] [Google Scholar]
  2. 2.
    Alegría M, O'Malley IS. 2022.. Opening the black box: overcoming obstacles to studying causal mechanisms in research on reducing inequality. Rep. , William T. Grant Found., New York:. https://wtgrantfoundation.org/wp-content/uploads/2022/03/Alegria-Omalley_WTG-Digest-7.pdf
  3. 3.
    Appel JM, Fullerton K, Hennessy E, Korn AR, Tovar A, et al. 2019.. Design and methods of Shape Up Under 5: Integration of systems science and community-engaged research to prevent early childhood obesity. . PLOS ONE 14:(8):e0220169
    [Crossref] [Google Scholar]
  4. 4.
    Auchincloss AH, Riolo RL, Brown DG, Cook J, Diez Roux AV. 2011.. An agent-based model of income inequalities in diet in the context of residential segregation. . Am. J. Prev. Med. 40:(3):30311
    [Crossref] [Google Scholar]
  5. 5.
    Barton AH. 1968.. Bringing society back in: survey research and macro-methodology. : Am. Behav. Sci. 12:(2):19
    [Crossref] [Google Scholar]
  6. 6.
    Bauer MS, Kirchner J. 2020.. Implementation science: What is it and why should I care?. Psychiatry Res. 283::112376
    [Crossref] [Google Scholar]
  7. 7.
    Baumann AA, Cabassa LJ. 2020.. Reframing implementation science to address inequities in healthcare delivery. . BMC Health Serv. Res. 20:(1):190
    [Crossref] [Google Scholar]
  8. 8.
    Begun JW, Zimmerman B, Dooley K. 2003.. Health care organizations as complex adaptive systems. . In Advances in Health Care Organization Theory, ed. SM Mick, ME Wyttenbach , pp. 25388. San Francisco:: Jossey-Bass
    [Google Scholar]
  9. 9.
    Berwick DM. 2008.. The science of improvement. . JAMA 299:(10):118284
    [Crossref] [Google Scholar]
  10. 10.
    Braithwaite J, Churruca K, Long JC, Ellis LA, Herkes J. 2018.. When complexity science meets implementation science: a theoretical and empirical analysis of systems change. . BMC Med. 16:(1):63
    [Crossref] [Google Scholar]
  11. 11.
    Burke JG, Lich KH, Neal JW, Meissner HI, Yonas M, Mabry PL. 2015.. Enhancing dissemination and implementation research using systems science methods. . Int. J. Behav. Med. 22:(3):28391
    [Crossref] [Google Scholar]
  12. 12.
    Calancie L, Anderson S, Branscomb J, Apostolico AA, Lich KH. 2018.. Using behavior over time graphs to spur systems thinking among public health practitioners. . Prev. Chronic Dis. 15::170254
    [Crossref] [Google Scholar]
  13. 13.
    Capra F, Luisi PL. 2014.. The Systems View of Life: A Unifying Vision. Cambridge, UK:: Cambridge Univ. Press
  14. 14.
    Cartwright N. 2009.. What is this thing called “efficacy”?. In Philosophy of the Social Sciences: Philosophical Theory and Scientific Practice, ed. C Mantzavinos , pp. 185206. Cambridge, UK:: Cambridge Univ. Press
    [Google Scholar]
  15. 15.
    Chambers DA, Glasgow RE, Stange KC. 2013.. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. . Implement. Sci. 8:(1):117
    [Crossref] [Google Scholar]
  16. 16.
    Clark WAV. 1991.. Residential preferences and neighborhood racial segregation: a test of the Schelling segregation model. . Demography 28:(1):119
    [Crossref] [Google Scholar]
  17. 17.
    Coiera E, Ash J, Berg M. 2016.. The unintended consequences of health information technology revisited. . Yearb. Med. Inform. 25:(1):16369
    [Crossref] [Google Scholar]
  18. 18.
    Coleman JS. 1990.. Foundations of Social Theory. Boston:: Harvard Univ. Press
  19. 19.
    Combs T, Nelson KL, Luke D, McGuire FH, Cruden G, et al. 2022.. Simulating the role of knowledge brokers in policy making in state agencies: an agent-based model. . Health Serv. Res. 57:(S1):12236
    [Crossref] [Google Scholar]
  20. 20.
    Combs TB, Ornstein JT, Chaitan VL, Golden SD, Henriksen L, Luke DA. 2022.. Draining the tobacco swamps: shaping the built environment to reduce tobacco retailer proximity to residents in 30 big US cities. . Health Place 75::102815
    [Crossref] [Google Scholar]
  21. 21.
    Currie CSM, Fowler JW, Kotiadis K, Monks T, Onggo BS, et al. 2020.. How simulation modelling can help reduce the impact of COVID-19. . J. Simul. 14:(2):8397
    [Crossref] [Google Scholar]
  22. 22.
    Dadich A, Vaughan P, Boydell K. 2023.. The unintended negative consequences of knowledge translation in healthcare: a systematic scoping review. . Health Sociol. Rev. 32:(1):7593
    [Crossref] [Google Scholar]
  23. 23.
    Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. 2009.. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. . Implement. Sci. 4:(1):50
    [Crossref] [Google Scholar]
  24. 24.
    Dearing JW, Cox JG. 2018.. Diffusion of innovations theory, principles, and practice. . Health Aff. 37:(2):18390
    [Crossref] [Google Scholar]
  25. 25.
    De Silva-Sanigorski AM, Bell AC, Kremer P, Park J, Demajo L, et al. 2012.. Process and impact evaluation of the Romp & Chomp obesity prevention intervention in early childhood settings: lessons learned from implementation in preschools and long day care settings. . Child. Obes. 8:(3):20515
    [Crossref] [Google Scholar]
  26. 26.
    D'Lima D, Soukup T, Hull L. 2022.. Evaluating the application of the RE-AIM planning and evaluation framework: an updated systematic review and exploration of pragmatic application. . Front. Public Health 9::755738
    [Crossref] [Google Scholar]
  27. 27.
    Dobbins M, Robeson P, Ciliska D, Hanna S, Cameron R, et al. 2009.. A description of a knowledge broker role implemented as part of a randomized controlled trial evaluating three knowledge translation strategies. . Implement. Sci. 4:(1):23
    [Crossref] [Google Scholar]
  28. 28.
    Economos CD, Calancie L, Korn AR, Allender S, Appel JM, et al. 2023.. Community coalition efforts to prevent childhood obesity: Two-year results of the Shape Up Under 5 study. . BMC Public Health 23:(1):529
    [Crossref] [Google Scholar]
  29. 29.
    Economos CD, Hammond RA. 2017.. Designing effective and sustainable multifaceted interventions for obesity prevention and healthy communities. . Obesity 25:(7):115556
    [Crossref] [Google Scholar]
  30. 30.
    Feldstein AC, Glasgow RE. 2008.. A Practical, Robust Implementation and Sustainability Model (PRISM) for integrating research findings into practice. . Jt. Comm. J. Qual. Patient Saf. 34:(4):22843
    [Google Scholar]
  31. 31.
    Folta SC, Kuder JF, Goldberg JP, Hyatt RR, Must A, et al. 2013.. Changes in diet and physical activity resulting from the Shape Up Somerville community intervention. . BMC Pediatr. 13:(1):157
    [Crossref] [Google Scholar]
  32. 32.
    Gallagher S, Richardson LF, Ventura SL, Eddy WF. 2018.. SPEW: Synthetic Populations and Ecosystems of the World. . J. Comput. Graph. Stat. 27:(4):77384
    [Crossref] [Google Scholar]
  33. 33.
    Geng EH, Baumann AA, Powell BJ. 2022.. Mechanism mapping to advance research on implementation strategies. . PLOS Med. 19:(2):e1003918
    [Crossref] [Google Scholar]
  34. 34.
    Geng EH, Mody A, Powell BJ. 2023.. On-the-go adaptation of implementation approaches and strategies in health: emerging perspectives and research opportunities. . Annu. Rev. Public Health 44::2136
    [Crossref] [Google Scholar]
  35. 35.
    Green LW, Ottoson JM, García C, Hiatt RA. 2009.. Diffusion theory and knowledge dissemination, utilization, and integration in public health. . Annu. Rev. Public Health 30::15174
    [Crossref] [Google Scholar]
  36. 36.
    Hawe P, Shiell A, Riley T. 2009.. Theorising interventions as events in systems. . Am. J. Community Psychol. 43:(3–4):26776
    [Crossref] [Google Scholar]
  37. 37.
    Hedström P, Ylikoski P. 2010.. Causal mechanisms in the social sciences. . Annu. Rev. Sociol. 36::4967
    [Crossref] [Google Scholar]
  38. 38.
    Hennessy E, Economos CD, Hammond RA, Sweeney LB, Brukilacchio L, et al. 2020.. Integrating complex systems methods to advance obesity prevention intervention research. . Health Educ. Behav. 47:(2):21323
    [Crossref] [Google Scholar]
  39. 39.
    Hovmand P. 2013.. Community Based System Dynamics. New York:: Springer
  40. 40.
    Huang W, Chang C-H, Stuart EA, Daumit GL, Wang N-Y, et al. 2021.. Agent-based modeling for implementation research: an application to tobacco smoking cessation for persons with serious mental illness. . Implement. Res. Pract. 2::26334895211010664
    [Google Scholar]
  41. 41.
    Isaacson W. 2017.. Leonardo da Vinci. New York:: Simon & Schuster
  42. 42.
    Jayasinghe S. 2015.. Social determinants of health inequalities: towards a theoretical perspective using systems science. . Int. J. Equity Health 14:(1):71
    [Crossref] [Google Scholar]
  43. 43.
    Kasman M, Hammond RA, Mack-Crane A, Purcell R, Korn AR, et al. 2023.. Using agent-based modeling to extrapolate community-wide impact from a stakeholder-driven childhood obesity prevention intervention: Shape Up Under 5. . Child. Obes. 19:(2):13038
    [Crossref] [Google Scholar]
  44. 44.
    Kiekens A, Dierckx De Casterlé B, Vandamme A-M. 2022.. Qualitative systems mapping for complex public health problems: a practical guide. . PLOS ONE 17:(2):e0264463
    [Crossref] [Google Scholar]
  45. 45.
    Kilbourne AM, Geng E, Eshun-Wilson I, Sweeney S, Shelley D, et al. 2023.. How does facilitation in healthcare work? Using mechanism mapping to illuminate the black box of a meta-implementation strategy. . Implement. Sci. Commun. 4:(1):53
    [Crossref] [Google Scholar]
  46. 46.
    Kislov R, Pope C, Martin GP, Wilson PM. 2019.. Harnessing the power of theorising in implementation science. . Implement. Sci. 14:(1):103
    [Crossref] [Google Scholar]
  47. 47.
    Klovdahl AS. 1985.. Social networks and the spread of infectious diseases: the AIDS example. . Soc. Sci. Med. 21:(11):120316
    [Crossref] [Google Scholar]
  48. 48.
    Koorts H, Cassar S, Salmon J, Lawrence M, Salmon P, Dorling H. 2021.. Mechanisms of scaling up: combining a realist perspective and systems analysis to understand successfully scaled interventions. . Int. J. Behav. Nutr. Phys. Act. 18:(1):42
    [Crossref] [Google Scholar]
  49. 49.
    Kruskal W. 1988.. Miracles and statistics: the casual assumption of independence. . J. Am. Stat. Assoc. 83:(404):92940
    [Crossref] [Google Scholar]
  50. 50.
    Kwan BM, Brownson RC, Glasgow RE, Morrato EH, Luke DA. 2022.. Designing for dissemination and sustainability to promote equitable impacts on health. . Annu. Rev. Public Health 43::33153
    [Crossref] [Google Scholar]
  51. 51.
    Lengnick-Hall R, Stadnick NA, Dickson KS, Moullin JC, Aarons GA. 2021.. Forms and functions of bridging factors: specifying the dynamic links between outer and inner contexts during implementation and sustainment. . Implement. Sci. 16::34
    [Crossref] [Google Scholar]
  52. 52.
    Lewis CC, Boyd MR, Walsh-Bailey C, Lyon AR, Beidas R, et al. 2020.. A systematic review of empirical studies examining mechanisms of implementation in health. . Implement. Sci. 15:(1):21
    [Crossref] [Google Scholar]
  53. 53.
    Lewis CC, Klasnja P, Powell BJ, Lyon AR, Tuzzio L, et al. 2018.. From classification to causality: advancing understanding of mechanisms of change in implementation science. . Front. Public Health 6::136
    [Crossref] [Google Scholar]
  54. 54.
    Long E, Gardani M, McCann M, Sweeting H, Tranmer M, Moore L. 2020.. Mental health disorders and adolescent peer relationships. . Soc. Sci. Med. 253::112973
    [Crossref] [Google Scholar]
  55. 55.
    Luke DA, Hammond RA, Combs T, Sorg A, Kasman M, et al. 2017.. Tobacco Town: computational modeling of policy options to reduce tobacco retailer density. . Am. J. Public Health 107:(5):74046
    [Crossref] [Google Scholar]
  56. 56.
    Luke DA, Harris JK. 2007.. Network analysis in public health: history, methods, and applications. . Annu. Rev. Public Health 28::6993
    [Crossref] [Google Scholar]
  57. 57.
    Luke DA, Morshed AB, McKay VR, Combs TB. 2023.. Systems science methods in dissemination and implementation research. . In Dissemination and Implementation Research in Health, ed. RC Brownson, GA Colditz, EK Proctor , pp. 26990. Oxford, UK:: Oxford Univ. Press. , 3rd ed..
    [Google Scholar]
  58. 58.
    Luke DA, Ornstein JT, Combs TB, Henriksen L, Mahoney M. 2020.. Moving from metrics to mechanisms to evaluate tobacco retailer policies: importance of retail policy in tobacco control. . Am. J. Public Health 110:(4):43133
    [Crossref] [Google Scholar]
  59. 59.
    Luke DA, Stamatakis KA. 2012.. Systems science methods in public health: dynamics, networks, and agents. . Annu. Rev. Public Health 33::35776
    [Crossref] [Google Scholar]
  60. 60.
    Mazzucca S, Tabak RG, Pilar M, Ramsey AT, Baumann AA, et al. 2018.. Variation in research designs used to test the effectiveness of dissemination and implementation strategies: a review. . Front. Public Health 6::32
    [Crossref] [Google Scholar]
  61. 61.
    McGinnis MD, Ostrom E. 2014.. Social-ecological system framework: initial changes and continuing challenges. . Ecol. Soc. 19:(2):30
    [Crossref] [Google Scholar]
  62. 62.
    McKay V, Vogel M, Combs T, Brossart L, Endrizal A, et al. 2022.. Tailoring dissemination of evidence to preferences of tobacco control partners: results from an academic-community partnership. . Subst. Abuse Treat. Prev. Policy 17:(1):29
    [Crossref] [Google Scholar]
  63. 63.
    Merton RK. 1968.. Social Theory and Social Structure. New York:: Simon and Schuster
  64. 64.
    Meza RD, Moreland JC, Pullmann MD, Klasnja P, Lewis CC, Weiner BJ. 2023.. Theorizing is for everybody: advancing the process of theorizing in implementation science. . Front. Health Serv. 3::1134931
    [Crossref] [Google Scholar]
  65. 65.
    Mobus GE, Kalton MC. 2014.. Principles of Systems Science. New York:: Springer
  66. 66.
    Morshed AB, Kasman M, Heuberger B, Hammond RA, Hovmand PS. 2019.. A systematic review of system dynamics and agent-based obesity models: evaluating obesity as part of the global syndemic. . Obes. Rev. 20:(S2):16178
    [Crossref] [Google Scholar]
  67. 67.
    Muttalib F, Ballard E, Langton J, Malone S, Fonseca Y, et al. 2021.. Application of systems dynamics and group model building to identify barriers and facilitators to acute care delivery in a resource limited setting. . BMC Health Serv. Res. 21:(1):26
    [Crossref] [Google Scholar]
  68. 68.
    NCI (Natl. Cancer Inst.). 2007.. Greater Than the Sum: Systems Thinking in Tobacco Control. Washington, DC:: NCI, US Dep. Health Hum. Serv., Public Health Serv., Natl. Inst. Health
  69. 69.
    Nilsen P. 2015.. Making sense of implementation theories, models and frameworks. . Implement. Sci. 10:(1):53
    [Crossref] [Google Scholar]
  70. 70.
    Nilsen P, Bernhardsson S. 2019.. Context matters in implementation science: a scoping review of determinant frameworks that describe contextual determinants for implementation outcomes. . BMC Health Serv. Res. 19:(1):189
    [Crossref] [Google Scholar]
  71. 71.
    Northridge ME, Metcalf SS. 2016.. Enhancing implementation science by applying best principles of systems science. . Health Res. Policy Syst. 14:(1):74
    [Crossref] [Google Scholar]
  72. 72.
    Palinkas LA, Zatzick D. 2019.. Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE) in pragmatic clinical trials of mental health services implementation: Methods and applied case study. . Adm. Policy Ment. Health 46:(2):25570
    [Crossref] [Google Scholar]
  73. 73.
    Powell BJ, Beidas RS. 2016.. Advancing implementation research and practice in behavioral health systems. . Adm. Policy Ment. Health 43:(6):82533
    [Crossref] [Google Scholar]
  74. 74.
    Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, et al. 2011.. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. . Adm. Policy Ment. Health 38:(2):6576
    [Crossref] [Google Scholar]
  75. 75.
    Proctor EK, Bunger AC, Lengnick-Hall R, Gerke DR, Martin JK, et al. 2023.. Ten years of implementation outcomes research: a scoping review. . Implement. Sci. 18:(1):31
    [Crossref] [Google Scholar]
  76. 76.
    Pruyt E, Kwakkel J. 2007.. Combining system dynamics and ethics: towards more science? Paper presented at the 2007 International Conference of the System Dynamics Society and 50th Anniversary Celebration, Cambridge, MA:, July 29–Aug. 2
  77. 77.
    Pullmann MD, Dorsey S, Duong MT, Lyon AR, Muse I, et al. 2022.. Expect the unexpected: a qualitative study of the ripple effects of children's mental health services implementation efforts. . Implement. Res. Pract. 3::26334895221120797
    [Google Scholar]
  78. 78.
    Richardson GP. 2012.. System dynamics: simulation for policy analysis from a feedback perspective. . In Qualitative Simulation Modeling and Analysis, ed. PA Fishwick, PA Luker , pp. 14469. New York:: Springer
    [Google Scholar]
  79. 79.
    Rittel HWJ, Webber MM. 1973.. Dilemmas in a general theory of planning. . Policy Sci. 4:(2):15569
    [Crossref] [Google Scholar]
  80. 80.
    Rogers EM. 2003.. Diffusion of Innovations. New York:: Free Press/Simon and Schuster. , 5th ed..
  81. 81.
    Romney W, Salbach N, Parrott JS, Deutsch JE. 2020.. A knowledge translation intervention designed and implemented by a knowledge broker improved documented use of gait speed: a mixed-methods study. . J. Geriatr. Phys. Ther. 43:(3):E110
    [Crossref] [Google Scholar]
  82. 82.
    Rosenthal J, Arku RE, Baumgartner J, Brown J, Clasen T, et al. 2020.. Systems science approaches for global environmental health research: enhancing intervention design and implementation for household air pollution (HAP) and water, sanitation, and hygiene (WASH) programs. . Environ. Health Perspect. 128:(10):105001
    [Crossref] [Google Scholar]
  83. 83.
    Ross H, Tesche J, Vellios N. 2017.. Undermining government tax policies: common legal strategies employed by the tobacco industry in response to tobacco tax increases. . Prev. Med. 105::S1922
    [Crossref] [Google Scholar]
  84. 84.
    Salanitro AH, Estrada CA, Allison JJ. 2008.. Implementation research: beyond the traditional randomized controlled trial. . In Essentials of Clinical Research, ed. SP Glasser , pp. 21744. New York:: Springer
    [Google Scholar]
  85. 85.
    Schelling TC. 1971.. Dynamic models of segregation. . J. Math. Sociol. 1::14386
    [Crossref] [Google Scholar]
  86. 86.
    Schliep ME, Alonzo CN, Morris MA. 2017.. Beyond RCTs: innovations in research design and methods to advance implementation science. . Evid.-Based Commun. Assess. Interv. 11:(3–4):8298
    [Google Scholar]
  87. 87.
    Senge PM. 2006.. The Fifth Discipline: The Art & Practice of the Learning Organization. New York:: Doubleday. Revis. , ed..
  88. 88.
    Sheldrick RC, Cruden G, Schaefer AJ, Mackie TI. 2021.. Rapid-cycle systems modeling to support evidence-informed decision-making during system-wide implementation. . Implement. Sci. Commun. 2:(1):116
    [Crossref] [Google Scholar]
  89. 89.
    Shelton RC, Adsul P, Oh A, Moise N, Griffith DM. 2021.. Application of an antiracism lens in the field of implementation science (IS): recommendations for reframing implementation research with a focus on justice and racial equity. . Implement. Res. Pract. 2::26334895211049482
    [Google Scholar]
  90. 90.
    Shelton RC, Chambers DA, Glasgow RE. 2020.. An extension of RE-AIM to enhance sustainability: addressing dynamic context and promoting health equity over time. . Front. Public Health 8::134
    [Crossref] [Google Scholar]
  91. 91.
    Silva DS, Smith MJ, Norman CD. 2018.. Systems thinking and ethics in public health: a necessary and mutually beneficial partnership. . Monash Bioeth. Rev. 36:(1–4):5467
    [Crossref] [Google Scholar]
  92. 92.
    Simon HA. 2001.. Complex systems: the interplay of organizations and markets in contemporary society. . Comput. Math. Organ. Theory 7::7985
    [Crossref] [Google Scholar]
  93. 93.
    Singh NS, Kovacs RJ, Cassidy R, Kristensen SR, Borghi J, Brown GW. 2021.. A realist review to assess for whom, under what conditions and how pay for performance programmes work in low- and middle-income countries. . Soc. Sci. Med. 270::113624
    [Crossref] [Google Scholar]
  94. 94.
    Sisk BA, Mozersky J, Antes AL, DuBois JM. 2020.. The “ought-is” problem: an implementation science framework for translating ethical norms into practice. . Am. J. Bioeth. 20:(4):6270
    [Crossref] [Google Scholar]
  95. 95.
    Sterman JD. 2006.. Learning from evidence in a complex world. . Am. J. Public Health 96:(3):50514
    [Crossref] [Google Scholar]
  96. 96.
    Tabak RG, Khoong EC, Chambers DA, Brownson RC. 2012.. Bridging research and practice: models for dissemination and implementation research. . Am. J. Prev. Med. 43:(3):33750
    [Crossref] [Google Scholar]
  97. 97.
    Tracy M, Cerdá M, Keyes KM. 2018.. Agent-based modeling in public health: current applications and future directions. . Annu. Rev. Public Health 39::7794
    [Crossref] [Google Scholar]
  98. 98.
    Univ. Colo. Denver. 2023.. Helping navigate dissemination and implementation models. . Dissemination & Implementation Models in Health. https://dissemination-implementation.org
    [Google Scholar]
  99. 99.
    Valente TW. 2005.. Network models and methods for studying the diffusion of innovations. . In Models and Methods in Social Network Analysis, ed. PJ Carrington, J Scott, S Wasserman , pp. 98116. Cambridge Univ. Press
    [Google Scholar]
  100. 100.
    Victora CG, Habicht J-P, Bryce J. 2004.. Evidence-based public health: moving beyond randomized trials. . Am. J. Public Health 94:(3):400405
    [Crossref] [Google Scholar]
  101. 101.
    Wensing M, Grol R. 2019.. Knowledge translation in health: how implementation science could contribute more. . BMC Med. 17:(1):88
    [Crossref] [Google Scholar]
  102. 102.
    Williams F, Colditz GA, Hovmand P, Gehlert S. 2018.. Combining community-engaged research with group model building to address racial disparities in breast cancer mortality and treatment. . J. Health Disparities Res. Pract. 11:(1):16078
    [Google Scholar]
  103. 103.
    Woodward EN, Matthieu MM, Uchendu US, Rogal S, Kirchner JE. 2019.. The health equity implementation framework: proposal and preliminary study of hepatitis C virus treatment. . Implement. Sci. 14:(1):26
    [Crossref] [Google Scholar]
  104. 104.
    Zimmerman L, Lounsbury DW, Rosen CS, Kimerling R, Trafton JA, Lindley SE. 2016.. Participatory system dynamics modeling: increasing stakeholder engagement and precision to improve implementation planning in systems. . Adm. Policy Ment. Health 43:(6):83449
    [Crossref] [Google Scholar]
/content/journals/10.1146/annurev-publhealth-060922-040205
Loading
/content/journals/10.1146/annurev-publhealth-060922-040205
Loading

Data & Media loading...

  • Article Type: Review Article
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error