Skip to Main Content

Systematic Review Guide

While the focus of this Guide is on Systematic Reviews, as the researcher, you need to determine the best type of review to perform based on your scope, comprehensiveness, time constraints, resources and types of studies included. A number of tools are available to help determine which type of review is appropriate for your research project.

The table compares/contrasts features of other select reviews published in the peer-reviewed literature. (Grant & Booth, 2009; Khangura, Konnyu, Cushman, Grimshaw, & Moher, 2012; Munn et al., 2018; Sutton, Clowes, Preston, & Booth, 2019; Tricco et al., 2015; Whittemore & Knafl, 2005)

REVIEW TYPE SEARCH STRATEGY APPRAISAL BIAS
Systematic Review – seeks to systematically search for, appraise and synthesize research evidence on a specific question, often adhering to guidelines on the conduct of a review. Aims for exhaustive, comprehensive searching Quality assessment may determine inclusion/exclusion Specific methods to minimize bias
Meta-analysis – a technique that statistically combines the results of quantitative studies to provide a more precise effect of the results. A good systematic review is essential to a meta-analysis of the literature. Aims for exhaustive, comprehensive searching Quality assessment may determine inclusion/exclusion  
Other Types of Reviews
Integrative Review – broadest type of research review methods which allows for the simultaneous inclusion of experimental and non-experimental research to more fully understand a phenomenon of concern. Identifies the maximum number of eligible primary sources, using at least two to three strategies Evaluating quality of primary sources in the integrative review method where diverse primary sources are included increases the complexity Complexity involved in combining diverse methodologies can contribute to lack of rigor, inaccuracy, and bias
Narrative/Literature Review – encompasses reviews of published materials that provide an examination of recent or current literature on a broad and/or wide range of subjects May or may not include comprehensive search May or may not include quality assessment Potential for bias due to limit in search breadth and rigor, quality assessment and/or author bias
Rapid Review – a type of knowledge synthesis in which components of the systematic review process are simplified or omitted to produce information in a short period time. Review team and client negotiate scope and methods based on time available. Used on emerging issues needing timely answers. Completeness of searching determined by time constraints Formal quality assessment determined by time constraints Potential for bias due to streamlining scope, search, quality assessment and analysis, etc.
Scoping Review – provides a preliminary assessment of the potential size and scope of available research literature. It can identify either specific or general opportunities for further research. Completeness of searching determined by time/scope constraints. No formal quality assess Potential for bias due to limits in rigor and duration and lack of formal quality assessment
Umbrella Review – is a review of reviews that compiles evidence from existing reviews into one accessible and usable document. It may be conducted when there are competing interventions. Search includes reviews but no primary studies Quality assessment of studies within component reviews and/or of reviews themselves  

For information on other review types:

  • Grant, M. J., & Booth, A. (2009, Jun). A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J, 26(2), 91-108. https://doi.org/10.1111/j.1471-1842.2009.00848.x
  • Peters, M. D. J., Marnie, C., Colquhoun, H., Garritty, C. M., Hempel, S., Horsley, T., Langlois, E. V., Lillie, E., O'Brien, K. K., Tunçalp, Ӧ., Wilson, M. G., Zarin, W., & Tricco, A. C. (2021). Scoping reviews: reinforcing and advancing the methodology and application. Syst Rev, 10(1), 263. https://doi.org/10.1186/s13643-021-01821-3
  • Sutton, A., Clowes, M., Preston, L., & Booth, A. (2019, Sep). Meeting the review family: exploring review types and associated information retrieval requirements. Health Info Libr J, 36(3), 202-222. https://doi.org/10.1111/hir.12276