Skip to Main Content

Systematic Review Guide

Task 1 – Find Previous Systematic Reviews/Benchmark Articles

GROUP PRIMARY RESPONSIBILITY NOTES
Librarian Preliminary Search Librarian performs the preliminary search upon receipt of the completed Systematic Review Request Form.
SR Team Benchmark Articles  

Preliminary Search

It is important to determine if a systematic review on your research topic has been published within the last five years or a protocol has been submitted to PROSPERO or other registry.

Upon receipt of the Systematic Review Request Form from the SR Team, the Librarian will perform a preliminary keyword search and/or review the SR Team's preliminary search.

Based on the outcome of the preliminary search, the SR Team will decide next steps as noted in the SR flowchart (shown on the right).

Benchmark Articles

The individual (i.e., primary investigator/project lead) completing the Library's Systematic Review Request Form is asked to identify at least three benchmark articles which meet the proposed review's inclusion criteria. If the SR Team decides to proceed, the SR Team can either ask a Librarian to join the team (fee-based) or the SR Team can handle their own searches.

If a Librarian joins the SR Team, the benchmark articles provide the Librarian helpful feedback whether the proposed search strategy retrieved articles that the SR Team would expect to see in the results.

If the SR Team decides to handle their own searches, they can request training with applicable Level 1 – Education tasks by submitting the Training Request Form.

More Information about Database Searching

Task 2 – Formulate Review Question

GROUP PRIMARY RESPONSIBILITY NOTES
SR Team X  
Librarian   Librarian reviews and/or provides feedback on the research question as part of the fee-based service

Developing a well-defined SR question takes time – it provides the foundation for a successful systematic review by:

  • Focusing where to look for the information
  • Identifying key search topics
  • Clarifying inclusion/exclusion criteria

Using a standardized format or framework improves the scientific rigor of the SR and helps organize the parts of the question and identify key concepts. The PICO mnemonic concept – introduced in 1995 by Richardson, et. al. – was developed to help answer health-related quantitative questions by breaking down the question into searchable keywords.

  • P (patient or population or problem)
  • I (intervention Indicator, Exposure, Prognostic Factor)
  • C (Comparison or Control)
  • O (Outcome)

Over the years, the framework has evolved to include additional components, such as "T" (Timeframe) and "TT" (Type of question + Type of study design). (Davies, 2011; Richardson, Wilson, Nishikawa, & Hayward, 1995)

The effort invested to develop the question, will not only save time but will more likely identify relevant information.

More Information about Developing the Research Question

Task 3 – Write Protocol

GROUP PRIMARY RESPONSIBILITY NOTES
SR Team X  
Librarian   Librarian contributes to the search section of the protocol design and provides guidance on protocol registration as part of the fee-based service.

Written by the SR Team, the SR protocol includes the research question, context, and rationale for the review, study design, search strategy, inclusion/exclusion criteria, procedures for study collection, data collection and extraction, data synthesis, reporting, and other components of the research plan. The SR protocol is important for several reasons (IOM (Institute of Medicine), 2011; Moher et al., 2015; Shamseer et al., 2015):

  1. Helps the SR Team to plan and identify potential issues
  2. Allows the SR Team to explicitly detail their plan before they start their review, enabling others to compare the protocol and the completed review, to replicate review methods if desired, and to judge the validity of planned methods
  3. Prevents arbitrary decision making with respect to inclusion criteria and extraction of data
  4. May reduce duplication of efforts and enhance collaboration, when available

PRISMA-P, published in 2015, includes a 17-item checklist intended to facilitate the preparation and reporting of a robust protocol for the systematic review. The developers note that there are many review types outside of this scope. They recommend that due to the general lack of protocol guidance for other types of reviews, reviewers preparing any type of review protocol make use of PRISMA-P as applicable.

Registering the SR protocol helps minimize bias in the conduct and reporting of the review, reduce duplication, and keep systematic reviews updated.(IOM (Institute of Medicine), 2011) Review registries include but are not limited to:

  • PROSPERO – is an international prospective register of systematic reviews. Key details from new Cochrane protocols are automatically uploaded into PROSPERO. It is produced by the Centre of Reviews and Dissemination, University of York, UK. Note: It is recommended that the SR Team register their protocol in PROSPERO.
  • Cochrane Database of Systematic Reviews – is a journal and database published by Cochrane. It includes Cochrane Reviews (systematic reviews) and protocols for Cochrane Reviews
  • Campbell Collaboration – a sibling of The Cochrane Collaboration, it is an international research network that produces systematic reviews of the effects of social interventions The journal Campbell Systematic Reviews publishes protocols, reviews and methods papers.
  • JBI Systematic Review Register – Joanna Briggs Institute (JBI) recommends that protocols of eligible review projects be registered with PROSPERO.

More Information about Protocols

Review the related materials at specific review registries.

Task 4 – Devise Search Strategy

GROUP PRIMARY RESPONSIBILITY NOTES
Librarian Develops strategy
Identifies databases
Librarian collaborates with the SR Team primary contact to develop search strategy for their review and approval and identifies databases to search as part of the fee-based service.
SR Team Approves strategy  

It is important to locate and identify all relevant studies using a wide range of resources and search methods for the systematic review. Developing the search strategy is different from conducting the search. A comprehensive search strategy will help to reduce the risk of bias by identifying as much relevant evidence as possible. (Tsafnat et al., 2014; Higgins JPT, 2020)

A well-defined SR question is essential to develop a comprehensive search strategy. As a member of the SR team, the Librarian:

  • Collaborates with the SR Team primary contact to develop the search strategy.
  • Uses the SR question to identify key concepts. The PICO menomic or equivalent is helpful to organize concepts.
  • Further defines key concepts using a combination of subject headings and keywords.
  • Requests SR Team to review the preliminary list of search terms and decide whether terms need to be added or deleted.
  • Performs a preliminary search using Boolean Operators (OR, AND, NOT), search field queries and adjacency/proximity commands. Subject headings and keywords for each concept are combined using OR. The results for each concept are then combined using AND to make sure that each concept is included in the final search results.
  • Checks whether the preliminary search strategy retrieved the benchmark articles identified by the SR Team.
  • Requests SR Team to review/approve the search strategy in the core databases. Note: this step takes time and may require multiple revisions.
  • Seeks to maximize recall (sensitivity) while striving for reasonable precision (specificity). See Limits and Filters.
  • Recommends which bibliographic databases to search – the most commonly searched core bibliographic databases are Medline/PubMed, Embase and Cochrane Central.
  • Database selection should be guided by the review topic. When topics are specialized, cross-disciplinary, or involve emerging technologies, additional databases may need to be identified and searched.

Note: The SR Team also reviews and approves each search strategy in the remaining databases.

More Information about Devising the Search Strategy