Subject Guides
Systematic Review
- Home
- Step 0: Pre-Review Tasks
- Step 1: Develop a Systematic Review Protocol
- Step 2: Choose Systematic Review Tools
- Step 3: Develop a Systematic Search Strategy
- PRISMA-S: An extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews
- Partner with A Librarian
- Develop a Chart of Search Terms
- Compile a List of Exemplar Articles
- Choose Databases & Grey Literature Resources
- Avoid Repetition of Recently Published Reviews
- Systematic Search Process
- Build Your Search
- Translate Your Search
- Run a Pilot Search & Screen
- Citation Chasing
- PRISMA 2020 Checklist for Search Reporting
- Grey Literature This link opens in a new window
- Step 4: Register a Protocol
- Step 5: Run Finalized Searches
- Step 6: Standardized Article Screening
- Step 7: Appraise the Quality of the Included Studies
- Step 8: Data Extraction
- Step 9: Synthesize the Results
- Resources for Systematic Reviews in the Social Sciences
PRISMA-S: An extension to the PRISMA Statement for Reporting Literature Searches in Systematic Reviews
"The intent of PRISMA-S is to complement the PRISMA Statement and its extensions by providing a checklist that could be used by interdisciplinary authors, editors, and peer reviewers to verify that each component of a search is completely reported and therefore reproducible."
Partner with A Librarian
All guidelines governing the creation of systematic reviews recommend the involvement of a librarian or information professional on your systematic review team. We recommend you work with a librarian during the planning and searching phase of your systematic review.
Partnering with a librarian
- Saves researchers time
- Ensure a comprehensive and rigorous search
- Gets maximum retrieval of relevant articles
- Minimizes article screening time by excluding non-relevant articles from the search strategy
- Librarian co-author correlated with higher quality reported search strategies in general internal medicine systematic reviews
- Librarians and information specialists as methodological peer-reviewers: a case-study of the International Journal of Health Governance
- Cochrane Handbook: Role of the Librarian
This section of the Cochrane Handbook details the importance of librarian involvement and the role librarians can play in the review process.
Medsyntax: Medsyntax is a free, open-source tool for visualizing and editing literature searches. It transforms search terms into HTML elements to visualize the search strategy effectively, provides an inline scope-driven editor and offers real-time error detection. Used by librarians, researchers, nurses, physicians and other.
Develop a Chart of Search Terms
Turning a research question into a search string is a multi-stepped process:
- Break down your research question into searchable concepts
- Write down a list of keywords and synonyms for each concept
- Map each concept to relevant controlled vocabularies for each database (such as MeSH)
As you do test searches and read more relevant literature, you will be able to add additional keywords to your search concepts. It is recommended that you reach out to a librarian for assistance in generating keywords and mapping concepts to a controlled vocabulary.
Compile a List of Exemplar Articles
When you are first refining your research topic and looking at the literature, you will most likely come across articles of interest that you know should be included in your review. These are referred to as exemplar articles. Exemplar articles can be used to test your search strategy and ensure that your search strategy is retrieving the kinds of literature you want to include in the review. In addition, citation chasing from exemplar articles is a great way to identify additional relevant literature. See below for some tools that can take advantage of your exemplar articles.
- Citation Chaser
Citation Chaser can be used to easily identify articles that are citing or are being cited by specific articles you have identified as being relevant to your research topic.
- Yale MeSH Analyzer
A MeSH analysis grid can help identify the problems in your search strategy by presenting the ways articles are indexed in the MEDLINE database in an easy-to-scan tabular format. Librarians can then easily scan the grid and identify appropriate MesH terms, term variants, indexing consistency, and the reasons why some articles are retrieved and others are not. This inevitably leads to fresh iterations of the search strategy to include missing important terms.
- PubMed PubReMiner
The PubMed PubReMiner can be used to identify the most used subject headings for your exemplar articles, to help you identify relevant MeSH terms for your search strategy.
Choose Databases & Grey Literature Resources
Databases
A systematic review aims to review as much of the literature as possible to minimize bias. As such, it is recommended that at least 3 databases are searched for a systematic review.
A librarian can suggest additional databases relevant to your research topic. See below for a video demonstrating how to use the library website to find databases relevant to your research topic.
You can find the list of databases available here.
Grey Literature
Gray literature is a term used to describe all sources of research or research-related literature that exists outside of peer-reviewed, academic journal articles.
Examples of grey literature include: conference abstracts, presentations, proceedings; regulatory data; unpublished trial data; government publications; reports (such as white papers, working papers, and internal documentation); dissertations/theses; patents; and policies & procedures.
Why Search Gray Literature?
- To find information not available in traditional publication outlets
- To reduce publication bias in your results
- To get a complete picture of your research topic
- Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses?
The exclusion of grey literature from meta-analyses can lead to exaggerated estimates of intervention effectiveness. In general, meta-analysts should attempt to identify, retrieve, and include all reports, grey and published, that meet predefined inclusion criteria
- Finding Grey Literature Evidence and Assessing for Outcome and Analysis Reporting Biases When Comparing Medical Interventions: AHRQ and the Effective Health Care Program
This document provides guidance on steps that authors of systematic reviews can take to reduce the error in the assessment of the effect of an intervention that arises from biases in the way that studies are published and reported.
- Grey Literature Guide
Learn more about gray literature, to decide if you should include it in your literature searching.
- Grey Matters: a practical tool for searching health-related grey literature
A checklist on how to search for grey literature.
Avoid Repetition of Recently Published Reviews
During the planning stage, it is recommended that the team searches for existing systematic reviews on related topics. This helps to ensure that you are not duplicating an existing review (a review older than 10 years old can be updated), and can also be used to help inform the search strategy and inclusion/exclusion criteria you can use in your own review. Related systematic reviews can help you generate search terms and identify databases and journals of relevance to your topic. In addition, viewing the citations of those reviews might help you identify relevant research.
Many databases include search filters or limiters that will limit your search to just systematic reviews. If that is not available, searching for the phrase "systematic review" in the title of your search results will also work.
Systematic Search Process
Please contact your subject librarian for assistance with the development of a systematic search strategy.
Build Your Search
Once all terms have been identified, you need to put them together in a search string. You can export your search strategy in addition to the results, to use in your search documentation.
A search string will generally look like:
(Topic A term 1 OR Topic A term 2) AND (Topic B term 1 OR Topic B term 2) AND (Topic C term 1 OR Topic C term 2)
If searching PubMed with our example research question, the search string would look like:
(obesity OR overweight OR obese OR "morbidly obese" OR "Obesity"[Mesh] OR "Obesity, Morbid"[Mesh]) AND ("heart disease" OR "cardiac diseases" OR "heart disorders" OR cardiovascular OR "Heart Diseases"[Mesh]) AND (stroke OR "cerebrovascular accidents" OR "Stroke"[Mesh])
The search string above was developed for PubMed. When adapting the string for another database, you want to have the strings operate as similarly as possible. You would replace the MeSH terms with the controlled vocabulary of the other databases used.
The search string above is searching with both keywords and MeSH terms. The MeSH terms will be searched in the MeSH field. The keywords will be searched in all fields, like the title, abstract, journal name, etc.
Translate Your Search
In a systematic review, you will need to keep the search as similar as possible between different databases. (That is the 'systematic' piece of the search process.) In practice, you should only need to change a few things for each database:
- Applying consistent search limiters to each database
- Searching the same fields in each database
- Applying the controlled vocabulary of each database
As experts in database searching, librarians can help you translate your search string between different databases.
- Polyglot Search
Polyglot is a tool that will automatically translate your search from PubMed to other major databases such as Scopus and CINAHL. Note that Polyglot can only translate search syntax, so you will still need to manually translate your controlled vocabulary terms.
Run a Pilot Search & Screen
After the search strategy is developed, the search is translated and run in the identified databases and search engines.
The results from each resource is transferred to a separate dated file in the citation manager.
The team members then perform a blind screen of the pilot search results.
The purpose of the pilot search and screen are to:
- Ensure sensitivity and specificity of search strategy
- Provide feedback for necessary refinement of search strategy
- Ensure consistency among screeners for inclusion/exclusion criteria
Citation Chasing
Citation chasing is a technique you can use to identify relevant literature that may be missed in traditional systematic search methods. Citation chasing uses the citations of relevant articles to identify additional articles of relevance.
Citation Chasing Process
- Identify highly relevant articles for your review
- Consider using your exemplar articles
- Review the references of your chosen articles
- Identify articles relevant to your review and include them in the screening process
- Review articles that have cited your chosen articles
- Identify articles relevant to your review and include them in the screening process
There are some helpful tools that can streamline and automate this process.
- Citation Chaser
Citation Chaser can be used to easily identify articles that are citing or are being cited by specific articles you have identified as being relevant to your research topic.
- Systematic Review Accelator
The SR-Accelarator's tool, SpiderCite, can be used to take an input library of articles which were chosen for inclusion in a study, and generate all forwards and backwards citations (1 level deep) of those articles.
PRISMA 2020 Checklist for Search Reporting
The PRISMA Reporting Standards are used only for documenting the methodology of a systematic review.
They are NOT standards that state how to conduct the review.
- Last Updated: Nov 26, 2024 8:59 AM
- URL: https://libraryguides.binghamton.edu/systematicreview
- Print Page