how is literature review used

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base

Methodology

• How to Write a Literature Review | Guide, Examples, & Templates

How to Write a Literature Review | Guide, Examples, & Templates

Published on January 2, 2023 by Shona McCombes . Revised on September 11, 2023.

What is a literature review? A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research that you can later apply to your paper, thesis, or dissertation topic .

There are five key steps to writing a literature review:

• Search for relevant literature
• Evaluate sources
• Identify themes, debates, and gaps
• Outline the structure
• Write your literature review

A good literature review doesn’t just summarize sources—it analyzes, synthesizes , and critically evaluates to give a clear picture of the state of knowledge on the subject.

Instantly correct all language mistakes in your text

Upload your document to correct all your mistakes in minutes

Table of contents

What is the purpose of a literature review, examples of literature reviews, step 1 – search for relevant literature, step 2 – evaluate and select sources, step 3 – identify themes, debates, and gaps, step 4 – outline your literature review’s structure, step 5 – write your literature review, free lecture slides, other interesting articles, frequently asked questions, introduction.

• Quick Run-through
• Step 1 & 2

When you write a thesis , dissertation , or research paper , you will likely have to conduct a literature review to situate your research within existing knowledge. The literature review gives you a chance to:

• Demonstrate your familiarity with the topic and its scholarly context
• Develop a theoretical framework and methodology for your research
• Position your work in relation to other researchers and theorists
• Show how your research addresses a gap or contributes to a debate
• Evaluate the current state of research and demonstrate your knowledge of the scholarly debates around your topic.

Writing literature reviews is a particularly important skill if you want to apply for graduate school or pursue a career in research. We’ve written a step-by-step guide that you can follow below.

Receive feedback on language, structure, and formatting

Professional editors proofread and edit your paper by focusing on:

• Academic style
• Vague sentences
• Style consistency

See an example

Writing literature reviews can be quite challenging! A good starting point could be to look at some examples, depending on what kind of literature review you’d like to write.

• Example literature review #1: “Why Do People Migrate? A Review of the Theoretical Literature” ( Theoretical literature review about the development of economic migration theory from the 1950s to today.)
• Example literature review #2: “Literature review as a research methodology: An overview and guidelines” ( Methodological literature review about interdisciplinary knowledge acquisition and production.)
• Example literature review #3: “The Use of Technology in English Language Learning: A Literature Review” ( Thematic literature review about the effects of technology on language acquisition.)
• Example literature review #4: “Learners’ Listening Comprehension Difficulties in English Language Learning: A Literature Review” ( Chronological literature review about how the concept of listening skills has changed over time.)

You can also check out our templates with literature review examples and sample outlines at the links below.

Download Word doc Download Google doc

Before you begin searching for literature, you need a clearly defined topic .

If you are writing the literature review section of a dissertation or research paper, you will search for literature related to your research problem and questions .

Make a list of keywords

Start by creating a list of keywords related to your research question. Include each of the key concepts or variables you’re interested in, and list any synonyms and related terms. You can add to this list as you discover new keywords in the process of your literature search.

• Social media, Facebook, Instagram, Twitter, Snapchat, TikTok
• Body image, self-perception, self-esteem, mental health
• Generation Z, teenagers, adolescents, youth

Search for relevant sources

Use your keywords to begin searching for sources. Some useful databases to search for journals and articles include:

• Your university’s library catalogue
• Google Scholar
• Project Muse (humanities and social sciences)
• Medline (life sciences and biomedicine)
• EconLit (economics)
• Inspec (physics, engineering and computer science)

You can also use boolean operators to help narrow down your search.

Make sure to read the abstract to find out whether an article is relevant to your question. When you find a useful book or article, you can check the bibliography to find other relevant sources.

You likely won’t be able to read absolutely everything that has been written on your topic, so it will be necessary to evaluate which sources are most relevant to your research question.

For each publication, ask yourself:

• What question or problem is the author addressing?
• What are the key concepts and how are they defined?
• What are the key theories, models, and methods?
• Does the research use established frameworks or take an innovative approach?
• What are the results and conclusions of the study?
• How does the publication relate to other literature in the field? Does it confirm, add to, or challenge established knowledge?
• What are the strengths and weaknesses of the research?

Make sure the sources you use are credible , and make sure you read any landmark studies and major theories in your field of research.

You can use our template to summarize and evaluate sources you’re thinking about using. Click on either button below to download.

Take notes and cite your sources

As you read, you should also begin the writing process. Take notes that you can later incorporate into the text of your literature review.

It is important to keep track of your sources with citations to avoid plagiarism . It can be helpful to make an annotated bibliography , where you compile full citation information and write a paragraph of summary and analysis for each source. This helps you remember what you read and saves time later in the process.

The only proofreading tool specialized in correcting academic writing - try for free!

The academic proofreading tool has been trained on 1000s of academic texts and by native English editors. Making it the most accurate and reliable proofreading tool for students.

Try for free

To begin organizing your literature review’s argument and structure, be sure you understand the connections and relationships between the sources you’ve read. Based on your reading and notes, you can look for:

• Trends and patterns (in theory, method or results): do certain approaches become more or less popular over time?
• Themes: what questions or concepts recur across the literature?
• Debates, conflicts and contradictions: where do sources disagree?
• Pivotal publications: are there any influential theories or studies that changed the direction of the field?
• Gaps: what is missing from the literature? Are there weaknesses that need to be addressed?

This step will help you work out the structure of your literature review and (if applicable) show how your own research will contribute to existing knowledge.

• Most research has focused on young women.
• There is an increasing interest in the visual aspects of social media.
• But there is still a lack of robust research on highly visual platforms like Instagram and Snapchat—this is a gap that you could address in your own research.

There are various approaches to organizing the body of a literature review. Depending on the length of your literature review, you can combine several of these strategies (for example, your overall structure might be thematic, but each theme is discussed chronologically).

Chronological

The simplest approach is to trace the development of the topic over time. However, if you choose this strategy, be careful to avoid simply listing and summarizing sources in order.

Try to analyze patterns, turning points and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred.

If you have found some recurring central themes, you can organize your literature review into subsections that address different aspects of the topic.

For example, if you are reviewing literature about inequalities in migrant health outcomes, key themes might include healthcare policy, language barriers, cultural attitudes, legal status, and economic access.

Methodological

If you draw your sources from different disciplines or fields that use a variety of research methods , you might want to compare the results and conclusions that emerge from different approaches. For example:

• Look at what results have emerged in qualitative versus quantitative research
• Discuss how the topic has been approached by empirical versus theoretical scholarship
• Divide the literature into sociological, historical, and cultural sources

Theoretical

A literature review is often the foundation for a theoretical framework . You can use it to discuss various theories, models, and definitions of key concepts.

You might argue for the relevance of a specific theoretical approach, or combine various theoretical concepts to create a framework for your research.

Like any other academic text , your literature review should have an introduction , a main body, and a conclusion . What you include in each depends on the objective of your literature review.

The introduction should clearly establish the focus and purpose of the literature review.

Depending on the length of your literature review, you might want to divide the body into subsections. You can use a subheading for each theme, time period, or methodological approach.

As you write, you can follow these tips:

• Summarize and synthesize: give an overview of the main points of each source and combine them into a coherent whole
• Analyze and interpret: don’t just paraphrase other researchers — add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
• Critically evaluate: mention the strengths and weaknesses of your sources
• Write in well-structured paragraphs: use transition words and topic sentences to draw connections, comparisons and contrasts

In the conclusion, you should summarize the key findings you have taken from the literature and emphasize their significance.

When you’ve finished writing and revising your literature review, don’t forget to proofread thoroughly before submitting. Not a language expert? Check out Scribbr’s professional proofreading services !

This article has been adapted into lecture slides that you can use to teach your students about writing a literature review.

Scribbr slides are free to use, customize, and distribute for educational purposes.

Open Google Slides Download PowerPoint

If you want to know more about the research process , methodology , research bias , or statistics , make sure to check out some of our other articles with explanations and examples.

• Sampling methods
• Simple random sampling
• Stratified sampling
• Cluster sampling
• Likert scales
• Reproducibility

 Statistics

• Null hypothesis
• Statistical power
• Probability distribution
• Effect size
• Poisson distribution

Research bias

• Optimism bias
• Cognitive bias
• Implicit bias
• Hawthorne effect
• Anchoring bias
• Explicit bias

A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .

It is often written as part of a thesis, dissertation , or research paper , in order to situate your work in relation to existing knowledge.

There are several reasons to conduct a literature review at the beginning of a research project:

• To familiarize yourself with the current state of knowledge on your topic
• To ensure that you’re not just repeating what others have already done
• To identify gaps in knowledge and unresolved problems that your research can address
• To develop your theoretical framework and methodology
• To provide an overview of the key findings and debates on the topic

Writing the literature review shows your reader how your work relates to existing research and what new insights it will contribute.

The literature review usually comes near the beginning of your thesis or dissertation . After the introduction , it grounds your research in a scholarly field and leads directly to your theoretical framework or methodology .

A literature review is a survey of credible sources on a topic, often used in dissertations , theses, and research papers . Literature reviews give an overview of knowledge on a subject, helping you identify relevant theories and methods, as well as gaps in existing research. Literature reviews are set up similarly to other  academic texts , with an introduction , a main body, and a conclusion .

An  annotated bibliography is a list of  source references that has a short description (called an annotation ) for each of the sources. It is often assigned as part of the research process for a  paper .  

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

McCombes, S. (2023, September 11). How to Write a Literature Review | Guide, Examples, & Templates. Scribbr. Retrieved April 15, 2024, from https://www.scribbr.com/dissertation/literature-review/

Is this article helpful?

Shona McCombes

Other students also liked, what is a theoretical framework | guide to organizing, what is a research methodology | steps & tips, how to write a research proposal | examples & templates, what is your plagiarism score.

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

Writing a Literature Review

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays). When we say “literature review” or refer to “the literature,” we are talking about the research ( scholarship ) in a given field. You will often see the terms “the research,” “the scholarship,” and “the literature” used mostly interchangeably.

Where, when, and why would I write a lit review?

There are a number of different situations where you might write a literature review, each with slightly different expectations; different disciplines, too, have field-specific expectations for what a literature review is and does. For instance, in the humanities, authors might include more overt argumentation and interpretation of source material in their literature reviews, whereas in the sciences, authors are more likely to report study designs and results in their literature reviews; these differences reflect these disciplines’ purposes and conventions in scholarship. You should always look at examples from your own discipline and talk to professors or mentors in your field to be sure you understand your discipline’s conventions, for literature reviews as well as for any other genre.

A literature review can be a part of a research paper or scholarly article, usually falling after the introduction and before the research methods sections. In these cases, the lit review just needs to cover scholarship that is important to the issue you are writing about; sometimes it will also cover key sources that informed your research methodology.

Lit reviews can also be standalone pieces, either as assignments in a class or as publications. In a class, a lit review may be assigned to help students familiarize themselves with a topic and with scholarship in their field, get an idea of the other researchers working on the topic they’re interested in, find gaps in existing research in order to propose new projects, and/or develop a theoretical framework and methodology for later research. As a publication, a lit review usually is meant to help make other scholars’ lives easier by collecting and summarizing, synthesizing, and analyzing existing research on a topic. This can be especially helpful for students or scholars getting into a new research area, or for directing an entire community of scholars toward questions that have not yet been answered.

What are the parts of a lit review?

Most lit reviews use a basic introduction-body-conclusion structure; if your lit review is part of a larger paper, the introduction and conclusion pieces may be just a few sentences while you focus most of your attention on the body. If your lit review is a standalone piece, the introduction and conclusion take up more space and give you a place to discuss your goals, research methods, and conclusions separately from where you discuss the literature itself.

Introduction:

• An introductory paragraph that explains what your working topic and thesis is
• A forecast of key topics or texts that will appear in the review
• Potentially, a description of how you found sources and how you analyzed them for inclusion and discussion in the review (more often found in published, standalone literature reviews than in lit review sections in an article or research paper)
• Summarize and synthesize: Give an overview of the main points of each source and combine them into a coherent whole
• Analyze and interpret: Don’t just paraphrase other researchers – add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
• Critically Evaluate: Mention the strengths and weaknesses of your sources
• Write in well-structured paragraphs: Use transition words and topic sentence to draw connections, comparisons, and contrasts.

Conclusion:

• Summarize the key findings you have taken from the literature and emphasize their significance
• Connect it back to your primary research question

How should I organize my lit review?

Lit reviews can take many different organizational patterns depending on what you are trying to accomplish with the review. Here are some examples:

• Chronological : The simplest approach is to trace the development of the topic over time, which helps familiarize the audience with the topic (for instance if you are introducing something that is not commonly known in your field). If you choose this strategy, be careful to avoid simply listing and summarizing sources in order. Try to analyze the patterns, turning points, and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred (as mentioned previously, this may not be appropriate in your discipline — check with a teacher or mentor if you’re unsure).
• Thematic : If you have found some recurring central themes that you will continue working with throughout your piece, you can organize your literature review into subsections that address different aspects of the topic. For example, if you are reviewing literature about women and religion, key themes can include the role of women in churches and the religious attitude towards women.
• Qualitative versus quantitative research
• Empirical versus theoretical scholarship
• Divide the research by sociological, historical, or cultural sources
• Theoretical : In many humanities articles, the literature review is the foundation for the theoretical framework. You can use it to discuss various theories, models, and definitions of key concepts. You can argue for the relevance of a specific theoretical approach or combine various theorical concepts to create a framework for your research.

What are some strategies or tips I can use while writing my lit review?

Any lit review is only as good as the research it discusses; make sure your sources are well-chosen and your research is thorough. Don’t be afraid to do more research if you discover a new thread as you’re writing. More info on the research process is available in our "Conducting Research" resources .

As you’re doing your research, create an annotated bibliography ( see our page on the this type of document ). Much of the information used in an annotated bibliography can be used also in a literature review, so you’ll be not only partially drafting your lit review as you research, but also developing your sense of the larger conversation going on among scholars, professionals, and any other stakeholders in your topic.

Usually you will need to synthesize research rather than just summarizing it. This means drawing connections between sources to create a picture of the scholarly conversation on a topic over time. Many student writers struggle to synthesize because they feel they don’t have anything to add to the scholars they are citing; here are some strategies to help you:

• It often helps to remember that the point of these kinds of syntheses is to show your readers how you understand your research, to help them read the rest of your paper.
• Writing teachers often say synthesis is like hosting a dinner party: imagine all your sources are together in a room, discussing your topic. What are they saying to each other?
• Look at the in-text citations in each paragraph. Are you citing just one source for each paragraph? This usually indicates summary only. When you have multiple sources cited in a paragraph, you are more likely to be synthesizing them (not always, but often
• Read more about synthesis here.

The most interesting literature reviews are often written as arguments (again, as mentioned at the beginning of the page, this is discipline-specific and doesn’t work for all situations). Often, the literature review is where you can establish your research as filling a particular gap or as relevant in a particular way. You have some chance to do this in your introduction in an article, but the literature review section gives a more extended opportunity to establish the conversation in the way you would like your readers to see it. You can choose the intellectual lineage you would like to be part of and whose definitions matter most to your thinking (mostly humanities-specific, but this goes for sciences as well). In addressing these points, you argue for your place in the conversation, which tends to make the lit review more compelling than a simple reporting of other sources.

• UConn Library
• Literature Review: The What, Why and How-to Guide
• Introduction

Literature Review: The What, Why and How-to Guide — Introduction

• Getting Started
• How to Pick a Topic
• Strategies to Find Sources
• Evaluating Sources & Lit. Reviews
• Tips for Writing Literature Reviews
• Writing Literature Review: Useful Sites
• Citation Resources
• Other Academic Writings

What are Literature Reviews?

So, what is a literature review? "A literature review is an account of what has been published on a topic by accredited scholars and researchers. In writing the literature review, your purpose is to convey to your reader what knowledge and ideas have been established on a topic, and what their strengths and weaknesses are. As a piece of writing, the literature review must be defined by a guiding concept (e.g., your research objective, the problem or issue you are discussing, or your argumentative thesis). It is not just a descriptive list of the material available, or a set of summaries." Taylor, D.  The literature review: A few tips on conducting it . University of Toronto Health Sciences Writing Centre.

Goals of Literature Reviews

What are the goals of creating a Literature Review?  A literature could be written to accomplish different aims:

• To develop a theory or evaluate an existing theory
• To summarize the historical or existing state of a research topic
• Identify a problem in a field of research 

Baumeister, R. F., & Leary, M. R. (1997). Writing narrative literature reviews .  Review of General Psychology , 1 (3), 311-320.

What kinds of sources require a Literature Review?

• A research paper assigned in a course
• A thesis or dissertation
• A grant proposal
• An article intended for publication in a journal

All these instances require you to collect what has been written about your research topic so that you can demonstrate how your own research sheds new light on the topic.

Types of Literature Reviews

What kinds of literature reviews are written?

Narrative review: The purpose of this type of review is to describe the current state of the research on a specific topic/research and to offer a critical analysis of the literature reviewed. Studies are grouped by research/theoretical categories, and themes and trends, strengths and weakness, and gaps are identified. The review ends with a conclusion section which summarizes the findings regarding the state of the research of the specific study, the gaps identify and if applicable, explains how the author's research will address gaps identify in the review and expand the knowledge on the topic reviewed.

• Example : Predictors and Outcomes of U.S. Quality Maternity Leave: A Review and Conceptual Framework:  10.1177/08948453211037398  

Systematic review : "The authors of a systematic review use a specific procedure to search the research literature, select the studies to include in their review, and critically evaluate the studies they find." (p. 139). Nelson, L. K. (2013). Research in Communication Sciences and Disorders . Plural Publishing.

• Example : The effect of leave policies on increasing fertility: a systematic review:  10.1057/s41599-022-01270-w

Meta-analysis : "Meta-analysis is a method of reviewing research findings in a quantitative fashion by transforming the data from individual studies into what is called an effect size and then pooling and analyzing this information. The basic goal in meta-analysis is to explain why different outcomes have occurred in different studies." (p. 197). Roberts, M. C., & Ilardi, S. S. (2003). Handbook of Research Methods in Clinical Psychology . Blackwell Publishing.

• Example : Employment Instability and Fertility in Europe: A Meta-Analysis:  10.1215/00703370-9164737

Meta-synthesis : "Qualitative meta-synthesis is a type of qualitative study that uses as data the findings from other qualitative studies linked by the same or related topic." (p.312). Zimmer, L. (2006). Qualitative meta-synthesis: A question of dialoguing with texts .  Journal of Advanced Nursing , 53 (3), 311-318.

• Example : Women’s perspectives on career successes and barriers: A qualitative meta-synthesis:  10.1177/05390184221113735

Literature Reviews in the Health Sciences

• UConn Health subject guide on systematic reviews Explanation of the different review types used in health sciences literature as well as tools to help you find the right review type
• << Previous: Getting Started
• Next: How to Pick a Topic >>
• Last Updated: Sep 21, 2022 2:16 PM
• URL: https://guides.lib.uconn.edu/literaturereview

• Resources Home 🏠
• Try SciSpace Copilot
• Search research papers
• Add Copilot Extension
• Try AI Detector
• Try Paraphraser
• Try Citation Generator
• April Papers
• June Papers
• July Papers

How To Write A Literature Review - A Complete Guide

Table of Contents

A literature review is much more than just another section in your research paper. It forms the very foundation of your research. It is a formal piece of writing where you analyze the existing theoretical framework, principles, and assumptions and use that as a base to shape your approach to the research question.

Curating and drafting a solid literature review section not only lends more credibility to your research paper but also makes your research tighter and better focused. But, writing literature reviews is a difficult task. It requires extensive reading, plus you have to consider market trends and technological and political changes, which tend to change in the blink of an eye.

Now streamline your literature review process with the help of SciSpace Copilot. With this AI research assistant, you can efficiently synthesize and analyze a vast amount of information, identify key themes and trends, and uncover gaps in the existing research. Get real-time explanations, summaries, and answers to your questions for the paper you're reviewing, making navigating and understanding the complex literature landscape easier.

In this comprehensive guide, we will explore everything from the definition of a literature review, its appropriate length, various types of literature reviews, and how to write one.

What is a literature review?

A literature review is a collation of survey, research, critical evaluation, and assessment of the existing literature in a preferred domain.

Eminent researcher and academic Arlene Fink, in her book Conducting Research Literature Reviews , defines it as the following:

“A literature review surveys books, scholarly articles, and any other sources relevant to a particular issue, area of research, or theory, and by so doing, provides a description, summary, and critical evaluation of these works in relation to the research problem being investigated.

Literature reviews are designed to provide an overview of sources you have explored while researching a particular topic, and to demonstrate to your readers how your research fits within a larger field of study.”

Simply put, a literature review can be defined as a critical discussion of relevant pre-existing research around your research question and carving out a definitive place for your study in the existing body of knowledge. Literature reviews can be presented in multiple ways: a section of an article, the whole research paper itself, or a chapter of your thesis.

A literature review does function as a summary of sources, but it also allows you to analyze further, interpret, and examine the stated theories, methods, viewpoints, and, of course, the gaps in the existing content.

As an author, you can discuss and interpret the research question and its various aspects and debate your adopted methods to support the claim.

What is the purpose of a literature review?

A literature review is meant to help your readers understand the relevance of your research question and where it fits within the existing body of knowledge. As a researcher, you should use it to set the context, build your argument, and establish the need for your study.

What is the importance of a literature review?

The literature review is a critical part of research papers because it helps you:

• Gain an in-depth understanding of your research question and the surrounding area
• Convey that you have a thorough understanding of your research area and are up-to-date with the latest changes and advancements
• Establish how your research is connected or builds on the existing body of knowledge and how it could contribute to further research
• Elaborate on the validity and suitability of your theoretical framework and research methodology
• Identify and highlight gaps and shortcomings in the existing body of knowledge and how things need to change
• Convey to readers how your study is different or how it contributes to the research area

How long should a literature review be?

Ideally, the literature review should take up 15%-40% of the total length of your manuscript. So, if you have a 10,000-word research paper, the minimum word count could be 1500.

Your literature review format depends heavily on the kind of manuscript you are writing — an entire chapter in case of doctoral theses, a part of the introductory section in a research article, to a full-fledged review article that examines the previously published research on a topic.

Another determining factor is the type of research you are doing. The literature review section tends to be longer for secondary research projects than primary research projects.

What are the different types of literature reviews?

All literature reviews are not the same. There are a variety of possible approaches that you can take. It all depends on the type of research you are pursuing.

Here are the different types of literature reviews:

Argumentative review

It is called an argumentative review when you carefully present literature that only supports or counters a specific argument or premise to establish a viewpoint.

Integrative review

It is a type of literature review focused on building a comprehensive understanding of a topic by combining available theoretical frameworks and empirical evidence.

Methodological review

This approach delves into the ''how'' and the ''what" of the research question —  you cannot look at the outcome in isolation; you should also review the methodology used.

Systematic review

This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research and collect, report, and analyze data from the studies included in the review.

Meta-analysis review

Meta-analysis uses statistical methods to summarize the results of independent studies. By combining information from all relevant studies, meta-analysis can provide more precise estimates of the effects than those derived from the individual studies included within a review.

Historical review

Historical literature reviews focus on examining research throughout a period, often starting with the first time an issue, concept, theory, or phenomenon emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and identify future research's likely directions.

Theoretical Review

This form aims to examine the corpus of theory accumulated regarding an issue, concept, theory, and phenomenon. The theoretical literature review helps to establish what theories exist, the relationships between them, the degree the existing approaches have been investigated, and to develop new hypotheses to be tested.

Scoping Review

The Scoping Review is often used at the beginning of an article, dissertation, or research proposal. It is conducted before the research to highlight gaps in the existing body of knowledge and explains why the project should be greenlit.

State-of-the-Art Review

The State-of-the-Art review is conducted periodically, focusing on the most recent research. It describes what is currently known, understood, or agreed upon regarding the research topic and highlights where there are still disagreements.

Can you use the first person in a literature review?

When writing literature reviews, you should avoid the usage of first-person pronouns. It means that instead of "I argue that" or "we argue that," the appropriate expression would be "this research paper argues that."

Do you need an abstract for a literature review?

Ideally, yes. It is always good to have a condensed summary that is self-contained and independent of the rest of your review. As for how to draft one, you can follow the same fundamental idea when preparing an abstract for a literature review. It should also include:

• The research topic and your motivation behind selecting it
• A one-sentence thesis statement
• An explanation of the kinds of literature featured in the review
• Summary of what you've learned
• Conclusions you drew from the literature you reviewed
• Potential implications and future scope for research

Here's an example of the abstract of a literature review

Is a literature review written in the past tense?

Yes, the literature review should ideally be written in the past tense. You should not use the present or future tense when writing one. The exceptions are when you have statements describing events that happened earlier than the literature you are reviewing or events that are currently occurring; then, you can use the past perfect or present perfect tenses.

How many sources for a literature review?

There are multiple approaches to deciding how many sources to include in a literature review section. The first approach would be to look level you are at as a researcher. For instance, a doctoral thesis might need 60+ sources. In contrast, you might only need to refer to 5-15 sources at the undergraduate level.

The second approach is based on the kind of literature review you are doing — whether it is merely a chapter of your paper or if it is a self-contained paper in itself. When it is just a chapter, sources should equal the total number of pages in your article's body. In the second scenario, you need at least three times as many sources as there are pages in your work.

Quick tips on how to write a literature review

To know how to write a literature review, you must clearly understand its impact and role in establishing your work as substantive research material.

You need to follow the below-mentioned steps, to write a literature review:

• Outline the purpose behind the literature review
• Search relevant literature
• Examine and assess the relevant resources
• Discover connections by drawing deep insights from the resources
• Structure planning to write a good literature review

1. Outline and identify the purpose of  a literature review

As a first step on how to write a literature review, you must know what the research question or topic is and what shape you want your literature review to take. Ensure you understand the research topic inside out, or else seek clarifications. You must be able to the answer below questions before you start:

• How many sources do I need to include?
• What kind of sources should I analyze?
• How much should I critically evaluate each source?
• Should I summarize, synthesize or offer a critique of the sources?
• Do I need to include any background information or definitions?

Additionally, you should know that the narrower your research topic is, the swifter it will be for you to restrict the number of sources to be analyzed.

2. Search relevant literature

Dig deeper into search engines to discover what has already been published around your chosen topic. Make sure you thoroughly go through appropriate reference sources like books, reports, journal articles, government docs, and web-based resources.

You must prepare a list of keywords and their different variations. You can start your search from any library’s catalog, provided you are an active member of that institution. The exact keywords can be extended to widen your research over other databases and academic search engines like:

• Google Scholar
• Microsoft Academic
• Science.gov

Besides, it is not advisable to go through every resource word by word. Alternatively, what you can do is you can start by reading the abstract and then decide whether that source is relevant to your research or not.

Additionally, you must spend surplus time assessing the quality and relevance of resources. It would help if you tried preparing a list of citations to ensure that there lies no repetition of authors, publications, or articles in the literature review.

3. Examine and assess the sources

It is nearly impossible for you to go through every detail in the research article. So rather than trying to fetch every detail, you have to analyze and decide which research sources resemble closest and appear relevant to your chosen domain.

While analyzing the sources, you should look to find out answers to questions like:

• What question or problem has the author been describing and debating?
• What is the definition of critical aspects?
• How well the theories, approach, and methodology have been explained?
• Whether the research theory used some conventional or new innovative approach?
• How relevant are the key findings of the work?
• In what ways does it relate to other sources on the same topic?
• What challenges does this research paper pose to the existing theory
• What are the possible contributions or benefits it adds to the subject domain?

Be always mindful that you refer only to credible and authentic resources. It would be best if you always take references from different publications to validate your theory.

Always keep track of important information or data you can present in your literature review right from the beginning. It will help steer your path from any threats of plagiarism and also make it easier to curate an annotated bibliography or reference section.

4. Discover connections

At this stage, you must start deciding on the argument and structure of your literature review. To accomplish this, you must discover and identify the relations and connections between various resources while drafting your abstract.

A few aspects that you should be aware of while writing a literature review include:

• Rise to prominence: Theories and methods that have gained reputation and supporters over time.
• Constant scrutiny: Concepts or theories that repeatedly went under examination.
• Contradictions and conflicts: Theories, both the supporting and the contradictory ones, for the research topic.
• Knowledge gaps: What exactly does it fail to address, and how to bridge them with further research?
• Influential resources: Significant research projects available that have been upheld as milestones or perhaps, something that can modify the current trends

Once you join the dots between various past research works, it will be easier for you to draw a conclusion and identify your contribution to the existing knowledge base.

5. Structure planning to write a good literature review

There exist different ways towards planning and executing the structure of a literature review. The format of a literature review varies and depends upon the length of the research.

Like any other research paper, the literature review format must contain three sections: introduction, body, and conclusion. The goals and objectives of the research question determine what goes inside these three sections.

Nevertheless, a good literature review can be structured according to the chronological, thematic, methodological, or theoretical framework approach.

Literature review samples

1. Standalone

2. As a section of a research paper

How SciSpace Discover makes literature review a breeze?

SciSpace Discover is a one-stop solution to do an effective literature search and get barrier-free access to scientific knowledge. It is an excellent repository where you can find millions of only peer-reviewed articles and full-text PDF files. Here’s more on how you can use it:

Find the right information

Find what you want quickly and easily with comprehensive search filters that let you narrow down papers according to PDF availability, year of publishing, document type, and affiliated institution. Moreover, you can sort the results based on the publishing date, citation count, and relevance.

Assess credibility of papers quickly

When doing the literature review, it is critical to establish the quality of your sources. They form the foundation of your research. SciSpace Discover helps you assess the quality of a source by providing an overview of its references, citations, and performance metrics.

Get the complete picture in no time

SciSpace Discover’s personalized suggestion engine helps you stay on course and get the complete picture of the topic from one place. Every time you visit an article page, it provides you links to related papers. Besides that, it helps you understand what’s trending, who are the top authors, and who are the leading publishers on a topic.

Make referring sources super easy

To ensure you don't lose track of your sources, you must start noting down your references when doing the literature review. SciSpace Discover makes this step effortless. Click the 'cite' button on an article page, and you will receive preloaded citation text in multiple styles — all you've to do is copy-paste it into your manuscript.

Final tips on how to write a literature review

A massive chunk of time and effort is required to write a good literature review. But, if you go about it systematically, you'll be able to save a ton of time and build a solid foundation for your research.

We hope this guide has helped you answer several key questions you have about writing literature reviews.

Would you like to explore SciSpace Discover and kick off your literature search right away? You can get started here .

Frequently Asked Questions (FAQs)

1. how to start a literature review.

• What questions do you want to answer?

• What sources do you need to answer these questions?

• What information do these sources contain?

• How can you use this information to answer your questions?

2. What to include in a literature review?

• A brief background of the problem or issue

• What has previously been done to address the problem or issue

• A description of what you will do in your project

• How this study will contribute to research on the subject

3. Why literature review is important?

The literature review is an important part of any research project because it allows the writer to look at previous studies on a topic and determine existing gaps in the literature, as well as what has already been done. It will also help them to choose the most appropriate method for their own study.

4. How to cite a literature review in APA format?

To cite a literature review in APA style, you need to provide the author's name, the title of the article, and the year of publication. For example: Patel, A. B., & Stokes, G. S. (2012). The relationship between personality and intelligence: A meta-analysis of longitudinal research. Personality and Individual Differences, 53(1), 16-21

5. What are the components of a literature review?

• A brief introduction to the topic, including its background and context. The introduction should also include a rationale for why the study is being conducted and what it will accomplish.

• A description of the methodologies used in the study. This can include information about data collection methods, sample size, and statistical analyses.

• A presentation of the findings in an organized format that helps readers follow along with the author's conclusions.

6. What are common errors in writing literature review?

• Not spending enough time to critically evaluate the relevance of resources, observations and conclusions.

• Totally relying on secondary data while ignoring primary data.

• Letting your personal bias seep into your interpretation of existing literature.

• No detailed explanation of the procedure to discover and identify an appropriate literature review.

7. What are the 5 C's of writing literature review?

• Cite - the sources you utilized and referenced in your research.

• Compare - existing arguments, hypotheses, methodologies, and conclusions found in the knowledge base.

• Contrast - the arguments, topics, methodologies, approaches, and disputes that may be found in the literature.

• Critique - the literature and describe the ideas and opinions you find more convincing and why.

• Connect - the various studies you reviewed in your research.

8. How many sources should a literature review have?

When it is just a chapter, sources should equal the total number of pages in your article's body. if it is a self-contained paper in itself, you need at least three times as many sources as there are pages in your work.

9. Can literature review have diagrams?

• To represent an abstract idea or concept

• To explain the steps of a process or procedure

• To help readers understand the relationships between different concepts

10. How old should sources be in a literature review?

Sources for a literature review should be as current as possible or not older than ten years. The only exception to this rule is if you are reviewing a historical topic and need to use older sources.

11. What are the types of literature review?

• Argumentative review

• Integrative review

• Methodological review

• Systematic review

• Meta-analysis review

• Historical review

• Theoretical review

• Scoping review

• State-of-the-Art review

12. Is a literature review mandatory?

Yes. Literature review is a mandatory part of any research project. It is a critical step in the process that allows you to establish the scope of your research, and provide a background for the rest of your work.

But before you go,

• Six Online Tools for Easy Literature Review
• Evaluating literature review: systematic vs. scoping reviews
• Systematic Approaches to a Successful Literature Review
• Writing Integrative Literature Reviews: Guidelines and Examples

You might also like

Consensus GPT vs. SciSpace GPT: Choose the Best GPT for Research

Literature Review and Theoretical Framework: Understanding the Differences

Types of Essays in Academic Writing - Quick Guide (2024)

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

• Knowledge Base
• Dissertation
• What is a Literature Review? | Guide, Template, & Examples

What is a Literature Review? | Guide, Template, & Examples

Published on 22 February 2022 by Shona McCombes . Revised on 7 June 2022.

What is a literature review? A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research.

There are five key steps to writing a literature review:

• Search for relevant literature
• Evaluate sources
• Identify themes, debates and gaps
• Outline the structure
• Write your literature review

A good literature review doesn’t just summarise sources – it analyses, synthesises, and critically evaluates to give a clear picture of the state of knowledge on the subject.

Instantly correct all language mistakes in your text

Be assured that you'll submit flawless writing. Upload your document to correct all your mistakes.

Table of contents

Why write a literature review, examples of literature reviews, step 1: search for relevant literature, step 2: evaluate and select sources, step 3: identify themes, debates and gaps, step 4: outline your literature review’s structure, step 5: write your literature review, frequently asked questions about literature reviews, introduction.

• Quick Run-through
• Step 1 & 2

When you write a dissertation or thesis, you will have to conduct a literature review to situate your research within existing knowledge. The literature review gives you a chance to:

• Demonstrate your familiarity with the topic and scholarly context
• Develop a theoretical framework and methodology for your research
• Position yourself in relation to other researchers and theorists
• Show how your dissertation addresses a gap or contributes to a debate

You might also have to write a literature review as a stand-alone assignment. In this case, the purpose is to evaluate the current state of research and demonstrate your knowledge of scholarly debates around a topic.

The content will look slightly different in each case, but the process of conducting a literature review follows the same steps. We’ve written a step-by-step guide that you can follow below.

Prevent plagiarism, run a free check.

Writing literature reviews can be quite challenging! A good starting point could be to look at some examples, depending on what kind of literature review you’d like to write.

• Example literature review #1: “Why Do People Migrate? A Review of the Theoretical Literature” ( Theoretical literature review about the development of economic migration theory from the 1950s to today.)
• Example literature review #2: “Literature review as a research methodology: An overview and guidelines” ( Methodological literature review about interdisciplinary knowledge acquisition and production.)
• Example literature review #3: “The Use of Technology in English Language Learning: A Literature Review” ( Thematic literature review about the effects of technology on language acquisition.)
• Example literature review #4: “Learners’ Listening Comprehension Difficulties in English Language Learning: A Literature Review” ( Chronological literature review about how the concept of listening skills has changed over time.)

You can also check out our templates with literature review examples and sample outlines at the links below.

Download Word doc Download Google doc

Before you begin searching for literature, you need a clearly defined topic .

If you are writing the literature review section of a dissertation or research paper, you will search for literature related to your research objectives and questions .

If you are writing a literature review as a stand-alone assignment, you will have to choose a focus and develop a central question to direct your search. Unlike a dissertation research question, this question has to be answerable without collecting original data. You should be able to answer it based only on a review of existing publications.

Make a list of keywords

Start by creating a list of keywords related to your research topic. Include each of the key concepts or variables you’re interested in, and list any synonyms and related terms. You can add to this list if you discover new keywords in the process of your literature search.

• Social media, Facebook, Instagram, Twitter, Snapchat, TikTok
• Body image, self-perception, self-esteem, mental health
• Generation Z, teenagers, adolescents, youth

Search for relevant sources

Use your keywords to begin searching for sources. Some databases to search for journals and articles include:

• Your university’s library catalogue
• Google Scholar
• Project Muse (humanities and social sciences)
• Medline (life sciences and biomedicine)
• EconLit (economics)
• Inspec (physics, engineering and computer science)

You can use boolean operators to help narrow down your search:

Read the abstract to find out whether an article is relevant to your question. When you find a useful book or article, you can check the bibliography to find other relevant sources.

To identify the most important publications on your topic, take note of recurring citations. If the same authors, books or articles keep appearing in your reading, make sure to seek them out.

You probably won’t be able to read absolutely everything that has been written on the topic – you’ll have to evaluate which sources are most relevant to your questions.

For each publication, ask yourself:

• What question or problem is the author addressing?
• What are the key concepts and how are they defined?
• What are the key theories, models and methods? Does the research use established frameworks or take an innovative approach?
• What are the results and conclusions of the study?
• How does the publication relate to other literature in the field? Does it confirm, add to, or challenge established knowledge?
• How does the publication contribute to your understanding of the topic? What are its key insights and arguments?
• What are the strengths and weaknesses of the research?

Make sure the sources you use are credible, and make sure you read any landmark studies and major theories in your field of research.

You can find out how many times an article has been cited on Google Scholar – a high citation count means the article has been influential in the field, and should certainly be included in your literature review.

The scope of your review will depend on your topic and discipline: in the sciences you usually only review recent literature, but in the humanities you might take a long historical perspective (for example, to trace how a concept has changed in meaning over time).

Remember that you can use our template to summarise and evaluate sources you’re thinking about using!

Take notes and cite your sources

As you read, you should also begin the writing process. Take notes that you can later incorporate into the text of your literature review.

It’s important to keep track of your sources with references to avoid plagiarism . It can be helpful to make an annotated bibliography, where you compile full reference information and write a paragraph of summary and analysis for each source. This helps you remember what you read and saves time later in the process.

You can use our free APA Reference Generator for quick, correct, consistent citations.

To begin organising your literature review’s argument and structure, you need to understand the connections and relationships between the sources you’ve read. Based on your reading and notes, you can look for:

• Trends and patterns (in theory, method or results): do certain approaches become more or less popular over time?
• Themes: what questions or concepts recur across the literature?
• Debates, conflicts and contradictions: where do sources disagree?
• Pivotal publications: are there any influential theories or studies that changed the direction of the field?
• Gaps: what is missing from the literature? Are there weaknesses that need to be addressed?

This step will help you work out the structure of your literature review and (if applicable) show how your own research will contribute to existing knowledge.

• Most research has focused on young women.
• There is an increasing interest in the visual aspects of social media.
• But there is still a lack of robust research on highly-visual platforms like Instagram and Snapchat – this is a gap that you could address in your own research.

There are various approaches to organising the body of a literature review. You should have a rough idea of your strategy before you start writing.

Depending on the length of your literature review, you can combine several of these strategies (for example, your overall structure might be thematic, but each theme is discussed chronologically).

Chronological

The simplest approach is to trace the development of the topic over time. However, if you choose this strategy, be careful to avoid simply listing and summarising sources in order.

Try to analyse patterns, turning points and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred.

If you have found some recurring central themes, you can organise your literature review into subsections that address different aspects of the topic.

For example, if you are reviewing literature about inequalities in migrant health outcomes, key themes might include healthcare policy, language barriers, cultural attitudes, legal status, and economic access.

Methodological

If you draw your sources from different disciplines or fields that use a variety of research methods , you might want to compare the results and conclusions that emerge from different approaches. For example:

• Look at what results have emerged in qualitative versus quantitative research
• Discuss how the topic has been approached by empirical versus theoretical scholarship
• Divide the literature into sociological, historical, and cultural sources

Theoretical

A literature review is often the foundation for a theoretical framework . You can use it to discuss various theories, models, and definitions of key concepts.

You might argue for the relevance of a specific theoretical approach, or combine various theoretical concepts to create a framework for your research.

Like any other academic text, your literature review should have an introduction , a main body, and a conclusion . What you include in each depends on the objective of your literature review.

The introduction should clearly establish the focus and purpose of the literature review.

If you are writing the literature review as part of your dissertation or thesis, reiterate your central problem or research question and give a brief summary of the scholarly context. You can emphasise the timeliness of the topic (“many recent studies have focused on the problem of x”) or highlight a gap in the literature (“while there has been much research on x, few researchers have taken y into consideration”).

Depending on the length of your literature review, you might want to divide the body into subsections. You can use a subheading for each theme, time period, or methodological approach.

As you write, make sure to follow these tips:

• Summarise and synthesise: give an overview of the main points of each source and combine them into a coherent whole.
• Analyse and interpret: don’t just paraphrase other researchers – add your own interpretations, discussing the significance of findings in relation to the literature as a whole.
• Critically evaluate: mention the strengths and weaknesses of your sources.
• Write in well-structured paragraphs: use transitions and topic sentences to draw connections, comparisons and contrasts.

In the conclusion, you should summarise the key findings you have taken from the literature and emphasise their significance.

If the literature review is part of your dissertation or thesis, reiterate how your research addresses gaps and contributes new knowledge, or discuss how you have drawn on existing theories and methods to build a framework for your research. This can lead directly into your methodology section.

A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .

It is often written as part of a dissertation , thesis, research paper , or proposal .

There are several reasons to conduct a literature review at the beginning of a research project:

• To familiarise yourself with the current state of knowledge on your topic
• To ensure that you’re not just repeating what others have already done
• To identify gaps in knowledge and unresolved problems that your research can address
• To develop your theoretical framework and methodology
• To provide an overview of the key findings and debates on the topic

Writing the literature review shows your reader how your work relates to existing research and what new insights it will contribute.

The literature review usually comes near the beginning of your  dissertation . After the introduction , it grounds your research in a scholarly field and leads directly to your theoretical framework or methodology .

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.

McCombes, S. (2022, June 07). What is a Literature Review? | Guide, Template, & Examples. Scribbr. Retrieved 15 April 2024, from https://www.scribbr.co.uk/thesis-dissertation/literature-review/

Is this article helpful?

Shona McCombes

Other students also liked, how to write a dissertation proposal | a step-by-step guide, what is a theoretical framework | a step-by-step guide, what is a research methodology | steps & tips.

Literature Reviews

What this handout is about.

This handout will explain what literature reviews are and offer insights into the form and construction of literature reviews in the humanities, social sciences, and sciences.

Introduction

OK. You’ve got to write a literature review. You dust off a novel and a book of poetry, settle down in your chair, and get ready to issue a “thumbs up” or “thumbs down” as you leaf through the pages. “Literature review” done. Right?

Wrong! The “literature” of a literature review refers to any collection of materials on a topic, not necessarily the great literary texts of the world. “Literature” could be anything from a set of government pamphlets on British colonial methods in Africa to scholarly articles on the treatment of a torn ACL. And a review does not necessarily mean that your reader wants you to give your personal opinion on whether or not you liked these sources.

What is a literature review, then?

A literature review discusses published information in a particular subject area, and sometimes information in a particular subject area within a certain time period.

A literature review can be just a simple summary of the sources, but it usually has an organizational pattern and combines both summary and synthesis. A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information. It might give a new interpretation of old material or combine new with old interpretations. Or it might trace the intellectual progression of the field, including major debates. And depending on the situation, the literature review may evaluate the sources and advise the reader on the most pertinent or relevant.

But how is a literature review different from an academic research paper?

The main focus of an academic research paper is to develop a new argument, and a research paper is likely to contain a literature review as one of its parts. In a research paper, you use the literature as a foundation and as support for a new insight that you contribute. The focus of a literature review, however, is to summarize and synthesize the arguments and ideas of others without adding new contributions.

Why do we write literature reviews?

Literature reviews provide you with a handy guide to a particular topic. If you have limited time to conduct research, literature reviews can give you an overview or act as a stepping stone. For professionals, they are useful reports that keep them up to date with what is current in the field. For scholars, the depth and breadth of the literature review emphasizes the credibility of the writer in his or her field. Literature reviews also provide a solid background for a research paper’s investigation. Comprehensive knowledge of the literature of the field is essential to most research papers.

Who writes these things, anyway?

Literature reviews are written occasionally in the humanities, but mostly in the sciences and social sciences; in experiment and lab reports, they constitute a section of the paper. Sometimes a literature review is written as a paper in itself.

Let’s get to it! What should I do before writing the literature review?

If your assignment is not very specific, seek clarification from your instructor:

• Roughly how many sources should you include?
• What types of sources (books, journal articles, websites)?
• Should you summarize, synthesize, or critique your sources by discussing a common theme or issue?
• Should you evaluate your sources?
• Should you provide subheadings and other background information, such as definitions and/or a history?

Find models

Look for other literature reviews in your area of interest or in the discipline and read them to get a sense of the types of themes you might want to look for in your own research or ways to organize your final review. You can simply put the word “review” in your search engine along with your other topic terms to find articles of this type on the Internet or in an electronic database. The bibliography or reference section of sources you’ve already read are also excellent entry points into your own research.

Narrow your topic

There are hundreds or even thousands of articles and books on most areas of study. The narrower your topic, the easier it will be to limit the number of sources you need to read in order to get a good survey of the material. Your instructor will probably not expect you to read everything that’s out there on the topic, but you’ll make your job easier if you first limit your scope.

Keep in mind that UNC Libraries have research guides and to databases relevant to many fields of study. You can reach out to the subject librarian for a consultation: https://library.unc.edu/support/consultations/ .

And don’t forget to tap into your professor’s (or other professors’) knowledge in the field. Ask your professor questions such as: “If you had to read only one book from the 90’s on topic X, what would it be?” Questions such as this help you to find and determine quickly the most seminal pieces in the field.

Consider whether your sources are current

Some disciplines require that you use information that is as current as possible. In the sciences, for instance, treatments for medical problems are constantly changing according to the latest studies. Information even two years old could be obsolete. However, if you are writing a review in the humanities, history, or social sciences, a survey of the history of the literature may be what is needed, because what is important is how perspectives have changed through the years or within a certain time period. Try sorting through some other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to consider what is currently of interest to scholars in this field and what is not.

Strategies for writing the literature review

Find a focus.

A literature review, like a term paper, is usually organized around ideas, not the sources themselves as an annotated bibliography would be organized. This means that you will not just simply list your sources and go into detail about each one of them, one at a time. No. As you read widely but selectively in your topic area, consider instead what themes or issues connect your sources together. Do they present one or different solutions? Is there an aspect of the field that is missing? How well do they present the material and do they portray it according to an appropriate theory? Do they reveal a trend in the field? A raging debate? Pick one of these themes to focus the organization of your review.

Convey it to your reader

A literature review may not have a traditional thesis statement (one that makes an argument), but you do need to tell readers what to expect. Try writing a simple statement that lets the reader know what is your main organizing principle. Here are a couple of examples:

The current trend in treatment for congestive heart failure combines surgery and medicine. More and more cultural studies scholars are accepting popular media as a subject worthy of academic consideration.

Consider organization

You’ve got a focus, and you’ve stated it clearly and directly. Now what is the most effective way of presenting the information? What are the most important topics, subtopics, etc., that your review needs to include? And in what order should you present them? Develop an organization for your review at both a global and local level:

First, cover the basic categories

Just like most academic papers, literature reviews also must contain at least three basic elements: an introduction or background information section; the body of the review containing the discussion of sources; and, finally, a conclusion and/or recommendations section to end the paper. The following provides a brief description of the content of each:

• Introduction: Gives a quick idea of the topic of the literature review, such as the central theme or organizational pattern.
• Body: Contains your discussion of sources and is organized either chronologically, thematically, or methodologically (see below for more information on each).
• Conclusions/Recommendations: Discuss what you have drawn from reviewing literature so far. Where might the discussion proceed?

Organizing the body

Once you have the basic categories in place, then you must consider how you will present the sources themselves within the body of your paper. Create an organizational method to focus this section even further.

To help you come up with an overall organizational framework for your review, consider the following scenario:

You’ve decided to focus your literature review on materials dealing with sperm whales. This is because you’ve just finished reading Moby Dick, and you wonder if that whale’s portrayal is really real. You start with some articles about the physiology of sperm whales in biology journals written in the 1980’s. But these articles refer to some British biological studies performed on whales in the early 18th century. So you check those out. Then you look up a book written in 1968 with information on how sperm whales have been portrayed in other forms of art, such as in Alaskan poetry, in French painting, or on whale bone, as the whale hunters in the late 19th century used to do. This makes you wonder about American whaling methods during the time portrayed in Moby Dick, so you find some academic articles published in the last five years on how accurately Herman Melville portrayed the whaling scene in his novel.

Now consider some typical ways of organizing the sources into a review:

• Chronological: If your review follows the chronological method, you could write about the materials above according to when they were published. For instance, first you would talk about the British biological studies of the 18th century, then about Moby Dick, published in 1851, then the book on sperm whales in other art (1968), and finally the biology articles (1980s) and the recent articles on American whaling of the 19th century. But there is relatively no continuity among subjects here. And notice that even though the sources on sperm whales in other art and on American whaling are written recently, they are about other subjects/objects that were created much earlier. Thus, the review loses its chronological focus.
• By publication: Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on biological studies of sperm whales if the progression revealed a change in dissection practices of the researchers who wrote and/or conducted the studies.
• By trend: A better way to organize the above sources chronologically is to examine the sources under another trend, such as the history of whaling. Then your review would have subsections according to eras within this period. For instance, the review might examine whaling from pre-1600-1699, 1700-1799, and 1800-1899. Under this method, you would combine the recent studies on American whaling in the 19th century with Moby Dick itself in the 1800-1899 category, even though the authors wrote a century apart.
• Thematic: Thematic reviews of literature are organized around a topic or issue, rather than the progression of time. However, progression of time may still be an important factor in a thematic review. For instance, the sperm whale review could focus on the development of the harpoon for whale hunting. While the study focuses on one topic, harpoon technology, it will still be organized chronologically. The only difference here between a “chronological” and a “thematic” approach is what is emphasized the most: the development of the harpoon or the harpoon technology.But more authentic thematic reviews tend to break away from chronological order. For instance, a thematic review of material on sperm whales might examine how they are portrayed as “evil” in cultural documents. The subsections might include how they are personified, how their proportions are exaggerated, and their behaviors misunderstood. A review organized in this manner would shift between time periods within each section according to the point made.
• Methodological: A methodological approach differs from the two above in that the focusing factor usually does not have to do with the content of the material. Instead, it focuses on the “methods” of the researcher or writer. For the sperm whale project, one methodological approach would be to look at cultural differences between the portrayal of whales in American, British, and French art work. Or the review might focus on the economic impact of whaling on a community. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed. Once you’ve decided on the organizational method for the body of the review, the sections you need to include in the paper should be easy to figure out. They should arise out of your organizational strategy. In other words, a chronological review would have subsections for each vital time period. A thematic review would have subtopics based upon factors that relate to the theme or issue.

Sometimes, though, you might need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. Put in only what is necessary. Here are a few other sections you might want to consider:

• Current Situation: Information necessary to understand the topic or focus of the literature review.
• History: The chronological progression of the field, the literature, or an idea that is necessary to understand the literature review, if the body of the literature review is not already a chronology.
• Methods and/or Standards: The criteria you used to select the sources in your literature review or the way in which you present your information. For instance, you might explain that your review includes only peer-reviewed articles and journals.

Questions for Further Research: What questions about the field has the review sparked? How will you further your research as a result of the review?

Begin composing

Once you’ve settled on a general pattern of organization, you’re ready to write each section. There are a few guidelines you should follow during the writing stage as well. Here is a sample paragraph from a literature review about sexism and language to illuminate the following discussion:

However, other studies have shown that even gender-neutral antecedents are more likely to produce masculine images than feminine ones (Gastil, 1990). Hamilton (1988) asked students to complete sentences that required them to fill in pronouns that agreed with gender-neutral antecedents such as “writer,” “pedestrian,” and “persons.” The students were asked to describe any image they had when writing the sentence. Hamilton found that people imagined 3.3 men to each woman in the masculine “generic” condition and 1.5 men per woman in the unbiased condition. Thus, while ambient sexism accounted for some of the masculine bias, sexist language amplified the effect. (Source: Erika Falk and Jordan Mills, “Why Sexist Language Affects Persuasion: The Role of Homophily, Intended Audience, and Offense,” Women and Language19:2).

Use evidence

In the example above, the writers refer to several other sources when making their point. A literature review in this sense is just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence to show that what you are saying is valid.

Be selective

Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the review’s focus, whether it is thematic, methodological, or chronological.

Use quotes sparingly

Falk and Mills do not use any direct quotes. That is because the survey nature of the literature review does not allow for in-depth discussion or detailed quotes from the text. Some short quotes here and there are okay, though, if you want to emphasize a point, or if what the author said just cannot be rewritten in your own words. Notice that Falk and Mills do quote certain terms that were coined by the author, not common knowledge, or taken directly from the study. But if you find yourself wanting to put in more quotes, check with your instructor.

Summarize and synthesize

Remember to summarize and synthesize your sources within each paragraph as well as throughout the review. The authors here recapitulate important features of Hamilton’s study, but then synthesize it by rephrasing the study’s significance and relating it to their own work.

Keep your own voice

While the literature review presents others’ ideas, your voice (the writer’s) should remain front and center. Notice that Falk and Mills weave references to other sources into their own text, but they still maintain their own voice by starting and ending the paragraph with their own ideas and their own words. The sources support what Falk and Mills are saying.

Use caution when paraphrasing

When paraphrasing a source that is not your own, be sure to represent the author’s information or opinions accurately and in your own words. In the preceding example, Falk and Mills either directly refer in the text to the author of their source, such as Hamilton, or they provide ample notation in the text when the ideas they are mentioning are not their own, for example, Gastil’s. For more information, please see our handout on plagiarism .

Revise, revise, revise

Draft in hand? Now you’re ready to revise. Spending a lot of time revising is a wise idea, because your main objective is to present the material, not the argument. So check over your review again to make sure it follows the assignment and/or your outline. Then, just as you would for most other academic forms of writing, rewrite or rework the language of your review so that you’ve presented your information in the most concise manner possible. Be sure to use terminology familiar to your audience; get rid of unnecessary jargon or slang. Finally, double check that you’ve documented your sources and formatted the review appropriately for your discipline. For tips on the revising and editing process, see our handout on revising drafts .

Works consulted

We consulted these works while writing this handout. This is not a comprehensive list of resources on the handout’s topic, and we encourage you to do your own research to find additional publications. Please do not use this list as a model for the format of your own reference list, as it may not match the citation style you are using. For guidance on formatting citations, please see the UNC Libraries citation tutorial . We revise these tips periodically and welcome feedback.

Anson, Chris M., and Robert A. Schwegler. 2010. The Longman Handbook for Writers and Readers , 6th ed. New York: Longman.

Jones, Robert, Patrick Bizzaro, and Cynthia Selfe. 1997. The Harcourt Brace Guide to Writing in the Disciplines . New York: Harcourt Brace.

Lamb, Sandra E. 1998. How to Write It: A Complete Guide to Everything You’ll Ever Write . Berkeley: Ten Speed Press.

Rosen, Leonard J., and Laurence Behrens. 2003. The Allyn & Bacon Handbook , 5th ed. New York: Longman.

Troyka, Lynn Quittman, and Doug Hesse. 2016. Simon and Schuster Handbook for Writers , 11th ed. London: Pearson.

You may reproduce it for non-commercial use if you use the entire handout and attribute the source: The Writing Center, University of North Carolina at Chapel Hill

Make a Gift

• USC Libraries
• Research Guides

Organizing Your Social Sciences Research Paper

• 5. The Literature Review
• Purpose of Guide
• Design Flaws to Avoid
• Independent and Dependent Variables
• Glossary of Research Terms
• Reading Research Effectively
• Narrowing a Topic Idea
• Broadening a Topic Idea
• Extending the Timeliness of a Topic Idea
• Academic Writing Style
• Applying Critical Thinking
• Choosing a Title
• Making an Outline
• Paragraph Development
• Research Process Video Series
• Executive Summary
• The C.A.R.S. Model
• Background Information
• The Research Problem/Question
• Theoretical Framework
• Citation Tracking
• Content Alert Services
• Evaluating Sources
• Primary Sources
• Secondary Sources
• Tiertiary Sources
• Scholarly vs. Popular Publications
• Qualitative Methods
• Quantitative Methods
• Insiderness
• Using Non-Textual Elements
• Limitations of the Study
• Common Grammar Mistakes
• Writing Concisely
• Avoiding Plagiarism
• Footnotes or Endnotes?
• Further Readings
• Generative AI and Writing
• USC Libraries Tutorials and Other Guides
• Bibliography

A literature review surveys prior research published in books, scholarly articles, and any other sources relevant to a particular issue, area of research, or theory, and by so doing, provides a description, summary, and critical evaluation of these works in relation to the research problem being investigated. Literature reviews are designed to provide an overview of sources you have used in researching a particular topic and to demonstrate to your readers how your research fits within existing scholarship about the topic.

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . Fourth edition. Thousand Oaks, CA: SAGE, 2014.

Importance of a Good Literature Review

A literature review may consist of simply a summary of key sources, but in the social sciences, a literature review usually has an organizational pattern and combines both summary and synthesis, often within specific conceptual categories . A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information in a way that informs how you are planning to investigate a research problem. The analytical features of a literature review might:

• Give a new interpretation of old material or combine new with old interpretations,
• Trace the intellectual progression of the field, including major debates,
• Depending on the situation, evaluate the sources and advise the reader on the most pertinent or relevant research, or
• Usually in the conclusion of a literature review, identify where gaps exist in how a problem has been researched to date.

Given this, the purpose of a literature review is to:

• Place each work in the context of its contribution to understanding the research problem being studied.
• Describe the relationship of each work to the others under consideration.
• Identify new ways to interpret prior research.
• Reveal any gaps that exist in the literature.
• Resolve conflicts amongst seemingly contradictory previous studies.
• Identify areas of prior scholarship to prevent duplication of effort.
• Point the way in fulfilling a need for additional research.
• Locate your own research within the context of existing literature [very important].

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper. 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . Los Angeles, CA: SAGE, 2011; Knopf, Jeffrey W. "Doing a Literature Review." PS: Political Science and Politics 39 (January 2006): 127-132; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012.

Types of Literature Reviews

It is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the primary studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally among scholars that become part of the body of epistemological traditions within the field.

In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews. Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are a number of approaches you could adopt depending upon the type of analysis underpinning your study.

Argumentative Review This form examines literature selectively in order to support or refute an argument, deeply embedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to make summary claims of the sort found in systematic reviews [see below].

Integrative Review Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses or research problems. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication. This is the most common form of review in the social sciences.

Historical Review Few things rest in isolation from historical precedent. Historical literature reviews focus on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.

Methodological Review A review does not always focus on what someone said [findings], but how they came about saying what they say [method of analysis]. Reviewing methods of analysis provides a framework of understanding at different levels [i.e. those of theory, substantive fields, research approaches, and data collection and analysis techniques], how researchers draw upon a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection, and data analysis. This approach helps highlight ethical issues which you should be aware of and consider as you go through your own study.

Systematic Review This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyze data from the studies that are included in the review. The goal is to deliberately document, critically evaluate, and summarize scientifically all of the research about a clearly defined research problem . Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?" This type of literature review is primarily applied to examining prior research studies in clinical medicine and allied health fields, but it is increasingly being used in the social sciences.

Theoretical Review The purpose of this form is to examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review helps to establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.

NOTE : Most often the literature review will incorporate some combination of types. For example, a review that examines literature supporting or refuting an argument, assumption, or philosophical problem related to the research problem will also need to include writing supported by sources that establish the history of these arguments in the literature.

Baumeister, Roy F. and Mark R. Leary. "Writing Narrative Literature Reviews."  Review of General Psychology 1 (September 1997): 311-320; Mark R. Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Kennedy, Mary M. "Defining a Literature." Educational Researcher 36 (April 2007): 139-147; Petticrew, Mark and Helen Roberts. Systematic Reviews in the Social Sciences: A Practical Guide . Malden, MA: Blackwell Publishers, 2006; Torracro, Richard. "Writing Integrative Literature Reviews: Guidelines and Examples." Human Resource Development Review 4 (September 2005): 356-367; Rocco, Tonette S. and Maria S. Plakhotnik. "Literature Reviews, Conceptual Frameworks, and Theoretical Frameworks: Terms, Functions, and Distinctions." Human Ressource Development Review 8 (March 2008): 120-130; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

Structure and Writing Style

I.  Thinking About Your Literature Review

The structure of a literature review should include the following in support of understanding the research problem :

• An overview of the subject, issue, or theory under consideration, along with the objectives of the literature review,
• Division of works under review into themes or categories [e.g. works that support a particular position, those against, and those offering alternative approaches entirely],
• An explanation of how each work is similar to and how it varies from the others,
• Conclusions as to which pieces are best considered in their argument, are most convincing of their opinions, and make the greatest contribution to the understanding and development of their area of research.

The critical evaluation of each work should consider :

• Provenance -- what are the author's credentials? Are the author's arguments supported by evidence [e.g. primary historical material, case studies, narratives, statistics, recent scientific findings]?
• Methodology -- were the techniques used to identify, gather, and analyze the data appropriate to addressing the research problem? Was the sample size appropriate? Were the results effectively interpreted and reported?
• Objectivity -- is the author's perspective even-handed or prejudicial? Is contrary data considered or is certain pertinent information ignored to prove the author's point?
• Persuasiveness -- which of the author's theses are most convincing or least convincing?
• Validity -- are the author's arguments and conclusions convincing? Does the work ultimately contribute in any significant way to an understanding of the subject?

II.  Development of the Literature Review

Four Basic Stages of Writing 1.  Problem formulation -- which topic or field is being examined and what are its component issues? 2.  Literature search -- finding materials relevant to the subject being explored. 3.  Data evaluation -- determining which literature makes a significant contribution to the understanding of the topic. 4.  Analysis and interpretation -- discussing the findings and conclusions of pertinent literature.

Consider the following issues before writing the literature review: Clarify If your assignment is not specific about what form your literature review should take, seek clarification from your professor by asking these questions: 1.  Roughly how many sources would be appropriate to include? 2.  What types of sources should I review (books, journal articles, websites; scholarly versus popular sources)? 3.  Should I summarize, synthesize, or critique sources by discussing a common theme or issue? 4.  Should I evaluate the sources in any way beyond evaluating how they relate to understanding the research problem? 5.  Should I provide subheadings and other background information, such as definitions and/or a history? Find Models Use the exercise of reviewing the literature to examine how authors in your discipline or area of interest have composed their literature review sections. Read them to get a sense of the types of themes you might want to look for in your own research or to identify ways to organize your final review. The bibliography or reference section of sources you've already read, such as required readings in the course syllabus, are also excellent entry points into your own research. Narrow the Topic The narrower your topic, the easier it will be to limit the number of sources you need to read in order to obtain a good survey of relevant resources. Your professor will probably not expect you to read everything that's available about the topic, but you'll make the act of reviewing easier if you first limit scope of the research problem. A good strategy is to begin by searching the USC Libraries Catalog for recent books about the topic and review the table of contents for chapters that focuses on specific issues. You can also review the indexes of books to find references to specific issues that can serve as the focus of your research. For example, a book surveying the history of the Israeli-Palestinian conflict may include a chapter on the role Egypt has played in mediating the conflict, or look in the index for the pages where Egypt is mentioned in the text. Consider Whether Your Sources are Current Some disciplines require that you use information that is as current as possible. This is particularly true in disciplines in medicine and the sciences where research conducted becomes obsolete very quickly as new discoveries are made. However, when writing a review in the social sciences, a survey of the history of the literature may be required. In other words, a complete understanding the research problem requires you to deliberately examine how knowledge and perspectives have changed over time. Sort through other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to explore what is considered by scholars to be a "hot topic" and what is not.

III.  Ways to Organize Your Literature Review

Chronology of Events If your review follows the chronological method, you could write about the materials according to when they were published. This approach should only be followed if a clear path of research building on previous research can be identified and that these trends follow a clear chronological order of development. For example, a literature review that focuses on continuing research about the emergence of German economic power after the fall of the Soviet Union. By Publication Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on environmental studies of brown fields if the progression revealed, for example, a change in the soil collection practices of the researchers who wrote and/or conducted the studies. Thematic [“conceptual categories”] A thematic literature review is the most common approach to summarizing prior research in the social and behavioral sciences. Thematic reviews are organized around a topic or issue, rather than the progression of time, although the progression of time may still be incorporated into a thematic review. For example, a review of the Internet’s impact on American presidential politics could focus on the development of online political satire. While the study focuses on one topic, the Internet’s impact on American presidential politics, it would still be organized chronologically reflecting technological developments in media. The difference in this example between a "chronological" and a "thematic" approach is what is emphasized the most: themes related to the role of the Internet in presidential politics. Note that more authentic thematic reviews tend to break away from chronological order. A review organized in this manner would shift between time periods within each section according to the point being made. Methodological A methodological approach focuses on the methods utilized by the researcher. For the Internet in American presidential politics project, one methodological approach would be to look at cultural differences between the portrayal of American presidents on American, British, and French websites. Or the review might focus on the fundraising impact of the Internet on a particular political party. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed.

Other Sections of Your Literature Review Once you've decided on the organizational method for your literature review, the sections you need to include in the paper should be easy to figure out because they arise from your organizational strategy. In other words, a chronological review would have subsections for each vital time period; a thematic review would have subtopics based upon factors that relate to the theme or issue. However, sometimes you may need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. However, only include what is necessary for the reader to locate your study within the larger scholarship about the research problem.

Here are examples of other sections, usually in the form of a single paragraph, you may need to include depending on the type of review you write:

• Current Situation : Information necessary to understand the current topic or focus of the literature review.
• Sources Used : Describes the methods and resources [e.g., databases] you used to identify the literature you reviewed.
• History : The chronological progression of the field, the research literature, or an idea that is necessary to understand the literature review, if the body of the literature review is not already a chronology.
• Selection Methods : Criteria you used to select (and perhaps exclude) sources in your literature review. For instance, you might explain that your review includes only peer-reviewed [i.e., scholarly] sources.
• Standards : Description of the way in which you present your information.
• Questions for Further Research : What questions about the field has the review sparked? How will you further your research as a result of the review?

IV.  Writing Your Literature Review

Once you've settled on how to organize your literature review, you're ready to write each section. When writing your review, keep in mind these issues.

Use Evidence A literature review section is, in this sense, just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence [citations] that demonstrates that what you are saying is valid. Be Selective Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the research problem, whether it is thematic, methodological, or chronological. Related items that provide additional information, but that are not key to understanding the research problem, can be included in a list of further readings . Use Quotes Sparingly Some short quotes are appropriate if you want to emphasize a point, or if what an author stated cannot be easily paraphrased. Sometimes you may need to quote certain terminology that was coined by the author, is not common knowledge, or taken directly from the study. Do not use extensive quotes as a substitute for using your own words in reviewing the literature. Summarize and Synthesize Remember to summarize and synthesize your sources within each thematic paragraph as well as throughout the review. Recapitulate important features of a research study, but then synthesize it by rephrasing the study's significance and relating it to your own work and the work of others. Keep Your Own Voice While the literature review presents others' ideas, your voice [the writer's] should remain front and center. For example, weave references to other sources into what you are writing but maintain your own voice by starting and ending the paragraph with your own ideas and wording. Use Caution When Paraphrasing When paraphrasing a source that is not your own, be sure to represent the author's information or opinions accurately and in your own words. Even when paraphrasing an author’s work, you still must provide a citation to that work.

V.  Common Mistakes to Avoid

These are the most common mistakes made in reviewing social science research literature.

• Sources in your literature review do not clearly relate to the research problem;
• You do not take sufficient time to define and identify the most relevant sources to use in the literature review related to the research problem;
• Relies exclusively on secondary analytical sources rather than including relevant primary research studies or data;
• Uncritically accepts another researcher's findings and interpretations as valid, rather than examining critically all aspects of the research design and analysis;
• Does not describe the search procedures that were used in identifying the literature to review;
• Reports isolated statistical results rather than synthesizing them in chi-squared or meta-analytic methods; and,
• Only includes research that validates assumptions and does not consider contrary findings and alternative interpretations found in the literature.

Cook, Kathleen E. and Elise Murowchick. “Do Literature Review Skills Transfer from One Course to Another?” Psychology Learning and Teaching 13 (March 2014): 3-11; Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . London: SAGE, 2011; Literature Review Handout. Online Writing Center. Liberty University; Literature Reviews. The Writing Center. University of North Carolina; Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: SAGE, 2016; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012; Randolph, Justus J. “A Guide to Writing the Dissertation Literature Review." Practical Assessment, Research, and Evaluation. vol. 14, June 2009; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016; Taylor, Dena. The Literature Review: A Few Tips On Conducting It. University College Writing Centre. University of Toronto; Writing a Literature Review. Academic Skills Centre. University of Canberra.

Writing Tip

Break Out of Your Disciplinary Box!

Thinking interdisciplinarily about a research problem can be a rewarding exercise in applying new ideas, theories, or concepts to an old problem. For example, what might cultural anthropologists say about the continuing conflict in the Middle East? In what ways might geographers view the need for better distribution of social service agencies in large cities than how social workers might study the issue? You don’t want to substitute a thorough review of core research literature in your discipline for studies conducted in other fields of study. However, particularly in the social sciences, thinking about research problems from multiple vectors is a key strategy for finding new solutions to a problem or gaining a new perspective. Consult with a librarian about identifying research databases in other disciplines; almost every field of study has at least one comprehensive database devoted to indexing its research literature.

Frodeman, Robert. The Oxford Handbook of Interdisciplinarity . New York: Oxford University Press, 2010.

Another Writing Tip

Don't Just Review for Content!

While conducting a review of the literature, maximize the time you devote to writing this part of your paper by thinking broadly about what you should be looking for and evaluating. Review not just what scholars are saying, but how are they saying it. Some questions to ask:

• How are they organizing their ideas?
• What methods have they used to study the problem?
• What theories have been used to explain, predict, or understand their research problem?
• What sources have they cited to support their conclusions?
• How have they used non-textual elements [e.g., charts, graphs, figures, etc.] to illustrate key points?

When you begin to write your literature review section, you'll be glad you dug deeper into how the research was designed and constructed because it establishes a means for developing more substantial analysis and interpretation of the research problem.

Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1 998.

Yet Another Writing Tip

When Do I Know I Can Stop Looking and Move On?

Here are several strategies you can utilize to assess whether you've thoroughly reviewed the literature:

• Look for repeating patterns in the research findings . If the same thing is being said, just by different people, then this likely demonstrates that the research problem has hit a conceptual dead end. At this point consider: Does your study extend current research?  Does it forge a new path? Or, does is merely add more of the same thing being said?
• Look at sources the authors cite to in their work . If you begin to see the same researchers cited again and again, then this is often an indication that no new ideas have been generated to address the research problem.
• Search Google Scholar to identify who has subsequently cited leading scholars already identified in your literature review [see next sub-tab]. This is called citation tracking and there are a number of sources that can help you identify who has cited whom, particularly scholars from outside of your discipline. Here again, if the same authors are being cited again and again, this may indicate no new literature has been written on the topic.

Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: Sage, 2016; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

• << Previous: Theoretical Framework
• Next: Citation Tracking >>
• Last Updated: Apr 16, 2024 10:20 AM
• URL: https://libguides.usc.edu/writingguide

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• CAREER FEATURE
• 04 December 2020
• Correction 09 December 2020

How to write a superb literature review

Andy Tay is a freelance writer based in Singapore.

You can also search for this author in PubMed   Google Scholar

Literature reviews are important resources for scientists. They provide historical context for a field while offering opinions on its future trajectory. Creating them can provide inspiration for one’s own research, as well as some practice in writing. But few scientists are trained in how to write a review — or in what constitutes an excellent one. Even picking the appropriate software to use can be an involved decision (see ‘Tools and techniques’). So Nature asked editors and working scientists with well-cited reviews for their tips.

Access options

Access Nature and 54 other Nature Portfolio journals

Get Nature+, our best-value online-access subscription

24,99 € / 30 days

cancel any time

Subscribe to this journal

Receive 51 print issues and online access

185,98 € per year

only 3,65 € per issue

Rent or buy this article

Prices vary by article type

Prices may be subject to local taxes which are calculated during checkout

doi: https://doi.org/10.1038/d41586-020-03422-x

Interviews have been edited for length and clarity.

Updates & Corrections

Correction 09 December 2020 : An earlier version of the tables in this article included some incorrect details about the programs Zotero, Endnote and Manubot. These have now been corrected.

Hsing, I.-M., Xu, Y. & Zhao, W. Electroanalysis 19 , 755–768 (2007).

Article   Google Scholar  

Ledesma, H. A. et al. Nature Nanotechnol. 14 , 645–657 (2019).

Article   PubMed   Google Scholar  

Brahlek, M., Koirala, N., Bansal, N. & Oh, S. Solid State Commun. 215–216 , 54–62 (2015).

Choi, Y. & Lee, S. Y. Nature Rev. Chem . https://doi.org/10.1038/s41570-020-00221-w (2020).

Download references

Related Articles

• Research management

Deadly diseases and inflatable suits: how I found my niche in virology research

Spotlight 17 APR 24

How young people benefit from Swiss apprenticeships

I dive for fish in the longest freshwater lake in the world

Researchers want a ‘nutrition label’ for academic-paper facts

Nature Index 17 APR 24

How we landed job interviews for professorships straight out of our PhD programmes

Career Column 08 APR 24

Structure peer review to make it more robust

World View 16 APR 24

US COVID-origins hearing puts scientific journals in the hot seat

News 16 APR 24

FACULTY POSITION IN PATHOLOGY RESEARCH

Dallas, Texas (US)

The University of Texas Southwestern Medical Center (UT Southwestern Medical Center)

Postdoc Fellow / Senior Scientist

The Yakoub and Sulzer labs at Harvard Medical School-Brigham and Women’s Hospital and Columbia University

Boston, Massachusetts (US)

Harvard Medical School and Brigham and Women's Hospital

Postdoc in Computational Genomics – Machine Learning for Multi-Omics Profiling of Cancer Evolution

Computational Postdoc - Artificial Intelligence in Oncology and Regulatory Genomics and Cancer Evolution at the DKFZ - limited to 2 years

Heidelberg, Baden-Württemberg (DE)

German Cancer Research Center in the Helmholtz Association (DKFZ)

Computational Postdoc

The German Cancer Research Center is the largest biomedical research institution in Germany.

PhD / PostDoc Medical bioinformatics (m/f/d)

The Institute of Medical Bioinformatics and Systems Medicine / University of Freiburg is looking for a PhD/PostDoc Medical bioinformatics (m/w/d)

Freiburg im Breisgau, Baden-Württemberg (DE)

University of Freiburg

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

Get science-backed answers as you write with Paperpal's Research feature

What is a Literature Review? How to Write It (with Examples)

A literature review is a critical analysis and synthesis of existing research on a particular topic. It provides an overview of the current state of knowledge, identifies gaps, and highlights key findings in the literature. 1 The purpose of a literature review is to situate your own research within the context of existing scholarship, demonstrating your understanding of the topic and showing how your work contributes to the ongoing conversation in the field. Learning how to write a literature review is a critical tool for successful research. Your ability to summarize and synthesize prior research pertaining to a certain topic demonstrates your grasp on the topic of study, and assists in the learning process. 

Table of Contents

• What is the purpose of literature review? 
• a. Habitat Loss and Species Extinction: 
• b. Range Shifts and Phenological Changes: 
• c. Ocean Acidification and Coral Reefs: 
• d. Adaptive Strategies and Conservation Efforts: 
• How to write a good literature review 
• Choose a Topic and Define the Research Question: 
• Decide on the Scope of Your Review: 
• Select Databases for Searches: 
• Conduct Searches and Keep Track: 
• Review the Literature: 
• Organize and Write Your Literature Review: 
• Frequently asked questions 

What is a literature review?

A well-conducted literature review demonstrates the researcher’s familiarity with the existing literature, establishes the context for their own research, and contributes to scholarly conversations on the topic. One of the purposes of a literature review is also to help researchers avoid duplicating previous work and ensure that their research is informed by and builds upon the existing body of knowledge.

What is the purpose of literature review?

A literature review serves several important purposes within academic and research contexts. Here are some key objectives and functions of a literature review: 2  

• Contextualizing the Research Problem: The literature review provides a background and context for the research problem under investigation. It helps to situate the study within the existing body of knowledge. 
• Identifying Gaps in Knowledge: By identifying gaps, contradictions, or areas requiring further research, the researcher can shape the research question and justify the significance of the study. This is crucial for ensuring that the new research contributes something novel to the field. 
• Understanding Theoretical and Conceptual Frameworks: Literature reviews help researchers gain an understanding of the theoretical and conceptual frameworks used in previous studies. This aids in the development of a theoretical framework for the current research. 
• Providing Methodological Insights: Another purpose of literature reviews is that it allows researchers to learn about the methodologies employed in previous studies. This can help in choosing appropriate research methods for the current study and avoiding pitfalls that others may have encountered. 
• Establishing Credibility: A well-conducted literature review demonstrates the researcher’s familiarity with existing scholarship, establishing their credibility and expertise in the field. It also helps in building a solid foundation for the new research. 
• Informing Hypotheses or Research Questions: The literature review guides the formulation of hypotheses or research questions by highlighting relevant findings and areas of uncertainty in existing literature. 

Literature review example

Let’s delve deeper with a literature review example: Let’s say your literature review is about the impact of climate change on biodiversity. You might format your literature review into sections such as the effects of climate change on habitat loss and species extinction, phenological changes, and marine biodiversity. Each section would then summarize and analyze relevant studies in those areas, highlighting key findings and identifying gaps in the research. The review would conclude by emphasizing the need for further research on specific aspects of the relationship between climate change and biodiversity. The following literature review template provides a glimpse into the recommended literature review structure and content, demonstrating how research findings are organized around specific themes within a broader topic. 

Literature Review on Climate Change Impacts on Biodiversity:

Climate change is a global phenomenon with far-reaching consequences, including significant impacts on biodiversity. This literature review synthesizes key findings from various studies: 

a. Habitat Loss and Species Extinction:

Climate change-induced alterations in temperature and precipitation patterns contribute to habitat loss, affecting numerous species (Thomas et al., 2004). The review discusses how these changes increase the risk of extinction, particularly for species with specific habitat requirements. 

b. Range Shifts and Phenological Changes:

Observations of range shifts and changes in the timing of biological events (phenology) are documented in response to changing climatic conditions (Parmesan & Yohe, 2003). These shifts affect ecosystems and may lead to mismatches between species and their resources. 

c. Ocean Acidification and Coral Reefs:

The review explores the impact of climate change on marine biodiversity, emphasizing ocean acidification’s threat to coral reefs (Hoegh-Guldberg et al., 2007). Changes in pH levels negatively affect coral calcification, disrupting the delicate balance of marine ecosystems. 

d. Adaptive Strategies and Conservation Efforts:

Recognizing the urgency of the situation, the literature review discusses various adaptive strategies adopted by species and conservation efforts aimed at mitigating the impacts of climate change on biodiversity (Hannah et al., 2007). It emphasizes the importance of interdisciplinary approaches for effective conservation planning. 

How to write a good literature review

Writing a literature review involves summarizing and synthesizing existing research on a particular topic. A good literature review format should include the following elements. 

Introduction: The introduction sets the stage for your literature review, providing context and introducing the main focus of your review. 

• Opening Statement: Begin with a general statement about the broader topic and its significance in the field. 
• Scope and Purpose: Clearly define the scope of your literature review. Explain the specific research question or objective you aim to address. 
• Organizational Framework: Briefly outline the structure of your literature review, indicating how you will categorize and discuss the existing research. 
• Significance of the Study: Highlight why your literature review is important and how it contributes to the understanding of the chosen topic. 
• Thesis Statement: Conclude the introduction with a concise thesis statement that outlines the main argument or perspective you will develop in the body of the literature review. 

Body: The body of the literature review is where you provide a comprehensive analysis of existing literature, grouping studies based on themes, methodologies, or other relevant criteria. 

• Organize by Theme or Concept: Group studies that share common themes, concepts, or methodologies. Discuss each theme or concept in detail, summarizing key findings and identifying gaps or areas of disagreement. 
• Critical Analysis: Evaluate the strengths and weaknesses of each study. Discuss the methodologies used, the quality of evidence, and the overall contribution of each work to the understanding of the topic. 
• Synthesis of Findings: Synthesize the information from different studies to highlight trends, patterns, or areas of consensus in the literature. 
• Identification of Gaps: Discuss any gaps or limitations in the existing research and explain how your review contributes to filling these gaps. 
• Transition between Sections: Provide smooth transitions between different themes or concepts to maintain the flow of your literature review. 

Conclusion: The conclusion of your literature review should summarize the main findings, highlight the contributions of the review, and suggest avenues for future research. 

• Summary of Key Findings: Recap the main findings from the literature and restate how they contribute to your research question or objective. 
• Contributions to the Field: Discuss the overall contribution of your literature review to the existing knowledge in the field. 
• Implications and Applications: Explore the practical implications of the findings and suggest how they might impact future research or practice. 
• Recommendations for Future Research: Identify areas that require further investigation and propose potential directions for future research in the field. 
• Final Thoughts: Conclude with a final reflection on the importance of your literature review and its relevance to the broader academic community. 

Conducting a literature review

Conducting a literature review is an essential step in research that involves reviewing and analyzing existing literature on a specific topic. It’s important to know how to do a literature review effectively, so here are the steps to follow: 1  

Choose a Topic and Define the Research Question:

• Select a topic that is relevant to your field of study. 
• Clearly define your research question or objective. Determine what specific aspect of the topic do you want to explore? 

Decide on the Scope of Your Review:

• Determine the timeframe for your literature review. Are you focusing on recent developments, or do you want a historical overview? 
• Consider the geographical scope. Is your review global, or are you focusing on a specific region? 
• Define the inclusion and exclusion criteria. What types of sources will you include? Are there specific types of studies or publications you will exclude? 

Select Databases for Searches:

• Identify relevant databases for your field. Examples include PubMed, IEEE Xplore, Scopus, Web of Science, and Google Scholar. 
• Consider searching in library catalogs, institutional repositories, and specialized databases related to your topic. 

Conduct Searches and Keep Track:

• Develop a systematic search strategy using keywords, Boolean operators (AND, OR, NOT), and other search techniques. 
• Record and document your search strategy for transparency and replicability. 
• Keep track of the articles, including publication details, abstracts, and links. Use citation management tools like EndNote, Zotero, or Mendeley to organize your references. 

Review the Literature:

• Evaluate the relevance and quality of each source. Consider the methodology, sample size, and results of studies. 
• Organize the literature by themes or key concepts. Identify patterns, trends, and gaps in the existing research. 
• Summarize key findings and arguments from each source. Compare and contrast different perspectives. 
• Identify areas where there is a consensus in the literature and where there are conflicting opinions. 
• Provide critical analysis and synthesis of the literature. What are the strengths and weaknesses of existing research? 

Organize and Write Your Literature Review:

• Literature review outline should be based on themes, chronological order, or methodological approaches. 
• Write a clear and coherent narrative that synthesizes the information gathered. 
• Use proper citations for each source and ensure consistency in your citation style (APA, MLA, Chicago, etc.). 
• Conclude your literature review by summarizing key findings, identifying gaps, and suggesting areas for future research. 

The literature review sample and detailed advice on writing and conducting a review will help you produce a well-structured report. But remember that a literature review is an ongoing process, and it may be necessary to revisit and update it as your research progresses. 

Frequently asked questions

A literature review is a critical and comprehensive analysis of existing literature (published and unpublished works) on a specific topic or research question and provides a synthesis of the current state of knowledge in a particular field. A well-conducted literature review is crucial for researchers to build upon existing knowledge, avoid duplication of efforts, and contribute to the advancement of their field. It also helps researchers situate their work within a broader context and facilitates the development of a sound theoretical and conceptual framework for their studies.

Literature review is a crucial component of research writing, providing a solid background for a research paper’s investigation. The aim is to keep professionals up to date by providing an understanding of ongoing developments within a specific field, including research methods, and experimental techniques used in that field, and present that knowledge in the form of a written report. Also, the depth and breadth of the literature review emphasizes the credibility of the scholar in his or her field.  

Before writing a literature review, it’s essential to undertake several preparatory steps to ensure that your review is well-researched, organized, and focused. This includes choosing a topic of general interest to you and doing exploratory research on that topic, writing an annotated bibliography, and noting major points, especially those that relate to the position you have taken on the topic. 

Literature reviews and academic research papers are essential components of scholarly work but serve different purposes within the academic realm. 3 A literature review aims to provide a foundation for understanding the current state of research on a particular topic, identify gaps or controversies, and lay the groundwork for future research. Therefore, it draws heavily from existing academic sources, including books, journal articles, and other scholarly publications. In contrast, an academic research paper aims to present new knowledge, contribute to the academic discourse, and advance the understanding of a specific research question. Therefore, it involves a mix of existing literature (in the introduction and literature review sections) and original data or findings obtained through research methods. 

Literature reviews are essential components of academic and research papers, and various strategies can be employed to conduct them effectively. If you want to know how to write a literature review for a research paper, here are four common approaches that are often used by researchers.  Chronological Review: This strategy involves organizing the literature based on the chronological order of publication. It helps to trace the development of a topic over time, showing how ideas, theories, and research have evolved.  Thematic Review: Thematic reviews focus on identifying and analyzing themes or topics that cut across different studies. Instead of organizing the literature chronologically, it is grouped by key themes or concepts, allowing for a comprehensive exploration of various aspects of the topic.  Methodological Review: This strategy involves organizing the literature based on the research methods employed in different studies. It helps to highlight the strengths and weaknesses of various methodologies and allows the reader to evaluate the reliability and validity of the research findings.  Theoretical Review: A theoretical review examines the literature based on the theoretical frameworks used in different studies. This approach helps to identify the key theories that have been applied to the topic and assess their contributions to the understanding of the subject.  It’s important to note that these strategies are not mutually exclusive, and a literature review may combine elements of more than one approach. The choice of strategy depends on the research question, the nature of the literature available, and the goals of the review. Additionally, other strategies, such as integrative reviews or systematic reviews, may be employed depending on the specific requirements of the research.

The literature review format can vary depending on the specific publication guidelines. However, there are some common elements and structures that are often followed. Here is a general guideline for the format of a literature review:  Introduction:   Provide an overview of the topic.  Define the scope and purpose of the literature review.  State the research question or objective.  Body:   Organize the literature by themes, concepts, or chronology.  Critically analyze and evaluate each source.  Discuss the strengths and weaknesses of the studies.  Highlight any methodological limitations or biases.  Identify patterns, connections, or contradictions in the existing research.  Conclusion:   Summarize the key points discussed in the literature review.  Highlight the research gap.  Address the research question or objective stated in the introduction.  Highlight the contributions of the review and suggest directions for future research.

Both annotated bibliographies and literature reviews involve the examination of scholarly sources. While annotated bibliographies focus on individual sources with brief annotations, literature reviews provide a more in-depth, integrated, and comprehensive analysis of existing literature on a specific topic. The key differences are as follows: 

References 

• Denney, A. S., & Tewksbury, R. (2013). How to write a literature review.  Journal of criminal justice education ,  24 (2), 218-234. 
• Pan, M. L. (2016).  Preparing literature reviews: Qualitative and quantitative approaches . Taylor & Francis. 
• Cantero, C. (2019). How to write a literature review.  San José State University Writing Center . 

Paperpal is an AI writing assistant that help academics write better, faster with real-time suggestions for in-depth language and grammar correction. Trained on millions of research manuscripts enhanced by professional academic editors, Paperpal delivers human precision at machine speed.  

Try it for free or upgrade to  Paperpal Prime , which unlocks unlimited access to premium features like academic translation, paraphrasing, contextual synonyms, consistency checks and more. It’s like always having a professional academic editor by your side! Go beyond limitations and experience the future of academic writing.  Get Paperpal Prime now at just US$19 a month!

Related Reads:

• Empirical Research: A Comprehensive Guide for Academics 
• How to Write a Scientific Paper in 10 Steps 
• Life Sciences Papers: 9 Tips for Authors Writing in Biological Sciences
• What is an Argumentative Essay? How to Write It (With Examples)

6 Tips for Post-Doc Researchers to Take Their Career to the Next Level

Self-plagiarism in research: what it is and how to avoid it, you may also like, why traditional editorial process needs an upgrade, paperpal’s new ai research finder empowers authors to..., what is hedging in academic writing  , how to use ai to enhance your college..., ai + human expertise – a paradigm shift..., how to use paperpal to generate emails &..., ai in education: it’s time to change the..., is it ethical to use ai-generated abstracts without..., do plagiarism checkers detect ai content, word choice problems: how to use the right....

What Is A Literature Review?

A plain-language explainer (with examples).

By:  Derek Jansen (MBA) & Kerryn Warren (PhD) | June 2020 (Updated May 2023)

If you’re faced with writing a dissertation or thesis, chances are you’ve encountered the term “literature review” . If you’re on this page, you’re probably not 100% what the literature review is all about. The good news is that you’ve come to the right place.

Literature Review 101

• What (exactly) is a literature review
• What’s the purpose of the literature review chapter
• How to find high-quality resources
• How to structure your literature review chapter
• Example of an actual literature review

What is a literature review?

The word “literature review” can refer to two related things that are part of the broader literature review process. The first is the task of  reviewing the literature  – i.e. sourcing and reading through the existing research relating to your research topic. The second is the  actual chapter  that you write up in your dissertation, thesis or research project. Let’s look at each of them:

Reviewing the literature

The first step of any literature review is to hunt down and  read through the existing research  that’s relevant to your research topic. To do this, you’ll use a combination of tools (we’ll discuss some of these later) to find journal articles, books, ebooks, research reports, dissertations, theses and any other credible sources of information that relate to your topic. You’ll then  summarise and catalogue these  for easy reference when you write up your literature review chapter. 

The literature review chapter

The second step of the literature review is to write the actual literature review chapter (this is usually the second chapter in a typical dissertation or thesis structure ). At the simplest level, the literature review chapter is an  overview of the key literature  that’s relevant to your research topic. This chapter should provide a smooth-flowing discussion of what research has already been done, what is known, what is unknown and what is contested in relation to your research topic. So, you can think of it as an  integrated review of the state of knowledge  around your research topic. 

What’s the purpose of a literature review?

The literature review chapter has a few important functions within your dissertation, thesis or research project. Let’s take a look at these:

Purpose #1 – Demonstrate your topic knowledge

The first function of the literature review chapter is, quite simply, to show the reader (or marker) that you  know what you’re talking about . In other words, a good literature review chapter demonstrates that you’ve read the relevant existing research and understand what’s going on – who’s said what, what’s agreed upon, disagreed upon and so on. This needs to be  more than just a summary  of who said what – it needs to integrate the existing research to  show how it all fits together  and what’s missing (which leads us to purpose #2, next). 

Purpose #2 – Reveal the research gap that you’ll fill

The second function of the literature review chapter is to  show what’s currently missing  from the existing research, to lay the foundation for your own research topic. In other words, your literature review chapter needs to show that there are currently “missing pieces” in terms of the bigger puzzle, and that  your study will fill one of those research gaps . By doing this, you are showing that your research topic is original and will help contribute to the body of knowledge. In other words, the literature review helps justify your research topic.  

Purpose #3 – Lay the foundation for your conceptual framework

The third function of the literature review is to form the  basis for a conceptual framework . Not every research topic will necessarily have a conceptual framework, but if your topic does require one, it needs to be rooted in your literature review. 

For example, let’s say your research aims to identify the drivers of a certain outcome – the factors which contribute to burnout in office workers. In this case, you’d likely develop a conceptual framework which details the potential factors (e.g. long hours, excessive stress, etc), as well as the outcome (burnout). Those factors would need to emerge from the literature review chapter – they can’t just come from your gut! 

So, in this case, the literature review chapter would uncover each of the potential factors (based on previous studies about burnout), which would then be modelled into a framework. 

Purpose #4 – To inform your methodology

The fourth function of the literature review is to  inform the choice of methodology  for your own research. As we’ve  discussed on the Grad Coach blog , your choice of methodology will be heavily influenced by your research aims, objectives and questions . Given that you’ll be reviewing studies covering a topic close to yours, it makes sense that you could learn a lot from their (well-considered) methodologies.

So, when you’re reviewing the literature, you’ll need to  pay close attention to the research design , methodology and methods used in similar studies, and use these to inform your methodology. Quite often, you’ll be able to  “borrow” from previous studies . This is especially true for quantitative studies , as you can use previously tried and tested measures and scales. 

How do I find articles for my literature review?

Finding quality journal articles is essential to crafting a rock-solid literature review. As you probably already know, not all research is created equally, and so you need to make sure that your literature review is  built on credible research . 

We could write an entire post on how to find quality literature (actually, we have ), but a good starting point is Google Scholar . Google Scholar is essentially the academic equivalent of Google, using Google’s powerful search capabilities to find relevant journal articles and reports. It certainly doesn’t cover every possible resource, but it’s a very useful way to get started on your literature review journey, as it will very quickly give you a good indication of what the  most popular pieces of research  are in your field.

One downside of Google Scholar is that it’s merely a search engine – that is, it lists the articles, but oftentimes  it doesn’t host the articles . So you’ll often hit a paywall when clicking through to journal websites. 

Thankfully, your university should provide you with access to their library, so you can find the article titles using Google Scholar and then search for them by name in your university’s online library. Your university may also provide you with access to  ResearchGate , which is another great source for existing research. 

Remember, the correct search keywords will be super important to get the right information from the start. So, pay close attention to the keywords used in the journal articles you read and use those keywords to search for more articles. If you can’t find a spoon in the kitchen, you haven’t looked in the right drawer. 

Need a helping hand?

How should I structure my literature review?

Unfortunately, there’s no generic universal answer for this one. The structure of your literature review will depend largely on your topic area and your research aims and objectives.

You could potentially structure your literature review chapter according to theme, group, variables , chronologically or per concepts in your field of research. We explain the main approaches to structuring your literature review here . You can also download a copy of our free literature review template to help you establish an initial structure.

In general, it’s also a good idea to start wide (i.e. the big-picture-level) and then narrow down, ending your literature review close to your research questions . However, there’s no universal one “right way” to structure your literature review. The most important thing is not to discuss your sources one after the other like a list – as we touched on earlier, your literature review needs to synthesise the research , not summarise it .

Ultimately, you need to craft your literature review so that it conveys the most important information effectively – it needs to tell a logical story in a digestible way. It’s no use starting off with highly technical terms and then only explaining what these terms mean later. Always assume your reader is not a subject matter expert and hold their hand through a journe y of the literature while keeping the functions of the literature review chapter (which we discussed earlier) front of mind.

Example of a literature review

In the video below, we walk you through a high-quality literature review from a dissertation that earned full distinction. This will give you a clearer view of what a strong literature review looks like in practice and hopefully provide some inspiration for your own. 

Wrapping Up

In this post, we’ve (hopefully) answered the question, “ what is a literature review? “. We’ve also considered the purpose and functions of the literature review, as well as how to find literature and how to structure the literature review chapter. If you’re keen to learn more, check out the literature review section of the Grad Coach blog , as well as our detailed video post covering how to write a literature review . 

Psst… there’s more!

This post is an extract from our bestselling Udemy Course, Literature Review Bootcamp . If you want to work smart, you don't want to miss this .

You Might Also Like:

16 Comments

Thanks for this review. It narrates what’s not been taught as tutors are always in a early to finish their classes.

Thanks for the kind words, Becky. Good luck with your literature review 🙂

This website is amazing, it really helps break everything down. Thank you, I would have been lost without it.

This is review is amazing. I benefited from it a lot and hope others visiting this website will benefit too.

Timothy T. Chol [email protected]

Thank you very much for the guiding in literature review I learn and benefited a lot this make my journey smooth I’ll recommend this site to my friends

This was so useful. Thank you so much.

Hi, Concept was explained nicely by both of you. Thanks a lot for sharing it. It will surely help research scholars to start their Research Journey.

The review is really helpful to me especially during this period of covid-19 pandemic when most universities in my country only offer online classes. Great stuff

Great Brief Explanation, thanks

So helpful to me as a student

GradCoach is a fantastic site with brilliant and modern minds behind it.. I spent weeks decoding the substantial academic Jargon and grounding my initial steps on the research process, which could be shortened to a couple of days through the Gradcoach. Thanks again!

This is an amazing talk. I paved way for myself as a researcher. Thank you GradCoach!

Well-presented overview of the literature!

This was brilliant. So clear. Thank you

Submit a Comment Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

• Print Friendly

Encyclopedia of Evidence in Pharmaceutical Public Health and Health Services Research in Pharmacy pp 1–15 Cite as

Methodological Approaches to Literature Review

• Dennis Thomas 2 ,
• Elida Zairina 3 &
• Johnson George 4  
• Living reference work entry
• First Online: 09 May 2023

453 Accesses

The literature review can serve various functions in the contexts of education and research. It aids in identifying knowledge gaps, informing research methodology, and developing a theoretical framework during the planning stages of a research study or project, as well as reporting of review findings in the context of the existing literature. This chapter discusses the methodological approaches to conducting a literature review and offers an overview of different types of reviews. There are various types of reviews, including narrative reviews, scoping reviews, and systematic reviews with reporting strategies such as meta-analysis and meta-synthesis. Review authors should consider the scope of the literature review when selecting a type and method. Being focused is essential for a successful review; however, this must be balanced against the relevance of the review to a broad audience.

This is a preview of subscription content, log in via an institution .

Akobeng AK. Principles of evidence based medicine. Arch Dis Child. 2005;90(8):837–40.

Article   CAS   PubMed   PubMed Central   Google Scholar  

Alharbi A, Stevenson M. Refining Boolean queries to identify relevant studies for systematic review updates. J Am Med Inform Assoc. 2020;27(11):1658–66.

Article   PubMed   PubMed Central   Google Scholar  

Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.

Article   Google Scholar  

Aromataris E MZE. JBI manual for evidence synthesis. 2020.

Google Scholar  

Aromataris E, Pearson A. The systematic review: an overview. Am J Nurs. 2014;114(3):53–8.

Article   PubMed   Google Scholar  

Aromataris E, Riitano D. Constructing a search strategy and searching for evidence. A guide to the literature search for a systematic review. Am J Nurs. 2014;114(5):49–56.

Babineau J. Product review: covidence (systematic review software). J Canad Health Libr Assoc Canada. 2014;35(2):68–71.

Baker JD. The purpose, process, and methods of writing a literature review. AORN J. 2016;103(3):265–9.

Bastian H, Glasziou P, Chalmers I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med. 2010;7(9):e1000326.

Bramer WM, Rethlefsen ML, Kleijnen J, Franco OH. Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study. Syst Rev. 2017;6(1):1–12.

Brown D. A review of the PubMed PICO tool: using evidence-based practice in health education. Health Promot Pract. 2020;21(4):496–8.

Cargo M, Harris J, Pantoja T, et al. Cochrane qualitative and implementation methods group guidance series – paper 4: methods for assessing evidence on intervention implementation. J Clin Epidemiol. 2018;97:59–69.

Cook DJ, Mulrow CD, Haynes RB. Systematic reviews: synthesis of best evidence for clinical decisions. Ann Intern Med. 1997;126(5):376–80.

Article   CAS   PubMed   Google Scholar  

Counsell C. Formulating questions and locating primary studies for inclusion in systematic reviews. Ann Intern Med. 1997;127(5):380–7.

Cummings SR, Browner WS, Hulley SB. Conceiving the research question and developing the study plan. In: Cummings SR, Browner WS, Hulley SB, editors. Designing Clinical Research: An Epidemiological Approach. 4th ed. Philadelphia (PA): P Lippincott Williams & Wilkins; 2007. p. 14–22.

Eriksen MB, Frandsen TF. The impact of patient, intervention, comparison, outcome (PICO) as a search strategy tool on literature search quality: a systematic review. JMLA. 2018;106(4):420.

Ferrari R. Writing narrative style literature reviews. Medical Writing. 2015;24(4):230–5.

Flemming K, Booth A, Hannes K, Cargo M, Noyes J. Cochrane qualitative and implementation methods group guidance series – paper 6: reporting guidelines for qualitative, implementation, and process evaluation evidence syntheses. J Clin Epidemiol. 2018;97:79–85.

Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Inf Libr J. 2009;26(2):91–108.

Green BN, Johnson CD, Adams A. Writing narrative literature reviews for peer-reviewed journals: secrets of the trade. J Chiropr Med. 2006;5(3):101–17.

Gregory AT, Denniss AR. An introduction to writing narrative and systematic reviews; tasks, tips and traps for aspiring authors. Heart Lung Circ. 2018;27(7):893–8.

Harden A, Thomas J, Cargo M, et al. Cochrane qualitative and implementation methods group guidance series – paper 5: methods for integrating qualitative and implementation evidence within intervention effectiveness reviews. J Clin Epidemiol. 2018;97:70–8.

Harris JL, Booth A, Cargo M, et al. Cochrane qualitative and implementation methods group guidance series – paper 2: methods for question formulation, searching, and protocol development for qualitative evidence synthesis. J Clin Epidemiol. 2018;97:39–48.

Higgins J, Thomas J. In: Chandler J, Cumpston M, Li T, Page MJ, Welch VA, editors. Cochrane Handbook for Systematic Reviews of Interventions version 6.3, updated February 2022). Available from www.training.cochrane.org/handbook.: Cochrane; 2022.

International prospective register of systematic reviews (PROSPERO). Available from https://www.crd.york.ac.uk/prospero/ .

Khan KS, Kunz R, Kleijnen J, Antes G. Five steps to conducting a systematic review. J R Soc Med. 2003;96(3):118–21.

Landhuis E. Scientific literature: information overload. Nature. 2016;535(7612):457–8.

Lockwood C, Porritt K, Munn Z, Rittenmeyer L, Salmond S, Bjerrum M, Loveday H, Carrier J, Stannard D. Chapter 2: Systematic reviews of qualitative evidence. In: Aromataris E, Munn Z, editors. JBI Manual for Evidence Synthesis. JBI; 2020. Available from https://synthesismanual.jbi.global . https://doi.org/10.46658/JBIMES-20-03 .

Chapter   Google Scholar  

Lorenzetti DL, Topfer L-A, Dennett L, Clement F. Value of databases other than medline for rapid health technology assessments. Int J Technol Assess Health Care. 2014;30(2):173–8.

Moher D, Liberati A, Tetzlaff J, Altman DG, the PRISMA Group. Preferred reporting items for (SR) and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;6:264–9.

Mulrow CD. Systematic reviews: rationale for systematic reviews. BMJ. 1994;309(6954):597–9.

Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. 2018;18(1):143.

Munthe-Kaas HM, Glenton C, Booth A, Noyes J, Lewin S. Systematic mapping of existing tools to appraise methodological strengths and limitations of qualitative research: first stage in the development of the CAMELOT tool. BMC Med Res Methodol. 2019;19(1):1–13.

Murphy CM. Writing an effective review article. J Med Toxicol. 2012;8(2):89–90.

NHMRC. Guidelines for guidelines: assessing risk of bias. Available at https://nhmrc.gov.au/guidelinesforguidelines/develop/assessing-risk-bias . Last published 29 August 2019. Accessed 29 Aug 2022.

Noyes J, Booth A, Cargo M, et al. Cochrane qualitative and implementation methods group guidance series – paper 1: introduction. J Clin Epidemiol. 2018b;97:35–8.

Noyes J, Booth A, Flemming K, et al. Cochrane qualitative and implementation methods group guidance series – paper 3: methods for assessing methodological limitations, data extraction and synthesis, and confidence in synthesized qualitative findings. J Clin Epidemiol. 2018a;97:49–58.

Noyes J, Booth A, Moore G, Flemming K, Tunçalp Ö, Shakibazadeh E. Synthesising quantitative and qualitative evidence to inform guidelines on complex interventions: clarifying the purposes, designs and outlining some methods. BMJ Glob Health. 2019;4(Suppl 1):e000893.

Peters MD, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. Guidance for conducting systematic scoping reviews. Int J Evid Healthcare. 2015;13(3):141–6.

Polanin JR, Pigott TD, Espelage DL, Grotpeter JK. Best practice guidelines for abstract screening large-evidence systematic reviews and meta-analyses. Res Synth Methods. 2019;10(3):330–42.

Article   PubMed Central   Google Scholar  

Shea BJ, Grimshaw JM, Wells GA, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7(1):1–7.

Shea BJ, Reeves BC, Wells G, et al. AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. Brit Med J. 2017;358

Sterne JA, Hernán MA, Reeves BC, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. Br Med J. 2016;355

Stroup DF, Berlin JA, Morton SC, et al. Meta-analysis of observational studies in epidemiology: a proposal for reporting. JAMA. 2000;283(15):2008–12.

Tawfik GM, Dila KAS, Mohamed MYF, et al. A step by step guide for conducting a systematic review and meta-analysis with simulation data. Trop Med Health. 2019;47(1):1–9.

The Critical Appraisal Program. Critical appraisal skills program. Available at https://casp-uk.net/ . 2022. Accessed 29 Aug 2022.

The University of Melbourne. Writing a literature review in Research Techniques 2022. Available at https://students.unimelb.edu.au/academic-skills/explore-our-resources/research-techniques/reviewing-the-literature . Accessed 29 Aug 2022.

The Writing Center University of Winconsin-Madison. Learn how to write a literature review in The Writer’s Handbook – Academic Professional Writing. 2022. Available at https://writing.wisc.edu/handbook/assignments/reviewofliterature/ . Accessed 29 Aug 2022.

Thompson SG, Sharp SJ. Explaining heterogeneity in meta-analysis: a comparison of methods. Stat Med. 1999;18(20):2693–708.

Tricco AC, Lillie E, Zarin W, et al. A scoping review on the conduct and reporting of scoping reviews. BMC Med Res Methodol. 2016;16(1):15.

Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–73.

Yoneoka D, Henmi M. Clinical heterogeneity in random-effect meta-analysis: between-study boundary estimate problem. Stat Med. 2019;38(21):4131–45.

Yuan Y, Hunt RH. Systematic reviews: the good, the bad, and the ugly. Am J Gastroenterol. 2009;104(5):1086–92.

Download references

Author information

Authors and affiliations.

Centre of Excellence in Treatable Traits, College of Health, Medicine and Wellbeing, University of Newcastle, Hunter Medical Research Institute Asthma and Breathing Programme, Newcastle, NSW, Australia

Dennis Thomas

Department of Pharmacy Practice, Faculty of Pharmacy, Universitas Airlangga, Surabaya, Indonesia

Elida Zairina

Centre for Medicine Use and Safety, Monash Institute of Pharmaceutical Sciences, Faculty of Pharmacy and Pharmaceutical Sciences, Monash University, Parkville, VIC, Australia

Johnson George

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Johnson George .

Section Editor information

College of Pharmacy, Qatar University, Doha, Qatar

Derek Charles Stewart

Department of Pharmacy, University of Huddersfield, Huddersfield, United Kingdom

Zaheer-Ud-Din Babar

Rights and permissions

Reprints and permissions

Copyright information

© 2023 Springer Nature Switzerland AG

About this entry

Cite this entry.

Thomas, D., Zairina, E., George, J. (2023). Methodological Approaches to Literature Review. In: Encyclopedia of Evidence in Pharmaceutical Public Health and Health Services Research in Pharmacy. Springer, Cham. https://doi.org/10.1007/978-3-030-50247-8_57-1

Download citation

DOI : https://doi.org/10.1007/978-3-030-50247-8_57-1

Received : 22 February 2023

Accepted : 22 February 2023

Published : 09 May 2023

Publisher Name : Springer, Cham

Print ISBN : 978-3-030-50247-8

Online ISBN : 978-3-030-50247-8

eBook Packages : Springer Reference Biomedicine and Life Sciences Reference Module Biomedical and Life Sciences

• Publish with us

Policies and ethics

• Find a journal
• Track your research

How to Write a Literature Review

Learn what a literature review is, where it is used, and the structure it should follow, including how to refer to studies and establish themes. We provides tips on writing a literature review, such as stating your research question, selecting key terms, and finding relevant literature on your topic.

Updated on May 17, 2023

A literature review is an overview of the existing literature on a particular topic. It provides a concise summary and critical analysis of existing publications. This justifies why the study was conducted. It also helps the reader understand the topic and see areas for future research. It can be part of a manuscript’s introduction section or a required part of an academic thesis. It can also be a standalone paper, such as a narrative review.

This article discusses what a literature review is when it’s part of a research paper. It provides strategies, tools, and tips for writing a good review.

What is a literature review, and where is it used?

A literature review is an organized summary of existing literature on a topic or research question. It’s used to help readers understand what has been done before related to the topic you’re writing on.

It shows how your study fits into the literature, why your study is needed, and what novel insights your study will bring to the literature.

In that sense, a literature review justifies your work and its potential impact. Literature reviews are also valuable for other researchers, as they can overview a specific topic.

A literature review is used in academic documents, including manuscripts, theses and dissertations, and in standalone papers such as systematic reviews and narrative reviews.

In a manuscript or dissertation, the literature review is presented as background information in the introduction section. Here, it summarizes prior research on the key concepts the paper focuses on, identifies gaps in the literature, and provides context for why the current study is needed. It focuses on summarizing articles that provide specific evidence relating to the topic of the larger manuscript and is very narrowly focused.

In contrast, a standalone literature review is a comprehensive and critical analysis of the existing research and literature on a specific topic. It synthesizes the current state of knowledge on the topic, identifies gaps, contradictions, and future directions for research. A literature review paper is typically longer, more comprehensive, and applies a study methodology.

What structure do literature reviews follow?

Literature reviews follow a logical structure, meaning every sentence logically leads to the next. They begin with a broad overview of the topic and then narrow down to specific research carried out on that topic in a way that builds on the previous information. Supporting studies are discussed one-by-one or they’re grouped by themes. They may or may not specifically indicate the authors by name. That depends on personal style and guidelines.

Referring to studies

For example, the literature review in Howden et al. (2018), reporting on a randomized controlled trial (RCT) on fitness and heart failure, first states the overall theme: sedentary aging’s association with worsening cardiovascular health. In concise sentences, it then lists the themes along with subscript numbers of the supporting literature, e.g., “...middle age is the strongest predictor of future heart failure.5–7”. No authors are named. This may be because of the referencing style (using numbers leading to the References list, unlike, for instance, APA, which uses last names), or it may be the authors’ preference.

Tramontano et al. (2021), on remote work , lists authors’ names along with the supporting research. In some cases, the names are in parentheses (per APA style) and in other cases, (e.g., ...Gonzales Vazquez and colleagues (2019) indicated...) the names represent the study. Again, it’s a combination of referencing style and authors’ preference.

Establish themes

As the literature review progresses, you synthesize the information from the articles. Articles are grouped together by theme or evidence (i.e., supporting or contrasting), with relevant citations giving support. Typically, findings are condensed and summarized concisely (i.e., in one or a couple of sentences).

For example, if you were exploring how processed food affects heart health, articles in the literature review might be grouped into categories such as heart health in general, processed foods, and the negative effects of processed foods on general heart health. You’d then summarize the key findings for each category with relevant citations.

As such, a literature review in a manuscript is not simply a chronological list of articles and their findings. Rather, it’s a report and analysis of the existing literature. It weaves a narrative that underpins your own study.

Writing your literature review

State your research question .

The first step to writing a good literature review is stating your research question.

If you’re writing a manuscript or dissertation, you likely already know what your research question is. Be sure it’s clearly presented at the end of the introductory paragraph so the reader immediately knows what the study will be about.

Select key terms

Next, identify several key words/terms/phrases that will be used to query your search for relevant literature.

For example, if your manuscript is about the effects of processed foods on heart health, you will want to use keywords such as “cardiovascular,” “processed foods,” and “heart disease” to retrieve relevant publications.

Find relevant literature on your topic

Most researchers have a specialty or a few specialties. Reading other studies should already be part of your day-to-day practice. So it’s very unusual to start a literature review from zero. You probably already have a folder full of PDFs (or, ideally, a reference manager full of well-organized articles in digital format).

For your current research, you’ll then add further literature in more specific and specialized areas. You’ll need to update your personal library. And you may find you lack sufficient publications in a certain area of research. Your literature review will address all these issues. Methods for diving in include databases, review articles, and asking colleagues and other researchers.

Online databases

Searching with databases often requires a combination of free and paid sources.

Google Scholar is probably the most commonly known search engine for academic literature because, well, it’s Google. Type titles, keywords, authors, or other entries to find papers on your topic of interest. You don’t need to create an account, but just because a publication is listed in Scholar doesn’t mean you can access the full text. Still, its powerful search features can help you rapidly narrow your search. You can then find publications in a database for which you have a subscription.

EBSCO and ProQuest are commonly available in universities’ online libraries, and databases like PubMed are comprehensive scientific collections. Some databases are open access, while others require a subscription to fully access the articles. Hopefully, you have access through your university or institution.

There are also publisher-managed search engines and databases like ScienceDirect or Scopus , as well as Wiley Online Library . These usually require a subscription.

Elicit is an AI-based search engine. Ask a research question and find relevant literature. It also suggests questions based on your input for better results. No account is needed.

Zendy is a search engine dedicated to open access journals. It’s accessible once you create an account.

Colleagues, fellow researchers

Asking your colleagues or fellow researchers in your field can be a great resource for finding additional studies. You can also look for highly cited papers in your field or search for articles from known experts in your field.

Other literature reviews, review articles, and reference lists

Previous review papers on your topic, introduction sections of articles (which contain their own literature reviews), are reference lists of papers are all great tools for finding additional articles. Look through the reference lists of previous prior review papers to locate other relevant articles.

With this approach, you’ll find yourself diving down one rabbit hole after another. And it can get overwhelming, so scan quickly, keep notes, and use a good reference manager (see below). After a while, you’ll start to see the same publications emerge. You’ll start to recognize the seminal pieces as well as highly specific studies on limited populations.

Software and reference managers

Apps like Connected Papers can help expand your collection and ensure you’re not missing any articles. With this tool, you can search for a work and then see it visualized through other articles it references, and that referenced it. It’s shown as a network of connected papers – fantastic for visual types.

Reference managers like EndNote and Mendeley are helpful tools for organizing your papers and adding citations to your manuscript. You can download them to your computer and easily search for the information you’ve read before, saving a lot of time in the writing process. While they both require creating an account, Mendeley is free. Paperpile is an excellent lighter-weight option.

Organize your sources

When you’ve compiled sufficient publications via your literature search, extract relevant information for your research question.

Identify themes

First, identify the most relevant papers for your research question. One good approach is to read the abstract and methods sections to understand the main findings.

Narrow down your list to articles that have a research question as similar as possible to yours. Then, group them by themes or evidence. For instance, group articles showing that processed foods lead to increased rates of heart disease in one section.

Include contradictory evidence to fully cover the scope of the topic. This will help you better organize the sections for your review later.

Define your key concepts

Every good review section begins with specific definitions of the concepts the paper will focus on. They should be defined in the abstract and introduction.

Write an outline

Write an outline with subheadings representing categories or themes your review will cover. Under each theme, enter a few references or key points that reflect what you want to convey to your reader in that section.

Organize the subheadings logically so that one idea flows into the next. Don’t jump back and forth between concepts. For example, if you’re establishing a common, evidence-supported definition of heart disease, focus only on that. Bringing in other diseases will confuse the reader. If you need to compare with other diseases, that’s probably cause for another subsection.

Review previous articles on your topic and check how the authors structured their introduction section to get ideas for your outline.

For longer reviews, you can use tables to present the literature and key themes more clearly for the reader. Tables are especially useful in dedicated review papers like narrative reviews.

Write your literature review

Following your outline, expand on your notes with sentences and paragraphs, including relevant citations (see the section above for examples of how these are typically written). Use clear and concise language. Make sure all your paragraphs have a dedicated topic sentence that reflects what the rest of the paragraph is about.

Start your review broadly, then use your prior research to narrow down to why your research question is needed. For example, define what heart disease is broadly, then narrow down to how specific processed foods can impact it and what still needs to be investigated (i.e., with your study).

Review your work

After finishing your first draft, revise and refine your work. Here are some key steps.

Refine your literature review

As you write, you may need to expand sections or include more evidence. Read over your review several times and determine if it’s conveying the information you want to get across clearly and adjust accordingly.

Omit unnecessary information

In scientific communication, less is more, so avoid making your review too long. Remove unnecessary information and avoid being too wordy. As a general rule, aim for just one idea per sentence and no more than around 15–20 words per sentence.

A credible citation (or citations) should support every assertion. But it can also get tempting to follow irrelevant paths that aren’t immediately relevant to the study you’re doing now.

Professional editing can also help you refine wordiness.

Check the logical structure

Check that each section in your review relates to the main research question. Check that every paragraph transitions smoothly to the next and that the ideas flow logically from one argument to the next. Ask yourself, “Does this idea directly relate to my next idea?” (and vice versa).

Also, check for consistency and completeness. Be sure you used the same wording for key concepts throughout your review and that you included all relevant evidence for your arguments.

Check for and remove/correct plagiarism

There are many ways to plagiarize , and some authors don’t even know when they’re doing it. It can be a critical mistake.

Journals use tools such as i Thenticate to detect plagiarism. And being caught plagiarizing can be a cause for a rapid rejection . Avoid plagiarizing by ensuring you cite the original source and don’t copy/paste text unless you use quotation marks. You can check for plagiarism using apps like Grammarly or Trinka , which can also help you improve your writing style and correct grammar mistakes.

Get outside perspectives

Ask a senior researcher or colleague to read your work and provide feedback or criticism. Ask junior researchers as well. Put your ego on the line for the good of rigorous science. Often, those with less experience may be able to see the more basic gaps in logic and clarity, as they bring a less honed and specialized perspective.

Check that you’ve included all references in the format required by the journal (e.g., APA, Vancouver, AMA). Use tools like Mendeley and EndNote to automatically generate a bibliography section based on the references you enter in your document. But do double-check what the software generates. It may be relying on incorrect metadata.

Good example of a literature review in a published article

Good literature reviews should be clear, concise, and informative. They should present enough information on the topic that you can understand the importance of the topic, the relevance of the literature included for the broader field, and what’s still missing from the literature (i.e., where further research is needed).

Here’s a good example:

Heart issues, sedentary lifestyle, exercise (from Howden et al. 2018)

Readable and well-structured, this review quickly highlights the negative relationship between a sedentary lifestyle and heart issues. It concisely reviews previous literature showing the relationship between exercise and heart health, so the reader understands why the study is needed.

Bonus: What’s the difference between a literature review and an annotated bibliography?

An annotated bibliography is a list of references with a brief summary of the results of that reference. It can also include your personal notes on the study and why it’s relevant to your study.

Especially for students, a literature review can be confused with an annotated bibliography. Both these devices detail existing studies. However, they perform quite different functions.

Annotated bibliographies are powerful when you’re writing a dissertation or any longer research piece, as they help you keep track of everything you’ve read and why it’s relevant. You may not publish it, but you can definitely use it when you write your literature review.

So, the key differences between an annotated bibliography are:

• An annotated bibliography is a list of references with no connection established among them, while a literature review is a narrative of all the studies.
• Annotated bibliographies are organized alphabetically by reference, whereas literature reviews are organized by themes or supporting or contrasting evidence. 
• Annotated bibliographies summarize (in a few sentences) each reference, while literature reviews place the publication in context along with other publications.

The AJE Team

See our "Privacy Policy"

Harvey Cushing/John Hay Whitney Medical Library

• Collections
• Research Help

YSN Doctoral Programs: Steps in Conducting a Literature Review

• Biomedical Databases
• Global (Public Health) Databases
• Soc. Sci., History, and Law Databases
• Grey Literature
• Trials Registers
• Data and Statistics
• Public Policy
• Google Tips
• Recommended Books
• Steps in Conducting a Literature Review

What is a literature review?

A literature review is an integrated analysis -- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question.  That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.

A literature review may be a stand alone work or the introduction to a larger research paper, depending on the assignment.  Rely heavily on the guidelines your instructor has given you.

Why is it important?

A literature review is important because it:

• Explains the background of research on a topic.
• Demonstrates why a topic is significant to a subject area.
• Discovers relationships between research studies/ideas.
• Identifies major themes, concepts, and researchers on a topic.
• Identifies critical gaps and points of disagreement.
• Discusses further research questions that logically come out of the previous studies.

APA7 Style resources

APA Style Blog - for those harder to find answers

1. Choose a topic. Define your research question.

Your literature review should be guided by your central research question.  The literature represents background and research developments related to a specific research question, interpreted and analyzed by you in a synthesized way.

• Make sure your research question is not too broad or too narrow.  Is it manageable?
• Begin writing down terms that are related to your question. These will be useful for searches later.
• If you have the opportunity, discuss your topic with your professor and your class mates.

2. Decide on the scope of your review

How many studies do you need to look at? How comprehensive should it be? How many years should it cover? 

• This may depend on your assignment.  How many sources does the assignment require?

3. Select the databases you will use to conduct your searches.

Make a list of the databases you will search. 

Where to find databases:

• use the tabs on this guide
• Find other databases in the Nursing Information Resources web page
• More on the Medical Library web page
• ... and more on the Yale University Library web page

4. Conduct your searches to find the evidence. Keep track of your searches.

• Use the key words in your question, as well as synonyms for those words, as terms in your search. Use the database tutorials for help.
• Save the searches in the databases. This saves time when you want to redo, or modify, the searches. It is also helpful to use as a guide is the searches are not finding any useful results.
• Review the abstracts of research studies carefully. This will save you time.
• Use the bibliographies and references of research studies you find to locate others.
• Check with your professor, or a subject expert in the field, if you are missing any key works in the field.
• Ask your librarian for help at any time.
• Use a citation manager, such as EndNote as the repository for your citations. See the EndNote tutorials for help.

Review the literature

Some questions to help you analyze the research:

• What was the research question of the study you are reviewing? What were the authors trying to discover?
• Was the research funded by a source that could influence the findings?
• What were the research methodologies? Analyze its literature review, the samples and variables used, the results, and the conclusions.
• Does the research seem to be complete? Could it have been conducted more soundly? What further questions does it raise?
• If there are conflicting studies, why do you think that is?
• How are the authors viewed in the field? Has this study been cited? If so, how has it been analyzed?

Tips: 

• Review the abstracts carefully.  
• Keep careful notes so that you may track your thought processes during the research process.
• Create a matrix of the studies for easy analysis, and synthesis, across all of the studies.
• << Previous: Recommended Books
• Last Updated: Jan 4, 2024 10:52 AM
• URL: https://guides.library.yale.edu/YSNDoctoral

An official website of the United States government

The .gov means it's official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you're on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings
• Browse Titles

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Lau F, Kuziemsky C, editors. Handbook of eHealth Evaluation: An Evidence-based Approach [Internet]. Victoria (BC): University of Victoria; 2017 Feb 27.

Handbook of eHealth Evaluation: An Evidence-based Approach [Internet].

Chapter 9 methods for literature reviews.

Guy Paré and Spyros Kitsiou .

9.1. Introduction

Literature reviews play a critical role in scholarship because science remains, first and foremost, a cumulative endeavour ( vom Brocke et al., 2009 ). As in any academic discipline, rigorous knowledge syntheses are becoming indispensable in keeping up with an exponentially growing eHealth literature, assisting practitioners, academics, and graduate students in finding, evaluating, and synthesizing the contents of many empirical and conceptual papers. Among other methods, literature reviews are essential for: (a) identifying what has been written on a subject or topic; (b) determining the extent to which a specific research area reveals any interpretable trends or patterns; (c) aggregating empirical findings related to a narrow research question to support evidence-based practice; (d) generating new frameworks and theories; and (e) identifying topics or questions requiring more investigation ( Paré, Trudel, Jaana, & Kitsiou, 2015 ).

Literature reviews can take two major forms. The most prevalent one is the “literature review” or “background” section within a journal paper or a chapter in a graduate thesis. This section synthesizes the extant literature and usually identifies the gaps in knowledge that the empirical study addresses ( Sylvester, Tate, & Johnstone, 2013 ). It may also provide a theoretical foundation for the proposed study, substantiate the presence of the research problem, justify the research as one that contributes something new to the cumulated knowledge, or validate the methods and approaches for the proposed study ( Hart, 1998 ; Levy & Ellis, 2006 ).

The second form of literature review, which is the focus of this chapter, constitutes an original and valuable work of research in and of itself ( Paré et al., 2015 ). Rather than providing a base for a researcher’s own work, it creates a solid starting point for all members of the community interested in a particular area or topic ( Mulrow, 1987 ). The so-called “review article” is a journal-length paper which has an overarching purpose to synthesize the literature in a field, without collecting or analyzing any primary data ( Green, Johnson, & Adams, 2006 ).

When appropriately conducted, review articles represent powerful information sources for practitioners looking for state-of-the art evidence to guide their decision-making and work practices ( Paré et al., 2015 ). Further, high-quality reviews become frequently cited pieces of work which researchers seek out as a first clear outline of the literature when undertaking empirical studies ( Cooper, 1988 ; Rowe, 2014 ). Scholars who track and gauge the impact of articles have found that review papers are cited and downloaded more often than any other type of published article ( Cronin, Ryan, & Coughlan, 2008 ; Montori, Wilczynski, Morgan, Haynes, & Hedges, 2003 ; Patsopoulos, Analatos, & Ioannidis, 2005 ). The reason for their popularity may be the fact that reading the review enables one to have an overview, if not a detailed knowledge of the area in question, as well as references to the most useful primary sources ( Cronin et al., 2008 ). Although they are not easy to conduct, the commitment to complete a review article provides a tremendous service to one’s academic community ( Paré et al., 2015 ; Petticrew & Roberts, 2006 ). Most, if not all, peer-reviewed journals in the fields of medical informatics publish review articles of some type.

The main objectives of this chapter are fourfold: (a) to provide an overview of the major steps and activities involved in conducting a stand-alone literature review; (b) to describe and contrast the different types of review articles that can contribute to the eHealth knowledge base; (c) to illustrate each review type with one or two examples from the eHealth literature; and (d) to provide a series of recommendations for prospective authors of review articles in this domain.

9.2. Overview of the Literature Review Process and Steps

As explained in Templier and Paré (2015) , there are six generic steps involved in conducting a review article:

• formulating the research question(s) and objective(s),
• searching the extant literature,
• screening for inclusion,
• assessing the quality of primary studies,
• extracting data, and
• analyzing data.

Although these steps are presented here in sequential order, one must keep in mind that the review process can be iterative and that many activities can be initiated during the planning stage and later refined during subsequent phases ( Finfgeld-Connett & Johnson, 2013 ; Kitchenham & Charters, 2007 ).

Formulating the research question(s) and objective(s): As a first step, members of the review team must appropriately justify the need for the review itself ( Petticrew & Roberts, 2006 ), identify the review’s main objective(s) ( Okoli & Schabram, 2010 ), and define the concepts or variables at the heart of their synthesis ( Cooper & Hedges, 2009 ; Webster & Watson, 2002 ). Importantly, they also need to articulate the research question(s) they propose to investigate ( Kitchenham & Charters, 2007 ). In this regard, we concur with Jesson, Matheson, and Lacey (2011) that clearly articulated research questions are key ingredients that guide the entire review methodology; they underscore the type of information that is needed, inform the search for and selection of relevant literature, and guide or orient the subsequent analysis. Searching the extant literature: The next step consists of searching the literature and making decisions about the suitability of material to be considered in the review ( Cooper, 1988 ). There exist three main coverage strategies. First, exhaustive coverage means an effort is made to be as comprehensive as possible in order to ensure that all relevant studies, published and unpublished, are included in the review and, thus, conclusions are based on this all-inclusive knowledge base. The second type of coverage consists of presenting materials that are representative of most other works in a given field or area. Often authors who adopt this strategy will search for relevant articles in a small number of top-tier journals in a field ( Paré et al., 2015 ). In the third strategy, the review team concentrates on prior works that have been central or pivotal to a particular topic. This may include empirical studies or conceptual papers that initiated a line of investigation, changed how problems or questions were framed, introduced new methods or concepts, or engendered important debate ( Cooper, 1988 ). Screening for inclusion: The following step consists of evaluating the applicability of the material identified in the preceding step ( Levy & Ellis, 2006 ; vom Brocke et al., 2009 ). Once a group of potential studies has been identified, members of the review team must screen them to determine their relevance ( Petticrew & Roberts, 2006 ). A set of predetermined rules provides a basis for including or excluding certain studies. This exercise requires a significant investment on the part of researchers, who must ensure enhanced objectivity and avoid biases or mistakes. As discussed later in this chapter, for certain types of reviews there must be at least two independent reviewers involved in the screening process and a procedure to resolve disagreements must also be in place ( Liberati et al., 2009 ; Shea et al., 2009 ). Assessing the quality of primary studies: In addition to screening material for inclusion, members of the review team may need to assess the scientific quality of the selected studies, that is, appraise the rigour of the research design and methods. Such formal assessment, which is usually conducted independently by at least two coders, helps members of the review team refine which studies to include in the final sample, determine whether or not the differences in quality may affect their conclusions, or guide how they analyze the data and interpret the findings ( Petticrew & Roberts, 2006 ). Ascribing quality scores to each primary study or considering through domain-based evaluations which study components have or have not been designed and executed appropriately makes it possible to reflect on the extent to which the selected study addresses possible biases and maximizes validity ( Shea et al., 2009 ). Extracting data: The following step involves gathering or extracting applicable information from each primary study included in the sample and deciding what is relevant to the problem of interest ( Cooper & Hedges, 2009 ). Indeed, the type of data that should be recorded mainly depends on the initial research questions ( Okoli & Schabram, 2010 ). However, important information may also be gathered about how, when, where and by whom the primary study was conducted, the research design and methods, or qualitative/quantitative results ( Cooper & Hedges, 2009 ). Analyzing and synthesizing data : As a final step, members of the review team must collate, summarize, aggregate, organize, and compare the evidence extracted from the included studies. The extracted data must be presented in a meaningful way that suggests a new contribution to the extant literature ( Jesson et al., 2011 ). Webster and Watson (2002) warn researchers that literature reviews should be much more than lists of papers and should provide a coherent lens to make sense of extant knowledge on a given topic. There exist several methods and techniques for synthesizing quantitative (e.g., frequency analysis, meta-analysis) and qualitative (e.g., grounded theory, narrative analysis, meta-ethnography) evidence ( Dixon-Woods, Agarwal, Jones, Young, & Sutton, 2005 ; Thomas & Harden, 2008 ).

9.3. Types of Review Articles and Brief Illustrations

EHealth researchers have at their disposal a number of approaches and methods for making sense out of existing literature, all with the purpose of casting current research findings into historical contexts or explaining contradictions that might exist among a set of primary research studies conducted on a particular topic. Our classification scheme is largely inspired from Paré and colleagues’ (2015) typology. Below we present and illustrate those review types that we feel are central to the growth and development of the eHealth domain.

9.3.1. Narrative Reviews

The narrative review is the “traditional” way of reviewing the extant literature and is skewed towards a qualitative interpretation of prior knowledge ( Sylvester et al., 2013 ). Put simply, a narrative review attempts to summarize or synthesize what has been written on a particular topic but does not seek generalization or cumulative knowledge from what is reviewed ( Davies, 2000 ; Green et al., 2006 ). Instead, the review team often undertakes the task of accumulating and synthesizing the literature to demonstrate the value of a particular point of view ( Baumeister & Leary, 1997 ). As such, reviewers may selectively ignore or limit the attention paid to certain studies in order to make a point. In this rather unsystematic approach, the selection of information from primary articles is subjective, lacks explicit criteria for inclusion and can lead to biased interpretations or inferences ( Green et al., 2006 ). There are several narrative reviews in the particular eHealth domain, as in all fields, which follow such an unstructured approach ( Silva et al., 2015 ; Paul et al., 2015 ).

Despite these criticisms, this type of review can be very useful in gathering together a volume of literature in a specific subject area and synthesizing it. As mentioned above, its primary purpose is to provide the reader with a comprehensive background for understanding current knowledge and highlighting the significance of new research ( Cronin et al., 2008 ). Faculty like to use narrative reviews in the classroom because they are often more up to date than textbooks, provide a single source for students to reference, and expose students to peer-reviewed literature ( Green et al., 2006 ). For researchers, narrative reviews can inspire research ideas by identifying gaps or inconsistencies in a body of knowledge, thus helping researchers to determine research questions or formulate hypotheses. Importantly, narrative reviews can also be used as educational articles to bring practitioners up to date with certain topics of issues ( Green et al., 2006 ).

Recently, there have been several efforts to introduce more rigour in narrative reviews that will elucidate common pitfalls and bring changes into their publication standards. Information systems researchers, among others, have contributed to advancing knowledge on how to structure a “traditional” review. For instance, Levy and Ellis (2006) proposed a generic framework for conducting such reviews. Their model follows the systematic data processing approach comprised of three steps, namely: (a) literature search and screening; (b) data extraction and analysis; and (c) writing the literature review. They provide detailed and very helpful instructions on how to conduct each step of the review process. As another methodological contribution, vom Brocke et al. (2009) offered a series of guidelines for conducting literature reviews, with a particular focus on how to search and extract the relevant body of knowledge. Last, Bandara, Miskon, and Fielt (2011) proposed a structured, predefined and tool-supported method to identify primary studies within a feasible scope, extract relevant content from identified articles, synthesize and analyze the findings, and effectively write and present the results of the literature review. We highly recommend that prospective authors of narrative reviews consult these useful sources before embarking on their work.

Darlow and Wen (2015) provide a good example of a highly structured narrative review in the eHealth field. These authors synthesized published articles that describe the development process of mobile health ( m-health ) interventions for patients’ cancer care self-management. As in most narrative reviews, the scope of the research questions being investigated is broad: (a) how development of these systems are carried out; (b) which methods are used to investigate these systems; and (c) what conclusions can be drawn as a result of the development of these systems. To provide clear answers to these questions, a literature search was conducted on six electronic databases and Google Scholar . The search was performed using several terms and free text words, combining them in an appropriate manner. Four inclusion and three exclusion criteria were utilized during the screening process. Both authors independently reviewed each of the identified articles to determine eligibility and extract study information. A flow diagram shows the number of studies identified, screened, and included or excluded at each stage of study selection. In terms of contributions, this review provides a series of practical recommendations for m-health intervention development.

9.3.2. Descriptive or Mapping Reviews

The primary goal of a descriptive review is to determine the extent to which a body of knowledge in a particular research topic reveals any interpretable pattern or trend with respect to pre-existing propositions, theories, methodologies or findings ( King & He, 2005 ; Paré et al., 2015 ). In contrast with narrative reviews, descriptive reviews follow a systematic and transparent procedure, including searching, screening and classifying studies ( Petersen, Vakkalanka, & Kuzniarz, 2015 ). Indeed, structured search methods are used to form a representative sample of a larger group of published works ( Paré et al., 2015 ). Further, authors of descriptive reviews extract from each study certain characteristics of interest, such as publication year, research methods, data collection techniques, and direction or strength of research outcomes (e.g., positive, negative, or non-significant) in the form of frequency analysis to produce quantitative results ( Sylvester et al., 2013 ). In essence, each study included in a descriptive review is treated as the unit of analysis and the published literature as a whole provides a database from which the authors attempt to identify any interpretable trends or draw overall conclusions about the merits of existing conceptualizations, propositions, methods or findings ( Paré et al., 2015 ). In doing so, a descriptive review may claim that its findings represent the state of the art in a particular domain ( King & He, 2005 ).

In the fields of health sciences and medical informatics, reviews that focus on examining the range, nature and evolution of a topic area are described by Anderson, Allen, Peckham, and Goodwin (2008) as mapping reviews . Like descriptive reviews, the research questions are generic and usually relate to publication patterns and trends. There is no preconceived plan to systematically review all of the literature although this can be done. Instead, researchers often present studies that are representative of most works published in a particular area and they consider a specific time frame to be mapped.

An example of this approach in the eHealth domain is offered by DeShazo, Lavallie, and Wolf (2009). The purpose of this descriptive or mapping review was to characterize publication trends in the medical informatics literature over a 20-year period (1987 to 2006). To achieve this ambitious objective, the authors performed a bibliometric analysis of medical informatics citations indexed in medline using publication trends, journal frequencies, impact factors, Medical Subject Headings (MeSH) term frequencies, and characteristics of citations. Findings revealed that there were over 77,000 medical informatics articles published during the covered period in numerous journals and that the average annual growth rate was 12%. The MeSH term analysis also suggested a strong interdisciplinary trend. Finally, average impact scores increased over time with two notable growth periods. Overall, patterns in research outputs that seem to characterize the historic trends and current components of the field of medical informatics suggest it may be a maturing discipline (DeShazo et al., 2009).

9.3.3. Scoping Reviews

Scoping reviews attempt to provide an initial indication of the potential size and nature of the extant literature on an emergent topic (Arksey & O’Malley, 2005; Daudt, van Mossel, & Scott, 2013 ; Levac, Colquhoun, & O’Brien, 2010). A scoping review may be conducted to examine the extent, range and nature of research activities in a particular area, determine the value of undertaking a full systematic review (discussed next), or identify research gaps in the extant literature ( Paré et al., 2015 ). In line with their main objective, scoping reviews usually conclude with the presentation of a detailed research agenda for future works along with potential implications for both practice and research.

Unlike narrative and descriptive reviews, the whole point of scoping the field is to be as comprehensive as possible, including grey literature (Arksey & O’Malley, 2005). Inclusion and exclusion criteria must be established to help researchers eliminate studies that are not aligned with the research questions. It is also recommended that at least two independent coders review abstracts yielded from the search strategy and then the full articles for study selection ( Daudt et al., 2013 ). The synthesized evidence from content or thematic analysis is relatively easy to present in tabular form (Arksey & O’Malley, 2005; Thomas & Harden, 2008 ).

One of the most highly cited scoping reviews in the eHealth domain was published by Archer, Fevrier-Thomas, Lokker, McKibbon, and Straus (2011) . These authors reviewed the existing literature on personal health record ( phr ) systems including design, functionality, implementation, applications, outcomes, and benefits. Seven databases were searched from 1985 to March 2010. Several search terms relating to phr s were used during this process. Two authors independently screened titles and abstracts to determine inclusion status. A second screen of full-text articles, again by two independent members of the research team, ensured that the studies described phr s. All in all, 130 articles met the criteria and their data were extracted manually into a database. The authors concluded that although there is a large amount of survey, observational, cohort/panel, and anecdotal evidence of phr benefits and satisfaction for patients, more research is needed to evaluate the results of phr implementations. Their in-depth analysis of the literature signalled that there is little solid evidence from randomized controlled trials or other studies through the use of phr s. Hence, they suggested that more research is needed that addresses the current lack of understanding of optimal functionality and usability of these systems, and how they can play a beneficial role in supporting patient self-management ( Archer et al., 2011 ).

9.3.4. Forms of Aggregative Reviews

Healthcare providers, practitioners, and policy-makers are nowadays overwhelmed with large volumes of information, including research-based evidence from numerous clinical trials and evaluation studies, assessing the effectiveness of health information technologies and interventions ( Ammenwerth & de Keizer, 2004 ; Deshazo et al., 2009 ). It is unrealistic to expect that all these disparate actors will have the time, skills, and necessary resources to identify the available evidence in the area of their expertise and consider it when making decisions. Systematic reviews that involve the rigorous application of scientific strategies aimed at limiting subjectivity and bias (i.e., systematic and random errors) can respond to this challenge.

Systematic reviews attempt to aggregate, appraise, and synthesize in a single source all empirical evidence that meet a set of previously specified eligibility criteria in order to answer a clearly formulated and often narrow research question on a particular topic of interest to support evidence-based practice ( Liberati et al., 2009 ). They adhere closely to explicit scientific principles ( Liberati et al., 2009 ) and rigorous methodological guidelines (Higgins & Green, 2008) aimed at reducing random and systematic errors that can lead to deviations from the truth in results or inferences. The use of explicit methods allows systematic reviews to aggregate a large body of research evidence, assess whether effects or relationships are in the same direction and of the same general magnitude, explain possible inconsistencies between study results, and determine the strength of the overall evidence for every outcome of interest based on the quality of included studies and the general consistency among them ( Cook, Mulrow, & Haynes, 1997 ). The main procedures of a systematic review involve:

• Formulating a review question and developing a search strategy based on explicit inclusion criteria for the identification of eligible studies (usually described in the context of a detailed review protocol).
• Searching for eligible studies using multiple databases and information sources, including grey literature sources, without any language restrictions.
• Selecting studies, extracting data, and assessing risk of bias in a duplicate manner using two independent reviewers to avoid random or systematic errors in the process.
• Analyzing data using quantitative or qualitative methods.
• Presenting results in summary of findings tables.
• Interpreting results and drawing conclusions.

Many systematic reviews, but not all, use statistical methods to combine the results of independent studies into a single quantitative estimate or summary effect size. Known as meta-analyses , these reviews use specific data extraction and statistical techniques (e.g., network, frequentist, or Bayesian meta-analyses) to calculate from each study by outcome of interest an effect size along with a confidence interval that reflects the degree of uncertainty behind the point estimate of effect ( Borenstein, Hedges, Higgins, & Rothstein, 2009 ; Deeks, Higgins, & Altman, 2008 ). Subsequently, they use fixed or random-effects analysis models to combine the results of the included studies, assess statistical heterogeneity, and calculate a weighted average of the effect estimates from the different studies, taking into account their sample sizes. The summary effect size is a value that reflects the average magnitude of the intervention effect for a particular outcome of interest or, more generally, the strength of a relationship between two variables across all studies included in the systematic review. By statistically combining data from multiple studies, meta-analyses can create more precise and reliable estimates of intervention effects than those derived from individual studies alone, when these are examined independently as discrete sources of information.

The review by Gurol-Urganci, de Jongh, Vodopivec-Jamsek, Atun, and Car (2013) on the effects of mobile phone messaging reminders for attendance at healthcare appointments is an illustrative example of a high-quality systematic review with meta-analysis. Missed appointments are a major cause of inefficiency in healthcare delivery with substantial monetary costs to health systems. These authors sought to assess whether mobile phone-based appointment reminders delivered through Short Message Service ( sms ) or Multimedia Messaging Service ( mms ) are effective in improving rates of patient attendance and reducing overall costs. To this end, they conducted a comprehensive search on multiple databases using highly sensitive search strategies without language or publication-type restrictions to identify all rct s that are eligible for inclusion. In order to minimize the risk of omitting eligible studies not captured by the original search, they supplemented all electronic searches with manual screening of trial registers and references contained in the included studies. Study selection, data extraction, and risk of bias assessments were performed inde­­pen­dently by two coders using standardized methods to ensure consistency and to eliminate potential errors. Findings from eight rct s involving 6,615 participants were pooled into meta-analyses to calculate the magnitude of effects that mobile text message reminders have on the rate of attendance at healthcare appointments compared to no reminders and phone call reminders.

Meta-analyses are regarded as powerful tools for deriving meaningful conclusions. However, there are situations in which it is neither reasonable nor appropriate to pool studies together using meta-analytic methods simply because there is extensive clinical heterogeneity between the included studies or variation in measurement tools, comparisons, or outcomes of interest. In these cases, systematic reviews can use qualitative synthesis methods such as vote counting, content analysis, classification schemes and tabulations, as an alternative approach to narratively synthesize the results of the independent studies included in the review. This form of review is known as qualitative systematic review.

A rigorous example of one such review in the eHealth domain is presented by Mickan, Atherton, Roberts, Heneghan, and Tilson (2014) on the use of handheld computers by healthcare professionals and their impact on access to information and clinical decision-making. In line with the methodological guide­lines for systematic reviews, these authors: (a) developed and registered with prospero ( www.crd.york.ac.uk/ prospero / ) an a priori review protocol; (b) conducted comprehensive searches for eligible studies using multiple databases and other supplementary strategies (e.g., forward searches); and (c) subsequently carried out study selection, data extraction, and risk of bias assessments in a duplicate manner to eliminate potential errors in the review process. Heterogeneity between the included studies in terms of reported outcomes and measures precluded the use of meta-analytic methods. To this end, the authors resorted to using narrative analysis and synthesis to describe the effectiveness of handheld computers on accessing information for clinical knowledge, adherence to safety and clinical quality guidelines, and diagnostic decision-making.

In recent years, the number of systematic reviews in the field of health informatics has increased considerably. Systematic reviews with discordant findings can cause great confusion and make it difficult for decision-makers to interpret the review-level evidence ( Moher, 2013 ). Therefore, there is a growing need for appraisal and synthesis of prior systematic reviews to ensure that decision-making is constantly informed by the best available accumulated evidence. Umbrella reviews , also known as overviews of systematic reviews, are tertiary types of evidence synthesis that aim to accomplish this; that is, they aim to compare and contrast findings from multiple systematic reviews and meta-analyses ( Becker & Oxman, 2008 ). Umbrella reviews generally adhere to the same principles and rigorous methodological guidelines used in systematic reviews. However, the unit of analysis in umbrella reviews is the systematic review rather than the primary study ( Becker & Oxman, 2008 ). Unlike systematic reviews that have a narrow focus of inquiry, umbrella reviews focus on broader research topics for which there are several potential interventions ( Smith, Devane, Begley, & Clarke, 2011 ). A recent umbrella review on the effects of home telemonitoring interventions for patients with heart failure critically appraised, compared, and synthesized evidence from 15 systematic reviews to investigate which types of home telemonitoring technologies and forms of interventions are more effective in reducing mortality and hospital admissions ( Kitsiou, Paré, & Jaana, 2015 ).

9.3.5. Realist Reviews

Realist reviews are theory-driven interpretative reviews developed to inform, enhance, or supplement conventional systematic reviews by making sense of heterogeneous evidence about complex interventions applied in diverse contexts in a way that informs policy decision-making ( Greenhalgh, Wong, Westhorp, & Pawson, 2011 ). They originated from criticisms of positivist systematic reviews which centre on their “simplistic” underlying assumptions ( Oates, 2011 ). As explained above, systematic reviews seek to identify causation. Such logic is appropriate for fields like medicine and education where findings of randomized controlled trials can be aggregated to see whether a new treatment or intervention does improve outcomes. However, many argue that it is not possible to establish such direct causal links between interventions and outcomes in fields such as social policy, management, and information systems where for any intervention there is unlikely to be a regular or consistent outcome ( Oates, 2011 ; Pawson, 2006 ; Rousseau, Manning, & Denyer, 2008 ).

To circumvent these limitations, Pawson, Greenhalgh, Harvey, and Walshe (2005) have proposed a new approach for synthesizing knowledge that seeks to unpack the mechanism of how “complex interventions” work in particular contexts. The basic research question — what works? — which is usually associated with systematic reviews changes to: what is it about this intervention that works, for whom, in what circumstances, in what respects and why? Realist reviews have no particular preference for either quantitative or qualitative evidence. As a theory-building approach, a realist review usually starts by articulating likely underlying mechanisms and then scrutinizes available evidence to find out whether and where these mechanisms are applicable ( Shepperd et al., 2009 ). Primary studies found in the extant literature are viewed as case studies which can test and modify the initial theories ( Rousseau et al., 2008 ).

The main objective pursued in the realist review conducted by Otte-Trojel, de Bont, Rundall, and van de Klundert (2014) was to examine how patient portals contribute to health service delivery and patient outcomes. The specific goals were to investigate how outcomes are produced and, most importantly, how variations in outcomes can be explained. The research team started with an exploratory review of background documents and research studies to identify ways in which patient portals may contribute to health service delivery and patient outcomes. The authors identified six main ways which represent “educated guesses” to be tested against the data in the evaluation studies. These studies were identified through a formal and systematic search in four databases between 2003 and 2013. Two members of the research team selected the articles using a pre-established list of inclusion and exclusion criteria and following a two-step procedure. The authors then extracted data from the selected articles and created several tables, one for each outcome category. They organized information to bring forward those mechanisms where patient portals contribute to outcomes and the variation in outcomes across different contexts.

9.3.6. Critical Reviews

Lastly, critical reviews aim to provide a critical evaluation and interpretive analysis of existing literature on a particular topic of interest to reveal strengths, weaknesses, contradictions, controversies, inconsistencies, and/or other important issues with respect to theories, hypotheses, research methods or results ( Baumeister & Leary, 1997 ; Kirkevold, 1997 ). Unlike other review types, critical reviews attempt to take a reflective account of the research that has been done in a particular area of interest, and assess its credibility by using appraisal instruments or critical interpretive methods. In this way, critical reviews attempt to constructively inform other scholars about the weaknesses of prior research and strengthen knowledge development by giving focus and direction to studies for further improvement ( Kirkevold, 1997 ).

Kitsiou, Paré, and Jaana (2013) provide an example of a critical review that assessed the methodological quality of prior systematic reviews of home telemonitoring studies for chronic patients. The authors conducted a comprehensive search on multiple databases to identify eligible reviews and subsequently used a validated instrument to conduct an in-depth quality appraisal. Results indicate that the majority of systematic reviews in this particular area suffer from important methodological flaws and biases that impair their internal validity and limit their usefulness for clinical and decision-making purposes. To this end, they provide a number of recommendations to strengthen knowledge development towards improving the design and execution of future reviews on home telemonitoring.

9.4. Summary

Table 9.1 outlines the main types of literature reviews that were described in the previous sub-sections and summarizes the main characteristics that distinguish one review type from another. It also includes key references to methodological guidelines and useful sources that can be used by eHealth scholars and researchers for planning and developing reviews.

Typology of Literature Reviews (adapted from Paré et al., 2015).

As shown in Table 9.1 , each review type addresses different kinds of research questions or objectives, which subsequently define and dictate the methods and approaches that need to be used to achieve the overarching goal(s) of the review. For example, in the case of narrative reviews, there is greater flexibility in searching and synthesizing articles ( Green et al., 2006 ). Researchers are often relatively free to use a diversity of approaches to search, identify, and select relevant scientific articles, describe their operational characteristics, present how the individual studies fit together, and formulate conclusions. On the other hand, systematic reviews are characterized by their high level of systematicity, rigour, and use of explicit methods, based on an “a priori” review plan that aims to minimize bias in the analysis and synthesis process (Higgins & Green, 2008). Some reviews are exploratory in nature (e.g., scoping/mapping reviews), whereas others may be conducted to discover patterns (e.g., descriptive reviews) or involve a synthesis approach that may include the critical analysis of prior research ( Paré et al., 2015 ). Hence, in order to select the most appropriate type of review, it is critical to know before embarking on a review project, why the research synthesis is conducted and what type of methods are best aligned with the pursued goals.

9.5. Concluding Remarks

In light of the increased use of evidence-based practice and research generating stronger evidence ( Grady et al., 2011 ; Lyden et al., 2013 ), review articles have become essential tools for summarizing, synthesizing, integrating or critically appraising prior knowledge in the eHealth field. As mentioned earlier, when rigorously conducted review articles represent powerful information sources for eHealth scholars and practitioners looking for state-of-the-art evidence. The typology of literature reviews we used herein will allow eHealth researchers, graduate students and practitioners to gain a better understanding of the similarities and differences between review types.

We must stress that this classification scheme does not privilege any specific type of review as being of higher quality than another ( Paré et al., 2015 ). As explained above, each type of review has its own strengths and limitations. Having said that, we realize that the methodological rigour of any review — be it qualitative, quantitative or mixed — is a critical aspect that should be considered seriously by prospective authors. In the present context, the notion of rigour refers to the reliability and validity of the review process described in section 9.2. For one thing, reliability is related to the reproducibility of the review process and steps, which is facilitated by a comprehensive documentation of the literature search process, extraction, coding and analysis performed in the review. Whether the search is comprehensive or not, whether it involves a methodical approach for data extraction and synthesis or not, it is important that the review documents in an explicit and transparent manner the steps and approach that were used in the process of its development. Next, validity characterizes the degree to which the review process was conducted appropriately. It goes beyond documentation and reflects decisions related to the selection of the sources, the search terms used, the period of time covered, the articles selected in the search, and the application of backward and forward searches ( vom Brocke et al., 2009 ). In short, the rigour of any review article is reflected by the explicitness of its methods (i.e., transparency) and the soundness of the approach used. We refer those interested in the concepts of rigour and quality to the work of Templier and Paré (2015) which offers a detailed set of methodological guidelines for conducting and evaluating various types of review articles.

To conclude, our main objective in this chapter was to demystify the various types of literature reviews that are central to the continuous development of the eHealth field. It is our hope that our descriptive account will serve as a valuable source for those conducting, evaluating or using reviews in this important and growing domain.

• Ammenwerth E., de Keizer N. An inventory of evaluation studies of information technology in health care. Trends in evaluation research, 1982-2002. International Journal of Medical Informatics. 2004; 44 (1):44–56. [ PubMed : 15778794 ]
• Anderson S., Allen P., Peckham S., Goodwin N. Asking the right questions: scoping studies in the commissioning of research on the organisation and delivery of health services. Health Research Policy and Systems. 2008; 6 (7):1–12. [ PMC free article : PMC2500008 ] [ PubMed : 18613961 ] [ CrossRef ]
• Archer N., Fevrier-Thomas U., Lokker C., McKibbon K. A., Straus S.E. Personal health records: a scoping review. Journal of American Medical Informatics Association. 2011; 18 (4):515–522. [ PMC free article : PMC3128401 ] [ PubMed : 21672914 ]
• Arksey H., O’Malley L. Scoping studies: towards a methodological framework. International Journal of Social Research Methodology. 2005; 8 (1):19–32.
• A systematic, tool-supported method for conducting literature reviews in information systems. Paper presented at the Proceedings of the 19th European Conference on Information Systems ( ecis 2011); June 9 to 11; Helsinki, Finland. 2011.
• Baumeister R. F., Leary M.R. Writing narrative literature reviews. Review of General Psychology. 1997; 1 (3):311–320.
• Becker L. A., Oxman A.D. In: Cochrane handbook for systematic reviews of interventions. Higgins J. P. T., Green S., editors. Hoboken, nj : John Wiley & Sons, Ltd; 2008. Overviews of reviews; pp. 607–631.
• Borenstein M., Hedges L., Higgins J., Rothstein H. Introduction to meta-analysis. Hoboken, nj : John Wiley & Sons Inc; 2009.
• Cook D. J., Mulrow C. D., Haynes B. Systematic reviews: Synthesis of best evidence for clinical decisions. Annals of Internal Medicine. 1997; 126 (5):376–380. [ PubMed : 9054282 ]
• Cooper H., Hedges L.V. In: The handbook of research synthesis and meta-analysis. 2nd ed. Cooper H., Hedges L. V., Valentine J. C., editors. New York: Russell Sage Foundation; 2009. Research synthesis as a scientific process; pp. 3–17.
• Cooper H. M. Organizing knowledge syntheses: A taxonomy of literature reviews. Knowledge in Society. 1988; 1 (1):104–126.
• Cronin P., Ryan F., Coughlan M. Undertaking a literature review: a step-by-step approach. British Journal of Nursing. 2008; 17 (1):38–43. [ PubMed : 18399395 ]
• Darlow S., Wen K.Y. Development testing of mobile health interventions for cancer patient self-management: A review. Health Informatics Journal. 2015 (online before print). [ PubMed : 25916831 ] [ CrossRef ]
• Daudt H. M., van Mossel C., Scott S.J. Enhancing the scoping study methodology: a large, inter-professional team’s experience with Arksey and O’Malley’s framework. bmc Medical Research Methodology. 2013; 13 :48. [ PMC free article : PMC3614526 ] [ PubMed : 23522333 ] [ CrossRef ]
• Davies P. The relevance of systematic reviews to educational policy and practice. Oxford Review of Education. 2000; 26 (3-4):365–378.
• Deeks J. J., Higgins J. P. T., Altman D.G. In: Cochrane handbook for systematic reviews of interventions. Higgins J. P. T., Green S., editors. Hoboken, nj : John Wiley & Sons, Ltd; 2008. Analysing data and undertaking meta-analyses; pp. 243–296.
• Deshazo J. P., Lavallie D. L., Wolf F.M. Publication trends in the medical informatics literature: 20 years of “Medical Informatics” in mesh . bmc Medical Informatics and Decision Making. 2009; 9 :7. [ PMC free article : PMC2652453 ] [ PubMed : 19159472 ] [ CrossRef ]
• Dixon-Woods M., Agarwal S., Jones D., Young B., Sutton A. Synthesising qualitative and quantitative evidence: a review of possible methods. Journal of Health Services Research and Policy. 2005; 10 (1):45–53. [ PubMed : 15667704 ]
• Finfgeld-Connett D., Johnson E.D. Literature search strategies for conducting knowledge-building and theory-generating qualitative systematic reviews. Journal of Advanced Nursing. 2013; 69 (1):194–204. [ PMC free article : PMC3424349 ] [ PubMed : 22591030 ]
• Grady B., Myers K. M., Nelson E. L., Belz N., Bennett L., Carnahan L. … Guidelines Working Group. Evidence-based practice for telemental health. Telemedicine Journal and E Health. 2011; 17 (2):131–148. [ PubMed : 21385026 ]
• Green B. N., Johnson C. D., Adams A. Writing narrative literature reviews for peer-reviewed journals: secrets of the trade. Journal of Chiropractic Medicine. 2006; 5 (3):101–117. [ PMC free article : PMC2647067 ] [ PubMed : 19674681 ]
• Greenhalgh T., Wong G., Westhorp G., Pawson R. Protocol–realist and meta-narrative evidence synthesis: evolving standards ( rameses ). bmc Medical Research Methodology. 2011; 11 :115. [ PMC free article : PMC3173389 ] [ PubMed : 21843376 ]
• Gurol-Urganci I., de Jongh T., Vodopivec-Jamsek V., Atun R., Car J. Mobile phone messaging reminders for attendance at healthcare appointments. Cochrane Database System Review. 2013; 12 cd 007458. [ PMC free article : PMC6485985 ] [ PubMed : 24310741 ] [ CrossRef ]
• Hart C. Doing a literature review: Releasing the social science research imagination. London: SAGE Publications; 1998.
• Higgins J. P. T., Green S., editors. Cochrane handbook for systematic reviews of interventions: Cochrane book series. Hoboken, nj : Wiley-Blackwell; 2008.
• Jesson J., Matheson L., Lacey F.M. Doing your literature review: traditional and systematic techniques. Los Angeles & London: SAGE Publications; 2011.
• King W. R., He J. Understanding the role and methods of meta-analysis in IS research. Communications of the Association for Information Systems. 2005; 16 :1.
• Kirkevold M. Integrative nursing research — an important strategy to further the development of nursing science and nursing practice. Journal of Advanced Nursing. 1997; 25 (5):977–984. [ PubMed : 9147203 ]
• Kitchenham B., Charters S. ebse Technical Report Version 2.3. Keele & Durham. uk : Keele University & University of Durham; 2007. Guidelines for performing systematic literature reviews in software engineering.
• Kitsiou S., Paré G., Jaana M. Systematic reviews and meta-analyses of home telemonitoring interventions for patients with chronic diseases: a critical assessment of their methodological quality. Journal of Medical Internet Research. 2013; 15 (7):e150. [ PMC free article : PMC3785977 ] [ PubMed : 23880072 ]
• Kitsiou S., Paré G., Jaana M. Effects of home telemonitoring interventions on patients with chronic heart failure: an overview of systematic reviews. Journal of Medical Internet Research. 2015; 17 (3):e63. [ PMC free article : PMC4376138 ] [ PubMed : 25768664 ]
• Levac D., Colquhoun H., O’Brien K. K. Scoping studies: advancing the methodology. Implementation Science. 2010; 5 (1):69. [ PMC free article : PMC2954944 ] [ PubMed : 20854677 ]
• Levy Y., Ellis T.J. A systems approach to conduct an effective literature review in support of information systems research. Informing Science. 2006; 9 :181–211.
• Liberati A., Altman D. G., Tetzlaff J., Mulrow C., Gøtzsche P. C., Ioannidis J. P. A. et al. Moher D. The prisma statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: Explanation and elaboration. Annals of Internal Medicine. 2009; 151 (4):W-65. [ PubMed : 19622512 ]
• Lyden J. R., Zickmund S. L., Bhargava T. D., Bryce C. L., Conroy M. B., Fischer G. S. et al. McTigue K. M. Implementing health information technology in a patient-centered manner: Patient experiences with an online evidence-based lifestyle intervention. Journal for Healthcare Quality. 2013; 35 (5):47–57. [ PubMed : 24004039 ]
• Mickan S., Atherton H., Roberts N. W., Heneghan C., Tilson J.K. Use of handheld computers in clinical practice: a systematic review. bmc Medical Informatics and Decision Making. 2014; 14 :56. [ PMC free article : PMC4099138 ] [ PubMed : 24998515 ]
• Moher D. The problem of duplicate systematic reviews. British Medical Journal. 2013; 347 (5040) [ PubMed : 23945367 ] [ CrossRef ]
• Montori V. M., Wilczynski N. L., Morgan D., Haynes R. B., Hedges T. Systematic reviews: a cross-sectional study of location and citation counts. bmc Medicine. 2003; 1 :2. [ PMC free article : PMC281591 ] [ PubMed : 14633274 ]
• Mulrow C. D. The medical review article: state of the science. Annals of Internal Medicine. 1987; 106 (3):485–488. [ PubMed : 3813259 ] [ CrossRef ]
• Evidence-based information systems: A decade later. Proceedings of the European Conference on Information Systems ; 2011. Retrieved from http://aisel ​.aisnet.org/cgi/viewcontent ​.cgi?article ​=1221&context ​=ecis2011 .
• Okoli C., Schabram K. A guide to conducting a systematic literature review of information systems research. ssrn Electronic Journal. 2010
• Otte-Trojel T., de Bont A., Rundall T. G., van de Klundert J. How outcomes are achieved through patient portals: a realist review. Journal of American Medical Informatics Association. 2014; 21 (4):751–757. [ PMC free article : PMC4078283 ] [ PubMed : 24503882 ]
• Paré G., Trudel M.-C., Jaana M., Kitsiou S. Synthesizing information systems knowledge: A typology of literature reviews. Information & Management. 2015; 52 (2):183–199.
• Patsopoulos N. A., Analatos A. A., Ioannidis J.P. A. Relative citation impact of various study designs in the health sciences. Journal of the American Medical Association. 2005; 293 (19):2362–2366. [ PubMed : 15900006 ]
• Paul M. M., Greene C. M., Newton-Dame R., Thorpe L. E., Perlman S. E., McVeigh K. H., Gourevitch M.N. The state of population health surveillance using electronic health records: A narrative review. Population Health Management. 2015; 18 (3):209–216. [ PubMed : 25608033 ]
• Pawson R. Evidence-based policy: a realist perspective. London: SAGE Publications; 2006.
• Pawson R., Greenhalgh T., Harvey G., Walshe K. Realist review—a new method of systematic review designed for complex policy interventions. Journal of Health Services Research & Policy. 2005; 10 (Suppl 1):21–34. [ PubMed : 16053581 ]
• Petersen K., Vakkalanka S., Kuzniarz L. Guidelines for conducting systematic mapping studies in software engineering: An update. Information and Software Technology. 2015; 64 :1–18.
• Petticrew M., Roberts H. Systematic reviews in the social sciences: A practical guide. Malden, ma : Blackwell Publishing Co; 2006.
• Rousseau D. M., Manning J., Denyer D. Evidence in management and organizational science: Assembling the field’s full weight of scientific knowledge through syntheses. The Academy of Management Annals. 2008; 2 (1):475–515.
• Rowe F. What literature review is not: diversity, boundaries and recommendations. European Journal of Information Systems. 2014; 23 (3):241–255.
• Shea B. J., Hamel C., Wells G. A., Bouter L. M., Kristjansson E., Grimshaw J. et al. Boers M. amstar is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. Journal of Clinical Epidemiology. 2009; 62 (10):1013–1020. [ PubMed : 19230606 ]
• Shepperd S., Lewin S., Straus S., Clarke M., Eccles M. P., Fitzpatrick R. et al. Sheikh A. Can we systematically review studies that evaluate complex interventions? PLoS Medicine. 2009; 6 (8):e1000086. [ PMC free article : PMC2717209 ] [ PubMed : 19668360 ]
• Silva B. M., Rodrigues J. J., de la Torre Díez I., López-Coronado M., Saleem K. Mobile-health: A review of current state in 2015. Journal of Biomedical Informatics. 2015; 56 :265–272. [ PubMed : 26071682 ]
• Smith V., Devane D., Begley C., Clarke M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions. bmc Medical Research Methodology. 2011; 11 (1):15. [ PMC free article : PMC3039637 ] [ PubMed : 21291558 ]
• Sylvester A., Tate M., Johnstone D. Beyond synthesis: re-presenting heterogeneous research literature. Behaviour & Information Technology. 2013; 32 (12):1199–1215.
• Templier M., Paré G. A framework for guiding and evaluating literature reviews. Communications of the Association for Information Systems. 2015; 37 (6):112–137.
• Thomas J., Harden A. Methods for the thematic synthesis of qualitative research in systematic reviews. bmc Medical Research Methodology. 2008; 8 (1):45. [ PMC free article : PMC2478656 ] [ PubMed : 18616818 ]
• Reconstructing the giant: on the importance of rigour in documenting the literature search process. Paper presented at the Proceedings of the 17th European Conference on Information Systems ( ecis 2009); Verona, Italy. 2009.
• Webster J., Watson R.T. Analyzing the past to prepare for the future: Writing a literature review. Management Information Systems Quarterly. 2002; 26 (2):11.
• Whitlock E. P., Lin J. S., Chou R., Shekelle P., Robinson K.A. Using existing systematic reviews in complex systematic reviews. Annals of Internal Medicine. 2008; 148 (10):776–782. [ PubMed : 18490690 ]

This publication is licensed under a Creative Commons License, Attribution-Noncommercial 4.0 International License (CC BY-NC 4.0): see https://creativecommons.org/licenses/by-nc/4.0/

• Cite this Page Paré G, Kitsiou S. Chapter 9 Methods for Literature Reviews. In: Lau F, Kuziemsky C, editors. Handbook of eHealth Evaluation: An Evidence-based Approach [Internet]. Victoria (BC): University of Victoria; 2017 Feb 27.
• PDF version of this title (4.5M)
• Disable Glossary Links

In this Page

• Introduction
• Overview of the Literature Review Process and Steps
• Types of Review Articles and Brief Illustrations
• Concluding Remarks

Related information

• PMC PubMed Central citations
• PubMed Links to PubMed

Recent Activity

• Chapter 9 Methods for Literature Reviews - Handbook of eHealth Evaluation: An Ev... Chapter 9 Methods for Literature Reviews - Handbook of eHealth Evaluation: An Evidence-based Approach

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

Connect with NLM

National Library of Medicine 8600 Rockville Pike Bethesda, MD 20894

Web Policies FOIA HHS Vulnerability Disclosure

Help Accessibility Careers

• University of Texas Libraries

Literature Reviews

Steps in the literature review process.

• What is a literature review?
• Define your research question
• Determine inclusion and exclusion criteria
• Choose databases and search
• Review Results
• Synthesize Results
• Analyze Results
• Librarian Support
• You may need to some exploratory searching of the literature to get a sense of scope, to determine whether you need to narrow or broaden your focus
• Identify databases that provide the most relevant sources, and identify relevant terms (controlled vocabularies) to add to your search strategy
• Finalize your research question
• Think about relevant dates, geographies (and languages), methods, and conflicting points of view
• Conduct searches in the published literature via the identified databases
• Check to see if this topic has been covered in other discipline's databases
• Examine the citations of on-point articles for keywords, authors, and previous research (via references) and cited reference searching.
• Save your search results in a citation management tool (such as Zotero, Mendeley or EndNote)
• De-duplicate your search results
• Make sure that you've found the seminal pieces -- they have been cited many times, and their work is considered foundational 
• Check with your professor or a librarian to make sure your search has been comprehensive
• Evaluate the strengths and weaknesses of individual sources and evaluate for bias, methodologies, and thoroughness
• Group your results in to an organizational structure that will support why your research needs to be done, or that provides the answer to your research question  
• Develop your conclusions
• Are there gaps in the literature?
• Where has significant research taken place, and who has done it?
• Is there consensus or debate on this topic?
• Which methodological approaches work best?
• For example: Background, Current Practices, Critics and Proponents, Where/How this study will fit in 
• Organize your citations and focus on your research question and pertinent studies
• Compile your bibliography

Note: The first four steps are the best points at which to contact a librarian. Your librarian can help you determine the best databases to use for your topic, assess scope, and formulate a search strategy.

Videos Tutorials about Literature Reviews

This 4.5 minute video from Academic Education Materials has a Creative Commons License and a British narrator.

Recommended Reading

• Last Updated: Oct 26, 2022 2:49 PM
• URL: https://guides.lib.utexas.edu/literaturereviews

SYSTEMATIC REVIEW article

Facebook reactions in the context of politics and social issues: a systematic literature review provisionally accepted.

• 1 University of Urbino Carlo Bo, Italy

The final, formatted version of the article will be published soon.

In February 2016, Facebook launched five "Reactions" (i.e., Love, Haha, Wow, Sad, and anger) for users to emote their experiences with the posts, which were an extension of the "Like" button and were edited versions of Unicode emojis. Scholars used them to investigate user behavior and situation-based current topics to measure various aspects of socioeconomic and psychological topics. This literature review focuses on "Facebook reactions," examines the literature, and serves as a comprehensive and cumulative approach, summarizing the existing literature and research articles, scattered under different names. However, to get comparable results within broader classification and themes, we seek how "Facebook reactions" play a role in different or comparable topics and their results.Articles were collected using Google Scholar and other search engines. We used the keywords "Facebook" and "Reaction," with a combination of different key phrases and Boolean operators. Seventy-three articles are taken into consideration from 2016-2023. Matrix and Reference lists were scanned with different topics classified date-wise. The articles cover a wide range of topics/information such as Political News, Far-right and Extremist Parties, Racism, and Hate speech with COVID-19. Our Findings reveal nuanced patterns of the reaction distribution based on the topics. The positive reaction dominates articles related to lifestyle and entertainment, while the articles addressing sociopolitical issues elicit a wider range of reactions, including negative sentiments. Moreover, we observe that emotional content tends to get higher reaction volumes regardless of sentiment.

Keywords: facebook, Reactions, emotion, Emoji, Politics, Social issue

Received: 30 Jan 2024; Accepted: 16 Apr 2024.

Copyright: © 2024 Anwar and Giglietto. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) . The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

* Correspondence: Mr. Sawood Anwar, University of Urbino Carlo Bo, Urbino, Italy

People also looked at

Evidence Review of the Adverse Effects of COVID-19 Vaccination and Intramuscular Vaccine Administration

Vaccines are a public health success story, as they have prevented or lessened the effects of many infectious diseases. To address concerns around potential vaccine injuries, the Health Resources and Services Administration (HRSA) administers the Vaccine Injury Compensation Program (VICP) and the Countermeasures Injury Compensation Program (CICP), which provide compensation to those who assert that they were injured by routine vaccines or medical countermeasures, respectively. The National Academies of Sciences, Engineering, and Medicine have contributed to the scientific basis for VICP compensation decisions for decades.

HRSA asked the National Academies to convene an expert committee to review the epidemiological, clinical, and biological evidence about the relationship between COVID-19 vaccines and specific adverse events, as well as intramuscular administration of vaccines and shoulder injuries. This report outlines the committee findings and conclusions.

Read Full Description

• Digital Resource: Evidence Review of the Adverse Effects of COVID-19 Vaccination
• Digital Resource: Evidence Review of Shoulder Injuries from Intramuscular Administration of Vaccines
• Press Release

Recent News

NAS Launches Science and Innovation Fund for Ukraine

Science Academies Issue Statements to Inform G7 Talks

Supporting Family Caregivers in STEMM

A Vision for High-Quality Preschool for All

• Load More...

• Open access
• Published: 14 October 2023

A scoping review of ‘Pacing’ for management of Myalgic Encephalomyelitis/Chronic Fatigue Syndrome (ME/CFS): lessons learned for the long COVID pandemic

• Nilihan E. M. Sanal-Hayes 1 , 7 ,
• Marie Mclaughlin 1 , 8 ,
• Lawrence D. Hayes 1 ,
• Jacqueline L. Mair   ORCID: orcid.org/0000-0002-1466-8680 2 , 3 ,
• Jane Ormerod 4 ,
• David Carless 1 ,
• Natalie Hilliard 5 ,
• Rachel Meach 1 ,
• Joanne Ingram 6 &
• Nicholas F. Sculthorpe 1  

Journal of Translational Medicine volume  21 , Article number:  720 ( 2023 ) Cite this article

3333 Accesses

5 Citations

21 Altmetric

Metrics details

Controversy over treatment for people with myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS) is a barrier to appropriate treatment. Energy management or pacing is a prominent coping strategy for people with ME/CFS. Whilst a definitive definition of pacing is not unanimous within the literature or healthcare providers, it typically comprises regulating activity to avoid post exertional malaise (PEM), the worsening of symptoms after an activity. Until now, characteristics of pacing, and the effects on patients’ symptoms had not been systematically reviewed. This is problematic as the most common approach to pacing, pacing prescription, and the pooled efficacy of pacing was unknown. Collating evidence may help advise those suffering with similar symptoms, including long COVID, as practitioners would be better informed on methodological approaches to adopt, pacing implementation, and expected outcomes.

In this scoping review of the literature, we aggregated type of, and outcomes of, pacing in people with ME/CFS.

Eligibility criteria

Original investigations concerning pacing were considered in participants with ME/CFS.

Sources of evidence

Six electronic databases (PubMed, Scholar, ScienceDirect, Scopus, Web of Science and the Cochrane Central Register of Controlled Trials [CENTRAL]) were searched; and websites MEPedia, Action for ME, and ME Action were also searched for grey literature, to fully capture patient surveys not published in academic journals.

A scoping review was conducted. Review selection and characterisation was performed by two independent reviewers using pretested forms.

Authors reviewed 177 titles and abstracts, resulting in 17 included studies: three randomised control trials (RCTs); one uncontrolled trial; one interventional case series; one retrospective observational study; two prospective observational studies; four cross-sectional observational studies; and five cross-sectional analytical studies. Studies included variable designs, durations, and outcome measures. In terms of pacing administration, studies used educational sessions and diaries for activity monitoring. Eleven studies reported benefits of pacing, four studies reported no effect, and two studies reported a detrimental effect in comparison to the control group.

Conclusions

Highly variable study designs and outcome measures, allied to poor to fair methodological quality resulted in heterogenous findings and highlights the requirement for more research examining pacing. Looking to the long COVID pandemic, our results suggest future studies should be RCTs utilising objectively quantified digitised pacing, over a longer duration of examination (i.e. longitudinal studies), using the core outcome set for patient reported outcome measures. Until these are completed, the literature base is insufficient to inform treatment practises for people with ME/CFS and long COVID.

Introduction

Post-viral illness occurs when individuals experience an extended period of feeling unwell after a viral infection [ 1 , 2 , 3 , 4 , 5 , 6 ]. While post-viral illness is generally a non-specific condition with a constellation of symptoms that may be experienced, fatigue is amongst the most commonly reported [ 7 , 8 , 9 ]. For example, our recent systematic review found there was up to 94% prevalence of fatigue in people following acute COVID-19 infection [ 3 ]. The increasing prevalence of long COVID has generated renewed interest in symptomology and time-course of post-viral fatigue, with PubMed reporting 72 articles related to “post-viral fatigue” between 2020 and 2022, but less than five for every year since 1990.

As the coronavirus pandemic developed, it became clear that a significant proportion of the population experienced symptoms which persisted beyond the initial viral infection, meeting the definition of a post-viral illness. Current estimates suggest one in eight people develop long COVID [ 10 ] and its symptomatology has repeatedly been suggested to overlap with clinical demonstrations of myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS). In a study by Wong and Weitzer [ 11 ], long COVID symptoms from 21 studies were compared to a list of ME/CFS symptoms. Of the 29 known ME/CFS symptoms the authors reported that 25 (86%) were reported in at least one long COVID study suggesting significant similarities. Sukocheva et al. [ 12 ] reported that long COVID included changes in immune, cardiovascular, metabolic, gastrointestinal, nervous and autonomic systems. When observed from a pathological stance, this list of symptoms is shared with, or is similar to, the symptoms patients with ME/CFS describe [ 13 ]. In fact, a recent article reported 43% of people with long COVID are diagnosed with ME/CFS [ 13 ], evidencing the analogous symptom loads.

A striking commonality between long COVID and similar conditions such as ME/CFS is the worsening of symptoms including fatigue, pain, cognitive difficulties, sore throat, and/or swollen lymph nodes following exertion. Termed post exertional malaise (PEM) [ 14 , 15 , 16 , 17 ], lasting from hours to several days, it is arguably one of the most debilitating side effects experienced by those with ME/CFS [ 16 , 17 , 18 ]. PEM is associated with considerably reduced quality of life amongst those with ME/CFS, with reduced ability to perform activities of daily living, leading to restraints on social and family life, mental health comorbidities such as depression and anxiety, and devastating employment and financial consequences [ 19 , 20 , 21 , 22 ]. At present, there is no cure or pharmacological treatments for PEM, and therefore, effective symptom management strategies are required. This may be in part because the triggers of PEM are poorly understood, and there is little evidence for what causes PEM, beyond anecdotal evidence. The most common approach to manage PEM is to incorporate activity pacing into the day-to-day lives of those with ME/CFS with the intention of reducing the frequency of severity of bouts of PEM [ 23 ]. Pacing is defined as an approach where patients are encouraged to be as active as possible within the limits imposed by the illness [ 23 , 24 , 25 ]. In practice, pacing requires individuals to determine a level at which they can function, but which does not lead to a marked increase in fatigue and other symptoms [ 26 , 27 ].

Although long COVID is a new condition [ 3 , 14 ], the available evidence suggests substantial overlap with the symptoms of conditions such as ME/CFS and it is therefore pragmatic to consider the utility of management strategies (such as pacing) used in ME/CFS for people with long COVID. In fact, a recent Delphi study recommended that management of long COVID should incorporate careful pacing to avoid PEM relapse [ 28 ]. This position was enforced by a multidisciplinary consensus statement considering treatment of fatigue in long COVID, recommending energy conservation strategies (including pacing) for people with long COVID [ 29 ]. Given the estimated > 2 million individuals who have experienced long COVID in the UK alone [ 30 , 31 , 32 ], there is an urgent need for evidence-based public health strategies. In this context, it seems pragmatic to borrow from the ME/CFS literature.

From a historical perspective, the 2007 NICE guidelines for people with ME/CFS advised both cognitive behavioural therapy (CBT) and graded exercise therapy (GET) should be offered to people with ME/CFS [ 33 ]. As of the 2021 update, NICE guidelines for people with ME/CFS do not advise CBT or GET, and the only recommended management strategy is pacing [ 34 ]. In the years between changes to these guidelines, the landmark PACE trial [ 35 ] was published in 2011. This large, randomised control trial (RCT; n = 639) compared pacing with CBT and reported GET and CBT were more effective than pacing for improving symptoms. Yet, this study has come under considerable criticism from patient groups and clinicians alike [ 36 , 37 , 38 , 39 ]. This may partly explain why NICE do not advise CBT or GET as of 2021, and only recommend pacing for symptom management people with ME/CFS [ 34 ]. There has been some controversy over best treatment for people with ME/CFS in the literature and support groups, potentially amplified by the ambiguity of evidence for pacing efficacy and how pacing should be implemented. As such, before pacing can be advised for people with long COVID, it is imperative previous literature concerning pacing is systematically reviewed. This is because a consensus is needed within the literature for implementing pacing so practitioners treating people with ME/CFS or long COVID can do so effectively. A lack of agreement in pacing implementation is a barrier to adoption for both practitioners and patients. Despite several systematic reviews concerning pharmacological interventions or cognitive behavioural therapy in people with ME/CFS [ 36 , 40 , 41 ], to date, there are no systematic reviews concerning pacing.

Despite the widespread use of pacing, the literature base is limited and includes clinical commentaries, case studies, case series, and few randomised control trials. Consequently, while a comprehensive review of the effects of pacing in ME/CFS is an essential tool to guide symptom management advice, the available literature means that effective pooling of data is not feasible [ 42 ] and therefore, a traditional systematic review and meta-analysis, with a tightly focussed research question would be premature [ 43 ]. Consequently, we elected to undertake a scoping review. This approach retains the systematic approach to literature searching but aims to map out the current state of the research [ 43 ]. Using the framework of Arksey and O'Malley [ 44 ], a scoping review aims to use a broad set of search terms and include a wide range of study designs and methods (in contrast to a systematic review [ 44 ]). This approach, has the benefit of clarifying key concepts, surveying current data collection approaches, and identifying critical knowledge gaps.

We aimed to provide an overview of existing literature concerning pacing in ME/CFS. Our three specific objectives of this scoping review were to (1) conduct a systematic search of the published literature concerning ME/CFS and pacing, (2) map characteristics and methodologies used, and (3) provide recommendations for the advancement of the research area.

Protocol and registration

The review was conducted and reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews (PRISMA-ScR) guidelines [ 45 ] and the five-stage framework outlined in Arksey and O’Malley [ 44 ]. Registration is not recommended for scoping reviews.

Studies that met the following criteria were included in this review: (1) published as a full-text manuscript; (2) not a review; (3) participants with ME/CFS; (4) studies employed a pacing intervention or retrospective analysis of pacing or a case study of pacing. Studies utilising sub-analysis of the pacing, graded activity, and cognitive behaviour therapy: a randomised evaluation (PACE) trial were included as these have different outcome measures and, as this is not a meta-analysis, this will not influence effect size estimates. Additionally, due to the paucity of evidence, grey literature has also been included in this review.

Search strategy

The search strategy consisted of a combination of free-text and MeSH terms relating to ME/CFS and pacing, which were developed through an examination of published original literature and review articles. Example search terms for PubMed included: ‘ME/CFS’ OR ‘ME’ OR ‘CFS’ OR ‘chronic fatigue syndrome’ OR ‘PEM’ OR ‘post exertional malaise’ OR ‘pene’ OR ‘post-exertion neurogenic exhaust’ AND ‘pacing’ OR ‘adaptive pacing’. The search was performed within title/abstract. Full search terms can be found in Additional file 1 .

Information sources

Six electronic databases [PubMed, Scholar, ScienceDirect, Scopus, Web of Science, and the Cochrane Central Register of Controlled Trials (CENTRAL)] were searched to identify original research articles published from the earliest available date up until 02/02/2022. Additional records were identified through reference lists of included studies. ‘Grey literature’ repositories including MEPedia, Action for ME, and ME Action were also searched with the same terms.

Study selection and data items

Once each database search was completed and manuscripts were sourced, all studies were downloaded into a single reference list (Zotero, version 6.0.23) and duplicates were removed. Titles and abstracts were screened for eligibility by two reviewers independently and discrepancies were resolved through discussion between reviewers. Subsequently, full text papers of potentially relevant studies were retrieved and assessed for eligibility by the same two reviewers independently. Any uncertainty by reviewers was discussed in consensus meetings and resolved by agreement. Data extracted from each study included sample size, participant characteristics, study design, trial registration details, study location, pacing description (type), intervention duration, intervention adherence, outcome variables, and main outcome data. Descriptions were extracted with as much detail as was provided by the authors. Study quality was assessed using the Physiotherapy Evidence Database (PEDro) scale [ 46 , 47 ].

Role of the funding source

The study sponsors had no role in study design, data collection, analysis, or interpretation, nor writing the report, nor submitting the paper for publication.

Study selection

After the initial database search, 281 records were identified (see Fig.  1 ). Once duplicates were removed, 177 titles and abstracts were screened for inclusion resulting in 22 studies being retrieved as full text and assessed for eligibility. Of those, five were excluded, and 17 articles remained and were used in the final qualitative synthesis.

Schematic flow diagram describing exclusions of potential studies and final number of studies. RCT = randomized control trial. CT = controlled trial. UCT = uncontrolled trial

Study characteristics

Study characteristics are summarised in Table 1 . Of the 17 studies included, three were randomised control trials (RCTs [ 35 , 48 , 49 ]); one was an uncontrolled trial [ 50 ]; one was a case series [ 51 ]; one was a retrospective observational study [ 52 ], two were prospective observational studies [ 53 , 54 ]; four were cross-sectional observational studies [ 25 , 55 , 56 ]; and five were cross-sectional analytical studies [ 57 , 58 , 59 , 60 , 61 ] including sub-analysis of the PACE trial [ 35 , 56 , 59 , 61 ]. Seven of the studies were registered trials [ 35 , 48 , 49 , 50 , 56 , 57 , 58 ]. Diagnostic criteria for ME/CFS are summarised in Table 2 .

Types of pacing

Pacing interventions.

Of the 17 studies included, five implemented their own pacing interventions and will be discussed in this section. Sample sizes ranged from n = 7 in an interventional case series [ 51 ] to n = 641 participants in the largest RCT [ 35 ]. The first of these five studies considered an education session on pacing and self-management as the ‘pacing’ group, and a ‘pain physiology education’ group as the control group [ 49 ]. Two studies included educational sessions provided by a therapist plus activity monitoring via ActiGraph accelerometers [ 51 ] and diaries [ 48 ] at baseline and follow-up. In the first of these two studies, Nijs and colleagues [ 51 ] implemented a ‘self-management program’ which asked patients to estimate their current physical capabilities prior to commencing an activity and then complete 25–50% less than their perceived energy envelope. They[ 51 ] did not include a control group and had a sample size of only n = 7. Six years later, the same research group [ 48 ] conducted another pacing study which utilised relaxation as a comparator group (n = 12 and n = 14 in the pacing and relaxation groups, respectively). The pacing group underwent a pacing phase whereby participants again aimed to complete 25–50% less than their perceived energy envelope, followed by a gradual increase in exercise after the pacing phase (the total intervention spanned three weeks, and it is unclear how much was allocated to pacing, and how much to activity increase). Therefore, it could be argued that Kos et al. [ 48 ] really assessed pacing followed by a gradual exercise increase as outcome measures were assessed following the graded activity phase. Another pacing intervention delivered weekly educational sessions for six weeks and utilised a standardised rehabilitation programme using the ‘activity pacing framework’ [ 50 ] in a single-arm, no comparator group feasibility study. Finally, the PACE trial adopted an adaptive pacing therapy intervention consisting of occupational therapists helping patients to plan and pace activities utilising activity diaries to identify activities associated with fatigue and staying within their energy envelope [ 35 ]. This study incorporated standard medical care, cognitive behavioural therapy (CBT) and graded exercise therapy (GET) as comparator groups [ 35 ]. It is worth noting that the pacing group and the CBT group were both ‘encouraged’ to increase physical activity levels as long as participants did not exceed their energy envelope. Although not all five intervention studies explicitly mentioned the “Energy Envelope Theory”, which dictates that people with ME/CFS should not necessarily increase or decrease their activity levels, but moderate activity and practice energy conservation [ 62 ], all intervention studies used language analogous to this theory, such as participants staying within limits, within capacity, or similar.

The interventions included in this review were of varying durations, from a single 30-min education session [ 49 ], a 3-week (one session a week) educational programme [ 51 ], a 3-week (3 × 60–90 min sessions/week) educational programme [ 48 ], a 6-week rehabilitation programme [ 50 ], to a 24-week programme [ 35 ]. Intervention follow-up durations also varied across studies from immediately after [ 49 ], 1-week [ 51 ], 3-weeks [ 48 ], 3-months [ 50 ], and 1-year post-intervention [ 35 ].

Observational studies of pacing

Eight studies were observational and, therefore, included no intervention. Observational study sample sizes ranged from 16 in a cross-sectional interview study [ 25 ] to 1428 in a cross-sectional survey [ 52 ]. One study involved a retrospective analysis of participants’ own pacing strategies varying from self-guided pacing or pacing administered by a therapist compared with implementation of CBT and GET [ 52 ]. Five involved a cross-sectional analysis of participants own pacing strategies which varied from activity adjustment, planning and acceptance [ 50 , 55 ], and the Energy Envelope method [ 58 , 60 ]. Two studies were prospective observational studies investigating the Energy Envelope theory [ 53 , 54 ]. Four studies [ 56 , 57 , 59 , 61 ] included in this review involved sub-analysis of results of the PACE trial [ 35 ].

Outcome measures

Quantitative health outcomes.

ME/CFS severity and general health status were the most common outcome measures across studies (16/17) [ 35 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 63 ]. Studies utilised different instruments, including the Short-Form 36 (SF-36; 8/16) [ 35 , 51 , 53 , 54 , 56 , 57 , 58 , 60 ], SF-12 (2/16) [ 50 , 63 ], ME symptom and illness severity (2/16) [ 52 , 55 ], Patient health (PHQ-15; 1/16) [ 59 ], DePaul symptom questionnaire (DSQ; 1/16) [ 58 ], and the Patient health questionnaire-9 (1/16) [ 50 ]. Additionally, some studies used diagnostic criteria for ME/CFS as an outcome measure to determine recovery [ 57 , 59 , 61 ].

Pain was assessed by most included studies (11/17) [ 35 , 49 , 50 , 51 , 53 , 54 , 55 , 57 , 59 , 60 , 61 , 63 ]. Two studies [ 59 , 61 ] included the international CDC criteria for CFS which contain five painful symptoms central to a diagnosis of CFS: muscle pain and joint pain. Other methods of assessment included Brief Pain Inventory (1/11) [ 53 ], Chronic Pain Coping Inventory (CPCI; 1/11) [ 49 ], Pain Self Efficacy Questionnaire (PSEQ; 1/11) [ 50 ], Tampa Scale for Kinesiophobia–version CFS (1/11) [ 49 ], algometry (1/11) [ 49 ], Knowledge of Neurophysiology of Pain Test (1/12) [ 49 ], Pain Catastrophizing Scale (1/11) [ 49 ], Pain Anxiety Symptoms Scale short version (PASS-20; 1/11) [ 50 ], Pain Numerical Rating Scale (NRS; 1/11) [ 63 ].

Fatigue or post-exertional malaise was assessed by 11 of the 17 studies [ 35 , 48 , 50 , 51 , 53 , 54 , 56 , 57 , 60 , 61 , 63 ]. Again, measurement instruments were divergent between studies and included the Chalder Fatigue Questionnaire (CFQ; 4/11) [ 35 , 50 , 57 , 63 ], Fatigue Severity Scale (2/11) [ 53 , 60 ], the Chronic Fatigue Syndrome Medical Questionnaire (1/11) [ 60 ], and Checklist Individual Strength (CIS; 2/11) [ 48 , 51 ].

Anxiety and depression were also common outcome measures, utilised by four studies (4/17) [ 50 , 53 , 59 , 63 ]. These were also assessed using different instruments including Hospital Anxiety and Depression Scale (HADS; 2/4) [ 59 , 63 ], Generalised Anxiety Disorder Assessment (1/4 [ 50 ]), Beck Depression Inventory (BDI-II; 1/4) [ 53 ], Beck Anxiety Inventory (BAI; 1/4) [ 53 ], and Perceived Stress Scale (PSS; 1/4) [ 53 ].

Outcome measures also included sleep (2/17) [ 53 , 59 ], assessed by The Pittsburgh Sleep Quality Index (1/2) [ 53 ] and Jenkins sleep scale (1/2) [ 59 ]; and quality of life (2/17) [ 50 , 53 ] as assessed by the EuroQol five-dimensions, five-levels (EQ-5D-5L; 1/2) [ 50 ] and The Quality-of-Life Scale (1/2) [ 53 ]. Self-Efficacy was measured in four studies [ 50 , 53 , 59 , 60 ], assessed by the Brief Coping Orientation to Problems Experienced Scale (bCOPE; 1/4) [ 60 ] and the Chronic Disease Self-Efficacy measure (3/4) [ 50 , 53 , 59 ].

Quantitative evaluation of pacing

Some studies (4/17) [ 25 , 50 , 52 , 63 ] included assessments of the participants’ experiences of pacing, using the Activity Pacing Questionnaire (APQ-28; 1/4 [ 50 ], APQ-38 (2/4) [ 25 , 63 ]), a re-analysis of the 228 question survey regarding treatment (1/4) [ 52 ] originally produced by the ME Association [ 55 ], and qualitative semi-structured telephone interviews regarding appropriateness of courses in relation to individual patient needs (1/4) [ 25 ]. The APQ-28 and -38 have been previously validated, but the 228-question survey has not. When outcome measures included physical activity levels (4/17), the Canadian Occupational Performance Measure (COPM) was used in two studies [ 48 , 51 ], and two studies used accelerometers to record physical activity [ 51 , 54 ]. Of these two studies, Nijs [ 51 ] examined accelerometery after a 3-week intervention based on the Energy Envelope Theory and Brown et al. [ 54 ] evaluated the Energy Envelope Theory of pacing over 12 months.

Other outcomes

Two [ 53 , 59 ] of the 17 studies included structured clinical interviews for the Diagnostic and Statistical Manual of Mental Disorders, 4th edition (DSM-IV) to assess psychiatric comorbidity and psychiatric exclusions. One study included a disability benefits questionnaire [ 55 ], and one study included employment and education questionnaire [ 55 ]. Additionally, satisfaction of primary care was also used as an outcome measure (2/17) [ 25 , 55 ] assessed using the Chronic Pain Coping Inventory (CPCI).

Efficacy of pacing interventions

The majority of studies (12/17) [ 25 , 48 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 58 , 60 , 63 ] highlighted improvements in at least one outcome following pacing (Fig.  2 ). When the effect of pacing was assessed by ME symptomology and general health outcomes, studies reported pacing to be beneficial [ 25 , 50 , 51 , 53 , 54 , 55 , 56 , 58 ]. It is worth noting however that pacing reportedly worsened ME symptoms in 14% of survey respondents, whilst improving symptoms in 44% of respondents [ 52 ]. Most studies using fatigue as an outcome measure reported pacing to be efficacious (7/10) [ 50 , 51 , 53 , 54 , 56 , 60 , 63 ]. However, one study reported no change in fatigue with a pacing intervention (1/10) [ 35 ], and 2/10 studies [ 53 , 63 ] reported a worsening of fatigue with pacing. Physical function was used to determine the efficacy of pacing in 11 studies [ 35 , 48 , 50 , 51 , 53 , 54 , 56 , 58 , 59 , 60 , 63 ]. Of these, the majority found pacing improved physical functioning (8/10) [ 48 , 50 , 51 , 53 , 54 , 56 , 58 , 60 ], with 1/10 [ 35 ] studies reporting no change in physical functioning, and 1/10 [ 59 ] reporting a worsening of physical functioning from pre- to post-pacing. Of the seven studies [ 35 , 49 , 50 , 51 , 53 , 54 , 60 ] which used pain to assess pacing efficacy, 4/7 [ 50 , 51 , 53 , 60 ] reported improvements in pain and 3/7 [ 35 , 51 , 53 ] reported no change in pain scores with pacing. All studies reporting quality of life (1/1) [ 53 ], self-efficacy (3/3) [ 50 , 53 , 59 ], sleep (2/2) [ 53 , 59 ], and depression and anxiety (4/4) [ 50 , 53 , 59 , 63 ], found pacing to be efficacious for ME/CFS participants.

Bubble plot displaying number of studies reporting each domain (x-axis) and the percentage of studies reporting improvement with pacing (y-axis), including a coloured scale of improvement from 0–100%. PEM = post-exertional malaise, 6MWT = 6-min walk time, CFS = chronic fatigue syndrome, DSQ = DePaul Symptom Questionnaire, PA = Physical Activity, HRQOL = Health-related quality of life, COPM = The Canadian Occupational Performance Measure

Participant characteristics

The majority of studies (10/17) [ 25 , 50 , 52 , 53 , 54 , 58 , 59 , 60 , 61 , 63 ] did not report age of the participants. For those which did report age, this ranged from 32 ± 14 to 43 ± 13 years. Where studies reported sex (11/17) [ 35 , 48 , 49 , 50 , 51 , 54 , 55 , 56 , 57 , 58 , 60 ], this was predominantly female, ranging from 75 to 100% female. Only six studies [ 35 , 54 , 56 , 57 , 58 , 60 ] reported ethnicity, with cohorts predominantly Caucasian (94–98%). Time since diagnosis was mostly unreported (12/17) [ 25 , 48 , 49 , 50 , 52 , 53 , 54 , 58 , 59 , 60 , 61 , 63 ] but ranged from 32 to 96 months, with a cross-sectional survey reporting 2% of the participants were diagnosed 1–2 years previously; 6% 3–4 years since diagnosis; 13% 3–4 years since diagnosis; 12% 5–6 years since diagnosis; 20% 7–10 years since diagnosis; 29% 11–21 years since diagnosis; 13% 21–30 years since diagnosis; and 5% > 30 years since diagnosis. Of the studies which reported comorbidities of the participants (6/17) [ 25 , 35 , 50 , 56 , 57 , 63 ], the comorbidities were chronic pain, depressive disorder, psychiatric disorder.

Study location

Of the 17 studies, 14 were from Europe [ 25 , 35 , 48 , 49 , 50 , 51 , 52 , 55 , 56 , 57 , 58 , 59 , 61 , 63 ], and three from North America [ 53 , 54 , 60 ]. Of the 14 studies[ 25 , 35 , 48 , 49 , 50 , 51 , 52 , 55 , 56 , 57 , 58 , 59 , 61 , 63 ] from Europe, ten [ 25 , 35 , 50 , 52 , 55 , 56 , 57 , 58 , 59 , 61 , 63 ] were conducted in the United Kingdom, three in Belgium [ 48 , 49 , 51 ], and one was a multicentred study between the United Kingdom and Norway [ 58 ].

Recruitment strategy

Of the 17 studies, three [ 53 , 54 , 60 ] used announcements in a newspaper and physician referrals to recruit participants, two [ 50 , 63 ] recruited patients referred by a consultant from a National Health Service (NHS) Trust following a pain diagnosis, two [ 52 , 55 ] concerned online platforms on the web, two [ 59 , 61 ] recruited from secondary care clinics, and two used the PACE trial databases [ 56 , 57 ]. Moreover, one study recruited from the hospital [ 58 ], one from physiotherapist referrals [ 25 ], two from specialist clinic centres [ 35 , 64 ], one from waiting list of rehabilitation centre [ 48 ], and one from medical files [ 49 ].

Study settings

Ten studies were carried out in hospital and clinic setting [ 25 , 35 , 48 , 49 , 50 , 51 , 58 , 59 , 61 , 63 ]. Two studies were performed on online platforms [ 52 , 55 ]. Three studies did not report study setting [ 53 , 54 , 60 ]. Two studies generated output from PACE trial databases [ 56 , 57 ]

Adherence and feasibility

All five intervention studies reported adherence rates (which they defined as number of sessions attended), which ranged from 4–44% (4% [ 49 ], 8% [ 35 ], 25% [ 48 ], 29% [ 51 ], and 44% [ 50 ]). One study reported the median number of rehabilitation programme sessions attended was five out of six possible sessions, with 58.9% [ 50 ] participants attending ≥ 5 sessions; 83.2% participants attending at least one educational session on activity pacing and 56.1% attending both activity pacing sessions.

This scoping review summarises the existing literature, with a view to aid physicians and healthcare practitioners better summarise evidence for pacing in ME/CFS and use this knowledge for other post-viral fatiguing conditions. Overall, studies generally reported pacing to be beneficial for people with ME/CFS. The exception to this trend is the controversial PACE trial [ 36 , 37 , 38 , 39 ], which we will expand on in subsequent sections. We believe information generated within this review can facilitate discussion of research opportunities and issues that need to be addressed in future studies concerning pacing, particularly given the immediate public health issue of the long COVID pandemic. As mentioned, we found some preliminary evidence for improved symptoms following pacing interventions or strategies. However, we wish to caution the reader that the current evidence base is extremely limited and hampered by several limitations which preclude clear conclusions on the efficacy of pacing. Firstly, studies were of poor to fair methodological quality (indicated by the PEDro scores), often with small sample sizes, and therefore unknown power to detect change. Moreover, very few studies implemented pacing, with most studies merely consulting on people’s views on pacing. This may of course lead to multiple biases such as reporting, recruitment, survivorship, confirmation, availability heuristic, to name but a few. Thus, there is a pressing need for more high-quality intervention studies. Secondly, the reporting of pacing strategies used was inconsistent and lacked detail, making it difficult to describe current approaches, or implement them in future research or symptom management strategies. Furthermore, outcome evaluations varied greatly between studies. This prevents any appropriate synthesis of research findings.

The lack of evidence concerning pacing is concerning given pacing is the only NICE recommended management strategy for ME/CFS following the 2021 update [ 34 ]. Given the analogous nature of long COVID with ME/CFS, patients and practitioners will be looking to the ME/CFS literature for guidance for symptom management. There is an urgent need for high quality studies (such as RCTs) investigating the effectiveness of pacing and better reporting of pacing intervention strategies so that clear recommendations can be made to patients. If this does not happen soon, there will be serious healthcare and economic implications for years to come [ 65 , 66 ].

Efficacy of pacing

Most studies (12/17) highlighted improvements in at least one outcome measure following pacing. Pacing was self-reported to be the most efficacious, safe, acceptable, and preferred form of activity management for people with ME/CFS [ 55 ]. Pacing was reported to improve symptoms and improve general health outcomes [ 25 , 50 , 52 , 58 , 63 ], fatigue and PEM [ 48 , 50 , 51 , 53 , 54 , 55 , 56 , 60 , 63 ], physical functioning [ 48 , 50 , 51 , 53 , 56 , 58 , 60 , 63 ], pain [ 25 , 50 , 55 , 63 ], quality of life [ 50 ], self-efficacy [ 50 , 53 ], sleep [ 53 , 55 ], and depression and anxiety [ 50 , 53 , 63 ]. These positive findings provide hope for those with ME/CFS, and other chronic fatiguing conditions such as long COVID, to improve quality of life through symptom management.

Conversely, some studies reported no effects of pacing on ME/CFS symptoms [ 52 ], fatigue, physical functioning [ 35 ], or pain scores [ 49 , 61 ]. Some studies even found pacing to have detrimental effects in those with ME/CFS, including a worsening of symptoms in 14% of survey participants recalling previous pacing experiences [ 52 ]. Furthermore, a worsening of fatigue [ 35 , 59 ], and physical functioning from pre- to post-pacing [ 35 , 57 , 59 , 61 ] was reported by the PACE trial and sub-analysis of the PACE trial [ 56 , 57 , 61 ]. The PACE trial [ 35 ], a large RCT (n = 639) comparing pacing with CBT and GET, reported GET and CBT were more effective for reducing ME/CFS-related fatigue and improving physical functioning than pacing. However, the methodology and conclusions from the PACE trial have been heavily criticised, mainly due to the authors lowering the thresholds they used to determine improvement [ 36 , 37 , 38 , 67 ]. With this in mind, Sharpe et al. [ 56 ] surveyed 75% of the participants from the PACE trial 1-year post-intervention and reported pacing improved fatigue and physical functioning, with effects similar to CBT and GET.

Lessons for pacing implementation

All pacing intervention studies (5/5) implemented educational or coaching sessions. These educational components were poorly reported in terms of the specific content and how and where they had been developed, with unclear pedagogical approaches. Consequently, even where interventions reported reduction in PEM or improved symptoms, it would be impossible to transfer that research into practice, future studies, or clinical guidance, given the ambiguity of reporting. Sessions typically contained themes of pacing such as activity adjustment (decrease, break-up, and reschedule activities based on energy levels), activity consistency (maintaining a consistently low level of activity to prevent PEM), activity planning (planning activities and rest around available energy levels), and activity progression (slowly progressing activity once maintaining a steady baseline) [ 35 , 48 , 49 , 50 , 51 ]. We feel it is pertinent to note here that although activity progression has been incorporated as a pacing strategy in these included studies, some view activity progression as a form of GET. The NICE definition of GET is “first establishing an individual's baseline of achievable exercise or physical activity, then making fixed incremental increases in the time spent being physically active” [ 34 ]. Thus, this form of pacing can also be considered a type of ‘long-term GET’ in which physical activity progression is performed over weeks or months with fixed incremental increases in time spent being physically.

Intervention studies attempted to create behaviour change, through educational programmes to modify physical activity, and plan behaviours. However, none of these studies detailed integrating any evidence-based theories of behaviour change [ 68 ] or reported using any frameworks to support behaviour change objectives. This is unfortunate since there is good evidence that theory-driven behaviour change interventions result in greater intervention effects [ 69 ]. Indeed, there is a large body of work regarding methods of behaviour change covering public health messaging, education, and intervention design, which has largely been ignored by the pacing literature. Interventions relied on subjective pacing (5/5 studies), with strategies including keeping an activity diary (3/5 studies) to identify links between activity and fatigue [ 35 , 48 , 50 ]. Given the high prevalence of ‘brain fog’ within ME/CFS [ 70 , 71 , 72 , 73 ], recall may be extremely difficult and there is significant potential for under-reporting. Other strategies included simply asking participants to estimate energy levels available for daily activities (2/5 studies [ 48 , 51 ]). Again, this is subjective and relies on participants’ ability to recall previous consequences of the activity. Other methods of activity tracking and measuring energy availability, such as wearable technology [ 74 , 75 , 76 , 77 , 78 ] could provide a more objective measure of adherence and pacing strategy fidelity in future studies. Despite technology such as accelerometers being widely accessible since well-before the earliest interventional study included in this review (which was published in 2009), none of the interventional studies utilised objective activity tracking to track pacing and provide feedback to participants. One study considered accelerometery alongside an activity diary [ 51 ]. However, accelerometery was considered the outcome variable, to assess change in activity levels from pre- to post-intervention and was not part of the intervention itself (which was one pacing coaching sessions per week for 3 weeks). Moreover, most research-grade accelerometers cannot be used as part of the intervention since they have no ability to provide continuous feedback and must be retrieved by the research team in order to access any data. Consequently, their use is mostly limited to outcome assessments only. As pacing comprises a limit to physical activity to prevent push-crash cycles, it is an astonishing observation from this scoping review that only two studies objectively measured physical activity to quantify changes to activity as a result of pacing [ 51 , 54 ]. If the aim of pacing is to reduce physical activity, or reduce variations in physical activity (i.e., push-crash cycles), only two studies have objectively quantified the effect pacing had on physical activity, so it is unclear whether pacing was successfully implemented in any of the other studies.

By exploring the pacing strategies previously used, in both intervention studies and more exploratory studies, we can identify and recommend approaches to improve symptoms of ME/CFS. These approaches can be categorised as follows: activity planning, activity consistency, activity progression, activity adjustment and staying within the Energy Envelope [ 50 , 53 , 60 , 63 ]. Activity planning was identified as a particularly effective therapeutic strategy, resulting in improvement of mean scores of all symptoms included in the APQ-28, reducing current pain, improvement of physical fatigue, mental fatigue, self-efficacy, quality of life, and mental and physical functioning [ 50 ]. Activity planning aligns with the self-regulatory behaviour change technique ‘Action Planning’ [ 79 ] which is commonly used to increase physical activity behaviour. In the case of ME/CFS, activity planning is successfully used to minimise rather than increase physical activity bouts to prevent expending too much energy and avoid PEM. Activity consistency, meaning undertaking similar amounts of activity each day, was also associated with reduced levels of depression, exercise avoidance, and higher levels of physical function [ 63 ]. Activity progression was associated with higher levels of current pain. Activity adjustment associated with depression and avoidance, and lower levels of physical function [ 63 ]. Staying within the Energy Envelope was reported to reduce PEM severity [ 53 , 60 ], improve physical functioning [ 53 , 60 ] and ME/CFS symptom scores [ 53 ], and more hours engaged in activity than individuals with lower available energy [ 53 ]. These results suggest that effective pacing strategies would include activity planning, consistency, and energy management techniques while avoiding progression. This data is, of course, limited by the small number of mostly low-quality studies and should be interpreted with some caution. Nevertheless, these are considerations that repeatedly appear in the literature and, as such, warrant deeper investigation. In addition, and as outlined earlier, most studies are relatively old, and we urgently need better insight into how modern technologies, particularly longitudinal activity tracking and contemporaneous heart-rate feedback, might improve (or otherwise) adaptive pacing. Such longitudinal tracking would also enable activities and other behaviours (sleep, diet, stress) to be linked to bouts of PEM. Linking would enable a deeper insight into potential PEM triggers and mitigations that might be possible.

The PACE trial

We feel it would be remiss of us to not specifically address the PACE trial within this manuscript, as five of the 17 included studies resulted from the PACE trial [ 35 , 56 , 57 , 59 , 61 ]. There has been considerable discussion around the PACE trial, which has been particularly divisive and controversial [ 37 , 38 , 39 , 59 , 67 , 80 , 81 ]. In the PACE trial, GET and CBT were deemed superior to pacing by the authors. Despite its size and funding, the PACE trial has received several published criticisms and rebuttals. Notably, NICE's most recent ME/CFS guideline update removed GET and CBT as suggested treatment options, which hitherto had been underpinned by the PACE findings. While we will not restate the criticisms and rebuttals here, what is not in doubt, is that the PACE trial has dominated discussions of pacing, representing almost a third of all the studies in this review. However, the trial results were published over a decade ago, with the study protocol devised almost two decades ago [ 82 ]. The intervening time has seen a revolution in the development of mobile and wearable technology and an ability to remotely track activity and provide real-time feedback in a way which was not available at that time. Furthermore, there has been no substantive research since the PACE trial that has attempted such work. Indeed, possibly driven by the reported lack of effect of pacing in the PACE trial, this review has demonstrated the dearth of progress and innovation in pacing research since its publication. Therefore, regardless of its findings or criticisms, the pacing implementation in the PACE trial is dated, and there is an urgent need for more technologically informed approaches to pacing research.

Limitations of the current evidence

The first limitation to the literature included in this scoping review is that not all studies followed the minimum data set (MDS) of patient-reported outcome measures (PROMs) agreed upon by the British Association of CFS/ME Professionals (BACME) (fatigue, sleep quality, self-efficacy, pain/discomfort, anxiety/depression, mobility, activities of daily living, self-care, and illness severity) [ 83 , 84 ]. All but one study included in this review measured illness severity, most studies included fatigue and pain/discomfort, and some studies included assessments of anxiety/depression. There was a lack of quantitative assessment of sleep quality, self-efficacy, mobility, activities of daily living, and self-care. Therefore, studies did not consistently capture the diverse nature of the symptoms experienced, with crucial domains missing from the analyses. The MDS of PROMs were established in 2012 [ 83 , 84 ] and therefore, for studies published out prior to 2012, these are not applicable [ 35 , 49 , 51 , 53 , 54 ]. However, for the 12 studies carried out after this time, the MDS should have been considered elucidate the effects of pacing on ME/CFS. Importantly, despite PEM being a central characteristic of ME/CFS, only two studies included PEM as an outcome measure [ 55 , 60 ]. This may be because of the difficulty of accurately measuring fluctuating symptoms, as PEM occurs multiple times over a period of months, and therefore pre- to post- studies and cross-sectional designs cannot adequately capture PEM incidence. Therefore, it is likely studies opted for measuring general fatigue instead. More appropriate longitudinal study designs are required to track PEM over time to capture a more representative picture of PEM patterns. Secondly, reporting of participant characteristics was inadequate, but in the studies that did describe participants, characteristics were congruent with the epidemiological literature and reporting of ME/CFS populations (i.e., 60–65% female) [ 85 ]. Therefore, in this respect, studies included herein were representative samples. However, the lack of reporting of participant characteristics limits inferences we can draw concerning any population-related effects (i.e. whether older, or male, or European, or people referred by a national health service would be more or less likely to respond positively to pacing). Thirdly, comparison groups (where included) were not ideal, with CBT or GET sometimes used as comparators to pacing [ 35 ], and often no true control group included. Penultimately, there is a distinct lack of high-quality RCTs (as mentioned throughout this manuscript). Finally, in reference to the previous section, inferences from the literature are dated and do not reflect the technological capabilities of 2023.

Recommendations for advancement of the investigative area

It is clear from the studies included in this scoping review for the last decade or more, progress and innovation in pacing research have been limited. This is unfortunate for several reasons. People with ME/CFS or long COVID are, of course, invested in their recovery. From our patient and public involvement (PPI) group engagement, it is clear many are ahead of the research and are using wearable technology to track steps, heart rate, and, in some cases, heart rate variability to improve their own pacing practice. While the lack of progress in the research means this is an understandable response by patients, it is also problematic. Without underpinning research, patients may make decisions based on an individual report of trial-and-error approaches given the lack of evidence-based guidance.

A more technologically-informed pacing approach could be implemented by integrating wearable trackers [ 77 , 78 , 86 , 87 ] to provide participants with live updates on their activity and could be integrated with research-informed messaging aimed at supporting behaviour change, as has been trialled in other research areas [ 88 , 89 , 90 , 91 ]. However, more work is needed to evaluate how to incorporate wearable activity trackers and which metrics are most helpful.

A more technologically-informed approach could also be beneficial for longitudinal symptom tracking, particularly useful given the highly variable symptom loads of ME/CFS and episodic nature of PEM. This would overcome reliance on assessments at a single point in time (as the studies within this review conducted). Similarly, mobile health (mHealth) approaches also allow questionnaires to be digitised to make it easier for participants to complete if they find holding a pen or reading small font problematic [ 92 ]. Reminders and notifications can also be helpful for patients completing tasks [ 77 , 93 , 94 , 95 ]. This approach has the added advantage of allowing contemporaneous data collection rather than relying on pre- to post-intervention designs limited by recall bias. Future work must try to leverage these approaches, as unless we collect large data sets on symptoms and behaviours (i.e. activity, diet, sleep, and pharmacology) in people with conditions like ME/CFS we will not be able to leverage emerging technologies such as AI and machine learning to improve the support and care for people with these debilitating conditions. The key areas for research outline in the NICE guidelines (2021 update) speaks to this, with specific mention of improved self-monitoring strategies, sleep strategies, and dietary strategies, all of which can be measured using mHealth approaches, in a scalable and labour-inexpensive way.

The potential for existing pacing research to address the long COVID pandemic

There is now an urgent public health need to address long COVID, with over 200 million sufferers worldwide [ 30 ]. Given the analogous symptomology between ME/CFS and long COVID, and the lack of promising treatment and management strategies in ME/CFS, pacing remains the only strategy for managing long COVID symptoms. This is concerning as the quality of evidence to support pacing is lacking. Given long COVID has reached pandemic proportions, scalable solutions will be required. In this context, we propose that technology should be harnessed to a) deliver, but also b) evaluate, pacing. We recently reported on a just-in-time adaptive intervention to increase physical activity during the pandemic [ 78 ]. However, this method could be adapted to decrease or maintain physical activity levels (i.e., pacing) in long COVID. This method has the advantage of scalability and remote data collection, reducing resource commitments and participant burden, essential for addressing a condition with so many sufferers.

This review highlights the need for more studies concerning pacing in chronic fatiguing conditions. Future studies would benefit from examining pacing’s effect on symptomology and PEM with objectively quantified pacing, over a longer duration of examination, using the MDS. It is essential this is conducted as an RCT, given that in the case of long COVID, participants may improve their health over time, and it is necessary to determine whether pacing exerts an additional effect over time elapsing. Future studies would benefit from digitising pacing to support individuals with varying symptom severity and personalise support. This would improve accessibility and reduce selection bias, in addition to improving scalability of interventions. Finally, clinicians and practitioners should be cognisant of the strength of evidence reported in this review and should exert caution when promoting pacing in their patients, given the varying methods utilised herein.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

Activity Pacing Questionnaire

Beck Anxiety Inventory

Beck Depression Inventory

Brief Coping Orientation to Problems Experienced Scale

Canadian Occupational Performance Measure

Centers for disease control and prevention

Chalder Fatigue Questionnaire

Checklist Individual Strength

Chronic Pain Coping Inventory

Cognitive behavioural therapy

Cochrane Central Register of Controlled Trials

DePaul symptom questionnaire

EuroQol five-dimensions, five-levels questionnaire

Graded exercise therapy

Hospital Anxiety and Depression Scale

Myalgic encephalomyelitis/chronic fatigue syndrome

Pain Self Efficacy Questionnaire

Pain Anxiety Symptoms Scale short version

Pain Numerical Rating Scale

Patient health questionnaire

Patient reported outcome measures

Physiotherapy Evidence Database

Perceived Stress Scale

Post exertional malaise

Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews

Randomised control trial

McMurray JC, May JW, Cunningham MW, Jones OY. Multisystem Inflammatory Syndrome in Children (MIS-C), a post-viral myocarditis and systemic vasculitis-a critical review of its pathogenesis and treatment. Front Pediatr. 2020;8: 626182.

Article   PubMed   PubMed Central   Google Scholar  

Perrin R, Riste L, Hann M, Walther A, Mukherjee A, Heald A. Into the looking glass: post-viral syndrome post COVID-19. Med Hypotheses. 2020;144: 110055.

Article   PubMed   PubMed Central   CAS   Google Scholar  

Hayes LD, Ingram J, Sculthorpe NF. More than 100 persistent symptoms of SARS-CoV-2 (Long COVID): A scoping review. Front Med. 2021. https://doi.org/10.3389/fmed.2021.750378 .

Article   Google Scholar  

McLaughlin M, Cerexhe C, Macdonald E, Ingram J, Sanal-Hayes NEM, Hayes LD, et al. A Cross-sectional study of symptom prevalence, frequency, severity, and impact of long-COVID in Scotland: part I. Am J Med. 2023. https://doi.org/10.1016/j.amjmed.2023.07.009 .

Article   PubMed   Google Scholar  

McLaughlin M, Cerexhe C, Macdonald E, Ingram J, Sanal-Hayes NEM, Hayes LD, et al. A cross-sectional study of symptom prevalence, frequency, severity, and impact of long-COVID in Scotland: part II. Am J Med. 2023. https://doi.org/10.1016/j.amjmed.2023.07.009 .

Hayes LD, Sanal-Hayes NEM, Mclaughlin M, Berry ECJ, Sculthorpe NF. People with long covid and ME/CFS exhibit similarly impaired balance and physical capacity: a case-case-control study. Am J Med. 2023;S0002–9343(23):00465–75.

Google Scholar  

Jenkins R. Post-viral fatigue syndrome. Epidemiology: lessons from the past. Br Med Bull. 1991;47:952–65.

Article   PubMed   CAS   Google Scholar  

Sandler CX, Wyller VBB, Moss-Morris R, Buchwald D, Crawley E, Hautvast J, et al. Long COVID and post-infective fatigue syndrome: a review. Open Forum Infect Dis. 2021;8:440.

Carod-Artal FJ. Post-COVID-19 syndrome: epidemiology, diagnostic criteria and pathogenic mechanisms involved. Rev Neurol. 2021;72:384–96.

PubMed   CAS   Google Scholar  

Ballering AV, van Zon SKR, Olde Hartman TC, Rosmalen JGM. Lifelines corona research initiative. Persistence of somatic symptoms after COVID-19 in the Netherlands: an observational cohort study. Lancet. 2022;400:452–61.

Wong TL, Weitzer DJ. Long COVID and Myalgic Encephalomyelitis/Chronic Fatigue Syndrome (ME/CFS)-a systemic review and comparison of clinical presentation and symptomatology. Medicina (Kaunas). 2021;57:418.

Sukocheva OA, Maksoud R, Beeraka NM, Madhunapantula SV, Sinelnikov M, Nikolenko VN, et al. Analysis of post COVID-19 condition and its overlap with myalgic encephalomyelitis/chronic fatigue syndrome. J Adv Res. 2021. https://doi.org/10.1016/j.jare.2021.11.013 .

Bonilla H, Quach TC, Tiwari A, Bonilla AE, Miglis M, Yang P, et al. Myalgic Encephalomyelitis/Chronic Fatigue Syndrome (ME/CFS) is common in post-acute sequelae of SARS-CoV-2 infection (PASC): results from a post-COVID-19 multidisciplinary clinic. medrxiv. 2022. https://doi.org/10.1101/2022.08.03.22278363v1 .

Twomey R, DeMars J, Franklin K, Culos-Reed SN, Weatherald J, Wrightson JG. Chronic fatigue and postexertional malaise in people living with long COVID: an observational study. Phys Ther. 2022;102:005.

Barhorst EE, Boruch AE, Cook DB, Lindheimer JB. Pain-related post-exertional malaise in myalgic encephalomyelitis/chronic fatigue syndrome (ME/CFS) and fibromyalgia: a systematic review and three-level meta-analysis. Pain Med. 2022;23:1144–57.

Goudsmit EM. The psychological aspects and management of chronic fatigue syndrome [Internet] [Thesis]. Brunel University, School of Social Sciences; 1996 [cited 2022 Jan 20]. https://scholar.google.co.uk/scholar_url?url=https://bura.brunel.ac.uk/bitstream/2438/4283/1/FulltextThesis.pdf&hl=en&sa=X&ei=kNYjZdeuA4-8ywTAmKmADQ&scisig=AFWwaeZvdxcuHmzGL08L3jp-QwNn&oi=scholarr . Accessed 2 Aug 2022

Stussman B, Williams A, Snow J, Gavin A, Scott R, Nath A, et al. Characterization of post-exertional malaise in patients with myalgic encephalomyelitis/chronic fatigue syndrome. Front Neurol. 2020;11:1025.

Holtzman CS, Bhatia KP, Cotler J, La J. Assessment of Post-Exertional Malaise (PEM) in Patients with Myalgic Encephalomyelitis (ME) and Chronic Fatigue Syndrome (CFS): a patient-driven survey. Diagnostics. 2019. https://doi.org/10.3390/diagnostics9010026 .

Fukuda K, Straus SE, Hickie I, Sharpe MC, Dobbins JG, Komaroff A. The chronic fatigue syndrome: a comprehensive approach to its definition and study. International Chronic Fatigue Syndrome Study Group. Ann Intern Med. 1994;121:953–9.

Carruthers BM, van de Sande MI, De Meirleir KL, Klimas NG, Broderick G, Mitchell T, et al. Myalgic encephalomyelitis: international consensus criteria. J Intern Med. 2011;270:327–38.

Carruthers JD, Lowe NJ, Menter MA, Gibson J, Eadie N, Botox Glabellar Lines II Study Group. Double-blind, placebo-controlled study of the safety and efficacy of botulinum toxin type A for patients with glabellar lines. Plast Reconstr Surg. 2003;112:1089–98.

Jason LA, Jordan K, Miike T, Bell DS, Lapp C, Torres-Harding S, et al. A pediatric case definition for myalgic encephalomyelitis and chronic fatigue syndrome. J Chronic Fatigue Syndrome. 2006;13:1–44.

Goudsmit EM, Nijs J, Jason LA, Wallman KE. Pacing as a strategy to improve energy management in myalgic encephalomyelitis/chronic fatigue syndrome: a consensus document. Disabil Rehabil. 2012;34:1140–7.

Antcliff D, Keenan A-M, Keeley P, Woby S, McGowan L. Engaging stakeholders to refine an activity pacing framework for chronic pain/fatigue: a nominal group technique. Musculoskeletal Care. 2019;17:354–62.

Antcliff D, Keeley P, Campbell M, Woby S, McGowan L. Exploring patients’ opinions of activity pacing and a new activity pacing questionnaire for chronic pain and/or fatigue: a qualitative study. Physiotherapy. 2016;102:300–7.

Yoshiuchi K, Cook DB, Ohashi K, Kumano H, Kuboki T, Yamamoto Y, et al. A real-time assessment of the effect of exercise in chronic fatigue syndrome. Physiol Behav. 2007;92:963–8.

Davenport TE, Stevens SR, Baroni K, Van Ness M, Snell CR. Diagnostic accuracy of symptoms characterising chronic fatigue syndrome. Disabil Rehabil. 2011;33:1768–75.

Nurek M, Rayner C, Freyer A, Taylor S, Järte L, MacDermott N, Delaney BC, Panellists D, et al. Recommendations for the recognition, diagnosis, and management of long COVID: a Delphi study. Br J Gen Pract. 2021. https://doi.org/10.3399/BJGP.2021.0265 .

Herrera JE, Niehaus WN, Whiteson J, Azola A, Baratta JM, Fleming TK, Kim SY, Naqvi H, Sampsel S, Silver JK, Gutierrez MV, Maley J, Herman E, Abramoff Benjamin, et al. Multidisciplinary collaborative consensus guidance statement on the assessment and treatment of fatigue in postacute sequelae of SARS-CoV-2 infection (PASC) patients. PM & R. 2021. https://doi.org/10.1002/pmrj.12684 .

Chen C, Haupert SR, Zimmermann L, Shi X, Fritsche LG, Mukherjee B. Global prevalence of post COVID-19 condition or long COVID: a meta-analysis and systematic review. J Infect Dis. 2022. https://doi.org/10.1093/infdis/jiac136 .

Office for National Statistics. Prevalence of ongoing symptoms following coronavirus (COVID-19) infection in the UK [Internet]. https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/bulletins/prevalenceofongoingsymptomsfollowingcoronaviruscovid19infectionintheuk/7july2022 . Accessed 2 Aug 2022

Office for National Statistics. Prevalence of ongoing symptoms following coronavirus (COVID-19) infection in the UK [Internet]. [cited 2022 Apr 1]. https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/bulletins/prevalenceofongoingsymptomsfollowingcoronaviruscovid19infectionintheuk/3march2022

Baker R, Shaw EJ. Diagnosis and management of chronic fatigue syndrome or myalgic encephalomyelitis (or encephalopathy): summary of NICE guidance. BMJ. 2007;335:446–8.

NICE. Overview | Myalgic encephalomyelitis (or encephalopathy)/chronic fatigue syndrome: diagnosis and management | Guidance | NICE [Internet]. NICE; [cited 2022 Aug 22]. https://www.nice.org.uk/guidance/ng206 . Accessed 2 Aug 2022

White P, Goldsmith K, Johnson A, Potts L, Walwyn R, DeCesare J, et al. Comparison of adaptive pacing therapy, cognitive behaviour therapy, graded exercise therapy, and specialist medical care for chronic fatigue syndrome (PACE): a randomised trial. The Lancet. 2011;377:823–36.

Article   CAS   Google Scholar  

Vink M. PACE trial authors continue to ignore their own null effect. J Health Psychol. 2017;22:1134–40.

Petrie K, Weinman J. The PACE trial: it’s time to broaden perceptions and move on. J Health Psychol. 2017;22:1198–200.

Stouten B. PACE-GATE: an alternative view on a study with a poor trial protocol. J Health Psychol. 2017;22:1192–7.

Agardy S. Chronic fatigue syndrome patients have no reason to accept the PACE trial results: response to Keith J Petrie and John Weinman. J Health Psychol. 2017;22:1206–8.

Kim D-Y, Lee J-S, Park S-Y, Kim S-J, Son C-G. Systematic review of randomized controlled trials for chronic fatigue syndrome/myalgic encephalomyelitis (CFS/ME). J Transl Med. 2020;18:7.

Twisk FNM, Maes M. A review on cognitive behavorial therapy (CBT) and graded exercise therapy (GET) in myalgic encephalomyelitis (ME) / chronic fatigue syndrome (CFS): CBT/GET is not only ineffective and not evidence-based, but also potentially harmful for many patients with ME/CFS. Neuro Endocrinol Lett. 2009;30:284–99.

PubMed   Google Scholar  

Mays N, Roberts E, Popay J. Synthesising research evidence. In: Fulop N, Allen P, Clarke A, Black N, editors. Studying the organisation and delivery of health services: research methods. London: Routledge; 2001. p. 188–220.

Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. 2018;18:143.

Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8:19–32.

Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169:467–73.

de Morton NA. The PEDro scale is a valid measure of the methodological quality of clinical trials: a demographic study. Aust J Physiother. 2009;55:129–33.

Maher CG, Sherrington C, Herbert RD, Moseley AM, Elkins M. Reliability of the PEDro scale for rating quality of randomized controlled trials. Phys Ther. 2003;83:713–21.

Kos D, van Eupen I, Meirte J, Van Cauwenbergh D, Moorkens G, Meeus M, et al. Activity pacing self-management in chronic fatigue syndrome: a randomized controlled trial. Am J Occup Ther. 2015;69:6905290020.

Meeus M, Nijs J, Van Oosterwijck J, Van Alsenoy V, Truijen S. Pain physiology education improves pain beliefs in patients with chronic fatigue syndrome compared with pacing and self-management education: a double-blind randomized controlled trial. Arch Phys Med Rehabil. 2010;91:1153–9.

Antcliff D, Keenan A-M, Keeley P, Woby S, McGowan L. Testing a newly developed activity pacing framework for chronic pain/fatigue: a feasibility study. BMJ Open. 2021;11: e045398.

Nijs J, van Eupen I, Vandecauter J, Augustinus E, Bleyen G, Moorkens G, et al. Can pacing self-management alter physical behavior and symptom severity in chronic fatigue syndrome? A case series. J Rehabil Res Dev. 2009;46:985–96.

Geraghty K, Hann M, Kurtev S. Myalgic encephalomyelitis/chronic fatigue syndrome patients’ reports of symptom changes following cognitive behavioural therapy, graded exercise therapy and pacing treatments: Analysis of a primary survey compared with secondary surveys. J Health Psychol. 2019;24:1318–33.

Jason L, Muldowney K, Torres-Harding S. The energy envelope theory and myalgic encephalomyelitis/chronic fatigue syndrome. AAOHN J. 2008;56:189–95.

Brown M, Khorana N, Jason LA. The role of changes in activity as a function of perceived available and expended energy in non-pharmacological treatment outcomes for ME/CFS. J Clin Psychol. 2011;67:253.

Association ME. ME/CFS illness management survey results:‘“No decisions about me without me.” Part 1: Results and in-depth analysis of the 2012 ME association patient survey examining the acceptability, efficacy and safety of cognitive behavioural therapy, graded exercise therapy and pacing, as interventions used as management strategies for ME/CFS. 2015. https://www.meassociation.org.uk/wp-content/uploads/NO-DECISIONS-WITHOUT-ME-report.docx . Accessed 2 Feb 2022

Sharpe M, Goldsmith KA, Johnson AL, Chalder T, Walker J, White PD. Rehabilitative treatments for chronic fatigue syndrome: long-term follow-up from the PACE trial. The Lancet Psychiatry. 2015;2:1067–74.

White PD, Goldsmith K, Johnson AL, Chalder T, Sharpe M. Recovery from chronic fatigue syndrome after treatments given in the PACE trial. Psychol Med. 2013;43:2227–35.

O’connor K, Sunnquist M, Nicholson L, Jason LA, Newton JL, Strand EB. Energy envelope maintenance among patients with myalgic encephalomyelitis and chronic fatigue syndrome: Implications of limited energy reserves. Chronic Illn. 2019;15:51–60.

Dougall D, Johnson A, Goldsmith K, Sharpe M, Angus B, Chalder T, et al. Adverse events and deterioration reported by participants in the PACE trial of therapies for chronic fatigue syndrome. J Psychosom Res. 2014;77:20–6.

Brown AA, Evans MA, Jason LA. Examining the energy envelope and associated symptom patterns in chronic fatigue syndrome: does coping matter? Chronic Illn. 2013;9:302–11.

Bourke JH, Johnson AL, Sharpe M, Chalder T, White PD. Pain in chronic fatigue syndrome: response to rehabilitative treatments in the PACE trial. Psychol Med. 2014;44:1545–52.

Jason LA, Brown M, Brown A, Evans M, Flores S, Grant-Holler E, et al. Energy conservation/envelope theory interventions to help patients with myalgic encephalomyelitis/chronic fatigue syndrome. Fatigue. 2013;1:27–42.

Antcliff D, Campbell M, Woby S, Keeley P. Activity pacing is associated with better and worse symptoms for patients with long-term conditions. Clin J Pain. 2017;33:205–14.

Nijs T, Klein Y, Mousavi S, Ahsan A, Nowakowska S, Constable E, et al. The different faces of 4’-Pyrimidinyl-Functionalized 4,2’:6’,4"-Terpyridin es: metal-organic assemblies from solution and on Au(111) and Cu(111) surface platforms. J Am Chem Soc. 2018;140:2933–9.

Cutler DM, Summers LH. The COVID-19 pandemic and the $16 Trillion Virus. JAMA. 2020;324:1495–6.

Cutler DM. The costs of long COVID. JAMA Health Forum. 2022;3:e221809–e221809.

Geraghty K. ‘PACE-Gate’: when clinical trial evidence meets open data access. J Health Psychol. 2017;22:1106–12.

Davis R, Campbell R, Hildon Z, Hobbs L, Michie S. Theories of behaviour and behaviour change across the social and behavioural sciences: a scoping review. Health Psychol Rev. 2015;9:323–44.

Prestwich A, Sniehotta FF, Whittington C, Dombrowski SU, Rogers L, Michie S. Does theory influence the effectiveness of health behavior interventions? Meta-analysis Health Psychol. 2014;33:465–74.

Balinas C, Eaton-Fitch N, Maksoud R, Staines D, Marshall-Gradisnik S. Impact of life stressors on Myalgic encephalomyelitis/chronic fatigue syndrome symptoms: an Australian longitudinal study. Int J Environ Res Public Health. 2021;18:10614.

McGregor NR, Armstrong CW, Lewis DP, Gooley PR. Post-exertional malaise is associated with hypermetabolism, hypoacetylation and purine metabolism deregulation in ME/CFS cases. Diagnostics. 2019;9:70.

Nacul LC, Lacerda EM, Campion P, Pheby D, de Drachler M, Leite JC, et al. The functional status and well being of people with myalgic encephalomyelitis/chronic fatigue syndrome and their carers. BMC Public Health. 2011;11:402.

Deumer U-S, Varesi A, Floris V, Savioli G, Mantovani E, López-Carrasco P, et al. Myalgic Encephalomyelitis/Chronic Fatigue Syndrome (ME/CFS): an overview. J Clin Med. 2021. https://doi.org/10.3390/jcm10204786 .

Düking P, Giessing L, Frenkel MO, Koehler K, Holmberg H-C, Sperlich B. Wrist-worn wearables for monitoring heart rate and energy expenditure while sitting or performing light-to-vigorous physical activity: validation study. JMIR Mhealth Uhealth. 2020;8: e16716.

Falter M, Budts W, Goetschalckx K, Cornelissen V, Buys R. Accuracy of apple watch measurements for heart rate and energy expenditure in patients with cardiovascular disease: cross-sectional study. JMIR Mhealth Uhealth. 2019;7: e11889.

Fuller D, Colwell E, Low J, Orychock K, Tobin MA, Simango B, et al. Reliability and validity of commercially available wearable devices for measuring steps, energy expenditure, and heart rate: systematic review. JMIR Mhealth Uhealth. 2020;8: e18694.

Mair JL, Hayes LD, Campbell AK, Sculthorpe N. Should we use activity tracker data from smartphones and wearables to understand population physical activity patterns? J Measur Phys Behav. 2022;1:1–5.

Mair JL, Hayes LD, Campbell AK, Buchan DS, Easton C, Sculthorpe N. A personalized smartphone-delivered just-in-time adaptive intervention (JitaBug) to increase physical activity in older adults: mixed methods feasibility study. JMIR Formative Res. 2022;6: e34662.

Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46:81–95.

Feehan SM. The PACE trial in chronic fatigue syndrome. The Lancet. 2011;377:1831–2.

Giakoumakis J. The PACE trial in chronic fatigue syndrome. The Lancet. 2011;377:1831.

White PD, Sharpe MC, Chalder T, DeCesare JC, Walwyn R, PACE trial group. Protocol for the PACE trial: a randomised controlled trial of adaptive pacing, cognitive behaviour therapy, and graded exercise, as supplements to standardised specialist medical care versus standardised specialist medical care alone for patients with the chronic fatigue syndrome/myalgic encephalomyelitis or encephalopathy. BMC Neurol. 2007;7:6.

Reuben DB, Tinetti ME. Goal-oriented patient care–an alternative health outcomes paradigm. N Engl J Med. 2012;366:777–9.

Roberts D. Chronic fatigue syndrome and quality of life. PROM. 2018;9:253–62.

Valdez AR, Hancock EE, Adebayo S, Kiernicki DJ, Proskauer D, Attewell JR, et al. Estimating prevalence, demographics, and costs of ME/CFS using large scale medical claims data and machine learning. Front Pediatr. 2019. https://doi.org/10.3389/fped.2018.00412 .

Greiwe J, Nyenhuis SM. Wearable technology and how this can be implemented into clinical practice. Curr Allergy Asthma Rep. 2020;20:36.

Sun S, Folarin AA, Ranjan Y, Rashid Z, Conde P, Stewart C, et al. Using smartphones and wearable devices to monitor behavioral changes during COVID-19. J Med Internet Res. 2020;22: e19992.

Hardeman W, Houghton J, Lane K, Jones A, Naughton F. A systematic review of just-in-time adaptive interventions (JITAIs) to promote physical activity. Int J Behav Nutr Phys Act. 2019;16:31.

Perski O, Hébert ET, Naughton F, Hekler EB, Brown J, Businelle MS. Technology-mediated just-in-time adaptive interventions (JITAIs) to reduce harmful substance use: a systematic review. Addiction. 2022;117:1220–41.

AhmedS A, van Luenen S, Aslam S, van Bodegom D, Chavannes NH. A systematic review on the use of mHealth to increase physical activity in older people. Clinical eHealth. 2020;3:31–9.

Valenzuela T, Okubo Y, Woodbury A, Lord SR, Delbaere K. Adherence to technology-based exercise programs in older adults: a systematic review. J Geriatric Phys Ther. 2018;41:49–61.

Bowling A. Mode of questionnaire administration can have serious effects on data quality. J Public Health. 2005;27:281–91.

Burns SP, Terblanche M, Perea J, Lillard H, DeLaPena C, Grinage N, et al. mHealth intervention applications for adults living with the effects of stroke: a scoping review. Arch Rehabil Res Clin Transl. 2021;3: 100095.

Vandelanotte C, Müller AM, Short CE, Hingle M, Nathan N, Williams SL, et al. Past, present, and future of eHealth and mHealth research to improve physical activity and dietary behaviors. J Nutr Educ Behav. 2016;48:219-228.e1.

Ludwig K, Arthur R, Sculthorpe N, Fountain H, Buchan DS. Text messaging interventions for improvement in physical activity and sedentary behavior in youth: systematic review. JMIR Mhealth Uhealth. 2018;6:e10799.

Download references

Acknowledgements

We have no acknowledgements to make.

Open access funding provided by Swiss Federal Institute of Technology Zurich. This work was supported by grants from the National Institute for Health and Care Research (COV-LT2-0010) and the funder had no role in the conceptualisation, design, data collection, analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and affiliations.

Sport and Physical Activity Research Institute, School of Health and Life Sciences, University of the West of Scotland, Glasgow, UK

Nilihan E. M. Sanal-Hayes, Marie Mclaughlin, Lawrence D. Hayes, David Carless, Rachel Meach & Nicholas F. Sculthorpe

Future Health Technologies, Singapore-ETH Centre, Campus for Research Excellence and Technological Enterprise (CREATE), Singapore, Singapore

Jacqueline L. Mair

Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore

Long COVID Scotland, 12 Kemnay Place, Aberdeen, UK

Jane Ormerod

Physios for ME, London, UK

Natalie Hilliard

School of Education and Social Sciences, University of the West of Scotland, Glasgow, UK

Joanne Ingram

School of Health and Society, University of Salford, Salford, UK

Nilihan E. M. Sanal-Hayes

School of Sport, Exercise & Rehabilitation Sciences, University of Hull, Hull, UK

Marie Mclaughlin

You can also search for this author in PubMed   Google Scholar

Contributions

Authors’ contributions are given according to the CRediT taxonomy as follows: Conceptualization, N.E.M.S–H., M.M., L.D.H, and N.F.S.; methodology, N.E.M.S–H., M.M., L.D.H., and N.F.S.; software, N.E.M.S–H., M.M., L.D.H., and N.F.S.B.; validation, N.E.M.S–H., M.M., L.D.H, and N.F.S.; formal analysis, N.E.M.S–H., M.M., L.D.H., and N.F.S.; investigation, N.E.M.S–H., M.M., L.D.H., and N.F.S.; resources, L.D.H., J.O., D.C., N.H., J.L.M., and N.F.S.; data curation, N.E.M.S.-H., M.M., L.D.H., and N.F.S.; writing—original draft preparation, N.E.M.S.-H., M.M., L.D.H., and N.F.S.; writing—review and editing, N.E.M.S–H., M.M., L.D.H., J.O., D.C., N.H., R.M., J.L.M., J.I., and N.F.S.; visualisation, N.E.M.S–H. and M.M., supervision, N.F.S; project administration, N.E.M.S–H., M.M., L.D.H., and N.F.S.; funding acquisition, L.D.H., J.O., D.C., N.H., J.L.M., J.I., and N.F.S. All authors have read and agreed to the published version of the manuscript.

Corresponding author

Correspondence to Jacqueline L. Mair .

Ethics declarations

Ethical approval and content to participate.

This manuscript did not involve human participants, data, or tissues, so did not require ethical approval.

Consent for publication

This paper does not contain any individual person’s data in any form.

Competing interests

We report no financial and non-financial competing interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1..

Supplementary file 1. Full search string for databse searching.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Sanal-Hayes, N.E.M., Mclaughlin, M., Hayes, L.D. et al. A scoping review of ‘Pacing’ for management of Myalgic Encephalomyelitis/Chronic Fatigue Syndrome (ME/CFS): lessons learned for the long COVID pandemic. J Transl Med 21 , 720 (2023). https://doi.org/10.1186/s12967-023-04587-5

Download citation

Received : 30 June 2023

Accepted : 03 October 2023

Published : 14 October 2023

DOI : https://doi.org/10.1186/s12967-023-04587-5

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Myalgic encephalomyelitis
• Chronic fatigue syndrome
• Post-exertional malaise

Journal of Translational Medicine

ISSN: 1479-5876

• Submission enquiries: Access here and click Contact Us
• General enquiries: [email protected]