Google sign-in

How to identify relevant variables from a literature review?

Variables are simply factors that represent properties, qualities, or characteristics of a person, thing, or concept. Any research paper like a thesis or dissertation requires relevant variables to be defined correctly. They can be as simple as demographic characteristics such as age, gender, or income (Marudhar, 2018). Other times they can be more complex like the psychological traits of an individual. Researchers do a thorough literature review to identify these complex variables.

Different types of variables in a research

Variables of any study are of four main types.

Identifying relevant variables in a research

A dependent variable is a variable that is dependent on the value of another variable. So if anything in the first variable changes then the dependent variable changes too.

‘Weight’ is often dependent on the ‘age’ of an individual. Here, ‘weight’ is the dependent variable. Marudhar, 2018; USCLibraries, 2017

An independent variable is a variable that is unaffected by other variables of the study. In studies, these variables could be regarded as the factors affecting the key research term.

‘Age’ is not related to ‘gender’, i.e. if a person’s gender changes then his age does not change. Therefore they both are independent variables.

A demographic variable is a variable that represents the basic demographic characteristics of the nature of respondents included in the study. They are neither independent nor dependent. Common demographic variables are age, gender, income, location, profession and marital status.

An extraneous variable is also known as an intervening variable and they make a relationship stronger or weaker.

While assessing how age affects a person’s tolerance to alcohol, weight is an extraneous variable that may or may not actually affect the tolerance.

Categorising relevant variables as dependent and independent variables

Literature review for major studies serves as a major methodological tool to answer research questions. It aims to delve deep into the background of the research topic. For this, researchers study review relevant research papers published in reputable publications.

Xiang et al. (2014) examined the factors influencing project governance in china and determined that aspects like system management, stakeholder management, risk management, integrity management, cost management, and audit management affect the project performance (strategic and operational). Agemb & Oyugi (2017) further explored the critical success factors for project performance and stated that factors like project manager competency, project team competency, rules and procedure compliance, and subcontractor services influence the project performance. Lastly, Ramesh et al. (2018) in their examination of project success derived that human resource management, task management, schedule management, and feasibility study contribute to influencing project performance.

With the empirical review of the literature in the above example, it can be derived that project performance is the dependent variable represented by:

  • project success,
  • strategic performance,
  • and operational performance.

While aspects like:

  • system management,
  • stakeholder management,
  • risk management,
  • integrity management,
  • cost management,
  • audit management,
  • project manager competency,
  • project team competency,
  • rules and procedure compliance,
  • subcontractor services,
  • human resource management,
  • task management,
  • schedule management and,
  • feasibility study

are possible independent variables.

To find out an answer to the research question of how many Indonesian consumers liked to consume nicotine and why:

  • First, do a background check of how many Indonesians are actually consuming nicotine.
  • Procure 20 good studies from reputed publications in the last 10 years to make a literature review and understand all the possible reasons people consume nicotine.
  • Identify the independent variables such as ‘stress’, ‘easy availability, or ‘peer pressure which cause everyone to consume nicotine.
  • Lastly, find out the hidden (extraneous) factors which indirectly affect Indonesians to consume nicotine, such as ‘alcohol is not easily available.

In this case, the dependent variable is the consumption of nicotine and the independent variables are stress, easy availability and peer pressure.

Presenting the identified relevant variables in the conceptual framework

In the literature review, researchers commonly use a diagram known as a conceptual framework to map out the linkage between the variables. A conceptual framework is a visual or written representation of the possible or expected relationships between variables (Swaen, 2021). A conceptual framework helps to identify the correct way to test the relationship between two variables. Thus, the presentation of variables in the conceptual framework should be to state the mix of variables and their linkage based on existing studies (Regoniel, 2015).

From the above example of the empirical review of literature, the conceptual framework can be presented as:

Independent variables

  • System management
  • Stakeholder management
  • Risk management
  • Cost management
  • Audit management
  • Subcontractor services
  • Human resource management
  • Task management
  • Schedule management

Dependent variable

Project performance

Dependent variable components

  • Project success
  • Strategic performance
  • Operational performance

While identifying relevant variables in a literature review, it is important that:

  • The variables should be consistent with the goal.
  • They should be measurable and replicable. Avoid making ‘feeling’ a variable.
  • The stated variables should have been widely used in recent years or at least defined in recent terms.
  • The variable should be within the stated study design.
  • Variables identified should be valid, reliable, prevalent, and common in the community.
  • Should be mentioned or determined based on literature review.
  • The variables should not be out of scope, very rare, or time-consuming.
  • Agemb, W., & Oyugi, B. (2017). Critical Success Factors of Project Management : Empirical Evidence From Projects Supported By Constitiency development fund in Nyakach sub-country, Kisumu country. International Journal of Marketing and Technology , 7 (8), 20–28.
  • Carver, J., & Basili, V. (2003). Identifying implicit process variables to support future empirical work. Journal of the Brazilian Computer Society , 9 (2), 77–87. https://doi.org/10.1590/s0104-65002003000300006
  • Joon Sung, W. (2018). The Empirical Study on Digital Literacy from the Viewpoint of Digital Accessibility. International Journal of Engineering & Technology , 7 (3.13), 137. https://doi.org/10.14419/ijet.v7i3.13.16340
  • Kroelinger, M. (2002). Strategy for Literature Review Process .
  • Marudhar. (2018). Identifying Variables. International Journal of Science and Research (IJSR) , 8 (3), 865–868. https://doi.org/10.32388/od6d1w
  • Ramesh, E., Babu, D. R., & Rao, P. R. (2018). The impact of project management in achieving project success- Empirical study. International Journal of Mechanical Engineering and Technology , 9 (13), 237–247.
  • Regoniel, P. (2015). Conceptual Framework: A Step by Step Guide on How to Make One. SimplyEducate . simplyeducate.me/2015/01/05/conceptual-framework-guide/
  • Swaen, B. (2021). Constructing a conceptual framework. Scribbr . https://www.scribbr.com/methodology/conceptual-framework/
  • USCLibraries. (2017). Research Guides . Usc.Edu. https://libguides.usc.edu/writingguide/background
  • Xiang, W., Li, Y., & Shou, Y. (2014). An empirical study of critical success factors of project governance in China. IEEE International Conference on Industrial Engineering and Engineering Management , 71072119 , 405–409. https://doi.org/10.1109/IEEM.2013.6962443
  • ZamenPub. (2019). The Use and Importance of Colorants . https://www.koelcolours.com/blog/colorants/the-use-and-importance-of-colorants/
  • Click to share on Twitter (Opens in new window)
  • Click to share on Facebook (Opens in new window)
  • Click to share on LinkedIn (Opens in new window)
  • Click to share on WhatsApp (Opens in new window)
  • Click to share on Telegram (Opens in new window)

Notify me of follow-up comments by email.

3 thoughts on “How to identify relevant variables from a literature review?”

Proofreading.

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

Writing a Literature Review

OWL logo

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays). When we say “literature review” or refer to “the literature,” we are talking about the research ( scholarship ) in a given field. You will often see the terms “the research,” “the scholarship,” and “the literature” used mostly interchangeably.

Where, when, and why would I write a lit review?

There are a number of different situations where you might write a literature review, each with slightly different expectations; different disciplines, too, have field-specific expectations for what a literature review is and does. For instance, in the humanities, authors might include more overt argumentation and interpretation of source material in their literature reviews, whereas in the sciences, authors are more likely to report study designs and results in their literature reviews; these differences reflect these disciplines’ purposes and conventions in scholarship. You should always look at examples from your own discipline and talk to professors or mentors in your field to be sure you understand your discipline’s conventions, for literature reviews as well as for any other genre.

A literature review can be a part of a research paper or scholarly article, usually falling after the introduction and before the research methods sections. In these cases, the lit review just needs to cover scholarship that is important to the issue you are writing about; sometimes it will also cover key sources that informed your research methodology.

Lit reviews can also be standalone pieces, either as assignments in a class or as publications. In a class, a lit review may be assigned to help students familiarize themselves with a topic and with scholarship in their field, get an idea of the other researchers working on the topic they’re interested in, find gaps in existing research in order to propose new projects, and/or develop a theoretical framework and methodology for later research. As a publication, a lit review usually is meant to help make other scholars’ lives easier by collecting and summarizing, synthesizing, and analyzing existing research on a topic. This can be especially helpful for students or scholars getting into a new research area, or for directing an entire community of scholars toward questions that have not yet been answered.

What are the parts of a lit review?

Most lit reviews use a basic introduction-body-conclusion structure; if your lit review is part of a larger paper, the introduction and conclusion pieces may be just a few sentences while you focus most of your attention on the body. If your lit review is a standalone piece, the introduction and conclusion take up more space and give you a place to discuss your goals, research methods, and conclusions separately from where you discuss the literature itself.

Introduction:

  • An introductory paragraph that explains what your working topic and thesis is
  • A forecast of key topics or texts that will appear in the review
  • Potentially, a description of how you found sources and how you analyzed them for inclusion and discussion in the review (more often found in published, standalone literature reviews than in lit review sections in an article or research paper)
  • Summarize and synthesize: Give an overview of the main points of each source and combine them into a coherent whole
  • Analyze and interpret: Don’t just paraphrase other researchers – add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
  • Critically Evaluate: Mention the strengths and weaknesses of your sources
  • Write in well-structured paragraphs: Use transition words and topic sentence to draw connections, comparisons, and contrasts.

Conclusion:

  • Summarize the key findings you have taken from the literature and emphasize their significance
  • Connect it back to your primary research question

How should I organize my lit review?

Lit reviews can take many different organizational patterns depending on what you are trying to accomplish with the review. Here are some examples:

  • Chronological : The simplest approach is to trace the development of the topic over time, which helps familiarize the audience with the topic (for instance if you are introducing something that is not commonly known in your field). If you choose this strategy, be careful to avoid simply listing and summarizing sources in order. Try to analyze the patterns, turning points, and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred (as mentioned previously, this may not be appropriate in your discipline — check with a teacher or mentor if you’re unsure).
  • Thematic : If you have found some recurring central themes that you will continue working with throughout your piece, you can organize your literature review into subsections that address different aspects of the topic. For example, if you are reviewing literature about women and religion, key themes can include the role of women in churches and the religious attitude towards women.
  • Qualitative versus quantitative research
  • Empirical versus theoretical scholarship
  • Divide the research by sociological, historical, or cultural sources
  • Theoretical : In many humanities articles, the literature review is the foundation for the theoretical framework. You can use it to discuss various theories, models, and definitions of key concepts. You can argue for the relevance of a specific theoretical approach or combine various theorical concepts to create a framework for your research.

What are some strategies or tips I can use while writing my lit review?

Any lit review is only as good as the research it discusses; make sure your sources are well-chosen and your research is thorough. Don’t be afraid to do more research if you discover a new thread as you’re writing. More info on the research process is available in our "Conducting Research" resources .

As you’re doing your research, create an annotated bibliography ( see our page on the this type of document ). Much of the information used in an annotated bibliography can be used also in a literature review, so you’ll be not only partially drafting your lit review as you research, but also developing your sense of the larger conversation going on among scholars, professionals, and any other stakeholders in your topic.

Usually you will need to synthesize research rather than just summarizing it. This means drawing connections between sources to create a picture of the scholarly conversation on a topic over time. Many student writers struggle to synthesize because they feel they don’t have anything to add to the scholars they are citing; here are some strategies to help you:

  • It often helps to remember that the point of these kinds of syntheses is to show your readers how you understand your research, to help them read the rest of your paper.
  • Writing teachers often say synthesis is like hosting a dinner party: imagine all your sources are together in a room, discussing your topic. What are they saying to each other?
  • Look at the in-text citations in each paragraph. Are you citing just one source for each paragraph? This usually indicates summary only. When you have multiple sources cited in a paragraph, you are more likely to be synthesizing them (not always, but often
  • Read more about synthesis here.

The most interesting literature reviews are often written as arguments (again, as mentioned at the beginning of the page, this is discipline-specific and doesn’t work for all situations). Often, the literature review is where you can establish your research as filling a particular gap or as relevant in a particular way. You have some chance to do this in your introduction in an article, but the literature review section gives a more extended opportunity to establish the conversation in the way you would like your readers to see it. You can choose the intellectual lineage you would like to be part of and whose definitions matter most to your thinking (mostly humanities-specific, but this goes for sciences as well). In addressing these points, you argue for your place in the conversation, which tends to make the lit review more compelling than a simple reporting of other sources.

Logo for British Columbia/Yukon Open Authoring Platform

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

The Research Proposal

83 Components of the Literature Review

Krathwohl (2005) suggests and describes a variety of components to include in a research proposal.  The following sections present these components in a suggested template for you to follow in the preparation of your research proposal.

Introduction

The introduction sets the tone for what follows in your research proposal – treat it as the initial pitch of your idea.  After reading the introduction your reader should:

  • Understand what it is you want to do;
  • Have a sense of your passion for the topic;
  • Be excited about the study´s possible outcomes.

As you begin writing your research proposal it is helpful to think of the introduction as a narrative of what it is you want to do, written in one to three paragraphs.  Within those one to three paragraphs, it is important to briefly answer the following questions:

  • What is the central research problem?
  • How is the topic of your research proposal related to the problem?
  • What methods will you utilize to analyze the research problem?
  • Why is it important to undertake this research? What is the significance of your proposed research?  Why are the outcomes of your proposed research important, and to whom or to what are they important?

Note : You may be asked by your instructor to include an abstract with your research proposal.  In such cases, an abstract should provide an overview of what it is you plan to study, your main research question, a brief explanation of your methods to answer the research question, and your expected findings. All of this information must be carefully crafted in 150 to 250 words.  A word of advice is to save the writing of your abstract until the very end of your research proposal preparation.  If you are asked to provide an abstract, you should include 5-7 key words that are of most relevance to your study. List these in order of relevance.

Background and significance

The purpose of this section is to explain the context of your proposal and to describe, in detail, why it is important to undertake this research. Assume that the person or people who will read your research proposal know nothing or very little about the research problem.  While you do not need to include all knowledge you have learned about your topic in this section, it is important to ensure that you include the most relevant material that will help to explain the goals of your research.

While there are no hard and fast rules, you should attempt to address some or all of the following key points:

  • State the research problem and provide a more thorough explanation about the purpose of the study than what you stated in the introduction.
  • Present the rationale for the proposed research study. Clearly indicate why this research is worth doing.  Answer the “so what?” question.
  • Describe the major issues or problems to be addressed by your research. Do not forget to explain how and in what ways your proposed research builds upon previous related research.
  • Explain how you plan to go about conducting your research.
  • Clearly identify the key or most relevant sources of research you intend to use and explain how they will contribute to your analysis of the topic.
  • Set the boundaries of your proposed research, in order to provide a clear focus. Where appropriate, state not only what you will study, but what will be excluded from your study.
  • Provide clear definitions of key concepts and terms. As key concepts and terms often have numerous definitions, make sure you state which definition you will be utilizing in your research.

Literature Review

This is the most time-consuming aspect in the preparation of your research proposal and it is a key component of the research proposal. As described in Chapter 5 , the literature review provides the background to your study and demonstrates the significance of the proposed research. Specifically, it is a review and synthesis of prior research that is related to the problem you are setting forth to investigate.  Essentially, your goal in the literature review is to place your research study within the larger whole of what has been studied in the past, while demonstrating to your reader that your work is original, innovative, and adds to the larger whole.

As the literature review is information dense, it is essential that this section be intelligently structured to enable your reader to grasp the key arguments underpinning your study. However, this can be easier to state and harder to do, simply due to the fact there is usually a plethora of related research to sift through. Consequently, a good strategy for writing the literature review is to break the literature into conceptual categories or themes, rather than attempting to describe various groups of literature you reviewed.  Chapter V, “ The Literature Review ,” describes a variety of methods to help you organize the themes.

Here are some suggestions on how to approach the writing of your literature review:

  • Think about what questions other researchers have asked, what methods they used, what they found, and what they recommended based upon their findings.
  • Do not be afraid to challenge previous related research findings and/or conclusions.
  • Assess what you believe to be missing from previous research and explain how your research fills in this gap and/or extends previous research

It is important to note that a significant challenge related to undertaking a literature review is knowing when to stop.  As such, it is important to know how to know when you have uncovered the key conceptual categories underlying your research topic.  Generally, when you start to see repetition in the conclusions or recommendations, you can have confidence that you have covered all of the significant conceptual categories in your literature review.  However, it is also important to acknowledge that researchers often find themselves returning to the literature as they collect and analyze their data.  For example, an unexpected finding may develop as one collects and/or analyzes the data and it is important to take the time to step back and review the literature again, to ensure that no other researchers have found a similar finding.  This may include looking to research outside your field.

This situation occurred with one of the authors of this textbook´s research related to community resilience.  During the interviews, the researchers heard many participants discuss individual resilience factors and how they believed these individual factors helped make the community more resilient, overall.  Sheppard and Williams (2016) had not discovered these individual factors in their original literature review on community and environmental resilience. However, when they returned to the literature to search for individual resilience factors, they discovered a small body of literature in the child and youth psychology field. Consequently, Sheppard and Williams had to go back and add a new section to their literature review on individual resilience factors. Interestingly, their research appeared to be the first research to link individual resilience factors with community resilience factors.

Research design and methods

The objective of this section of the research proposal is to convince the reader that your overall research design and methods of analysis will enable you to solve the research problem you have identified and also enable you to accurately and effectively interpret the results of your research. Consequently, it is critical that the research design and methods section is well-written, clear, and logically organized.  This demonstrates to your reader that you know what you are going to do and how you are going to do it.  Overall, you want to leave your reader feeling confident that you have what it takes to get this research study completed in a timely fashion.

Essentially, this section of the research proposal should be clearly tied to the specific objectives of your study; however, it is also important to draw upon and include examples from the literature review that relate to your design and intended methods.  In other words, you must clearly demonstrate how your study utilizes and builds upon past studies, as it relates to the research design and intended methods.  For example, what methods have been used by other researchers in similar studies?

While it is important to consider the methods that other researchers have employed, it is equally important, if not more so, to consider what methods have not been employed but could be.  Remember, the methods section is not simply a list of tasks to be undertaken. It is also an argument as to why and how the tasks you have outlined will help you investigate the research problem and answer your research question(s).

Tips for writing the research design and methods section:

  • Specify the methodological approaches you intend to employ to obtain information and the techniques you will use to analyze the data.
  • Specify the research operations you will undertake and he way you will interpret the results of those operations in relation to the research problem.
  • Go beyond stating what you hope to achieve through the methods you have chosen. State how you will actually do the methods (i.e. coding interview text, running regression analysis, etc.).
  • Anticipate and acknowledge any potential barriers you may encounter when undertaking your research and describe how you will address these barriers.
  • Explain where you believe you will find challenges related to data collection, including access to participants and information.

Preliminary suppositions and implications

The purpose of this section is to argue how and in what ways you anticipate that your research will refine, revise, or extend existing knowledge in the area of your study. Depending upon the aims and objectives of your study, you should also discuss how your anticipated findings may impact future research.  For example, is it possible that your research may lead to a new policy, new theoretical understanding, or a new method for analyzing data?  How might your study influence future studies?  What might your study mean for future practitioners working in the field?  Who or what may benefit from your study?  How might your study contribute to social, economic, environmental issues?  While it is important to think about and discuss possibilities such as these, it is equally important to be realistic in stating your anticipated findings.  In other words, you do not want to delve into idle speculation.  Rather, the purpose here is to reflect upon gaps in the current body of literature and to describe how and in what ways you anticipate your research will begin to fill in some or all of those gaps.

The conclusion reiterates the importance and significance of your research proposal and it provides a brief summary of the entire proposed study.  Essentially, this section should only be one or two paragraphs in length. Here is a potential outline for your conclusion:

  • Discuss why the study should be done. Specifically discuss how you expect your study will advance existing knowledge and how your study is unique.
  • Explain the specific purpose of the study and the research questions that the study will answer.
  • Explain why the research design and methods chosen for this study are appropriate, and why other design and methods were not chosen.
  • State the potential implications you expect to emerge from your proposed study,
  • Provide a sense of how your study fits within the broader scholarship currently in existence related to the research problem.

As with any scholarly research paper, you must cite the sources you used in composing your research proposal.  In a research proposal, this can take two forms: a reference list or a bibliography.  A reference list does what the name suggests, it lists the literature you referenced in the body of your research proposal.  All references in the reference list, must appear in the body of the research proposal.  Remember, it is not acceptable to say “as cited in …”  As a researcher you must always go to the original source and check it for yourself.  Many errors are made in referencing, even by top researchers, and so it is important not to perpetuate an error made by someone else. While this can be time consuming, it is the proper way to undertake a literature review.

In contrast, a bibliography , is a list of everything you used or cited in your research proposal, with additional citations to any key sources relevant to understanding the research problem.  In other words, sources cited in your bibliography may not necessarily appear in the body of your research proposal.  Make sure you check with your instructor to see which of the two you are expected to produce.

Overall, your list of citations should be a testament to the fact that you have done a sufficient level of preliminary research to ensure that your project will complement, but not duplicate, previous research efforts. For social sciences, the reference list or bibliography should be prepared in American Psychological Association (APA) referencing format. Usually, the reference list (or bibliography) is not included in the word count of the research proposal. Again, make sure you check with your instructor to confirm.

An Introduction to Research Methods in Sociology Copyright © 2019 by Valerie A. Sheppard is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License , except where otherwise noted.

Share This Book

  • UConn Library
  • Literature Review: The What, Why and How-to Guide
  • Introduction

Literature Review: The What, Why and How-to Guide — Introduction

  • Getting Started
  • How to Pick a Topic
  • Strategies to Find Sources
  • Evaluating Sources & Lit. Reviews
  • Tips for Writing Literature Reviews
  • Writing Literature Review: Useful Sites
  • Citation Resources
  • Other Academic Writings

What are Literature Reviews?

So, what is a literature review? "A literature review is an account of what has been published on a topic by accredited scholars and researchers. In writing the literature review, your purpose is to convey to your reader what knowledge and ideas have been established on a topic, and what their strengths and weaknesses are. As a piece of writing, the literature review must be defined by a guiding concept (e.g., your research objective, the problem or issue you are discussing, or your argumentative thesis). It is not just a descriptive list of the material available, or a set of summaries." Taylor, D.  The literature review: A few tips on conducting it . University of Toronto Health Sciences Writing Centre.

Goals of Literature Reviews

What are the goals of creating a Literature Review?  A literature could be written to accomplish different aims:

  • To develop a theory or evaluate an existing theory
  • To summarize the historical or existing state of a research topic
  • Identify a problem in a field of research 

Baumeister, R. F., & Leary, M. R. (1997). Writing narrative literature reviews .  Review of General Psychology , 1 (3), 311-320.

What kinds of sources require a Literature Review?

  • A research paper assigned in a course
  • A thesis or dissertation
  • A grant proposal
  • An article intended for publication in a journal

All these instances require you to collect what has been written about your research topic so that you can demonstrate how your own research sheds new light on the topic.

Types of Literature Reviews

What kinds of literature reviews are written?

Narrative review: The purpose of this type of review is to describe the current state of the research on a specific topic/research and to offer a critical analysis of the literature reviewed. Studies are grouped by research/theoretical categories, and themes and trends, strengths and weakness, and gaps are identified. The review ends with a conclusion section which summarizes the findings regarding the state of the research of the specific study, the gaps identify and if applicable, explains how the author's research will address gaps identify in the review and expand the knowledge on the topic reviewed.

  • Example : Predictors and Outcomes of U.S. Quality Maternity Leave: A Review and Conceptual Framework:  10.1177/08948453211037398  

Systematic review : "The authors of a systematic review use a specific procedure to search the research literature, select the studies to include in their review, and critically evaluate the studies they find." (p. 139). Nelson, L. K. (2013). Research in Communication Sciences and Disorders . Plural Publishing.

  • Example : The effect of leave policies on increasing fertility: a systematic review:  10.1057/s41599-022-01270-w

Meta-analysis : "Meta-analysis is a method of reviewing research findings in a quantitative fashion by transforming the data from individual studies into what is called an effect size and then pooling and analyzing this information. The basic goal in meta-analysis is to explain why different outcomes have occurred in different studies." (p. 197). Roberts, M. C., & Ilardi, S. S. (2003). Handbook of Research Methods in Clinical Psychology . Blackwell Publishing.

  • Example : Employment Instability and Fertility in Europe: A Meta-Analysis:  10.1215/00703370-9164737

Meta-synthesis : "Qualitative meta-synthesis is a type of qualitative study that uses as data the findings from other qualitative studies linked by the same or related topic." (p.312). Zimmer, L. (2006). Qualitative meta-synthesis: A question of dialoguing with texts .  Journal of Advanced Nursing , 53 (3), 311-318.

  • Example : Women’s perspectives on career successes and barriers: A qualitative meta-synthesis:  10.1177/05390184221113735

Literature Reviews in the Health Sciences

  • UConn Health subject guide on systematic reviews Explanation of the different review types used in health sciences literature as well as tools to help you find the right review type
  • << Previous: Getting Started
  • Next: How to Pick a Topic >>
  • Last Updated: Sep 21, 2022 2:16 PM
  • URL: https://guides.lib.uconn.edu/literaturereview

Creative Commons

  • Library Homepage

Literature Review: The What, Why and How-to Guide: Literature Reviews?

  • Literature Reviews?
  • Strategies to Finding Sources
  • Keeping up with Research!
  • Evaluating Sources & Literature Reviews
  • Organizing for Writing
  • Writing Literature Review
  • Other Academic Writings

What is a Literature Review?

So, what is a literature review .

"A literature review is an account of what has been published on a topic by accredited scholars and researchers. In writing the literature review, your purpose is to convey to your reader what knowledge and ideas have been established on a topic, and what their strengths and weaknesses are. As a piece of writing, the literature review must be defined by a guiding concept (e.g., your research objective, the problem or issue you are discussing, or your argumentative thesis). It is not just a descriptive list of the material available or a set of summaries." - Quote from Taylor, D. (n.d)."The Literature Review: A Few Tips on Conducting it".

  • Citation: "The Literature Review: A Few Tips on Conducting it"

What kinds of literature reviews are written?

Each field has a particular way to do reviews for academic research literature. In the social sciences and humanities the most common are:

  • Narrative Reviews: The purpose of this type of review is to describe the current state of the research on a specific research topic and to offer a critical analysis of the literature reviewed. Studies are grouped by research/theoretical categories, and themes and trends, strengths and weaknesses, and gaps are identified. The review ends with a conclusion section that summarizes the findings regarding the state of the research of the specific study, the gaps identify and if applicable, explains how the author's research will address gaps identify in the review and expand the knowledge on the topic reviewed.
  • Book review essays/ Historiographical review essays : A type of literature review typical in History and related fields, e.g., Latin American studies. For example, the Latin American Research Review explains that the purpose of this type of review is to “(1) to familiarize readers with the subject, approach, arguments, and conclusions found in a group of books whose common focus is a historical period; a country or region within Latin America; or a practice, development, or issue of interest to specialists and others; (2) to locate these books within current scholarship, critical methodologies, and approaches; and (3) to probe the relation of these new books to previous work on the subject, especially canonical texts. Unlike individual book reviews, the cluster reviews found in LARR seek to address the state of the field or discipline and not solely the works at issue.” - LARR

What are the Goals of Creating a Literature Review?

  • To develop a theory or evaluate an existing theory
  • To summarize the historical or existing state of a research topic
  • Identify a problem in a field of research 
  • Baumeister, R.F. & Leary, M.R. (1997). "Writing narrative literature reviews," Review of General Psychology , 1(3), 311-320.

When do you need to write a Literature Review?

  • When writing a prospectus or a thesis/dissertation
  • When writing a research paper
  • When writing a grant proposal

In all these cases you need to dedicate a chapter in these works to showcase what has been written about your research topic and to point out how your own research will shed new light into a body of scholarship.

Where I can find examples of Literature Reviews?

Note:  In the humanities, even if they don't use the term "literature review", they may have a dedicated  chapter that reviewed the "critical bibliography" or they incorporated that review in the introduction or first chapter of the dissertation, book, or article.

  • UCSB electronic theses and dissertations In partnership with the Graduate Division, the UC Santa Barbara Library is making available theses and dissertations produced by UCSB students. Currently included in ADRL are theses and dissertations that were originally filed electronically, starting in 2011. In future phases of ADRL, all theses and dissertations created by UCSB students may be digitized and made available.

Where to Find Standalone Literature Reviews

Literature reviews are also written as standalone articles as a way to survey a particular research topic in-depth. This type of literature review looks at a topic from a historical perspective to see how the understanding of the topic has changed over time. 

  • Find e-Journals for Standalone Literature Reviews The best way to get familiar with and to learn how to write literature reviews is by reading them. You can use our Journal Search option to find journals that specialize in publishing literature reviews from major disciplines like anthropology, sociology, etc. Usually these titles are called, "Annual Review of [discipline name] OR [Discipline name] Review. This option works best if you know the title of the publication you are looking for. Below are some examples of these journals! more... less... Journal Search can be found by hovering over the link for Research on the library website.

Social Sciences

  • Annual Review of Anthropology
  • Annual Review of Political Science
  • Annual Review of Sociology
  • Ethnic Studies Review

Hard science and health sciences:

  • Annual Review of Biomedical Data Science
  • Annual Review of Materials Science
  • Systematic Review From journal site: "The journal Systematic Reviews encompasses all aspects of the design, conduct, and reporting of systematic reviews" in the health sciences.
  • << Previous: Overview
  • Next: Strategies to Finding Sources >>
  • Last Updated: Mar 5, 2024 11:44 AM
  • URL: https://guides.library.ucsb.edu/litreview

Harvey Cushing/John Hay Whitney Medical Library

  • Collections
  • Research Help

YSN Doctoral Programs: Steps in Conducting a Literature Review

  • Biomedical Databases
  • Global (Public Health) Databases
  • Soc. Sci., History, and Law Databases
  • Grey Literature
  • Trials Registers
  • Data and Statistics
  • Public Policy
  • Google Tips
  • Recommended Books
  • Steps in Conducting a Literature Review

What is a literature review?

A literature review is an integrated analysis -- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question.  That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.

A literature review may be a stand alone work or the introduction to a larger research paper, depending on the assignment.  Rely heavily on the guidelines your instructor has given you.

Why is it important?

A literature review is important because it:

  • Explains the background of research on a topic.
  • Demonstrates why a topic is significant to a subject area.
  • Discovers relationships between research studies/ideas.
  • Identifies major themes, concepts, and researchers on a topic.
  • Identifies critical gaps and points of disagreement.
  • Discusses further research questions that logically come out of the previous studies.

APA7 Style resources

Cover Art

APA Style Blog - for those harder to find answers

1. Choose a topic. Define your research question.

Your literature review should be guided by your central research question.  The literature represents background and research developments related to a specific research question, interpreted and analyzed by you in a synthesized way.

  • Make sure your research question is not too broad or too narrow.  Is it manageable?
  • Begin writing down terms that are related to your question. These will be useful for searches later.
  • If you have the opportunity, discuss your topic with your professor and your class mates.

2. Decide on the scope of your review

How many studies do you need to look at? How comprehensive should it be? How many years should it cover? 

  • This may depend on your assignment.  How many sources does the assignment require?

3. Select the databases you will use to conduct your searches.

Make a list of the databases you will search. 

Where to find databases:

  • use the tabs on this guide
  • Find other databases in the Nursing Information Resources web page
  • More on the Medical Library web page
  • ... and more on the Yale University Library web page

4. Conduct your searches to find the evidence. Keep track of your searches.

  • Use the key words in your question, as well as synonyms for those words, as terms in your search. Use the database tutorials for help.
  • Save the searches in the databases. This saves time when you want to redo, or modify, the searches. It is also helpful to use as a guide is the searches are not finding any useful results.
  • Review the abstracts of research studies carefully. This will save you time.
  • Use the bibliographies and references of research studies you find to locate others.
  • Check with your professor, or a subject expert in the field, if you are missing any key works in the field.
  • Ask your librarian for help at any time.
  • Use a citation manager, such as EndNote as the repository for your citations. See the EndNote tutorials for help.

Review the literature

Some questions to help you analyze the research:

  • What was the research question of the study you are reviewing? What were the authors trying to discover?
  • Was the research funded by a source that could influence the findings?
  • What were the research methodologies? Analyze its literature review, the samples and variables used, the results, and the conclusions.
  • Does the research seem to be complete? Could it have been conducted more soundly? What further questions does it raise?
  • If there are conflicting studies, why do you think that is?
  • How are the authors viewed in the field? Has this study been cited? If so, how has it been analyzed?

Tips: 

  • Review the abstracts carefully.  
  • Keep careful notes so that you may track your thought processes during the research process.
  • Create a matrix of the studies for easy analysis, and synthesis, across all of the studies.
  • << Previous: Recommended Books
  • Last Updated: Jan 4, 2024 10:52 AM
  • URL: https://guides.library.yale.edu/YSNDoctoral
  • USC Libraries
  • Research Guides

Organizing Your Social Sciences Research Paper

  • 5. The Literature Review
  • Purpose of Guide
  • Design Flaws to Avoid
  • Independent and Dependent Variables
  • Glossary of Research Terms
  • Reading Research Effectively
  • Narrowing a Topic Idea
  • Broadening a Topic Idea
  • Extending the Timeliness of a Topic Idea
  • Academic Writing Style
  • Applying Critical Thinking
  • Choosing a Title
  • Making an Outline
  • Paragraph Development
  • Research Process Video Series
  • Executive Summary
  • The C.A.R.S. Model
  • Background Information
  • The Research Problem/Question
  • Theoretical Framework
  • Citation Tracking
  • Content Alert Services
  • Evaluating Sources
  • Primary Sources
  • Secondary Sources
  • Tiertiary Sources
  • Scholarly vs. Popular Publications
  • Qualitative Methods
  • Quantitative Methods
  • Insiderness
  • Using Non-Textual Elements
  • Limitations of the Study
  • Common Grammar Mistakes
  • Writing Concisely
  • Avoiding Plagiarism
  • Footnotes or Endnotes?
  • Further Readings
  • Generative AI and Writing
  • USC Libraries Tutorials and Other Guides
  • Bibliography

A literature review surveys prior research published in books, scholarly articles, and any other sources relevant to a particular issue, area of research, or theory, and by so doing, provides a description, summary, and critical evaluation of these works in relation to the research problem being investigated. Literature reviews are designed to provide an overview of sources you have used in researching a particular topic and to demonstrate to your readers how your research fits within existing scholarship about the topic.

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . Fourth edition. Thousand Oaks, CA: SAGE, 2014.

Importance of a Good Literature Review

A literature review may consist of simply a summary of key sources, but in the social sciences, a literature review usually has an organizational pattern and combines both summary and synthesis, often within specific conceptual categories . A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information in a way that informs how you are planning to investigate a research problem. The analytical features of a literature review might:

  • Give a new interpretation of old material or combine new with old interpretations,
  • Trace the intellectual progression of the field, including major debates,
  • Depending on the situation, evaluate the sources and advise the reader on the most pertinent or relevant research, or
  • Usually in the conclusion of a literature review, identify where gaps exist in how a problem has been researched to date.

Given this, the purpose of a literature review is to:

  • Place each work in the context of its contribution to understanding the research problem being studied.
  • Describe the relationship of each work to the others under consideration.
  • Identify new ways to interpret prior research.
  • Reveal any gaps that exist in the literature.
  • Resolve conflicts amongst seemingly contradictory previous studies.
  • Identify areas of prior scholarship to prevent duplication of effort.
  • Point the way in fulfilling a need for additional research.
  • Locate your own research within the context of existing literature [very important].

Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper. 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . Los Angeles, CA: SAGE, 2011; Knopf, Jeffrey W. "Doing a Literature Review." PS: Political Science and Politics 39 (January 2006): 127-132; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012.

Types of Literature Reviews

It is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the primary studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally among scholars that become part of the body of epistemological traditions within the field.

In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews. Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are a number of approaches you could adopt depending upon the type of analysis underpinning your study.

Argumentative Review This form examines literature selectively in order to support or refute an argument, deeply embedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to make summary claims of the sort found in systematic reviews [see below].

Integrative Review Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses or research problems. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication. This is the most common form of review in the social sciences.

Historical Review Few things rest in isolation from historical precedent. Historical literature reviews focus on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.

Methodological Review A review does not always focus on what someone said [findings], but how they came about saying what they say [method of analysis]. Reviewing methods of analysis provides a framework of understanding at different levels [i.e. those of theory, substantive fields, research approaches, and data collection and analysis techniques], how researchers draw upon a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection, and data analysis. This approach helps highlight ethical issues which you should be aware of and consider as you go through your own study.

Systematic Review This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyze data from the studies that are included in the review. The goal is to deliberately document, critically evaluate, and summarize scientifically all of the research about a clearly defined research problem . Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?" This type of literature review is primarily applied to examining prior research studies in clinical medicine and allied health fields, but it is increasingly being used in the social sciences.

Theoretical Review The purpose of this form is to examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review helps to establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.

NOTE : Most often the literature review will incorporate some combination of types. For example, a review that examines literature supporting or refuting an argument, assumption, or philosophical problem related to the research problem will also need to include writing supported by sources that establish the history of these arguments in the literature.

Baumeister, Roy F. and Mark R. Leary. "Writing Narrative Literature Reviews."  Review of General Psychology 1 (September 1997): 311-320; Mark R. Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Kennedy, Mary M. "Defining a Literature." Educational Researcher 36 (April 2007): 139-147; Petticrew, Mark and Helen Roberts. Systematic Reviews in the Social Sciences: A Practical Guide . Malden, MA: Blackwell Publishers, 2006; Torracro, Richard. "Writing Integrative Literature Reviews: Guidelines and Examples." Human Resource Development Review 4 (September 2005): 356-367; Rocco, Tonette S. and Maria S. Plakhotnik. "Literature Reviews, Conceptual Frameworks, and Theoretical Frameworks: Terms, Functions, and Distinctions." Human Ressource Development Review 8 (March 2008): 120-130; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

Structure and Writing Style

I.  Thinking About Your Literature Review

The structure of a literature review should include the following in support of understanding the research problem :

  • An overview of the subject, issue, or theory under consideration, along with the objectives of the literature review,
  • Division of works under review into themes or categories [e.g. works that support a particular position, those against, and those offering alternative approaches entirely],
  • An explanation of how each work is similar to and how it varies from the others,
  • Conclusions as to which pieces are best considered in their argument, are most convincing of their opinions, and make the greatest contribution to the understanding and development of their area of research.

The critical evaluation of each work should consider :

  • Provenance -- what are the author's credentials? Are the author's arguments supported by evidence [e.g. primary historical material, case studies, narratives, statistics, recent scientific findings]?
  • Methodology -- were the techniques used to identify, gather, and analyze the data appropriate to addressing the research problem? Was the sample size appropriate? Were the results effectively interpreted and reported?
  • Objectivity -- is the author's perspective even-handed or prejudicial? Is contrary data considered or is certain pertinent information ignored to prove the author's point?
  • Persuasiveness -- which of the author's theses are most convincing or least convincing?
  • Validity -- are the author's arguments and conclusions convincing? Does the work ultimately contribute in any significant way to an understanding of the subject?

II.  Development of the Literature Review

Four Basic Stages of Writing 1.  Problem formulation -- which topic or field is being examined and what are its component issues? 2.  Literature search -- finding materials relevant to the subject being explored. 3.  Data evaluation -- determining which literature makes a significant contribution to the understanding of the topic. 4.  Analysis and interpretation -- discussing the findings and conclusions of pertinent literature.

Consider the following issues before writing the literature review: Clarify If your assignment is not specific about what form your literature review should take, seek clarification from your professor by asking these questions: 1.  Roughly how many sources would be appropriate to include? 2.  What types of sources should I review (books, journal articles, websites; scholarly versus popular sources)? 3.  Should I summarize, synthesize, or critique sources by discussing a common theme or issue? 4.  Should I evaluate the sources in any way beyond evaluating how they relate to understanding the research problem? 5.  Should I provide subheadings and other background information, such as definitions and/or a history? Find Models Use the exercise of reviewing the literature to examine how authors in your discipline or area of interest have composed their literature review sections. Read them to get a sense of the types of themes you might want to look for in your own research or to identify ways to organize your final review. The bibliography or reference section of sources you've already read, such as required readings in the course syllabus, are also excellent entry points into your own research. Narrow the Topic The narrower your topic, the easier it will be to limit the number of sources you need to read in order to obtain a good survey of relevant resources. Your professor will probably not expect you to read everything that's available about the topic, but you'll make the act of reviewing easier if you first limit scope of the research problem. A good strategy is to begin by searching the USC Libraries Catalog for recent books about the topic and review the table of contents for chapters that focuses on specific issues. You can also review the indexes of books to find references to specific issues that can serve as the focus of your research. For example, a book surveying the history of the Israeli-Palestinian conflict may include a chapter on the role Egypt has played in mediating the conflict, or look in the index for the pages where Egypt is mentioned in the text. Consider Whether Your Sources are Current Some disciplines require that you use information that is as current as possible. This is particularly true in disciplines in medicine and the sciences where research conducted becomes obsolete very quickly as new discoveries are made. However, when writing a review in the social sciences, a survey of the history of the literature may be required. In other words, a complete understanding the research problem requires you to deliberately examine how knowledge and perspectives have changed over time. Sort through other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to explore what is considered by scholars to be a "hot topic" and what is not.

III.  Ways to Organize Your Literature Review

Chronology of Events If your review follows the chronological method, you could write about the materials according to when they were published. This approach should only be followed if a clear path of research building on previous research can be identified and that these trends follow a clear chronological order of development. For example, a literature review that focuses on continuing research about the emergence of German economic power after the fall of the Soviet Union. By Publication Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on environmental studies of brown fields if the progression revealed, for example, a change in the soil collection practices of the researchers who wrote and/or conducted the studies. Thematic [“conceptual categories”] A thematic literature review is the most common approach to summarizing prior research in the social and behavioral sciences. Thematic reviews are organized around a topic or issue, rather than the progression of time, although the progression of time may still be incorporated into a thematic review. For example, a review of the Internet’s impact on American presidential politics could focus on the development of online political satire. While the study focuses on one topic, the Internet’s impact on American presidential politics, it would still be organized chronologically reflecting technological developments in media. The difference in this example between a "chronological" and a "thematic" approach is what is emphasized the most: themes related to the role of the Internet in presidential politics. Note that more authentic thematic reviews tend to break away from chronological order. A review organized in this manner would shift between time periods within each section according to the point being made. Methodological A methodological approach focuses on the methods utilized by the researcher. For the Internet in American presidential politics project, one methodological approach would be to look at cultural differences between the portrayal of American presidents on American, British, and French websites. Or the review might focus on the fundraising impact of the Internet on a particular political party. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed.

Other Sections of Your Literature Review Once you've decided on the organizational method for your literature review, the sections you need to include in the paper should be easy to figure out because they arise from your organizational strategy. In other words, a chronological review would have subsections for each vital time period; a thematic review would have subtopics based upon factors that relate to the theme or issue. However, sometimes you may need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. However, only include what is necessary for the reader to locate your study within the larger scholarship about the research problem.

Here are examples of other sections, usually in the form of a single paragraph, you may need to include depending on the type of review you write:

  • Current Situation : Information necessary to understand the current topic or focus of the literature review.
  • Sources Used : Describes the methods and resources [e.g., databases] you used to identify the literature you reviewed.
  • History : The chronological progression of the field, the research literature, or an idea that is necessary to understand the literature review, if the body of the literature review is not already a chronology.
  • Selection Methods : Criteria you used to select (and perhaps exclude) sources in your literature review. For instance, you might explain that your review includes only peer-reviewed [i.e., scholarly] sources.
  • Standards : Description of the way in which you present your information.
  • Questions for Further Research : What questions about the field has the review sparked? How will you further your research as a result of the review?

IV.  Writing Your Literature Review

Once you've settled on how to organize your literature review, you're ready to write each section. When writing your review, keep in mind these issues.

Use Evidence A literature review section is, in this sense, just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence [citations] that demonstrates that what you are saying is valid. Be Selective Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the research problem, whether it is thematic, methodological, or chronological. Related items that provide additional information, but that are not key to understanding the research problem, can be included in a list of further readings . Use Quotes Sparingly Some short quotes are appropriate if you want to emphasize a point, or if what an author stated cannot be easily paraphrased. Sometimes you may need to quote certain terminology that was coined by the author, is not common knowledge, or taken directly from the study. Do not use extensive quotes as a substitute for using your own words in reviewing the literature. Summarize and Synthesize Remember to summarize and synthesize your sources within each thematic paragraph as well as throughout the review. Recapitulate important features of a research study, but then synthesize it by rephrasing the study's significance and relating it to your own work and the work of others. Keep Your Own Voice While the literature review presents others' ideas, your voice [the writer's] should remain front and center. For example, weave references to other sources into what you are writing but maintain your own voice by starting and ending the paragraph with your own ideas and wording. Use Caution When Paraphrasing When paraphrasing a source that is not your own, be sure to represent the author's information or opinions accurately and in your own words. Even when paraphrasing an author’s work, you still must provide a citation to that work.

V.  Common Mistakes to Avoid

These are the most common mistakes made in reviewing social science research literature.

  • Sources in your literature review do not clearly relate to the research problem;
  • You do not take sufficient time to define and identify the most relevant sources to use in the literature review related to the research problem;
  • Relies exclusively on secondary analytical sources rather than including relevant primary research studies or data;
  • Uncritically accepts another researcher's findings and interpretations as valid, rather than examining critically all aspects of the research design and analysis;
  • Does not describe the search procedures that were used in identifying the literature to review;
  • Reports isolated statistical results rather than synthesizing them in chi-squared or meta-analytic methods; and,
  • Only includes research that validates assumptions and does not consider contrary findings and alternative interpretations found in the literature.

Cook, Kathleen E. and Elise Murowchick. “Do Literature Review Skills Transfer from One Course to Another?” Psychology Learning and Teaching 13 (March 2014): 3-11; Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . London: SAGE, 2011; Literature Review Handout. Online Writing Center. Liberty University; Literature Reviews. The Writing Center. University of North Carolina; Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: SAGE, 2016; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012; Randolph, Justus J. “A Guide to Writing the Dissertation Literature Review." Practical Assessment, Research, and Evaluation. vol. 14, June 2009; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016; Taylor, Dena. The Literature Review: A Few Tips On Conducting It. University College Writing Centre. University of Toronto; Writing a Literature Review. Academic Skills Centre. University of Canberra.

Writing Tip

Break Out of Your Disciplinary Box!

Thinking interdisciplinarily about a research problem can be a rewarding exercise in applying new ideas, theories, or concepts to an old problem. For example, what might cultural anthropologists say about the continuing conflict in the Middle East? In what ways might geographers view the need for better distribution of social service agencies in large cities than how social workers might study the issue? You don’t want to substitute a thorough review of core research literature in your discipline for studies conducted in other fields of study. However, particularly in the social sciences, thinking about research problems from multiple vectors is a key strategy for finding new solutions to a problem or gaining a new perspective. Consult with a librarian about identifying research databases in other disciplines; almost every field of study has at least one comprehensive database devoted to indexing its research literature.

Frodeman, Robert. The Oxford Handbook of Interdisciplinarity . New York: Oxford University Press, 2010.

Another Writing Tip

Don't Just Review for Content!

While conducting a review of the literature, maximize the time you devote to writing this part of your paper by thinking broadly about what you should be looking for and evaluating. Review not just what scholars are saying, but how are they saying it. Some questions to ask:

  • How are they organizing their ideas?
  • What methods have they used to study the problem?
  • What theories have been used to explain, predict, or understand their research problem?
  • What sources have they cited to support their conclusions?
  • How have they used non-textual elements [e.g., charts, graphs, figures, etc.] to illustrate key points?

When you begin to write your literature review section, you'll be glad you dug deeper into how the research was designed and constructed because it establishes a means for developing more substantial analysis and interpretation of the research problem.

Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1 998.

Yet Another Writing Tip

When Do I Know I Can Stop Looking and Move On?

Here are several strategies you can utilize to assess whether you've thoroughly reviewed the literature:

  • Look for repeating patterns in the research findings . If the same thing is being said, just by different people, then this likely demonstrates that the research problem has hit a conceptual dead end. At this point consider: Does your study extend current research?  Does it forge a new path? Or, does is merely add more of the same thing being said?
  • Look at sources the authors cite to in their work . If you begin to see the same researchers cited again and again, then this is often an indication that no new ideas have been generated to address the research problem.
  • Search Google Scholar to identify who has subsequently cited leading scholars already identified in your literature review [see next sub-tab]. This is called citation tracking and there are a number of sources that can help you identify who has cited whom, particularly scholars from outside of your discipline. Here again, if the same authors are being cited again and again, this may indicate no new literature has been written on the topic.

Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: Sage, 2016; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.

  • << Previous: Theoretical Framework
  • Next: Citation Tracking >>
  • Last Updated: Apr 22, 2024 9:12 AM
  • URL: https://libguides.usc.edu/writingguide

Research Methods

  • Getting Started
  • Literature Review Research
  • Research Design
  • Research Design By Discipline
  • SAGE Research Methods
  • Teaching with SAGE Research Methods

Literature Review

  • What is a Literature Review?
  • What is NOT a Literature Review?
  • Purposes of a Literature Review
  • Types of Literature Reviews
  • Literature Reviews vs. Systematic Reviews
  • Systematic vs. Meta-Analysis

Literature Review  is a comprehensive survey of the works published in a particular field of study or line of research, usually over a specific period of time, in the form of an in-depth, critical bibliographic essay or annotated list in which attention is drawn to the most significant works.

Also, we can define a literature review as the collected body of scholarly works related to a topic:

  • Summarizes and analyzes previous research relevant to a topic
  • Includes scholarly books and articles published in academic journals
  • Can be an specific scholarly paper or a section in a research paper

The objective of a Literature Review is to find previous published scholarly works relevant to an specific topic

  • Help gather ideas or information
  • Keep up to date in current trends and findings
  • Help develop new questions

A literature review is important because it:

  • Explains the background of research on a topic.
  • Demonstrates why a topic is significant to a subject area.
  • Helps focus your own research questions or problems
  • Discovers relationships between research studies/ideas.
  • Suggests unexplored ideas or populations
  • Identifies major themes, concepts, and researchers on a topic.
  • Tests assumptions; may help counter preconceived ideas and remove unconscious bias.
  • Identifies critical gaps, points of disagreement, or potentially flawed methodology or theoretical approaches.
  • Indicates potential directions for future research.

All content in this section is from Literature Review Research from Old Dominion University 

Keep in mind the following, a literature review is NOT:

Not an essay 

Not an annotated bibliography  in which you summarize each article that you have reviewed.  A literature review goes beyond basic summarizing to focus on the critical analysis of the reviewed works and their relationship to your research question.

Not a research paper   where you select resources to support one side of an issue versus another.  A lit review should explain and consider all sides of an argument in order to avoid bias, and areas of agreement and disagreement should be highlighted.

A literature review serves several purposes. For example, it

  • provides thorough knowledge of previous studies; introduces seminal works.
  • helps focus one’s own research topic.
  • identifies a conceptual framework for one’s own research questions or problems; indicates potential directions for future research.
  • suggests previously unused or underused methodologies, designs, quantitative and qualitative strategies.
  • identifies gaps in previous studies; identifies flawed methodologies and/or theoretical approaches; avoids replication of mistakes.
  • helps the researcher avoid repetition of earlier research.
  • suggests unexplored populations.
  • determines whether past studies agree or disagree; identifies controversy in the literature.
  • tests assumptions; may help counter preconceived ideas and remove unconscious bias.

As Kennedy (2007) notes*, it is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the original studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally that become part of the lore of field. In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews.

Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are several approaches to how they can be done, depending upon the type of analysis underpinning your study. Listed below are definitions of types of literature reviews:

Argumentative Review      This form examines literature selectively in order to support or refute an argument, deeply imbedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to to make summary claims of the sort found in systematic reviews.

Integrative Review      Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication.

Historical Review      Few things rest in isolation from historical precedent. Historical reviews are focused on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.

Methodological Review      A review does not always focus on what someone said [content], but how they said it [method of analysis]. This approach provides a framework of understanding at different levels (i.e. those of theory, substantive fields, research approaches and data collection and analysis techniques), enables researchers to draw on a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection and data analysis, and helps highlight many ethical issues which we should be aware of and consider as we go through our study.

Systematic Review      This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyse data from the studies that are included in the review. Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?"

Theoretical Review      The purpose of this form is to concretely examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review help establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.

* Kennedy, Mary M. "Defining a Literature."  Educational Researcher  36 (April 2007): 139-147.

All content in this section is from The Literature Review created by Dr. Robert Larabee USC

Robinson, P. and Lowe, J. (2015),  Literature reviews vs systematic reviews.  Australian and New Zealand Journal of Public Health, 39: 103-103. doi: 10.1111/1753-6405.12393

what is variable in literature review

What's in the name? The difference between a Systematic Review and a Literature Review, and why it matters . By Lynn Kysh from University of Southern California

what is variable in literature review

Systematic review or meta-analysis?

A  systematic review  answers a defined research question by collecting and summarizing all empirical evidence that fits pre-specified eligibility criteria.

A  meta-analysis  is the use of statistical methods to summarize the results of these studies.

Systematic reviews, just like other research articles, can be of varying quality. They are a significant piece of work (the Centre for Reviews and Dissemination at York estimates that a team will take 9-24 months), and to be useful to other researchers and practitioners they should have:

  • clearly stated objectives with pre-defined eligibility criteria for studies
  • explicit, reproducible methodology
  • a systematic search that attempts to identify all studies
  • assessment of the validity of the findings of the included studies (e.g. risk of bias)
  • systematic presentation, and synthesis, of the characteristics and findings of the included studies

Not all systematic reviews contain meta-analysis. 

Meta-analysis is the use of statistical methods to summarize the results of independent studies. By combining information from all relevant studies, meta-analysis can provide more precise estimates of the effects of health care than those derived from the individual studies included within a review.  More information on meta-analyses can be found in  Cochrane Handbook, Chapter 9 .

A meta-analysis goes beyond critique and integration and conducts secondary statistical analysis on the outcomes of similar studies.  It is a systematic review that uses quantitative methods to synthesize and summarize the results.

An advantage of a meta-analysis is the ability to be completely objective in evaluating research findings.  Not all topics, however, have sufficient research evidence to allow a meta-analysis to be conducted.  In that case, an integrative review is an appropriate strategy. 

Some of the content in this section is from Systematic reviews and meta-analyses: step by step guide created by Kate McAllister.

  • << Previous: Getting Started
  • Next: Research Design >>
  • Last Updated: Aug 21, 2023 4:07 PM
  • URL: https://guides.lib.udel.edu/researchmethods

University of Texas

  • University of Texas Libraries

Literature Reviews

  • What is a literature review?
  • Steps in the Literature Review Process
  • Define your research question
  • Determine inclusion and exclusion criteria
  • Choose databases and search
  • Review Results
  • Synthesize Results
  • Analyze Results
  • Librarian Support

What is a Literature Review?

A literature or narrative review is a comprehensive review and analysis of the published literature on a specific topic or research question. The literature that is reviewed contains: books, articles, academic articles, conference proceedings, association papers, and dissertations. It contains the most pertinent studies and points to important past and current research and practices. It provides background and context, and shows how your research will contribute to the field. 

A literature review should: 

  • Provide a comprehensive and updated review of the literature;
  • Explain why this review has taken place;
  • Articulate a position or hypothesis;
  • Acknowledge and account for conflicting and corroborating points of view

From  S age Research Methods

Purpose of a Literature Review

A literature review can be written as an introduction to a study to:

  • Demonstrate how a study fills a gap in research
  • Compare a study with other research that's been done

Or it can be a separate work (a research article on its own) which:

  • Organizes or describes a topic
  • Describes variables within a particular issue/problem

Limitations of a Literature Review

Some of the limitations of a literature review are:

  • It's a snapshot in time. Unlike other reviews, this one has beginning, a middle and an end. There may be future developments that could make your work less relevant.
  • It may be too focused. Some niche studies may miss the bigger picture.
  • It can be difficult to be comprehensive. There is no way to make sure all the literature on a topic was considered.
  • It is easy to be biased if you stick to top tier journals. There may be other places where people are publishing exemplary research. Look to open access publications and conferences to reflect a more inclusive collection. Also, make sure to include opposing views (and not just supporting evidence).

Source: Grant, Maria J., and Andrew Booth. “A Typology of Reviews: An Analysis of 14 Review Types and Associated Methodologies.” Health Information & Libraries Journal, vol. 26, no. 2, June 2009, pp. 91–108. Wiley Online Library, doi:10.1111/j.1471-1842.2009.00848.x.

Meryl Brodsky : Communication and Information Studies

Hannah Chapman Tripp : Biology, Neuroscience

Carolyn Cunningham : Human Development & Family Sciences, Psychology, Sociology

Larayne Dallas : Engineering

Janelle Hedstrom : Special Education, Curriculum & Instruction, Ed Leadership & Policy ​

Susan Macicak : Linguistics

Imelda Vetter : Dell Medical School

For help in other subject areas, please see the guide to library specialists by subject .

Periodically, UT Libraries runs a workshop covering the basics and library support for literature reviews. While we try to offer these once per academic year, we find providing the recording to be helpful to community members who have missed the session. Following is the most recent recording of the workshop, Conducting a Literature Review. To view the recording, a UT login is required.

  • October 26, 2022 recording
  • Last Updated: Oct 26, 2022 2:49 PM
  • URL: https://guides.lib.utexas.edu/literaturereviews

Creative Commons License

Benedictine University Library

Literature Review: What is a Literature Review?

  • Sample Searches
  • Examples of Published Literature Reviews
  • Researching Your Topic
  • Subject Searching
  • Google Scholar
  • Track Your Work
  • Citation Managers This link opens in a new window
  • Citation Guides This link opens in a new window
  • Tips on Writing Your Literature Review This link opens in a new window
  • Research Help

Guide Author

Profile Photo

Virtual Outreach Librarian

Ask a Librarian

Chat with a Librarian

Lisle: (630) 829-6057 Mesa: (480) 878-7514 Toll Free: (877) 575-6050 Email: [email protected]

Book a Research Consultation Library Hours

Facebook

Not Just for Graduate Students!

A literature review is an in-depth critical analysis of published scholarly research related to a specific topic. Published scholarly research (the "literature") may include journal articles, books, book chapters, dissertations and thesis, or conference proceedings. 

A solid lit review must:

  • be organized around and related directly to the thesis or research question you're developing
  • synthesize results into a summary of what is and is not known
  • identify areas of controversy in the literature
  • formulate questions that need further research

Why Conduct a Literature Review?

  • to distinguish what has been done from what needs to be done
  • to discover important variables relevant to the topic
  • to synthesize and gain new perspective
  • to identify relationships between ideas and practices
  • to establish the context of the topic
  • to rationalize the significance of the problem
  • to enhance and acquire subject vocabulary
  • to understand the structure of the subject
  • tp relate ideas and theory to applications
  • to identify main methodologies and research techniques that have been used
  • to place research in a historical context to show familiarity with state-of-art development

Questions to Consider

  • What is the overarching question or problem your literature review seeks to address?
  • How much familiarity do you already have with the field? Are you already familiar with common methodologies or professional vocabularies?
  • What types of strategies or questions have others in your field pursued?
  • How will you synthesize or summarize the information you gather?
  • What do you or others perceive to be lacking in your field?
  • Is your topic broad? How could it be narrowed?
  • Can you articulate why your topic is important in your field?
  • Next: Sample Searches >>
  • Last Updated: Feb 27, 2023 2:09 PM
  • URL: https://researchguides.ben.edu/lit-review

Kindlon Hall 5700 College Rd. Lisle, IL 60532 (630) 829-6050

Gillett Hall 225 E. Main St. Mesa, AZ 85201 (480) 878-7514

Instagram

Frequently asked questions

What is a literature review.

A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .

It is often written as part of a dissertation , thesis, research paper , or proposal .

Frequently asked questions: Knowledge Base

Methodology refers to the overarching strategy and rationale of your research. Developing your methodology involves studying the research methods used in your field and the theories or principles that underpin them, in order to choose the approach that best matches your objectives.

Methods are the specific tools and procedures you use to collect and analyse data (e.g. interviews, experiments , surveys , statistical tests ).

In a dissertation or scientific paper, the methodology chapter or methods section comes after the introduction and before the results , discussion and conclusion .

Depending on the length and type of document, you might also include a literature review or theoretical framework before the methodology.

Quantitative research deals with numbers and statistics, while qualitative research deals with words and meanings.

Quantitative methods allow you to test a hypothesis by systematically collecting and analysing data, while qualitative methods allow you to explore ideas and experiences in depth.

Reliability and validity are both about how well a method measures something:

  • Reliability refers to the  consistency of a measure (whether the results can be reproduced under the same conditions).
  • Validity   refers to the  accuracy of a measure (whether the results really do represent what they are supposed to measure).

If you are doing experimental research , you also have to consider the internal and external validity of your experiment.

A sample is a subset of individuals from a larger population. Sampling means selecting the group that you will actually collect data from in your research.

For example, if you are researching the opinions of students in your university, you could survey a sample of 100 students.

Statistical sampling allows you to test a hypothesis about the characteristics of a population. There are various sampling methods you can use to ensure that your sample is representative of the population as a whole.

There are several reasons to conduct a literature review at the beginning of a research project:

  • To familiarise yourself with the current state of knowledge on your topic
  • To ensure that you’re not just repeating what others have already done
  • To identify gaps in knowledge and unresolved problems that your research can address
  • To develop your theoretical framework and methodology
  • To provide an overview of the key findings and debates on the topic

Writing the literature review shows your reader how your work relates to existing research and what new insights it will contribute.

The literature review usually comes near the beginning of your  dissertation . After the introduction , it grounds your research in a scholarly field and leads directly to your theoretical framework or methodology .

Harvard referencing uses an author–date system. Sources are cited by the author’s last name and the publication year in brackets. Each Harvard in-text citation corresponds to an entry in the alphabetised reference list at the end of the paper.

Vancouver referencing uses a numerical system. Sources are cited by a number in parentheses or superscript. Each number corresponds to a full reference at the end of the paper.

A Harvard in-text citation should appear in brackets every time you quote, paraphrase, or refer to information from a source.

The citation can appear immediately after the quotation or paraphrase, or at the end of the sentence. If you’re quoting, place the citation outside of the quotation marks but before any other punctuation like a comma or full stop.

In Harvard referencing, up to three author names are included in an in-text citation or reference list entry. When there are four or more authors, include only the first, followed by ‘ et al. ’

A bibliography should always contain every source you cited in your text. Sometimes a bibliography also contains other sources that you used in your research, but did not cite in the text.

MHRA doesn’t specify a rule about this, so check with your supervisor to find out exactly what should be included in your bibliography.

Footnote numbers should appear in superscript (e.g. 11 ). You can use the ‘Insert footnote’ button in Word to do this automatically; it’s in the ‘References’ tab at the top.

Footnotes always appear after the quote or paraphrase they relate to. MHRA generally recommends placing footnote numbers at the end of the sentence, immediately after any closing punctuation, like this. 12

In situations where this might be awkward or misleading, such as a long sentence containing multiple quotations, footnotes can also be placed at the end of a clause mid-sentence, like this; 13 note that they still come after any punctuation.

When a source has two or three authors, name all of them in your MHRA references . When there are four or more, use only the first name, followed by ‘and others’:

Note that in the bibliography, only the author listed first has their name inverted. The names of additional authors and those of translators or editors are written normally.

A citation should appear wherever you use information or ideas from a source, whether by quoting or paraphrasing its content.

In Vancouver style , you have some flexibility about where the citation number appears in the sentence – usually directly after mentioning the author’s name is best, but simply placing it at the end of the sentence is an acceptable alternative, as long as it’s clear what it relates to.

In Vancouver style , when you refer to a source with multiple authors in your text, you should only name the first author followed by ‘et al.’. This applies even when there are only two authors.

In your reference list, include up to six authors. For sources with seven or more authors, list the first six followed by ‘et al.’.

The words ‘ dissertation ’ and ‘thesis’ both refer to a large written research project undertaken to complete a degree, but they are used differently depending on the country:

  • In the UK, you write a dissertation at the end of a bachelor’s or master’s degree, and you write a thesis to complete a PhD.
  • In the US, it’s the other way around: you may write a thesis at the end of a bachelor’s or master’s degree, and you write a dissertation to complete a PhD.

The main difference is in terms of scale – a dissertation is usually much longer than the other essays you complete during your degree.

Another key difference is that you are given much more independence when working on a dissertation. You choose your own dissertation topic , and you have to conduct the research and write the dissertation yourself (with some assistance from your supervisor).

Dissertation word counts vary widely across different fields, institutions, and levels of education:

  • An undergraduate dissertation is typically 8,000–15,000 words
  • A master’s dissertation is typically 12,000–50,000 words
  • A PhD thesis is typically book-length: 70,000–100,000 words

However, none of these are strict guidelines – your word count may be lower or higher than the numbers stated here. Always check the guidelines provided by your university to determine how long your own dissertation should be.

At the bachelor’s and master’s levels, the dissertation is usually the main focus of your final year. You might work on it (alongside other classes) for the entirety of the final year, or for the last six months. This includes formulating an idea, doing the research, and writing up.

A PhD thesis takes a longer time, as the thesis is the main focus of the degree. A PhD thesis might be being formulated and worked on for the whole four years of the degree program. The writing process alone can take around 18 months.

References should be included in your text whenever you use words, ideas, or information from a source. A source can be anything from a book or journal article to a website or YouTube video.

If you don’t acknowledge your sources, you can get in trouble for plagiarism .

Your university should tell you which referencing style to follow. If you’re unsure, check with a supervisor. Commonly used styles include:

  • Harvard referencing , the most commonly used style in UK universities.
  • MHRA , used in humanities subjects.
  • APA , used in the social sciences.
  • Vancouver , used in biomedicine.
  • OSCOLA , used in law.

Your university may have its own referencing style guide.

If you are allowed to choose which style to follow, we recommend Harvard referencing, as it is a straightforward and widely used style.

To avoid plagiarism , always include a reference when you use words, ideas or information from a source. This shows that you are not trying to pass the work of others off as your own.

You must also properly quote or paraphrase the source. If you’re not sure whether you’ve done this correctly, you can use the Scribbr Plagiarism Checker to find and correct any mistakes.

In Harvard style , when you quote directly from a source that includes page numbers, your in-text citation must include a page number. For example: (Smith, 2014, p. 33).

You can also include page numbers to point the reader towards a passage that you paraphrased . If you refer to the general ideas or findings of the source as a whole, you don’t need to include a page number.

When you want to use a quote but can’t access the original source, you can cite it indirectly. In the in-text citation , first mention the source you want to refer to, and then the source in which you found it. For example:

It’s advisable to avoid indirect citations wherever possible, because they suggest you don’t have full knowledge of the sources you’re citing. Only use an indirect citation if you can’t reasonably gain access to the original source.

In Harvard style referencing , to distinguish between two sources by the same author that were published in the same year, you add a different letter after the year for each source:

  • (Smith, 2019a)
  • (Smith, 2019b)

Add ‘a’ to the first one you cite, ‘b’ to the second, and so on. Do the same in your bibliography or reference list .

To create a hanging indent for your bibliography or reference list :

  • Highlight all the entries
  • Click on the arrow in the bottom-right corner of the ‘Paragraph’ tab in the top menu.
  • In the pop-up window, under ‘Special’ in the ‘Indentation’ section, use the drop-down menu to select ‘Hanging’.
  • Then close the window with ‘OK’.

Though the terms are sometimes used interchangeably, there is a difference in meaning:

  • A reference list only includes sources cited in the text – every entry corresponds to an in-text citation .
  • A bibliography also includes other sources which were consulted during the research but not cited.

It’s important to assess the reliability of information found online. Look for sources from established publications and institutions with expertise (e.g. peer-reviewed journals and government agencies).

The CRAAP test (currency, relevance, authority, accuracy, purpose) can aid you in assessing sources, as can our list of credible sources . You should generally avoid citing websites like Wikipedia that can be edited by anyone – instead, look for the original source of the information in the “References” section.

You can generally omit page numbers in your in-text citations of online sources which don’t have them. But when you quote or paraphrase a specific passage from a particularly long online source, it’s useful to find an alternate location marker.

For text-based sources, you can use paragraph numbers (e.g. ‘para. 4’) or headings (e.g. ‘under “Methodology”’). With video or audio sources, use a timestamp (e.g. ‘10:15’).

In the acknowledgements of your thesis or dissertation, you should first thank those who helped you academically or professionally, such as your supervisor, funders, and other academics.

Then you can include personal thanks to friends, family members, or anyone else who supported you during the process.

Yes, it’s important to thank your supervisor(s) in the acknowledgements section of your thesis or dissertation .

Even if you feel your supervisor did not contribute greatly to the final product, you still should acknowledge them, if only for a very brief thank you. If you do not include your supervisor, it may be seen as a snub.

The acknowledgements are generally included at the very beginning of your thesis or dissertation, directly after the title page and before the abstract .

In a thesis or dissertation, the acknowledgements should usually be no longer than one page. There is no minimum length.

You may acknowledge God in your thesis or dissertation acknowledgements , but be sure to follow academic convention by also thanking the relevant members of academia, as well as family, colleagues, and friends who helped you.

All level 1 and 2 headings should be included in your table of contents . That means the titles of your chapters and the main sections within them.

The contents should also include all appendices and the lists of tables and figures, if applicable, as well as your reference list .

Do not include the acknowledgements or abstract   in the table of contents.

To automatically insert a table of contents in Microsoft Word, follow these steps:

  • Apply heading styles throughout the document.
  • In the references section in the ribbon, locate the Table of Contents group.
  • Click the arrow next to the Table of Contents icon and select Custom Table of Contents.
  • Select which levels of headings you would like to include in the table of contents.

Make sure to update your table of contents if you move text or change headings. To update, simply right click and select Update Field.

The table of contents in a thesis or dissertation always goes between your abstract and your introduction.

An abbreviation is a shortened version of an existing word, such as Dr for Doctor. In contrast, an acronym uses the first letter of each word to create a wholly new word, such as UNESCO (an acronym for the United Nations Educational, Scientific and Cultural Organization).

Your dissertation sometimes contains a list of abbreviations .

As a rule of thumb, write the explanation in full the first time you use an acronym or abbreviation. You can then proceed with the shortened version. However, if the abbreviation is very common (like UK or PC), then you can just use the abbreviated version straight away.

Be sure to add each abbreviation in your list of abbreviations !

If you only used a few abbreviations in your thesis or dissertation, you don’t necessarily need to include a list of abbreviations .

If your abbreviations are numerous, or if you think they won’t be known to your audience, it’s never a bad idea to add one. They can also improve readability, minimising confusion about abbreviations unfamiliar to your reader.

A list of abbreviations is a list of all the abbreviations you used in your thesis or dissertation. It should appear at the beginning of your document, immediately after your table of contents . It should always be in alphabetical order.

Fishbone diagrams have a few different names that are used interchangeably, including herringbone diagram, cause-and-effect diagram, and Ishikawa diagram.

These are all ways to refer to the same thing– a problem-solving approach that uses a fish-shaped diagram to model possible root causes of problems and troubleshoot solutions.

Fishbone diagrams (also called herringbone diagrams, cause-and-effect diagrams, and Ishikawa diagrams) are most popular in fields of quality management. They are also commonly used in nursing and healthcare, or as a brainstorming technique for students.

Some synonyms and near synonyms of among include:

  • In the company of
  • In the middle of
  • Surrounded by

Some synonyms and near synonyms of between  include:

  • In the space separating
  • In the time separating

In spite of   is a preposition used to mean ‘ regardless of ‘, ‘notwithstanding’, or ‘even though’.

It’s always used in a subordinate clause to contrast with the information given in the main clause of a sentence (e.g., ‘Amy continued to watch TV, in spite of the time’).

Despite   is a preposition used to mean ‘ regardless of ‘, ‘notwithstanding’, or ‘even though’.

It’s used in a subordinate clause to contrast with information given in the main clause of a sentence (e.g., ‘Despite the stress, Joe loves his job’).

‘Log in’ is a phrasal verb meaning ‘connect to an electronic device, system, or app’. The preposition ‘to’ is often used directly after the verb; ‘in’ and ‘to’ should be written as two separate words (e.g., ‘ log in to the app to update privacy settings’).

‘Log into’ is sometimes used instead of ‘log in to’, but this is generally considered incorrect (as is ‘login to’).

Some synonyms and near synonyms of ensure include:

  • Make certain

Some synonyms and near synonyms of assure  include:

Rest assured is an expression meaning ‘you can be certain’ (e.g., ‘Rest assured, I will find your cat’). ‘Assured’ is the adjectival form of the verb assure , meaning ‘convince’ or ‘persuade’.

Some synonyms and near synonyms for council include:

There are numerous synonyms and near synonyms for the two meanings of counsel :

AI writing tools can be used to perform a variety of tasks.

Generative AI writing tools (like ChatGPT ) generate text based on human inputs and can be used for interactive learning, to provide feedback, or to generate research questions or outlines.

These tools can also be used to paraphrase or summarise text or to identify grammar and punctuation mistakes. Y ou can also use Scribbr’s free paraphrasing tool , summarising tool , and grammar checker , which are designed specifically for these purposes.

Using AI writing tools (like ChatGPT ) to write your essay is usually considered plagiarism and may result in penalisation, unless it is allowed by your university. Text generated by AI tools is based on existing texts and therefore cannot provide unique insights. Furthermore, these outputs sometimes contain factual inaccuracies or grammar mistakes.

However, AI writing tools can be used effectively as a source of feedback and inspiration for your writing (e.g., to generate research questions ). Other AI tools, like grammar checkers, can help identify and eliminate grammar and punctuation mistakes to enhance your writing.

The Scribbr Knowledge Base is a collection of free resources to help you succeed in academic research, writing, and citation. Every week, we publish helpful step-by-step guides, clear examples, simple templates, engaging videos, and more.

The Knowledge Base is for students at all levels. Whether you’re writing your first essay, working on your bachelor’s or master’s dissertation, or getting to grips with your PhD research, we’ve got you covered.

As well as the Knowledge Base, Scribbr provides many other tools and services to support you in academic writing and citation:

  • Create your citations and manage your reference list with our free Reference Generators in APA and MLA style.
  • Scan your paper for in-text citation errors and inconsistencies with our innovative APA Citation Checker .
  • Avoid accidental plagiarism with our reliable Plagiarism Checker .
  • Polish your writing and get feedback on structure and clarity with our Proofreading & Editing services .

Yes! We’re happy for educators to use our content, and we’ve even adapted some of our articles into ready-made lecture slides .

You are free to display, distribute, and adapt Scribbr materials in your classes or upload them in private learning environments like Blackboard. We only ask that you credit Scribbr for any content you use.

We’re always striving to improve the Knowledge Base. If you have an idea for a topic we should cover, or you notice a mistake in any of our articles, let us know by emailing [email protected] .

The consequences of plagiarism vary depending on the type of plagiarism and the context in which it occurs. For example, submitting a whole paper by someone else will have the most severe consequences, while accidental citation errors are considered less serious.

If you’re a student, then you might fail the course, be suspended or expelled, or be obligated to attend a workshop on plagiarism. It depends on whether it’s your first offence or you’ve done it before.

As an academic or professional, plagiarising seriously damages your reputation. You might also lose your research funding or your job, and you could even face legal consequences for copyright infringement.

Paraphrasing without crediting the original author is a form of plagiarism , because you’re presenting someone else’s ideas as if they were your own.

However, paraphrasing is not plagiarism if you correctly reference the source . This means including an in-text referencing and a full reference , formatted according to your required citation style (e.g., Harvard , Vancouver ).

As well as referencing your source, make sure that any paraphrased text is completely rewritten in your own words.

Accidental plagiarism is one of the most common examples of plagiarism . Perhaps you forgot to cite a source, or paraphrased something a bit too closely. Maybe you can’t remember where you got an idea from, and aren’t totally sure if it’s original or not.

These all count as plagiarism, even though you didn’t do it on purpose. When in doubt, make sure you’re citing your sources . Also consider running your work through a plagiarism checker tool prior to submission, which work by using advanced database software to scan for matches between your text and existing texts.

Scribbr’s Plagiarism Checker takes less than 10 minutes and can help you turn in your paper with confidence.

The accuracy depends on the plagiarism checker you use. Per our in-depth research , Scribbr is the most accurate plagiarism checker. Many free plagiarism checkers fail to detect all plagiarism or falsely flag text as plagiarism.

Plagiarism checkers work by using advanced database software to scan for matches between your text and existing texts. Their accuracy is determined by two factors: the algorithm (which recognises the plagiarism) and the size of the database (with which your document is compared).

To avoid plagiarism when summarising an article or other source, follow these two rules:

  • Write the summary entirely in your own words by   paraphrasing the author’s ideas.
  • Reference the source with an in-text citation and a full reference so your reader can easily find the original text.

Plagiarism can be detected by your professor or readers if the tone, formatting, or style of your text is different in different parts of your paper, or if they’re familiar with the plagiarised source.

Many universities also use   plagiarism detection software like Turnitin’s, which compares your text to a large database of other sources, flagging any similarities that come up.

It can be easier than you think to commit plagiarism by accident. Consider using a   plagiarism checker prior to submitting your essay to ensure you haven’t missed any citations.

Some examples of plagiarism include:

  • Copying and pasting a Wikipedia article into the body of an assignment
  • Quoting a source without including a citation
  • Not paraphrasing a source properly (e.g. maintaining wording too close to the original)
  • Forgetting to cite the source of an idea

The most surefire way to   avoid plagiarism is to always cite your sources . When in doubt, cite!

Global plagiarism means taking an entire work written by someone else and passing it off as your own. This can include getting someone else to write an essay or assignment for you, or submitting a text you found online as your own work.

Global plagiarism is one of the most serious types of plagiarism because it involves deliberately and directly lying about the authorship of a work. It can have severe consequences for students and professionals alike.

Verbatim plagiarism means copying text from a source and pasting it directly into your own document without giving proper credit.

If the structure and the majority of the words are the same as in the original source, then you are committing verbatim plagiarism. This is the case even if you delete a few words or replace them with synonyms.

If you want to use an author’s exact words, you need to quote the original source by putting the copied text in quotation marks and including an   in-text citation .

Patchwork plagiarism , also called mosaic plagiarism, means copying phrases, passages, or ideas from various existing sources and combining them to create a new text. This includes slightly rephrasing some of the content, while keeping many of the same words and the same structure as the original.

While this type of plagiarism is more insidious than simply copying and pasting directly from a source, plagiarism checkers like Turnitin’s can still easily detect it.

To avoid plagiarism in any form, remember to reference your sources .

Yes, reusing your own work without citation is considered self-plagiarism . This can range from resubmitting an entire assignment to reusing passages or data from something you’ve handed in previously.

Self-plagiarism often has the same consequences as other types of plagiarism . If you want to reuse content you wrote in the past, make sure to check your university’s policy or consult your professor.

If you are reusing content or data you used in a previous assignment, make sure to cite yourself. You can cite yourself the same way you would cite any other source: simply follow the directions for the citation style you are using.

Keep in mind that reusing prior content can be considered self-plagiarism , so make sure you ask your instructor or consult your university’s handbook prior to doing so.

Most institutions have an internal database of previously submitted student assignments. Turnitin can check for self-plagiarism by comparing your paper against this database. If you’ve reused parts of an assignment you already submitted, it will flag any similarities as potential plagiarism.

Online plagiarism checkers don’t have access to your institution’s database, so they can’t detect self-plagiarism of unpublished work. If you’re worried about accidentally self-plagiarising, you can use Scribbr’s Self-Plagiarism Checker to upload your unpublished documents and check them for similarities.

Plagiarism has serious consequences and can be illegal in certain scenarios.

While most of the time plagiarism in an undergraduate setting is not illegal, plagiarism or self-plagiarism in a professional academic setting can lead to legal action, including copyright infringement and fraud. Many scholarly journals do not allow you to submit the same work to more than one journal, and if you do not credit a coauthor, you could be legally defrauding them.

Even if you aren’t breaking the law, plagiarism can seriously impact your academic career. While the exact consequences of plagiarism vary by institution and severity, common consequences include a lower grade, automatically failing a course, academic suspension or probation, and even expulsion.

Self-plagiarism means recycling work that you’ve previously published or submitted as an assignment. It’s considered academic dishonesty to present something as brand new when you’ve already gotten credit and perhaps feedback for it in the past.

If you want to refer to ideas or data from previous work, be sure to cite yourself.

Academic integrity means being honest, ethical, and thorough in your academic work. To maintain academic integrity, you should avoid misleading your readers about any part of your research and refrain from offences like plagiarism and contract cheating, which are examples of academic misconduct.

Academic dishonesty refers to deceitful or misleading behavior in an academic setting. Academic dishonesty can occur intentionally or unintentionally, and it varies in severity.

It can encompass paying for a pre-written essay, cheating on an exam, or committing plagiarism . It can also include helping others cheat, copying a friend’s homework answers, or even pretending to be sick to miss an exam.

Academic dishonesty doesn’t just occur in a classroom setting, but also in research and other academic-adjacent fields.

Consequences of academic dishonesty depend on the severity of the offence and your institution’s policy. They can range from a warning for a first offence to a failing grade in a course to expulsion from your university.

For those in certain fields, such as nursing, engineering, or lab sciences, not learning fundamentals properly can directly impact the health and safety of others. For those working in academia or research, academic dishonesty impacts your professional reputation, leading others to doubt your future work.

Academic dishonesty can be intentional or unintentional, ranging from something as simple as claiming to have read something you didn’t to copying your neighbour’s answers on an exam.

You can commit academic dishonesty with the best of intentions, such as helping a friend cheat on a paper. Severe academic dishonesty can include buying a pre-written essay or the answers to a multiple-choice test, or falsifying a medical emergency to avoid taking a final exam.

Plagiarism means presenting someone else’s work as your own without giving proper credit to the original author. In academic writing, plagiarism involves using words, ideas, or information from a source without including a citation .

Plagiarism can have serious consequences , even when it’s done accidentally. To avoid plagiarism, it’s important to keep track of your sources and cite them correctly.

Common knowledge does not need to be cited. However, you should be extra careful when deciding what counts as common knowledge.

Common knowledge encompasses information that the average educated reader would accept as true without needing the extra validation of a source or citation.

Common knowledge should be widely known, undisputed, and easily verified. When in doubt, always cite your sources.

Most online plagiarism checkers only have access to public databases, whose software doesn’t allow you to compare two documents for plagiarism.

However, in addition to our Plagiarism Checker , Scribbr also offers an Self-Plagiarism Checker . This is an add-on tool that lets you compare your paper with unpublished or private documents. This way you can rest assured that you haven’t unintentionally plagiarised or self-plagiarised .

Compare two sources for plagiarism

Rapport begrijpen OSC

The research methods you use depend on the type of data you need to answer your research question .

  • If you want to measure something or test a hypothesis , use quantitative methods . If you want to explore ideas, thoughts, and meanings, use qualitative methods .
  • If you want to analyse a large amount of readily available data, use secondary data. If you want data specific to your purposes with control over how they are generated, collect primary data.
  • If you want to establish cause-and-effect relationships between variables , use experimental methods. If you want to understand the characteristics of a research subject, use descriptive methods.

Methodology refers to the overarching strategy and rationale of your research project . It involves studying the methods used in your field and the theories or principles behind them, in order to develop an approach that matches your objectives.

Methods are the specific tools and procedures you use to collect and analyse data (e.g. experiments, surveys , and statistical tests ).

In shorter scientific papers, where the aim is to report the findings of a specific study, you might simply describe what you did in a methods section .

In a longer or more complex research project, such as a thesis or dissertation , you will probably include a methodology section , where you explain your approach to answering the research questions and cite relevant sources to support your choice of methods.

In mixed methods research , you use both qualitative and quantitative data collection and analysis methods to answer your research question .

Data collection is the systematic process by which observations or measurements are gathered in research. It is used in many different contexts by academics, governments, businesses, and other organisations.

There are various approaches to qualitative data analysis , but they all share five steps in common:

  • Prepare and organise your data.
  • Review and explore your data.
  • Develop a data coding system.
  • Assign codes to the data.
  • Identify recurring themes.

The specifics of each step depend on the focus of the analysis. Some common approaches include textual analysis , thematic analysis , and discourse analysis .

There are five common approaches to qualitative research :

  • Grounded theory involves collecting data in order to develop new theories.
  • Ethnography involves immersing yourself in a group or organisation to understand its culture.
  • Narrative research involves interpreting stories to understand how people make sense of their experiences and perceptions.
  • Phenomenological research involves investigating phenomena through people’s lived experiences.
  • Action research links theory and practice in several cycles to drive innovative changes.

Hypothesis testing is a formal procedure for investigating our ideas about the world using statistics. It is used by scientists to test specific predictions, called hypotheses , by calculating how likely it is that a pattern or relationship between variables could have arisen by chance.

Operationalisation means turning abstract conceptual ideas into measurable observations.

For example, the concept of social anxiety isn’t directly observable, but it can be operationally defined in terms of self-rating scores, behavioural avoidance of crowded places, or physical anxiety symptoms in social situations.

Before collecting data , it’s important to consider how you will operationalise the variables that you want to measure.

Triangulation in research means using multiple datasets, methods, theories and/or investigators to address a research question. It’s a research strategy that can help you enhance the validity and credibility of your findings.

Triangulation is mainly used in qualitative research , but it’s also commonly applied in quantitative research . Mixed methods research always uses triangulation.

These are four of the most common mixed methods designs :

  • Convergent parallel: Quantitative and qualitative data are collected at the same time and analysed separately. After both analyses are complete, compare your results to draw overall conclusions. 
  • Embedded: Quantitative and qualitative data are collected at the same time, but within a larger quantitative or qualitative design. One type of data is secondary to the other.
  • Explanatory sequential: Quantitative data is collected and analysed first, followed by qualitative data. You can use this design if you think your qualitative data will explain and contextualise your quantitative findings.
  • Exploratory sequential: Qualitative data is collected and analysed first, followed by quantitative data. You can use this design if you think the quantitative data will confirm or validate your qualitative findings.

An observational study could be a good fit for your research if your research question is based on things you observe. If you have ethical, logistical, or practical concerns that make an experimental design challenging, consider an observational study. Remember that in an observational study, it is critical that there be no interference or manipulation of the research subjects. Since it’s not an experiment, there are no control or treatment groups either.

The key difference between observational studies and experiments is that, done correctly, an observational study will never influence the responses or behaviours of participants. Experimental designs will have a treatment condition applied to at least a portion of participants.

Exploratory research explores the main aspects of a new or barely researched question.

Explanatory research explains the causes and effects of an already widely researched question.

Experimental designs are a set of procedures that you plan in order to examine the relationship between variables that interest you.

To design a successful experiment, first identify:

  • A testable hypothesis
  • One or more independent variables that you will manipulate
  • One or more dependent variables that you will measure

When designing the experiment, first decide:

  • How your variable(s) will be manipulated
  • How you will control for any potential confounding or lurking variables
  • How many subjects you will include
  • How you will assign treatments to your subjects

There are four main types of triangulation :

  • Data triangulation : Using data from different times, spaces, and people
  • Investigator triangulation : Involving multiple researchers in collecting or analysing data
  • Theory triangulation : Using varying theoretical perspectives in your research
  • Methodological triangulation : Using different methodologies to approach the same topic

Triangulation can help:

  • Reduce bias that comes from using a single method, theory, or investigator
  • Enhance validity by approaching the same topic with different tools
  • Establish credibility by giving you a complete picture of the research problem

But triangulation can also pose problems:

  • It’s time-consuming and labour-intensive, often involving an interdisciplinary team.
  • Your results may be inconsistent or even contradictory.

A confounding variable , also called a confounder or confounding factor, is a third variable in a study examining a potential cause-and-effect relationship.

A confounding variable is related to both the supposed cause and the supposed effect of the study. It can be difficult to separate the true effect of the independent variable from the effect of the confounding variable.

In your research design , it’s important to identify potential confounding variables and plan how you will reduce their impact.

In a between-subjects design , every participant experiences only one condition, and researchers assess group differences between participants in various conditions.

In a within-subjects design , each participant experiences all conditions, and researchers test the same participants repeatedly for differences between conditions.

The word ‘between’ means that you’re comparing different conditions between groups, while the word ‘within’ means you’re comparing different conditions within the same group.

A quasi-experiment is a type of research design that attempts to establish a cause-and-effect relationship. The main difference between this and a true experiment is that the groups are not randomly assigned.

In experimental research, random assignment is a way of placing participants from your sample into different groups using randomisation. With this method, every member of the sample has a known or equal chance of being placed in a control group or an experimental group.

Quasi-experimental design is most useful in situations where it would be unethical or impractical to run a true experiment .

Quasi-experiments have lower internal validity than true experiments, but they often have higher external validity  as they can use real-world interventions instead of artificial laboratory settings.

Within-subjects designs have many potential threats to internal validity , but they are also very statistically powerful .

Advantages:

  • Only requires small samples
  • Statistically powerful
  • Removes the effects of individual differences on the outcomes

Disadvantages:

  • Internal validity threats reduce the likelihood of establishing a direct relationship between variables
  • Time-related effects, such as growth, can influence the outcomes
  • Carryover effects mean that the specific order of different treatments affect the outcomes

Yes. Between-subjects and within-subjects designs can be combined in a single study when you have two or more independent variables (a factorial design). In a mixed factorial design, one variable is altered between subjects and another is altered within subjects.

In a factorial design, multiple independent variables are tested.

If you test two variables, each level of one independent variable is combined with each level of the other independent variable to create different conditions.

While a between-subjects design has fewer threats to internal validity , it also requires more participants for high statistical power than a within-subjects design .

  • Prevents carryover effects of learning and fatigue.
  • Shorter study duration.
  • Needs larger samples for high power.
  • Uses more resources to recruit participants, administer sessions, cover costs, etc.
  • Individual differences may be an alternative explanation for results.

Samples are used to make inferences about populations . Samples are easier to collect data from because they are practical, cost-effective, convenient, and manageable.

Probability sampling means that every member of the target population has a known chance of being included in the sample.

Probability sampling methods include simple random sampling , systematic sampling , stratified sampling , and cluster sampling .

In non-probability sampling , the sample is selected based on non-random criteria, and not every member of the population has a chance of being included.

Common non-probability sampling methods include convenience sampling , voluntary response sampling, purposive sampling , snowball sampling , and quota sampling .

In multistage sampling , or multistage cluster sampling, you draw a sample from a population using smaller and smaller groups at each stage.

This method is often used to collect data from a large, geographically spread group of people in national surveys, for example. You take advantage of hierarchical groupings (e.g., from county to city to neighbourhood) to create a sample that’s less expensive and time-consuming to collect data from.

Sampling bias occurs when some members of a population are systematically more likely to be selected in a sample than others.

Simple random sampling is a type of probability sampling in which the researcher randomly selects a subset of participants from a population . Each member of the population has an equal chance of being selected. Data are then collected from as large a percentage as possible of this random subset.

The American Community Survey  is an example of simple random sampling . In order to collect detailed data on the population of the US, the Census Bureau officials randomly select 3.5 million households per year and use a variety of methods to convince them to fill out the survey.

If properly implemented, simple random sampling is usually the best sampling method for ensuring both internal and external validity . However, it can sometimes be impractical and expensive to implement, depending on the size of the population to be studied,

If you have a list of every member of the population and the ability to reach whichever members are selected, you can use simple random sampling.

Cluster sampling is more time- and cost-efficient than other probability sampling methods , particularly when it comes to large samples spread across a wide geographical area.

However, it provides less statistical certainty than other methods, such as simple random sampling , because it is difficult to ensure that your clusters properly represent the population as a whole.

There are three types of cluster sampling : single-stage, double-stage and multi-stage clustering. In all three types, you first divide the population into clusters, then randomly select clusters for use in your sample.

  • In single-stage sampling , you collect data from every unit within the selected clusters.
  • In double-stage sampling , you select a random sample of units from within the clusters.
  • In multi-stage sampling , you repeat the procedure of randomly sampling elements from within the clusters until you have reached a manageable sample.

Cluster sampling is a probability sampling method in which you divide a population into clusters, such as districts or schools, and then randomly select some of these clusters as your sample.

The clusters should ideally each be mini-representations of the population as a whole.

In multistage sampling , you can use probability or non-probability sampling methods.

For a probability sample, you have to probability sampling at every stage. You can mix it up by using simple random sampling , systematic sampling , or stratified sampling to select units at different stages, depending on what is applicable and relevant to your study.

Multistage sampling can simplify data collection when you have large, geographically spread samples, and you can obtain a probability sample without a complete sampling frame.

But multistage sampling may not lead to a representative sample, and larger samples are needed for multistage samples to achieve the statistical properties of simple random samples .

In stratified sampling , researchers divide subjects into subgroups called strata based on characteristics that they share (e.g., race, gender, educational attainment).

Once divided, each subgroup is randomly sampled using another probability sampling method .

You should use stratified sampling when your sample can be divided into mutually exclusive and exhaustive subgroups that you believe will take on different mean values for the variable that you’re studying.

Using stratified sampling will allow you to obtain more precise (with lower variance ) statistical estimates of whatever you are trying to measure.

For example, say you want to investigate how income differs based on educational attainment, but you know that this relationship can vary based on race. Using stratified sampling, you can ensure you obtain a large enough sample from each racial group, allowing you to draw more precise conclusions.

Yes, you can create a stratified sample using multiple characteristics, but you must ensure that every participant in your study belongs to one and only one subgroup. In this case, you multiply the numbers of subgroups for each characteristic to get the total number of groups.

For example, if you were stratifying by location with three subgroups (urban, rural, or suburban) and marital status with five subgroups (single, divorced, widowed, married, or partnered), you would have 3 × 5 = 15 subgroups.

There are three key steps in systematic sampling :

  • Define and list your population , ensuring that it is not ordered in a cyclical or periodic order.
  • Decide on your sample size and calculate your interval, k , by dividing your population by your target sample size.
  • Choose every k th member of the population as your sample.

Systematic sampling is a probability sampling method where researchers select members of the population at a regular interval – for example, by selecting every 15th person on a list of the population. If the population is in a random order, this can imitate the benefits of simple random sampling .

Populations are used when a research question requires data from every member of the population. This is usually only feasible when the population is small and easily accessible.

A statistic refers to measures about the sample , while a parameter refers to measures about the population .

A sampling error is the difference between a population parameter and a sample statistic .

There are eight threats to internal validity : history, maturation, instrumentation, testing, selection bias , regression to the mean, social interaction, and attrition .

Internal validity is the extent to which you can be confident that a cause-and-effect relationship established in a study cannot be explained by other factors.

Attrition bias is a threat to internal validity . In experiments, differential rates of attrition between treatment and control groups can skew results.

This bias can affect the relationship between your independent and dependent variables . It can make variables appear to be correlated when they are not, or vice versa.

The external validity of a study is the extent to which you can generalise your findings to different groups of people, situations, and measures.

The two types of external validity are population validity (whether you can generalise to other groups of people) and ecological validity (whether you can generalise to other situations and settings).

There are seven threats to external validity : selection bias , history, experimenter effect, Hawthorne effect , testing effect, aptitude-treatment, and situation effect.

Attrition bias can skew your sample so that your final sample differs significantly from your original sample. Your sample is biased because some groups from your population are underrepresented.

With a biased final sample, you may not be able to generalise your findings to the original population that you sampled from, so your external validity is compromised.

Construct validity is about how well a test measures the concept it was designed to evaluate. It’s one of four types of measurement validity , which includes construct validity, face validity , and criterion validity.

There are two subtypes of construct validity.

  • Convergent validity : The extent to which your measure corresponds to measures of related constructs
  • Discriminant validity: The extent to which your measure is unrelated or negatively related to measures of distinct constructs

When designing or evaluating a measure, construct validity helps you ensure you’re actually measuring the construct you’re interested in. If you don’t have construct validity, you may inadvertently measure unrelated or distinct constructs and lose precision in your research.

Construct validity is often considered the overarching type of measurement validity ,  because it covers all of the other types. You need to have face validity , content validity, and criterion validity to achieve construct validity.

Statistical analyses are often applied to test validity with data from your measures. You test convergent validity and discriminant validity with correlations to see if results from your test are positively or negatively related to those of other established tests.

You can also use regression analyses to assess whether your measure is actually predictive of outcomes that you expect it to predict theoretically. A regression analysis that supports your expectations strengthens your claim of construct validity .

Face validity is about whether a test appears to measure what it’s supposed to measure. This type of validity is concerned with whether a measure seems relevant and appropriate for what it’s assessing only on the surface.

Face validity is important because it’s a simple first step to measuring the overall validity of a test or technique. It’s a relatively intuitive, quick, and easy way to start checking whether a new measure seems useful at first glance.

Good face validity means that anyone who reviews your measure says that it seems to be measuring what it’s supposed to. With poor face validity, someone reviewing your measure may be left confused about what you’re measuring and why you’re using this method.

It’s often best to ask a variety of people to review your measurements. You can ask experts, such as other researchers, or laypeople, such as potential participants, to judge the face validity of tests.

While experts have a deep understanding of research methods , the people you’re studying can provide you with valuable insights you may have missed otherwise.

There are many different types of inductive reasoning that people use formally or informally.

Here are a few common types:

  • Inductive generalisation : You use observations about a sample to come to a conclusion about the population it came from.
  • Statistical generalisation: You use specific numbers about samples to make statements about populations.
  • Causal reasoning: You make cause-and-effect links between different things.
  • Sign reasoning: You make a conclusion about a correlational relationship between different things.
  • Analogical reasoning: You make a conclusion about something based on its similarities to something else.

Inductive reasoning is a bottom-up approach, while deductive reasoning is top-down.

Inductive reasoning takes you from the specific to the general, while in deductive reasoning, you make inferences by going from general premises to specific conclusions.

In inductive research , you start by making observations or gathering data. Then, you take a broad scan of your data and search for patterns. Finally, you make general conclusions that you might incorporate into theories.

Inductive reasoning is a method of drawing conclusions by going from the specific to the general. It’s usually contrasted with deductive reasoning, where you proceed from general information to specific conclusions.

Inductive reasoning is also called inductive logic or bottom-up reasoning.

Deductive reasoning is a logical approach where you progress from general ideas to specific conclusions. It’s often contrasted with inductive reasoning , where you start with specific observations and form general conclusions.

Deductive reasoning is also called deductive logic.

Deductive reasoning is commonly used in scientific research, and it’s especially associated with quantitative research .

In research, you might have come across something called the hypothetico-deductive method . It’s the scientific method of testing hypotheses to check whether your predictions are substantiated by real-world data.

A dependent variable is what changes as a result of the independent variable manipulation in experiments . It’s what you’re interested in measuring, and it ‘depends’ on your independent variable.

In statistics, dependent variables are also called:

  • Response variables (they respond to a change in another variable)
  • Outcome variables (they represent the outcome you want to measure)
  • Left-hand-side variables (they appear on the left-hand side of a regression equation)

An independent variable is the variable you manipulate, control, or vary in an experimental study to explore its effects. It’s called ‘independent’ because it’s not influenced by any other variables in the study.

Independent variables are also called:

  • Explanatory variables (they explain an event or outcome)
  • Predictor variables (they can be used to predict the value of a dependent variable)
  • Right-hand-side variables (they appear on the right-hand side of a regression equation)

A correlation is usually tested for two variables at a time, but you can test correlations between three or more variables.

On graphs, the explanatory variable is conventionally placed on the x -axis, while the response variable is placed on the y -axis.

  • If you have quantitative variables , use a scatterplot or a line graph.
  • If your response variable is categorical, use a scatterplot or a line graph.
  • If your explanatory variable is categorical, use a bar graph.

The term ‘ explanatory variable ‘ is sometimes preferred over ‘ independent variable ‘ because, in real-world contexts, independent variables are often influenced by other variables. This means they aren’t totally independent.

Multiple independent variables may also be correlated with each other, so ‘explanatory variables’ is a more appropriate term.

The difference between explanatory and response variables is simple:

  • An explanatory variable is the expected cause, and it explains the results.
  • A response variable is the expected effect, and it responds to other variables.

There are 4 main types of extraneous variables :

  • Demand characteristics : Environmental cues that encourage participants to conform to researchers’ expectations
  • Experimenter effects : Unintentional actions by researchers that influence study outcomes
  • Situational variables : Eenvironmental variables that alter participants’ behaviours
  • Participant variables : Any characteristic or aspect of a participant’s background that could affect study results

An extraneous variable is any variable that you’re not investigating that can potentially affect the dependent variable of your research study.

A confounding variable is a type of extraneous variable that not only affects the dependent variable, but is also related to the independent variable.

‘Controlling for a variable’ means measuring extraneous variables and accounting for them statistically to remove their effects on other variables.

Researchers often model control variable data along with independent and dependent variable data in regression analyses and ANCOVAs . That way, you can isolate the control variable’s effects from the relationship between the variables of interest.

Control variables help you establish a correlational or causal relationship between variables by enhancing internal validity .

If you don’t control relevant extraneous variables , they may influence the outcomes of your study, and you may not be able to demonstrate that your results are really an effect of your independent variable .

A control variable is any variable that’s held constant in a research study. It’s not a variable of interest in the study, but it’s controlled because it could influence the outcomes.

In statistics, ordinal and nominal variables are both considered categorical variables .

Even though ordinal data can sometimes be numerical, not all mathematical operations can be performed on them.

In scientific research, concepts are the abstract ideas or phenomena that are being studied (e.g., educational achievement). Variables are properties or characteristics of the concept (e.g., performance at school), while indicators are ways of measuring or quantifying variables (e.g., yearly grade reports).

The process of turning abstract concepts into measurable variables and indicators is called operationalisation .

There are several methods you can use to decrease the impact of confounding variables on your research: restriction, matching, statistical control, and randomisation.

In restriction , you restrict your sample by only including certain subjects that have the same values of potential confounding variables.

In matching , you match each of the subjects in your treatment group with a counterpart in the comparison group. The matched subjects have the same values on any potential confounding variables, and only differ in the independent variable .

In statistical control , you include potential confounders as variables in your regression .

In randomisation , you randomly assign the treatment (or independent variable) in your study to a sufficiently large number of subjects, which allows you to control for all potential confounding variables.

A confounding variable is closely related to both the independent and dependent variables in a study. An independent variable represents the supposed cause , while the dependent variable is the supposed effect . A confounding variable is a third variable that influences both the independent and dependent variables.

Failing to account for confounding variables can cause you to wrongly estimate the relationship between your independent and dependent variables.

To ensure the internal validity of your research, you must consider the impact of confounding variables. If you fail to account for them, you might over- or underestimate the causal relationship between your independent and dependent variables , or even find a causal relationship where none exists.

Yes, but including more than one of either type requires multiple research questions .

For example, if you are interested in the effect of a diet on health, you can use multiple measures of health: blood sugar, blood pressure, weight, pulse, and many more. Each of these is its own dependent variable with its own research question.

You could also choose to look at the effect of exercise levels as well as diet, or even the additional effect of the two combined. Each of these is a separate independent variable .

To ensure the internal validity of an experiment , you should only change one independent variable at a time.

No. The value of a dependent variable depends on an independent variable, so a variable cannot be both independent and dependent at the same time. It must be either the cause or the effect, not both.

You want to find out how blood sugar levels are affected by drinking diet cola and regular cola, so you conduct an experiment .

  • The type of cola – diet or regular – is the independent variable .
  • The level of blood sugar that you measure is the dependent variable – it changes depending on the type of cola.

Determining cause and effect is one of the most important parts of scientific research. It’s essential to know which is the cause – the independent variable – and which is the effect – the dependent variable.

Quantitative variables are any variables where the data represent amounts (e.g. height, weight, or age).

Categorical variables are any variables where the data represent groups. This includes rankings (e.g. finishing places in a race), classifications (e.g. brands of cereal), and binary outcomes (e.g. coin flips).

You need to know what type of variables you are working with to choose the right statistical test for your data and interpret your results .

Discrete and continuous variables are two types of quantitative variables :

  • Discrete variables represent counts (e.g., the number of objects in a collection).
  • Continuous variables represent measurable amounts (e.g., water volume or weight).

You can think of independent and dependent variables in terms of cause and effect: an independent variable is the variable you think is the cause , while a dependent variable is the effect .

In an experiment, you manipulate the independent variable and measure the outcome in the dependent variable. For example, in an experiment about the effect of nutrients on crop growth:

  • The  independent variable  is the amount of nutrients added to the crop field.
  • The  dependent variable is the biomass of the crops at harvest time.

Defining your variables, and deciding how you will manipulate and measure them, is an important part of experimental design .

Including mediators and moderators in your research helps you go beyond studying a simple relationship between two variables for a fuller picture of the real world. They are important to consider when studying complex correlational or causal relationships.

Mediators are part of the causal pathway of an effect, and they tell you how or why an effect takes place. Moderators usually help you judge the external validity of your study by identifying the limitations of when the relationship between variables holds.

If something is a mediating variable :

  • It’s caused by the independent variable
  • It influences the dependent variable
  • When it’s taken into account, the statistical correlation between the independent and dependent variables is higher than when it isn’t considered

A confounder is a third variable that affects variables of interest and makes them seem related when they are not. In contrast, a mediator is the mechanism of a relationship between two variables: it explains the process by which they are related.

A mediator variable explains the process through which two variables are related, while a moderator variable affects the strength and direction of that relationship.

When conducting research, collecting original data has significant advantages:

  • You can tailor data collection to your specific research aims (e.g., understanding the needs of your consumers or user testing your website).
  • You can control and standardise the process for high reliability and validity (e.g., choosing appropriate measurements and sampling methods ).

However, there are also some drawbacks: data collection can be time-consuming, labour-intensive, and expensive. In some cases, it’s more efficient to use secondary data that has already been collected by someone else, but the data might be less reliable.

A structured interview is a data collection method that relies on asking questions in a set order to collect data on a topic. They are often quantitative in nature. Structured interviews are best used when:

  • You already have a very clear understanding of your topic. Perhaps significant research has already been conducted, or you have done some prior research yourself, but you already possess a baseline for designing strong structured questions.
  • You are constrained in terms of time or resources and need to analyse your data quickly and efficiently
  • Your research question depends on strong parity between participants, with environmental conditions held constant

More flexible interview options include semi-structured interviews , unstructured interviews , and focus groups .

The interviewer effect is a type of bias that emerges when a characteristic of an interviewer (race, age, gender identity, etc.) influences the responses given by the interviewee.

There is a risk of an interviewer effect in all types of interviews , but it can be mitigated by writing really high-quality interview questions.

A semi-structured interview is a blend of structured and unstructured types of interviews. Semi-structured interviews are best used when:

  • You have prior interview experience. Spontaneous questions are deceptively challenging, and it’s easy to accidentally ask a leading question or make a participant uncomfortable.
  • Your research question is exploratory in nature. Participant answers can guide future research questions and help you develop a more robust knowledge base for future research.

An unstructured interview is the most flexible type of interview, but it is not always the best fit for your research topic.

Unstructured interviews are best used when:

  • You are an experienced interviewer and have a very strong background in your research topic, since it is challenging to ask spontaneous, colloquial questions
  • Your research question is exploratory in nature. While you may have developed hypotheses, you are open to discovering new or shifting viewpoints through the interview process.
  • You are seeking descriptive data, and are ready to ask questions that will deepen and contextualise your initial thoughts and hypotheses
  • Your research depends on forming connections with your participants and making them feel comfortable revealing deeper emotions, lived experiences, or thoughts

The four most common types of interviews are:

  • Structured interviews : The questions are predetermined in both topic and order.
  • Semi-structured interviews : A few questions are predetermined, but other questions aren’t planned.
  • Unstructured interviews : None of the questions are predetermined.
  • Focus group interviews : The questions are presented to a group instead of one individual.

A focus group is a research method that brings together a small group of people to answer questions in a moderated setting. The group is chosen due to predefined demographic traits, and the questions are designed to shed light on a topic of interest. It is one of four types of interviews .

Social desirability bias is the tendency for interview participants to give responses that will be viewed favourably by the interviewer or other participants. It occurs in all types of interviews and surveys , but is most common in semi-structured interviews , unstructured interviews , and focus groups .

Social desirability bias can be mitigated by ensuring participants feel at ease and comfortable sharing their views. Make sure to pay attention to your own body language and any physical or verbal cues, such as nodding or widening your eyes.

This type of bias in research can also occur in observations if the participants know they’re being observed. They might alter their behaviour accordingly.

As a rule of thumb, questions related to thoughts, beliefs, and feelings work well in focus groups . Take your time formulating strong questions, paying special attention to phrasing. Be careful to avoid leading questions , which can bias your responses.

Overall, your focus group questions should be:

  • Open-ended and flexible
  • Impossible to answer with ‘yes’ or ‘no’ (questions that start with ‘why’ or ‘how’ are often best)
  • Unambiguous, getting straight to the point while still stimulating discussion
  • Unbiased and neutral

The third variable and directionality problems are two main reasons why correlation isn’t causation .

The third variable problem means that a confounding variable affects both variables to make them seem causally related when they are not.

The directionality problem is when two variables correlate and might actually have a causal relationship, but it’s impossible to conclude which variable causes changes in the other.

Controlled experiments establish causality, whereas correlational studies only show associations between variables.

  • In an experimental design , you manipulate an independent variable and measure its effect on a dependent variable. Other variables are controlled so they can’t impact the results.
  • In a correlational design , you measure variables without manipulating any of them. You can test whether your variables change together, but you can’t be sure that one variable caused a change in another.

In general, correlational research is high in external validity while experimental research is high in internal validity .

A correlation coefficient is a single number that describes the strength and direction of the relationship between your variables.

Different types of correlation coefficients might be appropriate for your data based on their levels of measurement and distributions . The Pearson product-moment correlation coefficient (Pearson’s r ) is commonly used to assess a linear relationship between two quantitative variables.

A correlational research design investigates relationships between two variables (or more) without the researcher controlling or manipulating any of them. It’s a non-experimental type of quantitative research .

A correlation reflects the strength and/or direction of the association between two or more variables.

  • A positive correlation means that both variables change in the same direction.
  • A negative correlation means that the variables change in opposite directions.
  • A zero correlation means there’s no relationship between the variables.

Longitudinal studies can last anywhere from weeks to decades, although they tend to be at least a year long.

The 1970 British Cohort Study , which has collected data on the lives of 17,000 Brits since their births in 1970, is one well-known example of a longitudinal study .

Longitudinal studies are better to establish the correct sequence of events, identify changes over time, and provide insight into cause-and-effect relationships, but they also tend to be more expensive and time-consuming than other types of studies.

Longitudinal studies and cross-sectional studies are two different types of research design . In a cross-sectional study you collect data from a population at a specific point in time; in a longitudinal study you repeatedly collect data from the same sample over an extended period of time.

Cross-sectional studies cannot establish a cause-and-effect relationship or analyse behaviour over a period of time. To investigate cause and effect, you need to do a longitudinal study or an experimental study .

Cross-sectional studies are less expensive and time-consuming than many other types of study. They can provide useful insights into a population’s characteristics and identify correlations for further research.

Sometimes only cross-sectional data are available for analysis; other times your research question may only require a cross-sectional study to answer it.

A hypothesis states your predictions about what your research will find. It is a tentative answer to your research question that has not yet been tested. For some research projects, you might have to write several hypotheses that address different aspects of your research question.

A hypothesis is not just a guess. It should be based on existing theories and knowledge. It also has to be testable, which means you can support or refute it through scientific research methods (such as experiments, observations, and statistical analysis of data).

A research hypothesis is your proposed answer to your research question. The research hypothesis usually includes an explanation (‘ x affects y because …’).

A statistical hypothesis, on the other hand, is a mathematical statement about a population parameter. Statistical hypotheses always come in pairs: the null and alternative hypotheses. In a well-designed study , the statistical hypotheses correspond logically to the research hypothesis.

Individual Likert-type questions are generally considered ordinal data , because the items have clear rank order, but don’t have an even distribution.

Overall Likert scale scores are sometimes treated as interval data. These scores are considered to have directionality and even spacing between them.

The type of data determines what statistical tests you should use to analyse your data.

A Likert scale is a rating scale that quantitatively assesses opinions, attitudes, or behaviours. It is made up of four or more questions that measure a single attitude or trait when response scores are combined.

To use a Likert scale in a survey , you present participants with Likert-type questions or statements, and a continuum of items, usually with five or seven possible responses, to capture their degree of agreement.

A questionnaire is a data collection tool or instrument, while a survey is an overarching research method that involves collecting and analysing data from people using questionnaires.

A true experiment (aka a controlled experiment) always includes at least one control group that doesn’t receive the experimental treatment.

However, some experiments use a within-subjects design to test treatments without a control group. In these designs, you usually compare one group’s outcomes before and after a treatment (instead of comparing outcomes between different groups).

For strong internal validity , it’s usually best to include a control group if possible. Without a control group, it’s harder to be certain that the outcome was caused by the experimental treatment and not by other variables.

An experimental group, also known as a treatment group, receives the treatment whose effect researchers wish to study, whereas a control group does not. They should be identical in all other ways.

In a controlled experiment , all extraneous variables are held constant so that they can’t influence the results. Controlled experiments require:

  • A control group that receives a standard treatment, a fake treatment, or no treatment
  • Random assignment of participants to ensure the groups are equivalent

Depending on your study topic, there are various other methods of controlling variables .

Questionnaires can be self-administered or researcher-administered.

Self-administered questionnaires can be delivered online or in paper-and-pen formats, in person or by post. All questions are standardised so that all respondents receive the same questions with identical wording.

Researcher-administered questionnaires are interviews that take place by phone, in person, or online between researchers and respondents. You can gain deeper insights by clarifying questions for respondents or asking follow-up questions.

You can organise the questions logically, with a clear progression from simple to complex, or randomly between respondents. A logical flow helps respondents process the questionnaire easier and quicker, but it may lead to bias. Randomisation can minimise the bias from order effects.

Closed-ended, or restricted-choice, questions offer respondents a fixed set of choices to select from. These questions are easier to answer quickly.

Open-ended or long-form questions allow respondents to answer in their own words. Because there are no restrictions on their choices, respondents can answer in ways that researchers may not have otherwise considered.

Naturalistic observation is a qualitative research method where you record the behaviours of your research subjects in real-world settings. You avoid interfering or influencing anything in a naturalistic observation.

You can think of naturalistic observation as ‘people watching’ with a purpose.

Naturalistic observation is a valuable tool because of its flexibility, external validity , and suitability for topics that can’t be studied in a lab setting.

The downsides of naturalistic observation include its lack of scientific control , ethical considerations , and potential for bias from observers and subjects.

You can use several tactics to minimise observer bias .

  • Use masking (blinding) to hide the purpose of your study from all observers.
  • Triangulate your data with different data collection methods or sources.
  • Use multiple observers and ensure inter-rater reliability.
  • Train your observers to make sure data is consistently recorded between them.
  • Standardise your observation procedures to make sure they are structured and clear.

The observer-expectancy effect occurs when researchers influence the results of their own study through interactions with participants.

Researchers’ own beliefs and expectations about the study results may unintentionally influence participants through demand characteristics .

Observer bias occurs when a researcher’s expectations, opinions, or prejudices influence what they perceive or record in a study. It usually affects studies when observers are aware of the research aims or hypotheses. This type of research bias is also called detection bias or ascertainment bias .

Data cleaning is necessary for valid and appropriate analyses. Dirty data contain inconsistencies or errors , but cleaning your data helps you minimise or resolve these.

Without data cleaning, you could end up with a Type I or II error in your conclusion. These types of erroneous conclusions can be practically significant with important consequences, because they lead to misplaced investments or missed opportunities.

Data cleaning involves spotting and resolving potential data inconsistencies or errors to improve your data quality. An error is any value (e.g., recorded weight) that doesn’t reflect the true value (e.g., actual weight) of something that’s being measured.

In this process, you review, analyse, detect, modify, or remove ‘dirty’ data to make your dataset ‘clean’. Data cleaning is also called data cleansing or data scrubbing.

Data cleaning takes place between data collection and data analyses. But you can use some methods even before collecting data.

For clean data, you should start by designing measures that collect valid data. Data validation at the time of data entry or collection helps you minimize the amount of data cleaning you’ll need to do.

After data collection, you can use data standardisation and data transformation to clean your data. You’ll also deal with any missing values, outliers, and duplicate values.

Clean data are valid, accurate, complete, consistent, unique, and uniform. Dirty data include inconsistencies and errors.

Dirty data can come from any part of the research process, including poor research design , inappropriate measurement materials, or flawed data entry.

Random assignment is used in experiments with a between-groups or independent measures design. In this research design, there’s usually a control group and one or more experimental groups. Random assignment helps ensure that the groups are comparable.

In general, you should always use random assignment in this type of experimental design when it is ethically possible and makes sense for your study topic.

Random selection, or random sampling , is a way of selecting members of a population for your study’s sample.

In contrast, random assignment is a way of sorting the sample into control and experimental groups.

Random sampling enhances the external validity or generalisability of your results, while random assignment improves the internal validity of your study.

To implement random assignment , assign a unique number to every member of your study’s sample .

Then, you can use a random number generator or a lottery method to randomly assign each number to a control or experimental group. You can also do so manually, by flipping a coin or rolling a die to randomly assign participants to groups.

Exploratory research is often used when the issue you’re studying is new or when the data collection process is challenging for some reason.

You can use exploratory research if you have a general idea or a specific question that you want to study but there is no preexisting knowledge or paradigm with which to study it.

Exploratory research is a methodology approach that explores research questions that have not previously been studied in depth. It is often used when the issue you’re studying is new, or the data collection process is challenging in some way.

Explanatory research is used to investigate how or why a phenomenon occurs. Therefore, this type of research is often one of the first stages in the research process , serving as a jumping-off point for future research.

Explanatory research is a research method used to investigate how or why something occurs when only a small amount of information is available pertaining to that topic. It can help you increase your understanding of a given topic.

Blinding means hiding who is assigned to the treatment group and who is assigned to the control group in an experiment .

Blinding is important to reduce bias (e.g., observer bias , demand characteristics ) and ensure a study’s internal validity .

If participants know whether they are in a control or treatment group , they may adjust their behaviour in ways that affect the outcome that researchers are trying to measure. If the people administering the treatment are aware of group assignment, they may treat participants differently and thus directly or indirectly influence the final results.

  • In a single-blind study , only the participants are blinded.
  • In a double-blind study , both participants and experimenters are blinded.
  • In a triple-blind study , the assignment is hidden not only from participants and experimenters, but also from the researchers analysing the data.

Many academic fields use peer review , largely to determine whether a manuscript is suitable for publication. Peer review enhances the credibility of the published manuscript.

However, peer review is also common in non-academic settings. The United Nations, the European Union, and many individual nations use peer review to evaluate grant applications. It is also widely used in medical and health-related fields as a teaching or quality-of-care measure.

Peer assessment is often used in the classroom as a pedagogical tool. Both receiving feedback and providing it are thought to enhance the learning process, helping students think critically and collaboratively.

Peer review can stop obviously problematic, falsified, or otherwise untrustworthy research from being published. It also represents an excellent opportunity to get feedback from renowned experts in your field.

It acts as a first defence, helping you ensure your argument is clear and that there are no gaps, vague terms, or unanswered questions for readers who weren’t involved in the research process.

Peer-reviewed articles are considered a highly credible source due to this stringent process they go through before publication.

In general, the peer review process follows the following steps:

  • First, the author submits the manuscript to the editor.
  • Reject the manuscript and send it back to author, or
  • Send it onward to the selected peer reviewer(s)
  • Next, the peer review process occurs. The reviewer provides feedback, addressing any major or minor issues with the manuscript, and gives their advice regarding what edits should be made.
  • Lastly, the edited manuscript is sent back to the author. They input the edits, and resubmit it to the editor for publication.

Peer review is a process of evaluating submissions to an academic journal. Utilising rigorous criteria, a panel of reviewers in the same subject area decide whether to accept each submission for publication.

For this reason, academic journals are often considered among the most credible sources you can use in a research project – provided that the journal itself is trustworthy and well regarded.

Anonymity means you don’t know who the participants are, while confidentiality means you know who they are but remove identifying information from your research report. Both are important ethical considerations .

You can only guarantee anonymity by not collecting any personally identifying information – for example, names, phone numbers, email addresses, IP addresses, physical characteristics, photos, or videos.

You can keep data confidential by using aggregate information in your research report, so that you only refer to groups of participants rather than individuals.

Research misconduct means making up or falsifying data, manipulating data analyses, or misrepresenting results in research reports. It’s a form of academic fraud.

These actions are committed intentionally and can have serious consequences; research misconduct is not a simple mistake or a point of disagreement but a serious ethical failure.

Research ethics matter for scientific integrity, human rights and dignity, and collaboration between science and society. These principles make sure that participation in studies is voluntary, informed, and safe.

Ethical considerations in research are a set of principles that guide your research designs and practices. These principles include voluntary participation, informed consent, anonymity, confidentiality, potential for harm, and results communication.

Scientists and researchers must always adhere to a certain code of conduct when collecting data from others .

These considerations protect the rights of research participants, enhance research validity , and maintain scientific integrity.

A systematic review is secondary research because it uses existing research. You don’t collect new data yourself.

The two main types of social desirability bias are:

  • Self-deceptive enhancement (self-deception): The tendency to see oneself in a favorable light without realizing it.
  • Impression managemen t (other-deception): The tendency to inflate one’s abilities or achievement in order to make a good impression on other people.

Demand characteristics are aspects of experiments that may give away the research objective to participants. Social desirability bias occurs when participants automatically try to respond in ways that make them seem likeable in a study, even if it means misrepresenting how they truly feel.

Participants may use demand characteristics to infer social norms or experimenter expectancies and act in socially desirable ways, so you should try to control for demand characteristics wherever possible.

Response bias refers to conditions or factors that take place during the process of responding to surveys, affecting the responses. One type of response bias is social desirability bias .

When your population is large in size, geographically dispersed, or difficult to contact, it’s necessary to use a sampling method .

This allows you to gather information from a smaller part of the population, i.e. the sample, and make accurate statements by using statistical analysis. A few sampling methods include simple random sampling , convenience sampling , and snowball sampling .

Stratified and cluster sampling may look similar, but bear in mind that groups created in cluster sampling are heterogeneous , so the individual characteristics in the cluster vary. In contrast, groups created in stratified sampling are homogeneous , as units share characteristics.

Relatedly, in cluster sampling you randomly select entire groups and include all units of each group in your sample. However, in stratified sampling, you select some units of all groups and include them in your sample. In this way, both methods can ensure that your sample is representative of the target population .

A sampling frame is a list of every member in the entire population . It is important that the sampling frame is as complete as possible, so that your sample accurately reflects your population.

Convenience sampling and quota sampling are both non-probability sampling methods. They both use non-random criteria like availability, geographical proximity, or expert knowledge to recruit study participants.

However, in convenience sampling, you continue to sample units or cases until you reach the required sample size.

In quota sampling, you first need to divide your population of interest into subgroups (strata) and estimate their proportions (quota) in the population. Then you can start your data collection , using convenience sampling to recruit participants, until the proportions in each subgroup coincide with the estimated proportions in the population.

Random sampling or probability sampling is based on random selection. This means that each unit has an equal chance (i.e., equal probability) of being included in the sample.

On the other hand, convenience sampling involves stopping people at random, which means that not everyone has an equal chance of being selected depending on the place, time, or day you are collecting your data.

Stratified sampling and quota sampling both involve dividing the population into subgroups and selecting units from each subgroup. The purpose in both cases is to select a representative sample and/or to allow comparisons between subgroups.

The main difference is that in stratified sampling, you draw a random sample from each subgroup ( probability sampling ). In quota sampling you select a predetermined number or proportion of units, in a non-random manner ( non-probability sampling ).

Snowball sampling is best used in the following cases:

  • If there is no sampling frame available (e.g., people with a rare disease)
  • If the population of interest is hard to access or locate (e.g., people experiencing homelessness)
  • If the research focuses on a sensitive topic (e.g., extra-marital affairs)

Snowball sampling relies on the use of referrals. Here, the researcher recruits one or more initial participants, who then recruit the next ones. 

Participants share similar characteristics and/or know each other. Because of this, not every member of the population has an equal chance of being included in the sample, giving rise to sampling bias .

Snowball sampling is a non-probability sampling method , where there is not an equal chance for every member of the population to be included in the sample .

This means that you cannot use inferential statistics and make generalisations – often the goal of quantitative research . As such, a snowball sample is not representative of the target population, and is usually a better fit for qualitative research .

Snowball sampling is a non-probability sampling method . Unlike probability sampling (which involves some form of random selection ), the initial individuals selected to be studied are the ones who recruit new participants.

Because not every member of the target population has an equal chance of being recruited into the sample, selection in snowball sampling is non-random.

Reproducibility and replicability are related terms.

  • Reproducing research entails reanalysing the existing data in the same manner.
  • Replicating (or repeating ) the research entails reconducting the entire analysis, including the collection of new data . 
  • A successful reproduction shows that the data analyses were conducted in a fair and honest manner.
  • A successful replication shows that the reliability of the results is high.

The reproducibility and replicability of a study can be ensured by writing a transparent, detailed method section and using clear, unambiguous language.

Convergent validity and discriminant validity are both subtypes of construct validity . Together, they help you evaluate whether a test measures the concept it was designed to measure.

  • Convergent validity indicates whether a test that is designed to measure a particular construct correlates with other tests that assess the same or similar construct.
  • Discriminant validity indicates whether two tests that should not be highly related to each other are indeed not related

You need to assess both in order to demonstrate construct validity. Neither one alone is sufficient for establishing construct validity.

Construct validity has convergent and discriminant subtypes. They assist determine if a test measures the intended notion.

Content validity shows you how accurately a test or other measurement method taps  into the various aspects of the specific construct you are researching.

In other words, it helps you answer the question: “does the test measure all aspects of the construct I want to measure?” If it does, then the test has high content validity.

The higher the content validity, the more accurate the measurement of the construct.

If the test fails to include parts of the construct, or irrelevant parts are included, the validity of the instrument is threatened, which brings your results into question.

Construct validity refers to how well a test measures the concept (or construct) it was designed to measure. Assessing construct validity is especially important when you’re researching concepts that can’t be quantified and/or are intangible, like introversion. To ensure construct validity your test should be based on known indicators of introversion ( operationalisation ).

On the other hand, content validity assesses how well the test represents all aspects of the construct. If some aspects are missing or irrelevant parts are included, the test has low content validity.

Face validity and content validity are similar in that they both evaluate how suitable the content of a test is. The difference is that face validity is subjective, and assesses content at surface level.

When a test has strong face validity, anyone would agree that the test’s questions appear to measure what they are intended to measure.

For example, looking at a 4th grade math test consisting of problems in which students have to add and multiply, most people would agree that it has strong face validity (i.e., it looks like a math test).

On the other hand, content validity evaluates how well a test represents all the aspects of a topic. Assessing content validity is more systematic and relies on expert evaluation. of each question, analysing whether each one covers the aspects that the test was designed to cover.

A 4th grade math test would have high content validity if it covered all the skills taught in that grade. Experts(in this case, math teachers), would have to evaluate the content validity by comparing the test to the learning objectives.

  • Discriminant validity indicates whether two tests that should not be highly related to each other are indeed not related. This type of validity is also called divergent validity .

Criterion validity and construct validity are both types of measurement validity . In other words, they both show you how accurately a method measures something.

While construct validity is the degree to which a test or other measurement method measures what it claims to measure, criterion validity is the degree to which a test can predictively (in the future) or concurrently (in the present) measure something.

Construct validity is often considered the overarching type of measurement validity . You need to have face validity , content validity , and criterion validity in order to achieve construct validity.

Attrition refers to participants leaving a study. It always happens to some extent – for example, in randomised control trials for medical research.

Differential attrition occurs when attrition or dropout rates differ systematically between the intervention and the control group . As a result, the characteristics of the participants who drop out differ from the characteristics of those who stay in the study. Because of this, study results may be biased .

Criterion validity evaluates how well a test measures the outcome it was designed to measure. An outcome can be, for example, the onset of a disease.

Criterion validity consists of two subtypes depending on the time at which the two measures (the criterion and your test) are obtained:

  • Concurrent validity is a validation strategy where the the scores of a test and the criterion are obtained at the same time
  • Predictive validity is a validation strategy where the criterion variables are measured after the scores of the test

Validity tells you how accurately a method measures what it was designed to measure. There are 4 main types of validity :

  • Construct validity : Does the test measure the construct it was designed to measure?
  • Face validity : Does the test appear to be suitable for its objectives ?
  • Content validity : Does the test cover all relevant parts of the construct it aims to measure.
  • Criterion validity : Do the results accurately measure the concrete outcome they are designed to measure?

Convergent validity shows how much a measure of one construct aligns with other measures of the same or related constructs .

On the other hand, concurrent validity is about how a measure matches up to some known criterion or gold standard, which can be another measure.

Although both types of validity are established by calculating the association or correlation between a test score and another variable , they represent distinct validation methods.

The purpose of theory-testing mode is to find evidence in order to disprove, refine, or support a theory. As such, generalisability is not the aim of theory-testing mode.

Due to this, the priority of researchers in theory-testing mode is to eliminate alternative causes for relationships between variables . In other words, they prioritise internal validity over external validity , including ecological validity .

Inclusion and exclusion criteria are typically presented and discussed in the methodology section of your thesis or dissertation .

Inclusion and exclusion criteria are predominantly used in non-probability sampling . In purposive sampling and snowball sampling , restrictions apply as to who can be included in the sample .

Scope of research is determined at the beginning of your research process , prior to the data collection stage. Sometimes called “scope of study,” your scope delineates what will and will not be covered in your project. It helps you focus your work and your time, ensuring that you’ll be able to achieve your goals and outcomes.

Defining a scope can be very useful in any research project, from a research proposal to a thesis or dissertation . A scope is needed for all types of research: quantitative , qualitative , and mixed methods .

To define your scope of research, consider the following:

  • Budget constraints or any specifics of grant funding
  • Your proposed timeline and duration
  • Specifics about your population of study, your proposed sample size , and the research methodology you’ll pursue
  • Any inclusion and exclusion criteria
  • Any anticipated control , extraneous , or confounding variables that could bias your research if not accounted for properly.

To make quantitative observations , you need to use instruments that are capable of measuring the quantity you want to observe. For example, you might use a ruler to measure the length of an object or a thermometer to measure its temperature.

Quantitative observations involve measuring or counting something and expressing the result in numerical form, while qualitative observations involve describing something in non-numerical terms, such as its appearance, texture, or color.

The Scribbr Reference Generator is developed using the open-source Citation Style Language (CSL) project and Frank Bennett’s citeproc-js . It’s the same technology used by dozens of other popular citation tools, including Mendeley and Zotero.

You can find all the citation styles and locales used in the Scribbr Reference Generator in our publicly accessible repository on Github .

To paraphrase effectively, don’t just take the original sentence and swap out some of the words for synonyms. Instead, try:

  • Reformulating the sentence (e.g., change active to passive , or start from a different point)
  • Combining information from multiple sentences into one
  • Leaving out information from the original that isn’t relevant to your point
  • Using synonyms where they don’t distort the meaning

The main point is to ensure you don’t just copy the structure of the original text, but instead reformulate the idea in your own words.

Plagiarism means using someone else’s words or ideas and passing them off as your own. Paraphrasing means putting someone else’s ideas into your own words.

So when does paraphrasing count as plagiarism?

  • Paraphrasing is plagiarism if you don’t properly credit the original author.
  • Paraphrasing is plagiarism if your text is too close to the original wording (even if you cite the source). If you directly copy a sentence or phrase, you should quote it instead.
  • Paraphrasing  is not plagiarism if you put the author’s ideas completely into your own words and properly reference the source .

To present information from other sources in academic writing , it’s best to paraphrase in most cases. This shows that you’ve understood the ideas you’re discussing and incorporates them into your text smoothly.

It’s appropriate to quote when:

  • Changing the phrasing would distort the meaning of the original text
  • You want to discuss the author’s language choices (e.g., in literary analysis )
  • You’re presenting a precise definition
  • You’re looking in depth at a specific claim

A quote is an exact copy of someone else’s words, usually enclosed in quotation marks and credited to the original author or speaker.

Every time you quote a source , you must include a correctly formatted in-text citation . This looks slightly different depending on the citation style .

For example, a direct quote in APA is cited like this: ‘This is a quote’ (Streefkerk, 2020, p. 5).

Every in-text citation should also correspond to a full reference at the end of your paper.

In scientific subjects, the information itself is more important than how it was expressed, so quoting should generally be kept to a minimum. In the arts and humanities, however, well-chosen quotes are often essential to a good paper.

In social sciences, it varies. If your research is mainly quantitative , you won’t include many quotes, but if it’s more qualitative , you may need to quote from the data you collected .

As a general guideline, quotes should take up no more than 5–10% of your paper. If in doubt, check with your instructor or supervisor how much quoting is appropriate in your field.

If you’re quoting from a text that paraphrases or summarises other sources and cites them in parentheses , APA  recommends retaining the citations as part of the quote:

  • Smith states that ‘the literature on this topic (Jones, 2015; Sill, 2019; Paulson, 2020) shows no clear consensus’ (Smith, 2019, p. 4).

Footnote or endnote numbers that appear within quoted text should be omitted.

If you want to cite an indirect source (one you’ve only seen quoted in another source), either locate the original source or use the phrase ‘as cited in’ in your citation.

A block quote is a long quote formatted as a separate ‘block’ of text. Instead of using quotation marks , you place the quote on a new line, and indent the entire quote to mark it apart from your own words.

APA uses block quotes for quotes that are 40 words or longer.

A credible source should pass the CRAAP test  and follow these guidelines:

  • The information should be up to date and current.
  • The author and publication should be a trusted authority on the subject you are researching.
  • The sources the author cited should be easy to find, clear, and unbiased.
  • For a web source, the URL and layout should signify that it is trustworthy.

Common examples of primary sources include interview transcripts , photographs, novels, paintings, films, historical documents, and official statistics.

Anything you directly analyze or use as first-hand evidence can be a primary source, including qualitative or quantitative data that you collected yourself.

Common examples of secondary sources include academic books, journal articles , reviews, essays , and textbooks.

Anything that summarizes, evaluates or interprets primary sources can be a secondary source. If a source gives you an overview of background information or presents another researcher’s ideas on your topic, it is probably a secondary source.

To determine if a source is primary or secondary, ask yourself:

  • Was the source created by someone directly involved in the events you’re studying (primary), or by another researcher (secondary)?
  • Does the source provide original information (primary), or does it summarize information from other sources (secondary)?
  • Are you directly analyzing the source itself (primary), or only using it for background information (secondary)?

Some types of sources are nearly always primary: works of art and literature, raw statistical data, official documents and records, and personal communications (e.g. letters, interviews ). If you use one of these in your research, it is probably a primary source.

Primary sources are often considered the most credible in terms of providing evidence for your argument, as they give you direct evidence of what you are researching. However, it’s up to you to ensure the information they provide is reliable and accurate.

Always make sure to properly cite your sources to avoid plagiarism .

A fictional movie is usually a primary source. A documentary can be either primary or secondary depending on the context.

If you are directly analysing some aspect of the movie itself – for example, the cinematography, narrative techniques, or social context – the movie is a primary source.

If you use the movie for background information or analysis about your topic – for example, to learn about a historical event or a scientific discovery – the movie is a secondary source.

Whether it’s primary or secondary, always properly cite the movie in the citation style you are using. Learn how to create an MLA movie citation or an APA movie citation .

Articles in newspapers and magazines can be primary or secondary depending on the focus of your research.

In historical studies, old articles are used as primary sources that give direct evidence about the time period. In social and communication studies, articles are used as primary sources to analyse language and social relations (for example, by conducting content analysis or discourse analysis ).

If you are not analysing the article itself, but only using it for background information or facts about your topic, then the article is a secondary source.

In academic writing , there are three main situations where quoting is the best choice:

  • To analyse the author’s language (e.g., in a literary analysis essay )
  • To give evidence from primary sources
  • To accurately present a precise definition or argument

Don’t overuse quotes; your own voice should be dominant. If you just want to provide information from a source, it’s usually better to paraphrase or summarise .

Your list of tables and figures should go directly after your table of contents in your thesis or dissertation.

Lists of figures and tables are often not required, and they aren’t particularly common. They specifically aren’t required for APA Style, though you should be careful to follow their other guidelines for figures and tables .

If you have many figures and tables in your thesis or dissertation, include one may help you stay organised. Your educational institution may require them, so be sure to check their guidelines.

Copyright information can usually be found wherever the table or figure was published. For example, for a diagram in a journal article , look on the journal’s website or the database where you found the article. Images found on sites like Flickr are listed with clear copyright information.

If you find that permission is required to reproduce the material, be sure to contact the author or publisher and ask for it.

A list of figures and tables compiles all of the figures and tables that you used in your thesis or dissertation and displays them with the page number where they can be found.

APA doesn’t require you to include a list of tables or a list of figures . However, it is advisable to do so if your text is long enough to feature a table of contents and it includes a lot of tables and/or figures .

A list of tables and list of figures appear (in that order) after your table of contents, and are presented in a similar way.

A glossary is a collection of words pertaining to a specific topic. In your thesis or dissertation, it’s a list of all terms you used that may not immediately be obvious to your reader. Your glossary only needs to include terms that your reader may not be familiar with, and is intended to enhance their understanding of your work.

Definitional terms often fall into the category of common knowledge , meaning that they don’t necessarily have to be cited. This guidance can apply to your thesis or dissertation glossary as well.

However, if you’d prefer to cite your sources , you can follow guidance for citing dictionary entries in MLA or APA style for your glossary.

A glossary is a collection of words pertaining to a specific topic. In your thesis or dissertation, it’s a list of all terms you used that may not immediately be obvious to your reader. In contrast, an index is a list of the contents of your work organised by page number.

Glossaries are not mandatory, but if you use a lot of technical or field-specific terms, it may improve readability to add one to your thesis or dissertation. Your educational institution may also require them, so be sure to check their specific guidelines.

A glossary is a collection of words pertaining to a specific topic. In your thesis or dissertation, it’s a list of all terms you used that may not immediately be obvious to your reader. In contrast, dictionaries are more general collections of words.

The title page of your thesis or dissertation should include your name, department, institution, degree program, and submission date.

The title page of your thesis or dissertation goes first, before all other content or lists that you may choose to include.

Usually, no title page is needed in an MLA paper . A header is generally included at the top of the first page instead. The exceptions are when:

  • Your instructor requires one, or
  • Your paper is a group project

In those cases, you should use a title page instead of a header, listing the same information but on a separate page.

When you mention different chapters within your text, it’s considered best to use Roman numerals for most citation styles. However, the most important thing here is to remain consistent whenever using numbers in your dissertation .

A thesis or dissertation outline is one of the most critical first steps in your writing process. It helps you to lay out and organise your ideas and can provide you with a roadmap for deciding what kind of research you’d like to undertake.

Generally, an outline contains information on the different sections included in your thesis or dissertation, such as:

  • Your anticipated title
  • Your abstract
  • Your chapters (sometimes subdivided into further topics like literature review, research methods, avenues for future research, etc.)

While a theoretical framework describes the theoretical underpinnings of your work based on existing research, a conceptual framework allows you to draw your own conclusions, mapping out the variables you may use in your study and the interplay between them.

A literature review and a theoretical framework are not the same thing and cannot be used interchangeably. While a theoretical framework describes the theoretical underpinnings of your work, a literature review critically evaluates existing research relating to your topic. You’ll likely need both in your dissertation .

A theoretical framework can sometimes be integrated into a  literature review chapter , but it can also be included as its own chapter or section in your dissertation . As a rule of thumb, if your research involves dealing with a lot of complex theories, it’s a good idea to include a separate theoretical framework chapter.

An abstract is a concise summary of an academic text (such as a journal article or dissertation ). It serves two main purposes:

  • To help potential readers determine the relevance of your paper for their own research.
  • To communicate your key findings to those who don’t have time to read the whole paper.

Abstracts are often indexed along with keywords on academic databases, so they make your work more easily findable. Since the abstract is the first thing any reader sees, it’s important that it clearly and accurately summarises the contents of your paper.

The abstract is the very last thing you write. You should only write it after your research is complete, so that you can accurately summarize the entirety of your thesis or paper.

Avoid citing sources in your abstract . There are two reasons for this:

  • The abstract should focus on your original research, not on the work of others.
  • The abstract should be self-contained and fully understandable without reference to other sources.

There are some circumstances where you might need to mention other sources in an abstract: for example, if your research responds directly to another study or focuses on the work of a single theorist. In general, though, don’t include citations unless absolutely necessary.

The abstract appears on its own page, after the title page and acknowledgements but before the table of contents .

Results are usually written in the past tense , because they are describing the outcome of completed actions.

The results chapter or section simply and objectively reports what you found, without speculating on why you found these results. The discussion interprets the meaning of the results, puts them in context, and explains why they matter.

In qualitative research , results and discussion are sometimes combined. But in quantitative research , it’s considered important to separate the objective results from your interpretation of them.

Formulating a main research question can be a difficult task. Overall, your question should contribute to solving the problem that you have defined in your problem statement .

However, it should also fulfill criteria in three main areas:

  • Researchability
  • Feasibility and specificity
  • Relevance and originality

The best way to remember the difference between a research plan and a research proposal is that they have fundamentally different audiences. A research plan helps you, the researcher, organize your thoughts. On the other hand, a dissertation proposal or research proposal aims to convince others (e.g., a supervisor, a funding body, or a dissertation committee) that your research topic is relevant and worthy of being conducted.

A noun is a word that represents a person, thing, concept, or place (e.g., ‘John’, ‘house’, ‘affinity’, ‘river’). Most sentences contain at least one noun or pronoun .

Nouns are often, but not always, preceded by an article (‘the’, ‘a’, or ‘an’) and/or another determiner such as an adjective.

There are many ways to categorize nouns into various types, and the same noun can fall into multiple categories or even change types depending on context.

Some of the main types of nouns are:

  • Common nouns and proper nouns
  • Countable and uncountable nouns
  • Concrete and abstract nouns
  • Collective nouns
  • Possessive nouns
  • Attributive nouns
  • Appositive nouns
  • Generic nouns

Pronouns are words like ‘I’, ‘she’, and ‘they’ that are used in a similar way to nouns . They stand in for a noun that has already been mentioned or refer to yourself and other people.

Pronouns can function just like nouns as the head of a noun phrase and as the subject or object of a verb. However, pronouns change their forms (e.g., from ‘I’ to ‘me’) depending on the grammatical context they’re used in, whereas nouns usually don’t.

Common nouns are words for types of things, people, and places, such as ‘dog’, ‘professor’, and ‘city’. They are not capitalised and are typically used in combination with articles and other determiners.

Proper nouns are words for specific things, people, and places, such as ‘Max’, ‘Dr Prakash’, and ‘London’. They are always capitalised and usually aren’t combined with articles and other determiners.

A proper adjective is an adjective that was derived from a proper noun and is therefore capitalised .

Proper adjectives include words for nationalities, languages, and ethnicities (e.g., ‘Japanese’, ‘Inuit’, ‘French’) and words derived from people’s names (e.g., ‘Bayesian’, ‘Orwellian’).

The names of seasons (e.g., ‘spring’) are treated as common nouns in English and therefore not capitalised . People often assume they are proper nouns, but this is an error.

The names of days and months, however, are capitalised since they’re treated as proper nouns in English (e.g., ‘Wednesday’, ‘January’).

No, as a general rule, academic concepts, disciplines, theories, models, etc. are treated as common nouns , not proper nouns , and therefore not capitalised . For example, ‘five-factor model of personality’ or ‘analytic philosophy’.

However, proper nouns that appear within the name of an academic concept (such as the name of the inventor) are capitalised as usual. For example, ‘Darwin’s theory of evolution’ or ‘ Student’s t table ‘.

Collective nouns are most commonly treated as singular (e.g., ‘the herd is grazing’), but usage differs between US and UK English :

  • In US English, it’s standard to treat all collective nouns as singular, even when they are plural in appearance (e.g., ‘The Rolling Stones is …’). Using the plural form is usually seen as incorrect.
  • In UK English, collective nouns can be treated as singular or plural depending on context. It’s quite common to use the plural form, especially when the noun looks plural (e.g., ‘The Rolling Stones are …’).

The plural of “crisis” is “crises”. It’s a loanword from Latin and retains its original Latin plural noun form (similar to “analyses” and “bases”). It’s wrong to write “crisises”.

For example, you might write “Several crises destabilized the regime.”

Normally, the plural of “fish” is the same as the singular: “fish”. It’s one of a group of irregular plural nouns in English that are identical to the corresponding singular nouns (e.g., “moose”, “sheep”). For example, you might write “The fish scatter as the shark approaches.”

If you’re referring to several species of fish, though, the regular plural “fishes” is often used instead. For example, “The aquarium contains many different fishes , including trout and carp.”

The correct plural of “octopus” is “octopuses”.

People often write “octopi” instead because they assume that the plural noun is formed in the same way as Latin loanwords such as “fungus/fungi”. But “octopus” actually comes from Greek, where its original plural is “octopodes”. In English, it instead has the regular plural form “octopuses”.

For example, you might write “There are four octopuses in the aquarium.”

The plural of “moose” is the same as the singular: “moose”. It’s one of a group of plural nouns in English that are identical to the corresponding singular nouns. So it’s wrong to write “mooses”.

For example, you might write “There are several moose in the forest.”

Bias in research affects the validity and reliability of your findings, leading to false conclusions and a misinterpretation of the truth. This can have serious implications in areas like medical research where, for example, a new form of treatment may be evaluated.

Observer bias occurs when the researcher’s assumptions, views, or preconceptions influence what they see and record in a study, while actor–observer bias refers to situations where respondents attribute internal factors (e.g., bad character) to justify other’s behaviour and external factors (difficult circumstances) to justify the same behaviour in themselves.

Response bias is a general term used to describe a number of different conditions or factors that cue respondents to provide inaccurate or false answers during surveys or interviews . These factors range from the interviewer’s perceived social position or appearance to the the phrasing of questions in surveys.

Nonresponse bias occurs when the people who complete a survey are different from those who did not, in ways that are relevant to the research topic. Nonresponse can happen either because people are not willing or not able to participate.

In research, demand characteristics are cues that might indicate the aim of a study to participants. These cues can lead to participants changing their behaviors or responses based on what they think the research is about.

Demand characteristics are common problems in psychology experiments and other social science studies because they can bias your research findings.

Demand characteristics are a type of extraneous variable that can affect the outcomes of the study. They can invalidate studies by providing an alternative explanation for the results.

These cues may nudge participants to consciously or unconsciously change their responses, and they pose a threat to both internal and external validity . You can’t be sure that your independent variable manipulation worked, or that your findings can be applied to other people or settings.

You can control demand characteristics by taking a few precautions in your research design and materials.

Use these measures:

  • Deception: Hide the purpose of the study from participants
  • Between-groups design : Give each participant only one independent variable treatment
  • Double-blind design : Conceal the assignment of groups from participants and yourself
  • Implicit measures: Use indirect or hidden measurements for your variables

Some attrition is normal and to be expected in research. However, the type of attrition is important because systematic research bias can distort your findings. Attrition bias can lead to inaccurate results because it affects internal and/or external validity .

To avoid attrition bias , applying some of these measures can help you reduce participant dropout (attrition) by making it easy and appealing for participants to stay.

  • Provide compensation (e.g., cash or gift cards) for attending every session
  • Minimise the number of follow-ups as much as possible
  • Make all follow-ups brief, flexible, and convenient for participants
  • Send participants routine reminders to schedule follow-ups
  • Recruit more participants than you need for your sample (oversample)
  • Maintain detailed contact information so you can get in touch with participants even if they move

If you have a small amount of attrition bias , you can use a few statistical methods to try to make up for this research bias .

Multiple imputation involves using simulations to replace the missing data with likely values. Alternatively, you can use sample weighting to make up for the uneven balance of participants in your sample.

Placebos are used in medical research for new medication or therapies, called clinical trials. In these trials some people are given a placebo, while others are given the new medication being tested.

The purpose is to determine how effective the new medication is: if it benefits people beyond a predefined threshold as compared to the placebo, it’s considered effective.

Although there is no definite answer to what causes the placebo effect , researchers propose a number of explanations such as the power of suggestion, doctor-patient interaction, classical conditioning, etc.

Belief bias and confirmation bias are both types of cognitive bias that impact our judgment and decision-making.

Confirmation bias relates to how we perceive and judge evidence. We tend to seek out and prefer information that supports our preexisting beliefs, ignoring any information that contradicts those beliefs.

Belief bias describes the tendency to judge an argument based on how plausible the conclusion seems to us, rather than how much evidence is provided to support it during the course of the argument.

Positivity bias is phenomenon that occurs when a person judges individual members of a group positively, even when they have negative impressions or judgments of the group as a whole. Positivity bias is closely related to optimism bias , or the e xpectation that things will work out well, even if rationality suggests that problems are inevitable in life.

Perception bias is a problem because it prevents us from seeing situations or people objectively. Rather, our expectations, beliefs, or emotions interfere with how we interpret reality. This, in turn, can cause us to misjudge ourselves or others. For example, our prejudices can interfere with whether we perceive people’s faces as friendly or unfriendly.

There are many ways to categorize adjectives into various types. An adjective can fall into one or more of these categories depending on how it is used.

Some of the main types of adjectives are:

  • Attributive adjectives
  • Predicative adjectives
  • Comparative adjectives
  • Superlative adjectives
  • Coordinate adjectives
  • Appositive adjectives
  • Compound adjectives
  • Participial adjectives
  • Proper adjectives
  • Denominal adjectives
  • Nominal adjectives

Cardinal numbers (e.g., one, two, three) can be placed before a noun to indicate quantity (e.g., one apple). While these are sometimes referred to as ‘numeral adjectives ‘, they are more accurately categorised as determiners or quantifiers.

Proper adjectives are adjectives formed from a proper noun (i.e., the name of a specific person, place, or thing) that are used to indicate origin. Like proper nouns, proper adjectives are always capitalised (e.g., Newtonian, Marxian, African).

The cost of proofreading depends on the type and length of text, the turnaround time, and the level of services required. Most proofreading companies charge per word or page, while freelancers sometimes charge an hourly rate.

For proofreading alone, which involves only basic corrections of typos and formatting mistakes, you might pay as little as £0.01 per word, but in many cases, your text will also require some level of editing , which costs slightly more.

It’s often possible to purchase combined proofreading and editing services and calculate the price in advance based on your requirements.

Then and than are two commonly confused words . In the context of ‘better than’, you use ‘than’ with an ‘a’.

  • Julie is better than Jesse.
  • I’d rather spend my time with you than with him.
  • I understand Eoghan’s point of view better than Claudia’s.

Use to and used to are commonly confused words . In the case of ‘used to do’, the latter (with ‘d’) is correct, since you’re describing an action or state in the past.

  • I used to do laundry once a week.
  • They used to do each other’s hair.
  • We used to do the dishes every day .

There are numerous synonyms and near synonyms for the various meanings of “ favour ”:

There are numerous synonyms and near synonyms for the two meanings of “ favoured ”:

No one (two words) is an indefinite pronoun meaning ‘nobody’. People sometimes mistakenly write ‘noone’, but this is incorrect and should be avoided. ‘No-one’, with a hyphen, is also acceptable in UK English .

Nobody and no one are both indefinite pronouns meaning ‘no person’. They can be used interchangeably (e.g., ‘nobody is home’ means the same as ‘no one is home’).

Some synonyms and near synonyms of  every time include:

  • Without exception

‘Everytime’ is sometimes used to mean ‘each time’ or ‘whenever’. However, this is incorrect and should be avoided. The correct phrase is every time   (two words).

Yes, the conjunction because is a compound word , but one with a long history. It originates in Middle English from the preposition “bi” (“by”) and the noun “cause”. Over time, the open compound “bi cause” became the closed compound “because”, which we use today.

Though it’s spelled this way now, the verb “be” is not one of the words that makes up “because”.

Yes, today is a compound word , but a very old one. It wasn’t originally formed from the preposition “to” and the noun “day”; rather, it originates from their Old English equivalents, “tō” and “dæġe”.

In the past, it was sometimes written as a hyphenated compound: “to-day”. But the hyphen is no longer included; it’s always “today” now (“to day” is also wrong).

IEEE citation format is defined by the Institute of Electrical and Electronics Engineers and used in their publications.

It’s also a widely used citation style for students in technical fields like electrical and electronic engineering, computer science, telecommunications, and computer engineering.

An IEEE in-text citation consists of a number in brackets at the relevant point in the text, which points the reader to the right entry in the numbered reference list at the end of the paper. For example, ‘Smith [1] states that …’

A location marker such as a page number is also included within the brackets when needed: ‘Smith [1, p. 13] argues …’

The IEEE reference page consists of a list of references numbered in the order they were cited in the text. The title ‘References’ appears in bold at the top, either left-aligned or centered.

The numbers appear in square brackets on the left-hand side of the page. The reference entries are indented consistently to separate them from the numbers. Entries are single-spaced, with a normal paragraph break between them.

If you cite the same source more than once in your writing, use the same number for all of the IEEE in-text citations for that source, and only include it on the IEEE reference page once. The source is numbered based on the first time you cite it.

For example, the fourth source you cite in your paper is numbered [4]. If you cite it again later, you still cite it as [4]. You can cite different parts of the source each time by adding page numbers [4, p. 15].

A verb is a word that indicates a physical action (e.g., ‘drive’), a mental action (e.g., ‘think’) or a state of being (e.g., ‘exist’). Every sentence contains a verb.

Verbs are almost always used along with a noun or pronoun to describe what the noun or pronoun is doing.

There are many ways to categorize verbs into various types. A verb can fall into one or more of these categories depending on how it is used.

Some of the main types of verbs are:

  • Regular verbs
  • Irregular verbs
  • Transitive verbs
  • Intransitive verbs
  • Dynamic verbs
  • Stative verbs
  • Linking verbs
  • Auxiliary verbs
  • Modal verbs
  • Phrasal verbs

Regular verbs are verbs whose simple past and past participle are formed by adding the suffix ‘-ed’ (e.g., ‘walked’).

Irregular verbs are verbs that form their simple past and past participles in some way other than by adding the suffix ‘-ed’ (e.g., ‘sat’).

The indefinite articles a and an are used to refer to a general or unspecified version of a noun (e.g., a house). Which indefinite article you use depends on the pronunciation of the word that follows it.

  • A is used for words that begin with a consonant sound (e.g., a bear).
  • An is used for words that begin with a vowel sound (e.g., an eagle).

Indefinite articles can only be used with singular countable nouns . Like definite articles, they are a type of determiner .

Editing and proofreading are different steps in the process of revising a text.

Editing comes first, and can involve major changes to content, structure and language. The first stages of editing are often done by authors themselves, while a professional editor makes the final improvements to grammar and style (for example, by improving sentence structure and word choice ).

Proofreading is the final stage of checking a text before it is published or shared. It focuses on correcting minor errors and inconsistencies (for example, in punctuation and capitalization ). Proofreaders often also check for formatting issues, especially in print publishing.

Whether you’re publishing a blog, submitting a research paper , or even just writing an important email, there are a few techniques you can use to make sure it’s error-free:

  • Take a break : Set your work aside for at least a few hours so that you can look at it with fresh eyes.
  • Proofread a printout : Staring at a screen for too long can cause fatigue – sit down with a pen and paper to check the final version.
  • Use digital shortcuts : Take note of any recurring mistakes (for example, misspelling a particular word, switching between US and UK English , or inconsistently capitalizing a term), and use Find and Replace to fix it throughout the document.

If you want to be confident that an important text is error-free, it might be worth choosing a professional proofreading service instead.

There are many different routes to becoming a professional proofreader or editor. The necessary qualifications depend on the field – to be an academic or scientific proofreader, for example, you will need at least a university degree in a relevant subject.

For most proofreading jobs, experience and demonstrated skills are more important than specific qualifications. Often your skills will be tested as part of the application process.

To learn practical proofreading skills, you can choose to take a course with a professional organisation such as the Society for Editors and Proofreaders . Alternatively, you can apply to companies that offer specialised on-the-job training programmes, such as the Scribbr Academy .

Though they’re pronounced the same, there’s a big difference in meaning between its and it’s .

  • ‘The cat ate its food’.
  • ‘It’s almost Christmas’.

Its and it’s are often confused, but its (without apostrophe) is the possessive form of ‘it’ (e.g., its tail, its argument, its wing). You use ‘its’ instead of ‘his’ and ‘her’ for neuter, inanimate nouns.

Then and than are two commonly confused words with different meanings and grammatical roles.

  • Then (pronounced with a short ‘e’ sound) refers to time. It’s often an adverb , but it can also be used as a noun meaning ‘that time’ and as an adjective referring to a previous status.
  • Than (pronounced with a short ‘a’ sound) is used for comparisons. Grammatically, it usually functions as a conjunction , but sometimes it’s a preposition .

Use to and used to are commonly confused words . In the case of ‘used to be’, the latter (with ‘d’) is correct, since you’re describing an action or state in the past.

  • I used to be the new coworker.
  • There used to be 4 cookies left.
  • We used to walk to school every day .

A grammar checker is a tool designed to automatically check your text for spelling errors, grammatical issues, punctuation mistakes , and problems with sentence structure . You can check out our analysis of the best free grammar checkers to learn more.

A paraphrasing tool edits your text more actively, changing things whether they were grammatically incorrect or not. It can paraphrase your sentences to make them more concise and readable or for other purposes. You can check out our analysis of the best free paraphrasing tools to learn more.

Some tools available online combine both functions. Others, such as QuillBot , have separate grammar checker and paraphrasing tools. Be aware of what exactly the tool you’re using does to avoid introducing unwanted changes.

Good grammar is the key to expressing yourself clearly and fluently, especially in professional communication and academic writing . Word processors, browsers, and email programs typically have built-in grammar checkers, but they’re quite limited in the kinds of problems they can fix.

If you want to go beyond detecting basic spelling errors, there are many online grammar checkers with more advanced functionality. They can often detect issues with punctuation , word choice, and sentence structure that more basic tools would miss.

Not all of these tools are reliable, though. You can check out our research into the best free grammar checkers to explore the options.

Our research indicates that the best free grammar checker available online is the QuillBot grammar checker .

We tested 10 of the most popular checkers with the same sample text (containing 20 grammatical errors) and found that QuillBot easily outperformed the competition, scoring 18 out of 20, a drastic improvement over the second-place score of 13 out of 20.

It even appeared to outperform the premium versions of other grammar checkers, despite being entirely free.

A teacher’s aide is a person who assists in teaching classes but is not a qualified teacher. Aide is a noun meaning ‘assistant’, so it will always refer to a person.

‘Teacher’s aid’ is incorrect.

A visual aid is an instructional device (e.g., a photo, a chart) that appeals to vision to help you understand written or spoken information. Aid is often placed after an attributive noun or adjective (like ‘visual’) that describes the type of help provided.

‘Visual aide’ is incorrect.

A job aid is an instructional tool (e.g., a checklist, a cheat sheet) that helps you work efficiently. Aid is a noun meaning ‘assistance’. It’s often placed after an adjective or attributive noun (like ‘job’) that describes the specific type of help provided.

‘Job aide’ is incorrect.

There are numerous synonyms for the various meanings of truly :

Yours truly is a phrase used at the end of a formal letter or email. It can also be used (typically in a humorous way) as a pronoun to refer to oneself (e.g., ‘The dinner was cooked by yours truly ‘). The latter usage should be avoided in formal writing.

It’s formed by combining the second-person possessive pronoun ‘yours’ with the adverb ‘ truly ‘.

A pathetic fallacy can be a short phrase or a whole sentence and is often used in novels and poetry. Pathetic fallacies serve multiple purposes, such as:

  • Conveying the emotional state of the characters or the narrator
  • Creating an atmosphere or set the mood of a scene
  • Foreshadowing events to come
  • Giving texture and vividness to a piece of writing
  • Communicating emotion to the reader in a subtle way, by describing the external world.
  • Bringing inanimate objects to life so that they seem more relatable.

AMA citation format is a citation style designed by the American Medical Association. It’s frequently used in the field of medicine.

You may be told to use AMA style for your student papers. You will also have to follow this style if you’re submitting a paper to a journal published by the AMA.

An AMA in-text citation consists of the number of the relevant reference on your AMA reference page , written in superscript 1 at the point in the text where the source is used.

It may also include the page number or range of the relevant material in the source (e.g., the part you quoted 2(p46) ). Multiple sources can be cited at one point, presented as a range or list (with no spaces 3,5–9 ).

An AMA reference usually includes the author’s last name and initials, the title of the source, information about the publisher or the publication it’s contained in, and the publication date. The specific details included, and the formatting, depend on the source type.

References in AMA style are presented in numerical order (numbered by the order in which they were first cited in the text) on your reference page. A source that’s cited repeatedly in the text still only appears once on the reference page.

An AMA in-text citation just consists of the number of the relevant entry on your AMA reference page , written in superscript at the point in the text where the source is referred to.

You don’t need to mention the author of the source in your sentence, but you can do so if you want. It’s not an official part of the citation, but it can be useful as part of a signal phrase introducing the source.

On your AMA reference page , author names are written with the last name first, followed by the initial(s) of their first name and middle name if mentioned.

There’s a space between the last name and the initials, but no space or punctuation between the initials themselves. The names of multiple authors are separated by commas , and the whole list ends in a period, e.g., ‘Andreessen F, Smith PW, Gonzalez E’.

The names of up to six authors should be listed for each source on your AMA reference page , separated by commas . For a source with seven or more authors, you should list the first three followed by ‘ et al’ : ‘Isidore, Gilbert, Gunvor, et al’.

In the text, mentioning author names is optional (as they aren’t an official part of AMA in-text citations ). If you do mention them, though, you should use the first author’s name followed by ‘et al’ when there are three or more : ‘Isidore et al argue that …’

Note that according to AMA’s rather minimalistic punctuation guidelines, there’s no period after ‘et al’ unless it appears at the end of a sentence. This is different from most other styles, where there is normally a period.

Yes, you should normally include an access date in an AMA website citation (or when citing any source with a URL). This is because webpages can change their content over time, so it’s useful for the reader to know when you accessed the page.

When a publication or update date is provided on the page, you should include it in addition to the access date. The access date appears second in this case, e.g., ‘Published June 19, 2021. Accessed August 29, 2022.’

Don’t include an access date when citing a source with a DOI (such as in an AMA journal article citation ).

Some variables have fixed levels. For example, gender and ethnicity are always nominal level data because they cannot be ranked.

However, for other variables, you can choose the level of measurement . For example, income is a variable that can be recorded on an ordinal or a ratio scale:

  • At an ordinal level , you could create 5 income groupings and code the incomes that fall within them from 1–5.
  • At a ratio level , you would record exact numbers for income.

If you have a choice, the ratio level is always preferable because you can analyse data in more ways. The higher the level of measurement, the more precise your data is.

The level at which you measure a variable determines how you can analyse your data.

Depending on the level of measurement , you can perform different descriptive statistics to get an overall summary of your data and inferential statistics to see if your results support or refute your hypothesis .

Levels of measurement tell you how precisely variables are recorded. There are 4 levels of measurement, which can be ranked from low to high:

  • Nominal : the data can only be categorised.
  • Ordinal : the data can be categorised and ranked.
  • Interval : the data can be categorised and ranked, and evenly spaced.
  • Ratio : the data can be categorised, ranked, evenly spaced and has a natural zero.

Statistical analysis is the main method for analyzing quantitative research data . It uses probabilities and models to test predictions about a population from sample data.

The null hypothesis is often abbreviated as H 0 . When the null hypothesis is written using mathematical symbols, it always includes an equality symbol (usually =, but sometimes ≥ or ≤).

The alternative hypothesis is often abbreviated as H a or H 1 . When the alternative hypothesis is written using mathematical symbols, it always includes an inequality symbol (usually ≠, but sometimes < or >).

As the degrees of freedom increase, Student’s t distribution becomes less leptokurtic , meaning that the probability of extreme values decreases. The distribution becomes more and more similar to a standard normal distribution .

When there are only one or two degrees of freedom , the chi-square distribution is shaped like a backwards ‘J’. When there are three or more degrees of freedom, the distribution is shaped like a right-skewed hump. As the degrees of freedom increase, the hump becomes less right-skewed and the peak of the hump moves to the right. The distribution becomes more and more similar to a normal distribution .

‘Looking forward in hearing from you’ is an incorrect version of the phrase looking forward to hearing from you . The phrasal verb ‘looking forward to’ always needs the preposition ‘to’, not ‘in’.

  • I am looking forward in hearing from you.
  • I am looking forward to hearing from you.

Some synonyms and near synonyms for the expression looking forward to hearing from you include:

  • Eagerly awaiting your response
  • Hoping to hear from you soon
  • It would be great to hear back from you
  • Thanks in advance for your reply

People sometimes mistakenly write ‘looking forward to hear from you’, but this is incorrect. The correct phrase is looking forward to hearing from you .

The phrasal verb ‘look forward to’ is always followed by a direct object, the thing you’re looking forward to. As the direct object has to be a noun phrase , it should be the gerund ‘hearing’, not the verb ‘hear’.

  • I’m looking forward to hear from you soon.
  • I’m looking forward to hearing from you soon.

Traditionally, the sign-off Yours sincerely is used in an email message or letter when you are writing to someone you have interacted with before, not a complete stranger.

Yours faithfully is used instead when you are writing to someone you have had no previous correspondence with, especially if you greeted them as ‘ Dear Sir or Madam ’.

Just checking in   is a standard phrase used to start an email (or other message) that’s intended to ask someone for a response or follow-up action in a friendly, informal way. However, it’s a cliché opening that can come across as passive-aggressive, so we recommend avoiding it in favor of a more direct opening like “We previously discussed …”

In a more personal context, you might encounter “just checking in” as part of a longer phrase such as “I’m just checking in to see how you’re doing”. In this case, it’s not asking the other person to do anything but rather asking about their well-being (emotional or physical) in a friendly way.

“Earliest convenience” is part of the phrase at your earliest convenience , meaning “as soon as you can”. 

It’s typically used to end an email in a formal context by asking the recipient to do something when it’s convenient for them to do so.

ASAP is an abbreviation of the phrase “as soon as possible”. 

It’s typically used to indicate a sense of urgency in highly informal contexts (e.g., “Let me know ASAP if you need me to drive you to the airport”).

“ASAP” should be avoided in more formal correspondence. Instead, use an alternative like at your earliest convenience .

Some synonyms and near synonyms of the verb   compose   (meaning “to make up”) are:

People increasingly use “comprise” as a synonym of “compose.” However, this is normally still seen as a mistake, and we recommend avoiding it in your academic writing . “Comprise” traditionally means “to be made up of,” not “to make up.”

Some synonyms and near synonyms of the verb comprise are:

  • Be composed of
  • Be made up of

People increasingly use “comprise” interchangeably with “compose,” meaning that they consider words like “compose,” “constitute,” and “form” to be synonymous with “comprise.” However, this is still normally regarded as an error, and we advise against using these words interchangeably in academic writing .

A fallacy is a mistaken belief, particularly one based on unsound arguments or one that lacks the evidence to support it. Common types of fallacy that may compromise the quality of your research are:

  • Correlation/causation fallacy: Claiming that two events that occur together have a cause-and-effect relationship even though this can’t be proven
  • Ecological fallacy : Making inferences about the nature of individuals based on aggregate data for the group
  • The sunk cost fallacy : Following through on a project or decision because we have already invested time, effort, or money into it, even if the current costs outweigh the benefits
  • The base-rate fallacy : Ignoring base-rate or statistically significant information, such as sample size or the relative frequency of an event, in favor of  less relevant information e.g., pertaining to a single case, or a small number of cases
  • The planning fallacy : Underestimating the time needed to complete a future task, even when we know that similar tasks in the past have taken longer than planned

The planning fallacy refers to people’s tendency to underestimate the resources needed to complete a future task, despite knowing that previous tasks have also taken longer than planned.

For example, people generally tend to underestimate the cost and time needed for construction projects. The planning fallacy occurs due to people’s tendency to overestimate the chances that positive events, such as a shortened timeline, will happen to them. This phenomenon is called optimism bias or positivity bias.

Although both red herring fallacy and straw man fallacy are logical fallacies or reasoning errors, they denote different attempts to “win” an argument. More specifically:

  • A red herring fallacy refers to an attempt to change the subject and divert attention from the original issue. In other words, a seemingly solid but ultimately irrelevant argument is introduced into the discussion, either on purpose or by mistake.
  • A straw man argument involves the deliberate distortion of another person’s argument. By oversimplifying or exaggerating it, the other party creates an easy-to-refute argument and then attacks it.

The red herring fallacy is a problem because it is flawed reasoning. It is a distraction device that causes people to become sidetracked from the main issue and draw wrong conclusions.

Although a red herring may have some kernel of truth, it is used as a distraction to keep our eyes on a different matter. As a result, it can cause us to accept and spread misleading information.

The sunk cost fallacy and escalation of commitment (or commitment bias ) are two closely related terms. However, there is a slight difference between them:

  • Escalation of commitment (aka commitment bias ) is the tendency to be consistent with what we have already done or said we will do in the past, especially if we did so in public. In other words, it is an attempt to save face and appear consistent.
  • Sunk cost fallacy is the tendency to stick with a decision or a plan even when it’s failing. Because we have already invested valuable time, money, or energy, quitting feels like these resources were wasted.

In other words, escalating commitment is a manifestation of the sunk cost fallacy: an irrational escalation of commitment frequently occurs when people refuse to accept that the resources they’ve already invested cannot be recovered. Instead, they insist on more spending to justify the initial investment (and the incurred losses).

When you are faced with a straw man argument , the best way to respond is to draw attention to the fallacy and ask your discussion partner to show how your original statement and their distorted version are the same. Since these are different, your partner will either have to admit that their argument is invalid or try to justify it by using more flawed reasoning, which you can then attack.

The straw man argument is a problem because it occurs when we fail to take an opposing point of view seriously. Instead, we intentionally misrepresent our opponent’s ideas and avoid genuinely engaging with them. Due to this, resorting to straw man fallacy lowers the standard of constructive debate.

A straw man argument is a distorted (and weaker) version of another person’s argument that can easily be refuted (e.g., when a teacher proposes that the class spend more time on math exercises, a parent complains that the teacher doesn’t care about reading and writing).

This is a straw man argument because it misrepresents the teacher’s position, which didn’t mention anything about cutting down on reading and writing. The straw man argument is also known as the straw man fallacy .

A slippery slope argument is not always a fallacy.

  • When someone claims adopting a certain policy or taking a certain action will automatically lead to a series of other policies or actions also being taken, this is a slippery slope argument.
  • If they don’t show a causal connection between the advocated policy and the consequent policies, then they commit a slippery slope fallacy .

There are a number of ways you can deal with slippery slope arguments especially when you suspect these are fallacious:

  • Slippery slope arguments take advantage of the gray area between an initial action or decision and the possible next steps that might lead to the undesirable outcome. You can point out these missing steps and ask your partner to indicate what evidence exists to support the claimed relationship between two or more events.
  • Ask yourself if each link in the chain of events or action is valid. Every proposition has to be true for the overall argument to work, so even if one link is irrational or not supported by evidence, then the argument collapses.
  • Sometimes people commit a slippery slope fallacy unintentionally. In these instances, use an example that demonstrates the problem with slippery slope arguments in general (e.g., by using statements to reach a conclusion that is not necessarily relevant to the initial statement). By attacking the concept of slippery slope arguments you can show that they are often fallacious.

People sometimes confuse cognitive bias and logical fallacies because they both relate to flawed thinking. However, they are not the same:

  • Cognitive bias is the tendency to make decisions or take action in an illogical way because of our values, memory, socialization, and other personal attributes. In other words, it refers to a fixed pattern of thinking rooted in the way our brain works.
  • Logical fallacies relate to how we make claims and construct our arguments in the moment. They are statements that sound convincing at first but can be disproven through logical reasoning.

In other words, cognitive bias refers to an ongoing predisposition, while logical fallacy refers to mistakes of reasoning that occur in the moment.

An appeal to ignorance (ignorance here meaning lack of evidence) is a type of informal logical fallacy .

It asserts that something must be true because it hasn’t been proven false—or that something must be false because it has not yet been proven true.

For example, “unicorns exist because there is no evidence that they don’t.” The appeal to ignorance is also called the burden of proof fallacy .

An ad hominem (Latin for “to the person”) is a type of informal logical fallacy . Instead of arguing against a person’s position, an ad hominem argument attacks the person’s character or actions in an effort to discredit them.

This rhetorical strategy is fallacious because a person’s character, motive, education, or other personal trait is logically irrelevant to whether their argument is true or false.

Name-calling is common in ad hominem fallacy (e.g., “environmental activists are ineffective because they’re all lazy tree-huggers”).

Ad hominem is a persuasive technique where someone tries to undermine the opponent’s argument by personally attacking them.

In this way, one can redirect the discussion away from the main topic and to the opponent’s personality without engaging with their viewpoint. When the opponent’s personality is irrelevant to the discussion, we call it an ad hominem fallacy .

Ad hominem tu quoque (‘you too”) is an attempt to rebut a claim by attacking its proponent on the grounds that they uphold a double standard or that they don’t practice what they preach. For example, someone is telling you that you should drive slowly otherwise you’ll get a speeding ticket one of these days, and you reply “but you used to get them all the time!”

Argumentum ad hominem means “argument to the person” in Latin and it is commonly referred to as ad hominem argument or personal attack. Ad hominem arguments are used in debates to refute an argument by attacking the character of the person making it, instead of the logic or premise of the argument itself.

The opposite of the hasty generalization fallacy is called slothful induction fallacy or appeal to coincidence .

It is the tendency to deny a conclusion even though there is sufficient evidence that supports it. Slothful induction occurs due to our natural tendency to dismiss events or facts that do not align with our personal biases and expectations. For example, a researcher may try to explain away unexpected results by claiming it is just a coincidence.

To avoid a hasty generalization fallacy we need to ensure that the conclusions drawn are well-supported by the appropriate evidence. More specifically:

  • In statistics , if we want to draw inferences about an entire population, we need to make sure that the sample is random and representative of the population . We can achieve that by using a probability sampling method , like simple random sampling or stratified sampling .
  • In academic writing , use precise language and measured phases. Try to avoid making absolute claims, cite specific instances and examples without applying the findings to a larger group.
  • As readers, we need to ask ourselves “does the writer demonstrate sufficient knowledge of the situation or phenomenon that would allow them to make a generalization?”

The hasty generalization fallacy and the anecdotal evidence fallacy are similar in that they both result in conclusions drawn from insufficient evidence. However, there is a difference between the two:

  • The hasty generalization fallacy involves genuinely considering an example or case (i.e., the evidence comes first and then an incorrect conclusion is drawn from this).
  • The anecdotal evidence fallacy (also known as “cherry-picking” ) is knowing in advance what conclusion we want to support, and then selecting the story (or a few stories) that support it. By overemphasizing anecdotal evidence that fits well with the point we are trying to make, we overlook evidence that would undermine our argument.

Although many sources use circular reasoning fallacy and begging the question interchangeably, others point out that there is a subtle difference between the two:

  • Begging the question fallacy occurs when you assume that an argument is true in order to justify a conclusion. If something begs the question, what you are actually asking is, “Is the premise of that argument actually true?” For example, the statement “Snakes make great pets. That’s why we should get a snake” begs the question “are snakes really great pets?”
  • Circular reasoning fallacy on the other hand, occurs when the evidence used to support a claim is just a repetition of the claim itself.  For example, “People have free will because they can choose what to do.”

In other words, we could say begging the question is a form of circular reasoning.

Circular reasoning fallacy uses circular reasoning to support an argument. More specifically, the evidence used to support a claim is just a repetition of the claim itself. For example: “The President of the United States is a good leader (claim), because they are the leader of this country (supporting evidence)”.

An example of a non sequitur is the following statement:

“Giving up nuclear weapons weakened the United States’ military. Giving up nuclear weapons also weakened China. For this reason, it is wrong to try to outlaw firearms in the United States today.”

Clearly there is a step missing in this line of reasoning and the conclusion does not follow from the premise, resulting in a non sequitur fallacy .

The difference between the post hoc fallacy and the non sequitur fallacy is that post hoc fallacy infers a causal connection between two events where none exists, whereas the non sequitur fallacy infers a conclusion that lacks a logical connection to the premise.

In other words, a post hoc fallacy occurs when there is a lack of a cause-and-effect relationship, while a non sequitur fallacy occurs when there is a lack of logical connection.

An example of post hoc fallacy is the following line of reasoning:

“Yesterday I had ice cream, and today I have a terrible stomachache. I’m sure the ice cream caused this.”

Although it is possible that the ice cream had something to do with the stomachache, there is no proof to justify the conclusion other than the order of events. Therefore, this line of reasoning is fallacious.

Post hoc fallacy and hasty generalisation fallacy are similar in that they both involve jumping to conclusions. However, there is a difference between the two:

  • Post hoc fallacy is assuming a cause and effect relationship between two events, simply because one happened after the other.
  • Hasty generalisation fallacy is drawing a general conclusion from a small sample or little evidence.

In other words, post hoc fallacy involves a leap to a causal claim; hasty generalisation fallacy involves a leap to a general proposition.

The fallacy of composition is similar to and can be confused with the hasty generalization fallacy . However, there is a difference between the two:

  • The fallacy of composition involves drawing an inference about the characteristics of a whole or group based on the characteristics of its individual members.
  • The hasty generalization fallacy involves drawing an inference about a population or class of things on the basis of few atypical instances or a small sample of that population or thing.

In other words, the fallacy of composition is using an unwarranted assumption that we can infer something about a whole based on the characteristics of its parts, while the hasty generalization fallacy is using insufficient evidence to draw a conclusion.

The opposite of the fallacy of composition is the fallacy of division . In the fallacy of division, the assumption is that a characteristic which applies to a whole or a group must necessarily apply to the parts or individual members. For example, “Australians travel a lot. Gary is Australian, so he must travel a lot.”

Base rate fallacy can be avoided by following these steps:

  • Avoid making an important decision in haste. When we are under pressure, we are more likely to resort to cognitive shortcuts like the availability heuristic and the representativeness heuristic . Due to this, we are more likely to factor in only current and vivid information, and ignore the actual probability of something happening (i.e., base rate).
  • Take a long-term view on the decision or question at hand. Look for relevant statistical data, which can reveal long-term trends and give you the full picture.
  • Talk to experts like professionals. They are more aware of probabilities related to specific decisions.

Suppose there is a population consisting of 90% psychologists and 10% engineers. Given that you know someone enjoyed physics at school, you may conclude that they are an engineer rather than a psychologist, even though you know that this person comes from a population consisting of far more psychologists than engineers.

When we ignore the rate of occurrence of some trait in a population (the base-rate information) we commit base rate fallacy .

Cost-benefit fallacy is a common error that occurs when allocating sources in project management. It is the fallacy of assuming that cost-benefit estimates are more or less accurate, when in fact they are highly inaccurate and biased. This means that cost-benefit analyses can be useful, but only after the cost-benefit fallacy has been acknowledged and corrected for. Cost-benefit fallacy is a type of base rate fallacy .

In advertising, the fallacy of equivocation is often used to create a pun. For example, a billboard company might advertise their billboards using a line like: “Looking for a sign? This is it!” The word sign has a literal meaning as billboard and a figurative one as a sign from God, the universe, etc.

Equivocation is a fallacy because it is a form of argumentation that is both misleading and logically unsound. When the meaning of a word or phrase shifts in the course of an argument, it causes confusion and also implies that the conclusion (which may be true) does not follow from the premise.

The fallacy of equivocation is an informal logical fallacy, meaning that the error lies in the content of the argument instead of the structure.

Fallacies of relevance are a group of fallacies that occur in arguments when the premises are logically irrelevant to the conclusion. Although at first there seems to be a connection between the premise and the conclusion, in reality fallacies of relevance use unrelated forms of appeal.

For example, the genetic fallacy makes an appeal to the source or origin of the claim in an attempt to assert or refute something.

The ad hominem fallacy and the genetic fallacy are closely related in that they are both fallacies of relevance. In other words, they both involve arguments that use evidence or examples that are not logically related to the argument at hand. However, there is a difference between the two:

  • In the ad hominem fallacy , the goal is to discredit the argument by discrediting the person currently making the argument.
  • In the genetic fallacy , the goal is to discredit the argument by discrediting the history or origin (i.e., genesis) of an argument.

False dilemma fallacy is also known as false dichotomy, false binary, and “either-or” fallacy. It is the fallacy of presenting only two choices, outcomes, or sides to an argument as the only possibilities, when more are available.

The false dilemma fallacy works in two ways:

  • By presenting only two options as if these were the only ones available
  • By presenting two options as mutually exclusive (i.e., only one option can be selected or can be true at a time)

In both cases, by using the false dilemma fallacy, one conceals alternative choices and doesn’t allow others to consider the full range of options. This is usually achieved through an“either-or” construction and polarised, divisive language (“you are either a friend or an enemy”).

The best way to avoid a false dilemma fallacy is to pause and reflect on two points:

  • Are the options presented truly the only ones available ? It could be that another option has been deliberately omitted.
  • Are the options mentioned mutually exclusive ? Perhaps all of the available options can be selected (or be true) at the same time, which shows that they aren’t mutually exclusive. Proving this is called “escaping between the horns of the dilemma.”

Begging the question fallacy is an argument in which you assume what you are trying to prove. In other words, your position and the justification of that position are the same, only slightly rephrased.

For example: “All freshmen should attend college orientation, because all college students should go to such an orientation.”

The complex question fallacy and begging the question fallacy are similar in that they are both based on assumptions. However, there is a difference between them:

  • A complex question fallacy occurs when someone asks a question that presupposes the answer to another question that has not been established or accepted by the other person. For example, asking someone “Have you stopped cheating on tests?”, unless it has previously been established that the person is indeed cheating on tests, is a fallacy.
  • Begging the question fallacy occurs when we assume the very thing as a premise that we’re trying to prove in our conclusion. In other words, the conclusion is used to support the premises, and the premises prove the validity of the conclusion. For example: “God exists because the Bible says so, and the Bible is true because it is the word of God.”

In other words, begging the question is about drawing a conclusion based on an assumption, while a complex question involves asking a question that presupposes the answer to a prior question.

“ No true Scotsman ” arguments aren’t always fallacious. When there is a generally accepted definition of who or what constitutes a group, it’s reasonable to use statements in the form of “no true Scotsman”.

For example, the statement that “no true pacifist would volunteer for military service” is not fallacious, since a pacifist is, by definition, someone who opposes war or violence as a means of settling disputes.

No true Scotsman arguments are fallacious because instead of logically refuting the counterexample, they simply assert that it doesn’t count. In other words, the counterexample is rejected for psychological, but not logical, reasons.

The appeal to purity or no true Scotsman fallacy is an attempt to defend a generalisation about a group from a counterexample by shifting the definition of the group in the middle of the argument. In this way, one can exclude the counterexample as not being “true”, “genuine”, or “pure” enough to be considered as part of the group in question.

To identify an appeal to authority fallacy , you can ask yourself the following questions:

  • Is the authority cited really a qualified expert in this particular area under discussion? For example, someone who has formal education or years of experience can be an expert.
  • Do experts disagree on this particular subject? If that is the case, then for almost any claim supported by one expert there will be a counterclaim that is supported by another expert. If there is no consensus, an appeal to authority is fallacious.
  • Is the authority in question biased? If you suspect that an expert’s prejudice and bias could have influenced their views, then the expert is not reliable and an argument citing this expert will be fallacious.To identify an appeal to authority fallacy, you ask yourself whether the authority cited is a qualified expert in the particular area under discussion.

Appeal to authority is a fallacy when those who use it do not provide any justification to support their argument. Instead they cite someone famous who agrees with their viewpoint, but is not qualified to make reliable claims on the subject.

Appeal to authority fallacy is often convincing because of the effect authority figures have on us. When someone cites a famous person, a well-known scientist, a politician, etc. people tend to be distracted and often fail to critically examine whether the authority figure is indeed an expert in the area under discussion.

The ad populum fallacy is common in politics. One example is the following viewpoint: “The majority of our countrymen think we should have military operations overseas; therefore, it’s the right thing to do.”

This line of reasoning is fallacious, because popular acceptance of a belief or position does not amount to a justification of that belief. In other words, following the prevailing opinion without examining the underlying reasons is irrational.

The ad populum fallacy plays on our innate desire to fit in (known as “bandwagon effect”). If many people believe something, our common sense tells us that it must be true and we tend to accept it. However, in logic, the popularity of a proposition cannot serve as evidence of its truthfulness.

Ad populum (or appeal to popularity) fallacy and appeal to authority fallacy are similar in that they both conflate the validity of a belief with its popular acceptance among a specific group. However there is a key difference between the two:

  • An ad populum fallacy tries to persuade others by claiming that something is true or right because a lot of people think so.
  • An appeal to authority fallacy tries to persuade by claiming a group of experts believe something is true or right, therefore it must be so.

To identify a false cause fallacy , you need to carefully analyse the argument:

  • When someone claims that one event directly causes another, ask if there is sufficient evidence to establish a cause-and-effect relationship. 
  • Ask if the claim is based merely on the chronological order or co-occurrence of the two events. 
  • Consider alternative possible explanations (are there other factors at play that could influence the outcome?).

By carefully analysing the reasoning, considering alternative explanations, and examining the evidence provided, you can identify a false cause fallacy and discern whether a causal claim is valid or flawed.

False cause fallacy examples include: 

  • Believing that wearing your lucky jersey will help your team win 
  • Thinking that everytime you wash your car, it rains
  • Claiming that playing video games causes violent behavior 

In each of these examples, we falsely assume that one event causes another without any proof.

The planning fallacy and procrastination are not the same thing. Although they both relate to time and task management, they describe different challenges:

  • The planning fallacy describes our inability to correctly estimate how long a future task will take, mainly due to optimism bias and a strong focus on the best-case scenario.
  • Procrastination refers to postponing a task, usually by focusing on less urgent or more enjoyable activities. This is due to psychological reasons, like fear of failure.

In other words, the planning fallacy refers to inaccurate predictions about the time we need to finish a task, while procrastination is a deliberate delay due to psychological factors.

A real-life example of the planning fallacy is the construction of the Sydney Opera House in Australia. When construction began in the late 1950s, it was initially estimated that it would be completed in four years at a cost of around $7 million.

Because the government wanted the construction to start before political opposition would stop it and while public opinion was still favorable, a number of design issues had not been carefully studied in advance. Due to this, several problems appeared immediately after the project commenced.

The construction process eventually stretched over 14 years, with the Opera House being completed in 1973 at a cost of over $100 million, significantly exceeding the initial estimates.

An example of appeal to pity fallacy is the following appeal by a student to their professor:

“Professor, please consider raising my grade. I had a terrible semester: my car broke down, my laptop got stolen, and my cat got sick.”

While these circumstances may be unfortunate, they are not directly related to the student’s academic performance.

While both the appeal to pity fallacy and   red herring fallacy can serve as a distraction from the original discussion topic, they are distinct fallacies. More specifically:

  • Appeal to pity fallacy attempts to evoke feelings of sympathy, pity, or guilt in an audience, so that they accept the speaker’s conclusion as truthful.
  • Red herring fallacy attempts to introduce an irrelevant piece of information that diverts the audience’s attention to a different topic.

Both fallacies can be used as a tool of deception. However, they operate differently and serve distinct purposes in arguments.

Argumentum ad misericordiam (Latin for “argument from pity or misery”) is another name for appeal to pity fallacy . It occurs when someone evokes sympathy or guilt in an attempt to gain support for their claim, without providing any logical reasons to support the claim itself. Appeal to pity is a deceptive tactic of argumentation, playing on people’s emotions to sway their opinion.

Yes, it’s quite common to start a sentence with a preposition, and there’s no reason not to do so.

For example, the sentence “ To many, she was a hero” is perfectly grammatical. It could also be rephrased as “She was a hero to  many”, but there’s no particular reason to do so. Both versions are fine.

Some people argue that you shouldn’t end a sentence with a preposition , but that “rule” can also be ignored, since it’s not supported by serious language authorities.

Yes, it’s fine to end a sentence with a preposition . The “rule” against doing so is overwhelmingly rejected by modern style guides and language authorities and is based on the rules of Latin grammar, not English.

Trying to avoid ending a sentence with a preposition often results in very unnatural phrasings. For example, turning “He knows what he’s talking about ” into “He knows about what he’s talking” or “He knows that about which he’s talking” is definitely not an improvement.

No, ChatGPT is not a credible source of factual information and can’t be cited for this purpose in academic writing . While it tries to provide accurate answers, it often gets things wrong because its responses are based on patterns, not facts and data.

Specifically, the CRAAP test for evaluating sources includes five criteria: currency , relevance , authority , accuracy , and purpose . ChatGPT fails to meet at least three of them:

  • Currency: The dataset that ChatGPT was trained on only extends to 2021, making it slightly outdated.
  • Authority: It’s just a language model and is not considered a trustworthy source of factual information.
  • Accuracy: It bases its responses on patterns rather than evidence and is unable to cite its sources .

So you shouldn’t cite ChatGPT as a trustworthy source for a factual claim. You might still cite ChatGPT for other reasons – for example, if you’re writing a paper about AI language models, ChatGPT responses are a relevant primary source .

ChatGPT is an AI language model that was trained on a large body of text from a variety of sources (e.g., Wikipedia, books, news articles, scientific journals). The dataset only went up to 2021, meaning that it lacks information on more recent events.

It’s also important to understand that ChatGPT doesn’t access a database of facts to answer your questions. Instead, its responses are based on patterns that it saw in the training data.

So ChatGPT is not always trustworthy . It can usually answer general knowledge questions accurately, but it can easily give misleading answers on more specialist topics.

Another consequence of this way of generating responses is that ChatGPT usually can’t cite its sources accurately. It doesn’t really know what source it’s basing any specific claim on. It’s best to check any information you get from it against a credible source .

No, it is not possible to cite your sources with ChatGPT . You can ask it to create citations, but it isn’t designed for this task and tends to make up sources that don’t exist or present information in the wrong format. ChatGPT also cannot add citations to direct quotes in your text.

Instead, use a tool designed for this purpose, like the Scribbr Citation Generator .

But you can use ChatGPT for assignments in other ways, to provide inspiration, feedback, and general writing advice.

GPT  stands for “generative pre-trained transformer”, which is a type of large language model: a neural network trained on a very large amount of text to produce convincing, human-like language outputs. The Chat part of the name just means “chat”: ChatGPT is a chatbot that you interact with by typing in text.

The technology behind ChatGPT is GPT-3.5 (in the free version) or GPT-4 (in the premium version). These are the names for the specific versions of the GPT model. GPT-4 is currently the most advanced model that OpenAI has created. It’s also the model used in Bing’s chatbot feature.

ChatGPT was created by OpenAI, an AI research company. It started as a nonprofit company in 2015 but became for-profit in 2019. Its CEO is Sam Altman, who also co-founded the company. OpenAI released ChatGPT as a free “research preview” in November 2022. Currently, it’s still available for free, although a more advanced premium version is available if you pay for it.

OpenAI is also known for developing DALL-E, an AI image generator that runs on similar technology to ChatGPT.

ChatGPT is owned by OpenAI, the company that developed and released it. OpenAI is a company dedicated to AI research. It started as a nonprofit company in 2015 but transitioned to for-profit in 2019. Its current CEO is Sam Altman, who also co-founded the company.

In terms of who owns the content generated by ChatGPT, OpenAI states that it will not claim copyright on this content , and the terms of use state that “you can use Content for any purpose, including commercial purposes such as sale or publication”. This means that you effectively own any content you generate with ChatGPT and can use it for your own purposes.

Be cautious about how you use ChatGPT content in an academic context. University policies on AI writing are still developing, so even if you “own” the content, you’re often not allowed to submit it as your own work according to your university or to publish it in a journal.

ChatGPT is a chatbot based on a large language model (LLM). These models are trained on huge datasets consisting of hundreds of billions of words of text, based on which the model learns to effectively predict natural responses to the prompts you enter.

ChatGPT was also refined through a process called reinforcement learning from human feedback (RLHF), which involves “rewarding” the model for providing useful answers and discouraging inappropriate answers – encouraging it to make fewer mistakes.

Essentially, ChatGPT’s answers are based on predicting the most likely responses to your inputs based on its training data, with a reward system on top of this to incentivise it to give you the most helpful answers possible. It’s a bit like an incredibly advanced version of predictive text. This is also one of ChatGPT’s limitations : because its answers are based on probabilities, they’re not always trustworthy .

OpenAI may store ChatGPT conversations for the purposes of future training. Additionally, these conversations may be monitored by human AI trainers.

Users can choose not to have their chat history saved. Unsaved chats are not used to train future models and are permanently deleted from ChatGPT’s system after 30 days.

The official ChatGPT app is currently only available on iOS devices. If you don’t have an iOS device, only use the official OpenAI website to access the tool. This helps to eliminate the potential risk of downloading fraudulent or malicious software.

ChatGPT conversations are generally used to train future models and to resolve issues/bugs. These chats may be monitored by human AI trainers.

However, users can opt out of having their conversations used for training. In these instances, chats are monitored only for potential abuse.

Yes, using ChatGPT as a conversation partner is a great way to practice a language in an interactive way.

Try using a prompt like this one:

“Please be my Spanish conversation partner. Only speak to me in Spanish. Keep your answers short (maximum 50 words). Ask me questions. Let’s start the conversation with the following topic: [conversation topic].”

Yes, there are a variety of ways to use ChatGPT for language learning , including treating it as a conversation partner, asking it for translations, and using it to generate a curriculum or practice exercises.

AI detectors aim to identify the presence of AI-generated text (e.g., from ChatGPT ) in a piece of writing, but they can’t do so with complete accuracy. In our comparison of the best AI detectors , we found that the 10 tools we tested had an average accuracy of 60%. The best free tool had 68% accuracy, the best premium tool 84%.

Because of how AI detectors work , they can never guarantee 100% accuracy, and there is always at least a small risk of false positives (human text being marked as AI-generated). Therefore, these tools should not be relied upon to provide absolute proof that a text is or isn’t AI-generated. Rather, they can provide a good indication in combination with other evidence.

Tools called AI detectors are designed to label text as AI-generated or human. AI detectors work by looking for specific characteristics in the text, such as a low level of randomness in word choice and sentence length. These characteristics are typical of AI writing, allowing the detector to make a good guess at when text is AI-generated.

But these tools can’t guarantee 100% accuracy. Check out our comparison of the best AI detectors to learn more.

You can also manually watch for clues that a text is AI-generated – for example, a very different style from the writer’s usual voice or a generic, overly polite tone.

Our research into the best summary generators (aka summarisers or summarising tools) found that the best summariser available in 2023 is the one offered by QuillBot.

While many summarisers just pick out some sentences from the text, QuillBot generates original summaries that are creative, clear, accurate, and concise. It can summarise texts of up to 1,200 words for free, or up to 6,000 with a premium subscription.

Try the QuillBot summarizer for free

Deep learning requires a large dataset (e.g., images or text) to learn from. The more diverse and representative the data, the better the model will learn to recognise objects or make predictions. Only when the training data is sufficiently varied can the model make accurate predictions or recognise objects from new data.

Deep learning models can be biased in their predictions if the training data consist of biased information. For example, if a deep learning model used for screening job applicants has been trained with a dataset consisting primarily of white male applicants, it will consistently favour this specific population over others.

A good ChatGPT prompt (i.e., one that will get you the kinds of responses you want):

  • Gives the tool a role to explain what type of answer you expect from it
  • Is precisely formulated and gives enough context
  • Is free from bias
  • Has been tested and improved by experimenting with the tool

ChatGPT prompts are the textual inputs (e.g., questions, instructions) that you enter into ChatGPT to get responses.

ChatGPT predicts an appropriate response to the prompt you entered. In general, a more specific and carefully worded prompt will get you better responses.

Yes, ChatGPT is currently available for free. You have to sign up for a free account to use the tool, and you should be aware that your data may be collected to train future versions of the model.

To sign up and use the tool for free, go to this page and click “Sign up”. You can do so with your email or with a Google account.

A premium version of the tool called ChatGPT Plus is available as a monthly subscription. It currently costs £16 and gets you access to features like GPT-4 (a more advanced version of the language model). But it’s optional: you can use the tool completely free if you’re not interested in the extra features.

You can access ChatGPT by signing up for a free account:

  • Follow this link to the ChatGPT website.
  • Click on “Sign up” and fill in the necessary details (or use your Google account). It’s free to sign up and use the tool.
  • Type a prompt into the chat box to get started!

A ChatGPT app is also available for iOS, and an Android app is planned for the future. The app works similarly to the website, and you log in with the same account for both.

According to OpenAI’s terms of use, users have the right to reproduce text generated by ChatGPT during conversations.

However, publishing ChatGPT outputs may have legal implications , such as copyright infringement.

Users should be aware of such issues and use ChatGPT outputs as a source of inspiration instead.

According to OpenAI’s terms of use, users have the right to use outputs from their own ChatGPT conversations for any purpose (including commercial publication).

However, users should be aware of the potential legal implications of publishing ChatGPT outputs. ChatGPT responses are not always unique: different users may receive the same response.

Furthermore, ChatGPT outputs may contain copyrighted material. Users may be liable if they reproduce such material.

ChatGPT can sometimes reproduce biases from its training data , since it draws on the text it has “seen” to create plausible responses to your prompts.

For example, users have shown that it sometimes makes sexist assumptions such as that a doctor mentioned in a prompt must be a man rather than a woman. Some have also pointed out political bias in terms of which political figures the tool is willing to write positively or negatively about and which requests it refuses.

The tool is unlikely to be consistently biased toward a particular perspective or against a particular group. Rather, its responses are based on its training data and on the way you phrase your ChatGPT prompts . It’s sensitive to phrasing, so asking it the same question in different ways will result in quite different answers.

Information extraction  refers to the process of starting from unstructured sources (e.g., text documents written in ordinary English) and automatically extracting structured information (i.e., data in a clearly defined format that’s easily understood by computers). It’s an important concept in natural language processing (NLP) .

For example, you might think of using news articles full of celebrity gossip to automatically create a database of the relationships between the celebrities mentioned (e.g., married, dating, divorced, feuding). You would end up with data in a structured format, something like MarriageBetween(celebrity 1 ,celebrity 2 ,date) .

The challenge involves developing systems that can “understand” the text well enough to extract this kind of data from it.

Knowledge representation and reasoning (KRR) is the study of how to represent information about the world in a form that can be used by a computer system to solve and reason about complex problems. It is an important field of artificial intelligence (AI) research.

An example of a KRR application is a semantic network, a way of grouping words or concepts by how closely related they are and formally defining the relationships between them so that a machine can “understand” language in something like the way people do.

A related concept is information extraction , concerned with how to get structured information from unstructured sources.

Yes, you can use ChatGPT to summarise text . This can help you understand complex information more easily, summarise the central argument of your own paper, or clarify your research question.

You can also use Scribbr’s free text summariser , which is designed specifically for this purpose.

Yes, you can use ChatGPT to paraphrase text to help you express your ideas more clearly, explore different ways of phrasing your arguments, and avoid repetition.

However, it’s not specifically designed for this purpose. We recommend using a specialised tool like Scribbr’s free paraphrasing tool , which will provide a smoother user experience.

Yes, you use ChatGPT to help write your college essay by having it generate feedback on certain aspects of your work (consistency of tone, clarity of structure, etc.).

However, ChatGPT is not able to adequately judge qualities like vulnerability and authenticity. For this reason, it’s important to also ask for feedback from people who have experience with college essays and who know you well. Alternatively, you can get advice using Scribbr’s essay editing service .

No, having ChatGPT write your college essay can negatively impact your application in numerous ways. ChatGPT outputs are unoriginal and lack personal insight.

Furthermore, Passing off AI-generated text as your own work is considered academically dishonest . AI detectors may be used to detect this offense, and it’s highly unlikely that any university will accept you if you are caught submitting an AI-generated admission essay.

However, you can use ChatGPT to help write your college essay during the preparation and revision stages (e.g., for brainstorming ideas and generating feedback).

ChatGPT and other AI writing tools can have unethical uses. These include:

  • Reproducing biases and false information
  • Using ChatGPT to cheat in academic contexts
  • Violating the privacy of others by inputting personal information

However, when used correctly, AI writing tools can be helpful resources for improving your academic writing and research skills. Some ways to use ChatGPT ethically include:

  • Following your institution’s guidelines
  • Critically evaluating outputs
  • Being transparent about how you used the tool

Ask our team

Want to contact us directly? No problem. We are always here for you.

Support team - Nina

Our support team is here to help you daily via chat, WhatsApp, email, or phone between 9:00 a.m. to 11:00 p.m. CET.

Our APA experts default to APA 7 for editing and formatting. For the Citation Editing Service you are able to choose between APA 6 and 7.

Yes, if your document is longer than 20,000 words, you will get a sample of approximately 2,000 words. This sample edit gives you a first impression of the editor’s editing style and a chance to ask questions and give feedback.

How does the sample edit work?

You will receive the sample edit within 24 hours after placing your order. You then have 24 hours to let us know if you’re happy with the sample or if there’s something you would like the editor to do differently.

Read more about how the sample edit works

Yes, you can upload your document in sections.

We try our best to ensure that the same editor checks all the different sections of your document. When you upload a new file, our system recognizes you as a returning customer, and we immediately contact the editor who helped you before.

However, we cannot guarantee that the same editor will be available. Your chances are higher if

  • You send us your text as soon as possible and
  • You can be flexible about the deadline.

Please note that the shorter your deadline is, the lower the chance that your previous editor is not available.

If your previous editor isn’t available, then we will inform you immediately and look for another qualified editor. Fear not! Every Scribbr editor follows the  Scribbr Improvement Model  and will deliver high-quality work.

Yes, our editors also work during the weekends and holidays.

Because we have many editors available, we can check your document 24 hours per day and 7 days per week, all year round.

If you choose a 72 hour deadline and upload your document on a Thursday evening, you’ll have your thesis back by Sunday evening!

Yes! Our editors are all native speakers, and they have lots of experience editing texts written by ESL students. They will make sure your grammar is perfect and point out any sentences that are difficult to understand. They’ll also notice your most common mistakes, and give you personal feedback to improve your writing in English.

Every Scribbr order comes with our award-winning Proofreading & Editing service , which combines two important stages of the revision process.

For a more comprehensive edit, you can add a Structure Check or Clarity Check to your order. With these building blocks, you can customize the kind of feedback you receive.

You might be familiar with a different set of editing terms. To help you understand what you can expect at Scribbr, we created this table:

View an example

When you place an order, you can specify your field of study and we’ll match you with an editor who has familiarity with this area.

However, our editors are language specialists, not academic experts in your field. Your editor’s job is not to comment on the content of your dissertation, but to improve your language and help you express your ideas as clearly and fluently as possible.

This means that your editor will understand your text well enough to give feedback on its clarity, logic and structure, but not on the accuracy or originality of its content.

Good academic writing should be understandable to a non-expert reader, and we believe that academic editing is a discipline in itself. The research, ideas and arguments are all yours – we’re here to make sure they shine!

After your document has been edited, you will receive an email with a link to download the document.

The editor has made changes to your document using ‘Track Changes’ in Word. This means that you only have to accept or ignore the changes that are made in the text one by one.

It is also possible to accept all changes at once. However, we strongly advise you not to do so for the following reasons:

  • You can learn a lot by looking at the mistakes you made.
  • The editors don’t only change the text – they also place comments when sentences or sometimes even entire paragraphs are unclear. You should read through these comments and take into account your editor’s tips and suggestions.
  • With a final read-through, you can make sure you’re 100% happy with your text before you submit!

You choose the turnaround time when ordering. We can return your dissertation within 24 hours , 3 days or 1 week . These timescales include weekends and holidays. As soon as you’ve paid, the deadline is set, and we guarantee to meet it! We’ll notify you by text and email when your editor has completed the job.

Very large orders might not be possible to complete in 24 hours. On average, our editors can complete around 13,000 words in a day while maintaining our high quality standards. If your order is longer than this and urgent, contact us to discuss possibilities.

Always leave yourself enough time to check through the document and accept the changes before your submission deadline.

Scribbr is specialised in editing study related documents. We check:

  • Graduation projects
  • Dissertations
  • Admissions essays
  • College essays
  • Application essays
  • Personal statements
  • Process reports
  • Reflections
  • Internship reports
  • Academic papers
  • Research proposals
  • Prospectuses

Calculate the costs

The fastest turnaround time is 24 hours.

You can upload your document at any time and choose between three deadlines:

At Scribbr, we promise to make every customer 100% happy with the service we offer. Our philosophy: Your complaint is always justified – no denial, no doubts.

Our customer support team is here to find the solution that helps you the most, whether that’s a free new edit or a refund for the service.

Yes, in the order process you can indicate your preference for American, British, or Australian English .

If you don’t choose one, your editor will follow the style of English you currently use. If your editor has any questions about this, we will contact you.

Literature reviews as independent studies: guidelines for academic practice

  • Original Paper
  • Open access
  • Published: 14 October 2022
  • Volume 16 , pages 2577–2595, ( 2022 )

Cite this article

You have full access to this open access article

  • Sascha Kraus   ORCID: orcid.org/0000-0003-4886-7482 1 , 2 ,
  • Matthias Breier 3 ,
  • Weng Marc Lim 4 , 8 , 22 ,
  • Marina Dabić 5 , 6 ,
  • Satish Kumar 7 , 8 ,
  • Dominik Kanbach 9 , 10 ,
  • Debmalya Mukherjee 11 ,
  • Vincenzo Corvello 12 ,
  • Juan Piñeiro-Chousa 13 ,
  • Eric Liguori 14 ,
  • Daniel Palacios-Marqués 15 ,
  • Francesco Schiavone 16 , 17 ,
  • Alberto Ferraris 18 , 21 ,
  • Cristina Fernandes 19 , 20 &
  • João J. Ferreira 19  

66k Accesses

267 Citations

4 Altmetric

Explore all metrics

Review articles or literature reviews are a critical part of scientific research. While numerous guides on literature reviews exist, these are often limited to the philosophy of review procedures, protocols, and nomenclatures, triggering non-parsimonious reporting and confusion due to overlapping similarities. To address the aforementioned limitations, we adopt a pragmatic approach to demystify and shape the academic practice of conducting literature reviews. We concentrate on the types, focuses, considerations, methods, and contributions of literature reviews as independent, standalone studies. As such, our article serves as an overview that scholars can rely upon to navigate the fundamental elements of literature reviews as standalone and independent studies, without getting entangled in the complexities of review procedures, protocols, and nomenclatures.

Similar content being viewed by others

what is variable in literature review

What is Qualitative in Qualitative Research

Patrik Aspers & Ugo Corte

what is variable in literature review

Why, When, Who, What, How, and Where for Trainees Writing Literature Review Articles

Gerry L. Koons, Katja Schenke-Layland & Antonios G. Mikos

what is variable in literature review

Criteria for Good Qualitative Research: A Comprehensive Review

Drishti Yadav

Avoid common mistakes on your manuscript.

1 Introduction

A literature review – or a review article – is “a study that analyzes and synthesizes an existing body of literature by identifying, challenging, and advancing the building blocks of a theory through an examination of a body (or several bodies) of prior work (Post et al. 2020 , p. 352). Literature reviews as standalone pieces of work may allow researchers to enhance their understanding of prior work in their field, enabling them to more easily identify gaps in the body of literature and potential avenues for future research. More importantly, review articles may challenge established assumptions and norms of a given field or topic, recognize critical problems and factual errors, and stimulate future scientific conversations around that topic. Literature reviews Footnote 1 come in many different formats and purposes:

Some review articles conduct a critical evaluation of the literature, whereas others elect to adopt a more exploratory and descriptive approach.

Some reviews examine data, methodologies, and findings, whereas others look at constructs, themes, and theories.

Some reviews provide summaries by holistically synthesizing the existing research on a topic, whereas others adopt an integrative approach by assessing related and interdisciplinary work.

The number of review articles published as independent or standalone studies has been increasing over time. According to Scopus (i.e., search database ), reviews (i.e., document type ) were first published in journals (i.e., source type ) as independent studies in 1945, and they subsequently appeared in three digits yearly from the late 1980s to the late 1990s, four digits yearly from the early 2000s to the late 2010s, and five digits in the year 2021 (Fig.  1 ). This increase is indicative that reviewers and editors in business and management research alike see value and purpose in review articles to such a level that they are now commonly accepted as independent, standalone studies. This development is also reflected in the fact that some academic journals exclusively publish review articles (e.g., the Academy of Management Annals , or the  International Journal of Management Reviews ), and journals publishing in various fields often have special issues dedicated to literature reviews on certain topic areas (e.g., the Journal of Management and the Journal of International Business Studies ).

figure 1

Full-year publication trend of review articles on Scopus (1945–2021)

One of the most important prerequisites of a high-quality review article is that the work follows an established methodology, systematically selects and analyzes articles, and periodically covers the field to identify latest developments (Snyder 2019 ). Additionally, it needs to be reproducible, well-evidenced, and transparent, resulting in a sample inclusive of all relevant and appropriate studies (Gusenbauer and Haddaway 2020; Hansen et al. 2021 ). This observation is in line with Palmatier et al. ( 2018 ), who state that review articles provide an important synthesis of findings and perspectives in a given body of knowledge. Snyder ( 2019 ) also reaffirmed this rationale, pointing out that review articles have the power to answer research questions beyond that which can be achieved in a single study. Ultimately, readers of review articles stand to gain a one-stop, state-of-the-art synthesis (Lim et al. 2022a ; Popli et al. 2022) that encapsulates critical insights through the process of re-interpreting, re-organizing, and re-connecting a body knowledge (Fan et al. 2022 ).

There are many reasons to conduct review articles. Kraus et al. ( 2020 ) explicitly mention the benefits of conducting systematic reviews by declaring that they often represent the first step in the context of larger research projects, such as doctoral dissertations. When carrying out work of this kind, it is important that a holistic overview of the current state of literature is achieved and embedded into a proper synthesis. This allows researchers to pinpoint relevant research gaps and adequately fit future conceptual or empirical studies into the state of the academic discussion (Kraus et al., 2021 ). A review article as an independent or standalone study is a viable option for any academic – especially young scholars, such as doctoral candidates – who wishes to delve into a specific topic for which a (recent) review article is not available.

The process of conducting a review article can be challenging, especially for novice scholars (Boell and Cecez-Kecmanovic 2015 ). Therefore, it is not surprising that numerous guides have been written in an attempt to improve the quality of review studies and support emerging scholars in their endeavors to have their work published. These guides for conducting review articles span a variety of academic fields, such as engineering education (Borrego et al. 2014 ), health sciences (Cajal et al. 2020 ), psychology (Laher and Hassem 2020 ), supply chain management (Durach et al. 2017 ), or business and entrepreneurship (Kraus et al. 2020 ; Tranfield et al. 2003 ) – the latter were among the first scholars to recognize the need to educate business/management scholars on the roles of review studies in assembling, ascertaining, and assessing the intellectual territory of a specific knowledge domain. Furthermore, they shed light on the stages (i.e., planning the review, conducting the review, reporting, and dissemination) and phases (i.e., identifying the need for a review, preparation of a proposal for a review, development of a review protocol, identification of research, selection of studies, study quality assessment, data extraction and monitoring progress, data synthesis, the report and recommendations, and getting evidence into practice) of conducting a systematic review. Other scholars have either adapted and/or developed new procedures (Kraus et al. 2020 ; Snyder 2019 ) or established review protocols such as the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram (Moher et al. 2015 ). The latter provides a checklist that improves transparency and reproducibility, thus reducing questionable research practices. The declarative and procedural knowledge of a checklist allows users to derive value from (and, in some cases, produce) methodological literature reviews.

Two distinct and critical gaps or issues provide impetus for our article. First, while the endeavors of the named scholars are undoubtedly valuable contributions, they often encourage other scholars to explain the methodology of their review studies in a non-parsimonious way ( 1st issue ). This can become problematic if this information distracts and deprives scholars from providing richer review findings, particularly in instances in which publication outlets impose a strict page and/or word limit. More often than not, the early parts (i.e., stages/phases, such as needs, aims, and scope) of these procedures or protocols are explained in the introduction, but they tend to be reiterated in the methodology section due to the prescription of these procedures or protocols. Other parts of these procedures or protocols could also be reported more parsimoniously, for example, by filtering out documents, given that scientific databases (such as Scopus or Web of Science ) have since been upgraded to allow scholars to select and implement filtering criteria when conducting a search (i.e., criterion-by-criterion filtering may no longer be necessary). More often than not, the procedures or protocols of review studies can be signposted (e.g., bracket labeling) and disclosed in a sharp and succinct manner while maintaining transparency and replicability.

Other guides have been written to introduce review nomenclatures (i.e., names/naming) and their equivalent philosophical underpinnings. Palmatier et al. ( 2018 ) introduced three clearly but broadly defined nomenclatures of literature reviews as independent studies: domain-based reviews, theory-based reviews, and method-based reviews. However, such review nomenclatures can be confusing due to their overlapping similarities ( 2nd issue ). For example, Lim et al. ( 2022a ) highlighted their observation that the review nomenclatures associated with domain-based reviews could also be used for theory-based and method-based reviews.

The two aforementioned issues – i.e., the lack of a parsimonious understanding and the reporting of the review methodology , and the confusion emerging from review nomenclatures – are inarguably the unintended outcomes of diving into an advanced (i.e., higher level) understanding of literature review procedures, protocols, and nomenclatures from a philosophical perspective (i.e., underpinnings) without a foundational (i.e., basic level) understanding of the fundamental (i.e., core) elements of literature reviews from a pragmatic perspective. Our article aims to shed light on these issues and hopes to provide clarity for future scholarly endeavors.

Having a foundational understanding of literature reviews as independent studies is (i) necessary when addressing the aforementioned issues; (ii) important in reconciling and scaffolding our understanding, and (iii) relevant and timely due to the proliferation of literature reviews as independent studies. To contribute a solution toward addressing this gap , we aim to demystify review articles as independent studies from a pragmatic standpoint (i.e., practicality). To do so, we deliberately (i) move away from review procedures, protocols, and nomenclatures, and (ii) invest our attention in developing a parsimonious, scaffolded understanding of the fundamental elements (i.e., types, focuses, considerations, methods, and contributions) of review articles as independent studies.

Three contributions distinguish our article. It is worth noting that pragmatic guides (i.e., foundational knowledge), such as the present one, are not at odds with extant philosophical guides (i.e., advanced knowledge), but rather they complement them. Having a foundational knowledge of the fundamental elements of literature reviews as independent studies is valuable , as it can help scholars to (i) gain a good grasp of the fundamental elements of literature reviews as independent studies ( 1st contribution ), and (ii) mindfully adopt or adapt existing review procedures, protocols, and nomenclatures to better suit the circumstances of their reviews (e.g., choosing and developing a well-defined review nomenclature, and choosing and reporting on review considerations and steps more parsimoniously) ( 2nd contribution ). Therefore, this pragmatic guide serves as (iii) a foundational article (i.e., preparatory understanding) for literature reviews as independent studies ( 3rd contribution ). Following this, extant guides using a philosophical approach (i.e., advanced understanding) could be relied upon to make informed review decisions (e.g., adoption, adaptation) in response to the conventions of extant review procedures, protocols, and nomenclatures (Fig.  2 ).

figure 2

Foundational and advanced understanding of literature reviews as independent studies

2 Fundamental elements of literature reviews as independent studies

A foundational understanding of literature reviews as independent studies can be acquired through the appreciation of five fundamental elements – i.e., types, focuses, considerations, methods, and contributions – which are illustrated in Fig.  3 and summarized in the following sections.

figure 3

Fundamental elements of literature reviews as independent studies

There are two types of literature reviews as independent studies: systematic literature reviews ( SLRs ) and non-systematic literature reviews ( non-SLRs ). It is important to recognize that SLRs and non-SLRs are not review nomenclatures (i.e., names/naming) but rather review types (i.e., classifications).

In particular, SLRs are reviews carried out in a systematic way using an adopted or adapted procedure or protocol to guide data curation and analysis, thus enabling transparent disclosure and replicability (Lim et al. 2022a ; Kraus et al. 2020 ). Therefore, any review nomenclature guided by a systematic methodology is essentially an SLR. The origin of this type of literature review can be traced back to the evidence-based medicine movement in the early 1990s, with the objective being to overcome the issue of inconclusive findings in studies for medical treatments (Boell and Cecez-Kecmanovic 2015 ).

In contrast, non-SLRs are reviews conducted without any systematic procedure or protocol; instead, they weave together relevant literature based on the critical evaluations and (subjective) choices of the author(s) through a process of discovery and critique (e.g., pointing out contradictions and questioning assertions or beliefs); they are shaped by the exposure, expertise, and experience (i.e., the “3Es” in judgement calls) of the author(s). Therefore, non-SLRs are essentially critical reviews of the literature (Lim and Weissmann 2021 ).

2.2 Focuses

Unlike Palmatier et al. ( 2018 ) who considered domain-based reviews, theory-based reviews, and method-based reviews as review nomenclatures, we consider domain , theory , and method as three substantive focuses that can take center stage in literature reviews as independent studies. This is in line with our attempt to move away from review nomenclatures when providing a foundational understanding of literature reviews as independent studies.

A review that is domain-focused can examine: (i) a  concept (e.g., customer engagement; Lim et al. 2022b ; digital transformation; Kraus et al. 2021 ; home sharing; Lim et al. 2021 ; sharing economy; Lim 2020 ), (ii) a context (e.g., India; Mukherjee et al. 2022a ), (iii) a discipline (e.g., entrepreneurship; Ferreira et al. 2015 ; international business; Ghauri et al. 2021 ), (iv) a field (e.g., family business; Lahiri et al. 2020 ; Rovelli et al. 2021 ; female entrepreneurship; Ojong et al. 2021 ), or (v) an outlet (e.g., Journal of Business Research ; Donthu et al. 2020 ; Management International Review ; Mukherjee et al. 2021 ; Review of Managerial Science ; Mas-Tur et al. 2020 ), which typically offer broad, overarching insights.

Domain-focused hybrids , such as the between-domain hybrid (e.g., concept-discipline hybrid, such as digital transformation in business and management; Kraus et al. 2022 ; religion in business and entrepreneurship; Kumar et al. 2022a ; personality traits in entrepreneurship; Salmony and Kanbach 2022 ; and policy implications in HR and OB research; Aguinis et al., 2022 ) and the within-domain hybrid (e.g., the concept-concept hybrid, such as customer engagement and social media; Lim and Rasul 2022 ; and global business and organizational excellence; Lim 2022 ; and the discipline-discipline hybrid, such as neuromarketing; Lim 2018 ) are also common as they can provide finer-grained insights.

A review that is theory-focused can explore a standalone theory (e.g., theory of planned behavior; Duan and Jiang 2008 ), as well as a theory in conjunction with a domain , such as the concept-theory hybrid (e.g., behavioral control and theory of planned behavior; Lim and Weissmann 2021 ) and the theory-discipline hybrid (e.g., theory of planned behavior in hospitality, leisure, and tourism; Ulker-Demirel and Ciftci 2020 ), or a theory in conjunction with a method (e.g., theory of planned behavior and structural equation modeling).

A review that is method-focused can investigate a standalone method (e.g., structural equation modeling; Deng et al. 2018 ) or a method in conjunction with a domain , such as the method-discipline hybrid (e.g., fsQCA in business and management; Kumar et al. 2022b ).

2.3 Planning the review, critical considerations, and data collection

The considerations required for literature reviews as independent studies depend on their type: SLRs or non-SLRs.

For non-SLRs, scholars often rely on the 3Es (i.e., exposure, expertise, and experience) to provide a critical review of the literature. Scholars who embark on non-SLRs should be well versed with the literature they are dealing with. They should know the state of the literature (e.g., debatable, underexplored, and well-established knowledge areas) and how it needs to be deciphered (e.g., tenets and issues) and approached (e.g., reconciliation proposals and new pathways) to advance theory and practice. In this regard, non-SLRs follow a deductive reasoning approach, whereby scholars initially develop a set of coverage areas for reviewing a domain, theory, or method and subsequently draw on relevant literature to shed light and support scholarly contentions in each area.

For SLRs, scholars often rely on a set of criteria to provide a well-scoped (i.e., breadth and depth), structured (i.e., organized aspects), integrated (i.e., synthesized evidence) and interpreted/narrated (i.e., describing what has happened, how and why) systematic review of the literature. Footnote 2 In this regard, SLRs follow an inductive reasoning approach, whereby a set of criteria is established and implemented to develop a corpus of scholarly documents that scholars can review. They can then deliver a state-of-the-art overview, as well as a future agenda for a domain, theory, or method. Such criteria are often listed in philosophical guides on SLR procedures (e.g., Kraus et al. 2020 ; Snyder 2019 ) and protocols (e.g., PRISMA), and they may be adopted/adapted with justifications Footnote 3 . Based on their commonalities they can be summarized as follows:

Search database (e.g., “Scopus” and/or “Web of Science”) can be defined based on justified evidence (e.g., by the two being the largest scientific databases of scholarly articles that can provide on-demand bibliographic data or records; Pranckutė 2021 ). To avoid biased outcomes due to the scope covered by the selected database, researchers could utilize two or more different databases (Dabić et al. 2021 ).

Search keywords may be developed by reading scholarly documents and subsequently brainstorming with experts. The expanding number of databases, journals, periodicals, automated approaches, and semi-automated procedures that use text mining and machine learning can offer researchers the ability to source new, relevant research and forecast the citations of influential studies. This enables them to determine further relevant articles.

Boolean operators (e.g., AND, OR) should be strategically used in developing the  string   of search keywords (e.g., “engagement” AND “customer” OR “consumer” OR “business”). Furthermore, the correct and precise application of quotation marks is important but is very frequently sidestepped, resulting in incorrect selection processes and differentiated results.

Search period (e.g., between a specified period [e.g., 2000 to 2020] or up to the latest full year at the time or writing [e.g., up to 2021]) can be defined based on the justified scope of study (e.g., contemporary evolution versus historical trajectory).

Search field (e.g., “article title, abstract, keywords”) can be defined based on justified assumptions (e.g., it is assumed that the focus of relevant documents will be mentioned in the article title, abstract, and/or keywords).

Subject area (e.g., “business, management, and accounting”) can be defined based on justified principles (e.g., the focus of the review is on the marketing discipline, which is located under the “business, management, and accounting” subject area in Scopus).

Publication stage (e.g., “final”) can be defined based on justified grounds (e.g., enabling greater accuracy in replication).

Document type (e.g., “article” and/or “review”), which reflects the type of scientific/practical contributions (e.g., empirical, synthesis, thought), can be defined based on justified rationales (e.g., articles selected because they are peer-reviewed; editorials not selected because they are not peer-reviewed).

Source type (e.g., “journal”) can be defined based on justified reasons (e.g., journals selected because they publish finalized work; conference proceedings not selected because they are work in progress, and in business/management, they are usually not being considered as full-fledged “publications”).

Language (e.g., “English”) can be determined based on justified limitations (e.g., nowadays, there are not many reasons to use another language besides the academic lingua franca English). Different spellings should also be considered, as the literature may contain both American and British spelling variants (e.g., organization and organisation). Truncation and wildcards in searches are recommended to capture both sets of spellings. It is important to note that each database varies in its symbology.

Quality filtering (e.g., “A*” and “A” or “4*”, “4”, and “3”) can be defined based on justified motivations (e.g., the goal is to unpack the most originally and rigorously produced knowledge, which is the hallmark of premier journals, such as those ranked “A*” and “A” by the Australian Business Deans Council [ABDC] Journal Quality List [JQL] and rated “4*”, “4”, and “3” by the Chartered Association of Business Schools [CABS] Academic Journal Guide [AJG]).

Document relevance (i.e., within the focus of the review) can be defined based on justified judgement (e.g., for a review focusing on customer engagement, articles that mention customer engagement as a passing remark without actually investigating it would be excluded).

Others: Screening process should be accomplished by beginning with the deduction of duplicate results from other databases, tracked using abstract screening to exclude unfitting studies, and ending with the full-text screening of the remaining documents.

Others: Exclusion-inclusion criteria interpretation of the abstracts/articles is obligatory when deciding whether or not the articles dealt with the matter. This step could involve removing a huge percentage of initially recognized articles.

Others: Codebook building pertains to the development of a codebook of the main descriptors within a specific field. An inductive approach can be followed and, in this case, descriptors are not established beforehand. Instead, they are established through the analysis of the articles’ content. This procedure is made up of several stages: (i) the extraction of important content from titles, abstracts, and keywords; (ii) the classification of this content to form a reduced list of the core descriptors; and (iii) revising the codebook in iterations and combining similar categories, thus developing a short list of descriptors (López-Duarte et al. 2016 , p. 512; Dabić et al. 2015 ; Vlacic et al. 2021 ).

2.4 Methods

Various methods are used to analyze the pertinent literature. Often, scholars choose a method for corpus analysis before corpus curation. Knowing the analytical technique beforehand is useful, as it allows researchers to acquire and prepare the right data in the right format. This typically occurs when scholars have decided upon and justified pursuing a specific review nomenclature upfront (e.g., bibliometric reviews) based on the problem at hand (e.g., broad domain [outlet] with a large corpus [thousands of articles], such as a premier journal that has been publishing for decades) (Donthu et al. 2021 ). However, this may not be applicable in instances where (i) scholars do not curate a corpus of articles (non-SLRs), and (ii) scholars only know the size of the corpus of articles once that corpus is curated (SLRs). Therefore, scholars may wish to decide on a method of analyzing the literature depending on (i) whether they rely on a corpus of articles (i.e., yes or no), and (ii) the size of the corpus of articles that they rely on to review the literature (i.e., n  = 0 to ∞).

When analytical techniques (e.g., bibliometric analysis, critical analysis, meta-analysis) are decoupled from review nomenclatures (e.g., bibliometric reviews, critical reviews, meta-analytical reviews), we uncover a toolbox of the following methods for use when analyzing the literature:

Bibliometric analysis measures the literature and processes data by using algorithm, arithmetic, and statistics to analyze, explore, organize, and investigate large amounts of data. This enables scholars to identify and recognize potential “hidden patterns” that could help them during the literature review process. Bibliometrics allows scholars to objectively analyze a large corpus of articles (e.g., high hundreds or more) using quantitative techniques (Donthu et al. 2021 ). There are two overarching categories for bibliometric analysis: performance analysis and science mapping. Performance analysis enables scholars to assess the productivity (publication) and impact (citation) of the literature relating to a domain, method, or theory using various quantitative metrics (e.g., average citations per publication or year, h -index, g -index, i -index). Science mapping grants scholars the ability to map the literature in that domain, method, or theory based on bibliographic data (e.g., bibliographic coupling generates thematic clusters based on similarities in shared bibliographic data [e.g., references] among citing articles; co-citation analysis generates thematic clusters based on commonly cited articles; co-occurrence analysis generates thematic clusters based on bibliographic data [e.g., keywords] that commonly appear together; PageRank analysis generates thematic clusters based on articles that are commonly cited in highly cited articles; and topic modeling generates thematic clusters based on the natural language processing of bibliographic data [e.g., article title, abstract, and keywords]). Footnote 4 Given the advancement in algorithms and technology, reviews using bibliometric analysis are considered to be smart (Kraus et al. 2021 ) and technologically-empowered (Kumar et al. 2022b ) SLRs, in which a review has harnessed the benefits of (i) the machine learning of the bibliographic data of scholarly research from technologically-empowered scientific databases, and (ii) big data analytics involving various science mapping techniques (Kumar et al. 2022c ).

Content analysis allows scholars to analyze a small to medium corpus of articles (i.e., tens to low hundreds) using quantitative and qualitative techniques. From a quantitative perspective , scholars can objectively carry out a content analysis by quantifying a specific unit of analysis . A useful method of doing so involves adopting, adapting, or developing an organizing framework . For example, Lim et al. ( 2021 ) employed an organizing (ADO-TCM) framework to quantify content in academic literature based on: (i) the categories of knowledge; (ii) the relationships between antecedents, decisions, and outcomes; and (iii) the theories, contexts, and methods used to develop the understanding for (i) and (ii). The rapid evolution of software for content analysis allows scholars to carry out complex elaborations on the corpus of analyzed articles, so much so that the most recent software enables the semi-automatic development of an organizing framework (Ammirato et al. 2022 ). From a qualitative perspective , scholars can conduct a content analysis or, more specifically, a thematic analysis , by subjectively organizing the content into themes. For example, Creevey et al. ( 2022 ) reviewed the literature on social media and luxury, providing insights on five core themes (i.e., luxury brand strategy, luxury brand social media communications, luxury consumer attitudes and perceptions, engagement, and the influence of social media on brand performance-related outcomes) generated through a content (thematic) analysis. Systematic approaches for inductive concept development through qualitative research are similarly applied in literature reviews in an attempt to reduce the subjectivity of derived themes. Following the principles of the approach by Gioia et al. ( 2012 ), Korherr and Kanbach ( 2021 ) develop a taxonomy of human-related capabilities in big data analytics. Building on a sample of 75 studies for the literature review, 33 first-order concepts are identified. These are categorized into 15 second-order themes and are finally merged into five aggregate dimensions. Using the same procedure, Leemann and Kanbach ( 2022 ) identify 240 idiosyncratic dynamic capabilities in a sample of 34 studies for their literature review. They then categorize these into 19 dynamic sub-capabilities. The advancement of technology also makes it possible to conduct content analysis using computer assisted qualitative data analysis (CAQDA) software (e.g., ATLAS.ti, Nvivo, Quirkos) (Lim et al. 2022a ).

Critical analysis allows scholars to subjectively use their 3Es (i.e., exposure, expertise, and experience) to provide a critical evaluation of academic literature. This analysis is typically used in non-SLRs, and can be deployed in tandem with other analyses, such as bibliometric analysis and content analysis in SLRs, which are used to discuss consensual, contradictory, and underexplored areas of the literature. For SLRs, scholars are encouraged to engage in critical evaluations of the literature so that they can truly contribute to advancing theory and practice (Baker et al. 2022 ; Lim et al. 2022a ; Mukherjee et al. 2022b ).

Meta-analysis allows scholars to objectively establish a quantitative estimate of commonly studied relationships in the literature (Grewal et al. 2018 ). This analysis is typically employed in SLRs intending to reconcile a myriad of relationships (Lim et al. 2022a ). The relationships established are often made up of conflicting evidence (e.g., a positive or significant effect in one study, but a negative or non-significant effect in another study). However, through meta-analysis, scholars are able to identify potential factors (e.g., contexts or sociodemographic information) that may have led to the conflict.

Others: Multiple correspondence analysis helps to map the field, assessing the associations between qualitative content within a matrix of variables and cases. Homogeneity Analysis by Means of Alternating Least Squares ( HOMALS ) is also considered useful in allowing researchers to map out the intellectual structure of a variety of research fields (Gonzalez-Loureiro et al. 2015 ; Gonzalez-Louriero 2021; Obradović et al. 2021 ). HOMALS can be performed in R or used along with a matrix through SPSS software. In summary, the overall objective of this analysis is to discover a low dimensional representation of the original high dimensional space (i.e., the matrix of descriptors and articles). To measure the goodness of fit, a loss function is used. This function is used minimally, and the HOMALS algorithm is applied to the least squares loss functions in SPSS. This analysis provides a proximity map, in which articles and descriptors are shown in low-dimensional spaces (typically on two axes). Keywords are paired and each couple that appears together in a large number of articles is shown to be closer on the map and vice-versa.

When conducting a literature review, software solutions allow researchers to cover a broad range of variables, from built-in functions of statistical software packages to software orientated towards meta-analyses, and from commercial to open-source solutions. Personal preference plays a huge role, but the decision as to which software will be the most useful is entirely dependent on how complex the methods and the dataset are. Of all the commercial software providers, we have found the built-in functions of (i) R and VOSviewer most useful in performing bibliometric analysis (Aria and Cuccurullo 2017 ; R Core Team 2021 ; Van Eck and Waltman 2014 ) and (ii) Stata most useful in performing meta-analytical tasks.

Many different analytical tools have been used. These include simple document counting, citation analysis, word frequency analysis, cluster analysis, co-word analysis, and cooperation analysis (Daim et al. 2006 ). Software has also been produced for bibliometric analysis, such as the Thomson Data Analyzer (TDA), which Thomson Reuters created, and CiteSpace developed by Chen ( 2013 ). VOSviewer helps us to construct and visualize bibliometric networks, which can include articles, journals, authors, countries, and institutions, among others (Van Eck and Waltman 2014 ). These can be organized based on citations, co-citations, bibliographic coupling, or co-authorship relations. In addition, VOSviewer provides text mining functions, which can be used to facilitate a better understanding of co-occurrence networks with regards to the key terms taken from a body of scientific literature (Donthu et al. 2021 ; Wong 2018 ). Other frequently used tools include for bibliometric analysis include Bibliometrix/Biblioshiny in R, CitNetExplorer, and Gephi, among others.

2.5 Contributions

Well-conducted literature reviews may make multiple contributions to the literature as standalone, independent studies.

Generally, there are three primary contributions of literature reviews as independent studies: (i) to provide an overview of current knowledge in the domain, method, or theory, (ii) to provide an evaluation of knowledge progression in the domain, method, or theory, including the establishment of key knowledge, conflicting or inconclusive findings, and emerging and underexplored areas, and (iii) to provide a proposal for potential pathways for advancing knowledge in the domain, method, or theory (Lim et al. 2022a , p. 487). Developing theory through literature reviews can take many forms, including organizing and categorizing the literature, problematizing the literature, identifying and exposing contradictions, developing analogies and metaphors, and setting out new narratives and conceptualizations (Breslin and Gatrell 2020 ). Taken collectively, these contributions offer crystalized, evidence-based insights that both ‘mine’ and ‘prospect’ the literature, highlighting extant gaps and how they can be resolved (e.g., flags paradoxes or theoretical tensions, explaining why something has not been done, what the challenges are, and how these challenges can be overcome). These contributions can be derived through successful bibliometric analysis, content analysis, critical analysis, and meta-analysis.

Additionally, the deployment of specific methods can bring in further added value. For example, a performance analysis in a bibliometric analysis can contribute to: (i) objectively assessing and reporting research productivity and impact ; (ii) ascertaining reach for coverage claims ; (iii) identifying social dominance and hidden biases ; (iv) detecting anomalies ; and (v) evaluating ( equitable ) relative performance ; whereas science mapping in bibliometric analysis can contribute to: (i) objectively discovering thematic clusters of knowledge ; (ii) clarifying nomological networks ; (iii) mapping social patterns ; (iv) tracking evolutionary nuances ; and (v) recognizing knowledge gaps (Mukherjee et al. 2022b , p. 105).

3 Conclusion

Independent literature reviews will continue to be written as a result of their necessity, importance, relevance, and urgency when it comes to advancing knowledge (Lim et al. 2022a ; Mukherjee et al. 2022b ), and this can be seen in the increasing number of reviews being published over the last several years. Literature reviews advance academic discussion. Journal publications on various topics and subject areas are becoming more frequent sites for publication. This trend will only heighten the need for literature reviews. This article offers directions and control points that address the needs of three different stakeholder groups: producers (i.e., potential authors), evaluators (i.e., journal editors and reviewers), and users (i.e., new researchers looking to learn more about a particular methodological issue, and those teaching the next generation of scholars). Future producers will derive value from this article’s teachings on the different fundamental elements and methodological nuances of literature reviews. Procedural knowledge (i.e., using control points to assist in decision-making during the manuscript preparation phase) will also be of use. Evaluators will be able to make use of the procedural and declarative knowledge evident in control points as well. As previously outlined, the need to cultivate novelty within research on business and management practices is vital. Scholars must also be supported to choose not only safe mining approaches; they should also be encouraged to attempt more challenging and risky ventures. It is important to note that abstracts often seem to offer a lot of potential, stating that authors intend to make large conceptual contributions, broadening the horizons of the field.

Our article offers important insights also for practitioners. Noteworthily, our framework can support corporate managers in decomposing and better understanding literature reviews as ad-hoc and independent studies about specific topics that matter for their organization. For instance, practitioners can understand more easily what are the emerging trends within their domain of interest and make corporate decisions in line with such trends.

This article arises from an intentional decoupling from philosophy, in favor of adopting a more pragmatic approach. This approach can assist us in clarifying the fundamental elements of literature reviews as independent studies. Five fundamental elements must be considered: types, focuses, considerations, methods, and contributions. These elements offer a useful frame for scholars starting to work on a literature review. Overview articles (guides) such as ours are thus invaluable, as they equip scholars with a solid foundational understanding of the integral elements of a literature review. Scholars can then put these teachings into practice, armed with a better understanding of the philosophy that underpins the procedures, protocols, and nomenclatures of literature reviews as independent studies.

Data availability

Our manuscript has no associate data.

Our focus here is on standalone literature reviews in contrast with literature reviews that form the theoretical foundation for a research article.

Scoping reviews, structured reviews, integrative reviews, and interpretive/narrative reviews are commonly found in review nomenclature. However, the philosophy of these review nomenclatures essentially reflects what constitutes a good SLR. That is to say, a good SLR should be well scoped, structured, integrated, and interpreted/narrated. This observation reaffirms our position and the value of moving away from review nomenclatures to gain a foundational understanding of literature reviews as independent studies.

Given that many of these considerations can be implemented simultaneously in contemporary versions of scientific databases, scholars may choose to consolidate them into a single (or a few) step(s), where appropriate, so that they can be reported more parsimoniously. For a parsimonious but transparent and replicable exemplar, see Lim ( 2022 ).

Where keywords are present (e.g., author keywords or keywords derived from machine learning [e.g., natural language processing]), it is assumed that each keyword represents a specific meaning (e.g., topic [concept, context], method), and that a collection of keywords grouped under the same cluster represents a specific theme.

Aguinis H, Jensen SH, Kraus S (2022) Policy implications of organizational behavior and human resource management research. Acad Manage Perspect 36(3):1–22

Article   Google Scholar  

Ammirato S, Felicetti AM, Rogano D, Linzalone R, Corvello V (2022) Digitalising the systematic literature review process: The My SLR platform. Knowl Manage Res Pract. doi: https://doi.org/10.1080/14778238.2022.2041375

Aria M, Cuccurullo C (2017) bibliometrix: An R-tool for comprehensive science mapping analysis. J Informetrics 11(4):959–975

Baker WE, Mukherjee D, Perin MG (2022) Learning orientation and competitive advantage: A critical synthesis and future directions. J Bus Res 144:863–873

Boell SK, Cecez-Kecmanovic D (2015) On being ‘systematic’ in literature reviews. J Inform Technol 30:161–173

Borrego M, Foster MJ, Froyd JE (2014) Systematic literature reviews in engineering education and other developing interdisciplinary fields. J Eng Educ 103(1):45–76

Breslin D, Gatrell C (2020) Theorizing through literature reviews: The miner-prospector continuum. Organizational Res Methods. https://doi.org/10.1177/1094428120943288 (in press)

Cajal B, Jiménez R, Gervilla E, Montaño JJ (2020) Doing a systematic review in health sciences. Clínica y Salud 31(2):77–83

Chen C (2013) Mapping scientific frontiers: The quest for knowledge visualization. Springer Science & Business Media

Creevey D, Coughlan J, O’Connor C (2022) Social media and luxury: A systematic literature review. Int J Manage Reviews 24(1):99–129

Dabić M, González-Loureiro M, Harvey M (2015) Evolving research on expatriates: what is ‘known’after four decades (1970–2012). Int J Hum Resource Manage 26(3):316–337

Dabić M, Vlačić B, Kiessling T, Caputo A, Pellegrini M(2021) Serial entrepreneurs: A review of literature and guidance for future research.Journal of Small Business Management,1–36

Daim TU, Rueda G, Martin H, Gerdsri P (2006) Forecasting emerging technologies: Use of bibliometrics and patent analysis. Technol Forecast Soc Chang 73(8):981–1012

Deng L, Yang M, Marcoulides KM (2018) Structural equation modeling with many variables: A systematic review of issues and developments. Front Psychol 9:580

Donthu N, Kumar S, Pattnaik D (2020) Forty-five years of Journal of Business Research: A bibliometric analysis. J Bus Res 109:1–14

Donthu N, Kumar S, Mukherjee D, Pandey N, Lim WM (2021) How to conduct a bibliometric analysis: An overview and guidelines. J Bus Res 133:285–296

Duan W, Jiang G (2008) A review of the theory of planned behavior. Adv Psychol Sci 16(2):315–320

Google Scholar  

Durach CF, Kembro J, Wieland A (2017) A new paradigm for systematic literature reviews in supply chain management. J Supply Chain Manage 53(4):67–85

Fan D, Breslin D, Callahan JL, Szatt-White M (2022) Advancing literature review methodology through rigour, generativity, scope and transparency. Int J Manage Reviews 24(2):171–180

Ferreira MP, Reis NR, Miranda R (2015) Thirty years of entrepreneurship research published in top journals: Analysis of citations, co-citations and themes. J Global Entrepreneurship Res 5(1):1–22

Ghauri P, Strange R, Cooke FL (2021) Research on international business: The new realities. Int Bus Rev 30(2):101794

Gioia DA, Corley KG, Hamilton AL (2012) Seeking qualitative rigor in inductive research: Notes on the gioia methodology. Organizational Res Methods 16(1):15–31

Gonzalez-Loureiro M, Dabić M, Kiessling T (2015) Supply chain management as the key to a firm’s strategy in the global marketplace: Trends and research agenda. Int J Phys Distribution Logistics Manage 45(1/2):159–181. https://doi.org/10.1108/IJPDLM-05-2013-0124

Grewal D, Puccinelli N, Monroe KB (2018) Meta-analysis: Integrating accumulated knowledge. J Acad Mark Sci 46(1):9–30

Hansen C, Steinmetz H, Block J(2021) How to conduct a meta-analysis in eight steps: a practical guide.Management Review Quarterly,1–19

Korherr P, Kanbach DK (2021) Human-related capabilities in big data analytics: A taxonomy of human factors with impact on firm performance. RMS. https://doi.org/10.1007/s11846-021-00506-4 (in press)

Kraus S, Breier M, Dasí-Rodríguez S (2020) The art of crafting a systematic literature review in entrepreneurship research. Int Entrepreneurship Manage J 16(3):1023–1042

Kraus S, Durst S, Ferreira J, Veiga P, Kailer N, Weinmann A (2022) Digital transformation in business and management research: An overview of the current status quo. Int J Inf Manag 63:102466

Kraus S, Jones P, Kailer N, Weinmann A, Chaparro-Banegas N, Roig-Tierno N (2021) Digital transformation: An overview of the current state of the art of research. Sage Open 11(3):1–15

Kraus S, Mahto RV, Walsh ST (2021) The importance of literature reviews in small business and entrepreneurship research. J Small Bus Manage. https://doi.org/10.1080/00472778.2021.1955128 (in press)

Kumar S, Sahoo S, Lim WM, Dana LP (2022a) Religion as a social shaping force in entrepreneurship and business: Insights from a technology-empowered systematic literature review. Technol Forecast Soc Chang 175:121393

Kumar S, Sahoo S, Lim WM, Kraus S, Bamel U (2022b) Fuzzy-set qualitative comparative analysis (fsQCA) in business and management research: A contemporary overview. Technol Forecast Soc Chang 178:121599

Kumar S, Sharma D, Rao S, Lim WM, Mangla SK (2022c) Past, present, and future of sustainable finance: Insights from big data analytics through machine learning of scholarly research. Ann Oper Res. https://doi.org/10.1007/s10479-021-04410-8 (in press)

Laher S, Hassem T (2020) Doing systematic reviews in psychology. South Afr J Psychol 50(4):450–468

Leemann N, Kanbach DK (2022) Toward a taxonomy of dynamic capabilities – a systematic literature review. Manage Res Rev 45(4):486–501

Lahiri S, Mukherjee D, Peng MW (2020) Behind the internationalization of family SMEs: A strategy tripod synthesis. Glob Strategy J 10(4):813–838

Lim WM (2018) Demystifying neuromarketing. J Bus Res 91:205–220

Lim WM (2020) The sharing economy: A marketing perspective. Australasian Mark J 28(3):4–13

Lim WM (2022) Ushering a new era of Global Business and Organizational Excellence: Taking a leaf out of recent trends in the new normal. Global Bus Organizational Excellence 41(5):5–13

Lim WM, Rasul T (2022) Customer engagement and social media: Revisiting the past to inform the future. J Bus Res 148:325–342

Lim WM, Weissmann MA (2021) Toward a theory of behavioral control. J Strategic Mark. https://doi.org/10.1080/0965254X.2021.1890190 (in press)

Lim WM, Kumar S, Ali F (2022a) Advancing knowledge through literature reviews: ‘What’, ‘why’, and ‘how to contribute’. Serv Ind J 42(7–8):481–513

Lim WM, Rasul T, Kumar S, Ala M (2022b) Past, present, and future of customer engagement. J Bus Res 140:439–458

Lim WM, Yap SF, Makkar M (2021) Home sharing in marketing and tourism at a tipping point: What do we know, how do we know, and where should we be heading? J Bus Res 122:534–566

López-Duarte C, González-Loureiro M, Vidal-Suárez MM, González-Díaz B (2016) International strategic alliances and national culture: Mapping the field and developing a research agenda. J World Bus 51(4):511–524

Mas-Tur A, Kraus S, Brandtner M, Ewert R, Kürsten W (2020) Advances in management research: A bibliometric overview of the Review of Managerial Science. RMS 14(5):933–958

Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA (2015) Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Reviews 4(1):1–9

Mukherjee D, Kumar S, Donthu N, Pandey N (2021) Research published in Management International Review from 2006 to 2020: A bibliometric analysis and future directions. Manage Int Rev 61:599–642

Mukherjee D, Kumar S, Mukherjee D, Goyal K (2022a) Mapping five decades of international business and management research on India: A bibliometric analysis and future directions. J Bus Res 145:864–891

Mukherjee D, Lim WM, Kumar S, Donthu N (2022b) Guidelines for advancing theory and practice through bibliometric research. J Bus Res 148:101–115

Obradović T, Vlačić B, Dabić M (2021) Open innovation in the manufacturing industry: A review and research agenda. Technovation 102:102221

Ojong N, Simba A, Dana LP (2021) Female entrepreneurship in Africa: A review, trends, and future research directions. J Bus Res 132:233–248

Palmatier RW, Houston MB, Hulland J (2018) Review articles: Purpose, process, and structure. J Acad Mark Sci 46(1):1–5

Post C, Sarala R, Gatrell C, Prescott JE (2020) Advancing theory with review articles. J Manage Stud 57(2):351–376

Pranckutė R (2021) Web of Science (WoS) and Scopus: The titans of bibliographic information in today’s academic world. Publications 9(1):12

R Core Team (2021) R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/ Accessed 20th July 2022

Rovelli P, Ferasso M, De Massis A, Kraus S(2021) Thirty years of research in family business journals: Status quo and future directions.Journal of Family Business Strategy,100422

Salmony FU, Kanbach DK (2022) Personality trait differences across types of entrepreneurs: a systematic literature review. RMS 16:713–749

Snyder H (2019) Literature review as a research methodology: An overview and guidelines. J Bus Res 104:333–339

Tranfield D, Denyer D, Smart P (2003) Towards a methodology for developing evidence-informed management knowledge by means of systematic review. Br J Manag 14(3):207–222

Ulker-Demirel E, Ciftci G (2020) A systematic literature review of the theory of planned behavior in tourism, leisure and hospitality management research. J Hospitality Tourism Manage 43:209–219

Van Eck NJ, Waltma L (2014) CitNetExplorer: A new software tool for analyzing and visualizing citation networks. J Informetrics 8(4):802–823

Vlačić B, Corbo L, Silva e, Dabić M (2021) The evolving role of artificial intelligence in marketing: A review and research agenda. J Bus Res 128:187–203

Wong D (2018) VOSviewer. Tech Serv Q 35(2):219–220. https://doi.org/10.1080/07317131.2018.1425352

Download references

Open access funding provided by Libera Università di Bolzano within the CRUI-CARE Agreement.

Author information

Authors and affiliations.

Faculty of Economics & Management, Free University of Bozen-Bolzano, Bolzano, Italy

Sascha Kraus

Department of Business Management, University of Johannesburg, Johannesburg, South Africa

School of Business, Lappeenranta University of Technology, Lappeenranta, Finland

Matthias Breier

Sunway University Business School, Sunway University, Sunway City, Malaysia

Weng Marc Lim

Faculty of Economics and Business, University of Zagreb, Zagreb, Croatia

Marina Dabić

School of Economics and Business, University of Ljubljana, Ljubljana, Slovenia

Department of Management Studies, Malaviya National Institute of Technology Jaipur, Jaipur, India

Satish Kumar

Faculty of Business, Design and Arts, Swinburne University of Technology, Kuching, Malaysia

Weng Marc Lim & Satish Kumar

Chair of Strategic Management and Digital Entrepreneurship, HHL Leipzig Graduate School of Management, Leipzig, Germany

Dominik Kanbach

School of Business, Woxsen University, Hyderabad, India

College of Business, The University of Akron, Akron, USA

Debmalya Mukherjee

Department of Engineering, University of Messina, Messina, Italy

Vincenzo Corvello

Department of Finance, Santiago de Compostela University, Santiago de Compostela, Spain

Juan Piñeiro-Chousa

Rowan University, Rohrer College of Business, Glassboro, NJ, USA

Eric Liguori

School of Engineering Design, Universidad Politécnica de Valencia, Valencia, Spain

Daniel Palacios-Marqués

Department of Management and Quantitative Studies, Parthenope University, Naples, Italy

Francesco Schiavone

Paris School of Business, Paris, France

Department of Management, University of Turin, Turin, Italy

Alberto Ferraris

Department of Management and Economics & NECE Research Unit in Business Sciences, University of Beira Interior, Covilha, Portugal

Cristina Fernandes & João J. Ferreira

Centre for Corporate Entrepreneurship and Innovation, Loughborough University, Loughborough, UK

Cristina Fernandes

Laboratory for International and Regional Economics, Graduate School of Economics and Management, Ural Federal University, Yekaterinburg, Russia

School of Business, Law and Entrepreneurship, Swinburne University of Technology, Hawthorn, Australia

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Sascha Kraus .

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Kraus, S., Breier, M., Lim, W.M. et al. Literature reviews as independent studies: guidelines for academic practice. Rev Manag Sci 16 , 2577–2595 (2022). https://doi.org/10.1007/s11846-022-00588-8

Download citation

Received : 15 August 2022

Accepted : 07 September 2022

Published : 14 October 2022

Issue Date : November 2022

DOI : https://doi.org/10.1007/s11846-022-00588-8

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Literature reviews
  • Bibliometrics
  • Meta Analysis
  • Contributions

JEL classification

  • Find a journal
  • Publish with us
  • Track your research

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

  • Advanced Search
  • Journal List
  • CBE Life Sci Educ
  • v.21(3); Fall 2022

Literature Reviews, Theoretical Frameworks, and Conceptual Frameworks: An Introduction for New Biology Education Researchers

Julie a. luft.

† Department of Mathematics, Social Studies, and Science Education, Mary Frances Early College of Education, University of Georgia, Athens, GA 30602-7124

Sophia Jeong

‡ Department of Teaching & Learning, College of Education & Human Ecology, Ohio State University, Columbus, OH 43210

Robert Idsardi

§ Department of Biology, Eastern Washington University, Cheney, WA 99004

Grant Gardner

∥ Department of Biology, Middle Tennessee State University, Murfreesboro, TN 37132

Associated Data

To frame their work, biology education researchers need to consider the role of literature reviews, theoretical frameworks, and conceptual frameworks as critical elements of the research and writing process. However, these elements can be confusing for scholars new to education research. This Research Methods article is designed to provide an overview of each of these elements and delineate the purpose of each in the educational research process. We describe what biology education researchers should consider as they conduct literature reviews, identify theoretical frameworks, and construct conceptual frameworks. Clarifying these different components of educational research studies can be helpful to new biology education researchers and the biology education research community at large in situating their work in the broader scholarly literature.

INTRODUCTION

Discipline-based education research (DBER) involves the purposeful and situated study of teaching and learning in specific disciplinary areas ( Singer et al. , 2012 ). Studies in DBER are guided by research questions that reflect disciplines’ priorities and worldviews. Researchers can use quantitative data, qualitative data, or both to answer these research questions through a variety of methodological traditions. Across all methodologies, there are different methods associated with planning and conducting educational research studies that include the use of surveys, interviews, observations, artifacts, or instruments. Ensuring the coherence of these elements to the discipline’s perspective also involves situating the work in the broader scholarly literature. The tools for doing this include literature reviews, theoretical frameworks, and conceptual frameworks. However, the purpose and function of each of these elements is often confusing to new education researchers. The goal of this article is to introduce new biology education researchers to these three important elements important in DBER scholarship and the broader educational literature.

The first element we discuss is a review of research (literature reviews), which highlights the need for a specific research question, study problem, or topic of investigation. Literature reviews situate the relevance of the study within a topic and a field. The process may seem familiar to science researchers entering DBER fields, but new researchers may still struggle in conducting the review. Booth et al. (2016b) highlight some of the challenges novice education researchers face when conducting a review of literature. They point out that novice researchers struggle in deciding how to focus the review, determining the scope of articles needed in the review, and knowing how to be critical of the articles in the review. Overcoming these challenges (and others) can help novice researchers construct a sound literature review that can inform the design of the study and help ensure the work makes a contribution to the field.

The second and third highlighted elements are theoretical and conceptual frameworks. These guide biology education research (BER) studies, and may be less familiar to science researchers. These elements are important in shaping the construction of new knowledge. Theoretical frameworks offer a way to explain and interpret the studied phenomenon, while conceptual frameworks clarify assumptions about the studied phenomenon. Despite the importance of these constructs in educational research, biology educational researchers have noted the limited use of theoretical or conceptual frameworks in published work ( DeHaan, 2011 ; Dirks, 2011 ; Lo et al. , 2019 ). In reviewing articles published in CBE—Life Sciences Education ( LSE ) between 2015 and 2019, we found that fewer than 25% of the research articles had a theoretical or conceptual framework (see the Supplemental Information), and at times there was an inconsistent use of theoretical and conceptual frameworks. Clearly, these frameworks are challenging for published biology education researchers, which suggests the importance of providing some initial guidance to new biology education researchers.

Fortunately, educational researchers have increased their explicit use of these frameworks over time, and this is influencing educational research in science, technology, engineering, and mathematics (STEM) fields. For instance, a quick search for theoretical or conceptual frameworks in the abstracts of articles in Educational Research Complete (a common database for educational research) in STEM fields demonstrates a dramatic change over the last 20 years: from only 778 articles published between 2000 and 2010 to 5703 articles published between 2010 and 2020, a more than sevenfold increase. Greater recognition of the importance of these frameworks is contributing to DBER authors being more explicit about such frameworks in their studies.

Collectively, literature reviews, theoretical frameworks, and conceptual frameworks work to guide methodological decisions and the elucidation of important findings. Each offers a different perspective on the problem of study and is an essential element in all forms of educational research. As new researchers seek to learn about these elements, they will find different resources, a variety of perspectives, and many suggestions about the construction and use of these elements. The wide range of available information can overwhelm the new researcher who just wants to learn the distinction between these elements or how to craft them adequately.

Our goal in writing this paper is not to offer specific advice about how to write these sections in scholarly work. Instead, we wanted to introduce these elements to those who are new to BER and who are interested in better distinguishing one from the other. In this paper, we share the purpose of each element in BER scholarship, along with important points on its construction. We also provide references for additional resources that may be beneficial to better understanding each element. Table 1 summarizes the key distinctions among these elements.

Comparison of literature reviews, theoretical frameworks, and conceptual reviews

This article is written for the new biology education researcher who is just learning about these different elements or for scientists looking to become more involved in BER. It is a result of our own work as science education and biology education researchers, whether as graduate students and postdoctoral scholars or newly hired and established faculty members. This is the article we wish had been available as we started to learn about these elements or discussed them with new educational researchers in biology.

LITERATURE REVIEWS

Purpose of a literature review.

A literature review is foundational to any research study in education or science. In education, a well-conceptualized and well-executed review provides a summary of the research that has already been done on a specific topic and identifies questions that remain to be answered, thus illustrating the current research project’s potential contribution to the field and the reasoning behind the methodological approach selected for the study ( Maxwell, 2012 ). BER is an evolving disciplinary area that is redefining areas of conceptual emphasis as well as orientations toward teaching and learning (e.g., Labov et al. , 2010 ; American Association for the Advancement of Science, 2011 ; Nehm, 2019 ). As a result, building comprehensive, critical, purposeful, and concise literature reviews can be a challenge for new biology education researchers.

Building Literature Reviews

There are different ways to approach and construct a literature review. Booth et al. (2016a) provide an overview that includes, for example, scoping reviews, which are focused only on notable studies and use a basic method of analysis, and integrative reviews, which are the result of exhaustive literature searches across different genres. Underlying each of these different review processes are attention to the s earch process, a ppraisa l of articles, s ynthesis of the literature, and a nalysis: SALSA ( Booth et al. , 2016a ). This useful acronym can help the researcher focus on the process while building a specific type of review.

However, new educational researchers often have questions about literature reviews that are foundational to SALSA or other approaches. Common questions concern determining which literature pertains to the topic of study or the role of the literature review in the design of the study. This section addresses such questions broadly while providing general guidance for writing a narrative literature review that evaluates the most pertinent studies.

The literature review process should begin before the research is conducted. As Boote and Beile (2005 , p. 3) suggested, researchers should be “scholars before researchers.” They point out that having a good working knowledge of the proposed topic helps illuminate avenues of study. Some subject areas have a deep body of work to read and reflect upon, providing a strong foundation for developing the research question(s). For instance, the teaching and learning of evolution is an area of long-standing interest in the BER community, generating many studies (e.g., Perry et al. , 2008 ; Barnes and Brownell, 2016 ) and reviews of research (e.g., Sickel and Friedrichsen, 2013 ; Ziadie and Andrews, 2018 ). Emerging areas of BER include the affective domain, issues of transfer, and metacognition ( Singer et al. , 2012 ). Many studies in these areas are transdisciplinary and not always specific to biology education (e.g., Rodrigo-Peiris et al. , 2018 ; Kolpikova et al. , 2019 ). These newer areas may require reading outside BER; fortunately, summaries of some of these topics can be found in the Current Insights section of the LSE website.

In focusing on a specific problem within a broader research strand, a new researcher will likely need to examine research outside BER. Depending upon the area of study, the expanded reading list might involve a mix of BER, DBER, and educational research studies. Determining the scope of the reading is not always straightforward. A simple way to focus one’s reading is to create a “summary phrase” or “research nugget,” which is a very brief descriptive statement about the study. It should focus on the essence of the study, for example, “first-year nonmajor students’ understanding of evolution,” “metacognitive prompts to enhance learning during biochemistry,” or “instructors’ inquiry-based instructional practices after professional development programming.” This type of phrase should help a new researcher identify two or more areas to review that pertain to the study. Focusing on recent research in the last 5 years is a good first step. Additional studies can be identified by reading relevant works referenced in those articles. It is also important to read seminal studies that are more than 5 years old. Reading a range of studies should give the researcher the necessary command of the subject in order to suggest a research question.

Given that the research question(s) arise from the literature review, the review should also substantiate the selected methodological approach. The review and research question(s) guide the researcher in determining how to collect and analyze data. Often the methodological approach used in a study is selected to contribute knowledge that expands upon what has been published previously about the topic (see Institute of Education Sciences and National Science Foundation, 2013 ). An emerging topic of study may need an exploratory approach that allows for a description of the phenomenon and development of a potential theory. This could, but not necessarily, require a methodological approach that uses interviews, observations, surveys, or other instruments. An extensively studied topic may call for the additional understanding of specific factors or variables; this type of study would be well suited to a verification or a causal research design. These could entail a methodological approach that uses valid and reliable instruments, observations, or interviews to determine an effect in the studied event. In either of these examples, the researcher(s) may use a qualitative, quantitative, or mixed methods methodological approach.

Even with a good research question, there is still more reading to be done. The complexity and focus of the research question dictates the depth and breadth of the literature to be examined. Questions that connect multiple topics can require broad literature reviews. For instance, a study that explores the impact of a biology faculty learning community on the inquiry instruction of faculty could have the following review areas: learning communities among biology faculty, inquiry instruction among biology faculty, and inquiry instruction among biology faculty as a result of professional learning. Biology education researchers need to consider whether their literature review requires studies from different disciplines within or outside DBER. For the example given, it would be fruitful to look at research focused on learning communities with faculty in STEM fields or in general education fields that result in instructional change. It is important not to be too narrow or too broad when reading. When the conclusions of articles start to sound similar or no new insights are gained, the researcher likely has a good foundation for a literature review. This level of reading should allow the researcher to demonstrate a mastery in understanding the researched topic, explain the suitability of the proposed research approach, and point to the need for the refined research question(s).

The literature review should include the researcher’s evaluation and critique of the selected studies. A researcher may have a large collection of studies, but not all of the studies will follow standards important in the reporting of empirical work in the social sciences. The American Educational Research Association ( Duran et al. , 2006 ), for example, offers a general discussion about standards for such work: an adequate review of research informing the study, the existence of sound and appropriate data collection and analysis methods, and appropriate conclusions that do not overstep or underexplore the analyzed data. The Institute of Education Sciences and National Science Foundation (2013) also offer Common Guidelines for Education Research and Development that can be used to evaluate collected studies.

Because not all journals adhere to such standards, it is important that a researcher review each study to determine the quality of published research, per the guidelines suggested earlier. In some instances, the research may be fatally flawed. Examples of such flaws include data that do not pertain to the question, a lack of discussion about the data collection, poorly constructed instruments, or an inadequate analysis. These types of errors result in studies that are incomplete, error-laden, or inaccurate and should be excluded from the review. Most studies have limitations, and the author(s) often make them explicit. For instance, there may be an instructor effect, recognized bias in the analysis, or issues with the sample population. Limitations are usually addressed by the research team in some way to ensure a sound and acceptable research process. Occasionally, the limitations associated with the study can be significant and not addressed adequately, which leaves a consequential decision in the hands of the researcher. Providing critiques of studies in the literature review process gives the reader confidence that the researcher has carefully examined relevant work in preparation for the study and, ultimately, the manuscript.

A solid literature review clearly anchors the proposed study in the field and connects the research question(s), the methodological approach, and the discussion. Reviewing extant research leads to research questions that will contribute to what is known in the field. By summarizing what is known, the literature review points to what needs to be known, which in turn guides decisions about methodology. Finally, notable findings of the new study are discussed in reference to those described in the literature review.

Within published BER studies, literature reviews can be placed in different locations in an article. When included in the introductory section of the study, the first few paragraphs of the manuscript set the stage, with the literature review following the opening paragraphs. Cooper et al. (2019) illustrate this approach in their study of course-based undergraduate research experiences (CUREs). An introduction discussing the potential of CURES is followed by an analysis of the existing literature relevant to the design of CUREs that allows for novel student discoveries. Within this review, the authors point out contradictory findings among research on novel student discoveries. This clarifies the need for their study, which is described and highlighted through specific research aims.

A literature reviews can also make up a separate section in a paper. For example, the introduction to Todd et al. (2019) illustrates the need for their research topic by highlighting the potential of learning progressions (LPs) and suggesting that LPs may help mitigate learning loss in genetics. At the end of the introduction, the authors state their specific research questions. The review of literature following this opening section comprises two subsections. One focuses on learning loss in general and examines a variety of studies and meta-analyses from the disciplines of medical education, mathematics, and reading. The second section focuses specifically on LPs in genetics and highlights student learning in the midst of LPs. These separate reviews provide insights into the stated research question.

Suggestions and Advice

A well-conceptualized, comprehensive, and critical literature review reveals the understanding of the topic that the researcher brings to the study. Literature reviews should not be so big that there is no clear area of focus; nor should they be so narrow that no real research question arises. The task for a researcher is to craft an efficient literature review that offers a critical analysis of published work, articulates the need for the study, guides the methodological approach to the topic of study, and provides an adequate foundation for the discussion of the findings.

In our own writing of literature reviews, there are often many drafts. An early draft may seem well suited to the study because the need for and approach to the study are well described. However, as the results of the study are analyzed and findings begin to emerge, the existing literature review may be inadequate and need revision. The need for an expanded discussion about the research area can result in the inclusion of new studies that support the explanation of a potential finding. The literature review may also prove to be too broad. Refocusing on a specific area allows for more contemplation of a finding.

It should be noted that there are different types of literature reviews, and many books and articles have been written about the different ways to embark on these types of reviews. Among these different resources, the following may be helpful in considering how to refine the review process for scholarly journals:

  • Booth, A., Sutton, A., & Papaioannou, D. (2016a). Systemic approaches to a successful literature review (2nd ed.). Los Angeles, CA: Sage. This book addresses different types of literature reviews and offers important suggestions pertaining to defining the scope of the literature review and assessing extant studies.
  • Booth, W. C., Colomb, G. G., Williams, J. M., Bizup, J., & Fitzgerald, W. T. (2016b). The craft of research (4th ed.). Chicago: University of Chicago Press. This book can help the novice consider how to make the case for an area of study. While this book is not specifically about literature reviews, it offers suggestions about making the case for your study.
  • Galvan, J. L., & Galvan, M. C. (2017). Writing literature reviews: A guide for students of the social and behavioral sciences (7th ed.). Routledge. This book offers guidance on writing different types of literature reviews. For the novice researcher, there are useful suggestions for creating coherent literature reviews.

THEORETICAL FRAMEWORKS

Purpose of theoretical frameworks.

As new education researchers may be less familiar with theoretical frameworks than with literature reviews, this discussion begins with an analogy. Envision a biologist, chemist, and physicist examining together the dramatic effect of a fog tsunami over the ocean. A biologist gazing at this phenomenon may be concerned with the effect of fog on various species. A chemist may be interested in the chemical composition of the fog as water vapor condenses around bits of salt. A physicist may be focused on the refraction of light to make fog appear to be “sitting” above the ocean. While observing the same “objective event,” the scientists are operating under different theoretical frameworks that provide a particular perspective or “lens” for the interpretation of the phenomenon. Each of these scientists brings specialized knowledge, experiences, and values to this phenomenon, and these influence the interpretation of the phenomenon. The scientists’ theoretical frameworks influence how they design and carry out their studies and interpret their data.

Within an educational study, a theoretical framework helps to explain a phenomenon through a particular lens and challenges and extends existing knowledge within the limitations of that lens. Theoretical frameworks are explicitly stated by an educational researcher in the paper’s framework, theory, or relevant literature section. The framework shapes the types of questions asked, guides the method by which data are collected and analyzed, and informs the discussion of the results of the study. It also reveals the researcher’s subjectivities, for example, values, social experience, and viewpoint ( Allen, 2017 ). It is essential that a novice researcher learn to explicitly state a theoretical framework, because all research questions are being asked from the researcher’s implicit or explicit assumptions of a phenomenon of interest ( Schwandt, 2000 ).

Selecting Theoretical Frameworks

Theoretical frameworks are one of the most contemplated elements in our work in educational research. In this section, we share three important considerations for new scholars selecting a theoretical framework.

The first step in identifying a theoretical framework involves reflecting on the phenomenon within the study and the assumptions aligned with the phenomenon. The phenomenon involves the studied event. There are many possibilities, for example, student learning, instructional approach, or group organization. A researcher holds assumptions about how the phenomenon will be effected, influenced, changed, or portrayed. It is ultimately the researcher’s assumption(s) about the phenomenon that aligns with a theoretical framework. An example can help illustrate how a researcher’s reflection on the phenomenon and acknowledgment of assumptions can result in the identification of a theoretical framework.

In our example, a biology education researcher may be interested in exploring how students’ learning of difficult biological concepts can be supported by the interactions of group members. The phenomenon of interest is the interactions among the peers, and the researcher assumes that more knowledgeable students are important in supporting the learning of the group. As a result, the researcher may draw on Vygotsky’s (1978) sociocultural theory of learning and development that is focused on the phenomenon of student learning in a social setting. This theory posits the critical nature of interactions among students and between students and teachers in the process of building knowledge. A researcher drawing upon this framework holds the assumption that learning is a dynamic social process involving questions and explanations among students in the classroom and that more knowledgeable peers play an important part in the process of building conceptual knowledge.

It is important to state at this point that there are many different theoretical frameworks. Some frameworks focus on learning and knowing, while other theoretical frameworks focus on equity, empowerment, or discourse. Some frameworks are well articulated, and others are still being refined. For a new researcher, it can be challenging to find a theoretical framework. Two of the best ways to look for theoretical frameworks is through published works that highlight different frameworks.

When a theoretical framework is selected, it should clearly connect to all parts of the study. The framework should augment the study by adding a perspective that provides greater insights into the phenomenon. It should clearly align with the studies described in the literature review. For instance, a framework focused on learning would correspond to research that reported different learning outcomes for similar studies. The methods for data collection and analysis should also correspond to the framework. For instance, a study about instructional interventions could use a theoretical framework concerned with learning and could collect data about the effect of the intervention on what is learned. When the data are analyzed, the theoretical framework should provide added meaning to the findings, and the findings should align with the theoretical framework.

A study by Jensen and Lawson (2011) provides an example of how a theoretical framework connects different parts of the study. They compared undergraduate biology students in heterogeneous and homogeneous groups over the course of a semester. Jensen and Lawson (2011) assumed that learning involved collaboration and more knowledgeable peers, which made Vygotsky’s (1978) theory a good fit for their study. They predicted that students in heterogeneous groups would experience greater improvement in their reasoning abilities and science achievements with much of the learning guided by the more knowledgeable peers.

In the enactment of the study, they collected data about the instruction in traditional and inquiry-oriented classes, while the students worked in homogeneous or heterogeneous groups. To determine the effect of working in groups, the authors also measured students’ reasoning abilities and achievement. Each data-collection and analysis decision connected to understanding the influence of collaborative work.

Their findings highlighted aspects of Vygotsky’s (1978) theory of learning. One finding, for instance, posited that inquiry instruction, as a whole, resulted in reasoning and achievement gains. This links to Vygotsky (1978) , because inquiry instruction involves interactions among group members. A more nuanced finding was that group composition had a conditional effect. Heterogeneous groups performed better with more traditional and didactic instruction, regardless of the reasoning ability of the group members. Homogeneous groups worked better during interaction-rich activities for students with low reasoning ability. The authors attributed the variation to the different types of helping behaviors of students. High-performing students provided the answers, while students with low reasoning ability had to work collectively through the material. In terms of Vygotsky (1978) , this finding provided new insights into the learning context in which productive interactions can occur for students.

Another consideration in the selection and use of a theoretical framework pertains to its orientation to the study. This can result in the theoretical framework prioritizing individuals, institutions, and/or policies ( Anfara and Mertz, 2014 ). Frameworks that connect to individuals, for instance, could contribute to understanding their actions, learning, or knowledge. Institutional frameworks, on the other hand, offer insights into how institutions, organizations, or groups can influence individuals or materials. Policy theories provide ways to understand how national or local policies can dictate an emphasis on outcomes or instructional design. These different types of frameworks highlight different aspects in an educational setting, which influences the design of the study and the collection of data. In addition, these different frameworks offer a way to make sense of the data. Aligning the data collection and analysis with the framework ensures that a study is coherent and can contribute to the field.

New understandings emerge when different theoretical frameworks are used. For instance, Ebert-May et al. (2015) prioritized the individual level within conceptual change theory (see Posner et al. , 1982 ). In this theory, an individual’s knowledge changes when it no longer fits the phenomenon. Ebert-May et al. (2015) designed a professional development program challenging biology postdoctoral scholars’ existing conceptions of teaching. The authors reported that the biology postdoctoral scholars’ teaching practices became more student-centered as they were challenged to explain their instructional decision making. According to the theory, the biology postdoctoral scholars’ dissatisfaction in their descriptions of teaching and learning initiated change in their knowledge and instruction. These results reveal how conceptual change theory can explain the learning of participants and guide the design of professional development programming.

The communities of practice (CoP) theoretical framework ( Lave, 1988 ; Wenger, 1998 ) prioritizes the institutional level , suggesting that learning occurs when individuals learn from and contribute to the communities in which they reside. Grounded in the assumption of community learning, the literature on CoP suggests that, as individuals interact regularly with the other members of their group, they learn about the rules, roles, and goals of the community ( Allee, 2000 ). A study conducted by Gehrke and Kezar (2017) used the CoP framework to understand organizational change by examining the involvement of individual faculty engaged in a cross-institutional CoP focused on changing the instructional practice of faculty at each institution. In the CoP, faculty members were involved in enhancing instructional materials within their department, which aligned with an overarching goal of instituting instruction that embraced active learning. Not surprisingly, Gehrke and Kezar (2017) revealed that faculty who perceived the community culture as important in their work cultivated institutional change. Furthermore, they found that institutional change was sustained when key leaders served as mentors and provided support for faculty, and as faculty themselves developed into leaders. This study reveals the complexity of individual roles in a COP in order to support institutional instructional change.

It is important to explicitly state the theoretical framework used in a study, but elucidating a theoretical framework can be challenging for a new educational researcher. The literature review can help to identify an applicable theoretical framework. Focal areas of the review or central terms often connect to assumptions and assertions associated with the framework that pertain to the phenomenon of interest. Another way to identify a theoretical framework is self-reflection by the researcher on personal beliefs and understandings about the nature of knowledge the researcher brings to the study ( Lysaght, 2011 ). In stating one’s beliefs and understandings related to the study (e.g., students construct their knowledge, instructional materials support learning), an orientation becomes evident that will suggest a particular theoretical framework. Theoretical frameworks are not arbitrary , but purposefully selected.

With experience, a researcher may find expanded roles for theoretical frameworks. Researchers may revise an existing framework that has limited explanatory power, or they may decide there is a need to develop a new theoretical framework. These frameworks can emerge from a current study or the need to explain a phenomenon in a new way. Researchers may also find that multiple theoretical frameworks are necessary to frame and explore a problem, as different frameworks can provide different insights into a problem.

Finally, it is important to recognize that choosing “x” theoretical framework does not necessarily mean a researcher chooses “y” methodology and so on, nor is there a clear-cut, linear process in selecting a theoretical framework for one’s study. In part, the nonlinear process of identifying a theoretical framework is what makes understanding and using theoretical frameworks challenging. For the novice scholar, contemplating and understanding theoretical frameworks is essential. Fortunately, there are articles and books that can help:

  • Creswell, J. W. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Los Angeles, CA: Sage. This book provides an overview of theoretical frameworks in general educational research.
  • Ding, L. (2019). Theoretical perspectives of quantitative physics education research. Physical Review Physics Education Research , 15 (2), 020101-1–020101-13. This paper illustrates how a DBER field can use theoretical frameworks.
  • Nehm, R. (2019). Biology education research: Building integrative frameworks for teaching and learning about living systems. Disciplinary and Interdisciplinary Science Education Research , 1 , ar15. https://doi.org/10.1186/s43031-019-0017-6 . This paper articulates the need for studies in BER to explicitly state theoretical frameworks and provides examples of potential studies.
  • Patton, M. Q. (2015). Qualitative research & evaluation methods: Integrating theory and practice . Sage. This book also provides an overview of theoretical frameworks, but for both research and evaluation.

CONCEPTUAL FRAMEWORKS

Purpose of a conceptual framework.

A conceptual framework is a description of the way a researcher understands the factors and/or variables that are involved in the study and their relationships to one another. The purpose of a conceptual framework is to articulate the concepts under study using relevant literature ( Rocco and Plakhotnik, 2009 ) and to clarify the presumed relationships among those concepts ( Rocco and Plakhotnik, 2009 ; Anfara and Mertz, 2014 ). Conceptual frameworks are different from theoretical frameworks in both their breadth and grounding in established findings. Whereas a theoretical framework articulates the lens through which a researcher views the work, the conceptual framework is often more mechanistic and malleable.

Conceptual frameworks are broader, encompassing both established theories (i.e., theoretical frameworks) and the researchers’ own emergent ideas. Emergent ideas, for example, may be rooted in informal and/or unpublished observations from experience. These emergent ideas would not be considered a “theory” if they are not yet tested, supported by systematically collected evidence, and peer reviewed. However, they do still play an important role in the way researchers approach their studies. The conceptual framework allows authors to clearly describe their emergent ideas so that connections among ideas in the study and the significance of the study are apparent to readers.

Constructing Conceptual Frameworks

Including a conceptual framework in a research study is important, but researchers often opt to include either a conceptual or a theoretical framework. Either may be adequate, but both provide greater insight into the research approach. For instance, a research team plans to test a novel component of an existing theory. In their study, they describe the existing theoretical framework that informs their work and then present their own conceptual framework. Within this conceptual framework, specific topics portray emergent ideas that are related to the theory. Describing both frameworks allows readers to better understand the researchers’ assumptions, orientations, and understanding of concepts being investigated. For example, Connolly et al. (2018) included a conceptual framework that described how they applied a theoretical framework of social cognitive career theory (SCCT) to their study on teaching programs for doctoral students. In their conceptual framework, the authors described SCCT, explained how it applied to the investigation, and drew upon results from previous studies to justify the proposed connections between the theory and their emergent ideas.

In some cases, authors may be able to sufficiently describe their conceptualization of the phenomenon under study in an introduction alone, without a separate conceptual framework section. However, incomplete descriptions of how the researchers conceptualize the components of the study may limit the significance of the study by making the research less intelligible to readers. This is especially problematic when studying topics in which researchers use the same terms for different constructs or different terms for similar and overlapping constructs (e.g., inquiry, teacher beliefs, pedagogical content knowledge, or active learning). Authors must describe their conceptualization of a construct if the research is to be understandable and useful.

There are some key areas to consider regarding the inclusion of a conceptual framework in a study. To begin with, it is important to recognize that conceptual frameworks are constructed by the researchers conducting the study ( Rocco and Plakhotnik, 2009 ; Maxwell, 2012 ). This is different from theoretical frameworks that are often taken from established literature. Researchers should bring together ideas from the literature, but they may be influenced by their own experiences as a student and/or instructor, the shared experiences of others, or thought experiments as they construct a description, model, or representation of their understanding of the phenomenon under study. This is an exercise in intellectual organization and clarity that often considers what is learned, known, and experienced. The conceptual framework makes these constructs explicitly visible to readers, who may have different understandings of the phenomenon based on their prior knowledge and experience. There is no single method to go about this intellectual work.

Reeves et al. (2016) is an example of an article that proposed a conceptual framework about graduate teaching assistant professional development evaluation and research. The authors used existing literature to create a novel framework that filled a gap in current research and practice related to the training of graduate teaching assistants. This conceptual framework can guide the systematic collection of data by other researchers because the framework describes the relationships among various factors that influence teaching and learning. The Reeves et al. (2016) conceptual framework may be modified as additional data are collected and analyzed by other researchers. This is not uncommon, as conceptual frameworks can serve as catalysts for concerted research efforts that systematically explore a phenomenon (e.g., Reynolds et al. , 2012 ; Brownell and Kloser, 2015 ).

Sabel et al. (2017) used a conceptual framework in their exploration of how scaffolds, an external factor, interact with internal factors to support student learning. Their conceptual framework integrated principles from two theoretical frameworks, self-regulated learning and metacognition, to illustrate how the research team conceptualized students’ use of scaffolds in their learning ( Figure 1 ). Sabel et al. (2017) created this model using their interpretations of these two frameworks in the context of their teaching.

An external file that holds a picture, illustration, etc.
Object name is cbe-21-rm33-g001.jpg

Conceptual framework from Sabel et al. (2017) .

A conceptual framework should describe the relationship among components of the investigation ( Anfara and Mertz, 2014 ). These relationships should guide the researcher’s methods of approaching the study ( Miles et al. , 2014 ) and inform both the data to be collected and how those data should be analyzed. Explicitly describing the connections among the ideas allows the researcher to justify the importance of the study and the rigor of the research design. Just as importantly, these frameworks help readers understand why certain components of a system were not explored in the study. This is a challenge in education research, which is rooted in complex environments with many variables that are difficult to control.

For example, Sabel et al. (2017) stated: “Scaffolds, such as enhanced answer keys and reflection questions, can help students and instructors bridge the external and internal factors and support learning” (p. 3). They connected the scaffolds in the study to the three dimensions of metacognition and the eventual transformation of existing ideas into new or revised ideas. Their framework provides a rationale for focusing on how students use two different scaffolds, and not on other factors that may influence a student’s success (self-efficacy, use of active learning, exam format, etc.).

In constructing conceptual frameworks, researchers should address needed areas of study and/or contradictions discovered in literature reviews. By attending to these areas, researchers can strengthen their arguments for the importance of a study. For instance, conceptual frameworks can address how the current study will fill gaps in the research, resolve contradictions in existing literature, or suggest a new area of study. While a literature review describes what is known and not known about the phenomenon, the conceptual framework leverages these gaps in describing the current study ( Maxwell, 2012 ). In the example of Sabel et al. (2017) , the authors indicated there was a gap in the literature regarding how scaffolds engage students in metacognition to promote learning in large classes. Their study helps fill that gap by describing how scaffolds can support students in the three dimensions of metacognition: intelligibility, plausibility, and wide applicability. In another example, Lane (2016) integrated research from science identity, the ethic of care, the sense of belonging, and an expertise model of student success to form a conceptual framework that addressed the critiques of other frameworks. In a more recent example, Sbeglia et al. (2021) illustrated how a conceptual framework influences the methodological choices and inferences in studies by educational researchers.

Sometimes researchers draw upon the conceptual frameworks of other researchers. When a researcher’s conceptual framework closely aligns with an existing framework, the discussion may be brief. For example, Ghee et al. (2016) referred to portions of SCCT as their conceptual framework to explain the significance of their work on students’ self-efficacy and career interests. Because the authors’ conceptualization of this phenomenon aligned with a previously described framework, they briefly mentioned the conceptual framework and provided additional citations that provided more detail for the readers.

Within both the BER and the broader DBER communities, conceptual frameworks have been used to describe different constructs. For example, some researchers have used the term “conceptual framework” to describe students’ conceptual understandings of a biological phenomenon. This is distinct from a researcher’s conceptual framework of the educational phenomenon under investigation, which may also need to be explicitly described in the article. Other studies have presented a research logic model or flowchart of the research design as a conceptual framework. These constructions can be quite valuable in helping readers understand the data-collection and analysis process. However, a model depicting the study design does not serve the same role as a conceptual framework. Researchers need to avoid conflating these constructs by differentiating the researchers’ conceptual framework that guides the study from the research design, when applicable.

Explicitly describing conceptual frameworks is essential in depicting the focus of the study. We have found that being explicit in a conceptual framework means using accepted terminology, referencing prior work, and clearly noting connections between terms. This description can also highlight gaps in the literature or suggest potential contributions to the field of study. A well-elucidated conceptual framework can suggest additional studies that may be warranted. This can also spur other researchers to consider how they would approach the examination of a phenomenon and could result in a revised conceptual framework.

It can be challenging to create conceptual frameworks, but they are important. Below are two resources that could be helpful in constructing and presenting conceptual frameworks in educational research:

  • Maxwell, J. A. (2012). Qualitative research design: An interactive approach (3rd ed.). Los Angeles, CA: Sage. Chapter 3 in this book describes how to construct conceptual frameworks.
  • Ravitch, S. M., & Riggan, M. (2016). Reason & rigor: How conceptual frameworks guide research . Los Angeles, CA: Sage. This book explains how conceptual frameworks guide the research questions, data collection, data analyses, and interpretation of results.

CONCLUDING THOUGHTS

Literature reviews, theoretical frameworks, and conceptual frameworks are all important in DBER and BER. Robust literature reviews reinforce the importance of a study. Theoretical frameworks connect the study to the base of knowledge in educational theory and specify the researcher’s assumptions. Conceptual frameworks allow researchers to explicitly describe their conceptualization of the relationships among the components of the phenomenon under study. Table 1 provides a general overview of these components in order to assist biology education researchers in thinking about these elements.

It is important to emphasize that these different elements are intertwined. When these elements are aligned and complement one another, the study is coherent, and the study findings contribute to knowledge in the field. When literature reviews, theoretical frameworks, and conceptual frameworks are disconnected from one another, the study suffers. The point of the study is lost, suggested findings are unsupported, or important conclusions are invisible to the researcher. In addition, this misalignment may be costly in terms of time and money.

Conducting a literature review, selecting a theoretical framework, and building a conceptual framework are some of the most difficult elements of a research study. It takes time to understand the relevant research, identify a theoretical framework that provides important insights into the study, and formulate a conceptual framework that organizes the finding. In the research process, there is often a constant back and forth among these elements as the study evolves. With an ongoing refinement of the review of literature, clarification of the theoretical framework, and articulation of a conceptual framework, a sound study can emerge that makes a contribution to the field. This is the goal of BER and education research.

Supplementary Material

  • Allee, V. (2000). Knowledge networks and communities of learning . OD Practitioner , 32 ( 4 ), 4–13. [ Google Scholar ]
  • Allen, M. (2017). The Sage encyclopedia of communication research methods (Vols. 1–4 ). Los Angeles, CA: Sage. 10.4135/9781483381411 [ CrossRef ] [ Google Scholar ]
  • American Association for the Advancement of Science. (2011). Vision and change in undergraduate biology education: A call to action . Washington, DC. [ Google Scholar ]
  • Anfara, V. A., Mertz, N. T. (2014). Setting the stage . In Anfara, V. A., Mertz, N. T. (eds.), Theoretical frameworks in qualitative research (pp. 1–22). Sage. [ Google Scholar ]
  • Barnes, M. E., Brownell, S. E. (2016). Practices and perspectives of college instructors on addressing religious beliefs when teaching evolution . CBE—Life Sciences Education , 15 ( 2 ), ar18. https://doi.org/10.1187/cbe.15-11-0243 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Boote, D. N., Beile, P. (2005). Scholars before researchers: On the centrality of the dissertation literature review in research preparation . Educational Researcher , 34 ( 6 ), 3–15. 10.3102/0013189x034006003 [ CrossRef ] [ Google Scholar ]
  • Booth, A., Sutton, A., Papaioannou, D. (2016a). Systemic approaches to a successful literature review (2nd ed.). Los Angeles, CA: Sage. [ Google Scholar ]
  • Booth, W. C., Colomb, G. G., Williams, J. M., Bizup, J., Fitzgerald, W. T. (2016b). The craft of research (4th ed.). Chicago, IL: University of Chicago Press. [ Google Scholar ]
  • Brownell, S. E., Kloser, M. J. (2015). Toward a conceptual framework for measuring the effectiveness of course-based undergraduate research experiences in undergraduate biology . Studies in Higher Education , 40 ( 3 ), 525–544. https://doi.org/10.1080/03075079.2015.1004234 [ Google Scholar ]
  • Connolly, M. R., Lee, Y. G., Savoy, J. N. (2018). The effects of doctoral teaching development on early-career STEM scholars’ college teaching self-efficacy . CBE—Life Sciences Education , 17 ( 1 ), ar14. https://doi.org/10.1187/cbe.17-02-0039 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Cooper, K. M., Blattman, J. N., Hendrix, T., Brownell, S. E. (2019). The impact of broadly relevant novel discoveries on student project ownership in a traditional lab course turned CURE . CBE—Life Sciences Education , 18 ( 4 ), ar57. https://doi.org/10.1187/cbe.19-06-0113 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Creswell, J. W. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Los Angeles, CA: Sage. [ Google Scholar ]
  • DeHaan, R. L. (2011). Education research in the biological sciences: A nine decade review (Paper commissioned by the NAS/NRC Committee on the Status, Contributions, and Future Directions of Discipline Based Education Research) . Washington, DC: National Academies Press. Retrieved May 20, 2022, from www7.nationalacademies.org/bose/DBER_Mee ting2_commissioned_papers_page.html [ Google Scholar ]
  • Ding, L. (2019). Theoretical perspectives of quantitative physics education research . Physical Review Physics Education Research , 15 ( 2 ), 020101. [ Google Scholar ]
  • Dirks, C. (2011). The current status and future direction of biology education research . Paper presented at: Second Committee Meeting on the Status, Contributions, and Future Directions of Discipline-Based Education Research, 18–19 October (Washington, DC). Retrieved May 20, 2022, from http://sites.nationalacademies.org/DBASSE/BOSE/DBASSE_071087 [ Google Scholar ]
  • Duran, R. P., Eisenhart, M. A., Erickson, F. D., Grant, C. A., Green, J. L., Hedges, L. V., Schneider, B. L. (2006). Standards for reporting on empirical social science research in AERA publications: American Educational Research Association . Educational Researcher , 35 ( 6 ), 33–40. [ Google Scholar ]
  • Ebert-May, D., Derting, T. L., Henkel, T. P., Middlemis Maher, J., Momsen, J. L., Arnold, B., Passmore, H. A. (2015). Breaking the cycle: Future faculty begin teaching with learner-centered strategies after professional development . CBE—Life Sciences Education , 14 ( 2 ), ar22. https://doi.org/10.1187/cbe.14-12-0222 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Galvan, J. L., Galvan, M. C. (2017). Writing literature reviews: A guide for students of the social and behavioral sciences (7th ed.). New York, NY: Routledge. https://doi.org/10.4324/9781315229386 [ Google Scholar ]
  • Gehrke, S., Kezar, A. (2017). The roles of STEM faculty communities of practice in institutional and departmental reform in higher education . American Educational Research Journal , 54 ( 5 ), 803–833. https://doi.org/10.3102/0002831217706736 [ Google Scholar ]
  • Ghee, M., Keels, M., Collins, D., Neal-Spence, C., Baker, E. (2016). Fine-tuning summer research programs to promote underrepresented students’ persistence in the STEM pathway . CBE—Life Sciences Education , 15 ( 3 ), ar28. https://doi.org/10.1187/cbe.16-01-0046 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Institute of Education Sciences & National Science Foundation. (2013). Common guidelines for education research and development . Retrieved May 20, 2022, from www.nsf.gov/pubs/2013/nsf13126/nsf13126.pdf
  • Jensen, J. L., Lawson, A. (2011). Effects of collaborative group composition and inquiry instruction on reasoning gains and achievement in undergraduate biology . CBE—Life Sciences Education , 10 ( 1 ), 64–73. https://doi.org/10.1187/cbe.19-05-0098 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Kolpikova, E. P., Chen, D. C., Doherty, J. H. (2019). Does the format of preclass reading quizzes matter? An evaluation of traditional and gamified, adaptive preclass reading quizzes . CBE—Life Sciences Education , 18 ( 4 ), ar52. https://doi.org/10.1187/cbe.19-05-0098 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Labov, J. B., Reid, A. H., Yamamoto, K. R. (2010). Integrated biology and undergraduate science education: A new biology education for the twenty-first century? CBE—Life Sciences Education , 9 ( 1 ), 10–16. https://doi.org/10.1187/cbe.09-12-0092 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Lane, T. B. (2016). Beyond academic and social integration: Understanding the impact of a STEM enrichment program on the retention and degree attainment of underrepresented students . CBE—Life Sciences Education , 15 ( 3 ), ar39. https://doi.org/10.1187/cbe.16-01-0070 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Lave, J. (1988). Cognition in practice: Mind, mathematics and culture in everyday life . New York, NY: Cambridge University Press. [ Google Scholar ]
  • Lo, S. M., Gardner, G. E., Reid, J., Napoleon-Fanis, V., Carroll, P., Smith, E., Sato, B. K. (2019). Prevailing questions and methodologies in biology education research: A longitudinal analysis of research in CBE — Life Sciences Education and at the Society for the Advancement of Biology Education Research . CBE—Life Sciences Education , 18 ( 1 ), ar9. https://doi.org/10.1187/cbe.18-08-0164 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Lysaght, Z. (2011). Epistemological and paradigmatic ecumenism in “Pasteur’s quadrant:” Tales from doctoral research . In Official Conference Proceedings of the Third Asian Conference on Education in Osaka, Japan . Retrieved May 20, 2022, from http://iafor.org/ace2011_offprint/ACE2011_offprint_0254.pdf
  • Maxwell, J. A. (2012). Qualitative research design: An interactive approach (3rd ed.). Los Angeles, CA: Sage. [ Google Scholar ]
  • Miles, M. B., Huberman, A. M., Saldaña, J. (2014). Qualitative data analysis (3rd ed.). Los Angeles, CA: Sage. [ Google Scholar ]
  • Nehm, R. (2019). Biology education research: Building integrative frameworks for teaching and learning about living systems . Disciplinary and Interdisciplinary Science Education Research , 1 , ar15. https://doi.org/10.1186/s43031-019-0017-6 [ Google Scholar ]
  • Patton, M. Q. (2015). Qualitative research & evaluation methods: Integrating theory and practice . Los Angeles, CA: Sage. [ Google Scholar ]
  • Perry, J., Meir, E., Herron, J. C., Maruca, S., Stal, D. (2008). Evaluating two approaches to helping college students understand evolutionary trees through diagramming tasks . CBE—Life Sciences Education , 7 ( 2 ), 193–201. https://doi.org/10.1187/cbe.07-01-0007 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Posner, G. J., Strike, K. A., Hewson, P. W., Gertzog, W. A. (1982). Accommodation of a scientific conception: Toward a theory of conceptual change . Science Education , 66 ( 2 ), 211–227. [ Google Scholar ]
  • Ravitch, S. M., Riggan, M. (2016). Reason & rigor: How conceptual frameworks guide research . Los Angeles, CA: Sage. [ Google Scholar ]
  • Reeves, T. D., Marbach-Ad, G., Miller, K. R., Ridgway, J., Gardner, G. E., Schussler, E. E., Wischusen, E. W. (2016). A conceptual framework for graduate teaching assistant professional development evaluation and research . CBE—Life Sciences Education , 15 ( 2 ), es2. https://doi.org/10.1187/cbe.15-10-0225 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Reynolds, J. A., Thaiss, C., Katkin, W., Thompson, R. J. Jr. (2012). Writing-to-learn in undergraduate science education: A community-based, conceptually driven approach . CBE—Life Sciences Education , 11 ( 1 ), 17–25. https://doi.org/10.1187/cbe.11-08-0064 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Rocco, T. S., Plakhotnik, M. S. (2009). Literature reviews, conceptual frameworks, and theoretical frameworks: Terms, functions, and distinctions . Human Resource Development Review , 8 ( 1 ), 120–130. https://doi.org/10.1177/1534484309332617 [ Google Scholar ]
  • Rodrigo-Peiris, T., Xiang, L., Cassone, V. M. (2018). A low-intensity, hybrid design between a “traditional” and a “course-based” research experience yields positive outcomes for science undergraduate freshmen and shows potential for large-scale application . CBE—Life Sciences Education , 17 ( 4 ), ar53. https://doi.org/10.1187/cbe.17-11-0248 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Sabel, J. L., Dauer, J. T., Forbes, C. T. (2017). Introductory biology students’ use of enhanced answer keys and reflection questions to engage in metacognition and enhance understanding . CBE—Life Sciences Education , 16 ( 3 ), ar40. https://doi.org/10.1187/cbe.16-10-0298 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Sbeglia, G. C., Goodridge, J. A., Gordon, L. H., Nehm, R. H. (2021). Are faculty changing? How reform frameworks, sampling intensities, and instrument measures impact inferences about student-centered teaching practices . CBE—Life Sciences Education , 20 ( 3 ), ar39. https://doi.org/10.1187/cbe.20-11-0259 [ PMC free article ] [ PubMed ] [ Google Scholar ]
  • Schwandt, T. A. (2000). Three epistemological stances for qualitative inquiry: Interpretivism, hermeneutics, and social constructionism . In Denzin, N. K., Lincoln, Y. S. (Eds.), Handbook of qualitative research (2nd ed., pp. 189–213). Los Angeles, CA: Sage. [ Google Scholar ]
  • Sickel, A. J., Friedrichsen, P. (2013). Examining the evolution education literature with a focus on teachers: Major findings, goals for teacher preparation, and directions for future research . Evolution: Education and Outreach , 6 ( 1 ), 23. https://doi.org/10.1186/1936-6434-6-23 [ Google Scholar ]
  • Singer, S. R., Nielsen, N. R., Schweingruber, H. A. (2012). Discipline-based education research: Understanding and improving learning in undergraduate science and engineering . Washington, DC: National Academies Press. [ Google Scholar ]
  • Todd, A., Romine, W. L., Correa-Menendez, J. (2019). Modeling the transition from a phenotypic to genotypic conceptualization of genetics in a university-level introductory biology context . Research in Science Education , 49 ( 2 ), 569–589. https://doi.org/10.1007/s11165-017-9626-2 [ Google Scholar ]
  • Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes . Cambridge, MA: Harvard University Press. [ Google Scholar ]
  • Wenger, E. (1998). Communities of practice: Learning as a social system . Systems Thinker , 9 ( 5 ), 2–3. [ Google Scholar ]
  • Ziadie, M. A., Andrews, T. C. (2018). Moving evolution education forward: A systematic analysis of literature to identify gaps in collective knowledge for teaching . CBE—Life Sciences Education , 17 ( 1 ), ar11. https://doi.org/10.1187/cbe.17-08-0190 [ PMC free article ] [ PubMed ] [ Google Scholar ]

what is variable in literature review

Evidence Review of the Adverse Effects of COVID-19 Vaccination and Intramuscular Vaccine Administration

Vaccines are a public health success story, as they have prevented or lessened the effects of many infectious diseases. To address concerns around potential vaccine injuries, the Health Resources and Services Administration (HRSA) administers the Vaccine Injury Compensation Program (VICP) and the Countermeasures Injury Compensation Program (CICP), which provide compensation to those who assert that they were injured by routine vaccines or medical countermeasures, respectively. The National Academies of Sciences, Engineering, and Medicine have contributed to the scientific basis for VICP compensation decisions for decades.

HRSA asked the National Academies to convene an expert committee to review the epidemiological, clinical, and biological evidence about the relationship between COVID-19 vaccines and specific adverse events, as well as intramuscular administration of vaccines and shoulder injuries. This report outlines the committee findings and conclusions.

Read Full Description

  • Digital Resource: Evidence Review of the Adverse Effects of COVID-19 Vaccination
  • Digital Resource: Evidence Review of Shoulder Injuries from Intramuscular Administration of Vaccines
  • Press Release

Recent News

what is variable in literature review

Rohr Named U.S. Winner of Frontiers Planet Prize

what is variable in literature review

NAS Launches Science and Innovation Fund for Ukraine

what is variable in literature review

Science Academies Issue Statements to Inform G7 Talks

what is variable in literature review

Supporting Family Caregivers in STEMM

  • Load More...
  • Case Report
  • Open access
  • Published: 22 April 2024

Post-COVID reactivation of latent Bartonella henselae infection: a case report and literature review

  • Yanzhao Dong 1 ,
  • Ahmad Alhaskawi 1 ,
  • Xiaodi Zou 2 ,
  • Haiying Zhou 3 ,
  • Sohaib Hasan Abdullah Ezzi 4 ,
  • Vishnu Goutham Kota 5 ,
  • Mohamed Hasan Abdulla Hasan Abdulla 5 ,
  • Alenikova Olga 6 ,
  • Sahar Ahmed Abdalbary 7 &

BMC Infectious Diseases volume  24 , Article number:  422 ( 2024 ) Cite this article

Metrics details

Cat scratch disease (CSD) is caused by Bartonella henselae ( B. henselae ) and presents as lymphadenopathy following close contact with cats. However, in context of the global COVID-19 pandemic, clinical manifestations of CSD may vary, posing new challenges for healthcare professionals. Here we describe a case of a 54-year-old male with painful left upper arm mass, which gradually resolved until he was infected with COVID-19. The mass then rapidly progressed before admission. Meanwhile, pulmonary symptoms including pleural effusion emerged simultaneously. The cause was undetermined with routine blood culture and pathological test until the next generation sequencing (NGS) confirmed the presence of B. henselae . We believe this case is the first to report localized aggravation of CSD after COVID-19 infection and hopefully, offers treatment experience for clinicians worldwide.

Peer Review reports

Introduction

Cat-scratch disease (CSD), an uncommon infection often observed in households with domestic cats, is first described in 1950 by Debré R. et al. [ 1 ]. The causative pathogen of CSD is Bartonella henselae ( B. henselae ), a Gram-negative rod that can be detected by immunohistochemistry and several silver staining methods including Warthin-Starry stain, Steiner stain and Dieterle stain [ 2 ]. At the early stage of infection, CSD normally presents as non-specific lymphadenopathy affecting both adults and children [ 3 ]. As an infectious disease, CSD has been reported worldwide and higher incidents are reported in the autumn and winter, perceivably associated the seasonal breeding of domestic cats [ 4 ].

CSD is commonly seen among young adults and children, and the major clinical manifestations of CSD include a papule at the site of microbe entrance and axillary node lymphadenopathy, which could progress to fever, aches, nausea, abdominal pain and malaise [ 5 ]. Diagnosis of CSD is usually dependent on both history of cat contact and primary lesions followed by regional lymphadenopathy, which can be further confirmed via serological evidence, blood or suppuration culture, and the next generation sequencing (NGS). However, B. henselae is a slow-growing bacterium, and bacterial culture could take up to 21 days, with a high false-negative rate. While serological tests could aid in the diagnosis, they often fail to differentiate between B. henselae and other Bartonella species. Furthermore, positive serological results may persist for years after treatment. In contrast, NGS is a highly accurate method for identifying various pathogens including B. henselae . Additionally, NGS can provide quantitative data regarding the detected pathogen, serving as an indicator of the infection’s severity. This quantitative information can be invaluable in monitoring the status of the infection. Approximately 90% of untreated lymphadenitis and lymph node enlargement following CSD gradually regress to normal size in immunocompetent patients over a period of several months, while the remaining 10% patients could progress to cutaneous erythema and result in spontaneous suppuration [ 6 ]. In these cases, the combined use of azithromycin and rifampin orally or intravenously is recommended, although the dosage and course may vary [ 7 , 8 ].

While CSD is the most common manifestation of bartonellosis and over 90% cases of CSD are benign and self-limiting, the spectrum of bartonellosis is expanding as several studies and cases have elucidated association between Bartonella infection and cardiovascular, neurological, psychiatric, ocular and rheumatic disorders [ 9 , 10 , 11 , 12 , 13 ]. For immunocompromised patients, B. henselae infection elicits vasoproliferative responses instead of localized lymphadenopathy, and manifests as a cutaneous angiogenic lesion with inflammatory cell infiltrates [ 1 ]. What is causing this phenomenon, however, is still under debate. Moreover, disseminated bartonellosis has been observed in several cases of patients with human immunodeficiency virus (HIV) infection, and one of the cases reported rapid exacerbation to respiratory failure and ultimately, death of the patient [ 14 , 15 , 16 ]. As our understanding grows, it is being increasing acknowledged that bartonellosis is a major public health issue, and efforts made to better comprehend its reservoir and vector can be assimilated into solving this problem [ 17 ].

Since its discovery, CSD has been studied comprehensively by research groups across the world. Nevertheless, little is known about CSD progression in the context of Coronavirus disease 2019 (COVID) infection, with only one case report available on coinfection of COVID and B. henselae in 2021 [ 18 ]. We believe that this is the first case to report reactivation of B. henselae post COVID infection.

Case presentation

On January 31, 2023, a previously healthy male was admitted with a one-month history of red and swollen mass on the ulnar side of left upper arm. At the onset of the swollen mass, he visited the local clinic and ultrasound (US) examination was ordered, indicating inflammation with abscess formation. Therefore, he was prescribed with oral administration of cefuroxime (250 mg, BID) for 7 days and pain relief treatment (irecoxib, 100 mg, BID). The mass gradually resolved until shortly progression complicated with symptoms of fever (Tmax = 39.5 °C), cough, fatigue, myalgia, shortness of breath and anorexia, which was confirmed to be COVID infection by local hospital. During this period, he observed rapid progression of the original mass with both an increase in size and the formation of a purulent spot. In search of second medical opinion, he visited our out-patient clinic. Prehospital magnetic resonance imaging (MRI) indicated soft tissue swelling on the ulnar side of the left upper arm, with an internal mass-like elongated T2 signal and cellulitis-like enhancement on the enhancement imaging. He recalled no history of distant travel, animal bites or scratches. As a construction worker, he was generally well and the only significant medical history was lumbar disc herniation microdiscectomy he received 10 years ago.

On admission, the patient complained of coughing with white sputum, severe anorexia and nausea. Worse even, the mass had ruptured on the way to hospital, and he had to covered it with some gauze. During the dressing change, it was observed that the mass was swollen with a sinus tract, and approximately 15 mL exudate was drained. The exudate was initially purulent and became hemopurulent on pressure. Physical examination revealed lymphadenopathy in the unilateral axillary and supratrochlear lymph nodes, with local redness and tenderness around the abscess. Subcutaneous edema on the ulnar side of the left upper arm and forearm was observed. Lung auscultation showed scattered rales in both lungs, occasionally with wheezing. Pre-operative blood tests showed elevated white blood cell count (WBC) of 13.08*10 9 /L (normal range 4.0–10.0*10 9 /L), elevated C reactive protein (CRP) of 37.54 mg/L (normal range 0.00–8.00 mg/L) and negative result of HIV infection. Meanwhile, the patient showed no signs of fever (Temperature = 36.6 °C). Pulmonary CT scan showed inflammation on both lungs with interlobular and pleural effusion. Therefore, the patient was started empirically on intravenous infusion of piperacillin/tazobactam for the lesion and possible lower respiratory tract infection. On day 2 of admission, the first surgery was performed, where an extended incision was made to expose the subcutaneous fascia, revealing large amount of inflamed granulation tissue. The ulnar nerve was intact but adherent to surround tissue, and careful dissection was performed to free the ulnar nerve and avoid nerve damage. After excision of necrotic tissue, the abscess cavity was repeatedly irrigated and covered with vacuum sealing drainage (VSD) device. The excised tissue was then set for NGS, pathological tests and bacterial culture (Fig.  1 ).

figure 1

( A) : MRI image of the mass on admission; ( B ): Preoperative view of the mass, the pus head has ruptured; ( C) : Intra-operative view of the mass, most necrotic or infected tissue have been removed; ( D) : Post-operative histopathological results showing acute and chronic inflammation of subcutaneous soft tissue with histiocytes infiltration (marked by green triangle and magnification on the upper right corner), regional inflammatory granulation tissue hyperplasia (marked by red star)

In the meantime, on day 4 of hospitalization, the patient complained of shortness of breath with decreased blood oxygen saturation levels, and an urgent pulmonary CT scan was ordered. The repeated CT report showed progressed bilateral pleural and interlobar effusions with atelectasis of both lower lobes, and a new ground-glass opacity in the apical segment of the right upper lobe, suggestive of inflammatory changes. At consultation in respiratory medicine experts, bilateral thoracentesis and placement of chest drainage tubes was ordered, and a total of 1100 mL yellow clear pleural effusion was drained on the first day. The pleural drainage was collected and underwent routine, biological examination and bacterium culture, indicating Non-septic Exudative Pleural Effusion. Multiple tissue sample were sent for testing and culture, and the NGS result on day 5 reported presence of B. henselae in the abscess, which confirmed the diagnosis of CSD. Further inquiry on medical history revealed that the patient owned a rural warehouse where he kept clothing and bed sheets, and a pet cat, although he remembered frequent visit of local feral cats. The warehouse was relatively poor in terms of air flow, where he would take occasional naps. After alteration of antibiotic plan to doxycycline combined with azithromycin, the pulmonary distress gradually resolved and inflammatory indicators reduced to normal level on day 8 (CRP: 0.49 mg/L; WBC 5.02*10 9 /L).

On day 8 of admission, the patient reported relief from chest tightness and shortness of breath, and a repeated CT showed interstitial changes in both lungs without pleural effusion on day 8 of admission (Fig.  2 ). The bilateral chest drainage tubes were then removed.

figure 2

Pulmonary CT scan results with effusion indicated by red arrows. A : Taken 2 days prior to admission, showing interstitial changes, pneumonia with minor amount of pleural effusion; ( B) : Taken on day 4 of admission, showing progressed pneumonia with increased pleural effusion; ( C) : Taken on day 8 of admission, showing alleviated pneumonia, and previous pleural effusion absorbed; ( D) : Taken 2 weeks after discharge with normal result

Meanwhile, as the pulmonary symptoms relieved, the patient underwent secondary debridement, which showed localized inflammation and limited residual granulation tissue, and the remaining necrotized tissue was removed before suturing. The patient was generally well after the second surgery and discharged on day 11 of admission.

On out-patient follow-up 2 weeks later, the patient recovered from the previous symptoms. Physical examination showed negative pulmonary signs, and the incision healed without further inflammation.

CSD has been reported to cause pleural effusion possibly due to obstructed lymphatic drainage from the lungs [ 19 ]. In this case, the pulmonary CT scan on day 4 of admission showed interstitial inflammation with bilateral pulmonary effusion, indicating a possible role of COVID infection. This phenomenon was also observed in canine, as reported by Cherry N. et al. in 2009 [ 20 ]. Interestingly, a canine study led by Weeden A. et al. indicated positive B. henselae DNA in pleural and peritoneal effusion while pericardial effusion showed negative results [ 21 ]. In our case, the recurrence of localized mass and subsequent pleural effusion was parallel to COVID infection, possibly due to disrupted immune response.

As a zoonotic pathogen, B. henselae is transmitted to cats by flea feces contamination and ingested while grooming, therefore transmission to human is often achieved by cat scratches and bites [ 22 , 23 ]. This was corroborated by Chomel B. et al. in 1996, where they observed transmission of B. henselae to specific-pathogen-free (SPF) cats through contact with infected flea. They also noted that highly bacteremic cats, in absence of fleas, were unable to infect SPF cats [ 24 ]. The seasonality of CSD diagnosis, interestingly, has also been extensively studied by Nelson A., Saha S. and Mead P. in the United States spanning from 2005 to 2013 [ 25 ]. It was observed that the largest proportion of CSD diagnosis was made during January, followed by August and November, which they attributed to adoption pattern and age susceptibility of kittens, and peaking of fleas during fall and winter [ 26 ]. This is in line with our patient, who was also admitted in January.

In terms of source of infection, our patient denied cat scratch or bite on admission, whereas indirect contact with cats was found possible in his warehouse. The indirect mode of B. henselae transmission in this case was recently reported by Bush J. et al. in 2023, and they revealed the ability of B. henselae to exist stably in several biological and non-biological fluids [ 27 ]. While the discovery is exhilarating, the possibility of indirect B. henselae transmission poses a challenge for clinicians in face of similar patients without relevant history of feline contact.

Infection of B. henselae could cause diverse clinical symptoms depending on the age group, where children and younger individuals are prone to develop lymphadenitis while the elderly are more likely to suffer from endocarditis, and combined with B. quintana account for over 90% Bartonella endocarditis cases [ 28 ]. While it is necessary to consider infection of Bartonella species in the differential diagnosis in patients with fever of unknown causes, CSD is often misdiagnosed since the diagnosis is critically dependent on serological tests or polymerase chain reaction (PCR) assay as routine blood culture methods fails to detect B. henselae [ 5 ]. While serological test often shows high sensitivity, it fails to distinguish from ongoing infection and past infection. On the other hand, PCR assay has been shown to detect B. henselae in fresh tissue or purulent sample with high sensitivity and specificity, as reported by Gaoz S. et al. in 2022 [ 29 ]. The major challenge for clinicians and microbiologists is that PCR requires specific target, which is sometimes unidentified initially. Another factor for PCR sensitivity is the type of sample, since Khalfe N. and Lin D. observed decreased PCR sensitivity in paraffin embedded sample fixed by formalin [ 30 ]. In comparison, NGS could detect the species of pathogen with a quantity profile, offering assistance for clinicians to narrow down suspected pathogens at an early stage of diseases.

COVID has been characterized as a highly transmissible emerging pathogen, causing mild to severe respiratory symptoms with or without systematic complications and spreading fast across the world [ 31 ]. In context of the global pandemic of COVID, the incidence of various disease has surged due to a variety of reasons. A national study in Argentina in 2022 reported that COVID pandemic is associated with increased incidence of CSD, which was attributed to the prolonged cat contact due to quarantine, and higher rates of systematic CSD, which is yet to be explained [ 32 ].

In conclusion, we present a case underscoring the importance of vigilance in diagnosing and managing unusual presentations of less common diseases, especially in the context of the COVID-19 pandemic. While CSD is typically a self-limiting condition, this case was complicated by COVID-19, leading to unique challenges in both diagnosis and treatment. The co-occurrence of these two conditions highlights the complexity of managing infectious diseases in a time of a global pandemic. Clinicians, hence, should consider multiple diagnostic possibilities and adapt treatment strategies accordingly.

Availability of data and materials

The dataset supporting the conclusions of this article is included with the article.

Florin TA, Zaoutis TE, Zaoutis LB. Beyond cat scratch disease: widening spectrum of Bartonella henselae infection. Pediatrics. 2008;121(5):e1413–25.

Article   PubMed   Google Scholar  

Peng J, Fan Z, Zheng H, Lu J, Zhan Y. Combined application of immunohistochemistry and Warthin-starry silver stain on the pathologic diagnosis of cat scratch disease. Appl Immunohistochem Mol Morphol. 2020;28(10):781–5.

Article   CAS   PubMed   Google Scholar  

Klotz SA, Ianas V, Elliott SP. Cat-scratch disease. Am Fam Physician. 2011;83(2):152–5.

PubMed   Google Scholar  

Windsor JJ. Cat-scratch disease: epidemiology, aetiology and treatment. Br J Biomed Sci. 2001;58(2):101–10.

CAS   PubMed   Google Scholar  

Mazur-Melewska K, Mania A, Kemnitz P, Figlerowicz M, Sluzewski W. Cat-scratch disease: a wide spectrum of clinical pictures. Postepy Dermatol Alergol. 2015;32(3):216–20.

Article   PubMed   PubMed Central   Google Scholar  

Bass JW, Vincent JM, Person DA. The expanding spectrum of Bartonella infections: II. Cat-scratch disease. Pediatr Infect Dis J. 1997;16(2):163–79.

Johnson SC, Kosut J, Ching N. Disseminated cat scratch disease in pediatric patients in Hawai’i. Hawaii J Health Soc Welf. 2020;79(5 Suppl 1):64–70.

PubMed   PubMed Central   Google Scholar  

Rolain JM, Brouqui P, Koehler JE, Maguina C, Dolan MJ, Raoult D. Recommendations for treatment of human infections caused by Bartonella species. Antimicrob Agents Chemother. 2004;48(6):1921–33.

Article   CAS   PubMed   PubMed Central   Google Scholar  

Breitschwerdt EB, Bradley JM, Maggi RG, Lashnits E, Reicherter P. Bartonella associated cutaneous lesions (BACL) in people with neuropsychiatric symptoms. Pathogens. 2020;9(12).

Breitschwerdt EB, Greenberg R, Maggi RG, Mozayeni BR, Lewis A, Bradley JM. Bartonella henselae bloodstream infection in a boy with pediatric acute-onset neuropsychiatric syndrome. J Cent Nerv Syst Dis. 2019;11:1179573519832014.

Mozayeni BR, Maggi RG, Bradley JM, Breitschwerdt EB. Rheumatological presentation of Bartonella koehlerae and Bartonella henselae bacteremias: a case report. Medicine (Baltimore). 2018;97(17):e0465.

Santos LSD, Drummond MR, Franca A, Pavan MHP, Stelini RF, Cintra ML, et al. Chronic type 2 reaction possibly triggered by an asymptomatic Bartonella henselae infection in a leprosy patient. Rev Inst Med Trop Sao Paulo. 2022;64:e17.

Drummond MR, de Almeida AR, Valandro L, Pavan MHP, Stucchi RSB, Aoki FH, et al. Bartonella henselae endocarditis in an elderly patient. PLoS Negl Trop Dis. 2020;14(7):e0008376.

Guccion JG, Gibert CL, Ortega LG, Hadfield TL. Cat scratch disease and acquired immunodeficiency disease: diagnosis by transmission electron microscopy. Ultrastruct Pathol. 1996;20(3):195–202.

Camargo ME. Cat scratch disease and AIDS. Rev Soc Bras Med Trop. 1994;27(2):65–7.

Shi Y, Yang J, Qi Y, Xu J, Shi Y, Shi T, et al. Detection of Bartonella vinsonii subsp. berkhoffii in an HIV patient using metagenomic next-generation sequencing. Emerg. Microbes Infect. 2022;11(1):1764–7.

Article   CAS   Google Scholar  

Cheslock MA, Embers ME. Human Bartonellosis: an underappreciated public health problem? Trop Med Infect Dis. 2019;4(2).

Garland H, Stoll S, Patel S, Mogal R. A case of Bartonellosis presenting as a puzzling multisystem disorder complicated by nosocomial COVID-19 infection. BMJ Case Rep. 2021;14(8).

Whitman BW, Krafte-Jacobs B. Cat-scratch disease associated with pleural effusions and encephalopathy in a child. Respiration. 1995;62(3):171–3.

Cherry NA, Diniz PP, Maggi RG, Hummel JB, Hardie EM, Behrend EN, et al. Isolation or molecular detection of Bartonella henselae and Bartonella vinsonii subsp. berkhoffii from dogs with idiopathic cavitary effusions. J Vet Intern Med. 2009;23(1):186–9.

Weeden AL, Cherry NA, Breitschwerdt EB, Cheves AG, Wamsley HL. Bartonella henselae in canine cavitary effusions: prevalence, identification, and clinical associations. Vet Clin Pathol. 2017;46(2):326–30.

Chomel BB, Boulouis HJ, Breitschwerdt EB, Kasten RW, Vayssier-Taussat M, Birtles RJ, et al. Ecological fitness and strategies of adaptation of Bartonella species to their hosts and vectors. Vet Res. 2009;40(2):29.

Demers DM, Bass JW, Vincent JM, Person DA, Noyes DK, Staege CM, et al. Cat-scratch disease in Hawaii: etiology and seroepidemiology. J Pediatr. 1995;127(1):23–6.

Chomel BB, Kasten RW, Floyd-Hawkins K, Chi B, Yamamoto K, Roberts-Wilson J, et al. Experimental transmission of Bartonella henselae by the cat flea. J Clin Microbiol. 1996;34(8):1952–6.

Nelson CA, Saha S, Mead PS. Cat-scratch disease in the United States, 2005-2013. Emerg Infect Dis. 2016;22(10):1741–6.

Guptill L, Wu CC, HogenEsch H, Slater LN, Glickman N, Dunham A, et al. Prevalence, risk factors, and genetic diversity of Bartonella henselae infections in pet cats in four regions of the United States. J Clin Microbiol. 2004;42(2):652–9.

Bush JC, Maggi RG, Breitschwerdt EB. Viability and desiccation resistance of Bartonella henselae in biological and non-biological fluids: evidence for pathogen environmental stability. Pathogens. 2023;12(7).

Fournier PE, Lelievre H, Eykyn SJ, Mainardi JL, Marrie TJ, Bruneel F, et al. Epidemiologic and clinical characteristics of Bartonella quintana and Bartonella henselae endocarditis: a study of 48 patients. Medicine (Baltimore). 2001;80(4):245–51.

Goaz S, Rasis M, Binsky Ehrenreich I, Shapira L, Halutz O, Graidy-Varon M, et al. Molecular diagnosis of cat scratch disease: a 25-year retrospective comparative analysis of various clinical specimens and different PCR assays. Microbiol Spectr. 2022;10(2):e0259621.

Khalfe N, Lin D. Diagnosis and interpretation of testing for cat scratch disease. Proc (Bayl Univ Med Cent). 2022;35(1):68–9.

Hui DS, Azhar EI, Madani TA, Ntoumi F, Kock R, Dar O, et al. The continuing 2019-nCoV epidemic threat of novel coronaviruses to global health - The latest 2019 Novel coronavirus outbreak in Wuhan, China. Int J Infect Dis 2020;91:264–266.

Praino MLJG, Tineo S, Martinez M, Caratozzolo A, Toledano A, Cazes C, Contrini MM, López EL. 1357. Collateral consequence of COVID pandemic: Increased incidence of cat scratch disease. Open Forum Infect Dis. 2022;9(Suppl 2):ofac492.1186.

Article   PubMed Central   Google Scholar  

Download references

Acknowledgements

Not applicable.

Author information

Authors and affiliations.

Department of Orthopedics, The First Affiliated Hospital, Zhejiang University, #79 Qingchun Road, Hangzhou, Zhejiang Province, 310003, People’s Republic of China

Yanzhao Dong, Ahmad Alhaskawi & Hui Lu

The Second Affiliated Hospital of Zhejiang Chinese Medical University, Hangzhou, Zhejiang Province, 310003, People’s Republic of China

School of Biomedical Science, Faculty of Medicine, The Chinese University of Hong Kong, Rm 706, 7/F, Lo Kwee-Seong Integrated Biomedical Science Bldg, Shatin, New Territories, Hong Kong, China

Haiying Zhou

Department of Orthopedics, Third Xiangya Hospital, Central South University, #138 Tongzi po Road, Changsha, Hunan Province, 410013, People’s Republic of China

Sohaib Hasan Abdullah Ezzi

Zhejiang University School of Medicine, #866 Yuhangtang Road, Hangzhou, Zhejiang Province, 3100058, People’s Republic of China

Vishnu Goutham Kota & Mohamed Hasan Abdulla Hasan Abdulla

Department of Neurology, Republican Research and Clinical Center of Neurology and Neurosurgery, Skoriny, Minsk, Belarus

Alenikova Olga

Department of Orthopedic Physical Therapy, Faculty of Physical Therapy, Nahda University in Beni Suef, Beni Suef, Egypt

Sahar Ahmed Abdalbary

You can also search for this author in PubMed   Google Scholar

Contributions

Hui Lu designed the study; Yanzhao Dong and Ahmad Alhaskawi drafted the manuscript, Xiaodi Zou and Haiying Zhou performed literature selection and drew the figures; Sohaib Hasan Abdullah Ezzi and Vishnu Goutham Kota collected patient data, Sahar Ahmed Abdalbary, Alenikova Olga and Mohamed Hasan Abdulla Hasan Abdulla revised the manuscript. The authors have read and approved the final manuscript.

Corresponding author

Correspondence to Hui Lu .

Ethics declarations

Consent for publication.

Written informed consent was obtained from the patient for the publication of clinical details and clinical images. Upon request, a copy of the consent form is available for review by the Editor of this journal.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Dong, Y., Alhaskawi, A., Zou, X. et al. Post-COVID reactivation of latent Bartonella henselae infection: a case report and literature review. BMC Infect Dis 24 , 422 (2024). https://doi.org/10.1186/s12879-024-09336-7

Download citation

Received : 30 October 2023

Accepted : 19 April 2024

Published : 22 April 2024

DOI : https://doi.org/10.1186/s12879-024-09336-7

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Cat scratch disease (CSD)
  • Bartonella henselae
  • High-throughput sequencing

BMC Infectious Diseases

ISSN: 1471-2334

what is variable in literature review

IMAGES

  1. 15 Literature Review Examples (2024)

    what is variable in literature review

  2. How to write a literature review: Tips, Format and Significance

    what is variable in literature review

  3. How To Make A Literature Review For A Research Paper

    what is variable in literature review

  4. Types of Research Variable in Research with Example

    what is variable in literature review

  5. How to Write a Literature Review in 5 Simple Steps

    what is variable in literature review

  6. How to Write a Literature Review in 5 Simple Steps

    what is variable in literature review

VIDEO

  1. What is a variable

  2. Variables in Research: Applied Linguistics

  3. Types of variables in research|Controlled & extragenous variables|Intervening & moderating variables

  4. What is a review of literature in research?

  5. WHAT IS LITERATURE REVIEW?

  6. Literature Review

COMMENTS

  1. How to Write a Literature Review

    Examples of literature reviews. Step 1 - Search for relevant literature. Step 2 - Evaluate and select sources. Step 3 - Identify themes, debates, and gaps. Step 4 - Outline your literature review's structure. Step 5 - Write your literature review.

  2. How to identify relevant variables from a literature review?

    Variables of any study are of four main types. Figure 1: Identifying relevant variables in a research. A dependent variable is a variable that is dependent on the value of another variable. So if anything in the first variable changes then the dependent variable changes too. 'Weight' is often dependent on the 'age' of an individual.

  3. Ten Simple Rules for Writing a Literature Review

    Literature reviews are in great demand in most scientific fields. Their need stems from the ever-increasing output of scientific publications .For example, compared to 1991, in 2008 three, eight, and forty times more papers were indexed in Web of Science on malaria, obesity, and biodiversity, respectively .Given such mountains of papers, scientists cannot be expected to examine in detail every ...

  4. Writing a Literature Review

    A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis).The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays).

  5. What is a Literature Review?

    A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research. There are five key steps to writing a literature review: Search for relevant literature. Evaluate sources. Identify themes, debates and gaps.

  6. Components of the Literature Review

    Literature Review. This is the most time-consuming aspect in the preparation of your research proposal and it is a key component of the research proposal. As described in Chapter 5, the literature review provides the background to your study and demonstrates the significance of the proposed research. Specifically, it is a review and synthesis ...

  7. Independent and Dependent Variables

    Dependent Variable The variable that depends on other factors that are measured. These variables are expected to change as a result of an experimental manipulation of the independent variable or variables. ... In the methods section, you build on the literature review of prior studies about the research problem to describe in detail background ...

  8. Literature Review: The What, Why and How-to Guide

    What kinds of literature reviews are written? Narrative review: The purpose of this type of review is to describe the current state of the research on a specific topic/research and to offer a critical analysis of the literature reviewed. Studies are grouped by research/theoretical categories, and themes and trends, strengths and weakness, and gaps are identified.

  9. Writing a literature review

    A formal literature review is an evidence-based, in-depth analysis of a subject. There are many reasons for writing one and these will influence the length and style of your review, but in essence a literature review is a critical appraisal of the current collective knowledge on a subject. Rather than just being an exhaustive list of all that ...

  10. Literature Reviews?

    Most literature reviews are embedded in articles, books, and dissertations. In most research articles, there are set as a specific section, usually titled, "literature review", so they are hard to miss.But, sometimes, they are part of the narrative of the introduction of a book or article. This section is easily recognized since the author is engaging with other academics and experts by ...

  11. Steps in Conducting a Literature Review

    A literature review is an integrated analysis-- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question.That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.

  12. 5. The Literature Review

    A literature review may consist of simply a summary of key sources, but in the social sciences, a literature review usually has an organizational pattern and combines both summary and synthesis, often within specific conceptual categories.A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information in a way that ...

  13. Literature Review Research

    Literature Review is a comprehensive survey of the works published in a particular field of study or line of research, usually over a specific period of time, in the form of an in-depth, critical bibliographic essay or annotated list in which attention is drawn to the most significant works. Also, we can define a literature review as the ...

  14. What is a literature review?

    A literature or narrative review is a comprehensive review and analysis of the published literature on a specific topic or research question. The literature that is reviewed contains: books, articles, academic articles, conference proceedings, association papers, and dissertations. It contains the most pertinent studies and points to important ...

  15. Literature Review: What is a Literature Review?

    A literature review is an in-depth critical analysis of published scholarly research related to a specific topic. Published scholarly research (the "literature") may include journal articles, books, book chapters, dissertations and thesis, or conference proceedings. ... to discover important variables relevant to the topic; to synthesize and ...

  16. What is a Literature Review?

    A literature review is a review and synthesis of existing research on a topic or research question. A literature review is meant to analyze the scholarly literature, make connections across writings and identify strengths, weaknesses, trends, and missing conversations. A literature review should address different aspects of a topic as it ...

  17. Guidance on Conducting a Systematic Literature Review

    Literature review is an essential feature of academic research. Fundamentally, knowledge advancement must be built on prior existing work. To push the knowledge frontier, we must know where the frontier is. By reviewing relevant literature, we understand the breadth and depth of the existing body of work and identify gaps to explore.

  18. What is a literature review?

    A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question. It is often written as part of a dissertation, thesis, research paper, or proposal.

  19. What is a Literature Review?

    Conducting a Literature Review: What is a Literature Review? Interactive learning module that guides you through the process of identifying, evaluating, and using scholarly information to research and write a literature review.

  20. Chapter 9 Methods for Literature Reviews

    Literature reviews can take two major forms. The most prevalent one is the "literature review" or "background" section within a journal paper or a chapter in a graduate thesis. This section synthesizes the extant literature and usually identifies the gaps in knowledge that the empirical study addresses (Sylvester, Tate, & Johnstone, 2013).

  21. Literature review as a research methodology: An ...

    As mentioned previously, there are a number of existing guidelines for literature reviews. Depending on the methodology needed to achieve the purpose of the review, all types can be helpful and appropriate to reach a specific goal (for examples, please see Table 1).These approaches can be qualitative, quantitative, or have a mixed design depending on the phase of the review.

  22. Literature reviews as independent studies: guidelines for academic

    A literature review - or a review article - is "a study that analyzes and synthesizes an existing body of literature by identifying, challenging, and advancing the building blocks of a theory through an examination of a body (or several bodies) of prior work (Post et al. 2020, p. 352).Literature reviews as standalone pieces of work may allow researchers to enhance their understanding of ...

  23. Literature Reviews, Theoretical Frameworks, and Conceptual Frameworks

    A literature review should connect to the study question, guide the study methodology, and be central in the discussion by indicating how the analyzed data advances what is known in the field. ... A conceptual framework is a description of the way a researcher understands the factors and/or variables that are involved in the study and their ...

  24. Diseases

    Although lymphoma is the most frequent malignancy in common variable immunodeficiency (CVID), solid tumors, especially affected by oncogenic viruses, are not considered. Furthermore, in vitro genetic studies and cell cultures are not adequate for immune system and HBV interaction. We adopted a previously introduced clinical model of host-virus interaction (i.e., infectious process in ...

  25. What Are the Drivers of Bank Profitability in the World? A Critical

    A Critical Review of the Empirical Literature with the Layout of a Blueprint Model. Indranarain Ramlall Department of Economics and Statistics, University of Mauritius, ... 8 Total costs are regressed on a set of independent variables comprising of: log of total assets, half of log total assets squared, price of deposits (interest expenses over ...

  26. Ethics of Manufacturing and Supplying Bottled Water: A Systematic Review

    It uses a systematic review of the literature through the PRISMA method to determine the major ethical concerns surrounding these topics. A total of 107 articles were identified, and 31 were subjected to further reviews and analysis. The study found that the manufacturing and supply of bottled water may be unethical if it ends in deliberate ...

  27. Big data project success factors: A systematic literature review

    Big data project success factors: A systematic literature review. Big Data has become a major technology hotbed between academics and practitioners in the digital competitive area. In developing a successful Big Data project, it is necessary to investigate the variables and category of Critical Success Factors (CSF) that impact the successful ...

  28. New Comprehensive Review Examines Potential Harms of COVID-19

    WASHINGTON — A new report from the National Academies of Sciences, Engineering, and Medicine reviews evidence for 19 potential harms of the COVID-19 vaccines, and for nine potential shoulder injuries from intramuscular administration of vaccines more broadly. The committee that conducted the review identified sufficient evidence to draw 20 conclusions about whether these vaccines could cause ...

  29. Post-COVID reactivation of latent Bartonella henselae infection: a case

    Cat scratch disease (CSD) is caused by Bartonella henselae (B. henselae) and presents as lymphadenopathy following close contact with cats. However, in context of the global COVID-19 pandemic, clinical manifestations of CSD may vary, posing new challenges for healthcare professionals. Here we describe a case of a 54-year-old male with painful left upper arm mass, which gradually resolved until ...