An official website of the United States government
Official websites use .gov A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS A lock ( Lock Locked padlock icon ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.
- Publications
- Account settings
- Advanced Search
- Journal List
Formulating a good research question: Pearls and pitfalls
Wilson fandino.
- Author information
- Copyright and License information
Address for correspondence: Dr. Wilson Fandino, Anaesthesia Department, St Thomas' Hospital NHS Foundation Trust, Westminster Bridge Road, Lambeth, London SE1 7EH, United Kingdom. E-mail: [email protected]
This is an open access journal, and articles are distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 License, which allows others to remix, tweak, and build upon the work non-commercially, as long as appropriate credit is given and the new creations are licensed under the identical terms.
The process of formulating a good research question can be challenging and frustrating. While a comprehensive literature review is compulsory, the researcher usually encounters methodological difficulties in the conduct of the study, particularly if the primary study question has not been adequately selected in accordance with the clinical dilemma that needs to be addressed. Therefore, optimising time and resources before embarking in the design of a clinical protocol can make an impact on the final results of the research project. Researchers have developed effective ways to convey the message of how to build a good research question that can be easily recalled under the acronyms of PICOT (population, intervention, comparator, outcome, and time frame) and FINER (feasible, interesting, novel, ethical, and relevant). In line with these concepts, this article highlights the main issues faced by clinicians, when developing a research question.
Key words: Clinical protocols, medical education, medical writing, research design
INTRODUCTION
What is your research question? This is very often one of the first queries made by statisticians, when researchers come up with an interesting idea. In fact, the findings of a study may only acquire relevance if they provide an accurate and unbiased answer to a specific question,[ 1 , 2 ] and it has been suggested that up to one-third of the time spent in the whole process—from the conception of an idea to the publication of the manuscript—could be invested in finding the right primary study question.[ 3 ] Furthermore, selecting a good research question can be a time-consuming and challenging task: in one retrospective study, Mayo et al . reported that 3 out of 10 articles published would have needed a major rewording of the question.[ 1 ] This paper explores some recommendations to consider before starting any research project, and outlines the main difficulties faced by young and experienced clinicians, when it comes time to turn an exciting idea into a valuable and feasible research question.
OPTIMISATION OF TIME AND RESOURCES
Focusing on the primary research question.
The process of developing a new idea usually stems from a dilemma inherent to the clinical practice.[ 2 , 3 , 4 ] However, once the problem has been identified, it is tempting to formulate multiple research questions. Conducting a clinical trial with more than one primary study question would not be feasible. First, because each question may require a different research design, and second, because the necessary statistical power of the study would demand unaffordable sample sizes. It is the duty of editors and reviewers to make sure that authors clearly identify the primary research question, and as a consequence, studies approaching more than one primary research question may not be suitable for publication.
Working in the right environment
Teamwork is essential to find the appropriate research question. Working in the right environment will enable the investigator to interact with colleagues with different backgrounds, and create opportunities to exchange experiences in a collaborative way between clinicians and researchers. Likewise, it is of paramount importance to get involved colleagues with expertise in the field (lead clinicians, education supervisors, research mentors, department chairs, epidemiologists, biostatisticians, and ethical consultants, among others), and ask for their guidance.[ 5 , 6 , 7 , 8 ]
Evaluating the pertinence of the study
The researcher should wonder if, on the basis of the research question formulated, there is a need for a study to address the problem, as clinical research usually entails a large investment of resources and workforce involvement. Thus, if the answer to the posed clinical question seems to be evident before starting the study, investing in research to address the problem would become superfluous. For example, in a clinical trial, Herzog-Niescery et al . compared laryngeal masks with cuffed and uncuffed tracheal tubes, in the context of surgeons' exposure to sevoflurane, in infants undergoing adenoidectomy. However, it appears obvious that cuffed tracheal tubes are preferred to minimise surgeons' exposure to volatile gases, as authors concluded after recruiting 60 patients.[ 9 ]
Conducting a thorough literature review
Any research project requires the identification of at least one of three problems: the evidence is scarce, the existing literature yields conflicting results, or the results could be improved. Hence, a comprehensive review of the topic is imperative, as it allows the researcher to identify this gap in the literature, formulate a hypothesis and develop a research question.[ 2 ] To this end, it is crucial to be attentive to new ideas, keep the imagination roaming with reflective attitude, and remain sceptical to the new-gained information.[ 4 , 7 ]
Narrowing the research question
A broad research question may encompass an unaffordable extensive topic. For instance, do supraglottic devices provide similar conditions for the visualization of the glottis aperture in a German hospital? Such a general research question usually needs to be narrowed, not only by cutting away unnecessary components (a German hospital is irrelevant in this context), but also by defining a target population, a specific intervention, an alternative treatment or procedure to be compared with the intervention, a measurable primary outcome, and a time frame of the study. In contrast, an example of a good research question would be: among children younger than 1 year of age undergoing elective minor procedures, to what extent the insertion times are different, comparing the Supreme™ laryngeal mask airway (LMA) to Proseal™ LMA, when placed after reaching a BIS index <60?[ 10 ] In this example, the core ingredients of the research question can be easily identified as: children <1 year of age undergoing minor elective procedures, Supreme™ LMA, Proseal™ LMA and insertion times at anaesthetic induction when reaching a BIS index <60. These components are usually gathered in the literature under the acronym of PICOT (population, intervention, comparator, outcome and time frame, respectively).[ 1 , 3 , 5 ]
PICOT FRAMEWORK
Table 1 summarises the foremost questions likely to be addressed when working on PICOT frame.[ 1 , 6 , 8 ] These components are also applicable to observational studies, where the exposure takes place of the intervention.[ 1 , 11 ] Remarkably, if after browsing the title and the abstract of a paper, the reader is not able to clearly identify the PICOT parameters, and elucidate the question posed by the authors, there should be reasonable scepticism regarding the scientific rigor of the work.[ 12 , 13 ] All these elements are crucial in the design and methodology of a clinical trial, as they can affect the feasibility and reliability of results. Having formulated the primary study question in the context of the PICOT framework [ Table 1 ],[ 1 , 6 , 8 ] the researcher should be able to elucidate which design is most suitable for their work, determine what type of data needs to be collected, and write a structured introduction tailored to what they want to know, explicitly mentioning the primary study hypothesis, which should lead to formulate the main research question.[ 1 , 2 , 6 , 8 ]
Key questions to be answered when working with the PICOT framework (population, intervention, comparator, outcome, and time frame) in a clinical research design
Occasionally, the intended population of the study needs to be modified, in order to overcome any potential ethical issues, and/or for the sake of convenience and feasibility of the project. Yet, the researcher must be aware that the external validity of the results may be compromised. As an illustration, in a randomised clinical trial, authors compared the ease of tracheal tube insertion between C-MAC video laryngoscope and direct laryngoscopy, in patients presenting to the emergency department with an indication of rapid sequence intubation. However, owing to the existence of ethical concerns, a substantial amount of patients requiring emergency tracheal intubation, including patients with major maxillofacial trauma and ongoing cardiopulmonary resuscitation, had to be excluded from the trial.[ 14 ] In fact, the design of prospective studies to explore this subset of patients can be challenging, not only because of ethical considerations, but because of the low incidence of these cases. In another study, Metterlein et al . compared the glottis visualisation among five different supraglottic airway devices, using fibreroptic-guided tracheal intubation in an adult population. Despite that the study was aimed to explore the ease of intubation in patients with anticipated difficult airway (thus requiring fibreoptic tracheal intubation), authors decided to enrol patients undergoing elective laser treatment for genital condylomas, as a strategy to hasten the recruitment process and optimise resources.[ 15 ]
Intervention
Anaesthetic interventions can be classified into pharmacological (experimental treatment) and nonpharmacological. Among nonpharmacological interventions, the most common include anaesthetic techniques, monitoring instruments and airway devices. For example, it would be appropriate to examine the ease of insertion of Supreme™ LMA, when compared with ProSeal™ LMA. Notwithstanding, a common mistake is the tendency to be focused on the data aimed to be collected (the “stated” objective), rather than the question that needs to be answered (the “latent” objective).[ 1 , 4 ] In one clinical trial, authors stated: “we compared the Supreme™ and ProSeal™ LMAs in infants by measuring their performance characteristics, including insertion features, ventilation parameters, induced changes in haemodynamics, and rates of postoperative complications”.[ 10 ] Here, the research question has been centered on the measurements (insertion characteristics, haemodynamic variables, LMA insertion characteristics, ventilation parameters) rather than the clinical problem that needs to be addressed (is Supreme™ LMA easier to insert than ProSeal™ LMA?).
Comparators in clinical research can also be pharmacological (e.g., gold standard or placebo) or nonpharmacological. Typically, not more than two comparator groups are included in a clinical trial. Multiple comparisons should be generally avoided, unless there is enough statistical power to address the end points of interest, and statistical analyses have been adjusted for multiple testing. For instance, in the aforementioned study of Metterlein et al .,[ 15 ] authors compared five supraglottic airway devices by recruiting only 10--12 participants per group. In spite of the authors' recommendation of using two supraglottic devices based on the results of the study, there was no mention of statistical adjustments for multiple comparisons, and given the small sample size, larger clinical trials will undoubtedly be needed to confirm or refute these findings.[ 15 ]
A clear formulation of the primary outcome results of vital importance in clinical research, as the primary statistical analyses, including the sample size calculation (and therefore, the estimation of the effect size and statistical power), will be derived from the main outcome of interest. While it is clear that using more than one primary outcome would not be appropriate, it would be equally inadequate to include multiple point measurements of the same variable as the primary outcome (e.g., visual analogue scale for pain at 1, 2, 6, and 12 h postoperatively).
Composite outcomes, in which multiple primary endpoints are combined, may make it difficult to draw any conclusions based on the study findings. For example, in a clinical trial, 200 children undergoing ophthalmic surgery were recruited to explore the incidence of respiratory adverse events, when comparing desflurane with sevoflurane, following the removal of flexible LMA during the emergence of the anaesthesia. The primary outcome was the number of respiratory events, including breath holding, coughing, secretions requiring suction, laryngospasm, bronchospasm, and mild desaturation.[ 16 ] Should authors had claimed a significant difference between these anaesthetic volatiles, it would have been important to elucidate whether those differences were due to serious adverse events, like laryngospasm or bronchospasm, or the results were explained by any of the other events (e.g., secretions requiring suction). While it is true that clinical trials evaluating the occurrence of adverse events like laryngospasm/bronchospasm,[ 16 , 17 ] or life-threating complications following a tracheal intubation (e.g., inadvertent oesophageal placement, dental damage or injury of the larynx/pharynx)[ 14 ] are almost invariably underpowered, because the incidence of such events is expected to be low, subjective outcomes like coughing or secretions requiring suction should be avoided, as they are highly dependent on the examiner's criteria.[ 16 ]
Secondary outcomes are useful to document potential side effects (e.g., gastric insufflation after placing a supraglottic device), and evaluate the adherence (say, airway leak pressure) and safety of the intervention (for instance, occurrence, or laryngospasm/bronchospasm).[ 17 ] Nevertheless, the problem of addressing multiple secondary outcomes without the adequate statistical power is habitual in medical literature. A good illustration of this issue can be found in a study evaluating the performance of two supraglottic devices in 50 anaesthetised infants and neonates, whereby authors could not draw any conclusions in regard to potential differences in the occurrence of complications, because the sample size calculated made the study underpowered to explore those differences.[ 17 ]
Among PICOT components, the time frame is the most likely to be omitted or inappropriate.[ 1 , 12 ] There are two key aspects of the time component that need to be clearly specified in the research question: the time of measuring the outcome variables (e.g. visual analogue scale for pain at 1, 2, 6, and 12 h postoperatively), and the duration of each measurement (when indicated). The omission of these details in the study protocol might lead to substantial differences in the methodology used. For instance, if a study is designed to compare the insertion times of three different supraglottic devices, and researchers do not specify the exact moment of LMA insertion in the clinical trial protocol (i.e., at the anaesthetic induction after reaching a BIS index < 60), placing an LMA with insufficient depth of anaesthesia would have compromised the internal validity of the results, because inserting a supraglottic device in those patients would have resulted in failed attempts and longer insertion times.[ 10 ]
FINER CRITERIA
A well-elaborated research question may not necessarily be a good question. The proposed study also requires being achievable from both ethical and realistic perspectives, interesting and useful to the clinical practice, and capable to formulate new hypotheses, that may contribute to the generation of knowledge. Researchers have developed an effective way to convey the message of how to build a good research question, that is usually recalled under the acronym of FINER (feasible, interesting, novel, ethical and relevant).[ 5 , 6 , 7 ] Table 2 highlights the main characteristics of FINER criteria.[ 7 ]
Main features of FINER criteria (Feasibility, interest, novelty, ethics, and relevance) to formulate a good research question. Adapted from Cummings et al .[ 7 ]
Novelty and relevance
Although it is clear that any research project should commence with an accurate literature interpretation, in many instances it represents the start and the end of the research: the reader will soon realise that the answer to several questions can be easily found in the published literature.[ 5 ] When the question overcomes the test of a thorough literature review, the project may become novel (there is a gap in the knowledge, and therefore, there is a need for new evidence on the topic) and relevant (the paper may contribute to change the clinical practice). In this context, it is important to distinguish the difference between statistical significance and clinical relevance: in the aforementioned study of Oba et al .,[ 10 ] despite the means of insertion times were reported as significant for the Supreme™ LMA, as compared with ProSeal™ LMA, the difference found in the insertion times (528 vs. 486 sec, respectively), although reported as significant, had little or no clinical relevance.[ 10 ] Conversely, a statistically significant difference of 12 sec might be of clinical relevance in neonates weighing <5 kg.[ 17 ] Thus, statistical tests must be interpreted in the context of a clinically meaningful effect size, which should be previously defined by the researcher.
Feasibility and ethical aspects
Among FINER criteria, there are two potential barriers that may prevent the successful conduct of the project and publication of the manuscript: feasibility and ethical aspects. These obstacles are usually related to the target population, as discussed above. Feasibility refers not only to the budget but also to the complexity of the design, recruitment strategy, blinding, adequacy of the sample size, measurement of the outcome, time of follow-up of participants, and commitment of clinicians, among others.[ 3 , 7 ] Funding, as a component of feasibility, may also be implicated in the ethical principles of clinical research, because the choice of the primary study question may be markedly influenced by the specific criteria demanded in the interest of potential funders.
Discussing ethical issues with local committees is compulsory, as rules applied might vary among countries.[ 18 ] Potential risks and benefits need to be carefully weighed, based upon the four principles of respect for autonomy, beneficence, non-maleficence, and justice.[ 19 ] Although many of these issues may be related to the population target (e.g., conducting a clinical trial in patients with ongoing cardiopulmonary resuscitation would be inappropriate, as would be anaesthetising patients undergoing elective LASER treatment for condylomas, to examine the performance of supraglottic airway devices),[ 14 , 15 ] ethical conflicts may also arise from the intervention (particularly those involving the occurrence of side effects or complications, and their potential for reversibility), comparison (e.g., use of placebo or sham procedures),[ 19 ] outcome (surrogate outcomes should be considered in lieu of long term outcomes), or time frame (e.g., unnecessary longer exposition to an intervention). Thus, FINER criteria should not be conceived without a concomitant examination of the PICOT checklist, and consequently, PICOT framework and FINER criteria should not be seen as separated components, but rather complementary ingredients of a good research question.
Undoubtedly, no research project can be conducted if it is deemed unfeasible, and most institutional review boards would not be in a position to approve a work with major ethical problems. Nonetheless, whether or not the findings are interesting, is a subjective matter. Engaging the attention of readers also depends upon a number of factors, including the manner of presenting the problem, the background of the topic, the intended audience, and the reader's expectations. Furthermore, the interest is usually linked to the novelty and relevance of the topic, and it is worth nothing that editors and peer reviewers of high-impact medical journals are usually reluctant to accept any publication, if there is no novelty inherent to the research hypothesis, or there is a lack of relevance in the results.[ 11 ] Nevertheless, a considerable number of papers have been published without any novelty or relevance in the topic addressed. This is probably reflected in a recent survey, according to which only a third of respondents declared to have read thoroughly the most recent papers downloaded, and at least half of those manuscripts remained unread.[ 20 ] The same study reported that up to one-third of papers examined remained uncited after 5 years of publication, and only 20% of papers accounted for 80% of the citations.[ 20 ]
Formulating a good research question can be fascinating, albeit challenging, even for experienced investigators. While it is clear that clinical experience in combination with the accurate interpretation of literature and teamwork are essential to develop new ideas, the formulation of a clinical problem usually requires the compliance with PICOT framework in conjunction with FINER criteria, in order to translate a clinical dilemma into a researchable question. Working in the right environment with the adequate support of experienced researchers, will certainly make a difference in the generation of knowledge. By doing this, a lot of time will be saved in the search of the primary study question, and undoubtedly, there will be more chances to become a successful researcher.
Financial support and sponsorship
Conflicts of interest.
There are no conflicts of interest.
- 1. Mayo NE, Asano M, Pamela Barbic S. When is a research question not a research question? J Rehabil Med. 2013;45:513–8. doi: 10.2340/16501977-1150. [ DOI ] [ PubMed ] [ Google Scholar ]
- 2. Garg R. Methodology for research I. Indian J Anaesth. 2016;60:640–5. doi: 10.4103/0019-5049.190619. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 3. Riva JJ, Malik KM, Burnie SJ, Endicott AR, Busse JW. What is your research question? An introduction to the PICOT format for clinicians. J Can Chiropr Assoc. 2012;56:167–71. [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 4. Vandenbroucke JP, Pearce N. From ideas to studies: How to get ideas and sharpen them into research questions. Clin Epidemiol. 2018;10:253–64. doi: 10.2147/CLEP.S142940. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 5. Aslam S, Emmanuel P. Formulating a researchable question: A critical step for facilitating good clinical research. Indian J Sex Trans Dis. 2010;31:47–50. doi: 10.4103/0253-7184.69003. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 6. Farrugia P, Petrisor BA, Farrokhyar F, Bhandari M. Research questions, hypotheses and objectives. Can J Surgery. 2010;53:278–81. [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 7. Cummings SR, Browner WS, Hulley SB. Designing Clinical Research. 4th ed. Philadelphia: Lippincott Williams and Wilkins; 2013. Conceiving the research question and developing the study plan; pp. 14–22. [ Google Scholar ]
- 8. Durbin CG. How to come up with a good research question: Framing the hypothesis. Respir Care. 2004;49:1195–8. [ PubMed ] [ Google Scholar ]
- 9. Herzog-Niescery J, Gude P, Gahlen F, Seipp HM, Bartz H, Botteck NM, et al. Surgeons' exposure to sevoflurane during paediatric adenoidectomy: A comparison of three airway devices. Anaesthesia. 2016;71:915–20. doi: 10.1111/anae.13515. [ DOI ] [ PubMed ] [ Google Scholar ]
- 10. Oba S, Turk HS, Isil CT, Erdogan H, Sayin P, Dokucu AI. Comparison of the Supreme™ and ProSeal™ laryngeal mask airways in infants: A prospective randomised clinical study. BMC Anesthesiol. 2017;17:125. doi: 10.1186/s12871-017-0418-z. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 11. Davidson A, Delbridge E. How to write a research paper. Paediatr Child Health. 2012;22:61–5. [ Google Scholar ]
- 12. Thabane L, Thomas T, Ye C, Paul J. Posing the research question: Not so simple. Can J Anesth. 2009;56:71–9. doi: 10.1007/s12630-008-9007-4. [ DOI ] [ PubMed ] [ Google Scholar ]
- 13. Rios LP, Ye C, Thabane L. Association between framing of the research question using the PICOT format and reporting quality of randomized controlled trials. BMC Med Res Methodol. 2010;10:11. doi: 10.1186/1471-2288-10-11. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 14. Sulser S, Ubmann D, Schlaepfer M, Brueesch M, Goliasch G, Seifert B, et al. C-MAC videolaryngoscope compared with direct laryngoscopy for rapid sequence intubation in an emergency department: A randomised clinical trial. Eur J Anaesthesiol (EJA) 2016;33:943–8. doi: 10.1097/EJA.0000000000000525. [ DOI ] [ PubMed ] [ Google Scholar ]
- 15. Metterlein T, Dintenfelder A, Plank C, Graf B, Roth G. A comparison of various supraglottic airway devices for fiberoptical guided tracheal intubation. Braz J Anesthesiol. 2017;67:166–71. doi: 10.1016/j.bjane.2015.09.007. [ DOI ] [ PubMed ] [ Google Scholar ]
- 16. Kim EH, Song IK, Lee JH, Kim HS, Kim HC, Yoon SH, et al. Desflurane versus sevoflurane in pediatric anesthesia with a laryngeal mask airway: A randomized controlled trial. Medicine (Baltimore) 2017;96:e7977. doi: 10.1097/MD.0000000000007977. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 17. Kayhan GE, Begec Z, Sanli M, Gedik E, Durmus M. Performance of size 1 I-gel compared with size 1 ProSeal laryngeal mask in anesthetized infants and neonates. Scientific World Journal. 2015;2015:426186. doi: 10.1155/2015/426186. doi: 10.1155/2015/426186. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 18. World Medical Association. World medical association declaration of Helsinki: Ethical principles for medical research involving human subjects. JAMA. 2013;310:2191. doi: 10.1001/jama.2013.281053. [ DOI ] [ PubMed ] [ Google Scholar ]
- 19. Hall R, McKnight D, Cox R, Coonan T. Guidelines on the ethics of clinical research in anesthesia. Can J Anesth. 2011;58:1115–24. doi: 10.1007/s12630-011-9596-1. [ DOI ] [ PubMed ] [ Google Scholar ]
- 20. Johnson R, Watkinson A, Mabe M. The STM report: An overview of scientific and scholarly journals publishing. International Association of Scientific, Technical and Medical Publishers [Internet] 2018. [Last cited on 2019 Jan 05]. Available from: https://www.stm.assoc.org/2018_10_04_STM_Report_2018.pdf .
- View on publisher site
- PDF (364.9 KB)
- Collections
Similar articles
Cited by other articles, links to ncbi databases.
- Download .nbib .nbib
- Format: AMA APA MLA NLM
Add to Collections
Literature Reviews
- Getting Started
- Choosing a Type of Review
Developing a Research Question
Finding example literature reviews.
- Searching the Literature
- Searching Tips
- ChatGPT [beta]
- Documenting your Search
- Using Citation Managers
- Concept Mapping
- Writing the Review
- Further Resources
Goldilocker Tool
UM Librarians have developed a quick tool called Goldilocker to help beginners who are struggling to refine their Research Question.
DEVELOPING A RESEARCH QUESTION
Before searching for sources, you need to formulate a Research Question — this is what you are trying to answer using the existing academic literature. The Research Question pinpoints the focus of the review .
Your first step involves choosing, exploring, and focusing a topic. At this stage you might discover that you need to tweak your topic or the scope of your research as you learn more about the topic in the literature.
THINGS TO KEEP IN MIND:
- The question must be "researchable" — it can be answered with accessible facts and data
- Questions often start with How, Why, What, Which
- The question opens the door for other areas of inquiry — it identifies a gap in existing research
- Questions should be open-ended and focus on cause and effect
TRY TO AVOID:
- Simple yes/no questions, or questions with an easy answer (what is the radius of the moon?)
- Questions that can only be answered by an opinion (does it smell nice when it rains?)
- Questions that involve secret information (what is the recipe for Coca-Cola?)
- Questions that are too broad or too narrow
REFINING YOUR RESEARCH QUESTION
Two examples of refining research questions that could be considered either too broad or too narrow.
USING DATABASE FILTER TOOLS
It can be helpful to read existing literature reviews on your topic to get an idea of major themes, how authors structure their arguments, or what reviews look like in your discipline.
DOCUMENT TYPE FILTERS
Many library databases have the option to highlight just Review Articles after you perform a search. Filters above show what the Document Type filter looks like, with a "Review" option. These examples are from Scopus and ProQuest. The "Review" filter here refers to free-standing, comprehensive Review Articles on a topic, as opposed to a shorter literature review inside a scholarly article.
LIT REVIEWS INSIDE ARTICLES
It is also worth taking a look at the shorter literature reviews inside scholarly articles. These can sometimes be called "Background" or "Background Literature." Look for a section typically following the Introduction that covers the history or gives context on the paper's topic.
EXAMPLE REVIEW ARTICLES
Here are a few examples of Review Articles in different disciplines. Note sometimes an article can be a Review Article without the word "review" in the title.
HUMANITIES — Art — " Art and Crime: Conceptualising Graffiti in the City " from the journal Geography Compass
SCIENCES — Climate Change — " Mercury Isotopes in Earth and Environmental Sciences " from the journal Annual Review of Earth and Planetary Sciences
SOCIAL SCIENCES — Psychology — " Structural Competency and the Future of Firearm Research " from the journal Social Science & Medicine
- << Previous: Choosing a Type of Review
- Next: Searching the Literature >>
- Last Updated: Sep 17, 2024 12:03 PM
- URL: https://guides.lib.umich.edu/litreview
Literature Reviews
- 1. Define your research question
- Getting started
- Types of reviews
Define topic
Brainstorming, limit scope, how ai can help, helpful resources.
- 2. Plan your search
- 3. Search the literature
- 4. Organize your results
- 5. Synthesize your findings
- 6. Write the review
- Artificial intelligence (AI) tools
- Thompson Writing Studio This link opens in a new window
- Need to write a systematic review? This link opens in a new window
Contact a Librarian
Ask a Librarian
For example, the following research question is too broad.
Does social media affect mental health in college students?
A more focused research question could be:
Does social media play a role in the number of eating disorder diagnoses in college-aged women?
Need some guidance? Contact your subject librarian for a research consultation or reach out to [email protected] .
Start the brainstorming process:
- Begin by identifying a broad topic of research interest (the more you're personally interested in it, the better!). Write it down to clarify your focus.
- Narrow down your scope by considering specific areas within this topic that you want to explore.
- Identify key themes and elements related to these specific areas. These will be the building blocks of your investigation.
- Finally, integrate these key areas and elements into a well-crafted research question.
One way to brainstorm is to use a flowchart.
The scope of a topic encompasses the boundaries and constraints you set for your research. The more precise your research question, the smoother the research process becomes.
Feeling stuck? Here are some ways you can narrow down your topic:
- geographic location
- time period
- discipline/field of study
- age group, etc.
You: I need to conduct a literature review about social media, mental health, and college students. What are some example research questions within this topic?
ChatGPT:
- How does the frequency and nature of social media use impact the mental health of college students?
- What role do specific social media platforms play in influencing the mental well-being of college students?
- How do online social interactions on platforms like Facebook, Instagram, or Twitter relate to the mental health outcomes of college students?
- Are there differences in the association between social media use and mental health outcomes based on demographic factors such as gender, age, or academic major among college students?
- What strategies do college students employ to cope with negative mental health effects associated with social media use?
- How does the perception of social support through online platforms affect the mental health of college students?
- To what extent does the comparison of oneself to others on social media contribute to mental health challenges among college students?
- What interventions or educational programs are effective in promoting positive mental health behaviors in the context of social media use for college students?
- How do social media literacy and awareness programs impact the mental health attitudes and behaviors of college students?
- What is the relationship between the use of social media for academic and social purposes and the mental health outcomes of college students?
Generative AI tools : ChatGPT , Google Gemini (formerly Bard) , Claude , Microsoft Copilot
For more information on how to incorporate AI tools into your research, check out the section on AI Tools .
- Developing Your Research Question
- Developing a Researchable Question
- Brainstorming tips from UNC Writing Center
- << Previous: Types of reviews
- Next: 2. Plan your search >>
- Last Updated: Sep 30, 2024 12:26 PM
- URL: https://guides.library.duke.edu/litreviews
Services for...
- Faculty & Instructors
- Graduate Students
- Undergraduate Students
- International Students
- Patrons with Disabilities
- Harmful Language Statement
- Re-use & Attribution / Privacy
- Support the Libraries
Purdue Online Writing Lab Purdue OWL® College of Liberal Arts
Writing a Literature Review
Welcome to the Purdue OWL
This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.
Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.
A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays). When we say “literature review” or refer to “the literature,” we are talking about the research ( scholarship ) in a given field. You will often see the terms “the research,” “the scholarship,” and “the literature” used mostly interchangeably.
Where, when, and why would I write a lit review?
There are a number of different situations where you might write a literature review, each with slightly different expectations; different disciplines, too, have field-specific expectations for what a literature review is and does. For instance, in the humanities, authors might include more overt argumentation and interpretation of source material in their literature reviews, whereas in the sciences, authors are more likely to report study designs and results in their literature reviews; these differences reflect these disciplines’ purposes and conventions in scholarship. You should always look at examples from your own discipline and talk to professors or mentors in your field to be sure you understand your discipline’s conventions, for literature reviews as well as for any other genre.
A literature review can be a part of a research paper or scholarly article, usually falling after the introduction and before the research methods sections. In these cases, the lit review just needs to cover scholarship that is important to the issue you are writing about; sometimes it will also cover key sources that informed your research methodology.
Lit reviews can also be standalone pieces, either as assignments in a class or as publications. In a class, a lit review may be assigned to help students familiarize themselves with a topic and with scholarship in their field, get an idea of the other researchers working on the topic they’re interested in, find gaps in existing research in order to propose new projects, and/or develop a theoretical framework and methodology for later research. As a publication, a lit review usually is meant to help make other scholars’ lives easier by collecting and summarizing, synthesizing, and analyzing existing research on a topic. This can be especially helpful for students or scholars getting into a new research area, or for directing an entire community of scholars toward questions that have not yet been answered.
What are the parts of a lit review?
Most lit reviews use a basic introduction-body-conclusion structure; if your lit review is part of a larger paper, the introduction and conclusion pieces may be just a few sentences while you focus most of your attention on the body. If your lit review is a standalone piece, the introduction and conclusion take up more space and give you a place to discuss your goals, research methods, and conclusions separately from where you discuss the literature itself.
Introduction:
- An introductory paragraph that explains what your working topic and thesis is
- A forecast of key topics or texts that will appear in the review
- Potentially, a description of how you found sources and how you analyzed them for inclusion and discussion in the review (more often found in published, standalone literature reviews than in lit review sections in an article or research paper)
- Summarize and synthesize: Give an overview of the main points of each source and combine them into a coherent whole
- Analyze and interpret: Don’t just paraphrase other researchers – add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
- Critically Evaluate: Mention the strengths and weaknesses of your sources
- Write in well-structured paragraphs: Use transition words and topic sentence to draw connections, comparisons, and contrasts.
Conclusion:
- Summarize the key findings you have taken from the literature and emphasize their significance
- Connect it back to your primary research question
How should I organize my lit review?
Lit reviews can take many different organizational patterns depending on what you are trying to accomplish with the review. Here are some examples:
- Chronological : The simplest approach is to trace the development of the topic over time, which helps familiarize the audience with the topic (for instance if you are introducing something that is not commonly known in your field). If you choose this strategy, be careful to avoid simply listing and summarizing sources in order. Try to analyze the patterns, turning points, and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred (as mentioned previously, this may not be appropriate in your discipline — check with a teacher or mentor if you’re unsure).
- Thematic : If you have found some recurring central themes that you will continue working with throughout your piece, you can organize your literature review into subsections that address different aspects of the topic. For example, if you are reviewing literature about women and religion, key themes can include the role of women in churches and the religious attitude towards women.
- Qualitative versus quantitative research
- Empirical versus theoretical scholarship
- Divide the research by sociological, historical, or cultural sources
- Theoretical : In many humanities articles, the literature review is the foundation for the theoretical framework. You can use it to discuss various theories, models, and definitions of key concepts. You can argue for the relevance of a specific theoretical approach or combine various theorical concepts to create a framework for your research.
What are some strategies or tips I can use while writing my lit review?
Any lit review is only as good as the research it discusses; make sure your sources are well-chosen and your research is thorough. Don’t be afraid to do more research if you discover a new thread as you’re writing. More info on the research process is available in our "Conducting Research" resources .
As you’re doing your research, create an annotated bibliography ( see our page on the this type of document ). Much of the information used in an annotated bibliography can be used also in a literature review, so you’ll be not only partially drafting your lit review as you research, but also developing your sense of the larger conversation going on among scholars, professionals, and any other stakeholders in your topic.
Usually you will need to synthesize research rather than just summarizing it. This means drawing connections between sources to create a picture of the scholarly conversation on a topic over time. Many student writers struggle to synthesize because they feel they don’t have anything to add to the scholars they are citing; here are some strategies to help you:
- It often helps to remember that the point of these kinds of syntheses is to show your readers how you understand your research, to help them read the rest of your paper.
- Writing teachers often say synthesis is like hosting a dinner party: imagine all your sources are together in a room, discussing your topic. What are they saying to each other?
- Look at the in-text citations in each paragraph. Are you citing just one source for each paragraph? This usually indicates summary only. When you have multiple sources cited in a paragraph, you are more likely to be synthesizing them (not always, but often
- Read more about synthesis here.
The most interesting literature reviews are often written as arguments (again, as mentioned at the beginning of the page, this is discipline-specific and doesn’t work for all situations). Often, the literature review is where you can establish your research as filling a particular gap or as relevant in a particular way. You have some chance to do this in your introduction in an article, but the literature review section gives a more extended opportunity to establish the conversation in the way you would like your readers to see it. You can choose the intellectual lineage you would like to be part of and whose definitions matter most to your thinking (mostly humanities-specific, but this goes for sciences as well). In addressing these points, you argue for your place in the conversation, which tends to make the lit review more compelling than a simple reporting of other sources.
Literature Searching
Types of Research Questions
Research questions can be categorized into different types, depending on the type of research to be undertaken.
Qualitative questions concern broad areas or more specific areas of research and focus on discovering, explaining and exploring. Types of qualitative questions include:
- Exploratory Questions, which seeks to understand without influencing the results. The objective is to learn more about a topic without bias or preconceived notions.
- Predictive Questions, which seek to understand the intent or future outcome around a topic.
- Interpretive Questions, which tries to understand people’s behavior in a natural setting. The objective is to understand how a group makes sense of shared experiences with regards to various phenomena.
Quantitative questions prove or disprove a researcher’s hypothesis and are constructed to express the relationship between variables and whether this relationship is significant. Types of quantitative questions include:
- Descriptive questions , which are the most basic type of quantitative research question and seeks to explain the when, where, why or how something occurred.
- Comparative questions are helpful when studying groups with dependent variables where one variable is compared with another.
- Relationship-based questions try to answer whether or not one variable has an influence on another. These types of question are generally used in experimental research questions.
References/Additional Resources
Lipowski, E. E. (2008). Developing great research questions . American Journal of Health-System Pharmacy, 65(17), 1667–1670.
Ratan, S. K., Anand, T., & Ratan, J. (2019). Formulation of Research Question - Stepwise Approach . Journal of Indian Association of Pediatric Surgeons , 24 (1), 15–20.
Fandino W.(2019). Formulating a good research question: Pearls and pitfalls . I ndian J Anaesth. 63(8) :611-616.
Beck, L. L. (2023). The question: types of research questions and how to develop them . In Translational Surgery: Handbook for Designing and Conducting Clinical and Translational Research (pp. 111-120). Academic Press.
Doody, O., & Bailey, M. E. (2016). Setting a research question, aim and objective. Nurse Researcher, 23(4), 19–23.
Plano Clark, V., & Badiee, M. (2010). Research questions in mixed methods research . In: SAGE Handbook of Mixed Methods in Social & Behavioral Research . SAGE Publications, Inc.,
Agee, J. (2009). Developing qualitative research questions: A reflective process . International journal of qualitative studies in education , 22 (4), 431-447.
Flemming, K., & Noyes, J. (2021). Qualitative Evidence Synthesis: Where Are We at? I nternational Journal of Qualitative Methods, 20.
Research Question Frameworks
Research question frameworks have been designed to help structure research questions and clarify the main concepts. Not every question can fit perfectly into a framework, but using even just parts of a framework can help develop a well-defined research question. The framework to use depends on the type of question to be researched. There are over 25 research question frameworks available. The University of Maryland has a nice table listing out several of these research question frameworks, along with what the acronyms mean and what types of questions/disciplines that may be used for.
The process of developing a good research question involves taking your topic and breaking each aspect of it down into its component parts.
Booth, A., Noyes, J., Flemming, K., Moore, G., Tunçalp, Ö., & Shakibazadeh, E. (2019). Formulating questions to explore complex interventions within qualitative evidence synthesis. BMJ global health , 4 (Suppl 1), e001107. (See supplementary data#1)
The "Well-Built Clinical Question“: PICO(T)
One well-established framework that can be used both for refining questions and developing strategies is known as PICO(T). The PICO framework was designed primarily for questions that include interventions and comparisons, however other types of questions may also be able to follow its principles. If the PICO(T) framework does not precisely fit your question, using its principles (see alternative component suggestions) can help you to think about what you want to explore even if you do not end up with a true PICO question.
A PICO(T) question has the following components:
- P : The patient’s disorder or disease or problem of interest / research object
- I: The intervention, exposure or finding under review / Application of a theory or method
- C: A comparison intervention or control (if applicable- not always present)/ Alternative theories or methods (or, in their absence, the null hypothesis)
- O : The outcome(s) (desired or of interest) / Knowledge generation
- T : (The time factor or period)
Keep in mind that solely using a tool will not enable you to design a good question. What is required is for you to think, carefully, about exactly what you want to study and precisely what you mean by each of the things that you think you want to study.
Rzany, & Bigby, M. (n.d.). Formulating Well-Built Clinical Questions. In Evidence-based dermatology / (pp. 27–30). Blackwell Pub/BMJ Books.
Nishikawa-Pacher, A. (2022). Research questions with PICO: a universal mnemonic. Publications , 10 (3), 21.
- << Previous: Characteristics of a good research question
- Next: Choosing the Search Terms >>
IMAGES
VIDEO
COMMENTS
Learn how to turn a weak research question into a strong one with examples suitable for a research paper, thesis or dissertation.
How to Conduct a Literature Review: Research Question Interactive learning module that guides you through the process of identifying, evaluating, and using scholarly information to research and write a literature review.
This paper explores some recommendations to consider before starting any research project, and outlines the main difficulties faced by young and experienced clinicians, when it comes time to turn an exciting idea into a valuable and feasible research question.
A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question. It is often written as part of a thesis, dissertation , or research paper , in order to situate your work in relation to existing knowledge.
Before searching for sources, you need to formulate a Research Question — this is what you are trying to answer using the existing academic literature. The Research Question pinpoints the focus of the review. Your first step involves choosing, exploring, and focusing a topic.
A research question pinpoints exactly what you want to find out in your work. A good research question is essential to guide your research paper, dissertation, or thesis. All research questions should be: Focused on a single problem or issue. Researchable using primary and/or secondary sources.
Identifying a well-defined research question is the first step in the literature review process. For undergraduates, professors will often assign a broad topic for a literature review assignment. You will need to more narrowly define your question before you can begin the research process.
Purdue OWL. Research and Citation. Conducting Research. Writing a Literature Review. A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis).
Types of Research Questions. Research questions can be categorized into different types, depending on the type of research to be undertaken. Qualitative questions concern broad areas or more specific areas of research and focus on discovering, explaining and exploring. Types of qualitative questions include:
By integrating findings and perspectives from many empirical findings, a literature review can address research questions with a power that no single study has. It can also help to provide an overview of areas in which the research is disparate and interdisciplinary.