comparative quantitative research questions

• Cookies & Privacy
• GETTING STARTED
• Introduction
• FUNDAMENTALS
• Acknowledgements
• Research questions & hypotheses
• Concepts, constructs & variables
• Research limitations
• Getting started
• Sampling Strategy
• Research Quality
• Research Ethics
• Data Analysis

Structure of comparative research questions

There are five steps required to construct a comparative research question: (1) choose your starting phrase; (2) identify and name the dependent variable; (3) identify the groups you are interested in; (4) identify the appropriate adjoining text; and (5) write out the comparative research question. Each of these steps is discussed in turn:

Choose your starting phrase

Identify and name the dependent variable

Identify the groups you are interested in

Identify the appropriate adjoining text

Write out the comparative research question

FIRST Choose your starting phrase

Comparative research questions typically start with one of two phrases:

Some of these starting phrases are highlighted in blue text in the examples below:

What is the difference in the daily calorific intake of American men and women?

What is the difference in the weekly photo uploads on Facebook between British male and female university students?

What are the differences in perceptions towards Internet banking security between adolescents and pensioners?

What are the differences in attitudes towards music piracy when pirated music is freely distributed or purchased?

SECOND Identify and name the dependent variable

All comparative research questions have a dependent variable . You need to identify what this is. However, how the dependent variable is written out in a research question and what you call it are often two different things. In the examples below, we have illustrated the name of the dependent variable and highlighted how it would be written out in the blue text .

The first three examples highlight that while the name of the dependent variable is the same, namely daily calorific intake, the way that this dependent variable is written out differs in each case.

THIRD Identify the groups you are interested in

All comparative research questions have at least two groups . You need to identify these groups. In the examples below, we have identified the groups in the green text .

What is the difference in the daily calorific intake of American men and women ?

What is the difference in the weekly photo uploads on Facebook between British male and female university students ?

What are the differences in perceptions towards Internet banking security between adolescents and pensioners ?

What are the differences in attitudes towards music piracy when pirated music is freely distributed or purchased ?

It is often easy to identify groups because they reflect different types of people (e.g., men and women, adolescents and pensioners), as highlighted by the first three examples. However, sometimes the two groups you are interested in reflect two different conditions, as highlighted by the final example. In this final example, the two conditions (i.e., groups) are pirated music that is freely distributed and pirated music that is purchased. So we are interested in how the attitudes towards music piracy differ when pirated music is freely distributed as opposed to when pirated music in purchased.

FOURTH Identify the appropriate adjoining text

Before you write out the groups you are interested in comparing, you typically need to include some adjoining text. Typically, this adjoining text includes the words between or amongst , but other words may be more appropriate, as highlighted by the examples in red text below:

FIFTH Write out the comparative research question

Once you have these details - (1) the starting phrase, (2) the name of the dependent variable, (3) the name of the groups you are interested in comparing, and (4) any potential adjoining words - you can write out the comparative research question in full. The example comparative research questions discussed above are written out in full below:

In the section that follows, the structure of relationship-based research questions is discussed.

Structure of relationship-based research questions

There are six steps required to construct a relationship-based research question: (1) choose your starting phrase; (2) identify the independent variable(s); (3) identify the dependent variable(s); (4) identify the group(s); (5) identify the appropriate adjoining text; and (6) write out the relationship-based research question. Each of these steps is discussed in turn.

Identify the independent variable(s)

Identify the dependent variable(s)

Identify the group(s)

Write out the relationship-based research question

Relationship-based research questions typically start with one or two phrases:

What is the relationship between gender and attitudes towards music piracy amongst adolescents?

What is the relationship between study time and exam scores amongst university students?

What is the relationship of career prospects, salary and benefits, and physical working conditions on job satisfaction between managers and non-managers?

SECOND Name the independent variable(s)

All relationship-based research questions have at least one independent variable . You need to identify what this is. In the examples that follow, the independent variable(s) is highlighted in the purple text .

What is the relationship of career prospects , salary and benefits , and physical working conditions on job satisfaction between managers and non-managers?

When doing a dissertation at the undergraduate and master's level, it is likely that your research question will only have one or two independent variables, but this is not always the case.

THIRD Name the dependent variable(s)

All relationship-based research questions also have at least one dependent variable . You also need to identify what this is. At the undergraduate and master's level, it is likely that your research question will only have one dependent variable. In the examples that follow, the dependent variable is highlighted in the blue text .

FOURTH Name of the group(s)

All relationship-based research questions have at least one group , but can have multiple groups . You need to identify this group(s). In the examples below, we have identified the group(s) in the green text .

What is the relationship between gender and attitudes towards music piracy amongst adolescents ?

What is the relationship between study time and exam scores amongst university students ?

What is the relationship of career prospects, salary and benefits, and physical working conditions on job satisfaction between managers and non-managers ?

FIFTH Identify the appropriate adjoining text

Before you write out the groups you are interested in comparing, you typically need to include some adjoining text (i.e., usually the words between or amongst):

Some examples are highlighted in red text below:

SIXTH Write out the relationship-based research question

Once you have these details ? (1) the starting phrase, (2) the name of the dependent variable, (3) the name of the independent variable, (4) the name of the group(s) you are interested in, and (5) any potential adjoining words ? you can write out the relationship-based research question in full. The example relationship-based research questions discussed above are written out in full below:

STEP FOUR Write out the problem or issues you are trying to address in the form of a complete research question

In the previous section, we illustrated how to write out the three types of research question (i.e., descriptive, comparative and relationship-based research questions). Whilst these rules should help you when writing out your research question(s), the main thing you should keep in mind is whether your research question(s) flow and are easy to read .

Ohio State nav bar

The Ohio State University

• BuckeyeLink
• Find People
• Search Ohio State

Research Questions & Hypotheses

Generally, in quantitative studies, reviewers expect hypotheses rather than research questions. However, both research questions and hypotheses serve different purposes and can be beneficial when used together.

Research Questions

Clarify the research’s aim (farrugia et al., 2010).

• Research often begins with an interest in a topic, but a deep understanding of the subject is crucial to formulate an appropriate research question.
• Descriptive: “What factors most influence the academic achievement of senior high school students?”
• Comparative: “What is the performance difference between teaching methods A and B?”
• Relationship-based: “What is the relationship between self-efficacy and academic achievement?”
• Increasing knowledge about a subject can be achieved through systematic literature reviews, in-depth interviews with patients (and proxies), focus groups, and consultations with field experts.
• Some funding bodies, like the Canadian Institute for Health Research, recommend conducting a systematic review or a pilot study before seeking grants for full trials.
• The presence of multiple research questions in a study can complicate the design, statistical analysis, and feasibility.
• It’s advisable to focus on a single primary research question for the study.
• The primary question, clearly stated at the end of a grant proposal’s introduction, usually specifies the study population, intervention, and other relevant factors.
• The FINER criteria underscore aspects that can enhance the chances of a successful research project, including specifying the population of interest, aligning with scientific and public interest, clinical relevance, and contribution to the field, while complying with ethical and national research standards.
• The P ICOT approach is crucial in developing the study’s framework and protocol, influencing inclusion and exclusion criteria and identifying patient groups for inclusion.
• Defining the specific population, intervention, comparator, and outcome helps in selecting the right outcome measurement tool.
• The more precise the population definition and stricter the inclusion and exclusion criteria, the more significant the impact on the interpretation, applicability, and generalizability of the research findings.
• A restricted study population enhances internal validity but may limit the study’s external validity and generalizability to clinical practice.
• A broadly defined study population may better reflect clinical practice but could increase bias and reduce internal validity.
• An inadequately formulated research question can negatively impact study design, potentially leading to ineffective outcomes and affecting publication prospects.

Checklist: Good research questions for social science projects (Panke, 2018)

Research Hypotheses

Present the researcher’s predictions based on specific statements.

• These statements define the research problem or issue and indicate the direction of the researcher’s predictions.
• Formulating the research question and hypothesis from existing data (e.g., a database) can lead to multiple statistical comparisons and potentially spurious findings due to chance.
• The research or clinical hypothesis, derived from the research question, shapes the study’s key elements: sampling strategy, intervention, comparison, and outcome variables.
• Hypotheses can express a single outcome or multiple outcomes.
• After statistical testing, the null hypothesis is either rejected or not rejected based on whether the study’s findings are statistically significant.
• Hypothesis testing helps determine if observed findings are due to true differences and not chance.
• Hypotheses can be 1-sided (specific direction of difference) or 2-sided (presence of a difference without specifying direction).
• 2-sided hypotheses are generally preferred unless there’s a strong justification for a 1-sided hypothesis.
• A solid research hypothesis, informed by a good research question, influences the research design and paves the way for defining clear research objectives.

Types of Research Hypothesis

• In a Y-centered research design, the focus is on the dependent variable (DV) which is specified in the research question. Theories are then used to identify independent variables (IV) and explain their causal relationship with the DV.
• Example: “An increase in teacher-led instructional time (IV) is likely to improve student reading comprehension scores (DV), because extensive guided practice under expert supervision enhances learning retention and skill mastery.”
• Hypothesis Explanation: The dependent variable (student reading comprehension scores) is the focus, and the hypothesis explores how changes in the independent variable (teacher-led instructional time) affect it.
• In X-centered research designs, the independent variable is specified in the research question. Theories are used to determine potential dependent variables and the causal mechanisms at play.
• Example: “Implementing technology-based learning tools (IV) is likely to enhance student engagement in the classroom (DV), because interactive and multimedia content increases student interest and participation.”
• Hypothesis Explanation: The independent variable (technology-based learning tools) is the focus, with the hypothesis exploring its impact on a potential dependent variable (student engagement).
• Probabilistic hypotheses suggest that changes in the independent variable are likely to lead to changes in the dependent variable in a predictable manner, but not with absolute certainty.
• Example: “The more teachers engage in professional development programs (IV), the more their teaching effectiveness (DV) is likely to improve, because continuous training updates pedagogical skills and knowledge.”
• Hypothesis Explanation: This hypothesis implies a probable relationship between the extent of professional development (IV) and teaching effectiveness (DV).
• Deterministic hypotheses state that a specific change in the independent variable will lead to a specific change in the dependent variable, implying a more direct and certain relationship.
• Example: “If the school curriculum changes from traditional lecture-based methods to project-based learning (IV), then student collaboration skills (DV) are expected to improve because project-based learning inherently requires teamwork and peer interaction.”
• Hypothesis Explanation: This hypothesis presumes a direct and definite outcome (improvement in collaboration skills) resulting from a specific change in the teaching method.
• Example : “Students who identify as visual learners will score higher on tests that are presented in a visually rich format compared to tests presented in a text-only format.”
• Explanation : This hypothesis aims to describe the potential difference in test scores between visual learners taking visually rich tests and text-only tests, without implying a direct cause-and-effect relationship.
• Example : “Teaching method A will improve student performance more than method B.”
• Explanation : This hypothesis compares the effectiveness of two different teaching methods, suggesting that one will lead to better student performance than the other. It implies a direct comparison but does not necessarily establish a causal mechanism.
• Example : “Students with higher self-efficacy will show higher levels of academic achievement.”
• Explanation : This hypothesis predicts a relationship between the variable of self-efficacy and academic achievement. Unlike a causal hypothesis, it does not necessarily suggest that one variable causes changes in the other, but rather that they are related in some way.

Tips for developing research questions and hypotheses for research studies

• Perform a systematic literature review (if one has not been done) to increase knowledge and familiarity with the topic and to assist with research development.
• Learn about current trends and technological advances on the topic.
• Seek careful input from experts, mentors, colleagues, and collaborators to refine your research question as this will aid in developing the research question and guide the research study.
• Use the FINER criteria in the development of the research question.
• Ensure that the research question follows PICOT format.
• Develop a research hypothesis from the research question.
• Ensure that the research question and objectives are answerable, feasible, and clinically relevant.

If your research hypotheses are derived from your research questions, particularly when multiple hypotheses address a single question, it’s recommended to use both research questions and hypotheses. However, if this isn’t the case, using hypotheses over research questions is advised. It’s important to note these are general guidelines, not strict rules. If you opt not to use hypotheses, consult with your supervisor for the best approach.

Farrugia, P., Petrisor, B. A., Farrokhyar, F., & Bhandari, M. (2010). Practical tips for surgical research: Research questions, hypotheses and objectives.  Canadian journal of surgery. Journal canadien de chirurgie ,  53 (4), 278–281.

Hulley, S. B., Cummings, S. R., Browner, W. S., Grady, D., & Newman, T. B. (2007). Designing clinical research. Philadelphia.

Panke, D. (2018). Research design & method selection: Making good choices in the social sciences.  Research Design & Method Selection , 1-368.

• AI Content Shield
• AI KW Research
• AI Assistant
• SEO Optimizer
• AI KW Clustering
• Customer reviews
• The NLO Revolution
• Press Center
• Help Center
• Content Resources
• Facebook Group

An Effective Guide to Comparative Research Questions

Table of Contents

Comparative research questions are a type of quantitative research question. It aims to gather information on the differences between two or more research objects based on different variables. 

These kinds of questions assist the researcher in identifying distinctive characteristics that distinguish one research subject from another.

A systematic investigation is built around research questions. Therefore, asking the right quantitative questions is key to gathering relevant and valuable information that will positively impact your work.

This article discusses the types of quantitative research questions with a particular focus on comparative questions.

What Are Quantitative Research Questions?

Quantitative research questions are unbiased queries that offer thorough information regarding a study topic . You can statistically analyze numerical data yielded from quantitative research questions.

This type of research question aids in understanding the research issue by examining trends and patterns. The data collected can be generalized to the overall population and help make informed decisions. 

Types of Quantitative Research Questions

Quantitative research questions can be divided into three types which are explained below:

Descriptive Research Questions

Researchers use descriptive research questions to collect numerical data about the traits and characteristics of study subjects. These questions mainly look for responses that bring into light the characteristic pattern of the existing research subjects.

However, note that the descriptive questions are not concerned with the causes of the observed traits and features. Instead, they focus on the “what,” i.e., explaining the topic of the research without taking into account its reasons.

Examples of Descriptive research questions:

• How often do you use our keto diet app?
• What price range are you ready to accept for this product?

Comparative Research Questions

Comparative research questions seek to identify differences between two or more distinct groups based on one or more dependent variables. These research questions aim to identify features that differ one research subject from another while emphasizing their apparent similarities.

In market research surveys, asking comparative questions can reveal how your product or service compares to its competitors. It can also help you determine your product’s benefits and drawbacks to gain a competitive edge.

The steps in formulating comparative questions are as follows:

• Choose the right starting phrase
• Specify the dependent variable
• Choose the groups that interest you
• Identify the relevant adjoining text
• Compose the comparative research question

Relationship-Based Research Questions

A relationship-based research question refers to the nature of the association between research subjects of the same category. These kinds of research question assist you in learning more about the type of relationship between two study variables.

Because they aim to distinctly define the connection between two variables, relationship-based research questions are also known as correlational research questions.

Examples of Comparative Research Questions

• What is the difference between men’s and women’s daily caloric intake in London?
• What is the difference in the shopping attitude of millennial adults and those born in 1980?
• What is the difference in time spent on video games between people of the age group 15-17 and 18-21?
• What is the difference in political views of Mexicans and Americans in the US?
• What are the differences between Snapchat usage of American male and female university students?
• What is the difference in views towards the security of online banking between the youth and the seniors?
• What is the difference in attitude between Gen-Z and Millennial toward rock music?
• What are the differences between online and offline classes?
• What are the differences between on-site and remote work?
• What is the difference between weekly Facebook photo uploads between American male and female college students?
• What are the differences between an Android and an Apple phone?

Comparative research questions are a great way to identify the difference between two study subjects of the same group.

Asking the right questions will help you gain effective and insightful data to conduct your research better . This article discusses the various aspects of quantitative research questions and their types to help you make data-driven and informed decisions when needed.

Abir Ghenaiet

Abir is a data analyst and researcher. Among her interests are artificial intelligence, machine learning, and natural language processing. As a humanitarian and educator, she actively supports women in tech and promotes diversity.

Explore All Engaging Questions Tool Articles

Consider these fun questions about spring.

Spring is a season in the Earth’s yearly cycle after Winter and before Summer. It is the time life and…

• Engaging Questions Tool

Fun Spouse Game Questions For Couples

Answering spouse game questions together can be fun. It’ll help begin conversations and further explore preferences, history, and interests. The…

Best Snap Game Questions to Play on Snapchat

Are you out to get a fun way to connect with your friends on Snapchat? Look no further than snap…

How to Prepare for Short Response Questions in Tests

When it comes to acing tests, there are a few things that will help you more than anything else. Good…

Top 20 Reflective Questions for Students

As students, we are constantly learning new things. Every day, we are presented with further information and ideas we need…

Random History Questions For History Games

A great icebreaker game is playing trivia even though you don’t know the answer. It is always fun to guess…

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• Can J Hosp Pharm
• v.67(1); Jan-Feb 2014

Research: Articulating Questions, Generating Hypotheses, and Choosing Study Designs

Introduction.

Articulating a clear and concise research question is fundamental to conducting a robust and useful research study. Although “getting stuck into” the data collection is the exciting part of research, this preparation stage is crucial. Clear and concise research questions are needed for a number of reasons. Initially, they are needed to enable you to search the literature effectively. They will allow you to write clear aims and generate hypotheses. They will also ensure that you can select the most appropriate research design for your study.

This paper begins by describing the process of articulating clear and concise research questions, assuming that you have minimal experience. It then describes how to choose research questions that should be answered and how to generate study aims and hypotheses from your questions. Finally, it describes briefly how your question will help you to decide on the research design and methods best suited to answering it.

TURNING CURIOSITY INTO QUESTIONS

A research question has been described as “the uncertainty that the investigator wants to resolve by performing her study” 1 or “a logical statement that progresses from what is known or believed to be true to that which is unknown and requires validation”. 2 Developing your question usually starts with having some general ideas about the areas within which you want to do your research. These might flow from your clinical work, for example. You might be interested in finding ways to improve the pharmaceutical care of patients on your wards. Alternatively, you might be interested in identifying the best antihypertensive agent for a particular subgroup of patients. Lipowski 2 described in detail how work as a practising pharmacist can be used to great advantage to generate interesting research questions and hence useful research studies. Ideas could come from questioning received wisdom within your clinical area or the rationale behind quick fixes or workarounds, or from wanting to improve the quality, safety, or efficiency of working practice.

Alternatively, your ideas could come from searching the literature to answer a query from a colleague. Perhaps you could not find a published answer to the question you were asked, and so you want to conduct some research yourself. However, just searching the literature to generate questions is not to be recommended for novices—the volume of material can feel totally overwhelming.

Use a research notebook, where you regularly write ideas for research questions as you think of them during your clinical practice or after reading other research papers. It has been said that the best way to have a great idea is to have lots of ideas and then choose the best. The same would apply to research questions!

When you first identify your area of research interest, it is likely to be either too narrow or too broad. Narrow questions (such as “How is drug X prescribed for patients with condition Y in my hospital?”) are usually of limited interest to anyone other than the researcher. Broad questions (such as “How can pharmacists provide better patient care?”) must be broken down into smaller, more manageable questions. If you are interested in how pharmacists can provide better care, for example, you might start to narrow that topic down to how pharmacists can provide better care for one condition (such as affective disorders) for a particular subgroup of patients (such as teenagers). Then you could focus it even further by considering a specific disorder (depression) and a particular type of service that pharmacists could provide (improving patient adherence). At this stage, you could write your research question as, for example, “What role, if any, can pharmacists play in improving adherence to fluoxetine used for depression in teenagers?”

TYPES OF RESEARCH QUESTIONS

Being able to consider the type of research question that you have generated is particularly useful when deciding what research methods to use. There are 3 broad categories of question: descriptive, relational, and causal.

Descriptive

One of the most basic types of question is designed to ask systematically whether a phenomenon exists. For example, we could ask “Do pharmacists ‘care’ when they deliver pharmaceutical care?” This research would initially define the key terms (i.e., describing what “pharmaceutical care” and “care” are), and then the study would set out to look for the existence of care at the same time as pharmaceutical care was being delivered.

When you know that a phenomenon exists, you can then ask description and/or classification questions. The answers to these types of questions involve describing the characteristics of the phenomenon or creating typologies of variable subtypes. In the study above, for example, you could investigate the characteristics of the “care” that pharmacists provide. Classifications usually use mutually exclusive categories, so that various subtypes of the variable will have an unambiguous category to which they can be assigned. For example, a question could be asked as to “what is a pharmacist intervention” and a definition and classification system developed for use in further research.

When seeking further detail about your phenomenon, you might ask questions about its composition. These questions necessitate deconstructing a phenomenon (such as a behaviour) into its component parts. Within hospital pharmacy practice, you might be interested in asking questions about the composition of a new behavioural intervention to improve patient adherence, for example, “What is the detailed process that the pharmacist implicitly follows during delivery of this new intervention?”

After you have described your phenomena, you may then be interested in asking questions about the relationships between several phenomena. If you work on a renal ward, for example, you may be interested in looking at the relationship between hemoglobin levels and renal function, so your question would look something like this: “Are hemoglobin levels related to level of renal function?” Alternatively, you may have a categorical variable such as grade of doctor and be interested in the differences between them with regard to prescribing errors, so your research question would be “Do junior doctors make more prescribing errors than senior doctors?” Relational questions could also be asked within qualitative research, where a detailed understanding of the nature of the relationship between, for example, the gender and career aspirations of clinical pharmacists could be sought.

Once you have described your phenomena and have identified a relationship between them, you could ask about the causes of that relationship. You may be interested to know whether an intervention or some other activity has caused a change in your variable, and your research question would be about causality. For example, you may be interested in asking, “Does captopril treatment reduce blood pressure?” Generally, however, if you ask a causality question about a medication or any other health care intervention, it ought to be rephrased as a causality–comparative question. Without comparing what happens in the presence of an intervention with what happens in the absence of the intervention, it is impossible to attribute causality to the intervention. Although a causality question would usually be answered using a comparative research design, asking a causality–comparative question makes the research design much more explicit. So the above question could be rephrased as, “Is captopril better than placebo at reducing blood pressure?”

The acronym PICO has been used to describe the components of well-crafted causality–comparative research questions. 3 The letters in this acronym stand for Population, Intervention, Comparison, and Outcome. They remind the researcher that the research question should specify the type of participant to be recruited, the type of exposure involved, the type of control group with which participants are to be compared, and the type of outcome to be measured. Using the PICO approach, the above research question could be written as “Does captopril [ intervention ] decrease rates of cardiovascular events [ outcome ] in patients with essential hypertension [ population ] compared with patients receiving no treatment [ comparison ]?”

DECIDING WHETHER TO ANSWER A RESEARCH QUESTION

Just because a question can be asked does not mean that it needs to be answered. Not all research questions deserve to have time spent on them. One useful set of criteria is to ask whether your research question is feasible, interesting, novel, ethical, and relevant. 1 The need for research to be ethical will be covered in a later paper in the series, so is not discussed here. The literature review is crucial to finding out whether the research question fulfils the remaining 4 criteria.

Conducting a comprehensive literature review will allow you to find out what is already known about the subject and any gaps that need further exploration. You may find that your research question has already been answered. However, that does not mean that you should abandon the question altogether. It may be necessary to confirm those findings using an alternative method or to translate them to another setting. If your research question has no novelty, however, and is not interesting or relevant to your peers or potential funders, you are probably better finding an alternative.

The literature will also help you learn about the research designs and methods that have been used previously and hence to decide whether your potential study is feasible. As a novice researcher, it is particularly important to ask if your planned study is feasible for you to conduct. Do you or your collaborators have the necessary technical expertise? Do you have the other resources that will be needed? If you are just starting out with research, it is likely that you will have a limited budget, in terms of both time and money. Therefore, even if the question is novel, interesting, and relevant, it may not be one that is feasible for you to answer.

GENERATING AIMS AND HYPOTHESES

All research studies should have at least one research question, and they should also have at least one aim. As a rule of thumb, a small research study should not have more than 2 aims as an absolute maximum. The aim of the study is a broad statement of intention and aspiration; it is the overall goal that you intend to achieve. The wording of this broad statement of intent is derived from the research question. If it is a descriptive research question, the aim will be, for example, “to investigate” or “to explore”. If it is a relational research question, then the aim should state the phenomena being correlated, such as “to ascertain the impact of gender on career aspirations”. If it is a causal research question, then the aim should include the direction of the relationship being tested, such as “to investigate whether captopril decreases rates of cardiovascular events in patients with essential hypertension, relative to patients receiving no treatment”.

The hypothesis is a tentative prediction of the nature and direction of relationships between sets of data, phrased as a declarative statement. Therefore, hypotheses are really only required for studies that address relational or causal research questions. For the study above, the hypothesis being tested would be “Captopril decreases rates of cardiovascular events in patients with essential hypertension, relative to patients receiving no treatment”. Studies that seek to answer descriptive research questions do not test hypotheses, but they can be used for hypothesis generation. Those hypotheses would then be tested in subsequent studies.

CHOOSING THE STUDY DESIGN

The research question is paramount in deciding what research design and methods you are going to use. There are no inherently bad research designs. The rightness or wrongness of the decision about the research design is based simply on whether it is suitable for answering the research question that you have posed.

It is possible to select completely the wrong research design to answer a specific question. For example, you may want to answer one of the research questions outlined above: “Do pharmacists ‘care’ when they deliver pharmaceutical care?” Although a randomized controlled study is considered by many as a “gold standard” research design, such a study would just not be capable of generating data to answer the question posed. Similarly, if your question was, “Is captopril better than placebo at reducing blood pressure?”, conducting a series of in-depth qualitative interviews would be equally incapable of generating the necessary data. However, if these designs are swapped around, we have 2 combinations (pharmaceutical care investigated using interviews; captopril investigated using a randomized controlled study) that are more likely to produce robust answers to the questions.

The language of the research question can be helpful in deciding what research design and methods to use. Subsequent papers in this series will cover these topics in detail. For example, if the question starts with “how many” or “how often”, it is probably a descriptive question to assess the prevalence or incidence of a phenomenon. An epidemiological research design would be appropriate, perhaps using a postal survey or structured interviews to collect the data. If the question starts with “why” or “how”, then it is a descriptive question to gain an in-depth understanding of a phenomenon. A qualitative research design, using in-depth interviews or focus groups, would collect the data needed. Finally, the term “what is the impact of” suggests a causal question, which would require comparison of data collected with and without the intervention (i.e., a before–after or randomized controlled study).

CONCLUSIONS

This paper has briefly outlined how to articulate research questions, formulate your aims, and choose your research methods. It is crucial to realize that articulating a good research question involves considerable iteration through the stages described above. It is very common that the first research question generated bears little resemblance to the final question used in the study. The language is changed several times, for example, because the first question turned out not to be feasible and the second question was a descriptive question when what was really wanted was a causality question. The books listed in the “Further Reading” section provide greater detail on the material described here, as well as a wealth of other information to ensure that your first foray into conducting research is successful.

This article is the second in the CJHP Research Primer Series, an initiative of the CJHP Editorial Board and the CSHP Research Committee. The planned 2-year series is intended to appeal to relatively inexperienced researchers, with the goal of building research capacity among practising pharmacists. The articles, presenting simple but rigorous guidance to encourage and support novice researchers, are being solicited from authors with appropriate expertise.

Previous article in this series:

Bond CM. The research jigsaw: how to get started. Can J Hosp Pharm . 2014;67(1):28–30.

Competing interests: Mary Tully has received personal fees from the UK Renal Pharmacy Group to present a conference workshop on writing research questions and nonfinancial support (in the form of travel and accommodation) from the Dubai International Pharmaceuticals and Technologies Conference and Exhibition (DUPHAT) to present a workshop on conducting pharmacy practice research.

Further Reading

• Cresswell J. Research design: qualitative, quantitative and mixed methods approaches. London (UK): Sage; 2009. [ Google Scholar ]
• Haynes RB, Sackett DL, Guyatt GH, Tugwell P. Clinical epidemiology: how to do clinical practice research. 3rd ed. Philadelphia (PA): Lippincott, Williams & Wilkins; 2006. [ Google Scholar ]
• Kumar R. Research methodology: a step-by-step guide for beginners. 3rd ed. London (UK): Sage; 2010. [ Google Scholar ]
• Smith FJ. Conducting your pharmacy practice research project. London (UK): Pharmaceutical Press; 2005. [ Google Scholar ]

Literature Searching

Types of Research Questions

Research questions can be categorized into different types, depending on the type of research to be undertaken.

Qualitative questions concern broad areas or more specific areas of research and focus on discovering, explaining and exploring.  Types of qualitative questions include:

• Exploratory Questions, which seeks to understand without influencing the results.  The objective is to learn more about a topic without bias or preconceived notions.
• Predictive Questions, which seek to understand the intent or future outcome around a topic.
• Interpretive Questions, which tries to understand people’s behavior in a natural setting.  The objective is to understand how a group makes sense of shared experiences with regards to various phenomena.

Quantitative questions prove or disprove a  researcher’s hypothesis and are constructed to express the relationship between variables  and whether this relationship is significant.  Types of quantitative questions include:

• Descriptive questions , which are the most basic type of quantitative research question and seeks to explain the when, where, why or how something occurred. 
• Comparative questions are helpful when studying groups with dependent variables where one variable is compared with another.
• Relationship-based questions try to answer whether or not one variable has an influence on another.  These types of question are generally used in experimental research questions.

References/Additional Resources

Lipowski, E. E. (2008). Developing great research questions . American Journal of Health-System Pharmacy, 65(17), 1667–1670.

Ratan, S. K., Anand, T., & Ratan, J. (2019). Formulation of Research Question - Stepwise Approach .  Journal of Indian Association of Pediatric Surgeons ,  24 (1), 15–20.

Fandino W.(2019). Formulating a good research question: Pearls and pitfalls . I ndian J Anaesth. 63(8) :611-616. 

Beck, L. L. (2023). The question: types of research questions and how to develop them . In Translational Surgery: Handbook for Designing and Conducting Clinical and Translational Research (pp. 111-120). Academic Press. 

Doody, O., & Bailey, M. E. (2016). Setting a research question, aim and objective. Nurse Researcher, 23(4), 19–23.

Plano Clark, V., & Badiee, M. (2010). Research questions in mixed methods research . In: SAGE Handbook of Mixed Methods in Social & Behavioral Research .  SAGE Publications, Inc.,

Agee, J. (2009). Developing qualitative research questions: A reflective process .  International journal of qualitative studies in education ,  22 (4), 431-447. 

Flemming, K., & Noyes, J. (2021). Qualitative Evidence Synthesis: Where Are We at? I nternational Journal of Qualitative Methods, 20.  

Research Question Frameworks

Research question frameworks have been designed to help structure research questions and clarify the main concepts. Not every question can fit perfectly into a framework, but using even just parts of a framework can help develop a well-defined research question. The framework to use depends on the type of question to be researched.   There are over 25 research question frameworks available.  The University of Maryland has a nice table listing out several of these research question frameworks, along with what the acronyms mean and what types of questions/disciplines that may be used for.

The process of developing a good research question involves taking your topic and breaking each aspect of it down into its component parts.

Booth, A., Noyes, J., Flemming, K., Moore, G., Tunçalp, Ö., & Shakibazadeh, E. (2019). Formulating questions to explore complex interventions within qualitative evidence synthesis.   BMJ global health ,  4 (Suppl 1), e001107. (See supplementary data#1)

The "Well-Built Clinical Question“: PICO(T)

One well-established framework that can be used both for refining questions and developing strategies is known as PICO(T). The PICO framework was designed primarily for questions that include interventions and comparisons, however other types of questions may also be able to follow its principles.  If the PICO(T) framework does not precisely fit your question, using its principles (see alternative component suggestions) can help you to think about what you want to explore even if you do not end up with a true PICO question.

A PICO(T) question has the following components:

• P : The patient’s disorder or disease or problem of interest / research object
• I: The intervention, exposure or finding under review / Application of a theory or method
• C: A comparison intervention or control (if applicable- not always present)/ Alternative theories or methods (or, in their absence, the null hypothesis)
• O : The outcome(s) (desired or of interest) / Knowledge generation
• T : (The time factor or period)

Keep in mind that solely using a tool will not enable you to design a good question. What is required is for you to think, carefully, about exactly what you want to study and precisely what you mean by each of the things that you think you want to study.

Rzany, & Bigby, M. (n.d.). Formulating Well-Built Clinical Questions. In Evidence-based dermatology / (pp. 27–30). Blackwell Pub/BMJ Books.  

Nishikawa-Pacher, A. (2022). Research questions with PICO: a universal mnemonic.   Publications ,  10 (3), 21.

• << Previous: Characteristics of a good research question
• Next: Choosing the Search Terms >>

3. Comparative Research Methods

This chapter examines the ‘art of comparing’ by showing how to relate a theoretically guided research question to a properly founded research answer by developing an adequate research design. It first considers the role of variables in comparative research, before discussing the meaning of ‘cases’ and case selection. It then looks at the ‘core’ of the comparative research method: the use of the logic of comparative inquiry to analyse the relationships between variables (representing theory), and the information contained in the cases (the data). Two logics are distinguished: Method of Difference and Method of Agreement. The chapter concludes with an assessment of some problems common to the use of comparative methods.

• Related Documents

3. Comparative research methods

This chapter examines the ‘art of comparing’ by showing how to relate a theoretically guided research question to a properly founded research answer by developing an adequate research design. It first considers the role of variables in comparative research before discussing the meaning of ‘cases’ and case selection. It then looks at the ‘core’ of the comparative research method: the use of the logic of comparative inquiry to analyse the relationships between variables (representing theory) and the information contained in the cases (the data). Two logics are distinguished: Method of Difference and Method of Agreement. The chapter concludes with an assessment of some problems common to the use of comparative methods.

Rethinking Comparison

Qualitative comparative methods – and specifically controlled qualitative comparisons – are central to the study of politics. They are not the only kind of comparison, though, that can help us better understand political processes and outcomes. Yet there are few guides for how to conduct non-controlled comparative research. This volume brings together chapters from more than a dozen leading methods scholars from across the discipline of political science, including positivist and interpretivist scholars, qualitative methodologists, mixed-methods researchers, ethnographers, historians, and statisticians. Their work revolutionizes qualitative research design by diversifying the repertoire of comparative methods available to students of politics, offering readers clear suggestions for what kinds of comparisons might be possible, why they are useful, and how to execute them. By systematically thinking through how we engage in qualitative comparisons and the kinds of insights those comparisons produce, these collected essays create new possibilities to advance what we know about politics.

PERAN PEMUDA RELAWAN DEMOKRASI DALAM MENINGKATKAN PARTISIPASI POLITIK MASYARAKAT PADA PEMILIHAN UMUM LEGISLATIF TAHUN 2014 DAN IMPLIKASINYA TERHADAP KETAHANAN POLITIK WILAYAH (STUDI PADA RELAWAN DEMOKRASI BANYUMAS, JAWA TENGAH)

This research was going to described the role of Banyumas Democracy Volunteer ( Relawan Demokrasi Banyumas) in increasing political public partitipation in Banyumas’s legislative election 2014 and its implication to Banyumas’s political resilience. This research used qualitative research design as a research method. Data were collected by in depth review, observation and documentation. This research used purpossive sampling technique with stakeholder sampling variant to pick informants. The research showed that Banyumas Democracy Volunteer had a positive role in developing political resilience in Banyumas. Their role was gave political education and election education to voters in Banyumas. In the other words, Banyumas Democracy Volunteer had a vital role in developing ideal political resilience in Banyumas.Keywords: Banyumas Democracy Volunteer, Democracy, Election, Political Resilience of Region.

Ezer Kenegdo: Eksistensi Perempuan dan Perannya dalam Keluarga

AbstractPurpose of this study was to describe the meaning of ezer kenegdo and to know position and role of women in the family. The research method used is qualitative research methods (library research). The term of “ ezer kenegdo” refer to a helper but her position withoutsuperiority and inferiority. “The patner model” between men and women is uderstood in relation to one another as the same function, where differences are complementary and mutually beneficial in all walks of life and human endeavors.Keywords: Ezer Kenegdo; Women; Family.AbstrakTujuan penulisan artikel ini adalah untuk mendeskripsikan pengertian ezer kenegdo dan mengetahui kedudukan dan peran perempuan dalam keluarga. Metode yang digunakan adalah metode kualitatif library research. Ungkapan “ezer kenegdo” menunjuk pada seorang penolong namun kedudukannya adalah setara tanpa ada superioritas dan inferioritas. “Model kepatneran” antara laki-laki dan perempuan dipahami dengan hubungan satu dengan yang lain sebagai fungsi yang sama, yang mana perbedaan adalah saling melengkapi dan saling menguntungkan dalam semua lapisan kehidupan dan usaha manusia.Kata Kunci: Ezer Kenegdo, Prerempuan, Keluarga.

Commentary on ‘Opportunities and Challenges of Engaged Indigenous Scholarship’ (Van de Ven, Meyer, & Jing, 2018)

The mission ofManagement and Organization Review, founded in 2005, is to publish research about Chinese management and organizations, foreign organizations operating in China, or Chinese firms operating globally. The aspiration is to develop knowledge that is unique to China as well as universal knowledge that may transcend China. Articulated in the first editorial published in the inaugural issue of MOR (2005) and further elaborated in a second editorial (Tsui, 2006), the question of contextualization is framed, discussing the role of context in the choices of the research question, theory, measurement, and research design. The idea of ‘engaged indigenous research’ by Van de Ven, Meyer, and Jing (2018) describes the highest level of contextualization, with the local context serving as the primary factor guiding all the decisions of a research project. Tsui (2007: 1353) refers to it as ‘deep contextualization’.

PERAN DINAS KESEHATAN DALAM MENANGGULANGI GIZI BURUK ANAK DI KECAMATAN NGAMPRAH KABUPATEN BANDUNG BARAT

The title of this research is "The Role of the Health Office in Tackling Child Malnutrition in Ngamprah District, West Bandung Regency". The problem in this research is not yet optimal implementation of the Health Office in Overcoming Malnutrition in Children in Ngamprah District, West Bandung Regency. The research method that researchers use is descriptive research methods with a qualitative approach. The technique of determining the informants used was purposive sampling technique. The results showed that in carrying out its duties and functions, the health office, the Health Office had implemented a sufficiently optimal role seen from the six indicators of success in overcoming malnutrition, namely: All Posyandu carry out weighing operations at least once a month All toddlers are weighed, All cases of malnutrition are referred to the Puskemas Nursing or Home Sick, all cases of malnutrition are treated at the health center. Nursing or hospitalization is handled according to the management of malnutrition. All post-treatment malnourished toddlers receive assistance.

Jazz jem sessions in the aspect of listener perception

The purpose of the article is to identify the characteristic features ofjazz jam sessions as creative and concert events. The research methods arebased on the use of a number of empirical approaches. The historicalmethod has characterized the periodization of the emergence andpopularity of jam session as an artistic phenomenon. The use of themethod of comparison of jazz jam sessions and jazz concert made itpossible to determine the characteristic features of jams. An appeal toaxiological research methods has identified the most strikingimprovisational solos of leading jazz artists. Of particular importance inthe context of the article are the methods of analysis and synthesis,observation and generalization. It is important to pay attention to the use ofa structural-functional scientific-research method that indicates theeffectiveness of technological and execution processes on jams. Scientificinnovation. The article is about discovering the peculiarities of the jamsession phenomenon and defining the role of interaction between theaudience of improviser listeners and musicians throughout the jams. Theprocesses of development of jazz concerts and improvisations at jamsessions are revealed. Conclusions. The scientific research providedconfirms the fact that system of interactions between musicians amongthemselves and the audience, as well as improvisation of the performers atthe jam sessions is immense and infinite. That is why modern jazz singersand the audience will always strive for its development and understanding.This way is worth starting with repeated listening to improvisation, in theimmediate presence of the jam sessions (both participant and listener).

THE ROLE OF TECHNOLOGY INFORMATION SYSTEMS AND APPLICATION OF SAK ETAP ON DEVELOPMENT MODEL FINANCIAL POSITION REPORT

Bina Siswa SMA Plus Cisarua addressing in Jl. colonel canal masturi no. 64. At the time of document making, record-keeping of transaction relating to account real or financial position report account especially, Bina Siswa SMA Plus Cisarua has applied computer that is by using the application of Microsoft Office Word 2007 and Microsoft Excel 2007, in practice of control to relative financial position report account unable to be added with the duration process performed within financial statement making. For the problems then writer takes title: “The Role Of Technology Information Systems And Aplication Of SAK ETAP On Development Model Financial Position Report”. Research type which writer applies is research type academy, data type which writer applies is qualitative data and quantitative data, research design type which writer applies is research design deskriptif-analistis, research method which writer applies is descriptive research method, survey and eksperiment,  data collecting technique which writer applies is field researcher what consisted of interview and observation  library research, system development method which writer applies is methodologies orienting at process, data and output. System development structure applied is Iterasi. Design of information system applied is context diagram, data flow diagram, and flowchart. Design of this financial position report accounting information system according to statement of financial accounting standard SAK ETAP and output  consisted of information of accumulated fixed assets, receivable list, transaction summary of cash, transaction summary of bank and financial position report.

Dilema Hakim Pengadilan Agama dalam Menyelesaikan Perkara Hukum Keluarga Melalui Mediasi

This article aims to determine the role of judges in resolving family law cases through mediation in the Religious Courts, where judges have the position as state officials as regulated in Law Number 43 of 1999 concerning Basic Personnel, can also be a mediator in the judiciary. as regulated in Supreme Court Regulation Number 1 of 2016 concerning Mediation Procedures where judges have the responsibility to seek peace at every level of the trial and are also involved in mediation procedures. The research method used in this article uses normative legal research methods. Whereas until now judges still have a very important role in resolving family law cases in the Religious Courts due to the fact that there are still many negotiating processes with mediation assisted by judges, even though on the one hand the number of non-judge mediators is available, although in each region it is not evenly distributed in terms of number and capacity. non-judge mediator.

Anime affection on human IQ and behavior in Saudi Arabia

The present study attempted to determine the effects of watching anime and understanding if watching anime could affect the mental and social aspects of kids or other group of ages, and also to decide that the teenagers and children should watch anime or not. The research design used in this study is the descriptive research method and observational where in data and facts from direct observations and online questionnaires were used to answer the research question. The finding of this study suggested that anime viewers has higher level of general knowledge comparing with the non- anime viewers and as well as higher IQ level significantly in a specific group, besides anime can be used to spread a background about any culture and plays a role in increase the economy.

Export Citation Format

Share document.

• Examples of good research questions

Last updated

Reviewed by

Tanya Williams

However, developing a good research question is often challenging. But, doing appropriate data analysis or drawing meaningful conclusions from your investigation with a well-defined question make it easier.

So, to get you on the right track, let’s start by defining a research question, what types of research questions are common, and the steps to drafting an excellent research question.

Make research less tedious

Dovetail streamlines research to help you uncover and share actionable insights

• What is a research question?

The definition of a research question might seem fairly obvious.

 At its simplest, a research question is a question you research to find the answer.

Researchers typically start with a problem or an issue and seek to understand why it has occurred, how it can be solved, or other aspects of its nature.

As you'll see, researchers typically start with a broad question that becomes narrower and more specific as the research stages are completed.

In some cases, a study may tackle more than one research question.

• Research question types

Research questions are typically divided into three broad categories: qualitative, quantitative, and mixed-method.

These categories reflect the research type necessary to answer the research question.

Qualitative research

When you conduct qualitative research, you're broadly exploring a subject to analyze its inherent qualities.

There are many types of qualitative research questions, which include:

Descriptive: describing and illuminating little-known or overlooked aspects of a subject

Emancipatory: uncovering data that can serve to emancipate a particular group of people, such as disadvantaged or marginalized communities

Evaluative:  assessing how well a particular research approach or method works

Explanatory: answering “how” or “why” a given phenomenon occurs 

Exploratory:  identifying reasons behind certain behaviors and exploring motivations (also known as generative research because it can generate solutions to problems)

Ideological: researching ideologies or beliefs, such as political affiliation

Interpretive: understanding group perceptions, decision-making, and behavior in a natural setting

Predictive: forecasting a likely outcome or scenario by examining past events 

While it's helpful to understand the differences between these qualitative research question types, writing a good question doesn't start with determining the precise type of research question you'll be asking.

It starts with determining what answers you're seeking.

Quantitative research

Unlike broad, flexible qualitative research questions, quantitative research questions are precise. They also directly link the research question and the proposed methodology.

So, in a quantitative research question, you'll usually find

The study method 

An independent variable (or variables)

A dependent variable

The study population 

Quantitative research questions can also fall into multiple categories, including:

Comparative research questions compare two or more groups according to specific criteria and analyze their similarities and differences.

Descriptive questions measure a population's response to one or more variables.

Relationship (or relationship-based) questions examine how two or more variables interact.

Mixed-methods research

As its name suggests, mixed-methods research questions involve qualitative and quantitative components.

These questions are ideal when the answers require an evaluation of a specific aspect of a phenomenon that you can quantify and a broader understanding of aspects that can't.

• How to write a research question

Writing a good research question can be challenging, even if you're passionate about the subject matter.

A good research question aims to solve a problem that still needs to be answered and can be solved empirically. 

The approach might involve quantitative or qualitative methodology, or a mixture of both. To write a well-developed research question, follow the four steps below:

1. Select a general topic

Start with a broad topic. You may already have one in mind or get one assigned to you. If you don't, think about one you're curious about. 

You can also use common brainstorming techniques , draw on discussions you've had with family and friends, take topics from the news, or use other similar sources of inspiration.

Also, consider a subject that has yet to be studied or addressed. If you're looking to tackle a topic that has already been thoroughly studied, you'll want to examine it from a new angle.

Still, the closer your question, approach, and outcomes are to existing literature, the less value your work will offer. It will also be less publishing-worthy (if that’s your goal).

2. Conduct preliminary research

Next, you'll want to conduct some initial research about your topic. You'll read coverage about your topic in academic journals, the news, and other credible sources at this stage.

You'll familiarize yourself with the terminology commonly used to describe your topic and the current take from subject matter experts and the general public. 

This preliminary review helps you in a few ways. First, you'll find many researchers will discuss challenges they found conducting their research in their "Limitations," "Results," and "Discussion" sections of research papers.

Assessing these sections also helps you avoid choosing the wrong methodological approach to answering your question. Initial research also enables you to avoid focusing on a topic that has already been covered. 

You can generate valuable research questions by tracking topics that have yet to be covered.

3. Consider your audience

Next, you'll want to give some thought to your audience. For example, what kinds of research material are they looking for, and what might they find valuable?

Reflect on why you’re conducting the research. 

What is your team looking to learn if your research is for a work assignment?

How does what they’re asking for from you connect to business goals?

Understanding what your audience is seeking can help you shape the direction of your research so that the final draft connects with your audience.

If you're writing for an academic journal, what types of research do they publish? What kinds of research approaches have they published? And what criteria do they expect submitted manuscripts to meet?

4. Generate potential questions

Take the insights you've gained from your preliminary research and your audience assessment to narrow your topic into a research question. 

Your question should be one that you can answer using the appropriate research methods. Unfortunately, some researchers start with questions they need more resources to answer and then produce studies whose outcomes are limited, limiting the study's value to the broader community. 

Make sure your question is one you can realistically answer.

• Examples of poor research questions

"How do electronics distract teen drivers?"

This question could be better from a researcher's perspective because it is overly broad. For instance, what is “electronics” in this context? Some electronics, like eye-monitoring systems in semi-autonomous vehicles, are designed to keep drivers focused on the road.

Also, how does the question define “teens”? Some states allow you to get a learner's permit as young as 14, while others require you to be 18 to drive. Therefore, conducting a study without further defining the participants' ages is not scientifically sound.

Here's another example of an ineffective research question:

"Why is the sky blue?"

This question has been researched thoroughly and answered. 

A simple online search will turn up hundreds, if not thousands, of pages of resources devoted to this very topic. 

Suppose you spend time conducting original research on a long-answered question; your research won’t be interesting, relevant, or valuable to your audience.

Alternatively, here's an example of a good research question:

"How does using a vehicle’s infotainment touch screen by drivers aged 16 to 18 in the U.S. affect driving habits?"

This question is far more specific than the first bad example. It notes the population of the study, as well as the independent and dependent variables.

And if you're still interested in the sky's color, a better example of a research question might be:

"What color is the sky on Proxima Centauri b, based on existing observations?"

A qualitative research study based on this question could extrapolate what visitors on Proxima Centauri b (a planet in the closest solar system to ours) might see as they look at the sky.

You could approach this by contextualizing our understanding of how the light scatters off the molecules of air resulting in a blue sky, and the likely composition of Proxima Centauri b's atmosphere from data NASA and others have gathered.

• Why the right research question is critical

As you can see from the examples, starting with a poorly-framed research question can make your study difficult or impossible to complete. 

Or it can lead you to duplicate research findings.

Ultimately, developing the right research question sets you up for success. It helps you define a realistic scope for your study, informs the best approach to answer the central question, and conveys its value to your audience. 

That's why you must take the time to get your research question right before you embark on any other part of your project.

Get started today

Go from raw data to valuable insights with a flexible research platform

Editor’s picks

Last updated: 21 December 2023

Last updated: 16 December 2023

Last updated: 6 October 2023

Last updated: 25 November 2023

Last updated: 12 May 2023

Last updated: 15 February 2024

Last updated: 11 March 2024

Last updated: 12 December 2023

Last updated: 18 May 2023

Last updated: 6 March 2024

Last updated: 10 April 2023

Last updated: 20 December 2023

Latest articles

Related topics, log in or sign up.

Get started for free

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

Part 2. The FLOAT Method

2.2 Formulate

Formulate a research question.

Tips for Developing Research Questions:

• Make sure the question clearly states what the researcher needs to do.
• If working with tabular data, think in terms of how your question really relates one column to one or more others.
• The question should have an appropriate scope. If the question is too broad it will not be possible to answer it thoroughly within the word limit.
• If it is too narrow you will not have enough information to interpret and develop a strong argument.
• You must be able to answer the question thoroughly within the given timeframe and word limit.
• You must have access to a suitable amount of quality research materials, such as academic books and refereed journal articles to back up data driven assertions.

When formulating a research question that hinges on data, there is no set way to go about creating the core question. Different disciplines have their own distinct priorities and requirements. Still, there are some tips that facilitate this process.  The research process contains many different steps such as selecting a research methodology to reporting your findings. Whether the objective is qualitative or quantitative in nature determines which type or types of research questions should be utilized.

Types of Research Questions

There are several different types of questions you can pose. We have provided three below to get started:

Descriptive

Descriptive research questions describe the data. The researcher cannot infer any conclusions from this type of analysis; it simply presents data. Descriptive questions are useful when little is known on a topic, and you are seeking to answer what , where , when , and how , though not why .

Examples of Descriptive Questions:

• What are the top 10 most frequently anthologized short stories?
• Who are the top 10 most frequently anthologized short story writers?
• To what extent do the 10 most frequently republished short stories change over time?

Comparative

Comparative research questions are assessed using a continuous variable and/or a categorical grouping variable, in conjunction with two categorical grouping variables. Comparative questions are useful for considering the differences between subjects.

Examples of Comparative Questions:

• What are the differences in samples from the 1970s used on Jay-Z’s first album compared to his last album?
• What is the difference in between the number of vocal samples and instrumental samples across Jay-Z’s solo albums?
• Which of Jay-Z’s albums included the most vocal samples from the 1990s?

Relationship-Based

Relationship-Based Research Questions (also known as correlational ) questions are useful when you are trying to determine whether two variables are related or influence one another. Be mindful that “causation is not correlation,” which means that just because two variables are related (correlated), does not mean that one of those things determines (causes) a particular outcome.

Examples of Descriptive Relationship-Based Questions:

• Does the number of awards received annually increase as an artist’s total number of awards increases?
• What is the relationship between geographical wage data and home ownership?

Steps to Formulating a Research Question: Exploratory Data Analysis

A good way to begin formulating a research question is to use Exploratory Data Analysis (EDA). The point of EDA is to take a step back and take a broad assessment of your data. EDA is just as important as any part of a data project because datasets are not always clear. They also are often messy, and many variables are inaccurate. If you do not know your data, how are you going to form a logical question or know where to look for sources of error or confusion?

EDA is a subfield of statistics that is frequently used in the digital humanities to get acquainted with and summarize data sources. EDA often evokes new hypotheses and guides researchers toward selecting the appropriate techniques for testing. EDA can stand alone, especially when working with large datasets, but it must also be completed before statistical analysis is conducted to avoid blindly applying models without first considering the appropriateness of the method. EDA is concerned with exploring data by iterating between summary statistics, modeling techniques, and visualizations.

Summary or Descriptive Statistics

Descriptive statistics are summary information about your data. They offer a quick description of the data which allows ease of understanding at the onset of exploring the data. The most common descriptive or summary statistics one may gather from data are measures of central tendency (like means), data spread and variance (like the range). Here are the most common approaches:

Central Tendency – i.e., seeing where most of your data fall on average.

There are different reasons for selecting one or more of the three measures of central tendency. The arithmetic mean (or average) is the most popular and well known measure of central tendency because it can be used with both discrete and continuous data (although its use is most often with continuous data). However, it is not always the best choice for every data variable. Let us use an example to understand these measures of central tendency and why each is important.

• Mean – to calculate the mean, you add all the data for a variable together and divide the total by the number of data points.
• Median – to calculate the median, you sort your data by size. Then, the value where half the data is above and half the data are below is the median.
• Mode – to get the mode, you select the number which most frequently occurs in the data.

Descriptive Statistics Example

For a dataset where the measurement of lengths of 9 materials are as follows:

1 in, 2 in, 5 in, 5 in, 5 in , 6 in, 7 in, 10 in, and 100 in

The mean, median, and mode would be calculated as

• mean = (1+2+5+5+5+6+7+10+100)/9 = 15.67 in
• median = the number in the exact middle of the ordered list, which is 5 in   (underlined above)
• mode = the most frequent number, which is 5 in (in red above)

If the data fall under a normal distribution , or “Bell curve,” then that would lead to the mean, median, and mode all having the same value. Looking at the Descriptive Statistics Example to the right, where these values differ, which measure of central tendency is most accurate in describing the central value for that variable?

As you work with data, you become familiar with cases in which one or two are not as accurate than the other(s). In this case, the mean is not as accurate in describing the data due to the large outlier (or point that is drastically different from the others) with one piece of material measuring 100 inches.

Data Spread and Variance – i.e., the range and difference among the data points.

The easiest way to describe the spread of data is to calculate the range. The range is the difference between the highest and lowest values from a sample. This is very easily calculated. However, since it is only dependent upon two scores it is very sensitive to extreme values. The range is almost never used alone to describe the spread of data. It is often used in conjunction with the variance or the standard deviation. The variance provides a description of how spread out the data you collected is. The variance is computed as the average squared deviation of each number from its mean. However, rather than computing the calculation for variance, you can use another common approach.

This alternate common approach is the five-number summary, which gives the minimum, lower quartile, median, upper quartile, and maximum values for a given variable. A quartile represents 25% of your data range. So, the lower quartile (or the first quartile) is the 25th percentile, while mean (or the second quartile) is the 50th percentile. The upper quartile (or the third quartile) is the 75th percentile. These compactly describe a robust measure of the spread and central tendency of a variable while also indicating potential outliers. When we refer back to the Descriptive Statistics Example, we can see the values for spread are below:

• Minimum  – 1 in
• Lower Quartile  – 3.5 in
• Median  – 5 in
• Upper Quartile  – 8.5 in
• Maximum  – 100 in
• Range  – 99 in
• Interquartile Range – or the range between the lower and upper quartile, is 5 in

Using these numbers, you can quickly see that most of the data are low numbers with a possible large outlier or two. Of course, that is easy to tell with the data provided, since there were only 9 original data points. However, if you have a large dataset with hundreds or thousands of values, calculating the data spread and variance measures can give you a snapshot of where all your data fall.

Further Practice

Download the dataset and data dictionary for  The Black Short Story Dataset – Vol. 1 in Mavs Dataverse at https://doi.org/10.18738/T8/5TBANV (Rambsy et al.). Look at a variable, such as “Original Publication Year” to determine the average year the publications in the dataset were published? Calculate the mean, median, and mode to see which of these are most accurate. Then calculate the values of data spread and variance to see when all and most of the short stories were originally published. What trends do you see? If you were to look at some of these measures across some of the variables of interest to you, do you think you would have a better understanding of the dataset? If so, try to formulate a potential question, using the research question types above, about the dataset.

Visualizations

Data visualizations, like histograms, boxplots, scatterplots, and word clouds, can also be used to augment or better understand datasets. These are typically used to show distributions, ranges, and variance. We are visual creatures, and making use of a visualization to see what data exist is useful for researchers ourselves. Visualizing your data in various ways can help you see things you may have missed out on in your early stages of exploration. Here are four go-to visualizations to utilize. For example, in the following sets of data, these are identical when examined with summary statistics, but they vary greatly when visualized.

The Power of Visualizations: Anscombe’s Quartet

This graphic represents the four datasets defined by Francis Anscombe for which some of the usual statistical properties (mean, variance, correlation and regression line) are the same, even though the datasets are different. Reference: Anscombe, Francis J. (1973) Graphs in statistical analysis. American Statistician, 27, 17–21.

The histogram shows the distributions of numeric values for a variable. It is different than a bar chart because it shows the  frequency of “bins” of values for a particular variable. To create a histogram, you would determine how large bins would be. In the case of the figure below, bins are by 3s, or they represent numbers 0, 1-3, 4-6, and so on until it reaches the last bin of 100-102. Much like the measures above, a histogram can tell you the most frequent values, whether the values follow a normal distribution, and whether there are outlying values.

Scatterplots and boxplots show patterns between variables, a strategy particularly important when simultaneously analyzing multivariate data. The boxplot is a visualization of the measures of data spread and variance provided above.

Scatterplots

A scatterplot displays whether there is some kind of a relationship exists between any two numeric variables in your dataset. Typically the relationship is linear – in a straight line. A positive relationship is when more of one variable tends to go along with more of the other and vice versa (like longer study hours being correlated with higher grades). A positive relationship is apparent when the dots form a rising line. A negative relationship is when less of one leads to more of the other and vice versa (like how more hours exercising is correlated with lower body weight). A negative linear relationship is apparent when the dots form a falling line. However, you may find the data fall in other ways, such as exponential relationships. Plotting your points will allow you to know your data, and it will prevent serious assumptions in your analysis later (see the Anscombe’s Quartet example earlier). In the scatterplot matrix below, we can see that, as expected, publication year and publication decade are linearly positively related. But, we can also see a relationship between author’s birth decade and when they published their short story, which means there could be a story behind a certain age at which most people are likely to publish their significant works.

Scatterplot Matrix of Numeric Variables in The Black Short Story Dataset

A word cloud is a fourth visualization method. It is useful to determine crucial information when your raw data is text-based. It specifically visualizes frequency of text, where larger words are those that are found more frequently in the dataset.

Voyant Tools is a popular humanities tool for exploring data, including the development of word clouds. Visit Chapter 4.4 Voyant Tools for steps to use it.

Going through this process of understanding your data is vital for more than just the reasons I have mentioned. It might also eventually help you make informed decisions when it comes to selecting your model. The methods and processes outlined above are recommended for exploring a new dataset. There are so many more visualizations that you can use to explore and experiment with using your dataset. Don’t hold yourself back. You’re just trying to look at your data and understand it.

Not sure what visualization is best? Read Chapter 2.5: Tell , which goes further into visualizations and can help with selection.

By Peace Ossom-Williamson

Arnold, Taylor, and Lauren Tilton. “ New Data? The Role of Statistics in DH .” Debates in Digital Humanities, edited by Matthew K. Gold and Lauren F. Klein, University of Minnesota, 2019. ©   [ fair use analysis ]. Portions of the chapter are adapted  from the following sources:

Gupta, Aamodini. “ Exploring Exploratory Data Analysis .”  Towards Data Science , 29 May 2019, https://towardsdatascience.com/exploring-exploratory-data-analysis-1aa72908a5df. © [ fair use analysis ].

Hoffman, Chad. “ Lesson 3: Basic Descriptive Statistics .”  Statistics , 2007, https://www.webpages.uidaho.edu/learn/statistics/lessons/lesson03/3_1.htm. ©[ fair use analysis ].

Media Attributions

• Figure 2.2.1 – Formulate Triangle © Peace Ossom-Williamson is licensed under a CC BY (Attribution) license
• Figure 2.2.2 – Anscombe’s Quartet © Francis J. Anscombe is licensed under a CC BY-SA (Attribution ShareAlike) license
• Figure 2.2.3 – Histogram of Lengths © Peace Ossom-Williamson is licensed under a CC BY (Attribution) license
• Figure 2.2.4 – ex-boxplots © Peace Ossom-Williamson is licensed under a CC BY (Attribution) license
• Figure 2.2.5 – Scatterplot Matrix © Peace Ossom-Williamson is licensed under a CC BY (Attribution) license

Descriptive research questions simply aim to describe the variables you are measuring. When we use the word describe, we mean that these research questions aim to quantify the variables you are interested in. Think of research questions that start with words such as "How much?", "How often?", "What percentage?", and "What proportion?", but also sometimes questions starting "What is?" and "What are?". Often, descriptive research questions focus on only one variable and one group, but they can include multiple variables and groups.

Source: https://dissertation.laerd.com/types-of-quantitative-research-question.php

Comparative research questions aim to examine the differences between two or more groups on one or more dependent variables (although often just a single dependent variable). Such questions typically start by asking "What is the difference in?" a particular dependent variable (e.g., daily calorific intake) between two or more groups (e.g., American men and American women).

Whilst we refer to this type of quantitative research question as a relationship-based research question, the word relationship should be treated simply as a useful way of describing the fact that these types of quantitative research question are interested in the causal relationships, associations, trends and/or interactions amongst two or more variables on one or more groups. We have to be careful when using the word relationship because in statistics, it refers to a particular type of research design, namely experimental research designs where it is possible to measure the cause and effect between two or more variables; that is, it is possible to say that variable A (e.g., study time) was responsible for an increase in variable B (e.g., exam scores).

However, when we write a relationship-based research question, we do not have to make this distinction between causal relationships, associations, trends and interactions (i.e., it is just something that you should keep in the back of your mind). Instead, we typically start a relationship-based quantitative research question, "What is the relationship?", usually followed by the words, "between or amongst", then list the independent variables (e.g., gender) and dependent variables (e.g., attitudes towards music piracy), "amongst or between" the group(s) you are focusing on.

In statistics, exploratory data analysis is an approach of analyzing data sets to summarize their main characteristics, often using statistical graphics and other data visualization methods. A statistical model can be used or not, but primarily EDA is for seeing what the data can tell us beyond the formal modeling or hypothesis testing task.

Source: https://en.wikipedia.org/wiki/Exploratory_data_analysis

A descriptive statistic (in the count noun sense) is a summary statistic that quantitatively describes or summarizes features from a collection of information, while descriptive statistics (in the mass noun sense) is the process of using and analysing those statistics. Descriptive statistics is distinguished from inferential statistics (or inductive statistics) by its aim to summarize a sample, rather than use the data to learn about the population that the sample of data is thought to represent. This generally means that descriptive statistics, unlike inferential statistics, is not developed on the basis of probability theory, and are frequently non-parametric statistics. Even when a data analysis draws its main conclusions using inferential statistics, descriptive statistics are generally also presented.

Source: https://en.wikipedia.org/wiki/Descriptive_statistics

The Data Notebook Copyright © 2021 by Peace Ossom-Williamson and Kenton Rambsy is licensed under a Creative Commons Attribution 4.0 International License , except where otherwise noted.

Share This Book

• A/B Monadic Test
• A/B Pre-Roll Test
• Key Driver Analysis
• Multiple Implicit
• Penalty Reward
• Price Sensitivity
• Segmentation
• Single Implicit
• Category Exploration
• Competitive Landscape
• Consumer Segmentation
• Innovation & Renovation
• Product Portfolio
• Marketing Creatives
• Advertising
• Shelf Optimization
• Performance Monitoring
• Better Brand Health Tracking
• Ad Tracking
• Trend Tracking
• Satisfaction Tracking
• AI Insights
• Case Studies

quantilope is the Consumer Intelligence Platform for all end-to-end research needs

What Are Quantitative Survey Questions? Types and Examples

Table of contents: 

• Types of quantitative survey questions - with examples 
• Quantitative question formats
• How to write quantitative survey questions 
• Examples of quantitative survey questions 

Leveraging quantilope for your quantitative survey 

In a quantitative research study brands will gather numeric data for most of their questions through formats like numerical scale questions or ranking questions. However, brands can also include some non-quantitative questions throughout their quantitative study - like open-ended questions, where respondents will type in their own feedback to a question prompt. Even so, open-ended answers can be numerically coded to sift through feedback easily (e.g. anyone who writes in 'Pepsi' in a soda study would be assigned the number '1', to look at Pepsi feedback as a whole).  One of the biggest benefits of using a quantitative research approach is that insights around a research topic can undergo statistical analysis; the same can’t be said for qualitative data like focus group feedback or interviews. Another major difference between quantitative and qualitative research methods is that quantitative surveys require respondents to choose from a limited number of choices in a close-ended question - generating clear, actionable takeaways. However, these distinct quantitative takeaways often pair well with freeform qualitative responses - making quant and qual a great team to use together.  The rest of this article focuses on quantitative research, taking a closer look at quantitative survey question types and question formats/layouts. 

Back to table of contents 

Types of dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139745">quantitative survey questions - with examples 

Quantitative questions come in many forms, each with different benefits depending on dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139784">your dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139740">market research objectives. Below we’ll explore some of these dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139745">quantitative dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139785">survey question dropdown#toggle" data-dropdown-menu-id-param="menu_term_281139785" data-dropdown-placement-param="top" data-term-id="281139785"> types, which are commonly used together in a single survey to keep things interesting for dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents . The style of questioning used during dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139739">quantitative dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139750">data dropdown#toggle" data-dropdown-menu-id-param="menu_term_281139750" data-dropdown-placement-param="top" data-term-id="281139750"> collection is important, as a good mix of the right types of questions will deliver rich data, limit dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondent fatigue, and optimize the dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139757">response rate . dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139742">Questionnaires should be enjoyable - and varying the dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139755">types of dropdown#toggle" data-dropdown-menu-id-param="menu_term_281139755" data-dropdown-placement-param="top" data-term-id="281139755">quantitative research dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139755"> questions used throughout your survey will help achieve that. 

Descriptive survey questions

dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139763">Descriptive research questions (also known as usage and attitude, or, U&A questions) seek a general indication or prediction about how a dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139773">group of people behaves or will behave, how that group is characterized, or how a group thinks.

For example, a business might want to know what portion of adult men shave, and how often they do so. To find this out, they will survey men (the dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139743">target audience ) and ask descriptive questions about their frequency of shaving (e.g. daily, a few times a week, once per week, and so on.) Each of these frequencies get assigned a numerical ‘code’ so that it’s simple to chart and analyze the data later on; daily might be assigned ‘5’, a few times a week might be assigned ‘4’, and so on. That way, brands can create charts using the ‘top two’ and ‘bottom two’ values in a descriptive question to view these metrics side by side.

Another business might want to know how important local transit issues are to residents, so dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139745">quantitative survey questions will allow dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents to indicate the degrees of opinion attached to various transit issues. Perhaps the transit business running this survey would use a sliding numeric scale to see how important a particular issue is.

Comparative survey questions

dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139782">Comparative research questions are concerned with comparing individuals or groups of people based on one or more variables. These questions might be posed when a business wants to find out which segment of its dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139743">target audience might be more profitable, or which types of products might appeal to different sets of consumers.

For example, a business might want to know how the popularity of its chocolate bars is spread out across its entire customer base (i.e. do women prefer a certain flavor? Are children drawn to candy bars by certain packaging attributes? etc.). Questions in this case will be designed to profile and ‘compare’ segments of the market.

Other businesses might be looking to compare coffee consumption among older and younger consumers (i.e. dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139741">demographic segments), the difference in smartphone usage between younger men and women, or how women from different regions differ in their approach to skincare.

Relationship-based survey questions

As the name suggests, relationship-based survey questions are concerned with the relationship between two or more variables within one or more dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139741">demographic groups. This might be a dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139759">causal link between one thing and the other - for example, the consumption of caffeine and dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents ’ reported energy levels throughout the day. In this case, a coffee or energy drink brand might be interested in how energy levels differ between those who drink their caffeinated line of beverages and those who drink decaf/non-caffeinated beverages.

Alternatively, it might be a case of two or more factors co-existing, without there necessarily being a dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139759">causal link - for example, a particular type of air freshener being more popular amongst a certain dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139741">demographic (maybe one that is controlled wirelessly via Bluetooth is more popular among younger homeowners than one that’s plugged into the wall with no controls). Knowing that millennials favor air fresheners which have options for swapping out scents and setting up schedules would be valuable information for new product development.

Advanced method survey questions

Aside from descriptive, comparative, and relationship-based survey questions, brands can opt to include advanced methodologies in their quantitative dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139742">questionnaire for richer depth. Though advanced methods are more complex in terms of the insights output, quantilope’s Consumer Intelligence Platform automates the setup and analysis of these methods so that researchers of any background or skillset can leverage them with ease.

With quantilope’s pre-programmed suite of 12 advanced methodologies , including MaxDiff , TURF , Implicit , and more, users can drag and drop any of these into a dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139742">questionnaire and customize for their own dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139740">market research objectives.

For example, consider a beverage company that’s looking to expand its flavor profiles. This brand would benefit from a MaxDiff which forces dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents to make tradeoff decisions between a set of flavors. A dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondent might say that coconut is their most-preferred flavor, and lime their least (when in a consideration set with strawberry), yet later on in the MaxDiff that same dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondent may say Strawberry is their most-preferred flavor (over black cherry and kiwi). While this is just one example of an advanced method, instantly you can see how much richer and more actionable these quantitative metrics become compared to a standard usage and attitude question .

Advanced methods can be used alongside descriptive, comparison, or relationship questions to add a new layer of context wherever a business sees fit. Back to table of contents 

Quantitative question formats  

So we’ve covered the kinds of dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139736">quantitative research questions you might want to answer using dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139740">market research , but how do these translate into the actual format of questions that you might include on your dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139742">questionnaire ?

Thinking ahead to your reporting process during your dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139742">questionnaire setup is actually quite important, as the available chart types differ among the types of questions asked; some question data is compatible with bar chart displays, others pie charts, others in trended line graphs, etc. Also consider how well the questions you’re asking will translate onto different devices that your dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents might be using to complete the survey (mobile, PC, or tablet).

Single Select questions

Single select questions are the simplest form of quantitative questioning, as dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents are asked to choose just one answer from a list of items, which tend to be ‘either/or’, ‘yes/no’, or ‘true/false’ questions. These questions are useful when you need to get a clear answer without any qualifying nuances.

Multi-select questions

Multi-select questions (aka, dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139767">multiple choice ) offer more flexibility for responses, allowing for a number of responses on a single question. dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">Respondents can be asked to ‘check all that apply’ or a cap can be applied (e.g. ‘select up to 3 choices’).

For example:

Aside from asking text-based questions like the above examples, a brand could also use a single or multi-select question to ask respondents to select the image they prefer more (like different iterations of a logo design, packaging options, branding colors, etc.). 

dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139749">Likert dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139766">scale dropdown#toggle" data-dropdown-menu-id-param="menu_term_281139766" data-dropdown-placement-param="top" data-term-id="281139766"> questions

A dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139749">Likert scale   is widely used as a convenient and easy-to-interpret rating method. dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">Respondents find it easy to indicate their degree of feelings by selecting the response they most identify with.

Slider scales

Slider scales are another good interactive way of formatting questions. They allow dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents to customize their level of feeling about a question, with a bit more variance and nuance allowed than a numeric scale:

One particularly common use of a slider scale in a dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139740">market dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139770">research dropdown#toggle" data-dropdown-menu-id-param="menu_term_281139770" data-dropdown-placement-param="top" data-term-id="281139770"> study is known as a NPS (Net Promoter Score) - a way to measure dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139775">customer experience and loyalty . A 0-10 scale is used to ask customers how likely they are to recommend a brand’s product or services to others. The NPS score is calculated by subtracting the percentage of ‘detractors’ (those who respond with a 0-6) from the percentage of promoters (those who respond with a 9-10). dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">Respondents who select 7-8 are known as ‘passives’.

For example: 

Drag and drop questions

Drag-and-drop question formats are a more ‘gamified’ approach to survey capture as they ask dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents to do more than simply check boxes or slide a scale. Drag-and-drop question formats are great for ranking exercises - asking dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents to place answer options in a certain order by dragging with their mouse. For example, you could ask survey takers to put pizza toppings in order of preference by dragging options from a list of possible answers to a box displaying their personal preferences:

Matrix questions

Matrix   questions are a great way to consolidate a number of questions that ask for the same type of response (e.g. single select yes/no, true/false, or multi-select lists). They are mutually beneficial - making a survey look less daunting for the dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondent , and easier for a brand to set up than asking multiple separate questions.

Items in a matrix question are presented one by one, as respondents cycle through the pages selecting one answer for each coffee flavor shown. 

While the above example shows a single-matrix question - meaning a respondent can only select one answer per element (in this case, coffee flavors), a matrix setup can also be used for multiple-choice questions - allowing respondents to choose multiple answers per element shown, or for rating questions - allowing respondents to assign a rating (e.g. 1-5) for a list of elements at once.  Back to table of contents 

How to write dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139745">quantitative survey questions  

We’ve reviewed the types of questions you might ask in a quantitative survey, and how you might format those questions, but now for the actual crafting of the content.

When considering which questions to include in your survey, you’ll first want to establish what your research goals are and how these relate to your business goals. For example, thinking about the three types of dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139745">quantitative survey questions explained above - descriptive, comparative, and relationship-based - which type (or which combination) will best meet your research needs? The questions you ask dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents may be phrased in similar ways no matter what kind of layout you leverage, but you should have a good idea of how you’ll want to analyze the results as that will make it much easier to correctly set up your survey.

Quantitative questions tend to start with words like ‘how much,’ ‘how often,’ ‘to what degree,’ ‘what do you think of,’ ‘which of the following’ - anything that establishes what consumers do or think and that can be assigned a numerical code or value. Be sure to also include ‘other’ or ‘none of the above’ options in your quant questions, accommodating those who don’t feel the pre-set answers reflect their true opinion. As mentioned earlier, you can always include a small number of dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139748">open-ended questions in your quant survey to account for any ideas or expanded feedback that the pre-coded questions don’t (or can’t) cover. Back to table of contents 

Examples of dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139745">quantitative survey questions  

dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139745">Quantitative survey questions impose limits on the answers that dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents can choose from, and this is a good thing when it comes to measuring consumer opinions on a large scale and comparing across dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents . A large volume of freeform, open-ended answers is interesting when looking for themes from qualitative studies, but impractical to wade through when dealing with a large dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139756">sample size , and impossible to subject to dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139774">statistical analysis .

For example, a quantitative survey might aim to establish consumers' smartphone habits. This could include their frequency of buying a new smartphone, the considerations that drive purchase, which features they use their phone for, and how much they like their smartphone.

Some examples of quantitative survey questions relating to these habits would be:

Q. How often do you buy a new smartphone?

[single select question]

More than once per year

Every 1-2 years

Every 3-5 years

Every 6+ years

Q. Thinking about when you buy a smartphone, please rank the following factors in order of importance:

[drag and drop ranking question]

screen size

storage capacity

Q. How often do you use the following features on your smartphone?

[matrix question]

Q. How do you feel about your current smartphone?

[sliding scale]

I love it <-------> I hate it

Answers from these above questions, and others within the survey, would be analyzed to paint a picture of smartphone usage and attitude trends across a population and its sub-groups. dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139738">Qualitative research might then be carried out to explore those findings further - for example, people’s detailed attitudes towards their smartphones, how they feel about the amount of time they spend on it, and how features could be improved. Back to table of contents 

quantilope’s Consumer Intelligence Platform specializes in automated, advanced survey insights so that researchers of any skill level can benefit from quick, high-quality consumer insights. With 12 advanced methods to choose from and a wide variety of quantitative question formats, quantilope is your one-stop-shop for all things dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139740">market research (including its dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139776">in-depth dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139738">qualitative research solution - inColor ).

When it comes to building your survey, you decide how you want to go about it. You can start with a blank slate and drop questions into your survey from a pre-programmed list, or you can get a head start with a survey dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139765">template for a particular business use case (like concept testing ) and customize from there. Once your survey is ready to launch, simply specify your dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139743">target audience , connect any panel (quantilope is panel agnostic), and watch as dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139737">respondents dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139783">answer questions in your survey in real-time by monitoring the fieldwork section of your project. AI-driven dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139764">data analysis takes the raw data and converts it into actionable findings so you never have to worry about manual calculations or statistical testing.

Whether you want to run your quantitative study entirely on your own or with the help of a classically trained research team member, the choice is yours on quantilope’s platform. For more information on how quantilope can help with your next dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139736">quantitative dropdown#toggle" data-dropdown-placement-param="top" data-term-id="281139768">research dropdown#toggle" data-dropdown-menu-id-param="menu_term_281139768" data-dropdown-placement-param="top" data-term-id="281139768"> project , get in touch below!

Get in touch to learn more about quantitative research with quantilope!

Related posts, quirk's virtual event: fab-brew-lous collaboration: product innovations from the melitta group, brand value: what it is, how to build it, and how to measure it, what are brand perceptions and how can you measure them, how can brands build, measure, and manage brand equity.

• (855) 776-7763

Training Maker

All Products

Qualaroo Insights

ProProfs.com

• Sign Up Free

Do you want a free Survey Software?

We have the #1 Online Survey Maker Software to get actionable user insights.

How to Write Quantitative Research Questions: Types With Examples

For research to be effective, it becomes crucial to properly formulate the quantitative research questions in a correct way. Otherwise, you will not get the answers you were looking for.

Has it ever happened that you conducted a quantitative research study and found out the results you were expecting are quite different from the actual results?

This could happen due to many factors like the unpredictable nature of respondents, errors in calculation, research bias, etc. However, your quantitative research usually does not provide reliable results when questions are not written correctly.

We get it! Structuring the quantitative research questions can be a difficult task.

Hence, in this blog, we will share a few bits of advice on how to write good quantitative research questions. We will also look at different types of quantitative research questions along with their examples.

Let’s start:

How to Write Quantitative Research Questions?

When you want to obtain actionable insight into the trends and patterns of the research topic to make sense of it, quantitative research questions are your best bet.

Being objective in nature, these questions provide you with detailed information about the research topic and help in collecting quantifiable data that can be easily analyzed. This data can be generalized to the entire population and help make data-driven and sound decisions.

Respondents find it easier to answer quantitative survey questions than qualitative questions . At the same time, researchers can also analyze them quickly using various statistical models.

However, when it comes to writing the quantitative research questions, one can get a little overwhelmed as the entire study depends on the types of questions used.

There is no “one good way” to prepare these questions. However, to design well-structured quantitative research questions, you can follow the 4-steps approach given below:

1. Select the Type of Quantitative Question

The first step is to determine which type of quantitative question you want to add to your study. There are three types of quantitative questions:

• Descriptive
• Comparative 
• Relationship-based

This will help you choose the correct words and phrases while constructing the question. At the same time, it will also assist readers in understanding the question correctly.

2. Identify the Type of Variable

The second step involves identifying the type of variable you are trying to measure, manipulate, or control. Basically, there are two types of variables:

• Independent variable (a variable that is being manipulated)
• Dependent variable (outcome variable)

If you plan to use descriptive research questions, you have to deal with a number of dependent variables. However, where you plan to create comparative or relationship research questions, you will deal with both dependent and independent variables.

3. Select the Suitable Structure

The next step is determining the structure of the research question. It involves:

• Identifying the components of the question. It involves the type of dependent or independent variable and a group of interest (the group from which the researcher tries to conclude the population).
• The number of different components used. Like, as to how many variables and groups are being examined.
• Order in which these are presented. For example, the independent variable before the dependent variable or vice versa.

4. Draft the Complete Research Question

The last step involves identifying the problem or issue that you are trying to address in the form of complete quantitative survey questions. Also, make sure to build an exhaustive list of response options to make sure your respondents select the correct response. If you miss adding important answer options, then the ones chosen by respondents may not be entirely true.

Types of Quantitative Research Questions With Examples

Quantitative research questions are generally used to answer the “who” and “what” of the research topic. For quantitative research to be effective, it is crucial that the respondents are able to answer your questions concisely and precisely. With that in mind, let’s look in greater detail at the three types of formats you can use when preparing quantitative market research questions.

1. Descriptive

Descriptive research questions are used to collect participants’ opinions about the variable that you want to quantify. It is the most effortless way to measure the particular variable (single or multiple variables) you are interested in on a large scale. Usually, descriptive research questions begin with “ how much,” “how often,” “what percentage,” “what proportion,” etc.

Examples of descriptive research questions include:

2. Comparative

Comparative research questions help you identify the difference between two or more groups based on one or more variables. In general, a comparative research question is used to quantify one variable; however, you can use two or more variables depending on your market research objectives.

Comparative research questions examples include:

3. Relationship-based

Relationship research questions are used to identify trends, causal relationships, or associations between two or more variables. It is not vital to distinguish between causal relationships, trends, or associations while using these types of questions. These questions begin with “What is the relationship” between independent and dependent variables, amongst or between two or more groups.

Relationship-based quantitative questions examples include:

Ready to Write Your Quantitative Research Questions?

So, there you have it. It was all about quantitative research question types and their examples. By now, you must have figured out a way to write quantitative research questions for your survey to collect actionable customer feedback.

Now, the only thing you need is a good survey maker tool, like ProProfs Survey Maker, that will glide your process of designing and conducting your surveys . You also get access to various survey question types, both qualitative and quantitative, that you can add to any kind of survey along with professionally-designed survey templates .

About the author

Emma David is a seasoned market research professional with 8+ years of experience. Having kick-started her journey in research, she has developed rich expertise in employee engagement, survey creation and administration, and data management. Emma believes in the power of data to shape business performance positively. She continues to help brands and businesses make strategic decisions and improve their market standing through her understanding of research methodologies.

Popular Posts in This Category

Importance of Customer Feedback + Ways to Collect It

40+ Mental Health Survey Questions With Templates

11 SoGoSurvey Alternatives & Competitors in 2024

Customer Lifetime Value: An Ultimate Guide

Open Ended Questions: The Key to Collecting Qualitative Data

15 Ways to Collect Customer Feedback and Make the Most of It

quantitative approaches to comparative analyses: data properties and their implications for theory, measurement and modelling

• Introduction
• Open access
• Published: 06 November 2015
• Volume 14 , pages 385–393, ( 2015 )

Cite this article

You have full access to this open access article

• robert neumann 1 &
• peter graeff 2  

6059 Accesses

2 Citations

1 Altmetric

Explore all metrics

While there is an abundant use of macro data in the social sciences, little attention is given to the sources or the construction of these data. Owing to the restricted amount of indices or items, researchers most often apply the ‘available data at hand’. Since the opportunities to analyse data are constantly increasing and the availability of macro indicators is improving as well, one may be enticed to incorporate even qualitatively inferior indicators for the sake of statistically significant results. The pitfalls of applying biased indicators or using instruments with unknown methodological characteristics are biased estimates, false statistical inferences and, as one potential consequence, the derivation of misleading policy recommendations. This Special Issue assembles contributions that attempt to stimulate the missing debate about the criteria of assessing aggregate data and their measurement properties for comparative analyses.

Avoid common mistakes on your manuscript.

INTRODUCTION

The social sciences are witnessing an ever increasing supply of data at the aggregate levels on several key dimensions of societal progress or politico-institutional conditions. Next to standardised sources for comparing countries worldwide ( Solt, 2014 ), a bulge of indicators have been introduced over the past three decades to allow for comparative analyses regarding such issues as levels of perceived corruption, quality of governance, environmental sustainability, political rights and democratic freedom. And while there is an abundant use of these macro data, less attention has been given to the sources or to the construction of these data. Despite the spike in data availability, information on countries or regions often remains restricted to only a handful of indicators compiled by organisations that have the resources and know-how to offer worldwide a coverage of countries. Due to this restricted amount of indices or items, researchers for the most part apply the ‘available data at hand’ with only little consideration of their measurement properties.

There already have been attempts to address questions of data quality within the community of comparative political science. Herrera and Kapur (2007) try to foster the debate about the quality of comparative data sets by highlighting the three components of validity, coverage and accuracy. Mudde and Schedler (2010) discuss the challenges of data choice, distinguishing between procedural and outcome-oriented criteria when data quality is to be assessed. They relate the procedural criterion to aspects of transparency, reliability and replicability of data. The latter criteria is connected to validity, accuracy and precision ( Mudde and Schedler, 2010 : 411). Both groups of authors agree that research on data properties usually offers little scientific rewards, but that the debate about the measures is crucial and requires constant stimulation.

A few landmark books and articles have laid out some fundamental guidelines and approaches concerning case selection, operationalisation and implications for comparative model testing at the macro level (see for instance King et al, 1994 ; Adcock and Collier, 2001 ; Gerring, 2001 ). Yet it appears that the discussion within comparative research about measurement properties of different indicators lags the ongoing application of numerous indices in all sorts of comparative empirical research. That is, theoretical and empirical work with new and improved measurements has so far refrained from the opportunity to enhance an exchange about the conceptual framework for comparative multivariate modelling. Furthermore, it often remains problematic to grasp the core intentions of different streams of knowledge production especially when the computation of new cross-country indices was performed in response to prior criticism of existing measures.

DATA PROPERTIES AND THEIR TRADE-OFF

Judging data properties from a qualitative and quantitative perspective, King et al (1994 : 63, 97) propose the criteria of unbiasedness, efficiency and consistency. In particular they concentrate on the inferential performance of measures. Here, bias relates to the property to introduce specific variance into the measurement, which in turn leads to non-random variation between different or repeated applications of the measure in inferential tasks. For example, Hawken and Munck (2011 : 4) report that ratings on perceived corruption made by commercial risk assessment agencies systematically rate economies as more corrupt than surveys of business executives, representing a bias ‘which does not seem consistent with random measurement error’. Efficiency relates to the variance of a measure when taken as an estimator. The simple idea is that an increase in sample size will likely reduce the variance of a measure and will measure a phenomenon more efficiently. But, even King et al (1994 : 66) emphasise that these two properties come with a trade-off that is not always easily reconcilable to achieve consistency, most likely in the form that researchers should allow for more bias in their measure if they achieve larger improvements in efficiency. They do not elaborate on consistency further, although they obviously relate it to reliability, which points towards traditional criteria or properties of measurement theory.

‘… the criteria of validity and reliability remain the cornerstones of any discussions about measurement properties’.

This traditional approach of (psychometric) test or measurement theory usually provides social scientists with a framework to think about properties of measures or data. That is, the criteria of validity and reliability remain the cornerstones of any discussions about measurement properties. Footnote 1 One can define reliability as an ‘agreement between two efforts to measure same trait through maximally similar methods’ ( Campbell and Fiske, 1959 : 83). Usually, this translates to a test of internal consistency of an indicator or test-retest approaches to check whether the systematic variation of an observed phenomenon can be captured by an empirical measure, at several points in time or across different (sub-)samples ( Nunnally and Bernstein, 1978 : 191). Validity represents a more demanding measurement criterion. A few authors have put forward conceptual approaches to address the problems of constructing indices under the perspective of measurement validity (e.g., Bollen, 1989 ; Adcock and Collier, 2001 ). While measurement validity may be broadly defined as the achievement that ‘… scores (including the results of qualitative classification) meaningfully capture the ideas contained in the corresponding concept’ ( Adcock and Collier, 2001 : 530), it consists of various subcategories such as content, construct, internal/external validity, convergent/discriminant validity and even touches upon more ambitious concepts such as ecological validity as well. These various dimensions also reflect a variety of sources for measurement errors, whether stemming from the process data collection (randomisation versus case selection), survey mode and origin of data, data operationalisation or aggregation of different data sources.

Three aspects require us to think harder about the feasibility of these classical concepts of measurement theory. First, the increasing availability of data for the computation or aggregation of macro indicators should improve the reliability of measurements. In fact, it seems that econometricians have completely abandoned the idea of measurement validity and instead focus on statistical techniques for aggregating data. For instance, a recent debate has yielded the impression that reliability remains the main goal to be established, while the concept of validity are not treated as equally important (see the discussion between Kaufmann et al (2010) and Thomas (2010) ). The problem with the idea to increase the reliability of measures arises at the point when validity is sacrificed due to ‘methodological contamination’ ( Sullivan and Feldman, 1979 : 19), especially with regards to the notion that reliability ‘represents a necessary but not sufficient condition for validity’ ( Nunally and Bernstein, 1978 : 192, italics in the original). Hence, aggregated or broadly defined measures that are unable to discriminate concepts and which are theoretically distinct – and hence are not supposed to be measured by the initial approaches – do not necessarily represent threats to the reliability, but rather to the validity. This is especially the case in empirical tests of theoretical predictions regarding the determinants or consequences of certain politico-institutional conditions, where invalid measures are likely to generate biased coefficients due to measurement error among independent or even dependent variables ( Herrera and Kapur, 2007 ). To this end, results will subsequently lack generalisability. For example, combining several reliable measures of the same phenomena to increase the reliability of the aggregate measure can only claim to be unbiased if all underlying measures capture the same portion of systematic variation in a phenomenon and are able to exclude random measurement error equally well. Testing theories with aggregate measures always comes with the caveat of introducing random measurement error into a measure that is supposed to only represent systematic variation in a phenomenon (see for instance Bollen, 2009 for a discussion), despite being highly reliable.

The potential for a trade-off between reliability and components of validity leads to the second aspect to keep in mind when thinking about measurement properties: Lack of validity may only bother researchers who refer to a theory-driven approach of quantitative analyses. The shift towards a data-driven approach puts less emphasis on the underlying theory from which one derives hypotheses to be tested. Hypothesis testing may even be the least important aspect of statistical modelling ( Varian, 2014 : 5). Instead, the goals of data analyses are prediction, forecasting specific behaviours, events or outcomes based on large sets of data, prior knowledge or prior evidence. Due to large amounts of data available and the increasing computer capacities that have enabled the widespread use of Bayesian approaches or machine learning techniques in the social sciences (see Gelman et al, 2014 ; Jackman, 2009 ), claims can be made that measurement properties that derive their ideas from a theory-driven perspective may lose its relevance. Given this shift, it implies an increasing importance for concepts such as reliability or predictive validity that appear closer to the data-driven approach. Footnote 2

The third challenge confronts comparative scholars working with individual-level data. Here, the extension and longevity of survey programmes such as the World Values Surveys or the International Social Science Project (ISSP) have made the application of multilevel models for comparative cross-sectional longitudinal analyses feasible ( Beck, 2007 ; Fairbrother, 2014 ). Given these opportunities, one core assumption is that measurement invariance holds across countries. That is, questionnaire items capture the same underlying concept across different contexts of data collection in a similar way. On the other hand, the theoretical emphasis on the contextuality of social phenomena creates a desire to reflect such idiosyncratic characteristics of a society within the subsequent measurements approaches.

This creates another trade-off for scholars within the respective research communities. As in the case of reliability and validity, contextually reliable measures can come with a lack of measurement invariance. Given that measurement invariance is tested via its discrepancy to some theoretical model, the shift to data-driven approaches may affect the importance of this particular measurement property in a similar fashion as illustrated for the relationship between reliability and validity.

We perceive this development as neither definitive nor one-dimensional. Measurement theory and the concepts like validity remain crucial to evaluate and apply the right instruments and to know where to look when research questions are to be answered. That is, how to think or assess the properties of data becomes one crucial aspect of any empirical endeavour. But they seldom represent the only criteria for assessing the characteristics of data. Our own work was concentrated on the aspect of comparing different indices by their measurement properties ( Neumann and Graeff, 2010 , 2013 ). One conclusion from this work is that researchers face certain incentives that require decisions on how to cope with the aforementioned trade-offs when measures from comparative data are applied.

THE EDITED SPECIAL ISSUE

Despite the known problems with comparative data, only a few questions remain answered and the stream of new indicators constantly enhances new challenges facing current comparative research. Some key problems can be summarised as follows: How to account for the contextuality of measuring country characteristics while maintaining comparability? What are the consequences when prior knowledge and existing empirical findings are to be included into the derivation of existing and new indicators? How to assess the accuracy of an index and how to even define or measure accuracy in a measurement sense?

This edited issue comprises papers in which the properties of applied aggregate data and the underlying sources for the analysis are explicitly reflected. As the authors bring in different methodological backgrounds, the papers apply the variety of contemporary approaches dealing with reliability and validity. This does not always coincide with a psychometric notion of constructs or measurement criteria. The authors do not, however, fall prey to typical publication strategies such as reporting only significant and/or theoretical congruent results instead of null-results ( Gelman and Loken, 2014 ). All papers share the ambition to accurately reflect the underlying theoretical meaning of the constructs of interest. By this, they refer to the above mentioned key questions in their own way.

Susanne Pickel et al (2015 ) present a new framework for comparative social scientists that tackles one of the most prominent topics in political research: the quality of democracy. In particular, the authors propose a framework to assess the measurement properties of three prominent indices of the quality of democracy. This evaluative process requires both the integration of theoretical considerations about the definitional clarity and validity of the underlying concepts as well as empirical concerns about choice of data sources or procedures of operationalisation and aggregation. Their contribution picks up several important points when one deals with the measurement of macro phenomena. First, although the definition of a concept that encompasses concept validity may vary between researchers or research schools, an assessment of the measurement properties remains tied to rather objective criteria like reliability, transparency, parsimony or replicability. Second, the assessment of a concept and its measurement characteristic ultimately face the challenge of measuring contextual characteristics of a political system as close as possible while adhering to more general measurement principles. The latter represents a task for researchers who want to investigate the comparability of indices. Pickel et al apply a framework that includes twenty criteria, focusing on three indices of quality of democracy. The authors state that a theory-based conceptualisation represents the necessary condition for an attempt to face the (potential) trade-off between the adequacy of a measure and its property to compare it with other measures in a meaningful way.

Mark David Nieman and Jonathan Ring (2015 ) pick up one of the other big topics of political research: human rights. Their starting point is that all researchers dealing with country data on human rights have to rely on a restricted number of data sources. Namely, the Cingranelli-Richards (CIRI) or the Political Terror Scale (PTS) represents two widely used indices that are both constructed by using the same country reports on human rights violations from the United States State Department and Amnesty International. Their main concern is that if data resources share systematic measurement error, for instance due to politico-ideological or geopolitical bias in the country reports, these properties will likely be reflected in the indices constructed from these data sources. After clarifying why the reports of the US State Department possess such undesirable measurement properties, they propose specific remedies for the problem. Nieman and Ring discuss possible solutions such as data truncation as well as strategies of correcting for systematic bias using an instrumental variable approach. Their replication analysis reveals that the application of the corrected version indeed changes results from prior analyses. Their work highlights the importance of the decisions during the process of indicator choice and subsequent analysis, whereas some choice sets and their consequences regarding inferential reasoning pose conflicting incentives for researchers given the publication bias favouring statistical significant findings ( Brodeur et al, 2012 ).

Joakim Kreutz (2015) also scrutinises the methodological foundations of the PTS and CIRI. By referring to both indices, he tries to clarify the connection between human rights and the level of state repression in eighteen West African countries. But instead of focusing on repression levels, Kreutz focuses on changes in repression. By highlighting the importance of repression dynamics, he extends prior evidence on the connection of state repression and politico-institutional factors. From a measurement perspective, disaggregating levels of repression by the direction of change (increase/decrease) and by the nature of repressive actions (indiscriminate, selective targeting) may improve our understanding of the contextual features of repression dynamics. His study provides several implications for current research efforts that try to disentangle the relationship between levels of democracy and state repression.

Alexander Schmotz identifies a gap in the political science literature about the measurement of cooptation, which is the way by which non-members are absorbed by a ruling elite. Concepts of co-optation become particularly important for explaining the upholding of autocratic regimes. As such, issues of co-optation are at the heart of political science research but are only seldom operationalised, especially across time. Schmotz develops an index that is capable to measure several threats to autocratic regimes by social pressure groups. Co-optation is a way to deal with these threats. This topic illustrates some general problems in social science research, namely that theoretical ideas, their predictions about causes and effects, and their testing in empirical research are often intertwined. In such a situation, measurement quality (e.g., content validity) is also related to the performance of the index, in particular if the concept of co-optation refers to a ‘seemingly unrelated set of indicators’ ( Schmotz, 2015 ). Counterintuitive findings are then of particular importance as in study by Schmotz. He comes up with the conclusion that the concept of co-optation might not be as important as the relevant literature suggests. Such a finding – based on a new index with the potential for testing and improving its measurement features – will incite the discussion in this field and will most likely lead to refinements of theoretical ideas and their operationalisations.

Barbara Bechter and Bernd Brandl (2015 ) start with the observation that comparative research is mainly based on aggregates on the national level. This ‘methodological nationalism’ comes to a dead end if the variance between countries for the variable of interest vanishes (which typically occurs for political regime indicators for western countries, such as the Polity index). They provide an excellent example for an answer to the question about what accounts for the contextuality of comparative research measures as they find that for the field of industrial relations relevant variables reveal more variability across industrial sectors than across countries. This does not imply the meaninglessness of cross-country comparisons. Rather, it opens the perspective to alternative levels of analysis, not only in the field of industrial relations.

William Pollock, Jason Barabas, Jennifer Jerit, Martijn Schoonvelde, Susan Banducci and Daniel Stevens ( 2015 ) introduce their study of media effects with the statement that results from analyses of the degree of media exposure on certain attitudes or public opinion are affected by ‘data issues related to the number of observations, the timing of the inquiry, and (most importantly) the design choices that lead to alternative counterfactuals’ ( Pollock et al, 2015 ). In an attempt to provide a comprehensive overview, two identification strategies (difference-in-difference estimator versus within-survey/within-subject) for causal claims from cross- or single country survey data are compared to a traditional approach of statistical inference from regression analyses. Using the European Social Survey and information about media-related events during the data collection process allows them to investigate media effects of political or economic events across countries, across types and number of events as well as across time. With a focus on the external validity of such (quasi-)experimental use of survey data, they are able to generate in parts counterintuitive results regarding the impact of sample size and design effects. Their study emphasises that the process of data collection and design choices have an important impact on subsequent data analyses.

By referring to psychometric techniques, Jan Cieciuch et al (2015 ) raise the question about reliable ways of testing measurement invariance. As a precondition for comparing data, measurement invariance can be determined at the level of theoretical constructs (or latent variables), at the level of relations between the theoretical constructs and their indicators or at the level of indicators themselves. Standard methods to pinpoint measurement invariance based on factor analytical techniques are prone to produce false inferences due to model misspecifications. Cieciuch and his colleagues pick up the discussion in literature about model misspecification and show how one can assess whether a certain level of measurement invariance is obtained. As misspecification must be considered as a matter of degree, their study stimulates the discussion about the question, how much misspecification is acceptable.

King et al (1994: 25) clarify earlier that the achievement of reliability and validity represent key goals in any social inquiry, whether qualitative or quantitative in nature.

This change does not imply a shift from deductive to inductive reasoning from data to theories, because researchers remain bound to deriving their results from a theoretical framework. The nomological core of the data-driven approach stems from the distributive characteristics of different probability distributions. See Gelman and Shalizi (2014) for more details on this line of reasoning.

Adcock, R. and Collier, D. (2001) ‘Measurement validity: A shared standard for qualitative and quantitative research’, American Political Science Review 95 (3): 529–546.

Article   Google Scholar  

Beck, N. (2007) ‘From statistical nuisances to serious modeling: Changing how we think about the analysis of time-series–cross-section data’, Political Analysis 15 (2): 97–100. doi:10.1093/pan/mpm001.

Bechter, B. and Brandl, B. (2015) ‘Measurement and analysis of industrial relations aggregates: What is the relevant unit of analysis in comparative research?’ European Political Science 14(4): 422–438.

Bollen, K.A. (1989) Structural Equations with Latent Variables, New York, NY: Wiley.

Book   Google Scholar  

Bollen, K.A. (2009) ‘Liberal democracy series I, 1972–1988: Definition, measurement, and trajectories’, Electoral Studies 28 (3): 368–374.

Brodeur, A., Lé, M., Sangnier, M. and Zylberberg, Y. (2012) Star wars: The empirics strike back’, Paris School of Economics Working Paper 2012–29, pp. 1-.

Campbell, D.T. and Fiske, D.W. (1959) ‘Convergent and discriminant validity by the mutitrait-multimethod matrix’, Psychological Bulletin 56 (2): 81–105.

Cieciuch, J., Davidov, E., Oberski, D.L. and Algersheimer, R. (2015) ‘Testing for measurement invariance by detecting local misspecification and an illustration across online and paper-and-pencil samples’, European Political Science 14(4): 521–538.

Fairbrother, M. (2014) ‘Two multilevel modeling techniques for analyzing comparative longitudinal survey datasets’, Political Science Research and Methods 2 (1): 119–140.

Gelman, A., Carlin, J., Stern, H., Dunson, D.B., Vehtari, A. and Rubin, D. (2014) Bayesian Data Analysis, 3rd edn. London: CRC Press.

Google Scholar  

Gelman, A. and Shalizi, C. (2014) ‘Philosophy and the practice of Bayesian statistics’, British Journal of Mathematical and Statistical Psychology 66 (1): 8–38.

Gelman, A. and Loken, E. (2014) ‘The statistical crisis in science data-dependent analysis – a ‘garden of forking paths’ – explains why many statistically significant comparisons don't hold up’, American Scientist 102 (6): 460. doi:10.1511/2014.111.460.

Gerring, J. (2001) Social Science Methodology: A Criterial Framework, Cambridge: Cambridge University Press.

Hawken, A. and Munck, G.L. (2011) ‘Does the evaluator make a difference? Measurement validity in corruption research’, Measurement Validity in Corruption Research.

Herrera, Y.M. and Kapur, D. (2007) ‘Improving data quality: Actors, incentives, and capabilities’, Political Analysis 15 (4): 365–386.

Jackman, S. (2009) Bayesian Analysis for the Social Sciences, New York: John Wiley & Sons.

Kaufmann, D., Kraay, A. and Mastruzzi, M. (2010) ‘Response to ‘what do the worldwide governance indicators measure?’’, European Journal of Development Research 22 (1): 55–58.

King, G., Keohane, R.O. and Verba, S. (1994) Designing Social Inquiry: Scientific Inference in Qualitative Research, Princeton, NJ: Princeton University Press.

Kreutz, J. (2015) ‘Separating dirty war from dirty peace: Revisiting the conceptualization of state repression in quantitative data’, European Political Science 14(4): 458–472.

Mudde, C. and Schedler, A. (2010) ‘Introduction: Rational data choice’, Political Research Quarterly 63 (2): 410–416.

Neumann, R. and Graeff, P. (2010) ‘A multitrait-multimethod approach to pinpoint the validity of aggregated governance indicators’, Quality & Quantity 44 (5): 849–864.

Neumann, R. and Graeff, P. (2013) ‘Method bias in comparative research: Problems of construct validity as exemplified by the measurement of ethnic diversity’, Journal of Mathematical Sociology 37 (2): 85–112.

Nieman, M.D. and Ring, J.J. (2015) ‘The construction of human rights: Accounting for systematic bias in common human rights measures’, European Political Science 14(4): 473–495.

Nunally, J.C. and Bernstein, I.H. (1978) Psychometric Theory, New York: McGraw-Hill.

Pickel, S., Stark, T. and Breustedt, W. (2015) ‘Assessing the quality of quality measures of democracy: a theoretical framework and its empirical application’, European Political Science 14(4): 496–520.

Pollock, W., Barabas, J., Jerit, J., Schoonvelde, M., Banducci, S. and Stevens, D. (2015) ‘Studying media events in the European social surveys across research designs, countries, time, issues, and outcomes’, European Political Science 14(4): 394–421.

Schmotz, A. (2015) ‘Vulnerability and compensation – Constructing an index of co-optation in autocratic regimes’, European Political Science 14(4): 439–457.

Solt, F. (2014) ‘The Standardized World Income Inequality Database‘, Working paper. SWIID Version 5.0, October 2014. http://myweb.uiowa.edu/fsolt/index.html .

Sullivan, J.L. and Feldman, S. (1979) ‘Multiple indicators – An introduction‘ Sage University Paper series in Quantitative Applications in the Social Sciences No. 07–15, Beverly Hills and London: Sage.

Thomas, M. (2010) ‘What do the worldwide governance indicators measure?’ European Journal of Development Research 22 (1): 31–54.

Varian, H.R. (2014) ‘Big data: New tricks for econometrics’, The Journal of Economic Perspectives 28 (2): 3–28.

Download references

Acknowledgements

Parts of this Special Issue follow upon the symposium ‘The Quality of Measurement – Validity, Reliability and its Ramifications for Multivariate Modelling in Social Sciences’ held at Technische Universität Dresden from 21 to 22 September 2012. Videos of the presentations from the Symposium can be accessed through the website of the symposium at http://tinyurl.com/vwmeasurement . This symposium was financed by the Volkswagen Foundation, which supported the publication of this special issue as well. We thank all participants of the symposium for their remarks and contributions. Foremost, we thank the Volkswagen Foundation for their financial support.

Author information

Authors and affiliations.

Technische Universität Dresden, Dresden, 01069, Germany

robert neumann

University of Kiel, Christian-Albrechts-Platz 4, Kiel, 24118, Germany

peter graeff

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to robert neumann .

Additional information

The online version of this article is available Open Access

Rights and permissions

This work is licensed under a Creative Commons Attribution 3.0 Unported License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/3.0/

Reprints and permissions

About this article

neumann, r., graeff, p. quantitative approaches to comparative analyses: data properties and their implications for theory, measurement and modelling. Eur Polit Sci 14 , 385–393 (2015). https://doi.org/10.1057/eps.2015.59

Download citation

Published : 06 November 2015

Issue Date : 01 December 2015

DOI : https://doi.org/10.1057/eps.2015.59

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• reliability
• measurement
• quantitative analysis
• comparative politics
• comparative sociology
• Find a journal
• Publish with us
• Track your research

• Research Questions: Definitions, Types + [Examples]

Research questions lie at the core of systematic investigation and this is because recording accurate research outcomes is tied to asking the right questions. Asking the right questions when conducting research can help you collect relevant and insightful information that ultimately influences your work, positively. 

The right research questions are typically easy to understand, straight to the point, and engaging. In this article, we will share tips on how to create the right research questions and also show you how to create and administer an online questionnaire with Formplus . 

What is a Research Question? 

A research question is a specific inquiry which the research seeks to provide a response to. It resides at the core of systematic investigation and it helps you to clearly define a path for the research process. 

A research question is usually the first step in any research project. Basically, it is the primary interrogation point of your research and it sets the pace for your work.  

Typically, a research question focuses on the research, determines the methodology and hypothesis, and guides all stages of inquiry, analysis, and reporting. With the right research questions, you will be able to gather useful information for your investigation. 

Types of Research Questions 

Research questions are broadly categorized into 2; that is, qualitative research questions and quantitative research questions. Qualitative and quantitative research questions can be used independently and co-dependently in line with the overall focus and objectives of your research. 

If your research aims at collecting quantifiable data , you will need to make use of quantitative research questions. On the other hand, qualitative questions help you to gather qualitative data bothering on the perceptions and observations of your research subjects. 

Qualitative Research Questions  

A qualitative research question is a type of systematic inquiry that aims at collecting qualitative data from research subjects. The aim of qualitative research questions is to gather non-statistical information pertaining to the experiences, observations, and perceptions of the research subjects in line with the objectives of the investigation. 

Types of Qualitative Research Questions  

• Ethnographic Research Questions

As the name clearly suggests, ethnographic research questions are inquiries presented in ethnographic research. Ethnographic research is a qualitative research approach that involves observing variables in their natural environments or habitats in order to arrive at objective research outcomes. 

These research questions help the researcher to gather insights into the habits, dispositions, perceptions, and behaviors of research subjects as they interact in specific environments. 

Ethnographic research questions can be used in education, business, medicine, and other fields of study, and they are very useful in contexts aimed at collecting in-depth and specific information that are peculiar to research variables. For instance, asking educational ethnographic research questions can help you understand how pedagogy affects classroom relations and behaviors. 

This type of research question can be administered physically through one-on-one interviews, naturalism (live and work), and participant observation methods. Alternatively, the researcher can ask ethnographic research questions via online surveys and questionnaires created with Formplus.  

Examples of Ethnographic Research Questions

• Why do you use this product?
• Have you noticed any side effects since you started using this drug?
• Does this product meet your needs?

• Case Studies

A case study is a qualitative research approach that involves carrying out a detailed investigation into a research subject(s) or variable(s). In the course of a case study, the researcher gathers a range of data from multiple sources of information via different data collection methods, and over a period of time. 

The aim of a case study is to analyze specific issues within definite contexts and arrive at detailed research subject analyses by asking the right questions. This research method can be explanatory, descriptive , or exploratory depending on the focus of your systematic investigation or research. 

An explanatory case study is one that seeks to gather information on the causes of real-life occurrences. This type of case study uses “how” and “why” questions in order to gather valid information about the causative factors of an event. 

Descriptive case studies are typically used in business researches, and they aim at analyzing the impact of changing market dynamics on businesses. On the other hand, exploratory case studies aim at providing answers to “who” and “what” questions using data collection tools like interviews and questionnaires. 

Some questions you can include in your case studies are: 

• Why did you choose our services?
• How has this policy affected your business output?
• What benefits have you recorded since you started using our product?

An interview is a qualitative research method that involves asking respondents a series of questions in order to gather information about a research subject. Interview questions can be close-ended or open-ended , and they prompt participants to provide valid information that is useful to the research. 

An interview may also be structured, semi-structured , or unstructured , and this further influences the types of questions they include. Structured interviews are made up of more close-ended questions because they aim at gathering quantitative data while unstructured interviews consist, primarily, of open-ended questions that allow the researcher to collect qualitative information from respondents. 

You can conduct interview research by scheduling a physical meeting with respondents, through a telephone conversation, and via digital media and video conferencing platforms like Skype and Zoom. Alternatively, you can use Formplus surveys and questionnaires for your interview. 

Examples of interview questions include: 

• What challenges did you face while using our product?
• What specific needs did our product meet?
• What would you like us to improve our service delivery?

Quantitative Research Questions

Quantitative research questions are questions that are used to gather quantifiable data from research subjects. These types of research questions are usually more specific and direct because they aim at collecting information that can be measured; that is, statistical information. 

Types of Quantitative Research Questions

• Descriptive Research Questions

Descriptive research questions are inquiries that researchers use to gather quantifiable data about the attributes and characteristics of research subjects. These types of questions primarily seek responses that reveal existing patterns in the nature of the research subjects. 

It is important to note that descriptive research questions are not concerned with the causative factors of the discovered attributes and characteristics. Rather, they focus on the “what”; that is, describing the subject of the research without paying attention to the reasons for its occurrence. 

Descriptive research questions are typically closed-ended because they aim at gathering definite and specific responses from research participants. Also, they can be used in customer experience surveys and market research to collect information about target markets and consumer behaviors. 

Descriptive Research Question Examples

• How often do you make use of our fitness application?
• How much would you be willing to pay for this product?

• Comparative Research Questions

A comparative research question is a type of quantitative research question that is used to gather information about the differences between two or more research subjects across different variables. These types of questions help the researcher to identify distinct features that mark one research subject from the other while highlighting existing similarities. 

Asking comparative research questions in market research surveys can provide insights on how your product or service matches its competitors. In addition, it can help you to identify the strengths and weaknesses of your product for a better competitive advantage.  

The 5 steps involved in the framing of comparative research questions are: 

• Choose your starting phrase
• Identify and name the dependent variable
• Identify the groups you are interested in
• Identify the appropriate adjoining text
• Write out the comparative research question

Comparative Research Question Samples 

• What are the differences between a landline telephone and a smartphone?
• What are the differences between work-from-home and on-site operations?

• Relationship-based Research Questions  

Just like the name suggests, a relationship-based research question is one that inquires into the nature of the association between two research subjects within the same demographic. These types of research questions help you to gather information pertaining to the nature of the association between two research variables. 

Relationship-based research questions are also known as correlational research questions because they seek to clearly identify the link between 2 variables. 

Read: Correlational Research Designs: Types, Examples & Methods

Examples of relationship-based research questions include: 

• What is the relationship between purchasing power and the business site?
• What is the relationship between the work environment and workforce turnover?

Examples of a Good Research Question

Since research questions lie at the core of any systematic investigations, it is important to know how to frame a good research question. The right research questions will help you to gather the most objective responses that are useful to your systematic investigation. 

A good research question is one that requires impartial responses and can be answered via existing sources of information. Also, a good research question seeks answers that actively contribute to a body of knowledge; hence, it is a question that is yet to be answered in your specific research context.

• Open-Ended Questions

 An open-ended question is a type of research question that does not restrict respondents to a set of premeditated answer options. In other words, it is a question that allows the respondent to freely express his or her perceptions and feelings towards the research subject. 

Examples of Open-ended Questions

• How do you deal with stress in the workplace?
• What is a typical day at work like for you?
• Close-ended Questions

A close-ended question is a type of survey question that restricts respondents to a set of predetermined answers such as multiple-choice questions . Close-ended questions typically require yes or no answers and are commonly used in quantitative research to gather numerical data from research participants. 

Examples of Close-ended Questions

• Did you enjoy this event?
• How likely are you to recommend our services?
• Very Likely
• Somewhat Likely
• Likert Scale Questions

A Likert scale question is a type of close-ended question that is structured as a 3-point, 5-point, or 7-point psychometric scale . This type of question is used to measure the survey respondent’s disposition towards multiple variables and it can be unipolar or bipolar in nature. 

Example of Likert Scale Questions

• How satisfied are you with our service delivery?
• Very dissatisfied
• Not satisfied
• Very satisfied
• Rating Scale Questions

A rating scale question is a type of close-ended question that seeks to associate a specific qualitative measure (rating) with the different variables in research. It is commonly used in customer experience surveys, market research surveys, employee reviews, and product evaluations. 

Example of Rating Questions

• How would you rate our service delivery?

  Examples of a Bad Research Question

Knowing what bad research questions are would help you avoid them in the course of your systematic investigation. These types of questions are usually unfocused and often result in research biases that can negatively impact the outcomes of your systematic investigation. 

• Loaded Questions

A loaded question is a question that subtly presupposes one or more unverified assumptions about the research subject or participant. This type of question typically boxes the respondent in a corner because it suggests implicit and explicit biases that prevent objective responses. 

Example of Loaded Questions

• Have you stopped smoking?
• Where did you hide the money?
• Negative Questions

A negative question is a type of question that is structured with an implicit or explicit negator. Negative questions can be misleading because they upturn the typical yes/no response order by requiring a negative answer for affirmation and an affirmative answer for negation. 

Examples of Negative Questions

• Would you mind dropping by my office later today?
• Didn’t you visit last week?
• Leading Questions  

A l eading question is a type of survey question that nudges the respondent towards an already-determined answer. It is highly suggestive in nature and typically consists of biases and unverified assumptions that point toward its premeditated responses. 

Examples of Leading Questions

• If you enjoyed this service, would you be willing to try out our other packages?
• Our product met your needs, didn’t it?

Read More: Leading Questions: Definition, Types, and Examples

How to Use Formplus as Online Research Questionnaire Tool  

With Formplus, you can create and administer your online research questionnaire easily. In the form builder, you can add different form fields to your questionnaire and edit these fields to reflect specific research questions for your systematic investigation. 

Here is a step-by-step guide on how to create an online research questionnaire with Formplus: 

• Sign in to your Formplus accoun t, then click on the “create new form” button in your dashboard to access the Form builder.

• In the form builder, add preferred form fields to your online research questionnaire by dragging and dropping them into the form. Add a title to your form in the title block. You can edit form fields by clicking on the “pencil” icon on the right corner of each form field.

• Save the form to access the customization section of the builder. Here, you can tweak the appearance of your online research questionnaire by adding background images, changing the form font, and adding your organization’s logo.

• Finally, copy your form link and share it with respondents. You can also use any of the multiple sharing options available.

Conclusion  

The success of your research starts with framing the right questions to help you collect the most valid and objective responses. Be sure to avoid bad research questions like loaded and negative questions that can be misleading and adversely affect your research data and outcomes. 

Your research questions should clearly reflect the aims and objectives of your systematic investigation while laying emphasis on specific contexts. To help you seamlessly gather responses for your research questions, you can create an online research questionnaire on Formplus.  

Connect to Formplus, Get Started Now - It's Free!

• abstract in research papers
• bad research questions
• examples of research questions
• types of research questions
• busayo.longe

You may also like:

How to Write a Problem Statement for your Research

Learn how to write problem statements before commencing any research effort. Learn about its structure and explore examples

How to do a Meta Analysis: Methodology, Pros & Cons

In this article, we’ll go through the concept of meta-analysis, what it can be used for, and how you can use it to improve how you...

How to Write An Abstract For Research Papers: Tips & Examples

In this article, we will share some tips for writing an effective abstract, plus samples you can learn from.

Research Summary: What Is It & How To Write One

Introduction A research summary is a requirement during academic research and sometimes you might need to prepare a research summary...

Formplus - For Seamless Data Collection

Collect data the right way with a versatile data collection tool. try formplus and transform your work productivity today..