the critical thinking standard of relevance means your information is

Critical Thinking and Evaluating Information

• Introduction
• Words Of Wisdom

What Is Critical Thinking?

Five simple strategies to sharpen your critical thinking, were critical thinking skills used in this video.

• Critical Thinking and Reflective Judgement
• Problem Solving Skills
• Critical Reading
• Critical Writing
• Use the CRAAP Test
• Evaluating Fake News
• Explore Different Viewpoints
• The Peer-Review Process
• Critical ThinkingTutorials
• Books on Critical Thinking
• Explore More With These Links

Live Chat with a Librarian 24/7

Text a Librarian at 912-600-2782

Critical thinking is a complex process of deliberation that involves a wide range of skills and attitudes. It includes:

• identifying other people's positions,  arguments and conclusions 
• evaluating the evidence  for alternative points of view
• weighing up the opposing arguments  and evidence fairly
• being able to read between the lines,  seeing behind surfaces and identifying false or unfair assumptions
• recognizing techniques  used to make certain positions more appealing than others, such as false logic and persuasive devices
• reflecting on issues  in a structured way, bringing logic and insight to bear
• drawing conclusions  about whether arguments are valid and justifiable, based on good evidence and sensible assumptions
• presenting a point of view  in a structured, clear, well-reasoned way that convinces others

(Contrell, 2011)

Check Out More From This Source: 

A well-cultivated critical thinker:

• raises vital questions and problems, formulating them clearly and precisely;
• gathers and assesses relevant information, using abstract ideas to interpret it effectively  come to well-reasoned conclusions and solutions, testing them against relevant criteria and standards;
• thinks openmindedly within alternative systems of thought, recognizing and assessing, as need be, their assumptions, implications, and practical consequences; and
• communicates effectively with others in figuring out solutions to complex problems.

Critical thinking is, in short, self-directed, self-disciplined, self-monitored, and self-corrective thinking. It presupposes assent to rigorous standards of excellence and mindful command of their use. It entails effective communication and problem solving abilities and a commitment to overcome our native egocentrism and sociocentrism.  

(Taken from Richard Paul and Linda Elder,  The Miniature Guide to Critical Thinking Concepts and Tools,  Foundation for Critical Thinking Press, 2008)

Source: criticalthinking.org

Is the sky really blue? That might seem obvious. But sometimes things are more nuanced and complicated than you think. Here are five strategies to boost your critical thinking skills. Animated by Ana Stefaniak. Made in partnership with The Open University.

Video Source: BBC Ideas

Video Source: Dr. Bachyrycz

• << Previous: Introduction
• Next: Critical Thinking and Reflective Judgement >>
• Last Updated: Mar 25, 2024 8:18 AM
• URL: https://libguides.coastalpines.edu/thinkcritically

• Table of Contents
• Random Entry
• Chronological
• Editorial Information
• About the SEP
• Editorial Board
• How to Cite the SEP
• Special Characters
• Advanced Tools
• Support the SEP
• PDFs for SEP Friends
• Make a Donation
• SEPIA for Libraries
• Entry Contents

Bibliography

Academic tools.

• Friends PDF Preview
• Author and Citation Info
• Back to Top

Critical Thinking

Critical thinking is a widely accepted educational goal. Its definition is contested, but the competing definitions can be understood as differing conceptions of the same basic concept: careful thinking directed to a goal. Conceptions differ with respect to the scope of such thinking, the type of goal, the criteria and norms for thinking carefully, and the thinking components on which they focus. Its adoption as an educational goal has been recommended on the basis of respect for students’ autonomy and preparing students for success in life and for democratic citizenship. “Critical thinkers” have the dispositions and abilities that lead them to think critically when appropriate. The abilities can be identified directly; the dispositions indirectly, by considering what factors contribute to or impede exercise of the abilities. Standardized tests have been developed to assess the degree to which a person possesses such dispositions and abilities. Educational intervention has been shown experimentally to improve them, particularly when it includes dialogue, anchored instruction, and mentoring. Controversies have arisen over the generalizability of critical thinking across domains, over alleged bias in critical thinking theories and instruction, and over the relationship of critical thinking to other types of thinking.

2.1 Dewey’s Three Main Examples

2.2 dewey’s other examples, 2.3 further examples, 2.4 non-examples, 3. the definition of critical thinking, 4. its value, 5. the process of thinking critically, 6. components of the process, 7. contributory dispositions and abilities, 8.1 initiating dispositions, 8.2 internal dispositions, 9. critical thinking abilities, 10. required knowledge, 11. educational methods, 12.1 the generalizability of critical thinking, 12.2 bias in critical thinking theory and pedagogy, 12.3 relationship of critical thinking to other types of thinking, other internet resources, related entries.

Use of the term ‘critical thinking’ to describe an educational goal goes back to the American philosopher John Dewey (1910), who more commonly called it ‘reflective thinking’. He defined it as

active, persistent and careful consideration of any belief or supposed form of knowledge in the light of the grounds that support it, and the further conclusions to which it tends. (Dewey 1910: 6; 1933: 9)

and identified a habit of such consideration with a scientific attitude of mind. His lengthy quotations of Francis Bacon, John Locke, and John Stuart Mill indicate that he was not the first person to propose development of a scientific attitude of mind as an educational goal.

In the 1930s, many of the schools that participated in the Eight-Year Study of the Progressive Education Association (Aikin 1942) adopted critical thinking as an educational goal, for whose achievement the study’s Evaluation Staff developed tests (Smith, Tyler, & Evaluation Staff 1942). Glaser (1941) showed experimentally that it was possible to improve the critical thinking of high school students. Bloom’s influential taxonomy of cognitive educational objectives (Bloom et al. 1956) incorporated critical thinking abilities. Ennis (1962) proposed 12 aspects of critical thinking as a basis for research on the teaching and evaluation of critical thinking ability.

Since 1980, an annual international conference in California on critical thinking and educational reform has attracted tens of thousands of educators from all levels of education and from many parts of the world. Also since 1980, the state university system in California has required all undergraduate students to take a critical thinking course. Since 1983, the Association for Informal Logic and Critical Thinking has sponsored sessions in conjunction with the divisional meetings of the American Philosophical Association (APA). In 1987, the APA’s Committee on Pre-College Philosophy commissioned a consensus statement on critical thinking for purposes of educational assessment and instruction (Facione 1990a). Researchers have developed standardized tests of critical thinking abilities and dispositions; for details, see the Supplement on Assessment . Educational jurisdictions around the world now include critical thinking in guidelines for curriculum and assessment.

For details on this history, see the Supplement on History .

2. Examples and Non-Examples

Before considering the definition of critical thinking, it will be helpful to have in mind some examples of critical thinking, as well as some examples of kinds of thinking that would apparently not count as critical thinking.

Dewey (1910: 68–71; 1933: 91–94) takes as paradigms of reflective thinking three class papers of students in which they describe their thinking. The examples range from the everyday to the scientific.

Transit : “The other day, when I was down town on 16th Street, a clock caught my eye. I saw that the hands pointed to 12:20. This suggested that I had an engagement at 124th Street, at one o’clock. I reasoned that as it had taken me an hour to come down on a surface car, I should probably be twenty minutes late if I returned the same way. I might save twenty minutes by a subway express. But was there a station near? If not, I might lose more than twenty minutes in looking for one. Then I thought of the elevated, and I saw there was such a line within two blocks. But where was the station? If it were several blocks above or below the street I was on, I should lose time instead of gaining it. My mind went back to the subway express as quicker than the elevated; furthermore, I remembered that it went nearer than the elevated to the part of 124th Street I wished to reach, so that time would be saved at the end of the journey. I concluded in favor of the subway, and reached my destination by one o’clock.” (Dewey 1910: 68–69; 1933: 91–92)

Ferryboat : “Projecting nearly horizontally from the upper deck of the ferryboat on which I daily cross the river is a long white pole, having a gilded ball at its tip. It suggested a flagpole when I first saw it; its color, shape, and gilded ball agreed with this idea, and these reasons seemed to justify me in this belief. But soon difficulties presented themselves. The pole was nearly horizontal, an unusual position for a flagpole; in the next place, there was no pulley, ring, or cord by which to attach a flag; finally, there were elsewhere on the boat two vertical staffs from which flags were occasionally flown. It seemed probable that the pole was not there for flag-flying.

“I then tried to imagine all possible purposes of the pole, and to consider for which of these it was best suited: (a) Possibly it was an ornament. But as all the ferryboats and even the tugboats carried poles, this hypothesis was rejected. (b) Possibly it was the terminal of a wireless telegraph. But the same considerations made this improbable. Besides, the more natural place for such a terminal would be the highest part of the boat, on top of the pilot house. (c) Its purpose might be to point out the direction in which the boat is moving.

“In support of this conclusion, I discovered that the pole was lower than the pilot house, so that the steersman could easily see it. Moreover, the tip was enough higher than the base, so that, from the pilot’s position, it must appear to project far out in front of the boat. Moreover, the pilot being near the front of the boat, he would need some such guide as to its direction. Tugboats would also need poles for such a purpose. This hypothesis was so much more probable than the others that I accepted it. I formed the conclusion that the pole was set up for the purpose of showing the pilot the direction in which the boat pointed, to enable him to steer correctly.” (Dewey 1910: 69–70; 1933: 92–93)

Bubbles : “In washing tumblers in hot soapsuds and placing them mouth downward on a plate, bubbles appeared on the outside of the mouth of the tumblers and then went inside. Why? The presence of bubbles suggests air, which I note must come from inside the tumbler. I see that the soapy water on the plate prevents escape of the air save as it may be caught in bubbles. But why should air leave the tumbler? There was no substance entering to force it out. It must have expanded. It expands by increase of heat, or by decrease of pressure, or both. Could the air have become heated after the tumbler was taken from the hot suds? Clearly not the air that was already entangled in the water. If heated air was the cause, cold air must have entered in transferring the tumblers from the suds to the plate. I test to see if this supposition is true by taking several more tumblers out. Some I shake so as to make sure of entrapping cold air in them. Some I take out holding mouth downward in order to prevent cold air from entering. Bubbles appear on the outside of every one of the former and on none of the latter. I must be right in my inference. Air from the outside must have been expanded by the heat of the tumbler, which explains the appearance of the bubbles on the outside. But why do they then go inside? Cold contracts. The tumbler cooled and also the air inside it. Tension was removed, and hence bubbles appeared inside. To be sure of this, I test by placing a cup of ice on the tumbler while the bubbles are still forming outside. They soon reverse” (Dewey 1910: 70–71; 1933: 93–94).

Dewey (1910, 1933) sprinkles his book with other examples of critical thinking. We will refer to the following.

Weather : A man on a walk notices that it has suddenly become cool, thinks that it is probably going to rain, looks up and sees a dark cloud obscuring the sun, and quickens his steps (1910: 6–10; 1933: 9–13).

Disorder : A man finds his rooms on his return to them in disorder with his belongings thrown about, thinks at first of burglary as an explanation, then thinks of mischievous children as being an alternative explanation, then looks to see whether valuables are missing, and discovers that they are (1910: 82–83; 1933: 166–168).

Typhoid : A physician diagnosing a patient whose conspicuous symptoms suggest typhoid avoids drawing a conclusion until more data are gathered by questioning the patient and by making tests (1910: 85–86; 1933: 170).

Blur : A moving blur catches our eye in the distance, we ask ourselves whether it is a cloud of whirling dust or a tree moving its branches or a man signaling to us, we think of other traits that should be found on each of those possibilities, and we look and see if those traits are found (1910: 102, 108; 1933: 121, 133).

Suction pump : In thinking about the suction pump, the scientist first notes that it will draw water only to a maximum height of 33 feet at sea level and to a lesser maximum height at higher elevations, selects for attention the differing atmospheric pressure at these elevations, sets up experiments in which the air is removed from a vessel containing water (when suction no longer works) and in which the weight of air at various levels is calculated, compares the results of reasoning about the height to which a given weight of air will allow a suction pump to raise water with the observed maximum height at different elevations, and finally assimilates the suction pump to such apparently different phenomena as the siphon and the rising of a balloon (1910: 150–153; 1933: 195–198).

Diamond : A passenger in a car driving in a diamond lane reserved for vehicles with at least one passenger notices that the diamond marks on the pavement are far apart in some places and close together in others. Why? The driver suggests that the reason may be that the diamond marks are not needed where there is a solid double line separating the diamond lane from the adjoining lane, but are needed when there is a dotted single line permitting crossing into the diamond lane. Further observation confirms that the diamonds are close together when a dotted line separates the diamond lane from its neighbour, but otherwise far apart.

Rash : A woman suddenly develops a very itchy red rash on her throat and upper chest. She recently noticed a mark on the back of her right hand, but was not sure whether the mark was a rash or a scrape. She lies down in bed and thinks about what might be causing the rash and what to do about it. About two weeks before, she began taking blood pressure medication that contained a sulfa drug, and the pharmacist had warned her, in view of a previous allergic reaction to a medication containing a sulfa drug, to be on the alert for an allergic reaction; however, she had been taking the medication for two weeks with no such effect. The day before, she began using a new cream on her neck and upper chest; against the new cream as the cause was mark on the back of her hand, which had not been exposed to the cream. She began taking probiotics about a month before. She also recently started new eye drops, but she supposed that manufacturers of eye drops would be careful not to include allergy-causing components in the medication. The rash might be a heat rash, since she recently was sweating profusely from her upper body. Since she is about to go away on a short vacation, where she would not have access to her usual physician, she decides to keep taking the probiotics and using the new eye drops but to discontinue the blood pressure medication and to switch back to the old cream for her neck and upper chest. She forms a plan to consult her regular physician on her return about the blood pressure medication.

Candidate : Although Dewey included no examples of thinking directed at appraising the arguments of others, such thinking has come to be considered a kind of critical thinking. We find an example of such thinking in the performance task on the Collegiate Learning Assessment (CLA+), which its sponsoring organization describes as

a performance-based assessment that provides a measure of an institution’s contribution to the development of critical-thinking and written communication skills of its students. (Council for Aid to Education 2017)

A sample task posted on its website requires the test-taker to write a report for public distribution evaluating a fictional candidate’s policy proposals and their supporting arguments, using supplied background documents, with a recommendation on whether to endorse the candidate.

Immediate acceptance of an idea that suggests itself as a solution to a problem (e.g., a possible explanation of an event or phenomenon, an action that seems likely to produce a desired result) is “uncritical thinking, the minimum of reflection” (Dewey 1910: 13). On-going suspension of judgment in the light of doubt about a possible solution is not critical thinking (Dewey 1910: 108). Critique driven by a dogmatically held political or religious ideology is not critical thinking; thus Paulo Freire (1968 [1970]) is using the term (e.g., at 1970: 71, 81, 100, 146) in a more politically freighted sense that includes not only reflection but also revolutionary action against oppression. Derivation of a conclusion from given data using an algorithm is not critical thinking.

What is critical thinking? There are many definitions. Ennis (2016) lists 14 philosophically oriented scholarly definitions and three dictionary definitions. Following Rawls (1971), who distinguished his conception of justice from a utilitarian conception but regarded them as rival conceptions of the same concept, Ennis maintains that the 17 definitions are different conceptions of the same concept. Rawls articulated the shared concept of justice as

a characteristic set of principles for assigning basic rights and duties and for determining… the proper distribution of the benefits and burdens of social cooperation. (Rawls 1971: 5)

Bailin et al. (1999b) claim that, if one considers what sorts of thinking an educator would take not to be critical thinking and what sorts to be critical thinking, one can conclude that educators typically understand critical thinking to have at least three features.

• It is done for the purpose of making up one’s mind about what to believe or do.
• The person engaging in the thinking is trying to fulfill standards of adequacy and accuracy appropriate to the thinking.
• The thinking fulfills the relevant standards to some threshold level.

One could sum up the core concept that involves these three features by saying that critical thinking is careful goal-directed thinking. This core concept seems to apply to all the examples of critical thinking described in the previous section. As for the non-examples, their exclusion depends on construing careful thinking as excluding jumping immediately to conclusions, suspending judgment no matter how strong the evidence, reasoning from an unquestioned ideological or religious perspective, and routinely using an algorithm to answer a question.

If the core of critical thinking is careful goal-directed thinking, conceptions of it can vary according to its presumed scope, its presumed goal, one’s criteria and threshold for being careful, and the thinking component on which one focuses. As to its scope, some conceptions (e.g., Dewey 1910, 1933) restrict it to constructive thinking on the basis of one’s own observations and experiments, others (e.g., Ennis 1962; Fisher & Scriven 1997; Johnson 1992) to appraisal of the products of such thinking. Ennis (1991) and Bailin et al. (1999b) take it to cover both construction and appraisal. As to its goal, some conceptions restrict it to forming a judgment (Dewey 1910, 1933; Lipman 1987; Facione 1990a). Others allow for actions as well as beliefs as the end point of a process of critical thinking (Ennis 1991; Bailin et al. 1999b). As to the criteria and threshold for being careful, definitions vary in the term used to indicate that critical thinking satisfies certain norms: “intellectually disciplined” (Scriven & Paul 1987), “reasonable” (Ennis 1991), “skillful” (Lipman 1987), “skilled” (Fisher & Scriven 1997), “careful” (Bailin & Battersby 2009). Some definitions specify these norms, referring variously to “consideration of any belief or supposed form of knowledge in the light of the grounds that support it and the further conclusions to which it tends” (Dewey 1910, 1933); “the methods of logical inquiry and reasoning” (Glaser 1941); “conceptualizing, applying, analyzing, synthesizing, and/or evaluating information gathered from, or generated by, observation, experience, reflection, reasoning, or communication” (Scriven & Paul 1987); the requirement that “it is sensitive to context, relies on criteria, and is self-correcting” (Lipman 1987); “evidential, conceptual, methodological, criteriological, or contextual considerations” (Facione 1990a); and “plus-minus considerations of the product in terms of appropriate standards (or criteria)” (Johnson 1992). Stanovich and Stanovich (2010) propose to ground the concept of critical thinking in the concept of rationality, which they understand as combining epistemic rationality (fitting one’s beliefs to the world) and instrumental rationality (optimizing goal fulfillment); a critical thinker, in their view, is someone with “a propensity to override suboptimal responses from the autonomous mind” (2010: 227). These variant specifications of norms for critical thinking are not necessarily incompatible with one another, and in any case presuppose the core notion of thinking carefully. As to the thinking component singled out, some definitions focus on suspension of judgment during the thinking (Dewey 1910; McPeck 1981), others on inquiry while judgment is suspended (Bailin & Battersby 2009, 2021), others on the resulting judgment (Facione 1990a), and still others on responsiveness to reasons (Siegel 1988). Kuhn (2019) takes critical thinking to be more a dialogic practice of advancing and responding to arguments than an individual ability.

In educational contexts, a definition of critical thinking is a “programmatic definition” (Scheffler 1960: 19). It expresses a practical program for achieving an educational goal. For this purpose, a one-sentence formulaic definition is much less useful than articulation of a critical thinking process, with criteria and standards for the kinds of thinking that the process may involve. The real educational goal is recognition, adoption and implementation by students of those criteria and standards. That adoption and implementation in turn consists in acquiring the knowledge, abilities and dispositions of a critical thinker.

Conceptions of critical thinking generally do not include moral integrity as part of the concept. Dewey, for example, took critical thinking to be the ultimate intellectual goal of education, but distinguished it from the development of social cooperation among school children, which he took to be the central moral goal. Ennis (1996, 2011) added to his previous list of critical thinking dispositions a group of dispositions to care about the dignity and worth of every person, which he described as a “correlative” (1996) disposition without which critical thinking would be less valuable and perhaps harmful. An educational program that aimed at developing critical thinking but not the correlative disposition to care about the dignity and worth of every person, he asserted, “would be deficient and perhaps dangerous” (Ennis 1996: 172).

Dewey thought that education for reflective thinking would be of value to both the individual and society; recognition in educational practice of the kinship to the scientific attitude of children’s native curiosity, fertile imagination and love of experimental inquiry “would make for individual happiness and the reduction of social waste” (Dewey 1910: iii). Schools participating in the Eight-Year Study took development of the habit of reflective thinking and skill in solving problems as a means to leading young people to understand, appreciate and live the democratic way of life characteristic of the United States (Aikin 1942: 17–18, 81). Harvey Siegel (1988: 55–61) has offered four considerations in support of adopting critical thinking as an educational ideal. (1) Respect for persons requires that schools and teachers honour students’ demands for reasons and explanations, deal with students honestly, and recognize the need to confront students’ independent judgment; these requirements concern the manner in which teachers treat students. (2) Education has the task of preparing children to be successful adults, a task that requires development of their self-sufficiency. (3) Education should initiate children into the rational traditions in such fields as history, science and mathematics. (4) Education should prepare children to become democratic citizens, which requires reasoned procedures and critical talents and attitudes. To supplement these considerations, Siegel (1988: 62–90) responds to two objections: the ideology objection that adoption of any educational ideal requires a prior ideological commitment and the indoctrination objection that cultivation of critical thinking cannot escape being a form of indoctrination.

Despite the diversity of our 11 examples, one can recognize a common pattern. Dewey analyzed it as consisting of five phases:

• suggestions , in which the mind leaps forward to a possible solution;
• an intellectualization of the difficulty or perplexity into a problem to be solved, a question for which the answer must be sought;
• the use of one suggestion after another as a leading idea, or hypothesis , to initiate and guide observation and other operations in collection of factual material;
• the mental elaboration of the idea or supposition as an idea or supposition ( reasoning , in the sense on which reasoning is a part, not the whole, of inference); and
• testing the hypothesis by overt or imaginative action. (Dewey 1933: 106–107; italics in original)

The process of reflective thinking consisting of these phases would be preceded by a perplexed, troubled or confused situation and followed by a cleared-up, unified, resolved situation (Dewey 1933: 106). The term ‘phases’ replaced the term ‘steps’ (Dewey 1910: 72), thus removing the earlier suggestion of an invariant sequence. Variants of the above analysis appeared in (Dewey 1916: 177) and (Dewey 1938: 101–119).

The variant formulations indicate the difficulty of giving a single logical analysis of such a varied process. The process of critical thinking may have a spiral pattern, with the problem being redefined in the light of obstacles to solving it as originally formulated. For example, the person in Transit might have concluded that getting to the appointment at the scheduled time was impossible and have reformulated the problem as that of rescheduling the appointment for a mutually convenient time. Further, defining a problem does not always follow after or lead immediately to an idea of a suggested solution. Nor should it do so, as Dewey himself recognized in describing the physician in Typhoid as avoiding any strong preference for this or that conclusion before getting further information (Dewey 1910: 85; 1933: 170). People with a hypothesis in mind, even one to which they have a very weak commitment, have a so-called “confirmation bias” (Nickerson 1998): they are likely to pay attention to evidence that confirms the hypothesis and to ignore evidence that counts against it or for some competing hypothesis. Detectives, intelligence agencies, and investigators of airplane accidents are well advised to gather relevant evidence systematically and to postpone even tentative adoption of an explanatory hypothesis until the collected evidence rules out with the appropriate degree of certainty all but one explanation. Dewey’s analysis of the critical thinking process can be faulted as well for requiring acceptance or rejection of a possible solution to a defined problem, with no allowance for deciding in the light of the available evidence to suspend judgment. Further, given the great variety of kinds of problems for which reflection is appropriate, there is likely to be variation in its component events. Perhaps the best way to conceptualize the critical thinking process is as a checklist whose component events can occur in a variety of orders, selectively, and more than once. These component events might include (1) noticing a difficulty, (2) defining the problem, (3) dividing the problem into manageable sub-problems, (4) formulating a variety of possible solutions to the problem or sub-problem, (5) determining what evidence is relevant to deciding among possible solutions to the problem or sub-problem, (6) devising a plan of systematic observation or experiment that will uncover the relevant evidence, (7) carrying out the plan of systematic observation or experimentation, (8) noting the results of the systematic observation or experiment, (9) gathering relevant testimony and information from others, (10) judging the credibility of testimony and information gathered from others, (11) drawing conclusions from gathered evidence and accepted testimony, and (12) accepting a solution that the evidence adequately supports (cf. Hitchcock 2017: 485).

Checklist conceptions of the process of critical thinking are open to the objection that they are too mechanical and procedural to fit the multi-dimensional and emotionally charged issues for which critical thinking is urgently needed (Paul 1984). For such issues, a more dialectical process is advocated, in which competing relevant world views are identified, their implications explored, and some sort of creative synthesis attempted.

If one considers the critical thinking process illustrated by the 11 examples, one can identify distinct kinds of mental acts and mental states that form part of it. To distinguish, label and briefly characterize these components is a useful preliminary to identifying abilities, skills, dispositions, attitudes, habits and the like that contribute causally to thinking critically. Identifying such abilities and habits is in turn a useful preliminary to setting educational goals. Setting the goals is in its turn a useful preliminary to designing strategies for helping learners to achieve the goals and to designing ways of measuring the extent to which learners have done so. Such measures provide both feedback to learners on their achievement and a basis for experimental research on the effectiveness of various strategies for educating people to think critically. Let us begin, then, by distinguishing the kinds of mental acts and mental events that can occur in a critical thinking process.

• Observing : One notices something in one’s immediate environment (sudden cooling of temperature in Weather , bubbles forming outside a glass and then going inside in Bubbles , a moving blur in the distance in Blur , a rash in Rash ). Or one notes the results of an experiment or systematic observation (valuables missing in Disorder , no suction without air pressure in Suction pump )
• Feeling : One feels puzzled or uncertain about something (how to get to an appointment on time in Transit , why the diamonds vary in spacing in Diamond ). One wants to resolve this perplexity. One feels satisfaction once one has worked out an answer (to take the subway express in Transit , diamonds closer when needed as a warning in Diamond ).
• Wondering : One formulates a question to be addressed (why bubbles form outside a tumbler taken from hot water in Bubbles , how suction pumps work in Suction pump , what caused the rash in Rash ).
• Imagining : One thinks of possible answers (bus or subway or elevated in Transit , flagpole or ornament or wireless communication aid or direction indicator in Ferryboat , allergic reaction or heat rash in Rash ).
• Inferring : One works out what would be the case if a possible answer were assumed (valuables missing if there has been a burglary in Disorder , earlier start to the rash if it is an allergic reaction to a sulfa drug in Rash ). Or one draws a conclusion once sufficient relevant evidence is gathered (take the subway in Transit , burglary in Disorder , discontinue blood pressure medication and new cream in Rash ).
• Knowledge : One uses stored knowledge of the subject-matter to generate possible answers or to infer what would be expected on the assumption of a particular answer (knowledge of a city’s public transit system in Transit , of the requirements for a flagpole in Ferryboat , of Boyle’s law in Bubbles , of allergic reactions in Rash ).
• Experimenting : One designs and carries out an experiment or a systematic observation to find out whether the results deduced from a possible answer will occur (looking at the location of the flagpole in relation to the pilot’s position in Ferryboat , putting an ice cube on top of a tumbler taken from hot water in Bubbles , measuring the height to which a suction pump will draw water at different elevations in Suction pump , noticing the spacing of diamonds when movement to or from a diamond lane is allowed in Diamond ).
• Consulting : One finds a source of information, gets the information from the source, and makes a judgment on whether to accept it. None of our 11 examples include searching for sources of information. In this respect they are unrepresentative, since most people nowadays have almost instant access to information relevant to answering any question, including many of those illustrated by the examples. However, Candidate includes the activities of extracting information from sources and evaluating its credibility.
• Identifying and analyzing arguments : One notices an argument and works out its structure and content as a preliminary to evaluating its strength. This activity is central to Candidate . It is an important part of a critical thinking process in which one surveys arguments for various positions on an issue.
• Judging : One makes a judgment on the basis of accumulated evidence and reasoning, such as the judgment in Ferryboat that the purpose of the pole is to provide direction to the pilot.
• Deciding : One makes a decision on what to do or on what policy to adopt, as in the decision in Transit to take the subway.

By definition, a person who does something voluntarily is both willing and able to do that thing at that time. Both the willingness and the ability contribute causally to the person’s action, in the sense that the voluntary action would not occur if either (or both) of these were lacking. For example, suppose that one is standing with one’s arms at one’s sides and one voluntarily lifts one’s right arm to an extended horizontal position. One would not do so if one were unable to lift one’s arm, if for example one’s right side was paralyzed as the result of a stroke. Nor would one do so if one were unwilling to lift one’s arm, if for example one were participating in a street demonstration at which a white supremacist was urging the crowd to lift their right arm in a Nazi salute and one were unwilling to express support in this way for the racist Nazi ideology. The same analysis applies to a voluntary mental process of thinking critically. It requires both willingness and ability to think critically, including willingness and ability to perform each of the mental acts that compose the process and to coordinate those acts in a sequence that is directed at resolving the initiating perplexity.

Consider willingness first. We can identify causal contributors to willingness to think critically by considering factors that would cause a person who was able to think critically about an issue nevertheless not to do so (Hamby 2014). For each factor, the opposite condition thus contributes causally to willingness to think critically on a particular occasion. For example, people who habitually jump to conclusions without considering alternatives will not think critically about issues that arise, even if they have the required abilities. The contrary condition of willingness to suspend judgment is thus a causal contributor to thinking critically.

Now consider ability. In contrast to the ability to move one’s arm, which can be completely absent because a stroke has left the arm paralyzed, the ability to think critically is a developed ability, whose absence is not a complete absence of ability to think but absence of ability to think well. We can identify the ability to think well directly, in terms of the norms and standards for good thinking. In general, to be able do well the thinking activities that can be components of a critical thinking process, one needs to know the concepts and principles that characterize their good performance, to recognize in particular cases that the concepts and principles apply, and to apply them. The knowledge, recognition and application may be procedural rather than declarative. It may be domain-specific rather than widely applicable, and in either case may need subject-matter knowledge, sometimes of a deep kind.

Reflections of the sort illustrated by the previous two paragraphs have led scholars to identify the knowledge, abilities and dispositions of a “critical thinker”, i.e., someone who thinks critically whenever it is appropriate to do so. We turn now to these three types of causal contributors to thinking critically. We start with dispositions, since arguably these are the most powerful contributors to being a critical thinker, can be fostered at an early stage of a child’s development, and are susceptible to general improvement (Glaser 1941: 175)

8. Critical Thinking Dispositions

Educational researchers use the term ‘dispositions’ broadly for the habits of mind and attitudes that contribute causally to being a critical thinker. Some writers (e.g., Paul & Elder 2006; Hamby 2014; Bailin & Battersby 2016a) propose to use the term ‘virtues’ for this dimension of a critical thinker. The virtues in question, although they are virtues of character, concern the person’s ways of thinking rather than the person’s ways of behaving towards others. They are not moral virtues but intellectual virtues, of the sort articulated by Zagzebski (1996) and discussed by Turri, Alfano, and Greco (2017).

On a realistic conception, thinking dispositions or intellectual virtues are real properties of thinkers. They are general tendencies, propensities, or inclinations to think in particular ways in particular circumstances, and can be genuinely explanatory (Siegel 1999). Sceptics argue that there is no evidence for a specific mental basis for the habits of mind that contribute to thinking critically, and that it is pedagogically misleading to posit such a basis (Bailin et al. 1999a). Whatever their status, critical thinking dispositions need motivation for their initial formation in a child—motivation that may be external or internal. As children develop, the force of habit will gradually become important in sustaining the disposition (Nieto & Valenzuela 2012). Mere force of habit, however, is unlikely to sustain critical thinking dispositions. Critical thinkers must value and enjoy using their knowledge and abilities to think things through for themselves. They must be committed to, and lovers of, inquiry.

A person may have a critical thinking disposition with respect to only some kinds of issues. For example, one could be open-minded about scientific issues but not about religious issues. Similarly, one could be confident in one’s ability to reason about the theological implications of the existence of evil in the world but not in one’s ability to reason about the best design for a guided ballistic missile.

Facione (1990a: 25) divides “affective dispositions” of critical thinking into approaches to life and living in general and approaches to specific issues, questions or problems. Adapting this distinction, one can usefully divide critical thinking dispositions into initiating dispositions (those that contribute causally to starting to think critically about an issue) and internal dispositions (those that contribute causally to doing a good job of thinking critically once one has started). The two categories are not mutually exclusive. For example, open-mindedness, in the sense of willingness to consider alternative points of view to one’s own, is both an initiating and an internal disposition.

Using the strategy of considering factors that would block people with the ability to think critically from doing so, we can identify as initiating dispositions for thinking critically attentiveness, a habit of inquiry, self-confidence, courage, open-mindedness, willingness to suspend judgment, trust in reason, wanting evidence for one’s beliefs, and seeking the truth. We consider briefly what each of these dispositions amounts to, in each case citing sources that acknowledge them.

• Attentiveness : One will not think critically if one fails to recognize an issue that needs to be thought through. For example, the pedestrian in Weather would not have looked up if he had not noticed that the air was suddenly cooler. To be a critical thinker, then, one needs to be habitually attentive to one’s surroundings, noticing not only what one senses but also sources of perplexity in messages received and in one’s own beliefs and attitudes (Facione 1990a: 25; Facione, Facione, & Giancarlo 2001).
• Habit of inquiry : Inquiry is effortful, and one needs an internal push to engage in it. For example, the student in Bubbles could easily have stopped at idle wondering about the cause of the bubbles rather than reasoning to a hypothesis, then designing and executing an experiment to test it. Thus willingness to think critically needs mental energy and initiative. What can supply that energy? Love of inquiry, or perhaps just a habit of inquiry. Hamby (2015) has argued that willingness to inquire is the central critical thinking virtue, one that encompasses all the others. It is recognized as a critical thinking disposition by Dewey (1910: 29; 1933: 35), Glaser (1941: 5), Ennis (1987: 12; 1991: 8), Facione (1990a: 25), Bailin et al. (1999b: 294), Halpern (1998: 452), and Facione, Facione, & Giancarlo (2001).
• Self-confidence : Lack of confidence in one’s abilities can block critical thinking. For example, if the woman in Rash lacked confidence in her ability to figure things out for herself, she might just have assumed that the rash on her chest was the allergic reaction to her medication against which the pharmacist had warned her. Thus willingness to think critically requires confidence in one’s ability to inquire (Facione 1990a: 25; Facione, Facione, & Giancarlo 2001).
• Courage : Fear of thinking for oneself can stop one from doing it. Thus willingness to think critically requires intellectual courage (Paul & Elder 2006: 16).
• Open-mindedness : A dogmatic attitude will impede thinking critically. For example, a person who adheres rigidly to a “pro-choice” position on the issue of the legal status of induced abortion is likely to be unwilling to consider seriously the issue of when in its development an unborn child acquires a moral right to life. Thus willingness to think critically requires open-mindedness, in the sense of a willingness to examine questions to which one already accepts an answer but which further evidence or reasoning might cause one to answer differently (Dewey 1933; Facione 1990a; Ennis 1991; Bailin et al. 1999b; Halpern 1998, Facione, Facione, & Giancarlo 2001). Paul (1981) emphasizes open-mindedness about alternative world-views, and recommends a dialectical approach to integrating such views as central to what he calls “strong sense” critical thinking. In three studies, Haran, Ritov, & Mellers (2013) found that actively open-minded thinking, including “the tendency to weigh new evidence against a favored belief, to spend sufficient time on a problem before giving up, and to consider carefully the opinions of others in forming one’s own”, led study participants to acquire information and thus to make accurate estimations.
• Willingness to suspend judgment : Premature closure on an initial solution will block critical thinking. Thus willingness to think critically requires a willingness to suspend judgment while alternatives are explored (Facione 1990a; Ennis 1991; Halpern 1998).
• Trust in reason : Since distrust in the processes of reasoned inquiry will dissuade one from engaging in it, trust in them is an initiating critical thinking disposition (Facione 1990a, 25; Bailin et al. 1999b: 294; Facione, Facione, & Giancarlo 2001; Paul & Elder 2006). In reaction to an allegedly exclusive emphasis on reason in critical thinking theory and pedagogy, Thayer-Bacon (2000) argues that intuition, imagination, and emotion have important roles to play in an adequate conception of critical thinking that she calls “constructive thinking”. From her point of view, critical thinking requires trust not only in reason but also in intuition, imagination, and emotion.
• Seeking the truth : If one does not care about the truth but is content to stick with one’s initial bias on an issue, then one will not think critically about it. Seeking the truth is thus an initiating critical thinking disposition (Bailin et al. 1999b: 294; Facione, Facione, & Giancarlo 2001). A disposition to seek the truth is implicit in more specific critical thinking dispositions, such as trying to be well-informed, considering seriously points of view other than one’s own, looking for alternatives, suspending judgment when the evidence is insufficient, and adopting a position when the evidence supporting it is sufficient.

Some of the initiating dispositions, such as open-mindedness and willingness to suspend judgment, are also internal critical thinking dispositions, in the sense of mental habits or attitudes that contribute causally to doing a good job of critical thinking once one starts the process. But there are many other internal critical thinking dispositions. Some of them are parasitic on one’s conception of good thinking. For example, it is constitutive of good thinking about an issue to formulate the issue clearly and to maintain focus on it. For this purpose, one needs not only the corresponding ability but also the corresponding disposition. Ennis (1991: 8) describes it as the disposition “to determine and maintain focus on the conclusion or question”, Facione (1990a: 25) as “clarity in stating the question or concern”. Other internal dispositions are motivators to continue or adjust the critical thinking process, such as willingness to persist in a complex task and willingness to abandon nonproductive strategies in an attempt to self-correct (Halpern 1998: 452). For a list of identified internal critical thinking dispositions, see the Supplement on Internal Critical Thinking Dispositions .

Some theorists postulate skills, i.e., acquired abilities, as operative in critical thinking. It is not obvious, however, that a good mental act is the exercise of a generic acquired skill. Inferring an expected time of arrival, as in Transit , has some generic components but also uses non-generic subject-matter knowledge. Bailin et al. (1999a) argue against viewing critical thinking skills as generic and discrete, on the ground that skilled performance at a critical thinking task cannot be separated from knowledge of concepts and from domain-specific principles of good thinking. Talk of skills, they concede, is unproblematic if it means merely that a person with critical thinking skills is capable of intelligent performance.

Despite such scepticism, theorists of critical thinking have listed as general contributors to critical thinking what they variously call abilities (Glaser 1941; Ennis 1962, 1991), skills (Facione 1990a; Halpern 1998) or competencies (Fisher & Scriven 1997). Amalgamating these lists would produce a confusing and chaotic cornucopia of more than 50 possible educational objectives, with only partial overlap among them. It makes sense instead to try to understand the reasons for the multiplicity and diversity, and to make a selection according to one’s own reasons for singling out abilities to be developed in a critical thinking curriculum. Two reasons for diversity among lists of critical thinking abilities are the underlying conception of critical thinking and the envisaged educational level. Appraisal-only conceptions, for example, involve a different suite of abilities than constructive-only conceptions. Some lists, such as those in (Glaser 1941), are put forward as educational objectives for secondary school students, whereas others are proposed as objectives for college students (e.g., Facione 1990a).

The abilities described in the remaining paragraphs of this section emerge from reflection on the general abilities needed to do well the thinking activities identified in section 6 as components of the critical thinking process described in section 5 . The derivation of each collection of abilities is accompanied by citation of sources that list such abilities and of standardized tests that claim to test them.

Observational abilities : Careful and accurate observation sometimes requires specialist expertise and practice, as in the case of observing birds and observing accident scenes. However, there are general abilities of noticing what one’s senses are picking up from one’s environment and of being able to articulate clearly and accurately to oneself and others what one has observed. It helps in exercising them to be able to recognize and take into account factors that make one’s observation less trustworthy, such as prior framing of the situation, inadequate time, deficient senses, poor observation conditions, and the like. It helps as well to be skilled at taking steps to make one’s observation more trustworthy, such as moving closer to get a better look, measuring something three times and taking the average, and checking what one thinks one is observing with someone else who is in a good position to observe it. It also helps to be skilled at recognizing respects in which one’s report of one’s observation involves inference rather than direct observation, so that one can then consider whether the inference is justified. These abilities come into play as well when one thinks about whether and with what degree of confidence to accept an observation report, for example in the study of history or in a criminal investigation or in assessing news reports. Observational abilities show up in some lists of critical thinking abilities (Ennis 1962: 90; Facione 1990a: 16; Ennis 1991: 9). There are items testing a person’s ability to judge the credibility of observation reports in the Cornell Critical Thinking Tests, Levels X and Z (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005). Norris and King (1983, 1985, 1990a, 1990b) is a test of ability to appraise observation reports.

Emotional abilities : The emotions that drive a critical thinking process are perplexity or puzzlement, a wish to resolve it, and satisfaction at achieving the desired resolution. Children experience these emotions at an early age, without being trained to do so. Education that takes critical thinking as a goal needs only to channel these emotions and to make sure not to stifle them. Collaborative critical thinking benefits from ability to recognize one’s own and others’ emotional commitments and reactions.

Questioning abilities : A critical thinking process needs transformation of an inchoate sense of perplexity into a clear question. Formulating a question well requires not building in questionable assumptions, not prejudging the issue, and using language that in context is unambiguous and precise enough (Ennis 1962: 97; 1991: 9).

Imaginative abilities : Thinking directed at finding the correct causal explanation of a general phenomenon or particular event requires an ability to imagine possible explanations. Thinking about what policy or plan of action to adopt requires generation of options and consideration of possible consequences of each option. Domain knowledge is required for such creative activity, but a general ability to imagine alternatives is helpful and can be nurtured so as to become easier, quicker, more extensive, and deeper (Dewey 1910: 34–39; 1933: 40–47). Facione (1990a) and Halpern (1998) include the ability to imagine alternatives as a critical thinking ability.

Inferential abilities : The ability to draw conclusions from given information, and to recognize with what degree of certainty one’s own or others’ conclusions follow, is universally recognized as a general critical thinking ability. All 11 examples in section 2 of this article include inferences, some from hypotheses or options (as in Transit , Ferryboat and Disorder ), others from something observed (as in Weather and Rash ). None of these inferences is formally valid. Rather, they are licensed by general, sometimes qualified substantive rules of inference (Toulmin 1958) that rest on domain knowledge—that a bus trip takes about the same time in each direction, that the terminal of a wireless telegraph would be located on the highest possible place, that sudden cooling is often followed by rain, that an allergic reaction to a sulfa drug generally shows up soon after one starts taking it. It is a matter of controversy to what extent the specialized ability to deduce conclusions from premisses using formal rules of inference is needed for critical thinking. Dewey (1933) locates logical forms in setting out the products of reflection rather than in the process of reflection. Ennis (1981a), on the other hand, maintains that a liberally-educated person should have the following abilities: to translate natural-language statements into statements using the standard logical operators, to use appropriately the language of necessary and sufficient conditions, to deal with argument forms and arguments containing symbols, to determine whether in virtue of an argument’s form its conclusion follows necessarily from its premisses, to reason with logically complex propositions, and to apply the rules and procedures of deductive logic. Inferential abilities are recognized as critical thinking abilities by Glaser (1941: 6), Facione (1990a: 9), Ennis (1991: 9), Fisher & Scriven (1997: 99, 111), and Halpern (1998: 452). Items testing inferential abilities constitute two of the five subtests of the Watson Glaser Critical Thinking Appraisal (Watson & Glaser 1980a, 1980b, 1994), two of the four sections in the Cornell Critical Thinking Test Level X (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005), three of the seven sections in the Cornell Critical Thinking Test Level Z (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005), 11 of the 34 items on Forms A and B of the California Critical Thinking Skills Test (Facione 1990b, 1992), and a high but variable proportion of the 25 selected-response questions in the Collegiate Learning Assessment (Council for Aid to Education 2017).

Experimenting abilities : Knowing how to design and execute an experiment is important not just in scientific research but also in everyday life, as in Rash . Dewey devoted a whole chapter of his How We Think (1910: 145–156; 1933: 190–202) to the superiority of experimentation over observation in advancing knowledge. Experimenting abilities come into play at one remove in appraising reports of scientific studies. Skill in designing and executing experiments includes the acknowledged abilities to appraise evidence (Glaser 1941: 6), to carry out experiments and to apply appropriate statistical inference techniques (Facione 1990a: 9), to judge inductions to an explanatory hypothesis (Ennis 1991: 9), and to recognize the need for an adequately large sample size (Halpern 1998). The Cornell Critical Thinking Test Level Z (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005) includes four items (out of 52) on experimental design. The Collegiate Learning Assessment (Council for Aid to Education 2017) makes room for appraisal of study design in both its performance task and its selected-response questions.

Consulting abilities : Skill at consulting sources of information comes into play when one seeks information to help resolve a problem, as in Candidate . Ability to find and appraise information includes ability to gather and marshal pertinent information (Glaser 1941: 6), to judge whether a statement made by an alleged authority is acceptable (Ennis 1962: 84), to plan a search for desired information (Facione 1990a: 9), and to judge the credibility of a source (Ennis 1991: 9). Ability to judge the credibility of statements is tested by 24 items (out of 76) in the Cornell Critical Thinking Test Level X (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005) and by four items (out of 52) in the Cornell Critical Thinking Test Level Z (Ennis & Millman 1971; Ennis, Millman, & Tomko 1985, 2005). The College Learning Assessment’s performance task requires evaluation of whether information in documents is credible or unreliable (Council for Aid to Education 2017).

Argument analysis abilities : The ability to identify and analyze arguments contributes to the process of surveying arguments on an issue in order to form one’s own reasoned judgment, as in Candidate . The ability to detect and analyze arguments is recognized as a critical thinking skill by Facione (1990a: 7–8), Ennis (1991: 9) and Halpern (1998). Five items (out of 34) on the California Critical Thinking Skills Test (Facione 1990b, 1992) test skill at argument analysis. The College Learning Assessment (Council for Aid to Education 2017) incorporates argument analysis in its selected-response tests of critical reading and evaluation and of critiquing an argument.

Judging skills and deciding skills : Skill at judging and deciding is skill at recognizing what judgment or decision the available evidence and argument supports, and with what degree of confidence. It is thus a component of the inferential skills already discussed.

Lists and tests of critical thinking abilities often include two more abilities: identifying assumptions and constructing and evaluating definitions.

In addition to dispositions and abilities, critical thinking needs knowledge: of critical thinking concepts, of critical thinking principles, and of the subject-matter of the thinking.

We can derive a short list of concepts whose understanding contributes to critical thinking from the critical thinking abilities described in the preceding section. Observational abilities require an understanding of the difference between observation and inference. Questioning abilities require an understanding of the concepts of ambiguity and vagueness. Inferential abilities require an understanding of the difference between conclusive and defeasible inference (traditionally, between deduction and induction), as well as of the difference between necessary and sufficient conditions. Experimenting abilities require an understanding of the concepts of hypothesis, null hypothesis, assumption and prediction, as well as of the concept of statistical significance and of its difference from importance. They also require an understanding of the difference between an experiment and an observational study, and in particular of the difference between a randomized controlled trial, a prospective correlational study and a retrospective (case-control) study. Argument analysis abilities require an understanding of the concepts of argument, premiss, assumption, conclusion and counter-consideration. Additional critical thinking concepts are proposed by Bailin et al. (1999b: 293), Fisher & Scriven (1997: 105–106), Black (2012), and Blair (2021).

According to Glaser (1941: 25), ability to think critically requires knowledge of the methods of logical inquiry and reasoning. If we review the list of abilities in the preceding section, however, we can see that some of them can be acquired and exercised merely through practice, possibly guided in an educational setting, followed by feedback. Searching intelligently for a causal explanation of some phenomenon or event requires that one consider a full range of possible causal contributors, but it seems more important that one implements this principle in one’s practice than that one is able to articulate it. What is important is “operational knowledge” of the standards and principles of good thinking (Bailin et al. 1999b: 291–293). But the development of such critical thinking abilities as designing an experiment or constructing an operational definition can benefit from learning their underlying theory. Further, explicit knowledge of quirks of human thinking seems useful as a cautionary guide. Human memory is not just fallible about details, as people learn from their own experiences of misremembering, but is so malleable that a detailed, clear and vivid recollection of an event can be a total fabrication (Loftus 2017). People seek or interpret evidence in ways that are partial to their existing beliefs and expectations, often unconscious of their “confirmation bias” (Nickerson 1998). Not only are people subject to this and other cognitive biases (Kahneman 2011), of which they are typically unaware, but it may be counter-productive for one to make oneself aware of them and try consciously to counteract them or to counteract social biases such as racial or sexual stereotypes (Kenyon & Beaulac 2014). It is helpful to be aware of these facts and of the superior effectiveness of blocking the operation of biases—for example, by making an immediate record of one’s observations, refraining from forming a preliminary explanatory hypothesis, blind refereeing, double-blind randomized trials, and blind grading of students’ work. It is also helpful to be aware of the prevalence of “noise” (unwanted unsystematic variability of judgments), of how to detect noise (through a noise audit), and of how to reduce noise: make accuracy the goal, think statistically, break a process of arriving at a judgment into independent tasks, resist premature intuitions, in a group get independent judgments first, favour comparative judgments and scales (Kahneman, Sibony, & Sunstein 2021). It is helpful as well to be aware of the concept of “bounded rationality” in decision-making and of the related distinction between “satisficing” and optimizing (Simon 1956; Gigerenzer 2001).

Critical thinking about an issue requires substantive knowledge of the domain to which the issue belongs. Critical thinking abilities are not a magic elixir that can be applied to any issue whatever by somebody who has no knowledge of the facts relevant to exploring that issue. For example, the student in Bubbles needed to know that gases do not penetrate solid objects like a glass, that air expands when heated, that the volume of an enclosed gas varies directly with its temperature and inversely with its pressure, and that hot objects will spontaneously cool down to the ambient temperature of their surroundings unless kept hot by insulation or a source of heat. Critical thinkers thus need a rich fund of subject-matter knowledge relevant to the variety of situations they encounter. This fact is recognized in the inclusion among critical thinking dispositions of a concern to become and remain generally well informed.

Experimental educational interventions, with control groups, have shown that education can improve critical thinking skills and dispositions, as measured by standardized tests. For information about these tests, see the Supplement on Assessment .

What educational methods are most effective at developing the dispositions, abilities and knowledge of a critical thinker? In a comprehensive meta-analysis of experimental and quasi-experimental studies of strategies for teaching students to think critically, Abrami et al. (2015) found that dialogue, anchored instruction, and mentoring each increased the effectiveness of the educational intervention, and that they were most effective when combined. They also found that in these studies a combination of separate instruction in critical thinking with subject-matter instruction in which students are encouraged to think critically was more effective than either by itself. However, the difference was not statistically significant; that is, it might have arisen by chance.

Most of these studies lack the longitudinal follow-up required to determine whether the observed differential improvements in critical thinking abilities or dispositions continue over time, for example until high school or college graduation. For details on studies of methods of developing critical thinking skills and dispositions, see the Supplement on Educational Methods .

12. Controversies

Scholars have denied the generalizability of critical thinking abilities across subject domains, have alleged bias in critical thinking theory and pedagogy, and have investigated the relationship of critical thinking to other kinds of thinking.

McPeck (1981) attacked the thinking skills movement of the 1970s, including the critical thinking movement. He argued that there are no general thinking skills, since thinking is always thinking about some subject-matter. It is futile, he claimed, for schools and colleges to teach thinking as if it were a separate subject. Rather, teachers should lead their pupils to become autonomous thinkers by teaching school subjects in a way that brings out their cognitive structure and that encourages and rewards discussion and argument. As some of his critics (e.g., Paul 1985; Siegel 1985) pointed out, McPeck’s central argument needs elaboration, since it has obvious counter-examples in writing and speaking, for which (up to a certain level of complexity) there are teachable general abilities even though they are always about some subject-matter. To make his argument convincing, McPeck needs to explain how thinking differs from writing and speaking in a way that does not permit useful abstraction of its components from the subject-matters with which it deals. He has not done so. Nevertheless, his position that the dispositions and abilities of a critical thinker are best developed in the context of subject-matter instruction is shared by many theorists of critical thinking, including Dewey (1910, 1933), Glaser (1941), Passmore (1980), Weinstein (1990), Bailin et al. (1999b), and Willingham (2019).

McPeck’s challenge prompted reflection on the extent to which critical thinking is subject-specific. McPeck argued for a strong subject-specificity thesis, according to which it is a conceptual truth that all critical thinking abilities are specific to a subject. (He did not however extend his subject-specificity thesis to critical thinking dispositions. In particular, he took the disposition to suspend judgment in situations of cognitive dissonance to be a general disposition.) Conceptual subject-specificity is subject to obvious counter-examples, such as the general ability to recognize confusion of necessary and sufficient conditions. A more modest thesis, also endorsed by McPeck, is epistemological subject-specificity, according to which the norms of good thinking vary from one field to another. Epistemological subject-specificity clearly holds to a certain extent; for example, the principles in accordance with which one solves a differential equation are quite different from the principles in accordance with which one determines whether a painting is a genuine Picasso. But the thesis suffers, as Ennis (1989) points out, from vagueness of the concept of a field or subject and from the obvious existence of inter-field principles, however broadly the concept of a field is construed. For example, the principles of hypothetico-deductive reasoning hold for all the varied fields in which such reasoning occurs. A third kind of subject-specificity is empirical subject-specificity, according to which as a matter of empirically observable fact a person with the abilities and dispositions of a critical thinker in one area of investigation will not necessarily have them in another area of investigation.

The thesis of empirical subject-specificity raises the general problem of transfer. If critical thinking abilities and dispositions have to be developed independently in each school subject, how are they of any use in dealing with the problems of everyday life and the political and social issues of contemporary society, most of which do not fit into the framework of a traditional school subject? Proponents of empirical subject-specificity tend to argue that transfer is more likely to occur if there is critical thinking instruction in a variety of domains, with explicit attention to dispositions and abilities that cut across domains. But evidence for this claim is scanty. There is a need for well-designed empirical studies that investigate the conditions that make transfer more likely.

It is common ground in debates about the generality or subject-specificity of critical thinking dispositions and abilities that critical thinking about any topic requires background knowledge about the topic. For example, the most sophisticated understanding of the principles of hypothetico-deductive reasoning is of no help unless accompanied by some knowledge of what might be plausible explanations of some phenomenon under investigation.

Critics have objected to bias in the theory, pedagogy and practice of critical thinking. Commentators (e.g., Alston 1995; Ennis 1998) have noted that anyone who takes a position has a bias in the neutral sense of being inclined in one direction rather than others. The critics, however, are objecting to bias in the pejorative sense of an unjustified favoring of certain ways of knowing over others, frequently alleging that the unjustly favoured ways are those of a dominant sex or culture (Bailin 1995). These ways favour:

• reinforcement of egocentric and sociocentric biases over dialectical engagement with opposing world-views (Paul 1981, 1984; Warren 1998)
• distancing from the object of inquiry over closeness to it (Martin 1992; Thayer-Bacon 1992)
• indifference to the situation of others over care for them (Martin 1992)
• orientation to thought over orientation to action (Martin 1992)
• being reasonable over caring to understand people’s ideas (Thayer-Bacon 1993)
• being neutral and objective over being embodied and situated (Thayer-Bacon 1995a)
• doubting over believing (Thayer-Bacon 1995b)
• reason over emotion, imagination and intuition (Thayer-Bacon 2000)
• solitary thinking over collaborative thinking (Thayer-Bacon 2000)
• written and spoken assignments over other forms of expression (Alston 2001)
• attention to written and spoken communications over attention to human problems (Alston 2001)
• winning debates in the public sphere over making and understanding meaning (Alston 2001)

A common thread in this smorgasbord of accusations is dissatisfaction with focusing on the logical analysis and evaluation of reasoning and arguments. While these authors acknowledge that such analysis and evaluation is part of critical thinking and should be part of its conceptualization and pedagogy, they insist that it is only a part. Paul (1981), for example, bemoans the tendency of atomistic teaching of methods of analyzing and evaluating arguments to turn students into more able sophists, adept at finding fault with positions and arguments with which they disagree but even more entrenched in the egocentric and sociocentric biases with which they began. Martin (1992) and Thayer-Bacon (1992) cite with approval the self-reported intimacy with their subject-matter of leading researchers in biology and medicine, an intimacy that conflicts with the distancing allegedly recommended in standard conceptions and pedagogy of critical thinking. Thayer-Bacon (2000) contrasts the embodied and socially embedded learning of her elementary school students in a Montessori school, who used their imagination, intuition and emotions as well as their reason, with conceptions of critical thinking as

thinking that is used to critique arguments, offer justifications, and make judgments about what are the good reasons, or the right answers. (Thayer-Bacon 2000: 127–128)

Alston (2001) reports that her students in a women’s studies class were able to see the flaws in the Cinderella myth that pervades much romantic fiction but in their own romantic relationships still acted as if all failures were the woman’s fault and still accepted the notions of love at first sight and living happily ever after. Students, she writes, should

be able to connect their intellectual critique to a more affective, somatic, and ethical account of making risky choices that have sexist, racist, classist, familial, sexual, or other consequences for themselves and those both near and far… critical thinking that reads arguments, texts, or practices merely on the surface without connections to feeling/desiring/doing or action lacks an ethical depth that should infuse the difference between mere cognitive activity and something we want to call critical thinking. (Alston 2001: 34)

Some critics portray such biases as unfair to women. Thayer-Bacon (1992), for example, has charged modern critical thinking theory with being sexist, on the ground that it separates the self from the object and causes one to lose touch with one’s inner voice, and thus stigmatizes women, who (she asserts) link self to object and listen to their inner voice. Her charge does not imply that women as a group are on average less able than men to analyze and evaluate arguments. Facione (1990c) found no difference by sex in performance on his California Critical Thinking Skills Test. Kuhn (1991: 280–281) found no difference by sex in either the disposition or the competence to engage in argumentative thinking.

The critics propose a variety of remedies for the biases that they allege. In general, they do not propose to eliminate or downplay critical thinking as an educational goal. Rather, they propose to conceptualize critical thinking differently and to change its pedagogy accordingly. Their pedagogical proposals arise logically from their objections. They can be summarized as follows:

• Focus on argument networks with dialectical exchanges reflecting contesting points of view rather than on atomic arguments, so as to develop “strong sense” critical thinking that transcends egocentric and sociocentric biases (Paul 1981, 1984).
• Foster closeness to the subject-matter and feeling connected to others in order to inform a humane democracy (Martin 1992).
• Develop “constructive thinking” as a social activity in a community of physically embodied and socially embedded inquirers with personal voices who value not only reason but also imagination, intuition and emotion (Thayer-Bacon 2000).
• In developing critical thinking in school subjects, treat as important neither skills nor dispositions but opening worlds of meaning (Alston 2001).
• Attend to the development of critical thinking dispositions as well as skills, and adopt the “critical pedagogy” practised and advocated by Freire (1968 [1970]) and hooks (1994) (Dalgleish, Girard, & Davies 2017).

A common thread in these proposals is treatment of critical thinking as a social, interactive, personally engaged activity like that of a quilting bee or a barn-raising (Thayer-Bacon 2000) rather than as an individual, solitary, distanced activity symbolized by Rodin’s The Thinker . One can get a vivid description of education with the former type of goal from the writings of bell hooks (1994, 2010). Critical thinking for her is open-minded dialectical exchange across opposing standpoints and from multiple perspectives, a conception similar to Paul’s “strong sense” critical thinking (Paul 1981). She abandons the structure of domination in the traditional classroom. In an introductory course on black women writers, for example, she assigns students to write an autobiographical paragraph about an early racial memory, then to read it aloud as the others listen, thus affirming the uniqueness and value of each voice and creating a communal awareness of the diversity of the group’s experiences (hooks 1994: 84). Her “engaged pedagogy” is thus similar to the “freedom under guidance” implemented in John Dewey’s Laboratory School of Chicago in the late 1890s and early 1900s. It incorporates the dialogue, anchored instruction, and mentoring that Abrami (2015) found to be most effective in improving critical thinking skills and dispositions.

What is the relationship of critical thinking to problem solving, decision-making, higher-order thinking, creative thinking, and other recognized types of thinking? One’s answer to this question obviously depends on how one defines the terms used in the question. If critical thinking is conceived broadly to cover any careful thinking about any topic for any purpose, then problem solving and decision making will be kinds of critical thinking, if they are done carefully. Historically, ‘critical thinking’ and ‘problem solving’ were two names for the same thing. If critical thinking is conceived more narrowly as consisting solely of appraisal of intellectual products, then it will be disjoint with problem solving and decision making, which are constructive.

Bloom’s taxonomy of educational objectives used the phrase “intellectual abilities and skills” for what had been labeled “critical thinking” by some, “reflective thinking” by Dewey and others, and “problem solving” by still others (Bloom et al. 1956: 38). Thus, the so-called “higher-order thinking skills” at the taxonomy’s top levels of analysis, synthesis and evaluation are just critical thinking skills, although they do not come with general criteria for their assessment (Ennis 1981b). The revised version of Bloom’s taxonomy (Anderson et al. 2001) likewise treats critical thinking as cutting across those types of cognitive process that involve more than remembering (Anderson et al. 2001: 269–270). For details, see the Supplement on History .

As to creative thinking, it overlaps with critical thinking (Bailin 1987, 1988). Thinking about the explanation of some phenomenon or event, as in Ferryboat , requires creative imagination in constructing plausible explanatory hypotheses. Likewise, thinking about a policy question, as in Candidate , requires creativity in coming up with options. Conversely, creativity in any field needs to be balanced by critical appraisal of the draft painting or novel or mathematical theory.

• Abrami, Philip C., Robert M. Bernard, Eugene Borokhovski, David I. Waddington, C. Anne Wade, and Tonje Person, 2015, “Strategies for Teaching Students to Think Critically: A Meta-analysis”, Review of Educational Research , 85(2): 275–314. doi:10.3102/0034654314551063
• Aikin, Wilford M., 1942, The Story of the Eight-year Study, with Conclusions and Recommendations , Volume I of Adventure in American Education , New York and London: Harper & Brothers. [ Aikin 1942 available online ]
• Alston, Kal, 1995, “Begging the Question: Is Critical Thinking Biased?”, Educational Theory , 45(2): 225–233. doi:10.1111/j.1741-5446.1995.00225.x
• –––, 2001, “Re/Thinking Critical Thinking: The Seductions of Everyday Life”, Studies in Philosophy and Education , 20(1): 27–40. doi:10.1023/A:1005247128053
• American Educational Research Association, 2014, Standards for Educational and Psychological Testing / American Educational Research Association, American Psychological Association, National Council on Measurement in Education , Washington, DC: American Educational Research Association.
• Anderson, Lorin W., David R. Krathwohl, Peter W. Airiasian, Kathleen A. Cruikshank, Richard E. Mayer, Paul R. Pintrich, James Raths, and Merlin C. Wittrock, 2001, A Taxonomy for Learning, Teaching and Assessing: A Revision of Bloom’s Taxonomy of Educational Objectives , New York: Longman, complete edition.
• Bailin, Sharon, 1987, “Critical and Creative Thinking”, Informal Logic , 9(1): 23–30. [ Bailin 1987 available online ]
• –––, 1988, Achieving Extraordinary Ends: An Essay on Creativity , Dordrecht: Kluwer. doi:10.1007/978-94-009-2780-3
• –––, 1995, “Is Critical Thinking Biased? Clarifications and Implications”, Educational Theory , 45(2): 191–197. doi:10.1111/j.1741-5446.1995.00191.x
• Bailin, Sharon and Mark Battersby, 2009, “Inquiry: A Dialectical Approach to Teaching Critical Thinking”, in Juho Ritola (ed.), Argument Cultures: Proceedings of OSSA 09 , CD-ROM (pp. 1–10), Windsor, ON: OSSA. [ Bailin & Battersby 2009 available online ]
• –––, 2016a, “Fostering the Virtues of Inquiry”, Topoi , 35(2): 367–374. doi:10.1007/s11245-015-9307-6
• –––, 2016b, Reason in the Balance: An Inquiry Approach to Critical Thinking , Indianapolis: Hackett, 2nd edition.
• –––, 2021, “Inquiry: Teaching for Reasoned Judgment”, in Daniel Fasko, Jr. and Frank Fair (eds.), Critical Thinking and Reasoning: Theory, Development, Instruction, and Assessment , Leiden: Brill, pp. 31–46. doi: 10.1163/9789004444591_003
• Bailin, Sharon, Roland Case, Jerrold R. Coombs, and Leroi B. Daniels, 1999a, “Common Misconceptions of Critical Thinking”, Journal of Curriculum Studies , 31(3): 269–283. doi:10.1080/002202799183124
• –––, 1999b, “Conceptualizing Critical Thinking”, Journal of Curriculum Studies , 31(3): 285–302. doi:10.1080/002202799183133
• Blair, J. Anthony, 2021, Studies in Critical Thinking , Windsor, ON: Windsor Studies in Argumentation, 2nd edition. [Available online at https://windsor.scholarsportal.info/omp/index.php/wsia/catalog/book/106]
• Berman, Alan M., Seth J. Schwartz, William M. Kurtines, and Steven L. Berman, 2001, “The Process of Exploration in Identity Formation: The Role of Style and Competence”, Journal of Adolescence , 24(4): 513–528. doi:10.1006/jado.2001.0386
• Black, Beth (ed.), 2012, An A to Z of Critical Thinking , London: Continuum International Publishing Group.
• Bloom, Benjamin Samuel, Max D. Engelhart, Edward J. Furst, Walter H. Hill, and David R. Krathwohl, 1956, Taxonomy of Educational Objectives. Handbook I: Cognitive Domain , New York: David McKay.
• Boardman, Frank, Nancy M. Cavender, and Howard Kahane, 2018, Logic and Contemporary Rhetoric: The Use of Reason in Everyday Life , Boston: Cengage, 13th edition.
• Browne, M. Neil and Stuart M. Keeley, 2018, Asking the Right Questions: A Guide to Critical Thinking , Hoboken, NJ: Pearson, 12th edition.
• Center for Assessment & Improvement of Learning, 2017, Critical Thinking Assessment Test , Cookeville, TN: Tennessee Technological University.
• Cleghorn, Paul. 2021. “Critical Thinking in the Elementary School: Practical Guidance for Building a Culture of Thinking”, in Daniel Fasko, Jr. and Frank Fair (eds.), Critical Thinking and Reasoning: Theory, Development, Instruction, and Assessmen t, Leiden: Brill, pp. 150–167. doi: 10.1163/9789004444591_010
• Cohen, Jacob, 1988, Statistical Power Analysis for the Behavioral Sciences , Hillsdale, NJ: Lawrence Erlbaum Associates, 2nd edition.
• College Board, 1983, Academic Preparation for College. What Students Need to Know and Be Able to Do , New York: College Entrance Examination Board, ERIC document ED232517.
• Commission on the Relation of School and College of the Progressive Education Association, 1943, Thirty Schools Tell Their Story , Volume V of Adventure in American Education , New York and London: Harper & Brothers.
• Council for Aid to Education, 2017, CLA+ Student Guide . Available at http://cae.org/images/uploads/pdf/CLA_Student_Guide_Institution.pdf ; last accessed 2022 07 16.
• Dalgleish, Adam, Patrick Girard, and Maree Davies, 2017, “Critical Thinking, Bias and Feminist Philosophy: Building a Better Framework through Collaboration”, Informal Logic , 37(4): 351–369. [ Dalgleish et al. available online ]
• Dewey, John, 1910, How We Think , Boston: D.C. Heath. [ Dewey 1910 available online ]
• –––, 1916, Democracy and Education: An Introduction to the Philosophy of Education , New York: Macmillan.
• –––, 1933, How We Think: A Restatement of the Relation of Reflective Thinking to the Educative Process , Lexington, MA: D.C. Heath.
• –––, 1936, “The Theory of the Chicago Experiment”, Appendix II of Mayhew & Edwards 1936: 463–477.
• –––, 1938, Logic: The Theory of Inquiry , New York: Henry Holt and Company.
• Dominguez, Caroline (coord.), 2018a, A European Collection of the Critical Thinking Skills and Dispositions Needed in Different Professional Fields for the 21st Century , Vila Real, Portugal: UTAD. Available at http://bit.ly/CRITHINKEDUO1 ; last accessed 2022 07 16.
• ––– (coord.), 2018b, A European Review on Critical Thinking Educational Practices in Higher Education Institutions , Vila Real: UTAD. Available at http://bit.ly/CRITHINKEDUO2 ; last accessed 2022 07 16.
• ––– (coord.), 2018c, The CRITHINKEDU European Course on Critical Thinking Education for University Teachers: From Conception to Delivery , Vila Real: UTAD. Available at http:/bit.ly/CRITHINKEDU03; last accessed 2022 07 16.
• Dominguez Caroline and Rita Payan-Carreira (eds.), 2019, Promoting Critical Thinking in European Higher Education Institutions: Towards an Educational Protocol , Vila Real: UTAD. Available at http:/bit.ly/CRITHINKEDU04; last accessed 2022 07 16.
• Ennis, Robert H., 1958, “An Appraisal of the Watson-Glaser Critical Thinking Appraisal”, The Journal of Educational Research , 52(4): 155–158. doi:10.1080/00220671.1958.10882558
• –––, 1962, “A Concept of Critical Thinking: A Proposed Basis for Research on the Teaching and Evaluation of Critical Thinking Ability”, Harvard Educational Review , 32(1): 81–111.
• –––, 1981a, “A Conception of Deductive Logical Competence”, Teaching Philosophy , 4(3/4): 337–385. doi:10.5840/teachphil198143/429
• –––, 1981b, “Eight Fallacies in Bloom’s Taxonomy”, in C. J. B. Macmillan (ed.), Philosophy of Education 1980: Proceedings of the Thirty-seventh Annual Meeting of the Philosophy of Education Society , Bloomington, IL: Philosophy of Education Society, pp. 269–273.
• –––, 1984, “Problems in Testing Informal Logic, Critical Thinking, Reasoning Ability”, Informal Logic , 6(1): 3–9. [ Ennis 1984 available online ]
• –––, 1987, “A Taxonomy of Critical Thinking Dispositions and Abilities”, in Joan Boykoff Baron and Robert J. Sternberg (eds.), Teaching Thinking Skills: Theory and Practice , New York: W. H. Freeman, pp. 9–26.
• –––, 1989, “Critical Thinking and Subject Specificity: Clarification and Needed Research”, Educational Researcher , 18(3): 4–10. doi:10.3102/0013189X018003004
• –––, 1991, “Critical Thinking: A Streamlined Conception”, Teaching Philosophy , 14(1): 5–24. doi:10.5840/teachphil19911412
• –––, 1996, “Critical Thinking Dispositions: Their Nature and Assessability”, Informal Logic , 18(2–3): 165–182. [ Ennis 1996 available online ]
• –––, 1998, “Is Critical Thinking Culturally Biased?”, Teaching Philosophy , 21(1): 15–33. doi:10.5840/teachphil19982113
• –––, 2011, “Critical Thinking: Reflection and Perspective Part I”, Inquiry: Critical Thinking across the Disciplines , 26(1): 4–18. doi:10.5840/inquiryctnews20112613
• –––, 2013, “Critical Thinking across the Curriculum: The Wisdom CTAC Program”, Inquiry: Critical Thinking across the Disciplines , 28(2): 25–45. doi:10.5840/inquiryct20132828
• –––, 2016, “Definition: A Three-Dimensional Analysis with Bearing on Key Concepts”, in Patrick Bondy and Laura Benacquista (eds.), Argumentation, Objectivity, and Bias: Proceedings of the 11th International Conference of the Ontario Society for the Study of Argumentation (OSSA), 18–21 May 2016 , Windsor, ON: OSSA, pp. 1–19. Available at http://scholar.uwindsor.ca/ossaarchive/OSSA11/papersandcommentaries/105 ; last accessed 2022 07 16.
• –––, 2018, “Critical Thinking Across the Curriculum: A Vision”, Topoi , 37(1): 165–184. doi:10.1007/s11245-016-9401-4
• Ennis, Robert H., and Jason Millman, 1971, Manual for Cornell Critical Thinking Test, Level X, and Cornell Critical Thinking Test, Level Z , Urbana, IL: Critical Thinking Project, University of Illinois.
• Ennis, Robert H., Jason Millman, and Thomas Norbert Tomko, 1985, Cornell Critical Thinking Tests Level X & Level Z: Manual , Pacific Grove, CA: Midwest Publication, 3rd edition.
• –––, 2005, Cornell Critical Thinking Tests Level X & Level Z: Manual , Seaside, CA: Critical Thinking Company, 5th edition.
• Ennis, Robert H. and Eric Weir, 1985, The Ennis-Weir Critical Thinking Essay Test: Test, Manual, Criteria, Scoring Sheet: An Instrument for Teaching and Testing , Pacific Grove, CA: Midwest Publications.
• Facione, Peter A., 1990a, Critical Thinking: A Statement of Expert Consensus for Purposes of Educational Assessment and Instruction , Research Findings and Recommendations Prepared for the Committee on Pre-College Philosophy of the American Philosophical Association, ERIC Document ED315423.
• –––, 1990b, California Critical Thinking Skills Test, CCTST – Form A , Millbrae, CA: The California Academic Press.
• –––, 1990c, The California Critical Thinking Skills Test--College Level. Technical Report #3. Gender, Ethnicity, Major, CT Self-Esteem, and the CCTST , ERIC Document ED326584.
• –––, 1992, California Critical Thinking Skills Test: CCTST – Form B, Millbrae, CA: The California Academic Press.
• –––, 2000, “The Disposition Toward Critical Thinking: Its Character, Measurement, and Relationship to Critical Thinking Skill”, Informal Logic , 20(1): 61–84. [ Facione 2000 available online ]
• Facione, Peter A. and Noreen C. Facione, 1992, CCTDI: A Disposition Inventory , Millbrae, CA: The California Academic Press.
• Facione, Peter A., Noreen C. Facione, and Carol Ann F. Giancarlo, 2001, California Critical Thinking Disposition Inventory: CCTDI: Inventory Manual , Millbrae, CA: The California Academic Press.
• Facione, Peter A., Carol A. Sánchez, and Noreen C. Facione, 1994, Are College Students Disposed to Think? , Millbrae, CA: The California Academic Press. ERIC Document ED368311.
• Fisher, Alec, and Michael Scriven, 1997, Critical Thinking: Its Definition and Assessment , Norwich: Centre for Research in Critical Thinking, University of East Anglia.
• Freire, Paulo, 1968 [1970], Pedagogia do Oprimido . Translated as Pedagogy of the Oppressed , Myra Bergman Ramos (trans.), New York: Continuum, 1970.
• Gigerenzer, Gerd, 2001, “The Adaptive Toolbox”, in Gerd Gigerenzer and Reinhard Selten (eds.), Bounded Rationality: The Adaptive Toolbox , Cambridge, MA: MIT Press, pp. 37–50.
• Glaser, Edward Maynard, 1941, An Experiment in the Development of Critical Thinking , New York: Bureau of Publications, Teachers College, Columbia University.
• Groarke, Leo A. and Christopher W. Tindale, 2012, Good Reasoning Matters! A Constructive Approach to Critical Thinking , Don Mills, ON: Oxford University Press, 5th edition.
• Halpern, Diane F., 1998, “Teaching Critical Thinking for Transfer Across Domains: Disposition, Skills, Structure Training, and Metacognitive Monitoring”, American Psychologist , 53(4): 449–455. doi:10.1037/0003-066X.53.4.449
• –––, 2016, Manual: Halpern Critical Thinking Assessment , Mödling, Austria: Schuhfried. Available at https://pdfcoffee.com/hcta-test-manual-pdf-free.html; last accessed 2022 07 16.
• Hamby, Benjamin, 2014, The Virtues of Critical Thinkers , Doctoral dissertation, Philosophy, McMaster University. [ Hamby 2014 available online ]
• –––, 2015, “Willingness to Inquire: The Cardinal Critical Thinking Virtue”, in Martin Davies and Ronald Barnett (eds.), The Palgrave Handbook of Critical Thinking in Higher Education , New York: Palgrave Macmillan, pp. 77–87.
• Haran, Uriel, Ilana Ritov, and Barbara A. Mellers, 2013, “The Role of Actively Open-minded Thinking in Information Acquisition, Accuracy, and Calibration”, Judgment and Decision Making , 8(3): 188–201.
• Hatcher, Donald and Kevin Possin, 2021, “Commentary: Thinking Critically about Critical Thinking Assessment”, in Daniel Fasko, Jr. and Frank Fair (eds.), Critical Thinking and Reasoning: Theory, Development, Instruction, and Assessment , Leiden: Brill, pp. 298–322. doi: 10.1163/9789004444591_017
• Haynes, Ada, Elizabeth Lisic, Kevin Harris, Katie Leming, Kyle Shanks, and Barry Stein, 2015, “Using the Critical Thinking Assessment Test (CAT) as a Model for Designing Within-Course Assessments: Changing How Faculty Assess Student Learning”, Inquiry: Critical Thinking Across the Disciplines , 30(3): 38–48. doi:10.5840/inquiryct201530316
• Haynes, Ada and Barry Stein, 2021, “Observations from a Long-Term Effort to Assess and Improve Critical Thinking”, in Daniel Fasko, Jr. and Frank Fair (eds.), Critical Thinking and Reasoning: Theory, Development, Instruction, and Assessment , Leiden: Brill, pp. 231–254. doi: 10.1163/9789004444591_014
• Hiner, Amanda L. 2021. “Equipping Students for Success in College and Beyond: Placing Critical Thinking Instruction at the Heart of a General Education Program”, in Daniel Fasko, Jr. and Frank Fair (eds.), Critical Thinking and Reasoning: Theory, Development, Instruction, and Assessment , Leiden: Brill, pp. 188–208. doi: 10.1163/9789004444591_012
• Hitchcock, David, 2017, “Critical Thinking as an Educational Ideal”, in his On Reasoning and Argument: Essays in Informal Logic and on Critical Thinking , Dordrecht: Springer, pp. 477–497. doi:10.1007/978-3-319-53562-3_30
• –––, 2021, “Seven Philosophical Implications of Critical Thinking: Themes, Variations, Implications”, in Daniel Fasko, Jr. and Frank Fair (eds.), Critical Thinking and Reasoning: Theory, Development, Instruction, and Assessment , Leiden: Brill, pp. 9–30. doi: 10.1163/9789004444591_002
• hooks, bell, 1994, Teaching to Transgress: Education as the Practice of Freedom , New York and London: Routledge.
• –––, 2010, Teaching Critical Thinking: Practical Wisdom , New York and London: Routledge.
• Johnson, Ralph H., 1992, “The Problem of Defining Critical Thinking”, in Stephen P, Norris (ed.), The Generalizability of Critical Thinking , New York: Teachers College Press, pp. 38–53.
• Kahane, Howard, 1971, Logic and Contemporary Rhetoric: The Use of Reason in Everyday Life , Belmont, CA: Wadsworth.
• Kahneman, Daniel, 2011, Thinking, Fast and Slow , New York: Farrar, Straus and Giroux.
• Kahneman, Daniel, Olivier Sibony, & Cass R. Sunstein, 2021, Noise: A Flaw in Human Judgment , New York: Little, Brown Spark.
• Kenyon, Tim, and Guillaume Beaulac, 2014, “Critical Thinking Education and Debasing”, Informal Logic , 34(4): 341–363. [ Kenyon & Beaulac 2014 available online ]
• Krathwohl, David R., Benjamin S. Bloom, and Bertram B. Masia, 1964, Taxonomy of Educational Objectives, Handbook II: Affective Domain , New York: David McKay.
• Kuhn, Deanna, 1991, The Skills of Argument , New York: Cambridge University Press. doi:10.1017/CBO9780511571350
• –––, 2019, “Critical Thinking as Discourse”, Human Development, 62 (3): 146–164. doi:10.1159/000500171
• Lipman, Matthew, 1987, “Critical Thinking–What Can It Be?”, Analytic Teaching , 8(1): 5–12. [ Lipman 1987 available online ]
• –––, 2003, Thinking in Education , Cambridge: Cambridge University Press, 2nd edition.
• Loftus, Elizabeth F., 2017, “Eavesdropping on Memory”, Annual Review of Psychology , 68: 1–18. doi:10.1146/annurev-psych-010416-044138
• Makaiau, Amber Strong, 2021, “The Good Thinker’s Tool Kit: How to Engage Critical Thinking and Reasoning in Secondary Education”, in Daniel Fasko, Jr. and Frank Fair (eds.), Critical Thinking and Reasoning: Theory, Development, Instruction, and Assessment , Leiden: Brill, pp. 168–187. doi: 10.1163/9789004444591_011
• Martin, Jane Roland, 1992, “Critical Thinking for a Humane World”, in Stephen P. Norris (ed.), The Generalizability of Critical Thinking , New York: Teachers College Press, pp. 163–180.
• Mayhew, Katherine Camp, and Anna Camp Edwards, 1936, The Dewey School: The Laboratory School of the University of Chicago, 1896–1903 , New York: Appleton-Century. [ Mayhew & Edwards 1936 available online ]
• McPeck, John E., 1981, Critical Thinking and Education , New York: St. Martin’s Press.
• Moore, Brooke Noel and Richard Parker, 2020, Critical Thinking , New York: McGraw-Hill, 13th edition.
• Nickerson, Raymond S., 1998, “Confirmation Bias: A Ubiquitous Phenomenon in Many Guises”, Review of General Psychology , 2(2): 175–220. doi:10.1037/1089-2680.2.2.175
• Nieto, Ana Maria, and Jorge Valenzuela, 2012, “A Study of the Internal Structure of Critical Thinking Dispositions”, Inquiry: Critical Thinking across the Disciplines , 27(1): 31–38. doi:10.5840/inquiryct20122713
• Norris, Stephen P., 1985, “Controlling for Background Beliefs When Developing Multiple-choice Critical Thinking Tests”, Educational Measurement: Issues and Practice , 7(3): 5–11. doi:10.1111/j.1745-3992.1988.tb00437.x
• Norris, Stephen P. and Robert H. Ennis, 1989, Evaluating Critical Thinking (The Practitioners’ Guide to Teaching Thinking Series), Pacific Grove, CA: Midwest Publications.
• Norris, Stephen P. and Ruth Elizabeth King, 1983, Test on Appraising Observations , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland.
• –––, 1984, The Design of a Critical Thinking Test on Appraising Observations , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland. ERIC Document ED260083.
• –––, 1985, Test on Appraising Observations: Manual , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland.
• –––, 1990a, Test on Appraising Observations , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland, 2nd edition.
• –––, 1990b, Test on Appraising Observations: Manual , St. John’s, NL: Institute for Educational Research and Development, Memorial University of Newfoundland, 2nd edition.
• OCR [Oxford, Cambridge and RSA Examinations], 2011, AS/A Level GCE: Critical Thinking – H052, H452 , Cambridge: OCR. Past papers available at https://pastpapers.co/ocr/?dir=A-Level/Critical-Thinking-H052-H452; last accessed 2022 07 16.
• Ontario Ministry of Education, 2013, The Ontario Curriculum Grades 9 to 12: Social Sciences and Humanities . Available at http://www.edu.gov.on.ca/eng/curriculum/secondary/ssciences9to122013.pdf ; last accessed 2022 07 16.
• Passmore, John Arthur, 1980, The Philosophy of Teaching , London: Duckworth.
• Paul, Richard W., 1981, “Teaching Critical Thinking in the ‘Strong’ Sense: A Focus on Self-Deception, World Views, and a Dialectical Mode of Analysis”, Informal Logic , 4(2): 2–7. [ Paul 1981 available online ]
• –––, 1984, “Critical Thinking: Fundamental to Education for a Free Society”, Educational Leadership , 42(1): 4–14.
• –––, 1985, “McPeck’s Mistakes”, Informal Logic , 7(1): 35–43. [ Paul 1985 available online ]
• Paul, Richard W. and Linda Elder, 2006, The Miniature Guide to Critical Thinking: Concepts and Tools , Dillon Beach, CA: Foundation for Critical Thinking, 4th edition.
• Payette, Patricia, and Edna Ross, 2016, “Making a Campus-Wide Commitment to Critical Thinking: Insights and Promising Practices Utilizing the Paul-Elder Approach at the University of Louisville”, Inquiry: Critical Thinking Across the Disciplines , 31(1): 98–110. doi:10.5840/inquiryct20163118
• Possin, Kevin, 2008, “A Field Guide to Critical-Thinking Assessment”, Teaching Philosophy , 31(3): 201–228. doi:10.5840/teachphil200831324
• –––, 2013a, “Some Problems with the Halpern Critical Thinking Assessment (HCTA) Test”, Inquiry: Critical Thinking across the Disciplines , 28(3): 4–12. doi:10.5840/inquiryct201328313
• –––, 2013b, “A Serious Flaw in the Collegiate Learning Assessment (CLA) Test”, Informal Logic , 33(3): 390–405. [ Possin 2013b available online ]
• –––, 2013c, “A Fatal Flaw in the Collegiate Learning Assessment Test”, Assessment Update , 25 (1): 8–12.
• –––, 2014, “Critique of the Watson-Glaser Critical Thinking Appraisal Test: The More You Know, the Lower Your Score”, Informal Logic , 34(4): 393–416. [ Possin 2014 available online ]
• –––, 2020, “CAT Scan: A Critical Review of the Critical-Thinking Assessment Test”, Informal Logic , 40 (3): 489–508. [Available online at https://informallogic.ca/index.php/informal_logic/article/view/6243]
• Rawls, John, 1971, A Theory of Justice , Cambridge, MA: Harvard University Press.
• Rear, David, 2019, “One Size Fits All? The Limitations of Standardised Assessment in Critical Thinking”, Assessment & Evaluation in Higher Education , 44(5): 664–675. doi: 10.1080/02602938.2018.1526255
• Rousseau, Jean-Jacques, 1762, Émile , Amsterdam: Jean Néaulme.
• Scheffler, Israel, 1960, The Language of Education , Springfield, IL: Charles C. Thomas.
• Scriven, Michael, and Richard W. Paul, 1987, Defining Critical Thinking , Draft statement written for the National Council for Excellence in Critical Thinking Instruction. Available at http://www.criticalthinking.org/pages/defining-critical-thinking/766 ; last accessed 2022 07 16.
• Sheffield, Clarence Burton Jr., 2018, “Promoting Critical Thinking in Higher Education: My Experiences as the Inaugural Eugene H. Fram Chair in Applied Critical Thinking at Rochester Institute of Technology”, Topoi , 37(1): 155–163. doi:10.1007/s11245-016-9392-1
• Siegel, Harvey, 1985, “McPeck, Informal Logic and the Nature of Critical Thinking”, in David Nyberg (ed.), Philosophy of Education 1985: Proceedings of the Forty-First Annual Meeting of the Philosophy of Education Society , Normal, IL: Philosophy of Education Society, pp. 61–72.
• –––, 1988, Educating Reason: Rationality, Critical Thinking, and Education , New York: Routledge.
• –––, 1999, “What (Good) Are Thinking Dispositions?”, Educational Theory , 49(2): 207–221. doi:10.1111/j.1741-5446.1999.00207.x
• Simon, Herbert A., 1956, “Rational Choice and the Structure of the Environment”, Psychological Review , 63(2): 129–138. doi: 10.1037/h0042769
• Simpson, Elizabeth, 1966–67, “The Classification of Educational Objectives: Psychomotor Domain”, Illinois Teacher of Home Economics , 10(4): 110–144, ERIC document ED0103613. [ Simpson 1966–67 available online ]
• Skolverket, 2018, Curriculum for the Compulsory School, Preschool Class and School-age Educare , Stockholm: Skolverket, revised 2018. Available at https://www.skolverket.se/download/18.31c292d516e7445866a218f/1576654682907/pdf3984.pdf; last accessed 2022 07 15.
• Smith, B. Othanel, 1953, “The Improvement of Critical Thinking”, Progressive Education , 30(5): 129–134.
• Smith, Eugene Randolph, Ralph Winfred Tyler, and the Evaluation Staff, 1942, Appraising and Recording Student Progress , Volume III of Adventure in American Education , New York and London: Harper & Brothers.
• Splitter, Laurance J., 1987, “Educational Reform through Philosophy for Children”, Thinking: The Journal of Philosophy for Children , 7(2): 32–39. doi:10.5840/thinking1987729
• Stanovich Keith E., and Paula J. Stanovich, 2010, “A Framework for Critical Thinking, Rational Thinking, and Intelligence”, in David D. Preiss and Robert J. Sternberg (eds), Innovations in Educational Psychology: Perspectives on Learning, Teaching and Human Development , New York: Springer Publishing, pp 195–237.
• Stanovich Keith E., Richard F. West, and Maggie E. Toplak, 2011, “Intelligence and Rationality”, in Robert J. Sternberg and Scott Barry Kaufman (eds.), Cambridge Handbook of Intelligence , Cambridge: Cambridge University Press, 3rd edition, pp. 784–826. doi:10.1017/CBO9780511977244.040
• Tankersley, Karen, 2005, Literacy Strategies for Grades 4–12: Reinforcing the Threads of Reading , Alexandria, VA: Association for Supervision and Curriculum Development.
• Thayer-Bacon, Barbara J., 1992, “Is Modern Critical Thinking Theory Sexist?”, Inquiry: Critical Thinking Across the Disciplines , 10(1): 3–7. doi:10.5840/inquiryctnews199210123
• –––, 1993, “Caring and Its Relationship to Critical Thinking”, Educational Theory , 43(3): 323–340. doi:10.1111/j.1741-5446.1993.00323.x
• –––, 1995a, “Constructive Thinking: Personal Voice”, Journal of Thought , 30(1): 55–70.
• –––, 1995b, “Doubting and Believing: Both are Important for Critical Thinking”, Inquiry: Critical Thinking across the Disciplines , 15(2): 59–66. doi:10.5840/inquiryctnews199515226
• –––, 2000, Transforming Critical Thinking: Thinking Constructively , New York: Teachers College Press.
• Toulmin, Stephen Edelston, 1958, The Uses of Argument , Cambridge: Cambridge University Press.
• Turri, John, Mark Alfano, and John Greco, 2017, “Virtue Epistemology”, in Edward N. Zalta (ed.), The Stanford Encyclopedia of Philosophy (Winter 2017 Edition). URL = < https://plato.stanford.edu/archives/win2017/entries/epistemology-virtue/ >
• Vincent-Lancrin, Stéphan, Carlos González-Sancho, Mathias Bouckaert, Federico de Luca, Meritxell Fernández-Barrerra, Gwénaël Jacotin, Joaquin Urgel, and Quentin Vidal, 2019, Fostering Students’ Creativity and Critical Thinking: What It Means in School. Educational Research and Innovation , Paris: OECD Publishing.
• Warren, Karen J. 1988. “Critical Thinking and Feminism”, Informal Logic , 10(1): 31–44. [ Warren 1988 available online ]
• Watson, Goodwin, and Edward M. Glaser, 1980a, Watson-Glaser Critical Thinking Appraisal, Form A , San Antonio, TX: Psychological Corporation.
• –––, 1980b, Watson-Glaser Critical Thinking Appraisal: Forms A and B; Manual , San Antonio, TX: Psychological Corporation,
• –––, 1994, Watson-Glaser Critical Thinking Appraisal, Form B , San Antonio, TX: Psychological Corporation.
• Weinstein, Mark, 1990, “Towards a Research Agenda for Informal Logic and Critical Thinking”, Informal Logic , 12(3): 121–143. [ Weinstein 1990 available online ]
• –––, 2013, Logic, Truth and Inquiry , London: College Publications.
• Willingham, Daniel T., 2019, “How to Teach Critical Thinking”, Education: Future Frontiers , 1: 1–17. [Available online at https://prod65.education.nsw.gov.au/content/dam/main-education/teaching-and-learning/education-for-a-changing-world/media/documents/How-to-teach-critical-thinking-Willingham.pdf.]
• Zagzebski, Linda Trinkaus, 1996, Virtues of the Mind: An Inquiry into the Nature of Virtue and the Ethical Foundations of Knowledge , Cambridge: Cambridge University Press. doi:10.1017/CBO9781139174763

How to cite this entry . Preview the PDF version of this entry at the Friends of the SEP Society . Look up topics and thinkers related to this entry at the Internet Philosophy Ontology Project (InPhO). Enhanced bibliography for this entry at PhilPapers , with links to its database.

• Association for Informal Logic and Critical Thinking (AILACT)
• Critical Thinking Across the European Higher Education Curricula (CRITHINKEDU)
• Critical Thinking Definition, Instruction, and Assessment: A Rigorous Approach
• Critical Thinking Research (RAIL)
• Foundation for Critical Thinking
• Insight Assessment
• Partnership for 21st Century Learning (P21)
• The Critical Thinking Consortium
• The Nature of Critical Thinking: An Outline of Critical Thinking Dispositions and Abilities , by Robert H. Ennis

abilities | bias, implicit | children, philosophy for | civic education | decision-making capacity | Dewey, John | dispositions | education, philosophy of | epistemology: virtue | logic: informal

Copyright © 2022 by David Hitchcock < hitchckd @ mcmaster . ca >

• Accessibility

Support SEP

Mirror sites.

View this site from another server:

• Info about mirror sites

The Stanford Encyclopedia of Philosophy is copyright © 2024 by The Metaphysics Research Lab , Department of Philosophy, Stanford University

Library of Congress Catalog Data: ISSN 1095-5054

• school Campus Bookshelves
• menu_book Bookshelves
• perm_media Learning Objects
• login Login
• how_to_reg Request Instructor Account
• hub Instructor Commons

Margin Size

• Download Page (PDF)
• Download Full Book (PDF)
• Periodic Table
• Physics Constants
• Scientific Calculator
• Reference & Cite
• Tools expand_more
• Readability

selected template will load here

This action is not available.

6.1: Thinking Critically About Sources

• Last updated
• Save as PDF
• Page ID 81190

• Cheryl Lowry
• The Ohio State University via Ohio State University Libraries

\( \newcommand{\vecs}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)

\( \newcommand{\vecd}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash {#1}}} \)

\( \newcommand{\id}{\mathrm{id}}\) \( \newcommand{\Span}{\mathrm{span}}\)

( \newcommand{\kernel}{\mathrm{null}\,}\) \( \newcommand{\range}{\mathrm{range}\,}\)

\( \newcommand{\RealPart}{\mathrm{Re}}\) \( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)

\( \newcommand{\Argument}{\mathrm{Arg}}\) \( \newcommand{\norm}[1]{\| #1 \|}\)

\( \newcommand{\inner}[2]{\langle #1, #2 \rangle}\)

\( \newcommand{\Span}{\mathrm{span}}\)

\( \newcommand{\id}{\mathrm{id}}\)

\( \newcommand{\kernel}{\mathrm{null}\,}\)

\( \newcommand{\range}{\mathrm{range}\,}\)

\( \newcommand{\RealPart}{\mathrm{Re}}\)

\( \newcommand{\ImaginaryPart}{\mathrm{Im}}\)

\( \newcommand{\Argument}{\mathrm{Arg}}\)

\( \newcommand{\norm}[1]{\| #1 \|}\)

\( \newcommand{\Span}{\mathrm{span}}\) \( \newcommand{\AA}{\unicode[.8,0]{x212B}}\)

\( \newcommand{\vectorA}[1]{\vec{#1}}      % arrow\)

\( \newcommand{\vectorAt}[1]{\vec{\text{#1}}}      % arrow\)

\( \newcommand{\vectorB}[1]{\overset { \scriptstyle \rightharpoonup} {\mathbf{#1}} } \)

\( \newcommand{\vectorC}[1]{\textbf{#1}} \)

\( \newcommand{\vectorD}[1]{\overrightarrow{#1}} \)

\( \newcommand{\vectorDt}[1]{\overrightarrow{\text{#1}}} \)

\( \newcommand{\vectE}[1]{\overset{-\!-\!\rightharpoonup}{\vphantom{a}\smash{\mathbf {#1}}}} \)

Thinking Critically About Sources

Evaluating sources often involves piecing together clues.

This section teaches how to identify relevant and credible sources that you have most likely turned up on the Web and on your results pages of the library catalog, Google Scholar, and specialized databases. Relevant, credible sources will meet the information needs of your of your research project.

In order to evaluate a source, you have to answer two questions about it:

• Is this source relevant to my research question?
• Is this a credible source– a source my audience and I should be able to believe?

It’s important to determine relevance before credibility because no mater how credible a source is, if it’s not relevant to your research question it’s useless to you for this project.

TIP: Other Criteria from Your Professor

Don’t forget that you also have to make sure your sources meet any other criteria that your professor may have given you for this assignment. For instance, professors often stipulate that, some of your sources have to be scholarly sources or articles from a particular database.

So make sure you have identified enough of the kind of sources your professor has requested.

You might already be worrying about how long evaluating sources is going to take. So let’s say right off that you won’t have to read all of a source to decide whether it is relevant and credible. (Later, of course, it will take a closer read to determine what direct quotes, paraphrases, and summaries you may want to use from the sources you have selected.)

Nonetheless, our advice is to not begrudge the time you spend evaluating sources. It’s one of the most important things to learn at college—the opportunity to evaluate sources is one of the big reasons your professors assign research projects. And your future employers will expect you to have learned how to do it. For the rest of your professional and personal life, you will be using the critical thinking skills that make choosing the right sources possible. So learning those skills is a good investment.

Happily, you’ll also get faster the more you do it.

ACTIVITY: Evaluation Basics

Open activity in a Web browser .

Making Inferences: Good Enough for Your Purpose?

Sources should always be evaluated relative to your purpose-why you’re looking for information. But because there often aren’t clear-cut answers when you evaluate sources, most of the time it is inferences-educated guesses from available clues- that you have to make about whether to use information from particular sources.

Your information needs will dictate:

• What kind of information will help.
• How serious you consider the consequences of making a mistake by using information that turns out to be inaccurate. When the consequences aren’t very serious, it’s easier to decide a source and its information are good enough for your purpose. Of course, there’s a lot to be said for always having accurate information, regardless.
• How hard you’re willing to work to get the credible, timely information that suits your purpose. (What you’re learning here will make it easier.)

Thus, your standards for relevance and credibility may vary, depending on whether you need, say,:

• Information about a personal health problem.
• An image you can use on a poster.
• Evidence to win a bet with a rival in the dorm.
• Dates and times a movie is showing locally.
• A game to have fun with.
• Evidence for your argument in a term paper.

For your research assignments or a health problem, the consequences may be great if you use information that is not relevant or not credible.

Activity: Quick Check

Instructions: Select one answer to each question. Open activity in a web browser.

Please log in to save materials. Log in

• Austin Community College
• Effective Learning Strategies
• Student Success

Critical Thinking and Evaluating Information

LEARNING OBJECTIVES

By the end of this section, you will be able to:

Define critical thinking

• Describe the role that logic plays in critical thinking
• Describe how both critical and creative thinking skills can be used to problem-solve
• Describe how critical thinking skills can be used to evaluate information
• Apply the CRAAP test to evaluate sources of information
• Identify strategies for developing yourself as a critical thinker

Critical Thinking

As a college student, you are tasked with engaging and expanding your thinking skills. One of the most important of these skills is critical thinking because it relates to nearly all tasks, situations, topics, careers, environments, challenges, and opportunities. It is a “domain-general” thinking skill, not one that is specific to a particular subject area.

What Is Critical Thinking?

Critical thinking  is clear, reasonable, reflective thinking focused on deciding what to believe or do. It means asking probing questions like “How do we know?” or “Is this true in every case or just in this instance?” It involves being skeptical and challenging assumptions rather than simply memorizing facts or blindly accepting what you hear or read.

Imagine, for example, that you’re reading a history textbook. You wonder who wrote it and why, because you detect certain biases in the writing. You find that the author has a limited scope of research focused only on a particular group within a population. In this case, your critical thinking reveals that there are “other sides to the story.”

Who are critical thinkers, and what characteristics do they have in common? Critical thinkers are usually curious and reflective people. They like to explore and probe new areas and seek knowledge, clarification, and new solutions. They ask pertinent questions, evaluate statements and arguments, and they distinguish between facts and opinion. They are also willing to examine their own beliefs, possessing a manner of humility that allows them to admit lack of knowledge or understanding when needed. They are open to changing their mind. Perhaps most of all, they actively enjoy learning, and seeking new knowledge is a lifelong pursuit. This may well be you!

No matter where you are on the road to being a critical thinker, you can always more fully develop and finely tune your skills. Doing so will help you develop more balanced arguments, express yourself clearly, read critically, and glean important information efficiently. Critical thinking skills will help you in any profession or any circumstance of life, from science to art to business to teaching. With critical thinking, you become a clearer thinker and problem solver.

Critical Thinking and Logic

Critical thinking is fundamentally a process of questioning information and data. You may question the information you read in a textbook, or you may question what a politician or a professor or a classmate says. You can also question a commonly-held belief or a new idea. With critical thinking, anything and everything is subject to question and examination for the purpose of logically constructing reasoned perspectives.

What Is Logic?

The word  logic  comes from the Ancient Greek  logike , referring to the science or art of reasoning. Using logic, a person evaluates arguments and reasoning and strives to distinguish between good and bad reasoning, or between truth and falsehood. Using logic, you can evaluate the ideas and claims of others, make good decisions, and form sound beliefs about the world. [1]

Questions of Logic in Critical Thinking

Let’s use a simple example of applying logic to a critical-thinking situation. In this hypothetical scenario, a man has a Ph.D. in political science, and he works as a professor at a local college. His wife works at the college, too. They have three young children in the local school system, and their family is well known in the community. The man is now running for political office. Are his credentials and experience sufficient for entering public office? Will he be effective in the political office? Some voters might believe that his personal life and current job, on the surface, suggest he will do well in the position, and they will vote for him. In truth, the characteristics described don’t guarantee that the man will do a good job. The information is somewhat irrelevant. What else might you want to know? How about whether the man had already held a political office and done a good job? In this case, we want to think critically about how much information is adequate in order to make a decision based on  logic  instead of  assumptions.

The following questions, presented in Figure 1, below, are ones you may apply to formulating a logical, reasoned perspective in the above scenario or any other situation:

• What’s happening?  Gather the basic information and begin to think of questions.
• Why is it important?  Ask yourself why it’s significant and whether or not you agree.
• What don’t I see?  Is there anything important missing?
• How do I know?  Ask yourself where the information came from and how it was constructed.
• Who is saying it?  What’s the position of the speaker and what is influencing them?
• What else?   What if?  What other ideas exist and are there other possibilities?

Problem-Solving with Critical Thinking

For most people, a typical day is filled with critical thinking and problem-solving challenges. In fact, critical thinking and problem-solving go hand-in-hand. They both refer to using knowledge, facts, and data to solve problems effectively. But with problem-solving, you are specifically identifying, selecting, and defending your solution. Below are some examples of using critical thinking to problem-solve:

• Your roommate was upset and said some unkind words to you, which put a crimp in the relationship. You try to see through the angry behaviors to determine how you might best support the roommate and help bring the relationship back to a comfortable spot.
• Your campus club has been languishing due to lack of participation and funds. The new club president, though, is a marketing major and has identified some strategies to interest students in joining and supporting the club. Implementation is forthcoming.
• Your final art class project challenges you to conceptualize form in new ways. On the last day of class when students present their projects, you describe the techniques you used to fulfill the assignment. You explain why and how you selected that approach.
• Your math teacher sees that the class is not quite grasping a concept. She uses clever questioning to dispel anxiety and guide you to a new understanding of the concept.
• You have a job interview for a position that you feel you are only partially qualified for, although you really want the job and you are excited about the prospects. You analyze how you will explain your skills and experiences in a way to show that you are a good match for the prospective employer.
• You are doing well in college, and most of your college and living expenses are covered. But there are some gaps between what you want and what you feel you can afford. You analyze your income, savings, and budget to better calculate what you will need to stay in college and maintain your desired level of spending.

Problem-Solving Action Checklist

Problem-solving can be an efficient and rewarding process, especially if you are organized and mindful of critical steps and strategies. Remember to assume the attributes of a good critical thinker: if you are curious, reflective, knowledge-seeking, open to change, probing, organized, and ethical, your challenge or problem will be less of a hurdle, and you’ll be in a good position to find intelligent solutions. The steps outlined in this checklist will help you adhere to these qualities in your approach to any problem:

Critical and Creative Thinking

Critical and creative thinking (described in more detail in Chapter 6: Theories of Learning) complement each other when it comes to problem-solving. The following words, by Dr. Andrew Robert Baker, are excerpted from his “Thinking Critically and Creatively” essay. Dr. Baker illuminates some of the many ways that college students will be exposed to critical and creative thinking and how it can enrich their learning experiences.

THINKING CRITICALLY AND CREATIVELY Critical thinking skills are perhaps the most fundamental skills involved in making judgments and solving problems. You use them every day, and you can continue improving them. The ability to think critically about a matter—to analyze a question, situation, or problem down to its most basic parts—is what helps us evaluate the accuracy and truthfulness of statements, claims, and information we read and hear. It is the sharp knife that, when honed, separates fact from fiction, honesty from lies, and the accurate from the misleading. We all use this skill to one degree or another almost every day. For example, we use critical thinking every day as we consider the latest consumer products and why one particular product is the best among its peers. Is it a quality product because a celebrity endorses it? Because a lot of other people may have used it? Because it is made by one company versus another? Or perhaps because it is made in one country or another? These are questions representative of critical thinking. The academic setting demands more of us in terms of critical thinking than everyday life. It demands that we evaluate information and analyze myriad issues. It is the environment where our critical thinking skills can be the difference between success and failure. In this environment we must consider information in an analytical, critical manner. We must ask questions—What is the source of this information? Is this source an expert one and what makes it so? Are there multiple perspectives to consider on an issue? Do multiple sources agree or disagree on an issue? Does quality research substantiate information or opinion? Do I have any personal biases that may affect my consideration of this information? It is only through purposeful, frequent, intentional questioning such as this that we can sharpen our critical thinking skills and improve as students, learners and researchers. While critical thinking analyzes information and roots out the true nature and facets of problems, it is creative thinking that drives progress forward when it comes to solving these problems. Exceptional creative thinkers are people that invent new solutions to existing problems that do not rely on past or current solutions. They are the ones who invent solution C when everyone else is still arguing between A and B. Creative thinking skills involve using strategies to clear the mind so that our thoughts and ideas can transcend the current limitations of a problem and allow us to see beyond barriers that prevent new solutions from being found. Brainstorming is the simplest example of intentional creative thinking that most people have tried at least once. With the quick generation of many ideas at once, we can block-out our brain’s natural tendency to limit our solution-generating abilities so we can access and combine many possible solutions/thoughts and invent new ones. It is sort of like sprinting through a race’s finish line only to find there is new track on the other side and we can keep going, if we choose. As with critical thinking, higher education both demands creative thinking from us and is the perfect place to practice and develop the skill. Everything from word problems in a math class, to opinion or persuasive speeches and papers, call upon our creative thinking skills to generate new solutions and perspectives in response to our professor’s demands. Creative thinking skills ask questions such as—What if? Why not? What else is out there? Can I combine perspectives/solutions? What is something no one else has brought-up? What is being forgotten/ignored? What about ______? It is the opening of doors and options that follows problem-identification. Consider an assignment that required you to compare two different authors on the topic of education and select and defend one as better. Now add to this scenario that your professor clearly prefers one author over the other. While critical thinking can get you as far as identifying the similarities and differences between these authors and evaluating their merits, it is creative thinking that you must use if you wish to challenge your professor’s opinion and invent new perspectives on the authors that have not previously been considered. So, what can we do to develop our critical and creative thinking skills? Although many students may dislike it, group work is an excellent way to develop our thinking skills. Many times I have heard from students their disdain for working in groups based on scheduling, varied levels of commitment to the group or project, and personality conflicts too, of course. True—it’s not always easy, but that is why it is so effective. When we work collaboratively on a project or problem we bring many brains to bear on a subject. These different brains will naturally develop varied ways of solving or explaining problems and examining information. To the observant individual we see that this places us in a constant state of back and forth critical/creative thinking modes. For example, in group work we are simultaneously analyzing information and generating solutions on our own, while challenging other’s analyses/ideas and responding to challenges to our own analyses/ideas. This is part of why students tend to avoid group work—it challenges us as thinkers and forces us to analyze others while defending ourselves, which is not something we are used to or comfortable with as most of our educational experiences involve solo work. Your professors know this—that’s why we assign it—to help you grow as students, learners, and thinkers! —Dr. Andrew Robert Baker,  Foundations of Academic Success: Words of Wisdom

Evaluating Information with Critical Thinking

Evaluating information can be one of the most complex tasks you will be faced with in college. But if you utilize the following four strategies, you will be well on your way to success:

• Read for understanding
• Examine arguments
• Clarify thinking
• Cultivate “habits of mind”

Read for Understanding

When you read, take notes or mark the text to track your thinking about what you are reading. As you make connections and ask questions in response to what you read,  you monitor your comprehension and enhance your long-term understanding of the material. You will want to mark important arguments and key facts. Indicate where you agree and disagree or have further questions. You don’t necessarily need to read every word, but make sure you understand the concepts or the intentions behind what is written. See the chapter on  Active Reading Strategies  for additional tips.

Examine Arguments

When you examine arguments or claims that an author, speaker, or other source is making, your goal is to identify and examine the hard facts. You can use the spectrum of authority strategy for this purpose. The spectrum of authority strategy assists you in identifying the “hot” end of an argument—feelings, beliefs, cultural influences, and societal influences—and the “cold” end of an argument—scientific influences. The most compelling arguments balance elements from both ends of the spectrum. The following video explains this strategy in further detail:

Clarify Thinking

When you use critical thinking to evaluate information, you need to clarify your thinking to yourself and likely to others. Doing this well is mainly a process of asking and answering probing questions, such as the logic questions discussed earlier. Design your questions to fit your needs, but be sure to cover adequate ground. What is the purpose? What question are we trying to answer? What point of view is being expressed? What assumptions are we or others making? What are the facts and data we know, and how do we know them? What are the concepts we’re working with? What are the conclusions, and do they make sense? What are the implications?

Cultivate “Habits of Mind”

“Habits of mind” are the personal commitments, values, and standards you have about the principle of good thinking. Consider your intellectual commitments, values, and standards. Do you approach problems with an open mind, a respect for truth, and an inquiring attitude? Some good habits to have when thinking critically are being receptive to having your opinions changed, having respect for others, being independent and not accepting something is true until you’ve had the time to examine the available evidence, being fair-minded, having respect for a reason, having an inquiring mind, not making assumptions, and always, especially, questioning your own conclusions—in other words, developing an intellectual work ethic. Try to work these qualities into your daily life.

In 2010, a textbook being used in fourth-grade classrooms in Virginia became big news for all the wrong reasons. The book,  Our Virginia  by Joy Masoff, had caught the attention of a parent who was helping her child do her homework, according to  an article in  The Washington Post . Carol Sheriff was a historian for the College of William and Mary and as she worked with her daughter, she began to notice some glaring historical errors, not the least of which was a passage which described how thousands of African Americans fought for the South during the Civil War.

Further investigation into the book revealed that, although the author had written textbooks on a variety of subjects, she was not a trained historian. The research she had done to write  Our Virginia,  and in particular the information she included about Black Confederate soldiers, was done through the Internet and included sources created by groups like the Sons of Confederate Veterans, an organization which promotes views of history that de-emphasize the role of slavery in the Civil War.

How did a book with errors like these come to be used as part of the curriculum and who was at fault? Was it Masoff for using untrustworthy sources for her research? Was it the editors who allowed the book to be published with these errors intact? Was it the school board for approving the book without more closely reviewing its accuracy?

There are a number of issues at play in the case of  Our Virginia , but there’s no question that evaluating sources is an important part of the research process and doesn’t just apply to Internet sources. Using inaccurate, irrelevant, or poorly researched sources can affect the quality of your own work. Being able to understand and apply the concepts that follow is crucial to becoming a more savvy user and creator of information.

When you begin evaluating sources, what should you consider? The  CRAAP test  is a series of common evaluative elements you can use to evaluate the  C urrency,  R elevance,  A uthority,  A ccuracy, and  P urpose of your sources. The CRAAP test was developed by librarians at California State University at Chico and it gives you a good, overall set of elements to look for when evaluating a resource. Let’s consider what each of these evaluative elements means. You can visit the ACC Library’s Web page for a tutorial on  Evaluating Information  using the CRAAP test.

One of the most important and interesting steps to take as you begin researching a subject is selecting the resources that will help you build your thesis and support your assertions. Certain topics require you to pay special attention to how current your resource is—because they are time sensitive, because they have evolved so much over the years, or because new research comes out on the topic so frequently. When evaluating the currency of an article, consider the following:

• When was the item written, and how frequently does the publication come out?
• Is there evidence of newly added or updated information in the item?
• If the information is dated, is it still suitable for your topic?
• How frequently does information change about your topic?

Understanding what resources are most applicable to your subject and why they are applicable can help you focus and refine your thesis. Many topics are broad and searching for information on them produces a wide range of resources. Narrowing your topic and focusing on resources specific to your needs can help reduce the piles of information and help you focus in on what is truly important to read and reference. When determining relevance consider the following:

• Does the item contain information relevant to your argument or thesis?
• Read the article’s introduction, thesis, and conclusion.
• Scan main headings and identify article keywords.
• For book resources, start with the index or table of contents—how wide a scope does the item have? Will you use part or all of this resource?
• Does the information presented support or refute your ideas?
• If the information refutes your ideas, how will this change your argument?
• Does the material provide you with current information?
• What is the material’s intended audience?

Understanding more about your information’s source helps you determine when, how, and where to use that information. Is your author an expert on the subject? Do they have some personal stake in the argument they are making? What is the author or information producer’s background? When determining the authority of your source, consider the following:

• What are the author’s credentials?
• What is the author’s level of education, experience, and/or occupation?
• What qualifies the author to write about this topic?
• What affiliations does the author have? Could these affiliations affect their position?
• What organization or body published the information? Is it authoritative? Does it have an explicit position or bias?

Determining where information comes from, if the evidence supports the information, and if the information has been reviewed or refereed can help you decide how and whether to use a source. When determining the accuracy of a source, consider the following:

• Is the source well-documented? Does it include footnotes, citations, or a bibliography?
• Is information in the source presented as fact, opinion, or propaganda? Are biases clear?
• Can you verify information from the references cited in the source?
• Is the information written clearly and free of typographical and grammatical mistakes? Does the source look to be edited before publication? A clean, well-presented paper does not always indicate accuracy, but usually at least means more eyes have been on the information.

Knowing why the information was created is a key to evaluation. Understanding the reason or purpose of the information, if the information has clear intentions, or if the information is fact, opinion, or propaganda will help you decide how and why to use information:

• Is the author’s purpose to inform, sell, persuade, or entertain?
• Does the source have an obvious bias or prejudice?
• Is the article presented from multiple points of view?
• Does the author omit important facts or data that might disprove their argument?
• Is the author’s language informal, joking, emotional, or impassioned?
• Is the information clearly supported by evidence?

When you feel overwhelmed by the information you are finding, the CRAAP test can help you determine which information is the most useful to your research topic. How you respond to what you find out using the CRAAP test will depend on your topic. Maybe you want to use two overtly biased resources to inform an overview of typical arguments in a particular field. Perhaps your topic is historical and currency means the past hundred years rather than the past one or two years. Use the CRAAP test, be knowledgeable about your topic, and you will be on your way to evaluating information efficiently and well!

Developing Yourself As a Critical Thinker

Critical thinking is a fundamental skill for college students, but it should also be a lifelong pursuit. Below are additional strategies to develop yourself as a critical thinker in college and in everyday life:

• Reflect and practice : Always reflect on what you’ve learned. Is it true all the time? How did you arrive at your conclusions?
• Use wasted time : It’s certainly important to make time for relaxing, but if you find you are indulging in too much of a good thing, think about using your time more constructively. Determine when you do your best thinking and try to learn something new during that part of the day.
• Redefine the way you see things : It can be very uninteresting to always think the same way. Challenge yourself to see familiar things in new ways. Put yourself in someone else’s shoes and consider things from a different angle or perspective.  If you’re trying to solve a problem, list all your concerns: what you need in order to solve it, who can help, what some possible barriers might be, etc. It’s often possible to reframe a problem as an opportunity. Try to find a solution where there seems to be none.
• Analyze the influences on your thinking and in your life : Why do you think or feel the way you do? Analyze your influences. Think about who in your life influences you. Do you feel or react a certain way because of social convention, or because you believe it is what is expected of you? Try to break out of any molds that may be constricting you.
• Express yourself : Critical thinking also involves being able to express yourself clearly. Most important in expressing yourself clearly is stating one point at a time. You might be inclined to argue every thought, but you might have greater impact if you focus just on your main arguments. This will help others to follow your thinking clearly. For more abstract ideas, assume that your audience may not understand. Provide examples, analogies, or metaphors where you can.
• Enhance your wellness : It’s easier to think critically when you take care of your mental and physical health. Try taking activity breaks throughout the day to reach 30 to 60 minutes of physical activity each day. Scheduling physical activity into your day can help lower stress and increase mental alertness. Also,  do your most difficult work when you have the most energy . Think about the time of day you are most effective and have the most energy. Plan to do your most difficult work during these times. And be sure to  reach out for help i f you feel you need assistance with your mental or physical health (see  Maintaining Your Mental and Physical Health  for more information).

Complete Section #2 Below: ACTIVITY: REFLECT ON CRITICAL THINKING

Key takeaways.

• Critical thinking is logical and reflective thinking focused on deciding what to believe or do.
• Critical thinking involves questioning and evaluating information.
• Critical and creative thinking both contribute to our ability to solve problems in a variety of contexts.
• Evaluating information is a complex, but essential, process. You can use the CRAAP test to help determine if sources and information are reliable.
• You can take specific actions to develop and strengthen your critical thinking skills.

ACTIVITY: REFLECT ON CRITICAL THINKING

• Apply critical thinking strategies to your life

Directions:

• Think about someone you consider to be a critical thinker (friend, professor, historical figure, etc). What qualities does he/she have?
• Review some of the critical thinking strategies discussed on this page. Pick one strategy that makes sense to you. How can you apply this critical thinking technique to your academic work?
• Habits of mind are attitudes and beliefs that influence how you approach the world (i.e., inquiring attitude, open mind, respect for truth, etc). What is one habit of mind you would like to actively develop over the next year? How will you develop a daily practice to cultivate this habit?
• Write your responses in journal form, and submit according to your instructor’s guidelines.

Version History

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

E valuating resources often means piecing together clues

This section teaches you how to identify relevant and credible sources that have most likely turned up when searching the Web and on your results pages of the library catalog and specialized databases. Remember you always want to look for relevant, credible sources that will meet the information needs of your research project.

In order to evaluate a source, you have to read and review the information keeping in mind two very important questions:

• Is this source relevant to my research question?
• Is this a credible source– a source my audience and I should be able to believe

Note: As you read an academic paper you will need to determine relevance before credibility because no matter how credible a source is if it’s not relevant to your research question it’s useless to you for this project. Reading research-centric papers can be challenging. Check out the tips in the video below.

UBC iSchool. (2013). How to read an academic paper . https://youtu.be/SKxm2HF_-k0

Happily, you’ll also get faster the more you do it.

Making Inferences: Good Enough for Your Purpose?

Sources should always be evaluated relative to your purpose-why you’re looking for information. But because there often aren’t clear-cut answers when you evaluate sources, most of the time it is inferences, educated guesses from available clues, that you have to make about whether to use information from particular sources.

Your information needs will dictate:

• What kind of information will help?
• How serious you consider the consequences of making a mistake by using information that turns out to be inaccurate. When the consequences aren’t very serious, it’s easier to decide if a source and its information are good enough for your purpose. Of course, there’s a lot to be said for always having accurate information, regardless.
• How hard you’re willing to work to get the credible, timely information that suits your purpose. (What you’re learning here will make it easier.)

Thus, your standards for relevance and credibility may vary, depending on whether you need, say:

• Information about a personal health problem.
• An image you can use on a poster.
• Evidence to win a bet with a rival in the dorm.
• Dates and times a movie is showing locally.
• A game to have fun with.
• Evidence for your argument in a term paper.

For your research assignments or a health problem, the consequences may be great if you use information that is not relevant or not credible.

Evaluating Sources

There are many approaches to evaluating your web and library resources. One that is quite useful is the SIFT process. 

Critical Thinking in Academic Research Copyright © 2022 by Cindy Gruwell and Robin Ewing is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License , except where otherwise noted.

Share This Book

• Programs & Services
• Delphi Center

Ideas to Action (i2a)

• Paul-Elder Critical Thinking Framework

Critical thinking is that mode of thinking – about any subject, content, or problem — in which the thinker improves the quality of his or her thinking by skillfully taking charge of the structures inherent in thinking and imposing intellectual standards upon them. (Paul and Elder, 2001). The Paul-Elder framework has three components:

• The elements of thought (reasoning)
• The  intellectual standards that should be applied to the elements of reasoning
• The intellectual traits associated with a cultivated critical thinker that result from the consistent and disciplined application of the intellectual standards to the elements of thought

According to Paul and Elder (1997), there are two essential dimensions of thinking that students need to master in order to learn how to upgrade their thinking. They need to be able to identify the "parts" of their thinking, and they need to be able to assess their use of these parts of thinking.

Elements of Thought (reasoning)

The "parts" or elements of thinking are as follows:

• All reasoning has a purpose
• All reasoning is an attempt to figure something out, to settle some question, to solve some problem
• All reasoning is based on assumptions
• All reasoning is done from some point of view
• All reasoning is based on data, information and evidence
• All reasoning is expressed through, and shaped by, concepts and ideas
• All reasoning contains inferences or interpretations by which we draw conclusions and give meaning to data
• All reasoning leads somewhere or has implications and consequences

Universal Intellectual Standards

The intellectual standards that are to these elements are used to determine the quality of reasoning. Good critical thinking requires having a command of these standards. According to Paul and Elder (1997 ,2006), the ultimate goal is for the standards of reasoning to become infused in all thinking so as to become the guide to better and better reasoning. The intellectual standards include:

Intellectual Traits

Consistent application of the standards of thinking to the elements of thinking result in the development of intellectual traits of:

• Intellectual Humility
• Intellectual Courage
• Intellectual Empathy
• Intellectual Autonomy
• Intellectual Integrity
• Intellectual Perseverance
• Confidence in Reason
• Fair-mindedness

Characteristics of a Well-Cultivated Critical Thinker

Habitual utilization of the intellectual traits produce a well-cultivated critical thinker who is able to:

• Raise vital questions and problems, formulating them clearly and precisely
• Gather and assess relevant information, using abstract ideas to interpret it effectively
• Come to well-reasoned conclusions and solutions, testing them against relevant criteria and standards;
• Think open-mindedly within alternative systems of thought, recognizing and assessing, as need be, their assumptions, implications, and practical consequences; and
• Communicate effectively with others in figuring out solutions to complex problems

Paul, R. and Elder, L. (2010). The Miniature Guide to Critical Thinking Concepts and Tools. Dillon Beach: Foundation for Critical Thinking Press.

• SACS & QEP
• Planning and Implementation
• What is Critical Thinking?
• Why Focus on Critical Thinking?
• Culminating Undergraduate Experience
• Community Engagement
• Frequently Asked Questions
• What is i2a?

Copyright © 2012 - University of Louisville , Delphi Center

Research Skills: Quality and Relevance of Information

• Using the Unisa Library Homepage
• Formulate an Effective Search Strategy This link opens in a new window
• Finding Subject Databases
• Print Books
• Finding Journal Articles
• Theses and Dissertations
• Finding e-Reference Sources
• Finding e-Newspapers
• Types of Legal Resources
• Locating Legislation
• Locating Legal Sources
• Popular versus Scholarly
• Quality and Relevance of Information
• Opinion Versus Fact
• Primary versus Secondary Sources
• How to Evaluate Information on the Internet
• Managing Your References
• Keeping Up to Date
• Citation Analysis and Tracking
• Types of Citation Resources
• Citation Analysis Tools
• Conducting a Literature Search
• Taking Notes
• Productivity

Critical Thinking

What is critical thinking?

 The ability to critically analyse information is one of the most important skills you need as a researcher. This is not the same as summarising information but rather the ability to evaluate it, reflect on it, reject or accept it, and then to come to your own conclusion on which you can base your arguments.  This process of using logic and reason to establish which information is fact or opinion and then decising on your interpretation of it is known as critical thinking.  

A particularly useful definition of critical thinking was devised by William Graham Sumner:

 [Critical thinking is] . . . the examination and test of propositions of any kind which are offered for acceptance, in order to find out whether they correspond to reality or not. The critical faculty is a product of education and training. It is a mental habit and power. It is a prime condition of human welfare that men and women should be trained in it. It is our only guarantee against delusion, deception, superstition, and misapprehension of ourselves and our earthly circumstances.

Sumner, W. G. (1940).  Folkways: A Study of the Sociological Importance of Usages, Manners, Customs, Mores, and Morals , New York: Ginn and Co., pp. 632, 633. This quotation is taken from:  http://www.criticalthinking.org/pages/critical-thinking-in-the-oxford-tutorial-abstract/867  (accessed 24 July 2013).

Critical Reading

Critical reading is the ability to read effectively in order to understand the author's point of view. You also need to look for the author's particular biases, make judgements about the author's viewpoints and examine the evidence which has been used to support the author's arguments.

  SOME TIPS ON CRITICAL THINKING AND CRITICAL READING

• Ke ep your research topic in mind.

One of the starting points when you apply critical thinking and critical reading is your research topic.  When you begin your reading you will be looking for relevance to your topic, and you will search for information that supports or negates your hypothesis or hypotheses, together with whether the information is valid and convincing. Stick to the point and do not move away from the main focus of your topic.  

• Distinguish between Fact and Opinion

By understanding how various authors arrive at the many points of view on your topic, you will be better informed and better able to interpret the partial or complete validity or invalidity of academic opinion. Reading widely may likewise expose any errors or false assumptions in your own thinking and this will be of great benefit to your work.

•   Question everything.

Do not accept or believe information blindly. Examine the text for evidence of bias, prejudice, missteps in logic, inaccuracy, a lack of academic rigor, conflicts of interest, superficiality and so on. Question yourself, too, by the same standards that you apply to the authors you encounter.

•   Seek out diverse points of view.

This is one of the purposes of the literature review – to have an overview of the body of research on your topic and to be exposed to a wide range of opinion and argument. Read comparatively and do not seek only to confirm your existing opinions but challenge them by reading points of view opposed to yours.

•   Be open.

Be open to the way that new information can change your thoughts on a subject. The more you read, the more depth and complexity you will bring to your thinking and writing on a subject. Be willing to change your mind and be open to other arguments.  

• << Previous: Popular versus Scholarly
• Next: Opinion Versus Fact >>
• Last Updated: May 7, 2024 5:59 AM
• URL: https://libguides.unisa.ac.za/Research_Skills

Critical Thinking Definition, Skills, and Examples

• Homework Help
• Private School
• College Admissions
• College Life
• Graduate School
• Business School
• Distance Learning

• Indiana University, Bloomington
• State University of New York at Oneonta

Critical thinking refers to the ability to analyze information objectively and make a reasoned judgment. It involves the evaluation of sources, such as data, facts, observable phenomena, and research findings.

Good critical thinkers can draw reasonable conclusions from a set of information, and discriminate between useful and less useful details to solve problems or make decisions. Employers prioritize the ability to think critically—find out why, plus see how you can demonstrate that you have this ability throughout the job application process. 

Why Do Employers Value Critical Thinking Skills?

Employers want job candidates who can evaluate a situation using logical thought and offer the best solution.

 Someone with critical thinking skills can be trusted to make decisions independently, and will not need constant handholding.

Hiring a critical thinker means that micromanaging won't be required. Critical thinking abilities are among the most sought-after skills in almost every industry and workplace. You can demonstrate critical thinking by using related keywords in your resume and cover letter, and during your interview.

Examples of Critical Thinking

The circumstances that demand critical thinking vary from industry to industry. Some examples include:

• A triage nurse analyzes the cases at hand and decides the order by which the patients should be treated.
• A plumber evaluates the materials that would best suit a particular job.
• An attorney reviews evidence and devises a strategy to win a case or to decide whether to settle out of court.
• A manager analyzes customer feedback forms and uses this information to develop a customer service training session for employees.

Promote Your Skills in Your Job Search

If critical thinking is a key phrase in the job listings you are applying for, be sure to emphasize your critical thinking skills throughout your job search.

Add Keywords to Your Resume

You can use critical thinking keywords (analytical, problem solving, creativity, etc.) in your resume. When describing your  work history , include top critical thinking skills that accurately describe you. You can also include them in your  resume summary , if you have one.

For example, your summary might read, “Marketing Associate with five years of experience in project management. Skilled in conducting thorough market research and competitor analysis to assess market trends and client needs, and to develop appropriate acquisition tactics.”

Mention Skills in Your Cover Letter

Include these critical thinking skills in your cover letter. In the body of your letter, mention one or two of these skills, and give specific examples of times when you have demonstrated them at work. Think about times when you had to analyze or evaluate materials to solve a problem.

Show the Interviewer Your Skills

You can use these skill words in an interview. Discuss a time when you were faced with a particular problem or challenge at work and explain how you applied critical thinking to solve it.

Some interviewers will give you a hypothetical scenario or problem, and ask you to use critical thinking skills to solve it. In this case, explain your thought process thoroughly to the interviewer. He or she is typically more focused on how you arrive at your solution rather than the solution itself. The interviewer wants to see you analyze and evaluate (key parts of critical thinking) the given scenario or problem.

Of course, each job will require different skills and experiences, so make sure you read the job description carefully and focus on the skills listed by the employer.

Top Critical Thinking Skills

Keep these in-demand critical thinking skills in mind as you update your resume and write your cover letter. As you've seen, you can also emphasize them at other points throughout the application process, such as your interview. 

Part of critical thinking is the ability to carefully examine something, whether it is a problem, a set of data, or a text. People with  analytical skills  can examine information, understand what it means, and properly explain to others the implications of that information.

• Asking Thoughtful Questions
• Data Analysis
• Interpretation
• Questioning Evidence
• Recognizing Patterns

Communication

Often, you will need to share your conclusions with your employers or with a group of colleagues. You need to be able to  communicate with others  to share your ideas effectively. You might also need to engage in critical thinking in a group. In this case, you will need to work with others and communicate effectively to figure out solutions to complex problems.

• Active Listening
• Collaboration
• Explanation
• Interpersonal
• Presentation
• Verbal Communication
• Written Communication

Critical thinking often involves creativity and innovation. You might need to spot patterns in the information you are looking at or come up with a solution that no one else has thought of before. All of this involves a creative eye that can take a different approach from all other approaches.

• Flexibility
• Conceptualization
• Imagination
• Drawing Connections
• Synthesizing

Open-Mindedness

To think critically, you need to be able to put aside any assumptions or judgments and merely analyze the information you receive. You need to be objective, evaluating ideas without bias.

• Objectivity
• Observation

Problem Solving

Problem-solving is another critical thinking skill that involves analyzing a problem, generating and implementing a solution, and assessing the success of the plan. Employers don’t simply want employees who can think about information critically. They also need to be able to come up with practical solutions.

• Attention to Detail
• Clarification
• Decision Making
• Groundedness
• Identifying Patterns

More Critical Thinking Skills

• Inductive Reasoning
• Deductive Reasoning
• Noticing Outliers
• Adaptability
• Emotional Intelligence
• Brainstorming
• Optimization
• Restructuring
• Integration
• Strategic Planning
• Project Management
• Ongoing Improvement
• Causal Relationships
• Case Analysis
• Diagnostics
• SWOT Analysis
• Business Intelligence
• Quantitative Data Management
• Qualitative Data Management
• Risk Management
• Scientific Method
• Consumer Behavior

Key Takeaways

• Demonstrate that you have critical thinking skills by adding relevant keywords to your resume.
• Mention pertinent critical thinking skills in your cover letter, too, and include an example of a time when you demonstrated them at work.
• Finally, highlight critical thinking skills during your interview. For instance, you might discuss a time when you were faced with a challenge at work and explain how you applied critical thinking skills to solve it.

University of Louisville. " What is Critical Thinking ."

American Management Association. " AMA Critical Skills Survey: Workers Need Higher Level Skills to Succeed in the 21st Century ."

• Questions for Each Level of Bloom's Taxonomy
• Critical Thinking in Reading and Composition
• Bloom's Taxonomy in the Classroom
• Introduction to Critical Thinking
• How To Become an Effective Problem Solver
• Creativity & Creative Thinking
• Higher-Order Thinking Skills (HOTS) in Education
• 2020-21 Common Application Essay Option 4—Solving a Problem
• 6 Skills Students Need to Succeed in Social Studies Classes
• College Interview Tips: "Tell Me About a Challenge You Overcame"
• Types of Medical School Interviews and What to Expect
• The Horse Problem: A Math Challenge
• What to Do When the Technology Fails in Class
• What Are Your Strengths and Weaknesses? Interview Tips for Teachers
• A Guide to Business Letters Types
• How to Practice Critical Thinking in 4 Steps

Standards of Critical Thinking

Thinking towards truth..

Posted June 11, 2012 | Reviewed by Ekua Hagan

• What Is Cognition?
• Find counselling near me

What is critical thinking? According to my favorite critical thinking text , it is disciplined thinking that is governed by clear intellectual standards.

This involves identifying and analyzing arguments and truth claims, discovering and overcoming prejudices and biases, developing your own reasons and arguments in favor of what you believe, considering objections to your beliefs, and making rational choices about what to do based on your beliefs.

Clarity is an important standard of critical thought. Clarity of communication is one aspect of this. We must be clear in how we communicate our thoughts, beliefs, and reasons for those beliefs.

Careful attention to language is essential here. For example, when we talk about morality , one person may have in mind the conventional morality of a particular community, while another may be thinking of certain transcultural standards of morality. Defining our terms can greatly aid us in the quest for clarity.

Clarity of thought is important as well; this means that we clearly understand what we believe, and why we believe it.

Precision involves working hard at getting the issue under consideration before our minds in a particular way. One way to do this is to ask the following questions: What is the problem at issue? What are the possible answers? What are the strengths and weaknesses of each answer?

Accuracy is unquestionably essential to critical thinking. In order to get at or closer to the truth, critical thinkers seek accurate and adequate information. They want the facts because they need the right information before they can move forward and analyze it.

Relevance means that the information and ideas discussed must be logically relevant to the issue being discussed. Many pundits and politicians are great at distracting us away from this.

Consistency is a key aspect of critical thinking. Our beliefs should be consistent. We shouldn’t hold beliefs that are contradictory. If we find that we do hold contradictory beliefs, then one or both of those beliefs are false. For example, I would likely contradict myself if I believed both that " Racism is always immoral" and "Morality is entirely relative." This is a logical inconsistency.

There is another form of inconsistency, called practical inconsistency, which involves saying you believe one thing while doing another. For example, if I say that I believe my family is more important than my work, but I tend to sacrifice their interests for the sake of my work, then I am being practically inconsistent.

The last three standards are logical correctness, completeness, and fairness. Logical correctness means that one is engaging in correct reasoning from what we believe in a given instance to the conclusions that follow from those beliefs. Completeness means that we engage in deep and thorough thinking and evaluation, avoiding shallow and superficial thought and criticism. Fairness involves seeking to be open-minded, impartial, and free of biases and preconceptions that distort our thinking.

Like any skill or set of skills, getting better at critical thinking requires practice. Anyone wanting to grow in this area might think through these standards and apply them to an editorial in the newspaper or on the web, a blog post, or even their own beliefs. Doing so can be a useful and often meaningful exercise.

Michael W. Austin, Ph.D. , is a professor of philosophy at Eastern Kentucky University.

• Find a Therapist
• Find a Treatment Center
• Find a Psychiatrist
• Find a Support Group
• Find Online Therapy
• International
• New Zealand
• South Africa
• Switzerland
• Asperger's
• Bipolar Disorder
• Chronic Pain
• Eating Disorders
• Passive Aggression
• Personality
• Goal Setting
• Positive Psychology
• Stopping Smoking
• Low Sexual Desire
• Relationships
• Child Development
• Therapy Center NEW
• Diagnosis Dictionary
• Types of Therapy

Understanding what emotional intelligence looks like and the steps needed to improve it could light a path to a more emotionally adept world.

• Emotional Intelligence
• Gaslighting
• Affective Forecasting
• Neuroscience

• International Center for the Assessment of Higher Order Thinking
• Our Team of Presenters

• Dr. Richard Paul
• Dr. Linda Elder
• Dr. Gerald Nosich
• Permission to Use Our Work
• Create a CriticalThinking.Org Account
• Contributions to the Foundation for Critical Thinking
• Contact Us - Office Information
• Testimonials
• Center for Critical Thinking

The National Council for Excellence in Critical Thinking

Translate this page from English...

*Machine translated pages not guaranteed for accuracy. Click Here for our professional translations.

A Draft Statement of Principles

Goals The goals of the National Council for Excellence in Critical Thinking Instruction are as follows:

• To articulate, preserve, and foster high standards of research, scholarship, and instruction in critical thinking.
• To articulate the standards upon which "quality" thinking is based and the criteria by means of which thinking, and instruction for thinking, can be appropriately cultivated and assessed.
• To assess programs which claim to foster higher-order critical thinking.
• To disseminate information that aids educators and others in identifying quality critical thinking programs and approaches which ground the reform and restructuring of education on a systematic cultivation of disciplined universal and domain specific intellectual standards.

Founding Principles

• There is an intimate interrelation between knowledge and thinking.
• Knowing that something is so is not simply a matter of believing that it is so, it also entails being justified in that belief (Definition: Knowledge is justified true belief).
• There are general, as well as domain-specific, standards for the assessment of thinking.
• To achieve knowledge in any domain, it is essential to think critically.
• Critical thinking is based on articulable intellectual standards and hence is intrinsically subject to assessment by those standards.
• Criteria for the assessment of thinking in all domains are based on such general standards as: clarity, precision, accuracy, relevance, significance, fairness, logic, depth, and breadth, evidentiary support, probability, predictive or explanatory power. These standards, and others, are embedded not only in the history of the intellectual and scientific communities, but also in the self-assessing behavior of reasonable persons in everyday life. It is possible to teach all subjects in such a way as to encourage the use of these intellectual standards in both professional and personal life.
• Instruction in critical thinking should increasingly enable students to assess both their own thought and action and that of others by reference, ultimately, to standards such as those above. It should lead progressively, in other words, to a disciplining of the mind and to a self-chosen commitment to a life of intellectual and moral integrity.
• Instruction in all subject domains should result in the progressive disciplining of the mind with respect to the capacity and disposition to think critically within that domain. Hence, instruction in science should lead to disciplined scientific thinking; instruction in mathematics should lead to disciplined mathematical thinking; instruction in history should lead to disciplined historical thinking; and in a parallel manner in every discipline and domain of learning.
• Disciplined thinking with respect to any subject involves the capacity on the part of the thinker to recognize, analyze, and assess the basic elements of thought: the purpose or goal of the thinking; the problem or question at issue; the frame of reference or points of view involved; assumptions made; central concepts and ideas at work; principles or theories used; evidence, data, or reasons advanced, claims made and conclusions drawn; inferences, reasoning, and lines of formulated thought; and implications and consequences involved.
• Critical reading, writing, speaking, and listening are academically essential modes of learning. To be developed generally they must be systematically cultivated in a variety of subject domains as well as with respect to interdisciplinary issues. Each are modes of thinking which are successful to the extent that they are disciplined and guided by critical thought and reflection.
• The earlier that children develop sensitivity to the standards of sound thought and reasoning, the more likely they will develop desirable intellectual habits and become open-minded persons responsive to reasonable persuasion.
• Education - in contrast to training, socialization, and indoctrination - implies a process conducive to critical thought and judgment. It is intrinsically committed to the cultivation of reasonability and rationality.

History and Philosophy Critical thinking is integral to education and rationality and, as an idea, is traceable, ultimately, to the teaching practices — and the educational ideal implicit in them — of Socrates of ancient Greece. It has played a seminal role in the emergence of academic disciplines, as well as in the work of discovery of those who created them. Knowledge, in other words, has been discovered and verified by the distinguished critical thinkers of intellectual, scientific, and technological history. For the majority of the idea's history, however, critical thinking has been "buried," a conception in practice without an explicit name. Most recently, however, it has undergone something of an awakening, a coming-out, a first major social expression, signaling perhaps a turning-point in its history. This awakening is correlated with a growing awareness that if education is to produce critical thinkers en mass, if it is to globally cultivate nations of skilled thinkers and innovators rather than a scattering of thinkers amid an army of intellectually unskilled, undisciplined, and uncreative followers, then a renaissance and re-emergence of the idea of critical thinking as integral to knowledge and understanding is necessary. Such a reawakening and recognition began first in the USA in the later 30's and then surfaced in various forms in the 50's, 60's, and 70's, reaching its most public expression in the 80's and 90's. Nevertheless, despite the scholarship surrounding the idea, despite the scattered efforts to embody it in educational practice, the educational and social acceptance of the idea is still in its infancy, still largely misunderstood, still existing more in stereotype than in substance, more in image than in reality. The members of the Council (some 8000 plus educators) are committed to high standards of excellence in critical thinking instruction across the curriculum at all levels of education. They are, therefore, concerned with the proliferation of poorly conceived "thinking skills" programs with their simplistic — often slick — approaches to both thinking and instruction. If the current emphasis on critical thinking is genuinely to take root, if it is to avoid the traditional fate of passing educational fad and "buzz word," it is essential that the deep obstacles to its embodiment in quality education be recognized for what they are, reasonable strategies to combat them formulated by leading scholars in the field, and successful communication of both obstacles and strategies to the educational and broader community achieved. To this end, sound standards of the field of critical thinking research must be made accessible by clear articulation and the means set up for the large-scale dissemination of that articulation. The nature and challenge of critical thinking as an educational ideal must not be allowed to sink into the murky background of educational reform and restructuring efforts, while superficial ideas take its place. Critical thinking must assume its proper place at the hub of educational reform and restructuring. Critical thinking — and intellectual and social development generally — are not well-served when educational discussion is inundated with superficial conceptions of critical thinking and slick merchandizing of "thinking skills" programs while substantial — and necessarily more challenging conceptions and programs — are thrust aside, obscured, or ignored.

Elements of Thought

  If teachers want their students to think well, they must help students understand at least the rudiments of thought, the most basic structures out of which all thinking is made. In other words, students must learn how to take thinking apart. All thinking is defined by the eight elements that make it up. Eight basic structures are present in all thinking.  Whenever we think, we think for a purpose within a point of view based on assumptions leading to implications and consequences.  We use concepts, ideas, and theories to interpret data, facts, and experiences in order to answer questions, solve problems, and resolve issues.  Thinking, then, generates purposes, raises questions, uses information, utilizes concepts, makes inferences, makes assumptions, generates implications, and embodies a point of view. Students should understand that each of these structures has implications for the others. If they change their purpose or agenda, they change their questions and problems. If they change their questions and problems, they are forced to seek new information and data, and so on. Students should regularly use the following checklist for reasoning to improve their thinking in any discipline or subject area:

• State your purpose clearly.
• Distinguish your purpose from related purposes.
• Check periodically to be sure you are still on target.
• Choose significant and realistic purposes.
• State the question at issue clearly and precisely.
• Express the question in several ways to clarify its meaning and scope.
• Break the question into sub-questions.
• Distinguish questions that have definitive answers from those that are a matter of opinion and from those that require consideration of multiple viewpoints.
• Clearly identify your assumptions and determine whether they are justifiable.
• Consider how your assumptions are shaping your point of view.
• Identify your point of view.
• Seek other points of view and identify their strengths and weaknesses.
• Strive to be fair-minded in evaluating all points of view.
• Restrict your claims to those supported by the data you have.
• Search for information that opposes your position, as well as information that supports it.
• Make sure that all information used is clear, accurate, and relevant to the question at issue.
• Make sure you have gathered sufficient information.
• Identify key concepts and explain them clearly.
• Consider alternative concepts or alternative definitions of concepts.
• Make sure you are using concepts with care and precision.
• Infer only what the evidence implies.
• Check inferences for their consistency with each other.
• Identify assumptions that lead you to your inferences.
• Trace the implications and consequences that follow from your reasoning.
• Search for negative as well as positive implications.
• Consider all possible consequences.

Universal Intellectual Standards

Universal intellectual standards are standards which must be applied to thinking whenever one is interested in checking the quality of reasoning about a problem, issue, or situation. To think critically entails having command of these standards. To help students learn them, teachers should pose questions which probe student thinking, questions which hold students accountable for their thinking, questions which, through consistent use by the teacher in the classroom, become internalized by students as questions they need to ask themselves.

The ultimate goal, then, is for these questions to become infused in the thinking of students, forming part of their inner voice, which then guides them to better and better reasoning. While there are a number of universal standards, the following are the most significant:

Clarity is the gateway standard. If a statement is unclear, we cannot determine whether it is accurate or relevant. In fact, we cannot tell anything about it because we don’t yet know what it is saying. For example, the question "What can be done about the education system in America?" is unclear. In order to address the question adequately, we would need to have a clearer understanding of what the person asking the question is considering the "problem" to be. A clearer question might be "What can educators do to ensure that students learn the skills and abilities which help them function successfully on the job and in their daily decision-making?"

A statement can be clear but not accurate, as in "Most dogs are over 300 pounds in weight."

A statement can be both clear and accurate, but not precise, as in "Jack is overweight." (We don’t know how overweight Jack is, one pound or 500 pounds.)

A statement can be clear, accurate, and precise, but not relevant to the question at issue. For example, students often think that the amount of effort they put into a course should be used in raising their grade in a course. Often, however, the "effort" does not measure the quality of student learning, and when this is so , effort is irrelevant to their appropriate grade.

A statement can be clear, accurate, precise, and relevant, but superficial (that is, lacks depth). For example, the statement "Just say No," which is often used to discourage children and teens from using drugs, is clear, accurate, precise, and relevant. Nevertheless, it lacks depth because it treats an extremely complex issue, the pervasive problem of drug use among young people, superficially. It fails to deal with the complexities of the issue.

A line of reasoning may be clear accurate, precise, relevant, and deep, but lack breadth (as in an argument from either the conservative or liberal standpoint which gets deeply into an issue, but only recognizes the insights of one side of the question.)

When we think, we bring a variety of thoughts together into some order. When the combination of thoughts are mutually supporting and make sense in combination, the thinking is "logical." When the combination is not mutually supporting, is contradictory in some sense, or does not "make sense," the combination is not logical.

Valuable Intellectual Traits

Intellectual traits, or virtues, are interrelated intellectual habits that enable students to discipline and improve mental functioning. Teachers need to keep in mind that critical thinking can be used to serve two incompatible ends: self-centeredness or fair-mindedness. As students learn the basic intellectual skills that critical thinking entails, they can begin to use those skills in either a selfish or in a fair-minded way. For example, when students are taught how to recognize mistakes in reasoning (commonly called fallacies), most students readily see those mistakes in the reasoning of others but do not see them so readily in their own reasoning. Often they enjoy pointing out others' errors and develop some proficiency in making their opponents' thinking look bad, but they don't generally use their understanding of fallacies to analyze and assess their own reasoning. It is thus possible for students to develop as thinkers and yet not to develop as fair-minded thinkers. The best thinkers strive to be fair-minded, even when it means they have to give something up. They recognize that the mind is not naturally fair-minded, but selfish. And they understand that to be fair-minded, they must also develop particular traits of mind, traits such as intellectual humility, intellectual courage, intellectual empathy, intellectual integrity, intellectual perseverance, faith in reason, and fair-mindedness. Teachers should model and discuss the following intellectual traits as they help their students become fair-minded, ethical thinkers.  

• Intellectual Humility : Having a consciousness of the limits of one's knowledge, including a sensitivity to circumstances in which one's native egocentrism is likely to function self-deceptively; sensitivity to bias, prejudice and limitations of one's viewpoint. Intellectual humility depends on recognizing that one should not claim more than one actually knows. It does not imply spinelessness or submissiveness. It implies the lack of intellectual pretentiousness, boastfulness, or conceit, combined with insight into the logical foundations, or lack of such foundations, of one's beliefs.
• Intellectual Courage : Having a consciousness of the need to face and fairly address ideas, beliefs or viewpoints toward which we have strong negative emotions and to which we have not given a serious hearing. This courage is connected with the recognition that ideas considered dangerous or absurd are sometimes rationally justified (in whole or in part) and that conclusions and beliefs inculcated in us are sometimes false or misleading. To determine for ourselves which is which, we must not passively and uncritically "accept" what we have "learned." Intellectual courage comes into play here, because inevitably we will come to see some truth in some ideas considered dangerous and absurd, and distortion or falsity in some ideas strongly held in our social group. We need courage to be true to our own thinking in such circumstances. The penalties for non-conformity can be severe.
• Intellectual Empathy : Having a consciousness of the need to imaginatively put oneself in the place of others in order to genuinely understand them, which requires the consciousness of our egocentric tendency to identify truth with our immediate perceptions of long-standing thought or belief. This trait correlates with the ability to reconstruct accurately the viewpoints and reasoning of others and to reason from premises, assumptions, and ideas other than our own. This trait also correlates with the willingness to remember occasions when we were wrong in the past despite an intense conviction that we were right, and with the ability to imagine our being similarly deceived in a case-at-hand.
• Intellectual Integrity : Recognition of the need to be true to one's own thinking; to be consistent in the intellectual standards one applies; to hold one's self to the same rigorous standards of evidence and proof to which one holds one's antagonists; to practice what one advocates for others; and to honestly admit discrepancies and inconsistencies in one’s own thought and action.
• Intellectual Perseverance : Having a consciousness of the need to use intellectual insights and truths in spite of difficulties, obstacles, and frustrations; firm adherence to rational principles despite the irrational opposition of others; a sense of the need to struggle with confusion and unsettled questions over an extended period of time to achieve deeper understanding or insight.  

Faith In Reason: Confidence that, in the long run, one's own higher interests and those of humankind at large will be best served by giving the freest play to reason, by encouraging people to come to their own conclusions by developing their own rational faculties; faith that, with proper encouragement and cultivation, people can learn to think for themselves, to form rational viewpoints, draw reasonable conclusions, think coherently and logically, persuade each other by reason and become reasonable persons, despite the deep-seated obstacles in the native character of the human mind and in society as we know it.

Fair-mindedness : Having a consciousness of the need to treat all viewpoints alike, without reference to one's own feelings or vested interests, or the feelings or vested interests of one's friends, community or nation; implies adherence to intellectual standards without reference to one's own advantage or the advantage of one's group.

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

6-Evaluating Sources

2. Evaluating for Relevancy

Relevant sources are those that pertain to your research question. You’ll be able to identify them fairly quickly by reading or skimming particular parts of sources and maybe jotting down little tables that help you keep track. We’ll show you how below, including where to look in specific kinds of sources and what questions to ask yourself as you do.

One thing to consider early on as you make inferences about relevancy is the effect that timeliness– called a source’s currency–should have on deciding whether a source is relevant. Sometimes timeliness has a lot to do with relevancy; sometimes it is less important. Your research question and your discipline will determine that.

For instance, if your research question is about the life sciences, you probably should consider only the most recent sources relevant for citing because the life sciences are changing so quickly. There is a good chance that anything but the most recent sources may be out of date. So it’s a good idea to aim for life sciences sources no more than 5 years old. (An example of a discipline that calls for even newer sources is computer security.)

Sometimes emergencies change the schedule of what is recent enough. For instance, when the Covid-19 pandemic started, it was incredibility important for scientists to share their research information as quickly as possible. At that time, scientific information about Covid-19 could become outdated in weeks or months–before the peer review process was barely started.

Lives were at stake and for that reason, scientists started publishing their new research results on Covid-19 as preprints —publications of results that had not yet been peer-reviewed–in an attempt to have them be useful faster. Nonetheless, after preprint publication, the peer review process continued for much of that research.

But pre-prints didn’t start with the Covid pandemic. Around for more than 30 years and now at Cornell University, arXiv is a free distribution service and an open-access archive for more than two million scholarly articles first published as preprints in the fields of physics, mathematics, computer science, quantitative biology, quantitative finance, statistics, electrical engineering and systems science, and economics. Materials on the site are not peer-reviewed by arXiv itself. (arXiv is pronounced archive.)

Before using preprints as sources, talk with your professor about whether she or he recommends their use in your situation.

Many sciences other than life sciences primarily use newer content under 10 years old. But not always. That’s because the history department is not alone in valuing older content. For instance, mathematics is a discipline that makes heavy use of older content. So how important the currency of your sources is will depend on your research question and your discipline. Your professor can guide you about your own situation.

In most cases, it’s best not to use a hard and fast rule about how current your sources have to be. Instead, consider your discipline and research question and do some critical thinking. For example, suppose your research question is about the Edo Period in Japan (1603-1868) or about Robert Falcon Scott, who explored the Antarctic from 1901-1913. In these cases, an item from 1918 might be just as useful as an item from 2018 (although new information may have been found in the 100-year gap). But something from 1899 about Antarctica or from 1597 about Japan would not be current enough for these research questions.

These examples also give you two more clues about how to treat the timeliness or currency of sources as you consider relevance:

• Because of how long ago they lived or occurred, it would be unusual for many sources on Robert Scott or the Edo Period to have been published very recently. So, unlike sources for the life sciences, whether a source is very recent should probably not determine its relevancy to research questions about Scott or the Edo Period.
• Primary sources might be considered especially relevant to many humanities and other non-science research questions. For disciplines in the humanities, the phrase primary sources refers to sources created at the same time as something under study—in this case, things such as Scott’s diaries and expedition photographs, as well as paintings, literature, clothing, and household items from the Edo Period. They go a long way to explain faraway people and times. (See Primary, Secondary, & Tertiary Sources .) On the other hand, when science disciplines use the phrase primary source, they usually mean where they primarily find the information they consider valid—in research journals.

EXAMPLE: TED Currency

Check out how currency is handled on TED . This site provides videos of speakers talking about new ideas in technology, entertainment, and design. (That’s what TED stands for.) Some videos are labeled “Newest Talks,” and TED tells when every video was recorded. That’s because currency matters with TED Talks.

For your own sources for which timeliness matters, see the section below called Where to Look, which includes where to look in websites, articles, and books for information about a source’s currency.

Time-Saving Tips

Instead of thinking you have to read all of every source in order to figure out whether it’s relevant, read or skim only parts of each source. If you’re looking at the right parts, that should give you enough information to make an educated guess about relevancy and currency.

But what should you be looking for as you do that reading and skimming? One way to figure that out is to first parse your research question so that you can figure out its main concepts . (This is like identifying main concepts in your research question in order to search precisely, as we advise in Chapter 4.)

For instance, suppose your research question is: How does having diverse members in a group increase the critical thinking of the group?

What are this question’s main concepts? Our answer is: group diversity and critical thinking.

So when trying to judge which sources are relevant to these main concepts, you would assess whether each source you’ve found pertains to at least one of these main concepts. We recommend you jot down a little table like the one in the example below to keep track of which sources address each main concept.

To be considered relevant to your research question, a source wouldn’t necessarily have to cover all of your main concepts. But finding sources that do is ideal. Otherwise, you just have to make do with what you’ve got. Don’t forget that each source would have to pass the currency test, too, if the currency is important to your research question. So it saves time to record your decisions about the sources’ currency on your tables, too.

EXAMPLE: Sources’ Main Concepts and Currency

Research question: How does having diverse members in a group increase the critical thinking of the group?

The table in this hypothetical example indicates that both Sources A and C are relevant because each pertains to at least one main concept from the research question. Currency doesn’t seem to matter much to our research question, so all three sources were marked current. But since currency is all that Source B has to offer, it is not relevant for this project.

If you do make little tables for relevance, it’s probably a good idea to hang on to them. You might find them helpful later in your research process.

Where to Look in Websites, Articles, and Books

The information below tells where to look and what questions to ask yourself to assess the relevancy of articles, books, and websites. The name of a source seldom tells you enough about its relevance, so whatever you do, don’t stop evaluating after looking only at a website’s name or the title of another source.

Save time by looking in particular places in sources for information that will help you figure out whether the source is relevant to your research project. Much of our advice below comes from “Speedy Reading” in The Craft of Research , second edition, by Wayne Booth, Gregory Colomb, and Joseph Williams, University of Chicago Press, 2003, pp. 108-109.

On a website , check the name of the website and its articles for clues that they contain material relevant to your research question. Consider whether time should have an impact on what information can be considered relevant to your research question. If so:

• Skim any dates, datelines, What’s New pages, and press releases to see whether any website content works with the time considerations you need.
• Check for page creation or revision dates that you find. What you’ve already learned from other sources can also help. For instance, you may know that the information covered by a particular website, which seems relevant, is no longer considered the latest thinking. In that case, you could mark it irrelevant on your little table.
• Skim any site map and index on the website for key words related to your research question.
• Try the key words of your research question in the search box. Do you see enough content about your keywords to make you think parts of the website could be helpful?

For a research journal article, magazine article, or newspaper article , think about the title. Does it have something to do with your research question? Consider whether time should have an impact on what sources can be considered relevant. If so:

• Is the publication date of any of these three kinds of articles within your parameters?
• Skim the abstract of a journal article to see whether the article works with the time considerations you need. For instance, if there is a time period in your research question, does the article address the same time period or was it created during that time period?
• Look at the abstract and section headings in a journal article or the early parts of a newspaper or magazine article to locate the problem or question that the article addresses, its solution, and the outline of the article’s argument for its main claim. Can those help answer your research question? Do they make it seem as if the article will give you information about what others have written about your research question? Do they offer a description of the situation surrounding your research question?
• Do the journal article’s introduction and conclusion sections help you answer your research question and/or offer a description of the situation surrounding your question so you can explain in your final product why the question is important?
• Check whether the journal article’s bibliography contains keywords related to your research question. Do the sources cited by the bibliography pertain to your research question? (Bibliographies are especially good places to look for sources.)
• If you decide the newspaper or magazine article is relevant, look at sources quoted or otherwise identified within it. Those may be additional sources for you.

For a book (perhaps in its library catalog listing) , check whether the title and/or subtitle indicates the book could be about your research question. You can find a lot of such information about the book from its listing in a library catalog. Consider whether time should have an impact on what sources can be considered relevant.

• Is the publication date or copyright date (usually listed in the library catalog or on the back of the book’s title page) too early or late for any time constraints in your research question? Maybe it’s just right.
• Skim some of the preface and introduction to see whether the book works with the time considerations you need.
• Check the bibliography to see whether the sources cited are about your research question.
• Skim the book’s table of contents and any summary chapters to locate the problem or question that the book addresses, its solution, and the broad outline of the book’s argument for its main claim. Will any of that be helpful in answering your research question?
• Do those sections give you information about what others have written about your research question?
• Do they offer a description of the situation surrounding your research question?
• Look for your key words in the bibliography. Do the sources cited pertain to your research question?
• Skim the index for topics with the most page references. Do the topics with the most page references pertain to your research question?

ACTIVITY: Follow a Title’s Clues for Relevance

Instructions: This quiz asks you to use logic, the titles of sources, and their publication dates, to identify the source most likely to be relevant to each research question. (Outside of this quiz, sources are not actually in competition with one another to be relevant. But this seemed like a good way to have you practice your skills at assessing relevance.) Many titles and dates below are fictitious, but that doesn’t affect their relevance within the quiz. Book, journal, website, and newspaper titles are italicized; chapter and article titles are in quotes.

• For each, read the information about the research question and each source.
• For each, record your judgments on a little table that you jot down like those illustrated earlier.
• For each, mark your answer, which should be the most relevant source according to the little table you completed for the question.
• Check your answers with our feedback.

ACTIVITY: Connecting the Dots Beyond the Title

Instructions: You always need to go beyond the title of a source when judging relevance. In the previous activity, you evaluated the titles of sources for currency and relevance. For this activity, you will investigate beyond the title to see whether one of the (hypothetical) articles named in the last activity is indeed relevant to meeting your information needs.

• Read the abstract of the article below, using your critical thinking skills to try to identify the information needs of your project it could help you meet.
• Then answer the questions about which information needs the source can help you meet. (Mark all that apply.)
• If there is at least one need it can help meet, you should judge the article relevant. Don’t forget to compare your answers with our feedback.

Your research question is: How does “prospect theory” in behavioral economics help explain medical doctors’ decisions to favor surgery or radiation to cure cancer in patients?

As usual, your information needs are:

• To learn more background information.
• To answer your research question.
• To convince your audience that your answer is correct or, at least, the most reasonable answer.
• To describe the situation surrounding your research question for your audience and explain why it’s important,
• To report what others have said about your question, including any different answers to your research question.

Abstract: “Cancer Treatment Prescription–Advancing Prospect Theory beyond Economics,” in Journal of The American Medical Association Oncology , June, 2022. (This article and abstract are fictitious but the journal and its form for abstracts are real.) Importance Cancer treatment is complex. We expect oncologists to make treatment decisions according to definitive standards of care. Finding out that prospect theory demonstrates that they react very much like most other people when deciding to recommend surgery or chemotherapy for their patients indicates that more self-reflection on oncologists’ part could help patients make better decisions. (Prospect theory describes how people choose between alternatives that have risk when the probability of different outcomes is unknown.) Objective To show whether prospect theory applies to how oncologists framed their recommendations for surgery or chemotherapy for patients in good condition and bad condition. Design, Settings, and Participants Records of 100 U.S. oncologists were examined for the years 2019 and 2020, which documented patient conditions and the way oncologists framed their recommendations regarding surgery or chemotherapy. Records of nine thousand patients were involved. Thus, a quasiexperimental ex post facto design was used for the study. Main Outcomes and Measures This study explored the relationship between the way in which the oncologists “framed” the choice of surgery or chemotherapy as they made recommendations to patients, the patients’ conditions, and the choice actually made. Those results were compared to what prospect theory would predict for this situation. Results Physicians seemed to present their recommendation of surgery or chemotherapy in a loss frame (e.g., “This is likely to happen to you if you don’t have this procedure”) when patients’ conditions were poor and in a gain frame (e.g., “By having this procedure, you can probably dramatically cut your chances of reoccurrence”) when their conditions were less poor. These results are what prospect theory would have predicted. Conclusions and Relevance This study opens up the possibility that, as described by prospect theory, a person’s choice of framing behavior is not limited to how we naturally act for ourselves but includes how we act for other people, as the oncologists were acting on behalf of their patients. More research is necessary to confirm this line of evidence and determine whether oncologists’ decision making and framing is the most effective and entirely according to the best standards of care.

Which information needs could this source help you meet if your research question was: How does “prospect theory” in behavioral economics help explain medical doctors’ decisions to favor surgery or radiation to cure cancer in patients?

A brief summary of what a journal article is about and a quick read in order to decide whether the article is likely to contain information relevant to your research project. The abstract may appear in research databases and, sometimes, in the article itself.

Choosing & Using Sources: A Guide to Academic Research Copyright © 2015 by Teaching & Learning, Ohio State University Libraries is licensed under a Creative Commons Attribution 4.0 International License , except where otherwise noted.

Share This Book

• Privacy Policy
• Terms Of Use
• Speaking & Training
• Covenant Life Outreach Church, Inc.

Critical Thinking Tools: RELEVANCE

Home   >>   Critical Thinking   >>   Critical Thinking Tools: RELEVANCE

If you're new here, you may want to subscribe to my RSS feed . Thanks for visiting!

What is the relevance?

Now that we are thinking clearly , precisely , and accurately , we must ask ourselves, “Is this relevant?”

A funny illustration of this point is found in the movie, “Kindergarten Cop”.  Arnold is teaching the class and says something to the effect of, “Today, children, we are going to learn the alphabet.”  Little Billy raises his hand.  “Yes, Billy. What is it?”

Billy announces proudly, “My Daddy’s a Fireman!”

That’s great kid, we all thank your dad for his service, but NOT RELEVANT to the issue at hand.

I used to see this type of thing all the time when I was a street cop.  I would catch some cat dealing crack and he would tell me about how the guy across the street how was selling crack too. Why didn’t I go arrest that guy instead?  NOT RELEVANT.

I’ve seen it during break-ups of boyfriend and girlfriend.  Boy gets caught cheating and he brings up the issue of her family members never liking him.  NOT RELEVANT.

I’ve seen it when I had rental properties.

“You guys are 2 months late on the rent and you haven’t cut the grass all summer and the city sent me a citation.”

“Well, the cable company is charging more for the basic package, so we couldn’t buy a lawn mower or pay rent.”  NOT RELEVANT.

So I don’t inflame already emotional thinkers, I don’t say, “NOT RELEVANT”.  Instead I ask a series of questions:

How does that help us with the issue at hand?

How is this idea connected to the question?

How does that bear on the discussion?

How does this idea relate to that?

How does your question or statement pertain to what we are dealing with?

Usually irrelevant ideas come into the conversation from either misunderstanding the issues (Little Billy), or as misdirection from owning bad behavior (the boyfriend).

Share this:

• Click to share on Twitter (Opens in new window)
• Click to share on Facebook (Opens in new window)

Related posts:

• Critical Thinking Tools: CLARITY
• Critical Thinking Tools: ACCURACY
• Critical Thinking Tools: PRECISION
• Critical Thinking 101

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Notify me of follow-up comments by email.

Notify me of new posts by email.

This site uses Akismet to reduce spam. Learn how your comment data is processed .

Follow me on Twitter

Recent posts.

• Righteousness: God’s Equity
• DVD Commentary on Seven Secrets of Resilience for Parents
• Resilience for Parents
• Home and Family
• Australia’s Today Extra

Recent Comments

• Andrew Wittman on 2 Types of Conscience
• Lindsey Rachelle Thompson on 2 Types of Conscience
• Andrew Wittman on Home and Family
• Maureen Pirrello Grama 83 on Home and Family
• David Straub on Calming Your Upset Child

• Logicalness
• Significance
• Sufficiency