Clicked Gallery

What is Simpson's Paradox?

Highlighted from a real textbook passage. Explained by Clicked.

Used in a sentence

University Course Reader · STEM

The hospital with the worse survival rate turned out to be a case of Simpson's paradox: it treats the sickest patients, and beats its rival on every category of them.

The reader highlighted one term β€” in an article or a paper PDF. Clicked made the statistics term β€œSimpson's paradox” easy to understand:

Explained in three depths

Same facts, different vibe β€” Slang mode 😎

The Clicked way

●○○

Overview

Simpson's paradox is a comparison that points one way in the combined data and the other way inside every group the data is made of. In 1973 the University of California, Berkeley admitted about 44% of the men who applied to graduate study and about 35% of the women, a gap of 9 points. Looked at department by department, the gap was gone: six departments admitted women at a higher rate than men, and four did the opposite. The combined figure flipped because women had applied mostly to departments that were hard to get into, and men mostly to departments that were easy. So the total was comparing which departments each sex had chosen, not how each sex was treated. That is the paradox in one line: the total can point the opposite way from every one of its parts. The fix is to compare like with like, group by group, whenever the two sides did not face the same mix of cases.
●○○

Overview

Simpson's paradox is when the big-picture number says one thing and each slice of it says the reverse. The textbook case is Berkeley in 1973. Graduate applications came in from 8,442 men and 4,321 women. About 44% of the men got in and about 35% of the women, which reads as an open-and-shut case against the college. Then someone checked each department on its own, and the case fell apart: half a dozen departments let women in more often than men, four did it the other way round, and the rest were a wash. The headline number was grading the departments, not the people. Women had largely applied to departments that turned nearly everyone away, men to departments that waved nearly everyone through, and the total faithfully reported that choice as if it were treatment. So any time a total compares two sides, ask who got handed the hard cases. 😎

A quick take β€” often all you need.

●●○

Detail

Simpson's paradox is a comparison that reverses when the data is split into groups: one side wins on the combined figure and loses inside every group. Two things have to be true at once: the groups differ in difficulty, and the two sides are spread unevenly across them, one mostly in the hard group and the other mostly in the easy one. Then the combined figure measures the spread, not the sides. Two phone repair shops each take 100 jobs. Shop A fixes 90 of every 100 cracked screens and 30 of every 100 water-damaged phones. Shop B fixes 80 of every 100 screens and 20 of every 100 water-damaged phones, so A is better at both. But A's 100 jobs are 20 screens and 80 water-damaged: 18 plus 24 is 42 fixed. B's are 80 screens and 20 water-damaged: 64 plus 4 is 68 fixed. B wins the total while losing both kinds of job, because B got the easy work. Berkeley's 1973 graduate admissions had the same structure. Overall, 44% of men were admitted against 35% of women, yet department by department more departments favoured women than men. Women had applied to the departments that were hard to get into. The department is a confounding variable, a hidden factor tied to both the thing compared and the outcome. Splitting is not automatically the honest view, though. It is right when the grouping genuinely sets the difficulty, as damage type and department do, and splitting by something irrelevant can manufacture a flip the other way. Nor is Simpson's paradox bad data: every number in it is correct, and the total still misleads. A skewed sample is selection bias, a separate problem. The question that catches it is always the same: did the two sides face the same mix of cases?
●●○

Detail

Simpson's paradox is the name for a comparison that does a U-turn the moment you split the data, so whoever trails overall leads in every group. Two conditions have to line up for it: the groups are not equally tough, and the two sides are dealt them in unequal shares. Run it on two support agents, each closing out 100 tickets. Agent A solves 95 of every 100 easy tickets and 35 of every 100 nightmare ones. Agent B solves 90 and 25, so A beats B on both. But A's 100 tickets are 20 easy and 80 nightmares: 19 plus 28 is 47 closed. B's are 80 easy and 20 nightmares: 72 plus 5 is 77 closed. B tops the leaderboard for the crime of being dealt the easy pile. Berkeley in 1973 ran the same play: 44% of men admitted to 35% of women overall, while inside the departments the tilt ran the other way, towards women, because women had applied where the doors were narrowest. Whatever does the splitting, ticket difficulty or department, is what statisticians call a confounding variable: something hidden that is hooked to both sides of the comparison. Before treating the split as gospel, check that the grouping really decides how tough the job is. Slice by a coin toss and you can conjure a flip in either direction. And notice what nobody did here: fudge a figure. Each one is accurate and the total fibs anyway, which is a different animal from a lopsided sample (selection bias). Keep one short question handy. Who got the hard cases? 😎

Want more? One click digs deeper.

●●●

Analogy

Simpson's paradox is a comparison that flips when the data is split into groups, and two pizza places on a delivery app are the same idea. The app says Place A averages 32 minutes to your door and Place B averages 26, so B looks faster. Split the orders by distance and A is faster on both: 18 minutes against B's 20 for nearby orders, and 40 against B's 45 for far ones. A sits on the edge of town, so most of its orders are far, and B sits in the centre, so most of its orders are near. The overall average is grading the map, not the kitchens. The nearby and far orders are the groups, A's faster time in each is the side that wins every group, the app's average is the total, and where each shop sits is the uneven spread that flips it. The match ends here: on the app you can see the map, while in research the thing that splits the groups has to be thought of and measured.
●●●

Analogy

Simpson's paradox is when a total points one way and every group inside it points the other, and two driving instructors show how. Instructor A gets 50% of learners through at the city test site and 90% through at the village one. Instructor B manages 40% and 80% at the same two sites, so A is better at both. B still has the better overall pass rate, because B books nearly everyone into the village and A takes on the city traffic. The city and the village are the groups, A's higher rate at each is the side leading every group, the headline pass rate is the total, and B's booking habit is the lopsided spread doing the flipping. Pick the instructor with the "worse" pass rate, and read the headline as a review of the route, not the teacher. Where it breaks: a learner can simply ask which site, while a reader of a study has to hope somebody wrote it down. 😎

Unfamiliar concept? A real-world example makes it click β€” fresh analogies on tap.

AI explanations may contain errors · Not professional advice

Formal definition β€” The same term, explained the usual way

Simpson's paradox (also the Yule-Simpson effect) is the reversal or disappearance of an association between two variables when the data are stratified by a third variable, so that the direction observed in the aggregate differs from that observed within every stratum. It arises when the stratifying variable is associated with both the exposure and the outcome and is unequally distributed across comparison groups, i.e. it is a confounder whose imbalance is large enough to reverse the marginal association. The canonical case is Bickel, Hammel and O'Connell, Science 187:398-404 (1975): in fall 1973, 8,442 men and 4,321 women applied to graduate study at Berkeley; about 44% of men and 35% of women were admitted, yet of 85 departments only four showed bias against women beyond chance and six against men, the aggregate gap arising because women applied disproportionately to departments with low admission rates. Which figure is correct depends on the causal structure: stratify when the third variable is a confounder, not when it is a mediator or a collider. Named by Blyth (1972) after Simpson (1951); the phenomenon was described by Pearson (1899) and Yule (1903).

Want Clicked to explain terms like “Simpson's paradox” directly in your browser β€” including on PDFs?

Add to Chrome β€” Free

50 free Explanations · No credit card required