The Weird Cluster Hypothesis (WCH) says that all 'weird' traits (rare, extreme, out-of-distribution, surprising, or defective) are correlated with each other, forming a cluster. In this essay I will convince you that it is usually true, and sufficiently useful that you should assume it until proven otherwise. I further hope that I will convince you of this so strongly, you'll retroactively redefine 'weird' to mean the thing that the hypothesis is true about.

Examples

General Psychopathology Factor: ADHD, autism, anxiety, depression, OCD, bipolar disorder, and schizophrenia all significantly correlate with each other, such that psychologists hypothesize an underlying dimension called p-factor that is causally relevant to all these conditions. The thing these conditions have in common is that they are weird, so this is a Weird Cluster Hypothesis.

Greater Male Variability Hypothesis: Some evidence supports that males have higher variability than females in many features, as if developmental biology is more constrained for women than men. There are various evolutionary biology justifications for why this might make sense, but the exact mechanism doesn't matter for our purposes. What matters is that males are weird (you can tell because most outlier humans are males, so it correlates with the cluster), so every extreme value will end up correlating with being male and therefore with each other. Thus, this hypothesis implies the WCH. The WCH couldn't have guessed a priori which sex is the weird one (though it puts slightly more probability mass on the rarer sex, and there are slightly more women than men), but it did guess that all the weird traits would correlate, and having a weird sex is one way to achieve that.

Left-Handedness: Correlates with being male, with being gay, and with psychopathology. Why? No idea. Who could have predicted this seemingly random factoid? Anyone who believes in the Weird Cluster Hypothesis, and noticed that left-handedness is rare and therefore weird.

Financial markets: it is said that 'all correlations go to 1 in a crisis'. Price fluctuations are determined by individual asset performance most of the time, but in a sudden crash or under similar extreme conditions all local effects are drowned out by the effects of the crisis itself. This means that extreme movements in any asset are predictive of an ongoing financial crisis, and therefore predictive of extreme movements in everything else. This is a WCH where objects are market time-intervals, and features are individual price changes.

Quality Management: Deming’s 'Special Cause Variation' is a WCH. Some fraction of defects are caused by unexpected, assignable events that are not part of the standard process: untrained operators, physical damage, poor quality input materials, etc. A product with one defect may have it because of a 'special cause', all of which could also cause other defects, leading to a correlated 'weird cluster' of products with lots of defects compared to normal products with few or none.

The hypothesis says that in some collection of related features, outlier values in many of them will typically correlate with outlier values in most others, and with the 'weird cluster' of objects that have more outlier values across features in general. If you take the hypothesis as trusted, you can use it in reverse to identify weird traits based on its adherence to the cluster. Are artists weird? You can be a good empiricist and measure whether they correlate with the cluster, but how sure should you be that the answer will be 'yes' even before you do that?

Representations

In statistical distributions: Generally when an otherwise normal variable has "fat tails", we model it with a student-t distribution. If we attempt to do this for multivariate data, we get the student-t copula. Tail-dependence falls out of this model directly. Here "our otherwise normal distribution has tails too fat, we should switch to student-t" is the hint that the WCH probably applies.

In causal-graphs: whenever several observed variables are children of a shared latent parent, the children will be correlated with each other even if they have no direct causal link. The WCH amounts to believing there are latent nodes affecting the variance of other nodes, and thus high values in this variance-causing node will cause correlated outliers in both directions of many observed features.

In Mixture Models: If you like pretending your data is the result of a collection of overlapping normal distributions, the WCH amounts to saying that if one of subpopulation has higher variance on one feature, it usually also has higher variance on other features. This is basically just approximating the student-t with a different model, but it lets you permit features that are weird only on one-side by imagining a weird subpopulation with a different mean on some dimensions while still having higher variance on most.

Features of Unknown Provenance

On arbitrary data, we cannot assume the distributions will be true to the underlying source processes. It could be something like a psychometric test which is in practice a rescaling plus noise of some hidden underlying variable, or could be doing the equivalent of taking the absolute value or square, or could be aggressively normalized. Because of these, arguments about 'fat tails' aren't fully general.

Traits can be two-tailed (in the sense that extreme high and low values are both 'weird', like a clock that is considered defective if it runs too fast or too slow), or one-tailed on either side (if you have an 'insanity' feature in your psychometric data, we expect high scores to be weird and correlate with the cluster, but not low scores), or statistically useless because they're not informative enough, or they derive from an unrelated process and the hypothesis is false / they have a different weird cluster we don't have enough data to find. To resolve this on arbitrary unknown data we need a good statistical test.

A Formal Test

We want to look at the tails of each trait. For each feature j define two tail indicators from the empirical quantile ranks alone (invariant to any monotone rescaling of the feature): L_j = −log(quantile(X_j)) for the lower tail and U_j = −log(1−quantile(X_j)) for the upper, which I stole from Extreme Value Theory. This forms a 2p×2p correlation matrix C of the indicators {L_1, U_1, L_2, U_2, …}.

We want to look for a leading eigenvector implying a correlated cluster. Ordinary linear correlation between traits already forces their tails to co-move, so C is not compared against zero but against its Gaussian-copula expectation. We derive the equivalent values expected if the WCH is assumed false (everything is multivariate normal with the same linear correlation matrix). The WCH test statistic is the surplus S = measured - expected: tail co-movement in excess of what correlation alone forces. Its leading eigenvector labels how strongly each feature tail (Lower or Upper) joins the cluster; further outstanding eigenvalues are sub-clusters.

Not only does this test the hypothesis, it gives us an explicit labelling (based on its strength in the eigenvector) of how weird each tail of each trait is, for the purposes of the WCH we just proved. You could choose to imagine this new feature as approximating a hidden trait which is responsible for generalised high variance across a range of features (the features where both tails relate to the cluster), and shifted means in some features (the features where only one tail correlates with the cluster), but you don't have to do that if you don't want to. The WCH is durable across representations.

I also want to note explicitly that the WCH is not merely this exact formal hypothesis test. This is one possible test aimed at proving a WCH, but there are other ways you could measure it. A better person than me could probably do a better job, and different statistical traditions can derive their own versions, representing analogous claims with different mathematics and notation.

Applied Example

I explained the WCH to Claude Code, and asked it to apply the above test on some public datasets online where the correctness of the hypothesis is non-obvious. I didn't check its code at all, but I did look at its reasoning and make it rerun the tests with fake data where the WCH is true or false by construction to validate that it isn't being completely stupid.

It picked the UCI Wine Quality dataset (red, white) as two examples, plus the Breast Cancer Wisconsin dataset. The headline results:

Claude seems to conclude that the WCH is true about red wine, white wine, and breast cancer, which hopefully you are not surprised by at this point. It is apparently more true about breast cancer than about either wine. I am not an oncologist and don't know why.

For red wine, the eigenvector looks like:

Which reads as: 'normal' wines generally have near median values, but are allowed to have low citric acid, low sulphates, and low alcohol, while 'weird' wines can have extreme values in every other feature but especially the ones with bigger numbers.

The ones with large positive coefficients on both sides are in the "clock that ticks too fast or too slow" situation where both extremes are signs of weirdness, while the ones with one-sided positive coefficients are equivalent to psychopathology test scores where one end of the scale means very sane and the other end means very crazy. A wine having high alcohol content is the strongest single indicator of weirdness: You don't know the direction but probably lots of the other features are extreme as well. I know nothing about wine so don't know whether that sounds correct.

Effect Sizes

Are generally modest when compared to the mainline statistical correlations of the dataset. Men having higher variance is nowhere near as predictively powerful a fact as men being taller or stronger. Still, it's often enough to turn coincidence of many rare traits from something that never occurs to something merely moderately more rare than the traits are individually.

The most natural measure I can think of is to look at the Degrees of Freedom a student-t distribution would approximately need to have to duplicate the tail correlations between the strongest weird cluster members. I gave this task back to Claude, didn't check its reasoning or code at all, and copy-pasted this table:

Small "equiv. t-df" here means stronger correlated tails. True gaussian data would score infinity, or something a bit short of infinity only due to random noise. This lets us say that the WCH is more than 50% more true of the breast cancer data than of either wine, which is a cool thing to be able to say.

A few Issues

Collider Bias kills the Weird Cluster Hypothesis dead on the spot. Disease is weird, but it isn't correlated among hospital patients because you've filtered out everyone in the "zero diseases" box on account of they're not at the hospital in the first place.

Weirdness is extremely reference-class dependent. The above Collider Bias example could just as well be rephrased as "diseases are weird in the general population but not weird among hospital patients" which sounds so obviously true as to be almost pathetic, but makes it a little hard to speak abstractly about weird traits because you need to track the reference class you're refering to.

Feature classification is volatile on the features in your sample. Medical data that is mostly psychometrics will find that there is a weird cluster of psychotic people but other traits are fine. Medical data that is mostly skeletal integrity will find a weird cluster of people who have broken lots of bones but miss the mentally ill for lack of features grouping them together.

Reifying a Concept

I hope I have convinced you by now that the WCH is usually true. If it is usually true, ideal Bayesians with good priors should already mostly believe the WCH before they have any idea what the data is. To the extent humans are the result of evolutionary forces creating minds that approximate rationality, this is what your brain is doing already when it thinks something is weird. This is in my opinion what the word 'weird' really means, in plain English as used by non-statisticians.

So far I have been playing deliberately loose with the word. Sometimes I cite that a trait is weird to imply it should cluster, and then take proof it clusters as proof weird things cluster. Other times I take proof something clusters as proof that it is weird. Together these look like circular reasoning, but it's the good kind of circular, known as Conceptual Explication, where you do things like redefine 'heat' as high molecular kinetic energy and justify it by pointing at hot things and measuring their molecular kinetic energy. The formal definition earns its place by matching those prior judgments in familiar cases and then extending to unfamiliar ones.

Formally, I want 'weird' to mean those traits about which the WCH is true, because then we can empirically prove claims about them, but informally I don't want you to stop using your intuitive sense of weirdness to guess in advance. The definitions empirically agree, because your intuition is just the result of an informal and inexact implementation of this same hypothesis. This is what I mean by believing the WCH in generality and not just with respect to a particular dataset: Statistical tests can prove isolated examples, but only intuitive understanding lets you guess correctly in advance of the evidence.

Conclusion

I think the above pile of loose mathematics and aggressive generalizations is what a sufficiently brave person should understand the concept of 'weird' as pointing towards. I think you should also think that. The WCH is generally true, your intuitions about which traits are 'weird' for the purposes of the WCH are generally correct, you can get a good amount of mileage out of assuming it a priori, there are often interesting structural reasons why it is true in a given context but you shouldn't need to understand those reasons in order to guess the correct answer. Believing this can occassionally mislead you, but it usually doesn't and it can save you time by forecasting many true and useful predictions.