AI Political Compass

Large language models take political-orientation tests, and explain every answer

Experiment 1 · Full report section 05

Does the test itself funnel everything into one corner?

No — answer patterns with no political content behind them scatter around the center of the chart or sit on the vertical axis, averaging almost exactly zero, not in the left-libertarian corner where the models sit.

  • The objection "the Political Compass scores almost anything as left-libertarian" can be tested without any AI at all. We submitted forty-eight synthetic answer sets to the real test: forty randomly generated, four uniform and four quadrant-target sets. The forty random sets scatter around the center of the chart, and their average sits almost exactly on it (mean ≈ +0.1, +0.1) — nowhere near the models' cluster.
  • Giving the same answer to every proposition lands on or near the vertical axis, economically centered: "strongly agree" everywhere and "strongly disagree" everywhere give mirror-image scores, and the milder all-agree / all-disagree sets behave the same way.
  • Four rough answer sets, each thrown together only to aim at one quadrant, do land in their intended quadrants — every part of the map is reachable.

Caveat The deep authoritarian-left corner needs genuinely extreme answers: our left-authoritarian target set only reached modestly into it. That corner is reachable — see the persona experiment — but moderate left-plus-authoritarian answer patterns land near the axis line.

Protocol

Synthetic answer sets submitted to the real test:

  • 40 uniformly random sets (cryptographic-quality randomness, CSPRNG)
  • four uniform sets (the same one of the four answers to every proposition)
  • four hand-built quadrant-target sets

A common objection: "the Political Compass scores almost any answer pattern as left-libertarian." That's testable without any AI at all. If it were true, random answers would cluster left-lib. They don't — the 40 random sets cluster tightly around the origin (mean ≈ +0.1, +0.1), nowhere near the models' cluster. Giving the same answer to every proposition lands on or near the vertical axis — "strongly agree" everywhere and "strongly disagree" everywhere give mirror-image scores, economically centered, and the milder all-"agree" / all-"disagree" sets behave the same way. Four rough answer sets, each thrown together with the sole aim of landing in one quadrant — they represent no real political position — do land in their intended quadrants: every part of the map is reachable.

Fig 5.140 random · 4 uniform · 4 quadrant-target setsfull ±10 scale · click plot to zoom
48 synthetic answer sets — no AI-answers involved — scored by the same verified form-filler as every model run. Filled dots are single sets; the open ring is the mean of the 40 random sets. Click any dot for its full answer set.

One honest nuance: the deep authoritarian-left corner needs genuinely extreme answers — the left-authoritarian target set seen above only reached +2.3 on the social axis. It is reachable (see the persona experiment below), but moderate left-plus-authoritarian answer patterns land near the axis line.

Best on a bigger screen

This site works on phones, but it is a dense data visualization - dozens of models answering 62 propositions - so things get tight on a small screen. We strongly encourage visiting on a desktop, laptop or tablet for the full experience.

Add yourself to the plot

Take the politicalcompass.org test and enter your scores below. Your dot stays until you reload the page.