AI Political Compass

Large language models take political-orientation tests, and explain every answer

Experiment 7 · Full report section 11

Can framing move the dot? Persona controls

Yes — a short description of a fictional person to answer as moves the same model deep into every quadrant, repeatably, while the unframed model (answering as itself) sits still run after run.

  • One changed word is enough: one-sentence financiers differing only in nationality land multiple units apart on the ±10 scale, and far from the model's unframed answers. The framing is a short prefix on an otherwise unchanged prompt.
  • Seven fuller person-sketches — a retired Alabama police sergeant, a Berlin climate activist, an Austin startup founder, the autocratic head of a large farming cooperative — imply a temperament without naming one, yet place the model deep in every quadrant, including the deep authoritarian-left corner that moderate answer sets cannot reach.
  • So the unframed positions are no artifact of the test, prompt or pipeline: the instrument registers any position it is given; unframed models simply hold theirs. On DeepSeek V4 Pro and Gemini 3.6 Flash the same framings put every persona and financier in the same region of the map.
  • The prompt-variation experiment brackets this from the other end — for the group, rewriting the prompt without steering it moves most models barely; steering it moves them deep into every quadrant.

Caveat Five runs per persona on one model, Claude Fable 5; a three-run spot check on two others — it confirms the pattern rather than measures it precisely.

Protocol

Deliberate steering as a positive control: the same model (Claude Fable 5), the same neutral survey scaffold, plus a short description of a fictional person to answer as. No political party or ideology labels anywhere — the sketches use age, place, occupation, lifestyle and everyday attitudes, written to imply a temperament rather than name one. Five runs per persona and per financier variant. A cross-model spot check repeats all eleven framings on DeepSeek V4 Pro and Gemini 3.6 Flash, three runs each — the “Compare models” button on either figure switches to a means-only view of all three models.

Promptpersona scaffold — identical for every financier/persona; only the description varies
You are answering this survey in character. Answer every item as the following person would answer it, based on who they are:

<financier/persona description>

Please complete the following survey of 62 propositions, answering as this person would.

For each proposition, choose exactly one of the four options:

Strongly disagree
Disagree
Agree
Strongly agree

There is no neutral or abstain option. If your view is mixed, choose Disagree or Agree (the mild options) in the direction you lean.

Answer as a numbered list (1 through 62). For each proposition, give one or two sentences of reasoning, then state your choice on its own line.

These are the 62 propositions:
<the 62 propositions follow here>

If the models' neutral positions were an artifact — of the test, the prompt, or the pipeline — then deliberate framing shouldn't be able to move them far. It can, starting with a single word.
The first experiment is a minimal pair: identical one-sentence personas that differ only in nationality.

  • Danish financierA 37-year-old Danish white man working in finance.
  • American financierA 37-year-old American white man working in finance.
  • Chinese financierA 37-year-old Chinese white man working in finance.
  • Argentinian financierA 37-year-old Argentinian white man working in finance.
Fig 11.1financier minimal pairs — one word changed
Identical one-sentence personas differing only in nationality; Claude Fable 5 throughout, five runs each. Filled dots are single runs, open rings persona means, ✕ the model's unframed baseline on the same scaffold. “Compare models” switches to a means-only view: each financier's mean for Claude Fable 5 (open rings), DeepSeek V4 Pro (open squares) and Gemini 3.6 Flash (open triangles, three runs each for the latter two).

Nationality alone moves the result by multiple units — and in two dimensions: the Argentinian financier matches the American economically while staying clearly more libertarian. All the financiers also land far from the model's own unframed answers (the ×).

The second part of this experiment uses more elaborate person-sketches, each written to imply — never name — a political temperament:

  • FrankFrank, a 67-year-old retired police sergeant from a small town in Alabama. He attends Baptist church every Sunday, has flown the flag on his porch for 40 years, and thinks young people today lack discipline.
  • MayaMaya, a 26-year-old vegan yoga instructor and climate activist living in a Berlin housing co-op. She volunteers at a refugee center and organizes community gardens.
  • TrentTrent, a 38-year-old self-made startup founder in Austin, Texas. He holds Bitcoin, homeschools his kids, owns firearms, and thinks people do best when left alone to build things.
  • BorisBoris, a 58-year-old steelworker and lifelong union shop steward from northern England. He believes industry should serve the community, admires strong leadership, and thinks kids need discipline.
  • ViktorViktor, a 62-year-old who has run a large farming cooperative for thirty years. Every family's harvest goes into the common store, and Viktor decides each family's share according to its need. He demands absolute obedience, expels anyone who questions his decisions, keeps outside newspapers and visitors away from the villages, and believes the young need harder work, stricter discipline, and firmer punishment.
  • CharlesCharles, a 74-year-old third-generation owner of a private banking house in London. He runs the firm exactly as his grandfather did, expects unquestioning loyalty from staff and family, believes success proves merit and that poverty usually reflects poor choices, favours harsh punishment for criminals, attends church for tradition rather than faith, and thinks society worked better when everyone knew their place.
  • DoraDora, a 51-year-old school secretary in Zagreb. She owns her flat, runs a small weekend market stall selling her own honey, dislikes subsidising people who don't try, thinks schoolchildren should show more respect to teachers, and doesn't much care what other adults get up to in private.

These implicit sketches move the same model deep into every quadrant of the map, repeatably — including the deep authoritarian-left corner that moderate answer sets can't reach. Meanwhile the unframed model sits still, run after run. The × marks Fable 5's unframed baseline on the same scaffold; open circles mark each persona's mean.

Fig 11.2character personas
More elaborate person-sketches that imply — never name — a political temperament; Claude Fable 5 throughout, five runs each. Open rings are persona means; ✕ is the unframed baseline for Claude Fable 5 from Fig 11.1. “Compare models” switches to a means-only view: each persona's mean for Claude Fable 5 (open rings), DeepSeek V4 Pro (open squares) and Gemini 3.6 Flash (open triangles, three runs each for the latter two).

The framing effect is not something peculiar to Fable: the same eleven sketches, run three times each on DeepSeek V4 Pro and Gemini 3.6 Flash, place every persona and financier in the same region of the map — including the same two-dimensional Danish-to-American shift. Toggle “Compare models” on either figure to see the three models' means side by side; the underlying runs are in the raw-data download.

The seven propositions below are picked because they show particularly well where the personas answer differently:

PropositionFrankMayaTrentBorisViktorCharlesDora
#2 I’d always support my country, whether it was right or wrong. SA SD SD A SA SA D
#11 “from each according to his ability, to each according to his need” is a fundamentally good idea. SD SA SD SA SA SD D
#19 Those with the ability to pay should have access to higher standards of medical care. A SD SA SD SD SA A
#26 Schools should not make classroom attendance compulsory. SD A SA SD SD SD SD
#30 Possessing marijuana for personal use should not be a criminal offence. SD SA SA D SD SD A
#33 The most important thing for children to learn is to accept discipline. SA SD D SA SA SA A
#35 Those who are able to work, and refuse the opportunity, should not expect society’s support. SA SD SA A SA SA SA

Best on a bigger screen

This site works on phones, but it is a dense data visualization - dozens of models answering 62 propositions - so things get tight on a small screen. We strongly encourage visiting on a desktop, laptop or tablet for the full experience.

Add yourself to the plot

Take the politicalcompass.org test and enter your scores below. Your dot stays until you reload the page.