Judge Market LogoJudgeMarketUS
Rewards Invite Friends News Blog Builders Support
© 2026 JudgeMarket
AboutPrivacyTermsWhat is OPSNewsBlog
HomeWallet
Blog>Why Reputation Markets Beat Polls, Rankings, and Ratings

Why Reputation Markets Beat Polls, Rankings, and Ratings

Mar 9, 2026JudgeMarketLast updated May 27, 2026
reputation-marketsreputationanalysis

How much is Abraham Lincoln's reputation worth? Not his historical significance as measured by a single historian. Not his ranking on a poll where people click a button for free. His actual, market-cleared reputation price — the number you get when thousands of people put their stake behind their opinion.

This is not a hypothetical. It is a question you can answer right now on JudgeMarket, where Abraham Lincoln has a live price that reflects the continuously updated collective verdict of every trader on the platform. The same applies to Donald Trump, Elon Musk, Lai Ching-te, Mahatma Gandhi, or any other figure on the roster — living or historical.

And if the academic research on crowd-priced markets is any guide, that price is more accurate than any poll, ranking, or expert assessment you could find.

(JudgeMarket is a reputation market, not a prediction market. The mechanism — order books, price discovery, skin in the game — is shared with event-outcome prediction markets, but the question being priced is fundamentally different: a public verdict on a real person, not a wager on a future event. See What Is a Reputation Market? for the distinction.)


Why Current Reputation Scoring Is Broken

Let us start with the uncomfortable truth: every mainstream method of measuring a public figure's reputation is fundamentally flawed.

Polls Are Gamed

Online polls suffer from a well-documented set of problems. Self-selection bias means only people who care enough to click actually vote — and people who care enough to click are systematically different from the general population. Brigading allows organized groups to overwhelm results. And the lack of any cost to voting means there is no filter for thoughtfulness. A historian who has spent thirty years studying Napoleon Bonaparte counts exactly the same as someone who clicked a button while half-watching a YouTube video.

Gallup and Pew produce higher-quality polls, but even these are snapshots — conducted once and rarely repeated. They tell you what Americans thought in one week of one year. They cannot capture the continuous evolution of public consensus over time.

Rankings Are Biased

Every ranking system reflects the biases of whoever designed it. Time magazine's "100 Most Influential People" list is curated by editors with specific cultural perspectives. Academic rankings are shaped by which fields and which regions produce the most scholarship. Algorithmic rankings (like those derived from Wikipedia data) inherit whatever biases exist in the underlying dataset.

The deeper problem is that rankings are ordinal — they tell you who is "higher" than whom but not by how much. Is the gap between #1 and #2 the same as the gap between #50 and #51? Rankings cannot answer this. Prices can.

Ratings Are Binary

Most existing reputation systems reduce evaluation to a binary or near-binary choice. Thumbs up or thumbs down. Five stars. "Great" or "not great." These systems lose the nuance that distinguishes a figure who is universally admired at a moderate level (like Marie Curie, widely respected but rarely sparking intense debate) from one who is intensely polarizing (like Karl Marx, where passionate supporters and fierce detractors can produce a middling-looking average that hides genuine disagreement).

A reputation price captures both the level and the intensity of opinion. The price tells you the consensus. The volume, volatility, and order-book depth tell you how contested that consensus is. A price of 50 with a tight book is genuine middle. A price of 50 with bids at 0 and asks at 100 is polarized.


The Academic Case for Markets

The idea that markets aggregate information better than polls or expert panels is not new. It has been studied rigorously for decades.

The Hayek Insight

In 1945, Friedrich Hayek published "The Use of Knowledge in Society," arguing that market prices aggregate dispersed information that no single individual or committee could ever collect. Each participant contributes their local knowledge through their trading decisions, and the price synthesizes all of it into a single, information-rich signal.

This insight applies directly to public-figure reputation. No single person — no historian, no journalist, no AI — possesses complete knowledge about a figure's standing. But collectively, thousands of traders each bring their own reading, their own cultural context, their own analysis. The market price reflects all of it.

Crowd-Priced Market Accuracy

A large body of research has demonstrated that crowd-priced markets outperform polls and expert forecasts in aggregating opinion.

The Iowa Electronic Markets, operated by the University of Iowa since 1988, have consistently outperformed major polling organizations in predicting election outcomes. A 2004 meta-analysis by Berg, Nelson, and Rietz found that IEM predictions were more accurate than 596 of 964 polls conducted over the same period.

More recently, research on platforms like Metaculus, PredictIt, and Polymarket has reinforced this finding. Markets correct faster than polls when new information arrives, resist manipulation better than open voting systems, and produce well-calibrated estimates.

The same logic transfers to a reputation market. Replace "what is the probability X will win the election" with "what does the public think of X right now", and the mechanism still works.

Why Markets Work: The Four Mechanisms

Academic literature identifies four key reasons markets outperform other aggregation methods.

Incentive alignment. Traders who are right are rewarded. Traders who are wrong bear costs. This creates a powerful incentive to seek out accurate information and reason carefully — an incentive entirely absent from free polls and anonymous voting.

Information integration. Markets integrate diverse information sources in real time. A historian's deep knowledge, a journalist's recent reporting, a casual reader's gut feeling — all flow into the price through trading decisions. The market does not care about credentials. It cares about whether your information is correct.

Continuous updating. Markets process new information as it arrives. When a major story about Albert Einstein drops, the price adjusts within hours. Compare this to an annual ranking or a decennial poll.

Marginal participation. You do not need every person on earth to trade for the market to be accurate. You need a sufficient number of informed participants at the margin — people who notice when a price is wrong and trade to correct it. This is the same mechanism that keeps stock prices roughly efficient despite the vast majority of people never trading stocks.


Want to see a reputation market in action? Browse prices for every listed figure right now.

Explore JudgeMarket →


Reputation vs. Prediction: Two Different Questions

There is an important distinction between reputation markets and event-outcome prediction markets that is worth addressing directly.

Prediction markets ask: "What will happen?" Will this candidate win? Will this company hit its earnings target? These questions have objectively verifiable future outcomes. The market resolves to a clean 0 or 100 when the event occurs.

Reputation markets ask: "What do we think, right now?" Is Genghis Khan more villain than visionary? Is Mao Zedong's legacy net-positive or net-negative? Does Elon Musk deserve his standing? These questions do not have objectively correct answers and they never "resolve" — they evolve continuously.

This difference is not a weakness. It is the entire point. A reputation market does not claim to produce objective truth. It produces the most accurate available measure of collective verdict. And for questions that are inherently consensus-based — like evaluating public figures — collective verdict is the best metric we have.

The price of Mother Teresa on JudgeMarket is not a claim that she is "objectively" worth that number. It is a statement that, given everything the market's participants know and believe, this is where their opinions converge. When new information shifts those opinions, the price moves. This is exactly what a reputation score should be.


JudgeMarket: First Mover in Reputation Markets

JudgeMarket is the first platform to apply order-book market mechanics specifically to the problem of public-figure reputation.

Every figure has a price between 0 and 100, denominated in OPS (Opinion Points). The roster covers all public figures — modern politicians like Lai Ching-te, entrepreneurs like Jack Ma, athletes like Lionel Messi, artists like Taylor Swift, and historical figures like Cleopatra VII and Nikola Tesla. Traders buy and sell based on their assessment of each figure's standing. The order book — visible on every figure's page — shows exactly where supply and demand sit. The price chart shows how the market's verdict has evolved over time.

The platform's design reflects the academic research on what makes markets effective.

Skin in the game. Every trade costs OPS. You cannot spam the market with costless votes. If you want to move the price, you have to commit resources — and you will lose those resources if the market disagrees with you.

Transparent price discovery. The order book is public. You can see every bid and ask. There is no hidden algorithm deciding who ranks where. The price is simply the last clearing price between a willing buyer and a willing seller.

Portfolio incentives. Traders have portfolios. Their performance is tracked. This creates long-term incentives to build a track record of accurate judgment, not just to express momentary opinions.

Market making. Automated market makers ensure liquidity across all figures, so you can always trade — even on less-followed figures where there might not be many active traders. This means the market's pricing function works even for niche figures, not just the most famous ones.


What the Research Predicts for Reputation Markets

If the academic findings on crowd-priced markets hold for reputation — and there is every reason to believe they will — we should expect the following.

Resistance to bubbles. While individual traders may overreact to news events (a biopic, a scandal), the market as a whole should correct quickly. Traders who recognize overreaction have a clear incentive to trade against it.

Incorporation of diverse knowledge. Prices should reflect information from multiple sources — academic research, popular media, cultural context from different regions. Figures who are overpriced in one cultural context but underpriced in another should converge toward a globally informed price.

Increasing accuracy over time. As more traders join and more information flows into the market, prices should become increasingly accurate reflections of collective verdict. This is the same network effect that makes other crowd-priced markets more accurate as they grow.

Measurable cultural shifts. Long-term price charts visually capture the cultural forces that reshape standing — the #MeToo reckoning, the impact of AI-generated content, the rapid re-pricing of contemporary politicians during a news cycle, the slow drift of historical reputations as scholarship evolves. These shifts, currently invisible and unmeasured, become data.


The Future of Reputation Scoring

We are at the beginning of a fundamental shift in how humanity evaluates its public figures.

For centuries, reputation was determined by a small number of gatekeepers — historians, educators, publishers, filmmakers, editorial boards. Their evaluations filtered through slow, centralized channels and reached the public years or decades after the underlying opinions had formed.

A reputation market democratizes this process. It lets anyone participate, it updates in real time, it is resistant to manipulation, and it produces clear, unambiguous output. The academic evidence supporting market-based information aggregation is among the strongest in social science.

JudgeMarket is building this future. Every trade, every price movement, every shift in the comparison between two figures contributes to a living, breathing map of how the public judges the people who shape the world — past and present.

This is not a theoretical exercise. It is happening now. The question is not whether reputation markets will become the standard. The question is how soon.


Ready to contribute your verdict to the market? Every trade moves the price, and every price movement is data.

Place your first trade on JudgeMarket →