JudgeMarket vs Metaculus: Trading vs Forecasting
Two platforms, two philosophies. Both Metaculus and JudgeMarket harness the wisdom of crowds, but they do it in fundamentally different ways. One asks you to forecast the future through calibrated probability estimates. The other asks you to trade on how history judges people.
If you're trying to decide which platform fits your interests, or if you're curious about how these two approaches to collective intelligence compare, this guide covers everything you need to know.
The Core Difference: Forecasting vs Trading
Metaculus is a forecasting platform. You answer questions about future events by submitting probability distributions. Will fusion energy reach commercial viability by 2035? What will global average temperatures be in 2030? How many people will live on Mars by 2050? Each question has a resolution date and clear resolution criteria. Your accuracy is tracked over time and displayed on public leaderboards.
JudgeMarket is a reputation trading platform. Every historical figure and public personality has a live price between 0 and 100, denominated in OPS (Opinion Points). That price reflects the crowd's collective evaluation of that person's legacy, significance, and impact. You buy if you think someone is undervalued. You sell if you think they're overpriced. There's no resolution date, no final answer — the market evolves continuously.
Metaculus asks: "What will happen?" JudgeMarket asks: "Who matters?"
Format and Mechanics
Metaculus: Probability Estimates
On Metaculus, you interact with questions by submitting a probability estimate (or a full probability distribution for continuous questions). For a binary question like "Will country X hold elections by December 2027?" you might submit 72%. For a continuous question like "What will the global population be in 2030?" you submit a range with confidence intervals.
Your predictions are scored using proper scoring rules — mathematical functions designed so that your expected score is maximized when you report your true beliefs. You can update your predictions at any time before resolution, and the platform encourages you to revisit and refine forecasts as new information emerges.
The format is inherently individual. You think carefully about a question, research it, form a belief, and submit it. There's no counterparty on the other side of your forecast.
JudgeMarket: Order Book Trading
On JudgeMarket, you interact through an order book — the same mechanism used by stock exchanges and major prediction markets. When you want to go long on Albert Einstein, you place a buy order at a specific price. Someone else has to be willing to sell at that price for the trade to execute.
This creates a dynamic where the price at any moment reflects the balance between buyers and sellers. If more people think Einstein's legacy is undervalued, buying pressure pushes the price up. If a new historical analysis emerges that challenges his contributions, selling pressure pushes it down.
The trading format adds a layer that pure forecasting doesn't have: you can express the strength of your conviction through position sizing, use limit orders to define exact entry and exit points, and manage a portfolio of positions across dozens of historical figures.
Incentive Structures
This is where the philosophical differences between the two platforms become most apparent.
Metaculus: Reputation Points and Calibration
Metaculus incentivizes accuracy. Your track record is public — other users can see how well-calibrated your forecasts have been over time. If you consistently forecast 70% probabilities for events that happen about 70% of the time, your calibration curve will look impressive.
The primary reward is reputation. Metaculus tournament winners gain recognition. Being a top forecaster on Metaculus is a genuine credential, especially in fields like AI safety, biosecurity, and policy analysis where forecasting skill is valued.
The scoring system is elegant but abstract. You earn points based on the mathematical relationship between your forecast and the outcome. For many users, the motivation comes from intellectual satisfaction and the desire to see how well they can predict the world.
JudgeMarket: OPS Profits and Portfolio Growth
JudgeMarket incentivizes through market mechanics. When you buy Marie Curie at 45 and other traders later push her price to 60, you have a profitable position. Your portfolio tracks your total OPS balance, unrealized gains and losses, and trading history.
Because JudgeMarket uses OPS rather than real money, the financial risk is zero. But the trading mechanics are real — the order book, matching engine, price discovery, and position management all work exactly like they do on financial exchanges. This makes JudgeMarket an effective educational tool for anyone who wants to learn how markets function without putting real capital at risk.
The incentive is intuitive. Make good judgments about who history should value, and your portfolio grows. Make poor judgments, and it shrinks.
Community and Culture
Metaculus
Metaculus has cultivated a community that skews toward rationalist, effective altruist, and technical forecasting circles. The platform is particularly strong in questions about existential risk, AI timelines, climate change, and global health. Many professional forecasters use Metaculus, and the platform has formal partnerships with research organizations.
The community norms emphasize calibration, intellectual honesty, and evidence-based reasoning. Comment sections under questions often contain substantial analysis, links to research papers, and structured arguments for different probability ranges. The discourse quality is generally high.
JudgeMarket
JudgeMarket's community is more diverse in background because the subject matter — historical figures and public personalities — is universally accessible. You don't need domain expertise in biosecurity or macroeconomics. You need opinions about Napoleon, Shakespeare, or Steve Jobs — and almost everyone has those.
The trading format also attracts a different type of engagement. On Metaculus, you quietly submit your probability and move on. On JudgeMarket, you're actively watching prices move, managing open orders, and reacting to shifts in market sentiment. It's more interactive and more social.
Topics and Scope
Metaculus
Metaculus covers an enormous range of forward-looking questions:
- AI and technology — AGI timelines, compute costs, adoption rates
- Geopolitics — Elections, treaties, conflicts
- Science — Research milestones, clinical trials, space exploration
- Economics — GDP, inflation, employment figures
- Health — Pandemics, mortality rates, drug approvals
- Existential risk — Nuclear, biological, asteroid, AI catastrophe
Every question must have clear, verifiable resolution criteria. This means Metaculus can't easily address subjective or ongoing debates — a question has to eventually resolve as true, false, or to a specific number.
JudgeMarket
JudgeMarket focuses exclusively on people:
- Historical leaders — From Julius Caesar to modern heads of state
- Scientists and thinkers — From Aristotle to contemporary researchers
- Artists and creators — Musicians, writers, filmmakers across every era
- Business figures — Industrialists, tech founders, entrepreneurs
- Pop culture — Athletes, entertainers, public intellectuals
The "question" on JudgeMarket never resolves. A figure's price is a living evaluation of their legacy. This means the platform can capture nuanced, evolving collective sentiment in a way that binary resolution cannot.
Price Discovery
Both platforms produce signals about what crowds believe, but they do it differently.
Metaculus aggregates individual probability estimates into a community prediction, weighted by track record. The community prediction for "Will humans land on Mars before 2035?" reflects the calibration-weighted average of all forecasters who submitted predictions. It's a poll, but a sophisticated one where better forecasters have more influence.
JudgeMarket produces prices through supply and demand in an open market. The price of Leonardo da Vinci isn't an average of what people think — it's the price at which the last trade executed, determined by actual buy and sell orders. This mechanism is the same one that prices stocks, commodities, and other prediction market contracts.
Market prices tend to be more responsive to new information because traders have skin in the game (even if it's OPS rather than real money). When you have to commit resources to a position, you think more carefully about whether you actually believe it.
Learning and Education
Metaculus is an excellent tool for improving your forecasting ability. The calibration tools help you identify systematic biases in your thinking. Are you consistently overconfident? Underconfident? The data will show you. Many users report that regular forecasting practice on Metaculus has made them better thinkers in their professional lives.
JudgeMarket is an excellent tool for learning how financial markets work. The order book, limit orders, market orders, positions, portfolio management — these are the same concepts you'll encounter on stock exchanges and crypto platforms. Because there's no real money at risk, you can experiment freely. Place a limit order. Try a short position on a figure you think is overrated. Watch how the market responds. You learn by doing.
Which Should You Choose?
You don't have to choose — the two platforms serve different needs and can complement each other well.
Choose Metaculus if:
- You enjoy structured, question-based forecasting
- You want to improve your calibration and probabilistic thinking
- You're interested in AI safety, policy, or scientific questions
- You prefer individual reflection over active trading
Choose JudgeMarket if:
- You want the experience of active trading with an order book
- You're interested in history, legacy, and public reputation
- You want to learn market mechanics without financial risk
- You enjoy dynamic, real-time price movements over static forecasts
- You want a platform you can start using in under a minute with no barriers
Use both if you care about collective intelligence broadly and want to engage with it through two fundamentally different — and complementary — approaches.
Start Trading Reputation
Ready to see what the crowd thinks about history's most important figures?
Sign up for JudgeMarket and get 1,000 free OPS →
Already a Metaculus forecaster? You'll find that your analytical skills transfer beautifully to reputation trading. The difference is that on JudgeMarket, you don't just submit a number — you put your OPS where your mouth is and trade on your convictions.