The science
Why should anyone trust a crowd?
Because — under the right conditions — crowds have been beating experts for centuries. The conditions are the interesting part. This page explains how Fairgrade creates them, with demonstrations instead of equations.
The old idea
In 1785, the Marquis de Condorcet proved something strange: if each member of a jury is even slightly more likely to be right than wrong, a majority vote becomes more reliable than any single juror — and the bigger the jury, the more reliable it gets. Financial markets aggregate scattered opinions into prices; game-show audiences famously outperform the phone-a-friend expert. Independent, imperfect judgments, combined, produce accuracy none of the judges possess alone.
Where it breaks
The classical result assumes every judge is equally competent, honestly motivated, and independent. Classrooms — like the internet — violate all three. Some graders know more than others. Some don’t try. Some talk to each other. Naive averaging treats a careless score and a careful one as the same evidence, so a handful of bad actors can drag the whole estimate. That is why peer grading, done naively, has a bad reputation — and deserves it.
The distribution is information
Before fixing the judges, notice something about the votes themselves: how a crowd splits carries information beyond what any single vote says. A 10–5–3–2 split is not a coin flip about the plurality answer — it’s strong evidence for it, and the strength depends on how competent the voters are.
Play with the assumption and watch certainty move.
Twenty people answered a question with four options. You can see the votes — nothing else.
Computed live from a simple accuracy model. The production Marciano Method goes further: it estimates every voter’s accuracy individually, from their track record — Wisdom in the Crowd.
Credibility is earned, not assumed
The Marciano Method drops the classical assumption of equal judges. It estimates two unknowns at once — the quality of each submission and the credibility of each grader — letting each estimate sharpen the other until they converge. Below is a simplified version of that loop, running live. It is rigged in one direction only: against the bad actors you add. Go ahead — try to break it.
Dashed line — the grade the instructor gave working alone · scale 55–95
A simplified model of the Marciano Method, running live in your browser. Credibility is earned by agreement with the emerging consensus — and re-earned every time you interfere.
Objections
Asked and answered.
Won't students game it?
Gaming requires beating your own track record. A grader who scores strategically diverges from the emerging consensus, loses credibility, and with it, influence — the attack de-fangs itself. Try it above: add colluders and watch their weight collapse. Large coordinated majorities in tiny classes can still distort results, which is why review counts and class-size safeguards exist in the product.
What about lazy graders?
Random or careless scores are the easiest pattern to catch — they disagree with everyone, including each other. Their weight falls toward zero and the diligent majority carries the estimate. The lazy grader's own grade, meanwhile, depends partly on the quality of review work — diligence is rewarded on both sides.
Students aren't experts. Why trust them at all?
No single student needs to be an expert — that's the point. With a well-designed rubric, each peer is a noisy-but-informative instrument. The method's job is to extract the signal those instruments share and discount the noise they don't. The instructor's benchmark stays in the loop, and the instructor always finalizes.
Is this just AI grading in disguise?
No. The trust in Fairgrade comes from credibility-weighted human judgment — mathematics that predates the current AI wave by years. AI-assisted scoring exists as an optional, clearly-labeled second opinion beside the peer consensus. It never decides.
What about student privacy?
Reviews are structured and pseudonymous to peers; the platform runs on AWS with a FERPA-ready architecture, and your data stays yours. Credibility scores are internal instruments, not public labels.
Provenance
Ten years in the making.
The research
Two professors — economists teaching at top business schools — begin a decade of work on credibility-adjusted aggregation: how to extract calibrated truth from crowds of unequal reliability.
The classrooms
The method is piloted where it was invented: 5,000+ students across 60+ courses at NYU Stern.
The prize
Fairgrade wins the $100,000 Rennert Prize — the grand prize of NYU's $300K Entrepreneurs Challenge (2020).
The platform
The method becomes an enterprise-grade platform: rubric design, smart peer assignment, instructor dashboards, and optional AI-assisted scoring — in beta today.
The method is described in a working paper by its inventors, and the engine generalizes beyond grading — to any question where many observers of uneven reliability meet a hard problem. Grading is the first proof.
Ready to transform your classroom learning experience?
Start for free — no credit card required. Talk to us when your department is ready.
Are you a student? Join a class →