Research
The first proof, and what comes next.
The Marciano Method does not know it is grading essays. It knows how to estimate the truth from many judges of uneven reliability, and that problem appears wherever a hard decision meets a crowd. The Science page holds what is established about the method. This page holds what is being found out, field by field.
What makes a field a field
Three things define the shape of a judgment problem: who judges, what they judge, and what later shows whether they were right. When all three are the same in kind as a field already listed, the new case is a line on that field’s page, not a page of its own. The industry does not change the mathematics.
The programme
Six rooms, one problem.
Rows with a proposal or a product open on click.
Peer assessment in higher education→
Who judges
Students, with the instructor as benchmark
What they judge
Essays, cases and problem sets
Ground truth
The instructor's own grade
Hiring and staffing→
Who judges
Candidates and recruiters
What they judge
A work sample under a rubric
Ground truth
Retention and performance at ninety days
Expert panels and peer review
Who judges
Referees and committee members
What they judge
Submissions, proposals and entries
Ground truth
The editor's verdict; later citation and replication
Forecasting and risk
Who judges
Analysts and forecasters
What they judge
Forecasts and risk ratings
Ground truth
What happened
Performance review
Who judges
Colleagues and managers
What they judge
A year of someone's work
Ground truth
The next cycle: promotion, retention, results
Public discourse
Who judges
Readers, experts and fact-checkers
What they judge
Claims
Ground truth
What later proved true
- Deployed
- In production, with customers, and checked against a ground truth.
- Pilots open
- The proposal is written. We are seeking partners to run it with.
- Proposed
- A direction we believe in, stated as such. It earns a page when the proposal is written.
Essays
The arguments behind the programme.
The crowd was never the problem
The web assumed that enough voices, averaged, would surface the truth. Wherever the stakes were high, it did the opposite. What went wrong, what it cost, and why the fix was the weight all along.
Yash Goel · Science, Platform
Anyone can produce the work
Anyone can now produce the work. Nobody has agreed how to tell who understands it. The question the AI era left behind, in the classroom, the office, the journal and the hiring funnel.
Yash Goel · Science, Platform
Collective intelligence you can trust
The cost of producing an answer has gone to zero. The cost of knowing which answers to trust will define the next economy. What Fairgrade is for, why it began in higher education, and where it goes.
Yash Goel · Science, Education, Platform
Bring the method to your field.
Fairgrade takes on a small number of research pilots each year, at no charge, in exchange for a case study it may publish. If your organisation reaches high-stakes decisions through many evaluators and wants a signal it can check, write to us.
General enquiries: info@fairgrade.com · All research →