Back to Insights
Legal Directories29 April 20267 min read

Why referee strategy beats matter volume in the Chambers race

Directory rankings are decided less by what you submit than by what researchers hear when they pick up the phone.

DS

David Standard

Founder, Standard Consulting

Most conversations about Chambers and Legal 500 rankings start and end in the same place: the matter list.

Partners ask their BD teams which deals to lead with. BD teams wrestle with which mandates were the most prestigious. Confidentiality restrictions get negotiated, client permissions chased, deal values double-checked.

All of this matters. None of it is the main event.

The uncomfortable truth — uncomfortable because it's less controllable than matters — is that directory rankings are decided less by what you submit than by what the researchers hear when they pick up the phone.

That means your rankings are, to a degree firms rarely admit to themselves, a referee strategy problem.

What the researchers actually do

Directory research is not a document review exercise. It's a triangulation exercise.

A researcher reads your submission. Then they call clients. Then they call other lawyers. Then they read competitor submissions. Then they call those firms' clients. Then they weigh everything against their accumulated market understanding.

Your submission is one of five or six inputs. And it's the one the researcher trusts the least, because you wrote it.

Referee feedback — unscripted, unfiltered, from people who worked with your lawyers on real work — is the input researchers weight most heavily. This is not controversial. The directories are explicit about it. Chambers calls referee interviews "the most important part" of the research process.

Which means: a firm with a stronger matter list and weaker referee performance will lose to a firm with a weaker matter list and stronger referee performance. Not every time. But enough of the time that the pattern is visible across multiple cycles.

Three referee failures that hand rankings to competitors

Failure 1: Nominating the wrong people

There's a natural instinct to nominate your happiest clients. The ones you know will say something nice.

This backfires in two ways. First, researchers can hear scripted enthusiasm a mile away — generic praise is a soft negative signal. Second, the best referees aren't the most enthusiastic, they're the most credible: seasoned counterparties, sophisticated general counsel, clients who have worked with multiple firms and can genuinely compare.

A referee who says "they're great" is worth less than a referee who says "we used them on a matter where the stakes were X, they handled it better than firm Y would have, and here's the specific reason why."

Failure 2: Contacting referees too late

The industry norm is to contact referees in the weeks before submission. By that point, researchers are starting calls within days. Your referee has had no warm-up, no context, no chance to prepare.

Worse: your referee has almost certainly been nominated by two or three other firms as well, because strong clients get nominated everywhere. The firms that briefed their referee six weeks in advance, with context and suggested talking points (which is allowed and expected), will outperform the firms that sent a scrambled email in February.

Failure 3: No record of referee history

Almost every firm I've worked with manages referees in a spreadsheet that gets dusted off once a year. Who was contacted. Who was willing. What matter they were nominated for.

What this loses: cadence. If you nominated the same client in 2023, 2024, and 2025, they are almost certainly being nominated by two or three other firms in those same years. You are quietly over-drawing their goodwill. The fourth ask is when they say no, or worse, say yes reluctantly.

Without a year-over-year view, you can't see this coming. With one, you can rotate referees, space nominations, and keep your strongest advocates strong.

What a real referee strategy looks like

The firms that do this well share a set of practices. None of them are complicated. All of them are hard without the right infrastructure.

A single source of truth for referee relationships. Not a spreadsheet. A database that tracks every referee, every nomination, every outcome, every year. Cross-referenced to matters. Tagged by practice area, seniority, type of feedback most likely to resonate.

Referee nominations decided in December, not February. The firms that win have time to brief their referees properly. That only happens when the nomination decision is made months before the submission.

Warm-up touches through the year. Not marketing emails. Genuine, relationship-maintaining contact. A quick call after a matter closes. An invitation to an event. A heads-up about a relevant change in the market. Referees remember firms that stay in touch without asking for something.

A briefing document, not a briefing email. Before the researcher calls, your referee should have: a reminder of the specific matter, the specific partners, the specific outcome, and two or three talking points they can speak to credibly if the researcher asks. This is entirely permissible and universally done by firms that rank well.

A post-cycle debrief. After rankings are published, debrief with your referees. What did the researcher ask? What did your referee emphasise? What surprised them about the call? This data is pure gold for next year's strategy. Most firms throw it away.

The infrastructure problem

Every one of these practices is impossible to sustain with a spreadsheet and goodwill.

A referee CRM — one that tracks nomination history, cadence, relationship strength, willingness, matter cross-references — turns referee management from a once-a-year scramble into a year-round discipline. The tooling matters not because it writes better submissions, but because it changes what's possible to sustain.

This is one of the reasons we built SubsIQ around the assumption that referees are first-class objects, not an afterthought. Referee history, permission tracking, and matter-level cross-referencing are not optional features. They're the spine of a serious directory strategy.

The matter database is the foundation. The referee CRM is where the rankings are actually won.

The uncomfortable implication

If referee strategy matters more than matter volume, then the firms best positioned to climb the rankings are not the firms with the biggest deal lists. They're the firms with the deepest, best-managed client relationships and the discipline to treat those relationships as a year-round strategic asset.

That's good news and bad news.

Good news: a mid-size firm with a strong client culture can out-rank a larger firm with a weaker one. The playing field is less tilted than it looks.

Bad news: you can't fix this in February. The firms that will rank highest next year are doing the work right now.

Where to start

If you want to see what a referee CRM integrated with a matter database actually looks like in practice, SubsIQ has a self-serve demo. It's loaded with a fictional firm, including sample referees with permission tracking, so you can click through and assess whether the approach makes sense for you:

Try the demo →

Fifteen minutes will tell you whether this is the shape of the solution. The harder question — whether your firm has the client culture and BD discipline to exploit it — only you can answer.

Want to discuss this?

David works directly with managing partners and senior leadership teams.

Get in touch