Guides
Build or Buy Legal AI? Latham's GPUs, Harvey's Seats and the Firms in Between
Build vs buy legal AI in 2026: rent Harvey or Legora, assemble on Claude or Astra with MCP, or build like Latham on own GPUs. Costs, control, decision tree.
On this page
Latham & Watkins now keeps Nvidia H200 servers in a data centre only its own staff can enter and fine-tunes open-weight models on them. Kirkland & Ellis is spending $500 million on a proprietary platform. Slaughter and May went firm-wide with Harvey in April 2026, and a 100-lawyer firm's technology committee chose Claude Enterprise over Harvey and Legora in August. Three strategies, each right for a different firm. Here are the costs, the trade-offs and a decision tree by size.
Three doors, and who walked through each
The choice is usually presented as build or buy. As of September 2026 there are three doors, and the middle one is where most of the movement is.
Door one: rent a legal vertical. Harvey ($15.5bn valuation, ARR above $400m, used by 43% of firms in ILTA's 2026 survey and 84% of firms with 700+ lawyers), Legora ($5.6bn, 1,480+ customers), Thomson Reuters' CoCounsel Legal and Lexis+ with Protégé. You get an all-inclusive interface, pre-built agents, integrations and a vendor who has chosen the models for you. Slaughter and May, CMS (7,000+ lawyers and staff), White & Case and Baker McKenzie walked through this door in the past year. The Harvey and Legora reviews cover the products.
Door two: assemble on a frontier platform. A Claude, ChatGPT or Copilot enterprise tier; Anthropic's open-source Claude for Legal plugins (Apache 2.0, 150+ skills, 20+ connectors as of 18 September 2026) or OpenAI's Astra for Law (17 September 2026, 26 partner plugins); MCP connectors into iManage or NetDocuments; the firm's own playbooks. Freshfields wrapped Claude in its own platform for 5,700 staff; usage grew about 500% in six weeks. Clifford Chance runs its own "Assist" and a Microsoft-native Knowledge Bank of 400,000+ reclassified documents, and uses neither Harvey nor Legora. The r/legaltech thread in which a 100-lawyer firm's committee picked Claude Enterprise notes that the older partners wanted Harvey. The Claude for Legal plugins page and the DMS connection playbook show what assembling involves.
Door three: build. Latham bought Nvidia H200 servers, houses them where only its staff have access, and fine-tunes Nvidia's open-weight Nemotron 3 models; it has 900 technology staff, about 100 on AI, and revenue of about $8.3bn (Bloomberg Law, 10 September 2026). Kirkland will spend $500m over four years, $100m-plus in 2026, with a roughly 180-person team and 250 lawyers involved, and its job advertisements for an "AI Infrastructure Director" at $302,000–$335,000 require on-premise GPU experience (Global Legal Post, May 2026). The vendors are building too: Harvey's Tenet is a post-trained open-weight legal model (research preview 20 August 2026). At the other end, a German three-lawyer firm runs self-hosted n8n, local OCR and a local model on a German server for €20–30 a month and reclaimed six to seven hours a week (Lyron, spring 2026). That is also building.
McKinsey's 2026 State of AI survey found 38% of professional-services firms now forgo a software purchase to build in-house (McKinsey); Gartner expects more than 40% of agentic AI projects to be cancelled by end-2027.
What each door costs
Published and estimated prices as of September 2026; the pricing guide has the full table and the assumptions.
| Rent a vertical | Assemble on a platform | Build | |
|---|---|---|---|
| Licence | Harvey est. $1,000–1,200 per seat per month, 20-seat minimum (secondary sources); Legora from about $3,000 per user per year, 10-seat minimum; CoCounsel $104–639 per user per month; Clio Work $199 | Claude Team $25 standard / $125 premium seat; ChatGPT Business $25; M365 Copilot $30; Claude for Legal plugins free; Managed Agents $0.08 per session-hour plus tokens; API Opus 5 $5/$25, Sonnet 5 $2/$10 per million tokens | Kirkland $100m-plus in 2026, $500m over four years; Latham's server spend undisclosed; the German micro-firm €20–30 a month |
| People | Vendor customer-success teams; a firm champion | An owner for plugins, connectors and the prompt library; IT for allowlists and audit | Latham ~100 AI specialists of 900 technologists; Kirkland ~180 |
| What you own | Playbooks and custom agents, inside the vendor's format | Playbooks, prompts, skills and connectors, portable across models | Everything, including the model weights and the obsolescence |
| Model choice | Vendor's multi-model stack (Harvey added Opus 5 on 24 July 2026 and Fable 5.1 on 1 September) | Yours, subject to the platform | Yours; open weights from Nvidia, Mistral (Large 3, Apache 2.0), DeepSeek (V4-Pro, MIT licence) or Meta (Muse Glimmer 30B, runs on a 24GB GPU) |
| Exit | Export of Vault and agent definitions, if contracted | Skills and prompts move; connectors are standard MCP | You are the vendor |
The August 2026 Reddit bake-off is the honest footnote to the first row. A 30-lawyer firm ran the same intake notes through Harvey, Legora and CoCounsel; every system missed a disqualifying heirship issue, and only Claude Opus at maximum effort caught it. The head of technology concluded that subscription vendors are "not incentivized to provide the best model due to their cost"; a commenter's was that "the team that used the tool daily got real value from any of the three" while the occasional users "barely broke even on the seat cost" (r/legaltech, 30 August 2026). The vertical's premium buys integration and governance, not necessarily the strongest model on the day. The legal AI versus general-purpose AI comparison goes further.
Control and confidentiality: the sovereignty argument, tested
Latham's stated reason for door three is confidentiality and optionality: "They're in the cloud and this is on premise." Artificial Lawyer's Richard Tromans replied on 14 September 2026 that the more one looks at the GPU purchase "the less it seems to make sense", that "efficiency has never been part of the deal" in Big Law, and that the firm is "fighting against an incoming tide of commoditization" (Artificial Lawyer). Both sides have facts.
For on-premise: Anthropic's strongest models, Fable 5.1 and Mythos, require 30-day retention and are not eligible for zero data retention without express authorisation, and Claude's Team and Enterprise chat interfaces are not ZDR-eligible at all (Anthropic). On 12 June 2026 US export controls led Anthropic to suspend every user's access to Fable 5 worldwide for 18 days because it "had no reliable way to verify nationality in real-time". Mistral's positioning for EU firms is that a data-residency toggle "changes where data sits, not which government can compel its production". ÖRAK's first practice rule is that client data stays on EU servers. The zero data retention entry explains why the strongest model and the most private deployment are rarely the same thing.
Against it: open-weight models that a firm can host are measurably weaker on legal tasks as of September 2026. DeepSeek V4-Pro scored 40.87% on Vals' Legal Research Bench and 7.50% on Harvey's strict Legal Agent Benchmark; Mistral Large produced 64% citation errors in HAQQ's June 2026 test; Meta's Muse Spark tops the legal leaderboards but its promised open weights remain unpublished. A firm that builds is choosing control over capability, a legitimate choice for Latham's most sensitive work and an expensive one for a mid-market firm's NDAs. The open-weight versus closed models comparison and the fine-tuning entry have the detail.
The overlooked point is vendor half-life, which cuts against doors one and two equally. ChatGPT Atlas lasted 292 days. OpenAI's Agent Builder, launched October 2025, shuts on 30 November 2026. Relay.app closed to paying customers on 14 September 2026. Robin AI failed to close a round and put itself up for sale in October 2025. Tromans' "battle for centrality" piece on Astra for Law (18 September 2026) puts the buyer's position in one line: "no lawyer wants to be totally locked into one LLM maker". Whichever door, the vendor due diligence questions on data export and termination are not optional.
Talent: the constraint nobody budgets for
Money is the easier problem. Latham has 900 technologists; Kirkland is hiring 180 people at Silicon Valley rates. The Am Law 200 now has 132 chief-level AI, innovation or knowledge officers; a third of firms have only a director (Law.com, 5 August 2026). UBS's legal team narrowed 80 candidate use cases to three with a 140% ROI hurdle; discipline, not headcount, separated Axiom's 7% of teams that measure AI at scale from the rest.
At the assembling door the talent need is smaller but not zero. Someone has to own the plugins, keep the prompt library current, configure allowlists and audit capture, and verify the output. An ex-deputy general counsel who failed for weeks in n8n "rebuilt it in a day using Claude Code". The vibe coding entry and the n8n page show how far a lawyer gets without an engineer; the agent security guide shows where that stops being safe.
A decision tree by firm size
Start at your size. "Move up" means the trigger that justifies the next door.
- Solo to about 20 lawyers. Default: buy a business-tier frontier assistant ($20–30 a seat) plus, if the practice has volume in one task, a single legal tool (Clio Work at $199, Spellbook from about $99, AI:ssociate from €39 in Austria). Assemble intake and admin on n8n, Make or Zapier. Never build models; the German micro-firm's self-hosted stack is the ceiling. Harvey's 20-seat and Legora's 10-seat minimums settle it anyway. The small firms guide has three worked setups.
- 20 to about 100 lawyers. Default: assemble. Enterprise Claude, ChatGPT or Copilot; Claude for Legal or Astra for Law plugins; MCP into the DMS; a named owner at 20–40% of one person's time. Move up to a vertical when one practice group's volume in diligence, contract review or research means a vendor's pre-built agents save more than the seat premium; run a pilot on real matters first. Never build.
- 100 to about 500 lawyers. Default: one vertical for the high-volume practice groups plus an assembled frontier layer for everyone else, which is what DLA Piper (5,000 Harvey licences with Copilot as general assistant) and Simmons & Simmons (Legora, its own "Percy", Copilot and "hundreds of agents") run. Move up to building only for a specific, sensitive workload with a measured business case and an engineer on payroll.
- 500-plus lawyers. Default: two doors deliberately, with a chief-level owner. Build on-premise capacity only if you can answer Penn State's Daryl Lim, who noted that Latham's mathematics only works if the servers are used. The bet is that the firm's lawyers and data are a moat ("no AI company will ever replicate what we're doing because they don't have our lawyers", as Latham's Amber Banks put it); the counter-bet is Tromans' commoditisation tide.
- In-house departments. Default: assemble on whatever the company already licenses, usually Copilot, then add one vertical if outside-counsel spend justifies it; Salesforce chose Legora on 16 September 2026 despite having built much of its own tooling. The in-house guide has the roadmap.
At every branch the how to choose a legal AI tool page has the evaluation criteria, and Module 4 of the AI Lab for Lawyers course walks through assembling a working agent on a frontier platform with no code, the fastest way to find out whether door two is enough.
Why the answer is usually two doors
Every named firm here runs at least two. Latham fine-tunes its own models and pays for Harvey, Legora and frontier-lab tools, describing the combination as "best optionality". Freshfields announced a Google Cloud relationship one week before its Anthropic deal. Linklaters runs its in-house "Laila" (200,000+ uses a month) alongside Legora. Law.com asked in May 2026 whether Big Law is building "an AI Tower of Babel" of overlapping stacks; the firms' answer is that overlap is the hedge (Law.com).
The hedge only works if you can leave. Negotiate this exit checklist before signing any door:
- Export of playbooks, custom agents, prompts and Vault contents in a documented format, on termination and on demand.
- Written model list with notice of changes; the right to test a new model on your data before it becomes the default.
- Data retention, training and sub-processor terms that match the strictest bar rule you practise under; the confidentiality checklist has the clauses.
- Audit-log access and retention on the firm's terms, not the vendor's.
- A price cap or notice period on consumption elements; Harvey's and Legora's pricing already includes them.
- A named fallback for the day the platform goes dark, as Fable 5 did for 18 days in June 2026.
What to decide this quarter
Three decisions, in order:
- Which door is your default for the next 24 months. Use the tree above and write down the trigger that would move you.
- Who owns it. A name, a percentage of their time, and a budget line for training the people who will use it; the AI literacy guide sets out what that training contains.
- What you will measure. Hours per task before and after, verification failures caught, seats actually used monthly; RSGI's study of 40 Harvey organisations reported 92% monthly licence usage where firms saw benefit, and the Reddit bake-off found occasional users broke even at best.
Latham's servers, Harvey's seats and a €30 self-hosted stack are all rational answers to the same question. What is not rational is the fourth door, which is the one most firms are still standing in: no default, no owner, and 34% of staff using an unsanctioned tool on their own account.
Frequently asked questions
Should a law firm build its own AI model?
Only a handful should, and they already know who they are. Latham & Watkins ($8.3bn revenue, 900 technology staff) fine-tunes open-weight models on its own Nvidia servers and still uses Harvey, Legora and frontier tools. Kirkland & Ellis is spending $500m. Below that scale, the sensible version of building is assembling: a frontier platform, open-source plugins, MCP connectors into your DMS, and your own playbooks.
Is Harvey worth it compared to using Claude or ChatGPT directly?
It depends on what you would otherwise have to assemble. Harvey's estimated $1,000–1,200 a seat a month buys an all-inclusive price with no token usage to manage, Vault, 500+ pre-built agents, integrations and a contractual confidentiality posture many firms trust. A Claude or ChatGPT business seat costs $25–125, but the firm then owns the plugins, connectors, governance and verification workflow, and needs someone to run them.
What does Latham & Watkins do with its own GPUs?
As reported on 10–11 September 2026, Latham bought Nvidia H200 servers, housed in a data centre only Latham staff can access, and fine-tunes Nvidia's open-weight Nemotron 3 models for its most sensitive work. Its leaders describe the point as optionality and on-premise confidentiality that cloud vendors cannot offer, while the firm continues to use Harvey, Legora and frontier-lab tools.
How do small law firms decide between building and buying legal AI?
A firm under about 20 lawyers should buy a business-tier frontier assistant and, if the practice justifies it, one legal tool, and assemble the rest with no-code automation. A German three-lawyer firm runs intake, onboarding and deadline capture on a self-hosted server with a local model for €20–30 a month. Harvey's 20-seat minimum and Legora's 10-seat minimum put the verticals out of reach anyway.
Put this into practice
AI Lab for Lawyers: a live, hands-on course for practising lawyers
4 live sessions (8 hours), recordings included, taught by Dr. Niklas Schmidt of Wolf Theiss. Rated 4.7/5 from 381 ratings; alumni from Norton Rose Fulbright, Paul Hastings, Pillsbury and Taylor Wessing.
Related reading
Tools
Harvey AI in 2026: What It Does, What It Costs and Who Uses It
Harvey AI reviewed as of September 2026. The $15.5bn valuation, Harvey II, Tenet, 500-plus agents, who uses it, estimated seat prices and its own benchmark.
9 min read
Tools
Legora Review: The Agentic OS Challenging Harvey
Legora reviewed as of September 2026. The $5.6bn Stockholm challenger to Harvey: aOS, Tabular Review, Wexler litigation facts, pricing, clients to Salesforce.
7 min read
Tools
Claude for Legal Plugins Explained: The 12 Practice-Area Plugins and 20+ Connectors
Claude for Legal gives paid Claude users 12 open-source practice-area plugins, 150+ skills and 20+ connectors to iManage, NetDocuments and CoCounsel.
8 min read
Comparisons
Open-Weight vs Closed Models for Law Firms: Control, Cost and Confidentiality
Open-weight vs closed AI models for law firms: what Latham's own GPUs buy, Harvey Tenet, DeepSeek V4, Mistral, the legal benchmark gap, when self-hosting pays.
10 min read
Guides
What Legal AI Really Costs in 2026: Harvey, Legora, CoCounsel, Claude and ChatGPT
Legal AI cost as of September 2026, from €39 to $1,200 per seat per month, with Harvey, Legora, CoCounsel, Claude and ChatGPT prices and worked budgets for 5 and 50 lawyers.
10 min read
Regulation & Ethics
AI Vendor Due Diligence for Law Firms: The Questions to Ask Before You Sign
AI vendor due diligence for law firms starts with the subprocessor chain, then training and retention terms, ZDR eligibility, data residency, audit logs and exit rights.
11 min read