The independent guide to AI evaluation companies

Capability evals, safety evals and red teaming, domain-expert grading, custom benchmarks, and pre-deployment testing. Find the evaluator that matches your question, independence needs, and security requirements, with every fact linked to its source.

Explore the landscape Read the buyer’s guide

16vendors profiled: Managed services, expert networks, platforms, and dataset sellers.
50primary sources: Vendor sites, trust portals, and company releases. No listicles.
0paid placements: Nobody pays to appear or to change their position.

Who covers what

Filter vendors

Published workload coverage for 16 AI evaluation companies. Click a column to see those vendors.

Which workloads each vendor publicly describes
Vendor	Capability evals	Safety & red teaming	Expert grading	Custom benchmarks	Pre-deployment tests	Cyber & AI security	Agent evals	Governance & risk
Apollo Research	No	Yes	No	No	Yes	No	Yes	Yes
Epoch AI	Yes	No	No	Yes	No	No	No	No
Gray Swan AI	No	Yes	No	Yes	Yes	Yes	Yes	No
HackerOne	No	Yes	No	No	No	Yes	Yes	Yes
Invisible Technologies	Yes	Yes	Yes	No	No	No	No	No
Irregular	Yes	No	No	Yes	Yes	Yes	No	No
Mercor	No	No	Yes	Yes	No	No	Yes	No
METR	No	Yes	No	No	Yes	No	No	Yes
Prolific	Yes	Yes	Yes	Yes	No	No	No	No
Scale AI	Yes	Yes	No	Yes	No	Yes	No	No
Snorkel AI	No	No	Yes	Yes	No	No	Yes	No
Surge AI	No	No	Yes	Yes	Yes	No	No	No
Toloka	Yes	Yes	Yes	No	No	No	Yes	No
Trail of Bits	Yes	Yes	No	Yes	No	Yes	No	Yes
Turing	No	No	Yes	Yes	No	No	Yes	No
Vals AI	No	No	Yes	Yes	No	No	Yes	Yes
Vendors	7	9	8	11	5	5	8	5

Based on each vendor’s published categories and capabilities. A filled dot means the vendor describes this workload publicly; it is not a quality judgment.

Vendor landscape

16 evaluation companies, checked November 8, 2026. Filter by evaluation type, engagement model, published certifications, and public pricing. Select up to four to compare side by side.

AI evaluation companies in alphabetical order with buying model, ownership, published certifications, and pricing
Vendor	Buying model	Ownership	SOC 2	ISO 27001	HIPAA	FedRAMP	Pricing
Apollo ResearchIndependent evaluator and research organization	Independent evaluator or research organization	Privately held	Not found	Not found	Not found	Not found	On request
Epoch AIIndependent research organization	Independent evaluator or research organization	Privately held	Not found	Not found	Not found	Not found	On request
Gray Swan AIRed team engagements and adversarial evaluation	Managed evaluation service, Security and red-team engagement, Self-serve platform	Privately held	Published	Not found	Not found	Not found	On request
HackerOneSecurity assessment firm	Security and red-team engagement	Privately held	Published	Published	Not found	Published	On request
Invisible TechnologiesManaged evaluation and human data	Managed evaluation service, Self-serve platform	Privately held	Published	Not found	Published	Not found	On request
IrregularIndependent evaluator (frontier AI security)	Independent evaluator or research organization	Privately held	Not found	Not found	Not found	Not found	On request
MercorManaged evaluation and human data	Managed evaluation service	Privately held	Published	Not found	Not found	Not found	On request
METRIndependent evaluator and research organization (nonprofit)	Independent evaluator or research organization	Privately held	Not found	Not found	Not found	Not found	On request
ProlificSelf-serve participant platform	Managed evaluation service, Self-serve platform	Privately held	Not found	Published	Not found	Not found	Published
Scale AIManaged evaluation and red teaming	Managed evaluation service	Privately held	Published	Published	Not found	Published	On request
Snorkel AIManaged expert data and evaluation	Managed evaluation service	Privately held	Published	Not found	Published	Not found	On request
Surge AIManaged expert evaluation and human data	Managed evaluation service	Privately held	Not found	Not found	Not found	Not found	On request
TolokaManaged evaluation and red teaming	Managed evaluation service, Self-serve platform	Privately held	Published	Published	Not found	Not found	On request
Trail of BitsSecurity assessment firm	Security and red-team engagement	Privately held	Not found	Not found	Not found	Not found	On request
TuringManaged evaluation and human data	Managed evaluation service	Privately held	Published	Not found	Not found	Not found	On request
Vals AIIndependent evaluator	Independent evaluator or research organization	Privately held	Not found	Not found	Not found	Not found	On request

Alphabetical. A check means the vendor publishes it on its own site or trust portal; a dash means we found nothing public, so ask the vendor.

Research and comparisons

GuideNov 8, 2026 How to hire an AI evaluation company Seven decisions, in order: the question, engagement type, independence, evaluator expertise, deliverables, security evidence, and commercial terms. ComparisonNov 8, 2026 Apollo Research vs METR ComparisonNov 8, 2026 Gray Swan AI vs HackerOne ComparisonNov 8, 2026 Scale AI vs Surge AI

Browse by workload

How this guide works

Every claim links to a public source, with the date we checked it.
No paid rankings. Companies are listed alphabetically or by the filters you choose.
Pricing shown only where a company publishes it. Otherwise: contact vendor.

Read the methodology