DataUpdated Nov 8, 2026

AI evaluation service providers

16 vendors in alphabetical order. Filter by workload, buying model, ownership, certifications, and public pricing, then select up to four to compare.

AI evaluation companies in alphabetical order with buying model, ownership, published certifications, and pricing
Vendor	Buying model	Ownership	SOC 2	ISO 27001	HIPAA	FedRAMP	Pricing
Apollo ResearchIndependent evaluator and research organization	Independent evaluator or research organization	Privately held	Not found	Not found	Not found	Not found	On request
Epoch AIIndependent research organization	Independent evaluator or research organization	Privately held	Not found	Not found	Not found	Not found	On request
Gray Swan AIRed team engagements and adversarial evaluation	Managed evaluation service, Security and red-team engagement, Self-serve platform	Privately held	Published	Not found	Not found	Not found	On request
HackerOneSecurity assessment firm	Security and red-team engagement	Privately held	Published	Published	Not found	Published	On request
Invisible TechnologiesManaged evaluation and human data	Managed evaluation service, Self-serve platform	Privately held	Published	Not found	Published	Not found	On request
IrregularIndependent evaluator (frontier AI security)	Independent evaluator or research organization	Privately held	Not found	Not found	Not found	Not found	On request
MercorManaged evaluation and human data	Managed evaluation service	Privately held	Published	Not found	Not found	Not found	On request
METRIndependent evaluator and research organization (nonprofit)	Independent evaluator or research organization	Privately held	Not found	Not found	Not found	Not found	On request
ProlificSelf-serve participant platform	Managed evaluation service, Self-serve platform	Privately held	Not found	Published	Not found	Not found	Published
Scale AIManaged evaluation and red teaming	Managed evaluation service	Privately held	Published	Published	Not found	Published	On request
Snorkel AIManaged expert data and evaluation	Managed evaluation service	Privately held	Published	Not found	Published	Not found	On request
Surge AIManaged expert evaluation and human data	Managed evaluation service	Privately held	Not found	Not found	Not found	Not found	On request
TolokaManaged evaluation and red teaming	Managed evaluation service, Self-serve platform	Privately held	Published	Published	Not found	Not found	On request
Trail of BitsSecurity assessment firm	Security and red-team engagement	Privately held	Not found	Not found	Not found	Not found	On request
TuringManaged evaluation and human data	Managed evaluation service	Privately held	Published	Not found	Not found	Not found	On request
Vals AIIndependent evaluator	Independent evaluator or research organization	Privately held	Not found	Not found	Not found	Not found	On request

Who covers what

Published workload coverage by vendor.

Which workloads each vendor publicly describes
Vendor	Capability evals	Safety & red teaming	Expert grading	Custom benchmarks	Pre-deployment tests	Cyber & AI security	Agent evals	Governance & risk
Apollo Research	No	Yes	No	No	Yes	No	Yes	Yes
Epoch AI	Yes	No	No	Yes	No	No	No	No
Gray Swan AI	No	Yes	No	Yes	Yes	Yes	Yes	No
HackerOne	No	Yes	No	No	No	Yes	Yes	Yes
Invisible Technologies	Yes	Yes	Yes	No	No	No	No	No
Irregular	Yes	No	No	Yes	Yes	Yes	No	No
Mercor	No	No	Yes	Yes	No	No	Yes	No
METR	No	Yes	No	No	Yes	No	No	Yes
Prolific	Yes	Yes	Yes	Yes	No	No	No	No
Scale AI	Yes	Yes	No	Yes	No	Yes	No	No
Snorkel AI	No	No	Yes	Yes	No	No	Yes	No
Surge AI	No	No	Yes	Yes	Yes	No	No	No
Toloka	Yes	Yes	Yes	No	No	No	Yes	No
Trail of Bits	Yes	Yes	No	Yes	No	Yes	No	Yes
Turing	No	No	Yes	Yes	No	No	Yes	No
Vals AI	No	No	Yes	Yes	No	No	Yes	Yes
Vendors	7	9	8	11	5	5	8	5

Based on each vendor’s published categories and capabilities. A filled dot means the vendor describes this workload publicly; it is not a quality judgment.