Vendor deepfake assessment
A single deepfake attack has been known to cost organizations as much as $25 million.
Take the guesswork out of your investment in a voice authentication or deepfake detection solution. Will it work as promised?
At scale, in an organization's call center, deepfake attacks of $1,000-$5,000 each can mean tens of millions of dollars in losses (and additional reputational harm) in just one year.
deepreality Group offers financial institutions and other enterprise organizations a technology audit framework to help you validate voice authentication or deepfake detection technologies for your call centers or video conferencing systems.
If you're evaluating new vendors, or re-assessing existing tools, we can help you make quantifiable decisions on your business objectives and security level.
Evaluating AI-based technologies, which are non-deterministic, requires a new paradigm for testing that is critically different from standard software processes.
Our independent audit framework means —
You will ensure more rigorous validation of new voice authentication or deepfake detection systems, minimizing risks when you deploy at scale
You won't rely solely on any vendor's performance claims or demos
Our goal is to help you maximize authentication rates, reduce agent handle time, intercept fraud, and become resilient to the threat of deepfakes.
Unbiased. Independent. Technical.
deepreality Group does not accept referral fees or commissions from software vendors. Our commitment is entirely to our customer's security and business objectives.
Why Partner With Us?
We know how these systems should perform for you — we've built commercial voice authentication and deepfake detection systems, and deployed them for dozens of enterprise organizations worldwide, including several of the largest financial institutions in the world and other Fortune 500 companies
Expertise in state of the art technology — our AI research yielded the industry-leading algorithms for voice authentication, fraud detection and deepfake detection; purpose-built to prevent fraud and deepfake use in the real world
The reality Gap
A 99% detection rate in a controlled laboratory environment rarely survives the transition to a real-world telephony stack.
The gap between a sterile lab environment and the noisy real-world is ever widening, which means that production performance can be far worse than what is promised or apparent in standard testing. We even wrote a paper about it.
If you're adopting a new voice authentication or deepfake detection product, you need a way to reliably assess vendors for an initial selection and on an ongoing basis.
Our Audit Framework
Plan — Given your current progress, we develop a plan on how to collect data or otherwise test any authentication or deepfake detection systems in question
Assessment — We support your team to carry out statistically meaningful and realistic tests; we aim for a balance of scientific rigor and practical considerations. Some of the things we will look to assess include -
Resilience to latest Frontier AI models — adversarial red-teaming
Performance for your environment, whether it's your call centre or video conferencing platform
Accuracy tradeoffs
Resilience to broad set of attacks
Analysis — We review outcomes and support you in any followups or iterations with vendors
Key Deliverable — We prepare an Audit Report and Executive Briefing based on industry best practices from a technical (including FAR/FRR metrics) and business objectives (impact to security, operational efficiency, CSAT) perspective.
The report will include a detailed breakdown of the strengths and breakpoints of vendor technologies, as well as guidance on mitigating risks or making further adjustments.
