We need to process data in multiple languages for a…
We need to process data in multiple languages for a cross-border investigation. Which e-discovery tool has the most reliable machine translation and foreign language optical character recognition (OCR)?
Data as of Oct 5, 2026ChatGPT SearchGoogle AI ModeBased on 313 AI responses from ChatGPT Search and Google AI Mode·Reviewed by Dimitry Apollonsky ·
For cross-border investigations requiring robust foreign language support, TransPerfect Legal Solutions (Digital Reef) is a top recommendation for its advanced linguistic-aware OCR. For integrated workflows where translation and OCR need to happen directly inside the review process, Everlaw and Reveal are preferred for their AI-driven language identification and bulk document translation capabilities.
Best for document-centric investigation teams that need built-in translation to reduce costs. Its platform enables fast, on-the-fly translation of large volumes of records directly within the interface during document review.
For a cross-border investigation where both machine translation and foreign-language OCR are critical, I would shortlist Reveal and RelativityOne first. There is no credible public head-to-head benchmark showing that one platform is universally the most accurate at both tasks, so “most reliable” depends substantially on the languages and document types in your dataset.
Platform
Machine translation
Foreign-language OCR
Key consideration
Reveal
75+ languages
120+ languages; can process multiple languages in the same document/pass
For a cross-border investigation where multilingual translation and foreign-language OCR are core requirements, I’d put RelativityOne at the top of the shortlist.
100+ languages, including batch and on-the-fly translation
Multilingual OCR during processing
Strong choice for very large/complex investigations and established litigation workflows.
Everlaw
Broad multilingual support using Google Translate or Amazon Translate
Strong OCR, including Latin languages and CJK
Good alternative, but its autodetection has limitations when multiple languages occur on the same page.
My practical take
If foreign-language OCR is the dominant requirement:Reveal has a particularly compelling documented capability. Its processing OCR supports 120+ languages and can extract Chinese, Japanese, and Korean from the same document in a single OCR pass.
If the investigation is a very large, complex matter where multilingual processing is one part of a broader e-discovery workflow:RelativityOne is worth putting at the top of the technical evaluation. It supports translation into 100+ languages and integrates translation directly into the review environment.
If translation-provider choice matters: Everlaw explicitly uses Google Translate or Amazon Translate, and supports a particularly broad list of non-English languages.
One important caveat: machine translation should generally be treated as a review/triage aid rather than a substitute for certified human translation where the translated text will be used as evidence or in a legal filing. Everlaw makes the same distinction in its documentation.
If you tell me the specific languages involved (e.g., Chinese/Japanese/Korean, Arabic, Russian, German, French, etc.) and whether you're dealing mainly with scanned PDFs, emails, Office files, or handwritten documents, I can give you a much more meaningful Reveal vs. RelativityOne vs. Everlaw comparison.
For a complex cross-border investigation involving multiple languages, messy scanned documents, and foreign scripts, no single "out-of-the-box" native engine does everything perfectly. Instead, reliability comes down to ecosystem flexibility —how well an e-discovery platform integrates top-tier enterprise translation and OCR engines (like Microsoft Azure, AWS, Google Cloud, or specialized legal linguists like Language Weaver and TransPerfect) directly into the review workflow [2.2].
The top-tier e-discovery platforms handling heavy multilingual and cross-border investigations stack up as follows:
Relativity (Server / One / RelativityTrace): Widely considered the gold standard for massive, complex, multi-jurisdictional matters. Rather than relying on a proprietary engine, Relativity’s strength is its integration ecosystem. It features robust native language identification (part of Relativity Analytics) and seamless third-party connectors like the Language Weaver Connector for Relativity or deep integrations with TransPerfect Legal and AWS/Azure machine translation. For OCR, it leverages enterprise-grade image processing, though heavily degraded historical foreign scripts often require specialized pre-processing.
Reveal (with Brainspace & AWS/Azure AI): Reveal has heavily invested in AI-driven data processing. It natively handles multi-language concept searching, clustering, and sentiment analysis. Because it integrates deep cognitive services from cloud giants (AWS/Microsoft), its foreign language OCR and machine translation translation pipelines are spun up dynamically inside the review interface, making it exceptionally fast for triage across diverse character sets (like CJK or Cyrillic).
Everlaw: Known for an intuitive user interface and speed, Everlaw offers robust native foreign language support, automated language identification, and integrated machine translation. It is exceptionally user-friendly if your review team isn't deeply technical, though for massive, multi-terabyte cross-border data with obscure dialects, enterprise heavyweights like Relativity or Reveal offer tighter custom-linguistic pipelines.
Nuix Discover: Praised for forensic depth and raw processing power. Nuix excels at unearthing deeply buried artifacts across diverse file types and international character encodings. Its native processing engine extracts and indexes text across a massive array of languages cleanly, though you will often pair it with a specialized translation plug-in for high-volume cognitive translation during the review phase.
Key Factors for Your Investigation:
OCR vs. Machine Translation are separate steps: Ensure the platform doesn't just translate text well, but first accurately performs OCR on non-searchable or handwritten foreign documents (e.g., scanned invoices or handwritten ledgers in a foreign script). Tools utilizing Microsoft Azure AI Document Intelligence or advanced AWS OCR backends under the hood handle non-Latin and complex scripts best.
Language Identification (LID): You need a tool that can accurately auto-detect mixed-language documents (e.g., an email chain switching between English and Japanese) before passing them to the translation engine.
To help narrow down which platform fits your specific case, could you share:
What specific foreign languages or scripts (e.g., Mandarin, Arabic, Cyrillic, Western European) make up the bulk of the data?
Is the data mostly digital-native files (emails, chats) or messy scans/handwritten physical docs requiring heavy OCR?
For a cross-border investigation where multilingual processing is central, I’d put RelativityOne and Everlaw at the top of the shortlist, but there isn’t a credible independent basis to declare one universally “most reliable” for both machine translation and foreign-language OCR.
Platform
Machine translation
Foreign-language OCR
What stands out
RelativityOne
100+ languages; batch and on-the-fly translation
Broad multilingual processing; language support varies by document/scanned-PDF type
Strong choice for large, complex investigations and established review workflows
Everlaw
Google Translate or Amazon Translate; very broad language coverage
Automatic OCR with autodetection covering Latin languages plus Chinese/Japanese/Korean
Particularly transparent about supported languages and translation workflow
Reveal
Strong multilingual review/analytics capabilities
Broad processing capabilities
Worth testing if conceptual analytics across languages are important
Nuix
Strong investigation/data-processing ecosystem
Particularly strong for heterogeneous evidence and forensic processing
Worth considering when the investigation involves unusual data sources or forensic collections
RelativityOne has a particularly strong case if your corpus contains many languages and scanned material. Its Translate application supports batch translation and automatic language detection, with documentation covering a large number of languages; it also warns that multilingual documents can produce incomplete/incorrect translations, which is important for a real investigation.
Everlaw is the other platform I'd test head-to-head. Its current documentation says it can detect and translate a very large set of languages and supports both Google Translate and Amazon Translate. Its OCR automatically handles Latin-alphabet languages as well as Chinese, Japanese and Korean, although its documentation specifically cautions that automatic OCR is less reliable when multiple languages occur on the same page.
The important caveat
“Most reliable” really needs to be measured against your actual languages and document types. Translation quality can differ substantially for, say, Japanese contracts, Arabic scans, Cyrillic PDFs, mixed-language emails, and poor-quality faxes. OCR accuracy can likewise change dramatically with scan quality, handwriting, tables and mixed scripts.
For a serious cross-border investigation, I would therefore run a vendor bake-off using a blinded sample of perhaps 200–500 representative documents and measure:
OCR character/word accuracy by language and document type.
Translation accuracy against human-reviewed reference translations.
Entity/name preservation.
Treatment of legal terminology.
Mixed-language document performance.
Search recall after OCR/translation.
Handling of scanned PDFs, handwriting, tables and embedded images.
Auditability and ability to preserve the original alongside machine-derived text.
Data residency, subprocessors and cross-border transfer controls.
Also, machine translation should generally be treated as a review/discovery aid rather than a substitute for certified human translation when translated text itself will be relied upon in a legal proceeding. Everlaw explicitly makes this distinction in its documentation.
Bottom line: If multilingual OCR + translation is the deciding factor, I'd put RelativityOne and Everlaw into the first comparative pilot, rather than selecting a winner from vendor feature lists. If you tell me the languages involved (e.g., Chinese/Japanese/Arabic/German), approximate data volume, and whether the evidence is mostly native files or scanned PDFs, I can build a more rigorous side-by-side comparison of Relativity, Everlaw, Reveal, Nuix and DISCO.
For cross-border investigations involving complex, multi-language data sets, relying on a platform with native or tightly integrated processing pipelines is critical. Foreign language OCR requires specialized character sets and linguistic dictionaries to accurately capture non-Latin alphabets (such as Chinese, Japanese, Korean, Cyrillic, or Arabic) before machine translation (MT) can process them effectively.
The top e-discovery platforms compared on their foreign-language OCR ingestion and neural machine translation capabilities include:
RelativityOne (RelativityOne Translate ) is widely considered the industry benchmark for massive, complex cross-border matters. It features native, secure machine translation supporting over 100 languages directly in-platform. For OCR, Relativity leverages robust multi-language extraction engines and allows seamless integration with specialized legal translation connectors (like RWS Language Weaver ) and specialized processing extensions, making it the most customizable and scalable for diverse character sets.
Everlaw (Everlaw Translate ) provides streamlined, user-friendly multilingual support through ad-hoc document translation and advanced Everlaw AI batch translation capabilities. Its native OCR handles standard international character encoding well, and its interface makes it exceptionally easy for reviewing teams to execute quick, side-by-side or inline translations without jumping across multiple third-party windows.
Reveal (with Brainspace) integrates advanced AI-driven multilingual processing and conceptual analytics. Reveal stands out because its AI engine handles multi-language clustering and cross-lingual concept searching natively, meaning you can search for a concept in English and find relevant documents in Japanese or German without a prior translation pass.
TransPerfect Legal Solutions (Digital Reef) is technically a specialized managed service and software hybrid rather than a pure SaaS e-discovery platform, but it features proprietary Linguistic OCR . If your investigation deals with messy, highly degraded historical scans in unusual dialects or lesser-represented languages, their processing teams apply language-sensitive character sets that standard out-of-the-box e-discovery OCR frequently misses.
For complex, cross-border investigations involving heavy multi-language processing, two major enterprise e-discovery platforms stand out as the industry gold standards for foreign-language optical character recognition (OCR) and machine translation: Reveal (with Brainspace) and Relativity (RelativityOne).
Both handle non-Latin scripts, multi-language documents, and automated translation pipelines exceptionally well, but they approach the workflow slightly differently.
1. Reveal (with Brainspace)
Reveal is widely regarded as a powerhouse for native, AI-driven multilingual processing because it was architected to handle complex language identification and extraction deeply within its core engine.
Foreign Language OCR: Supports 120+ languages during processing. Crucially, it can handle multiple languages within a single document on a single pass (e.g., a mixed document containing Chinese, Japanese, and Korean).
Language Identification: Uses a neural network AI n-gram approach to automatically identify up to three languages and their precise percentages within a single file across 150+ languages.
Machine Translation: Offers built-in AI-driven translation spanning 75+ languages, allowing reviewers to seamlessly toggle languages in the interface.
Best For: Teams wanting out-of-the-box, heavy-duty processing of disparate, mixed-script global datasets without needing to stitch together separate third-party language packs immediately.
2. RelativityOne
Relativity remains the most ubiquitous ecosystem in e-discovery, and its strength for foreign languages lies in its massive App Hub and native integrations (such as Translate in RelativityOne and advanced plugins like Ai Translate).
Foreign Language OCR: Utilizes top-tier OCR engines (like ABBYY FineReader underlying or tightly integrated) that excel at degraded non-English text, handwriting, and complex multi-font foreign documents.
Machine Translation: Native translation features scale across 100+ languages directly inside the viewer. For high-stakes government or AmLaw cross-border work, integrations like Ai Translate provide cross-lingual semantic search, automated English summaries, and PII redaction across foreign text.
Best For: Large-scale matters requiring customizable, deeply specialized linguistic workflows, cross-lingual conceptual searching, and third-party translation memory add-ons.
Alternative Option: DISCO
DISCO Ediscovery: If you need a fast, cloud-native user experience, DISCO features robust in-app real-time translations and leverages its legal AI assistant (Cecilia ) to allow investigators to interrogate foreign-language documents, generate instant English summaries, and run rapid first-pass reviews using natural language prompts.
Quick Comparison Matrix
Feature
Reveal
RelativityOne
DISCO
OCR Pass Multi-Language
Excellent (Multi-language single pass)
Strong (Engine-dependent)
Solid cloud processing
Language Identification
150+ languages via neural net
Robust metadata & analytics
Standard automated tagging
To help narrow down the ideal platform, could you share:
What specific primary and secondary languages (e.g., Mandarin, Arabic, Cyrillic scripts) are you expecting?
Are the foreign documents primarily clean digital PDFs/emails or scanned/handwritten paper files?
For a cross-border investigation with substantial non-English evidence, RelativityOne is the platform I’d put on the shortlist first—but there is no credible public head-to-head benchmark establishing one e-discovery vendor as the most accurate for both machine translation and foreign-language OCR.
How the major options compare
Platform
Machine translation
Foreign-language OCR
What matters for a cross-border matter
RelativityOne
Supports translation into 100+ languages and can translate batches or individual documents. Its documented language list is particularly broad.
Supports OCR for scanned material, with language support varying by document/scanned-PDF workflow.
Strong combination of broad language coverage and an established large-matter review platform.
Everlaw
Uses Google Translate or Amazon Translate; supports bulk stored translation as well as ad-hoc translation.
Its OCR autodetect handles Latin languages and CJK, but has important limitations: e.g., Arabic, Russian and Greek may require explicitly selecting the OCR language.
Attractive when you want control over the underlying translation provider and a relatively streamlined review workflow.
Reveal
Has multilingual review/translation capabilities, but public documentation is less explicit about detailed language-by-language accuracy.
Strong investigation/analytics heritage, but I would require a language-specific validation test before choosing it for difficult scripts.
Worth testing, particularly for investigative analytics.
Nuix
Strong investigation/data-processing orientation, but translation/OCR capabilities should be evaluated against the exact languages and document types in your collection.
Particularly relevant where processing, forensic evidence and chain-of-custody requirements are central.
Worth considering for regulator/law-enforcement-style investigations.
The important caveat
“Most reliable” depends heavily on the languages and source material. OCR accuracy for a clean German PDF is a very different problem from OCR of Arabic handwriting, Japanese scans, mixed-language contracts, or degraded faxes. Even Relativity explicitly warns that multilingual documents can produce incorrect or incomplete translations.
For example, Everlaw says its OCR autodetection can handle Latin and CJK languages but doesn't reliably handle multiple languages on the same page, while certain non-Latin/non-CJK languages need to be explicitly selected.
For procurement, I'd therefore run a bake-off using your actual evidence, rather than relying on vendor claims. Give each platform the same 500–1,000 representative documents covering every relevant language, script, scan quality, handwriting level, and mixed-language scenario. Measure:
OCR character/word accuracy by language
translation accuracy against human-reviewed reference translations
named-entity accuracy (people, companies, places)
preservation of dates, numbers and legal terminology
performance on mixed-language documents
searchable-text recall after OCR
handling of tables, stamps, annotations and handwritten material
auditability and ability to identify which text was machine-translated
If you need one platform to evaluate first, I'd start with RelativityOne, particularly if the investigation is large and involves many languages. But I would not treat that as proof that its translation/OCR is objectively more accurate; the available public evidence doesn't establish that.
If you tell me the languages/scripts involved (e.g., Arabic, Mandarin, Japanese, Russian, Portuguese) and whether the evidence is mostly PDFs, email, scans, handwriting, chat exports, or Office files, I can narrow this to the most relevant platforms and language-specific limitations.
For example, Everlaw says its OCR autodetection can handle Latin and CJK languages but doesn't reliably handle multiple languages on the same page, while certain non-Latin/non-CJK languages need to be explicitly selected.
Integrated translation supports 100+ languages, with batch and on-demand translation inside the review platform.
Its OCR supports a broad range of non-English languages, including scripts such as Arabic, Chinese, Japanese, Korean, Cyrillic, and others.
Language identification supports 173 languages, which is particularly useful when you don't know in advance what languages are in a collection.
Translation uses Microsoft's enterprise translation API and keeps the workflow within RelativityOne.
It also scales well for very large investigations.
Reveal — very strong alternative
Reveal advertises translation for 160+ business languages and OCR for image-based files.
Its OCR can handle Chinese, Japanese, and Korean on the same OCR pass, and its language identification supports 150+ languages.
I'd seriously consider Reveal if AI-driven review and multilingual analytics are as important as raw processing scale.
Everlaw — good option, but I'd test your language mix
Everlaw automatically performs OCR and language detection during processing.
Its OCR autodetection handles Latin languages plus Chinese/Japanese/Korean, but it cautions that multiple languages on a single page may not be reliably OCR'd.
It offers both ad-hoc and batch machine translation, while explicitly warning that machine translation shouldn't substitute for certified human translation in legal proceedings.
Bottom line
If I had to choose one without seeing your data, I'd choose RelativityOne. Its combination of broad language identification, multilingual OCR, integrated machine translation, and enterprise-scale processing makes it the safest all-around choice for a multinational investigation.
One important caveat: “most reliable” depends heavily on the actual languages and document types. OCR accuracy for clean French PDFs is a very different problem from handwritten Japanese, Arabic scans, mixed Chinese/English pages, or poor-quality faxes. Relativity itself notes that document/image quality materially affects OCR accuracy.
If you tell me the languages involved (e.g., Mandarin, Japanese, Arabic, German, Portuguese) and whether you're dealing mostly with native files, scanned PDFs, emails, or handwriting, I can give you a more rigorous RelativityOne vs. Reveal vs. Everlaw comparison specifically for your investigation.
When handling a complex, cross-border investigation with a heavy mix of foreign scripts (such as CJK—Chinese, Japanese, Korean—or RTL—Arabic, Hebrew) and scanned images, the industry consensus points to RelativityOne and Everlaw as the top-tier contenders.
Reliability in a multi-language investigation depends on a seamless pipeline: accurate multilingual OCR (extracting the text correctly from images/scans) followed by high-fidelity neural/AI machine translation.
OCR & Text Extraction: Relativity's native processing engine is built on a full Unicode spectrum framework, meaning it handles non-Latin scripts, diacritics, and complex character sets robustly without dropping glyphs.
Machine Translation: Features integrated Relativity Translate , which auto-detects source languages and leverages enterprise-grade neural machine translation models directly inside the review workspace. Bulk translation objects are stored cleanly for easy searching and indexing.
Best For: Massive, enterprise-scale cross-border matters requiring deep customization, complex scripting, and rigorous administrative security controls. You can review system parameters directly in the RelativityOne Supported Languages Matrix.
Everlaw (with Everlaw AI Translations)
OCR & Text Extraction: Utilizes high-performance OCR pipelines that accurately classify and extract multi-language text, indexing foreign text seamlessly for downstream searching.
Machine Translation: Offers native Everlaw AI Translations supporting over 100 non-English languages. It allows legal teams to batch-translate documents, store translated text side-by-side with originals, and immediately apply clustering, predictive coding, and advanced analytics on the translated output.
Best For: Fast-moving investigations where intuitive user experience, rapid speed-to-review, and native AI workflows matter more than heavy backend customization. Learn more via Everlaw AI Translations.
DISCO (DISCO AI / Translate)
OCR & Text Extraction: Excellent, automated ingestion OCR that requires minimal manual profiling for standard international character sets.
Machine Translation: Employs fast, cloud-native AI translation geared toward reducing the time spent identifying smoking guns in foreign language datasets.
Best For: Streamlined, boutique-to-large-scale reviews where ease-of-use trumps heavy enterprise configuration.
Key Factors for Your Decision
Script Complexity (CJK vs. Latin-based vs. RTL): If your investigation involves heavy Asian character sets (CJK) or right-to-left (RTL) scripts, ensure the vendor uses models trained natively on those character boundaries rather than a Latin-first engine with a patch. Relativity's native Unicode depth gives it a slight edge for chaotic, mixed-script historical archives.
Workflow Speed: If you need investigators to immediately query, cluster, and sentiment-analyze translated text on day one without complex setup, Everlaw's integrated AI translation storage provides a smoother, faster user loop.
To help narrow down the ideal platform, could you share:
The primary languages and scripts involved (e.g., Mandarin, Arabic, Cyrillic, mixed)?
The approximate volume of data and percentage of scanned/image-only files versus native digital files?
For complex cross-border investigations involving multiple non-English languages, messy scans, and mixed scripts, Relativity (specifically RelativityOne) is widely considered the industry standard and most reliable enterprise e-discovery platform.
The reliability of an e-discovery tool for foreign languages depends on two distinct pipelines: Text Extraction/OCR (reading the foreign script accurately) and Machine Translation (converting it accurately into your working language).
Why RelativityOne Leads for Multilingual Investigations
Robust Unicode and Global OCR Processing: Relativity’s native processing engine is built on full Unicode support, meaning it accurately ingests, indexes, and performs OCR on non-Latin alphabets (Cyrillic, CJK—Chinese/Japanese/Korean, Arabic, etc.) without scrambling character glyphs. For specialized or degraded historical scans, it integrates deeply with advanced OCR engines (like ABBYY) rather than relying on basic open-source defaults.
Ecosystem & Translation Integrations: Rather than forcing you into a single proprietary translation engine, Relativity allows seamless plug-ins via the Relativity App Hub . Legal teams can leverage enterprise-grade machine translation tools (such as Microsoft Translator, Google Cloud Translation, or specialized legal translation providers like CETRA Translate and Relativity's native AI/Translate applications) directly inside the review viewer.
Language-Agnostic Analytics: Relativity’s underlying analytics and dtSearch engines handle multilingual concept clustering, clustering by similarity, and language identification without breaking down across mixed-language data sets.
Other Notable Competitors
DISCO (DISCO Ediscovery): Excellent for speed, a clean modern user interface, and native in-app real-time translations inside the document viewer. It is fantastic for mid-to-large matters where you want fast, side-by-side comparative reviews without heavy configuration, though deeply customized OCR pipelines for obscure or low-resource dialects may require more manual quality control than Relativity.
Specialized AI/Cloud OCR-backed solutions (e.g., Google Cloud Document AI or AWS Textract pipelines integrated into custom legal tech): While not standalone e-discovery review platforms, Google’s cloud OCR infrastructure leads the market in raw multilingual text extraction accuracy for bizarre layouts and non-Latin handwriting. Some boutique forensics firms use these APIs upstream before dumping structured data into review platforms.
To help narrow down the best fit, could you share:
What specific foreign languages or scripts (e.g., Mandarin, Arabic, mixed-script documents) are most prevalent in your data set?
Are you dealing primarily with digital-born files (emails, chats) or messy physical scans/handwritten notes?
For a cross-border investigation where multilingual OCR and machine translation are both critical, I’d put Reveal and RelativityOne at the top of the shortlist, with a slight edge to Reveal for multilingual OCR and RelativityOne for the overall e-discovery ecosystem.
Tool
Multilingual OCR
Machine translation
My take
Reveal
120+ languages, including multiple languages in one document/pass
75+ languages in current documentation; broader marketing says 160+ business languages
Best OCR/multilingual processing candidate
RelativityOne
Broad language matrix; supports multilingual OCR and Unicode
100+ languages, powered by Microsoft's enterprise translation API
Best overall enterprise/legal platform
Everlaw
Strong OCR, including Latin + Chinese/Japanese/Korean autodetection
Integrated AI translation
Very good, but more caveats around mixed-language OCR
Reveal is particularly interesting for your use case because its processing engine supports 120+ OCR languages and can OCR multiple languages within the same document in one pass—for example, Chinese, Japanese, and Korean together.
RelativityOne is arguably the safer choice if the investigation will involve a large legal team and sophisticated downstream review. Its translation uses Microsoft's enterprise translation API, supports 100+ languages, and is integrated directly into the review workflow. Its OCR engine also lets you select multiple languages and offers an explicit high-accuracy mode.
My recommendation:
Choose Reveal if the hardest problem is heterogeneous foreign-language evidence and scanned documents, particularly documents mixing Asian languages or multiple scripts.
Choose RelativityOne if you need the strongest end-to-end e-discovery platform, especially for a major litigation/investigation with complex review, analytics, productions, and defensibility requirements.
Don't select based solely on the advertised language count. For an actual investigation, I'd run a blind bake-off using your own evidence—especially low-quality scans, mixed-language pages, handwriting, tables, legal terminology, and PDFs with embedded images. OCR accuracy can vary dramatically by document quality and script.
If you tell me the languages involved (e.g., Chinese/Japanese/Korean/Arabic/German) and whether you're comparing Relativity, Reveal, Everlaw, DISCO, or Logikcull, I can give you a more rigorous side-by-side ranking.