Performance transparency

Benchmarks and Performance

Updated

A benchmark page that documents what should be measured without inventing unverified performance claims. Independent benchmark publication is currently in progress.

Documentation - FAQ - Security - Privacy - Responsible AI

Core trust links

Benchmark publication status

Independent benchmark publication is currently in progress. Until repeatable measurements are available, this page describes the categories, methodology, hardware factors, and dependencies that should be measured.

Benchmark table

The following metrics are intentionally marked "to be measured" until repeatable tests are run across representative Windows devices and network conditions.

MetricCurrent public valueMeasurement method needed
Average response latencyTo be measuredMeasure from question submit to first usable answer across 100+ runs.
Speech recognition accuracyTo be measuredWord error rate across English, Hindi, accents, and noisy rooms.
OCR / screenshot accuracyTo be measuredPrompt extraction accuracy across code, diagrams, tables, and logs.
Screenshot processing speedTo be measuredTime from capture to extracted prompt.
Supported programming languagesDocumented content support, benchmark pendingTest Java, Python, C++, JavaScript, SQL, React, Angular, Node.js, cloud prompts.
Supported interview platformsZoom, Meet, Teams workflows documentedRun workflow tests across versions and permission states.
Windows compatibilityWindows 10/11 positionedTest Windows 10/11 editions, display scaling, audio devices, and restricted machines.
Memory usageTo be measuredMeasure idle, transcription, screenshot, and answer-generation phases.

Response latency

Latency should be measured separately for voice transcription, screenshot processing, AI answer generation, and UI rendering. It should not be described with a single number unless the methodology is published.

Speech recognition

Speech recognition should be measured with English, Hindi, mixed-language, accent, headset, laptop microphone, and noisy-room samples. Accuracy should be reported with sample size and failure categories.

OCR performance

OCR and screenshot performance should be tested with code editors, browser coding platforms, architecture diagrams, SQL tables, logs, and different display scaling settings.

Hardware recommendations

Manual input required: publish minimum and recommended Windows hardware after testing. Until then, users should test the free flow on their own device before depending on the workflow in an interview.

Internet dependency

AI transcription and answer generation depend on network access and provider availability. Slow or unstable internet can increase latency, produce timeouts, or require manual fallback to prepared notes and typed input.

Benchmark rules

Benchmarks should include date, app version, device specs, network conditions, sample size, prompt set, and known failures. Do not publish best-case numbers as average results.

Limitations

Until measurements are published, no speed or accuracy figure should be quoted as a CrackInterviewAI result. Your own device, microphone, and connection decide what you will see, so test on the machine you will interview from.

All product limitations in the Trust Center

Frequently asked questions

Are benchmark numbers published?

Not yet. The categories and methodology are documented, and every metric that has not been measured is labeled "to be measured" instead of showing an estimate.

What slows down an answer the most?

Network speed, provider response time, the length of the question, screenshot clarity, and the device itself. That is why transcription, screenshot processing, answer generation, and display are meant to be measured separately.

How will speech recognition accuracy be measured?

With English, Hindi, mixed-language, accented, headset, laptop-microphone, and noisy-room samples, reported with the sample size and the kinds of errors found.

How will screenshot reading be tested?

On code editors, browser coding platforms, architecture diagrams, SQL tables, logs, and different display scaling settings, measuring both extraction accuracy and the time from capture to extracted prompt.

What hardware should I use until results are published?

A stable Windows 10 or 11 laptop or desktop, reliable internet, and a clear microphone. Test the free flow on that device before a paid session.