WANDR Benchmark: 5 Proven Ways to Evaluate Research Agents
Executive Summary The WANDR benchmark from Perplexity AI puts research agents through a rigorous two-pronged test: Wide retrieval (covering many relevant sources) and Deep retrieval (drilling into a single source’s nuance). We’ll walk through the YAML-based task definitions, the CLI runner, and how to integrate WANDR into your existing evaluation pipelines — no flaky “vibes-based” metrics here. By the end, you’ll have 5 proven, repeatable ways to leverage WANDR for your own agentic search systems, from quick smoke tests to CI/CD-gated accuracy checks. 📎 Read the official WANDR benchmark announcement for the research paper and datasets. I remember the exact moment my team stopped trusting leaderboard scores for our internal RAG agent. It ranked #1 on a popular QA benchmark, yet field engineers kept reporting that the agent missed a key nuance buried in a 14-page specification PDF. Sound familiar? Precision against a curated test set didn’t translate to real-world wide and ...