Code & developer
Security & vulnerabilities benchmark
Vulnerabilities, advisories and security data. Every security & vulnerabilities provider in Alexandria, compared on quality, speed and cost from real agent calls, so your agent can pick the right one.
- Providers
- 5
- 4 with enough calls to rank
- Calls
- 209
- Last 24 hours
- Top quality
- 100%
- CVE Program (CVE.org) CVE Services
- Fastest
- 177 ms
- CVE Program (CVE.org) CVE Services
Leaderboard
Ranked by quality on security & vulnerabilities tools only, not each provider as a whole.
| # | Provider | Quality | Speed | Cost | Calls |
|---|---|---|---|---|---|
| 1 | 100% | 177 ms | 5 credits | 21 | |
| 2 | 98.4% | 26.4 s | 5 credits | 64 | |
| 3 | 97.8% | 625 ms | 5 credits | 45 | |
| 4 | 93.7% | 45.5 s | 5 credits | 79 |
Fewer than 20 calls to rank yet: Red Hat Security Data API.
Tools in this benchmark
The endpoints agents call for security & vulnerabilities, busiest first.
| Tool | Provider | Quality | Speed | Calls |
|---|---|---|---|---|
| Cve | NIST National Vulnerability Database (NVD) | 93% | 45.5 s | 43 |
| Query | OSV.dev open source vulnerabilities | 97.3% | 45.5 s | 37 |
| Search | NIST National Vulnerability Database (NVD) | 94.4% | 45.5 s | 36 |
| Vuln | OSV.dev open source vulnerabilities | 100% | 264 ms | 27 |
| Kev recent | CISA Known Exploited Vulnerabilities (KEV) catalog | 95.8% | 792 ms | 24 |
| Kev lookup | CISA Known Exploited Vulnerabilities (KEV) catalog | 100% | 435 ms | 21 |
| Cve record | CVE Program (CVE.org) CVE Services | 100% | 177 ms | 21 |
How we measure
- Quality
- Calls answered without a tool error, on this use case's tools.
- Speed
- P95 latency: 95% of successful calls finish faster.
- Cost
- Firecrawl credits per call, from the catalogue.
Measured over last 24 hours of calls through Alexandria by every user. A provider needs at least 20 calls on these tools to rank; the rest are listed under the table.
More Code & developer benchmarks
- Code & packages5 providers · 7.2K calls
- Apps3 providers · 1.8K calls
- Developer docs14 providers · 1.3K calls
- Cloud & AI models7 providers · 1.3K calls
See every use case on the benchmarks and rankings pages.
//
Get started
//
Start building with Alexandria.
Give your AI agent direct access to the sources it needs.
Are you an AI agent? See setup options