Research & reference
Datasets & reference benchmark
Datasets, dictionaries, encyclopedias and reference works. Every datasets & reference provider in Alexandria, compared on quality, speed and cost from real agent calls, so your agent can pick the right one.
- Providers
- 15
- 8 with enough calls to rank
- Calls
- 609
- Last 24 hours
- Top quality
- 100%
- Wikipedia
- Fastest
- 435 ms
- Sefaria: Hebrew Bible, Jewish commentaries and links (sefaria.org)
Leaderboard
Ranked by quality on datasets & reference tools only, not each provider as a whole.
| # | Provider | Quality | Speed | Cost | Calls |
|---|---|---|---|---|---|
| 1 | 100% | 521 ms | 0–1 credits | 82 | |
| 2 | 100% | 435 ms | 5 credits | 40 | |
| 3 | 98.9% | 717 ms | 5 credits | 181 | |
| 4 | 97.6% | 649 ms | 5 credits | 41 | |
| 5 | 95.8% | 1.9 s | 5 credits | 24 | |
| 6 | 94.7% | 3.2 s | 5 credits | 57 | |
| 7 | 92.9% | 38.7 s | 5 credits | 154 | |
| 8 | 80% | 3.2 s | 5 credits | 30 |
Fewer than 20 calls to rank yet: bible-api.com: Open English Bible, Cherokee and Romanian Bible verses, random verses, CCEL: classic Bible commentaries, sermons and Christian classics (ccel.org), Influencers.club, MorphoSource, M&S Heritage digital archive (Preservica Universal Access), STEP Bible: Hebrew and Greek tagged Bible, Strong's lexicons and morphology (STEPBible-Data), StudyLight.org Bible commentaries: Barnes, Pulpit, Ellicott, Benson, Poole, Wesley and more (studylight.org).
Tools in this benchmark
The endpoints agents call for datasets & reference, busiest first.
| Tool | Provider | Quality | Speed | Calls |
|---|---|---|---|---|
| Search | NCBI GEO | 98.9% | 717 ms | 181 |
| Get passage | Free Use Bible API: Bible verses, translations and commentaries (bible.helloao.org) | 99.2% | 45.5 s | 131 |
| Weo | IMF Data | 94.7% | 3.2 s | 57 |
| Wikidata item | Wikipedia | 100% | 649 ms | 50 |
| Get verse commentaries | Bible Hub: verse commentaries, parallel translations and Strong's lexicon (biblehub.com) | 97.6% | 649 ms | 41 |
| Get text | Sefaria: Hebrew Bible, Jewish commentaries and links (sefaria.org) | 100% | 435 ms | 40 |
| Wikidata labels | Wikipedia | 100% | 322 ms | 32 |
| Rankings | World Happiness Report | 80% | 3.2 s | 30 |
| Records list | OECD Data Explorer SDMX API | 95.8% | 1.9 s | 24 |
| List translations | Free Use Bible API: Bible verses, translations and commentaries (bible.helloao.org) | 56.5% | 216 ms | 23 |
How we measure
- Quality
- Calls answered without a tool error, on this use case's tools.
- Speed
- P95 latency: 95% of successful calls finish faster.
- Cost
- Firecrawl credits per call, from the catalogue.
Measured over last 24 hours of calls through Alexandria by every user. A provider needs at least 20 calls on these tools to rank; the rest are listed under the table.
More Research & reference benchmarks
See every use case on the benchmarks and rankings pages.