# Scores

Every tool gets a 0–100 score per task type and region, recomputed every Monday 00:00 UTC. Formula v1:

100 × (0.40A + 0.25S + 0.20P + 0.10R + 0.05L) − min(20, 500D), clamped to 0–100

- **A**: Accuracy: share of benchmark cases where a correct result was delivered
- **S**: Pass rate: benchmark + live calls in the last 28 days, weighted by volume
- **P**: Audit precision: share of audited passes confirmed correct; uses A until 50 audits exist
- **R**: Reliability: 1 − provider error/timeout rate (last 28 days)
- **L**: Speed: task-median latency ÷ this tool's latency, capped at 1
- **D**: Upheld disputes ÷ passed results

- Rates from fewer than 200 data points use the 95% Wilson lower bound
- A score moves at most ±10 points a week unless the tool is paused
- Default ranking is score, with price breaking ties within 2 points
- Whether a tool can be bought through Arettic never affects its rank
- Scores are recomputed every Monday 00:00 UTC

## Live providers
_The first scores are published when benchmarks run on real providers._

## Test mode (mock providers)
These are the sandbox tools test keys use. Their scores prove the pipeline; they are not real providers.

| Task type | Tool | Provider | Region | Score | A | S | P | R | L | D | Sample | Week |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| enrich_company | mock-enrich-company | Arettic Mock Provider | GLOBAL | 56.53 | 0.4902 | 0.5958 | 0.4902 | 0.7225 | 1 | 0 | 10 | 2026-09-28 |
| enrich_person | mock-enrich-person | Arettic Mock Provider | GLOBAL | 56.53 | 0.4902 | 0.5958 | 0.4902 | 0.7225 | 1 | 0 | 10 | 2026-09-28 |
| extract_url | mock-extract-url | Arettic Mock Provider | GLOBAL | 56.53 | 0.4902 | 0.5958 | 0.4902 | 0.7225 | 1 | 0 | 10 | 2026-09-28 |
| find_email | mock-find-email | Arettic Mock Provider | GLOBAL | 56.53 | 0.4902 | 0.5958 | 0.4902 | 0.7225 | 1 | 0 | 10 | 2026-09-28 |
| verify_email | mock-verify-email | Arettic Mock Provider | GLOBAL | 62.87 | 0.5958 | 0.5958 | 0.5958 | 0.7225 | 1 | 0 | 10 | 2026-09-28 |
| web_search | mock-web-search | Arettic Mock Provider | GLOBAL | 73.63 | 0.7225 | 0.7225 | 0.7225 | 0.7225 | 1 | 0 | 10 | 2026-09-28 |

Open data under CC BY 4.0. JSON: https://api.arettic.com/v1/scores

This page as HTML: https://arettic.com/scores · Markdown: https://arettic.com/scores.md · JSON: https://arettic.com/scores.json