Leaderboard

All MPP services, ranked by quality. Tested via real payments on Tempo. Updated weekly. New services tested on discovery.

How scores work

All scores are out of 100. Only services with at least 1 successful paid test are rated.

Overall — weighted composite
Accuracy (40%) — output quality
Reliability (30%) — % requests succeeded
Latency (20%) — speed (100=<1s, 0=>30s)
Cost Eff. (10%) — quality per dollar spent via MPP
AllTravelDataInfrastructureAISearchMediaCommunicationBlockchain

Rated (12)

1
Google GeminiAI

High accuracy (100%) — responses consistently matched expected behavior. Very reliable — 10/10 requests got a response. Median response time: 2167ms (p95: 8183ms).

Acc
100
Rel
100
Lat
96
Cost
100
99.2
2
AnthropicAI

High accuracy (93%) — responses consistently matched expected behavior. Very reliable — 10/10 requests got a response. Median response time: 672ms (p95: 1494ms).

Acc
93
Rel
100
Lat
100
Cost
100
97.2
3
OpenRouterAI

High accuracy (93%) — responses consistently matched expected behavior. Very reliable — 10/10 requests got a response. Median response time: 655ms (p95: 1372ms).

Acc
93
Rel
100
Lat
100
Cost
100
97.2
4
StableEmailCommunication

High accuracy (93%) — responses consistently matched expected behavior. Very reliable — 10/10 requests got a response. Median response time: 1382ms (p95: 2122ms).

Acc
93
Rel
100
Lat
99
Cost
100
96.9
5
OpenAIAI

High accuracy (93%) — responses consistently matched expected behavior. Very reliable — 10/10 requests got a response. Median response time: 875ms (p95: 2251ms).

Acc
93
Rel
100
Lat
92
Cost
100
95.6
6
StableSocialData

High accuracy (93%) — responses consistently matched expected behavior. Very reliable — 10/10 requests got a response. Median response time: 1271ms (p95: 1930ms).

Acc
93
Rel
100
Lat
88
Cost
100
94.8
7
ParallelSearch

High accuracy (91%) — responses consistently matched expected behavior. Very reliable — 10/10 requests got a response. Median response time: 5770ms (p95: 7171ms).

Acc
91
Rel
100
Lat
84
Cost
100
93.1
8
fal.aiMedia

High accuracy (99%) — responses consistently matched expected behavior. Very reliable — 10/10 requests got a response. Median response time: 13505ms (p95: 14510ms).

Acc
99
Rel
100
Lat
57
Cost
100
91.0
9
ExaSearch

High accuracy (93%) — responses consistently matched expected behavior. Very reliable — 10/10 requests got a response. Median response time: 13385ms (p95: 13896ms).

Acc
93
Rel
100
Lat
57
Cost
100
88.7
10
FirecrawlSearch

Moderate accuracy (70%) — some responses were incomplete or partially correct. Very reliable — 10/10 requests got a response. Median response time: 12765ms (p95: 13476ms).

Acc
70
Rel
100
Lat
59
Cost
100
79.9
11
StableTravelTravel

Low accuracy (30%). Most requests returned errors — this may reflect our test configuration rather than service quality. We're working to improve coverage. Very reliable — 10/10 requests got a response. Median response time: 656ms (p95: 1360ms).

Acc
30
Rel
100
Lat
94
Cost
100
70.9
12
StablePhoneCommunication

Low accuracy (3%). Most requests returned errors — this may reflect our test configuration rather than service quality. We're working to improve coverage. Very reliable — 10/10 requests got a response. Median response time: 703ms (p95: 1229ms).

Acc
3
Rel
100
Lat
100
Cost
100
61.2

Endpoint not available (13)

Registered in the MPP directory but not responding to requests. We check every 6 hours.

2CaptchaInfrastructure
Not available at last check
AgentMailCommunication
Not available at last check
AlchemyBlockchain
Not available at last check
AlliumBlockchain
Not available at last check
BrowserbaseSearch
Not available at last check
CodexBlockchain
Not available at last check
DuneBlockchain
Not available at last check
ElevenLabsMedia
Not available at last check
FlightAPIInfrastructure
Not available at last check
Google MapsInfrastructure
Not available at last check
ModalInfrastructure
Not available at last check
StableEnrichData
Not available at last check
StableStudioMedia
Not available at last check

12 of 25 services rated. Tests run via real MPP payments on Tempo.