CAFE — Compound-AI Factorial Evaluation
Stop guessing which AI config is better. Prove it.
What this is
An open-source, self-hostable framework for running controlled experiments across your AI pipeline to statistically prove which changes actually improve output quality — for ML engineers, unrelated to restaurants.
Our one-line summary — not the founder’s tagline.
- How it works
- Treats every knob in an AI pipeline — retrieval, reranking, prompts, models, tools — as an experimental factor, runs factorial experiments, evaluates outputs with a configurable LLM or human reviewers, and applies mixed-effects models to measure which techniques help, by how much, and whether it's statistically significant.
- What's different
- Open source and self-hostable, replacing guesswork with statistically grounded experiment results.
- Best for
- ML engineers trying to prove which changes to an AI pipeline actually improve quality.
What we measured
Nobody else publishes this — it comes from knocking on the door every day.
- Watched by us
- 12 days
- Last checked
- 6d ago
Where it shows up
Every group here is a page of its own — each one checked daily.
The numbersIs it still shipping, is it overpriced, where did it land — and what the price is built from.
League price & chart
No money. No seat. It goes on your record — and in 28 days reality settles it.
Calls are closed while we rebuild accounts. You can still read every one of them.
AI. Launched 12d ago on Product Hunt, picking up 8 votes. Today, it's been quiet for 12 days and the price has started to bleed.
Already bleeding a little every day, and it accelerates the longer it stays quiet.
We check this site every day, ourselves. A founder can post “still working on it” — a claim like that doesn't price. What we price is what we can verify from the outside: evidence, not announcements. The real question isn't “will this be huge?” — it's “will they still be moving in four weeks?”
The market viewHow this launch is priced and ranked in our league — the investor side of the page.
ranked by the reality anchor, not the market price
It launched on Product Hunt with 8 votes.
No matter how much money goes in. There is no pump here — you can't make yourself right by buying more. The line only moves on things that actually happened: an award, revenue that grew, a new platform, code that shipped — or silence.
En eski 1 hareket bu listede yok — toplam 13 olay var. A launch that goes quiet eases down a little at a time — never a cliff you could have run from the night before.
Daily tracking just started for this launch — the first point is on the board. A second reading lands with tomorrow's run, and the curve builds from there.
How the launch is moving on its own board, day by day — the crowd's attention.
A flat line is normal: votes stop within a day or two of launch, on every board. What's unusual — and what actually counts — is a launch that keeps pulling votes long after its day is over.
About
CAFE treats every knob in your AI pipeline - retrieval, reranking, prompts, models, and tools - as an experimental factor. It runs factorial experiments, evaluates outputs using a configurable LLM (and optionally human reviewers), and applies mixed-effects models to determine: - Which techniques actually improve quality - How much each technique contributes - Whether the observed differences are statistically significant Open source and self-hostable.
Where it launched
1 platform| Platform | Votes | Counts toward price | Link |
|---|---|---|---|
| Product Hunt | 8 | sets the price | ↗ |
The board it did best on sets the price. Every other board only adds to it if the launch also placed high on that board too — because just showing up somewhere isn't an achievement. Listing on twelve directories is free; placing well on them isn't.
Discussion (0)
No thesis posted yet. Be the first.