Maintenance
Maintained by DEV SEC IT
Open source · Data & AI
DSI RAG Eval Apache-2.0
Measures retrieval recall and answer faithfulness against a labelled set, and fails the pipeline when either regresses.
https://github.com/dev-sec-it/rag-eval
Releases, issues and the commit history are on the repository, so the license and the maintenance status can be checked against the last tagged release rather than taken on trust.
Catalogue record
The facts a buyer screens on first
Every value below is copied from the catalogue entry and is verifiable against the public repository.
- Apache-2.0
- Python
- Beta
- 480
OSI identifier, as published in the repository.
Primary language and runtime.
As recorded in the DEV SEC IT catalogue.
Counted from the public repository at the time of writing.
What we maintain
Our contribution to DSI RAG Eval
This project is on the catalogue because we own part of it. The parts we wrote, review and release are named here; everything else is upstream work we depend on.
What we wrote
Faithfulness scorer and the regression gate
First tagged release
First tagged release in 2025.
Where it runs
An internal dependency, not a side project.
DSI RAG Eval is consumed inside DEV SEC IT's own platforms, which is why its release cadence and license are kept current rather than left to a final commit.
Consumed in production
dOne (Managed SaaS).
Talk to us
Need this running inside your own perimeter?
We maintain this project and the platforms built on it. If you want a deployment, a review or a fix against your environment, the same engineers who ship it can scope it.