Open source · Data & AI

DSI LLM Proxy Apache-2.0

A routing proxy in front of multiple model providers with per-tenant spend caps and a hard PII redaction stage.

Browse the catalogue

Public repository

https://github.com/dev-sec-it/llm-proxy

View repository

Releases, issues and the commit history are on the repository, so the license and the maintenance status can be checked against the last tagged release rather than taken on trust.

Catalogue record

The facts a buyer screens on first

Every value below is copied from the catalogue entry and is verifiable against the public repository.

License
Apache-2.0

OSI identifier, as published in the repository.

Stack
Go

Primary language and runtime.

Status
Beta

As recorded in the DEV SEC IT catalogue.

Stars
1.3k

Counted from the public repository at the time of writing.

What we maintain

Our contribution to DSI LLM Proxy

This project is on the catalogue because we own part of it. The parts we wrote, review and release are named here; everything else is upstream work we depend on.

Maintenance

Maintained by DEV SEC IT

What we wrote

Spend caps, redaction stage and the fallback router

First tagged release

First tagged release in 2024.

Used in

Where it runs

An internal dependency, not a side project.

DSI LLM Proxy is consumed inside DEV SEC IT's own platforms, which is why its release cadence and license are kept current rather than left to a final commit.

  • Consumed in production

    dOne (Managed SaaS).

Talk to us

Need this running inside your own perimeter?

We maintain this project and the platforms built on it. If you want a deployment, a review or a fix against your environment, the same engineers who ship it can scope it.

All open source