Langfuse is an open-source LLM engineering platform to help teams build production-grade LLM applications.
Its core offering is traces for debugging, letting users explore complex logs in a visual user interface. Especially useful for RAG or agent systems.
Quality scores can be attached to each trace through model-based evaluations, user feedback or manual labelling. This allows quality to be monitored over time. Other metrics that can be monitored include cost, latency and volume.
Prompt management can also be integrated in Langfuse to monitor different versions and roll back changes.