LangSmith vs Langfuse
People think LangSmith and Langfuse are one tool, because the names sound alike and both trace and test LLM apps. LangSmith comes from LangChain, the team behind the LangChain framework. Langfuse is a separate project with open code, free to run on your own servers. Both record each step of a run, keep prompts and score answers.
LangSmith
A tool from LangChain that records, tests and watches LLM apps.
LangSmith is a platform from LangChain for tracing, testing and watching LLM apps. Each run of your app becomes a trace, with every model call and tool step inside. You turn it on with two settings: LANGSMITH_TRACING set to true, and your key. It works with many frameworks, not only LangChain. It also has tests, dashboards and alerts, in the cloud or on your own servers.
Langfuse
A free tool that records each step of an LLM app. You can run it yourself.
Langfuse is an open-source platform for tracing and improving LLM apps. You can use its cloud or run it on your own servers. Each trace holds the model calls and the steps around them, like searches and API calls. It also stores prompt versions, runs evaluations and shows cost and speed on a dashboard. It is built on OpenTelemetry, a shared standard for tracing.
In one line
- LangSmith
- A tool from LangChain that records, tests and watches LLM apps.
- Langfuse
- A free tool that records each step of an LLM app. You can run it yourself.