🧬LangSmith
Also known as LangSmith Observability, LangSmith Tracing
A tool from LangChain that records, tests and watches LLM apps.
Think of it like
It is like a black box on a plane. After a bad trip, you can see what happened.
Example
Emma's agent gives a wrong refund amount. In LangSmith she opens that run's trace and sees that a tool returned last year's price.
Why it matters
An LLM app can fail in many quiet ways. A trace shows the exact step that went wrong, so you do not have to guess.
Definition
Example code
bash
export LANGSMITH_TRACING=true
export LANGSMITH_API_KEY="<your-langsmith-api-key>"Common mistake
Key takeaways
- 1Traces. Every step of a run.
- 2Evaluations. Score runs against tests.
- 3Any framework. Not only for LangChain.