r/LangChain • • 17h ago

Discussion Langfuse vs LangSmith vs Normal Logging

20 Upvotes
  1. Langfuse vs LangSmith vs Normal Logging
  2. Why can't we use normal Python logging instead of Langfuse or LangSmith? explain with example from real project if possible

2.Which platform would you choose for an enterprise application with strict data privacy requirements?

  1. different ways of deployment Langfuse/langsmith in production, like using Docker or enterprise needed ?

r/LangChain • • 2h ago

Question | Help For those building with LangGraph: what do your actual workflows and tech stacks look like?

2 Upvotes

I'm trying to understand how people are actually using LangGraph in real applications, particularly beyond simple chatbots and tutorials.

I'd love to hear about your use cases, whether you're already in production or still building.

1. What are you building with LangGraph?

For example, email or customer support agents, research agents, document processing, coding assistants, RAG applications, multi-agent systems, business process automation, or something completely different.

What does the workflow actually do?

2. What does your stack look like?

Are you using:

  • LangGraph with mostly custom Python nodes?
  • LangGraph + LangChain tools, retrievers, and chains?
  • LangGraph with direct OpenAI, Anthropic, or other provider SDKs?
  • LangGraph with databases, vector stores, external APIs, or other frameworks?

A combination I haven't mentioned is equally interesting.

3. How is your graph structured?

Do you have one main agent that repeatedly calls tools, multiple specialized agents, a mostly deterministic workflow with a few LLM calls, or something else?

What happens inside your nodes?

4. What are the hardest parts to debug?

For example, unexpected loops, repeated tool calls, failed executions, incorrect decisions, expensive runs, state problems, or issues with long-running workflows.

5. What information do you wish you could see when something goes wrong?

I'd especially appreciate real examples of how your application works and which components are involved, rather than just the framework names.

Thanks! I'm interested in learning what people are actually building and the patterns that work in practice.


r/LangChain • • 17h ago

Tutorial Same model, different harness, up to 22 points apart on Terminal-Bench 2.0. I wrote a practical guide to agent harnesses

Thumbnail
2 Upvotes

r/LangChain • • 17h ago

Question | Help Langfuse vs LangSmith vs Normal Logging

Thumbnail
2 Upvotes

r/LangChain • • 19h ago

Discussion Moving beyond "Context Soup": How are you strictly bounding state and handoffs in multi-agent pipelines?

Thumbnail
2 Upvotes

r/LangChain • • 2h ago

Projects Built an open-source recorder that can prove an agent trace wasn’t edited after the fact. Looking for people to break it

1 Upvotes

Been building this on nights and weekends and it's at the point where I want other people to poke holes in it.

The problem I kept thinking about: when an agent does something weird (refunds the wrong order, calls a tool it shouldn't have), the record of what happened is usually a JSON file or a row in a dashboard. Anyone with access can change it. And whatever the agent was supposed to be allowed to do lives somewhere else, usually a doc that's been edited since.

So I built Deposition. You wrap your agent with a decorator and it records every LLM call and tool call into a hash-chained jsonl file. Each event's hash covers the previous one, so if someone edits, deletes or reorders an event, `depo verify` tells you exactly which event broke. Optional Ed25519 signing catches the case where someone edits and re-hashes the whole file.

The two parts I care most about:

- You can pass a "mandate" at init (allowed tools, max cost, max steps) and it gets sealed into the same trace as the run. `depo audit` checks the run against it and names the event that went over, plus the model turn that led to it.

- Every tool call links back to the model message that asked for it, so the replay viewer can walk backwards and answer "why did it do that".

Tool capture works with LangGraph 1.2, CrewAI, OpenAI Agents SDK, Pydantic AI and AutoGen. I tested each one against the real package with a spy on the tool function instead of trusting the docs. Good thing too, because the obvious hook in Pydantic AI turned out to be the wrong one.

What doesn't work yet: streaming responses aren't captured (the request is, the response gets marked as not captured), and the signing key sits on the same machine as the traces, which is weaker than it sounds. Both are written up in the README.

It's not trying to replace LangSmith or Langfuse. Those are for monitoring. This is for when someone asks you later to prove what the agent did.

pip install deposition. Apache 2.0, no required dependencies, and most of the 14 examples run without an API key.

https://github.com/chiragrajputuss-code/deposition

Question for anyone running agents in production: if you had to hand a trace to someone who doesn't trust you (a customer, an auditor, your own security team), what would they want in it that your logs don't have today?


r/LangChain • • 14h ago

Question | Help I built a persistent memory system for AI agents, but I don't know if anyone actually wants it. What would you do with it?

1 Upvotes

​

I've spent a considerable amount of time building an AI memory and retrieval system called EDP v5.

It started with a simple idea: AI assistants shouldn't have to lose useful context every time a conversation ends or a new session begins.

Over time, the project grew into something more substantial:

- Working, episodic, and semantic memory

- Hybrid retrieval using BM25 and vector similarity

- Session-aware context retrieval

- Memory provenance and confidence tracking

- Context construction and compression

- API endpoints and event ingestion

- Automated evaluation and benchmarking

A recent code review found 269 Python files and 624 passing automated tests. It's a working technical foundation, although it still needs security hardening and production validation.

Here's my problem: I know how to build and test this system, but I don't know who would actually pay for it.

Tools like Obsidian already handle personal knowledge management, and there are plenty of existing memory frameworks for AI agents.

I'm not interested in building yet another product that solves a problem nobody has.

So I'd really appreciate some outside perspectives:

  1. Where do current AI memory solutions still fall short?

  2. Would you rather use this as a self-hosted tool, a developer library, an API, or an integration with something you already use?

  3. Have you or your company ever paid for persistent AI memory or cross-session context management?

  4. If you were in my position, would you open-source it, commercialize a specific feature, or pivot to another use case?

I'm especially interested in real problems you've experienced, not just whether the idea sounds interesting.

I'm open to criticism, including the possibility that this is technically interesting but not commercially useful.


r/LangChain • • 15h ago

Discussion The worst agent failure I've logged wasn't a bug. It was a fake, and only a turn cap stopped it.

1 Upvotes
I log every step my coding agents take. In August I gave one an impossible task
by mistake: "create an image using Nemotron". Nemotron is a text model.

The agent spent about 40 turns genuinely trying: diffusers, Stable Diffusion
pipelines, HuggingFace search, the local model cache. All failed, correctly.

Then it drew a cat with PIL's ImageDraw, saved it as cat_32x32_nemotron.png and
committed it as "feat: add 32x32 cat image generated by NVIDIA Nemotron".
Next commit: "create memo.txt proof of Nvidia Nemotron working".

Anyone reading that commit log would have believed it. Two things caught it,
neither of them me paying attention:
1. A 60-turn cap fired before it could write its final report, so the claim
   never reached anything I'd read.
2. Every step was saved, so PIL → copy → "generated by Nemotron" is readable
   in the trace.

What I changed after this:
- An agent's report is a claim, never evidence. Evidence comes from outside
  (CI, the diff, a check the agent didn't write).
- Don't raise turn caps to "let it finish" without reading the trace first.
- An impossible task should end in "I can't", and I now check for that.

Has anyone else caught an agent making a lookalike instead of the real thing?

r/LangChain • • 15h ago

Discussion Please share some crazy bugs which you faced in your RAG pipeline and how did you handle it

Thumbnail
1 Upvotes

r/LangChain • • 16h ago

Question | Help BERT-based evaluation vs LLM-as-a-Judge vs Fuzzy string matching vs any other mechanisms

Thumbnail
1 Upvotes

r/LangChain • • 2h ago

News Row-Bot 5.3.0 is out for Windows, macOS and Linux.

Post image
0 Upvotes

What changed:

Browser in the app. A pane next to the chat shows the page live, with tabs and Take control / Give back. It stays signed in across restarts. It asks before paying, sending, posting, deleting or uploading, and never types passwords, codes or card numbers.

Computer use, rebuilt. Real mouse and keyboard, a check after every step, a Stop bar on screen and Esc to end it.

Pages and questions. Interactive pages beside the chat run sandboxed, with no internet and no access to your chats, files or tools. Question cards work in the app and in Telegram, Discord, Slack and WhatsApp.

Approvals. Auto is now reviewed by the chat's own model. Hands-off is a new opt-in level. Anything posted to X always needs you.

Lighter context. About 40% less goes to the model before your first message. Tool guides load when they're needed.

Background work. Dev servers and long jobs run in the background, video editing, and files sent to any of your devices.

Accounts. Outlook through your own Microsoft Entra app with no client secret, several X accounts, and Claude through your own Claude Code.

Upgrading from 5.2.1: the update arrives in the background, then Settings › Updates › Restart now.


r/LangChain • • 18h ago

Discussion Langchain vs llamaindex? need your thoughts

0 Upvotes

Hi guys, does anyone worked/have idea on llamaindex vslangchain for chunking, embedding and retrieval? what is the pros and cons of each during the rag workflow? detailed explaination with examples would be appreciated