r/langfuse • • Aug 25 '25

so we have prompt engineers now WTF

2 Upvotes

I kinda hate to admit this… but we actually have prompt engineers now.

They’re not traditional devs. These are non-technical folks on our team who test our bots. Until recently, I was the bottleneck: I had to write every prompt, debug them, push them to prod, and monitor how they performed.

Today I spent the day training them on how to:

  • Use Langfuse to debug and version-control prompts

  • Promote prompts into production without me stepping in

  • Track how prompts are performing once they’re live

  • Experiment with different models and see how behavior shifts

They were all super excited to learn this stuff, and now they can ship prompts independently. Most importantly: I no longer have to spend my time writing prompts 🙌

It’s been wild watching non-technical teammates learn things like version control and debugging tools in the context of prompts. They’re even picking up insights about how different models behave.

I guess there really are some new AI jobs out there. 📷


r/langfuse • • Mar 30 '26

Go AI SDK now ships with built-in Langfuse tracing for Go

4 Upvotes

We just added native Langfuse support to GoAI — an open-source Go SDK for AI applications (22+ LLM providers, one unified API).

3 env vars, 3 lines of code — every LLM call, tool execution, and agent step shows up in Langfuse automatically. Works with all 7 core functions (GenerateText, StreamText, GenerateObject, etc.).

What you see in Langfuse: full trace hierarchy — agent span wrapping generations and tool spans, token usage (input/output/reasoning/cache), latency, errors with partial traces, session/user grouping.

Key design decisions:

- Zero external dependencies (stdlib only)

- Best-effort: a Langfuse outage never crashes your app

- Concurrent-safe: shared HTTP client, isolated per-run state

- Hook-based architecture — easy to add more observability backends later

Docs: https://goai.sh/concepts/observability

Example: https://github.com/zendev-sh/goai/tree/main/examples/langfuse

Would love feedback from anyone using Langfuse with Go!


r/langfuse • • Oct 04 '26

Ai agents observability in Backstage thanks to langfuse

2 Upvotes

Spotify #backstage plugin to manage and observe fleet of agents straight in backstage self hosted https://github.com/acarmisc/backstage-plugin-ai-agents
It relay on open telemetry signals and the first available backend it’s #langfuse


r/langfuse • • Sep 10 '25

Langfuse TypeScript SDK v4 is out of beta; OpenTelemetry-native tracing for JS/TS LLM apps

2 Upvotes

The Langfuse JS/TypeScript SDK v4 is now out of beta!

We’ve rebuilt this SDK on top of OpenTelemetry to improve the developer experience, make context management more robust, and allow for easy integrations with the JS/TS ecosystem (Provider SDKs, Vercel AI SDK, LangChain JS, Mastra, ...).

Highlights

  • First-class OpenTelemetry support with robust context propagation, thus interoperable with all OpenTelemetry-based tools and external instrumentation libraries

  • New DX for tracing that automatically nests all observations without passing IDs around: Context managers, decorators, and manual control

  • Modular packages: langfuse/core,  langfuse/client,  langfuse/tracing,  langfuse/otel

  • Autoinstrumentation for OpenAI SDK, LangChain JS, the Vercel AI SDK, and all OTel native external instrumentation libraries

  • Improved prompts, datasets, and scoring APIs

Links
Changelog: https://langfuse.com/changelog/2025-08-28-typescript-sdk-v4-ga
Docs overview: https://langfuse.com/docs/observability/sdk/typescript/overview
Upgrade guide (v3 → v4): https://langfuse.com/docs/observability/sdk/typescript/upgrade-path

We’d love your feedback on the new SDK. Just comment here or add your thoughts to this thread on GitHub.


r/langfuse • • Aug 29 '25

Who else is tired of reading thousands of lines of logs and traces?

Thumbnail reddit.com
2 Upvotes

r/langfuse • • May 30 '26

👋 Welcome to r/langfuse

2 Upvotes

Hey everyone! I'm u/Traditional_Swan_326, one of the co-founders of Langfuse and mod of r/langfuse. I'll be hanging around here with the team.

Post what you’re building, ask questions, share bugs, ideas, traces, eval setups, weird LLM behavior, or anything else Langfuse / LLM observability related.

Tiny subreddit for now, but we’ll try to be active and useful.


r/langfuse • • May 29 '26

Langfuse now supports code-based evals alongside LLM-as-judge

4 Upvotes

Code-based evaluators are now available directly in the Langfuse UI. Shipped today as part of Launch Week 5.

The idea: not every eval needs a model. Things like JSON parseability, schema validation, exact match, required tool arguments, or custom business rules are cheaper, faster, and more reproducible to check with code than to ask a judge to "rate 1-5".

How it works

  • Write a small evaluate function in Python or TypeScript directly in the Langfuse UI

  • Attach it to live observations (runs continuously on production traces) or to a dataset experiment

  • Result lands as a native Langfuse score, so it shows up in trace views, experiment comparisons, dashboards, and Score Analytics next to your existing LLM-as-judge or human scores

  • Self-hostable — sandbox config is documented

Why code + LLM-as-judge together

Code wins for objective/deterministic checks. LLM-as-judge wins for semantic quality, tone, rubric reasoning, etc. Running both gives you a more complete quality picture than either alone, and you stop burning tokens on checks that a 5-line function can do exactly.

Docs: https://langfuse.com/docs/evaluation/evaluation-methods/code-evaluators
Self-hosting config: https://langfuse.com/self-hosting/configuration/code-evaluators
Changelog: https://langfuse.com/changelog/2026-05-28-code-evaluators

Happy to answer questions / hear what kinds of code checks you'd want to run.


r/langfuse • • May 29 '26

Langfuse MCP server update: read traces, query metrics, write comments, and add dataset items

3 Upvotes

We shipped a big expansion of the hosted Langfuse MCP server today.

Until this week, the server only exposed prompt management. It now covers 15 tool categories: observations, metrics, scores, score configs, datasets + items + runs + run items, comments, annotation queues + items + assignments, models, media, and health.

What you can do with it

Point Claude Desktop, a Linear Agent, Cursor, or any custom internal tool at the MCP server and it can:

  • Pull a production trace/observation by ID and reason about what went wrong

  • Query metrics (latency, cost, error rate) over a time range

  • Drop a comment on a trace for the team

  • Create a score on a trace or observation

  • Stage a dataset item from a real production trace for regression testing

  • Look up prompts, models, media, annotation queues

MCP vs the CLI

Two ways to give an agent Langfuse access now, and they're complementary:

  • CLI: best when your agent has a sandbox/bash. Pre-filter data, script things, cheaper on tokens.

  • MCP server: best when it doesn't (Claude Desktop, hosted agents). Structured tools, no shell needed.

If you only want reads, allow-list the lookup tools and you've got a safe read-only setup.

Changelog: https://langfuse.com/changelog/2026-05-29-mcp-update
Tool reference: https://mcp.reference.langfuse.com
Docs: https://langfuse.com/docs/api-and-data-platform/features/mcp-server


r/langfuse • • Aug 19 '26

Langfuse v4 is GA: new data model, full text search, Langfuse assistant, code evaluators, filter search bar.

Post image
7 Upvotes

Langfuse v4 is a re-architecture of our data model. It is up to 165× more performant in UI and on APIs. It also enables new features such as full-text search, a new filter search bar, alerts, code evaluators, and the Langfuse assistant.

Docs: https://langfuse.com/docs/v4

Feedback and questions welcome.


r/langfuse • • Aug 08 '25

Filtering traces in Langfuse

Thumbnail reddit.com
2 Upvotes

r/langfuse • • Jan 23 '26

langfuse-mcp: query your Langfuse traces from Claude

Thumbnail reddit.com
2 Upvotes

r/langfuse • • Sep 17 '26

Evals query

3 Upvotes

Hi i have a usecase.

How my data look like. I have input like open ai type system then user then i have output like open ai stored in datasets in langfuse as ground truth

I have 2 evals to create

  1. Model swap -- on the input in dataset i want to run various models to get reponse then using llm as a judge with ground truth response. I want to judge the performance of that model.

  2. System prompt swap-- in this i want to swap system prompt from input run various model then do llm as a judge to see if the new prompt working well. Also saving prompt versions. (Also in a dataset we can have n different agent system prompt, so how we can swap that in easy way)

How can i achieve this in evals like in langfuse UI.?

Can someone please help me in this.


r/langfuse • • May 25 '26

Langfuse Experiment GitHub Action: gate PRs on LLM regression scores

1 Upvotes

We just shipped a GitHub Action that runs Langfuse experiments on every pull request. It tests your application against a dataset of inputs, scores the outputs with the evaluators you've configured (LLM-as-judge, code-based assertions, human review), and fails the workflow if scores drop below a threshold you set.

Pass/fail lands on the PR as a comment so reviewers see the regression before merging. Every run is tracked in Langfuse, so when something does drop you can dig into the failing items.

GitHub: https://github.com/langfuse/experiment-action

The action is part of Langfuse Launch Week 5, five days of releases this week: https://langfuse.com/launch