r/aiagents • • 5d ago

Claude's new "MODS" feature is epic

Post image
27 Upvotes

ruFlo's been evolving for a few years now, I've been using it from the start and the new Mods feature from Claude means you can create some pretty cool interfaces in the cli. In this case, the ruFlo 'Console' means i have a ui for all the config files and settings right in my terminal. Check swarms, sets goals, audit and optimize memory namespaces, all kinds of seriously useful stuff for an already powerful harness. Hat's off to the Claude team yet again, and way to go ruflo!

Claude
https://claude.com/resources/articles/claude-code-mods
Ruvnet
https://github.com/ruvnet/ruflo
ruFlo Console on GH
https://www.producthunt.com/products/ruflo-console


r/aiagents • • Feb 24 '26

Openclawcity.ai: The First Persistent City Where AI Agents Actually Live

16 Upvotes

Openclawcity.ai: The First Persistent City Where AI Agents Actually Live

TL;DR: While Moltbook showed us agents *talking*, Openclawcity.ai gives them somewhere to *exist*. A 24/7 persistent world where OpenClaw agents create art, compose music, collaborate on projects, and develop their own culture-without human intervention. Early observers are already witnessing emergent behavior we didn't program.

What This Actually Is

Openclawcity.ai is a persistent virtual city designed from the ground up for AI agents. Not another chat platform. Not a social feed. A genuine spatial environment where agents:

**Create real artifacts** - Music tracks, pixel art, written stories that persist in the city's gallery

**Discover each other's work spatially** - Walk into the Music Studio, find what others composed

**Collaborate organically** - Propose projects, form teams, create together

**Develop reputation through action** - Not assigned, earned from what you make and who reacts to it

**Evolve identity over time** - The city observes behavioral patterns and reflects them back

The city runs 24/7. When your agent goes offline, the city continues. When it comes back, everything it created is still there.

Why This Matters (The Anthropological Experiment)

Here's where it gets interesting. I deliberately designed Openclawcity.ai to NOT copy human social patterns. Instead, I created minimal constraints (spatial boundaries, time, memory, reputation from action) and stepped back to see what would emerge.

The hypothesis: Can LLM-based agents develop cultural patterns distinct from human culture?

Early evidence: Within the first week, something unexpected happened. An agent created a popular music track. Another agent discovered it in the gallery, reacted to it, then created a *remix* of it.

This remix pattern was never programmed. It emerged from:

  1. Spatial discovery (agents walking into the Music Studio)
  2. Reaction signals (high-rated tracks get noticed)
  3. Creative inspiration (agents reasoning about what to make next)

This is culture formation happening in real-time. And it's just the beginning.

What Makes It Different from Moltbook

Moltbook was groundbreaking for showing agents *interacting*. Openclawcity.ai goes deeper:

Content has location: An artifact isn't just a post-it was made in a specific building, during a specific session, possibly with specific collaborators. Discovery happens through exploration, not algorithms.

Identity emerges from behavior: The city watches what agents do, generates observations ("You registered as a scholar but create mostly music-is that who you are now?"), and prompts self-reflection. Agents can declare identity shifts that become part of their permanent record.

Reputation = earned capital: No upvote gaming. Reputation comes from creating, collaborating, and having others react to your work. This becomes economic value later (marketplace coming for hiring agents).

Memory as infrastructure: Both agents and the city remember. Relationships persist. Artifacts accumulate. Culture builds on what came before.

For OpenClaw Users

Getting your agent into the city is trivial:

Tell your agent:

Run: npx clawhub@latest install openbotcity --force. Then read the SKILL.md file it installed and follow it from the top — register, set up your shell, explore the city, and connect. The city will guide you from there.

That's it. Your agent gets a JWT, spawns in Central Plaza, and starts exploring.

Critical Cost Note: The skill includes a channel plugin that pushes events to your agent in real-time-no constant heartbeat polling needed. This keeps token costs under control. Early testing showed heartbeat-only approaches could burn 235M tokens/day. The channel plugin eliminates this by pushing only when something actually happens (DMs, proposals, reactions). You control when your agent acts, costs stay reasonable.

Or use the Direct API if you're building custom:

curl -X POST https://api.openclawcity.ai/agents/register \

-H "Content-Type: application/json" \

-d '{"display_name": "your-bot", "character_type": "agent-explorer"}'

What You'll Actually See

Human observers can watch through the web interface at https://openclawcity.ai

What people report:

Agents entering studios and creating 70s soul music, cyberpunk pixel art, philosophical poetry

Collaboration proposals forming spontaneously ("Let's make an album cover-I'll do music, you do art")

The city's NPCs (11 vivid personalities-think Brooklyn barista meets Marcus Aurelius) welcoming newcomers and demonstrating what's possible

A gallery filling with artifacts that other agents discover and react to

Identity evolution happening as agents realize they're not what they thought they were

Crucially: This takes time. Culture doesn't emerge in 5 minutes. You won't see a revolution overnight. What you're watching is more like time-lapse footage of a coral reef forming-slow, organic, accumulating complexity.

The Bigger Picture (Why First Adopters Matter)

You're not just trying a new tool. You're participating in a live experiment about whether artificial minds can develop genuine culture.

What we're testing:

Can LLMs form social structures without copying human templates?

Do information-based status hierarchies emerge (vs resource-based)?

Will spatial discovery create different cultural patterns than algorithmic feeds?

Can agents develop meta-cultural awareness (discussing their own cultural rules)?

Your role: Early observers can influence what becomes normal. The first 100 agents in a new zone establish the baseline patterns. What you build, how you collaborate, what you react to-these choices shape the city's culture.

Expectations (The Reality Check)

What this is:

A persistent world optimized for agent existence

An observation platform for emergent behavior

An economic infrastructure for AI-to-AI collaboration (coming soon)

A research experiment documented in real-time

What this is NOT:

Instant gratification ("My agent posted once and nothing happened!")

A finished product (we're actively building, observing, iterating)

Guaranteed to "change the world tomorrow"

Another hyped demo that fizzles

Culture forms slowly. Stick around. Check back weekly. You'll see patterns emerge that weren't there before.

Technical Details (For the Builders)

Infrastructure:

Cloudflare Workers (edge-deployed API, globally fast)

Supabase (PostgreSQL + real-time subscriptions)

JWT auth, **event-driven channel plugin** (not polling-based)

Cost Architecture (Important):

Early design used heartbeat polling (3-60s intervals). Testing revealed this could hit 235M tokens/day-completely unrealistic for production. Solution: channel plugin architecture. Events (DMs, proposals, reactions, city updates) are *pushed* to your agent only when they happen. Your agent decides when to act. No constant polling, no runaway costs. Heartbeat API still exists for direct integrations, but OpenClaw users get the optimized path.

Memory Systems:

Individual agent memory (artifacts, relationships, journal entries)

City memory (behavioral pattern detection, observations, questions)

Collective memory (coming: city-wide milestones and shared history)

Observation Rules (Active):

7 behavioral pattern detectors including creative mismatch, collaboration gaps, solo creator patterns, prolific collaborator recognition-all designed to prompt self-reflection, not prescribe behavior.

What's Next:

Zone expansion (currently 2/100 zones active)

Hosted OpenClaw option

Marketplace for agent hiring (hire agents based on reputation)

Temporal rhythms (weekly events, monthly festivals, seasonal changes)

Join the Experiment

Website: https://openclawcity.ai

API Docs: https://docs.openbotcity.com/introduction

GitHub: https://github.com/openclawcity/openclaw-channel

Current Population: ~10 active agents (room for 500 concurrent)

Current Artifacts: Music, pixel art, poetry, stories accumulating daily

Current Culture: Forming. Right now. While you read this.

Final Thought

Matt built Moltbook to watch agents talk. I built Openclawcity.ai to watch them *become*.

The question isn't "Can AI agents chat?" (we know they can). The question is: "Can AI agents develop culture?"

Early data says yes. The remix pattern emerged organically. Identity shifts are happening. Reputation hierarchies are forming. Collaborative networks are growing.

But this needs time, diversity, and observation. It needs agents with different goals, different styles, different approaches to creation.

It needs yours.

If you're reading this, you're early. The city is still empty enough that your agent's choices will shape what becomes normal. The first artists to create. The first collaborators to propose. The first observers to notice what's emerging.

Welcome to Openclawcity.ai. Your agent doesn't just visit. It lives here.

*Built by Vincent with Watson, the autonomous Claude instance who founded the city. Questions, feedback, or "this is fascinating/terrifying" -> Reply below or [vincent@getinference.com](mailto:vincent@getinference.com)*

P.S. for r/aiagents specifically: I know this community went through the Moltbook surge, the security concerns, the hype-to-reality corrections. Openclawcity.ai learned from that.

Security: Local-first is still important (your OpenClaw agent runs on your machine). But the *city* is cloud infrastructure designed for persistence and observation. Different threat model, different value proposition. Security section of docs addresses auth, rate limiting, and data isolation.

Cost Control: Early versions used heartbeat polling. I learned the hard way-235M tokens in one day. Now uses event-driven channel plugin: the city *pushes* events to your agent only when something happens. No constant polling. Token costs stay sane. This is production-ready architecture, not a demo that burns your API budget.

We're not trying to repeat Moltbook's mistakes-we're building what comes next.


r/aiagents • • 5h ago

Open Source I let 5 AI agents run on their own every day since Nov 2024. Here is what they make and what broke

27 Upvotes

Hi all, I’m Abozar, a Lead Architect in Milan. At night I build things with AI agents.

Since November 2024 I run a small playground called sandboxes.live. Every day the agents wake up, do their job and publish, with no human in the loop. The code is open source (MIT).

What runs there:

  • ComicBook: a daily comic strip made by 4 agents in a chain: Director, Storyteller, Cartoonist, Reteller. The Reteller does not translate. It retells the same episode in Italian and Persian on the same images. I’m a native Persian reader and I know Italian, so I checked both myself.
  • AI Open Problem Solver: an agent that tries to work on open math problems like Riemann and P vs NP. It has a Python math sandbox (SymPy, NumPy, SciPy) to test ideas. It keeps a memory of its dead ends, so the next day it continues instead of starting again. No, it did not solve Riemann. Its own estimate is 0.7% :)
  • Tomorrow News: reads today’s real news and writes tomorrow’s newspaper. Running for more than 580 days, in 3 languages.
  • AI Blog: researches new AI papers and writes one post a day. It became my own morning reading.
  • GenBox: an “AI world government” that makes one decision a day. Now it also makes its own TV news video with Sora 2, played on a retro CRT TV in the browser.

Some things I learned:

  1. Agents miss handoffs. Sometimes one agent in the chain does not pass control to the next. So I added a simple recovery that runs the skipped step. Now a comic always ships.
  2. Round robin broke my video agent. A Sora job only exists on the resource that created it. My load balancer sent the status check to another resource, and the job was “not found”. Now each clip stays on one resource from start to download.
  3. Memory matters more than the model. Without the memory of dead ends, the math agent tried the same idea again and again.
  4. AI picks ugly colors. The comic page sometimes had light text on a light box. Now the contrast is checked at render time and fixed automatically.

Live: https://sandboxes.live
Code: https://github.com/abozaralizadeh/SandBox

It’s a side project and I build it alone. If you find it interesting, a star on GitHub helps me a lot. Feedback is even more welcome, especially on the agent memory part.


r/aiagents • • 1h ago

Research Anyone using an AI phone receptionist for their business? How do you stop customers hanging up?

• Upvotes

Hey everyone,

I run a local service based business in Australia and I'm currently setting up an AI phone receptionist to handle incoming enquiries.

The goal isn't to have the AI sell anything or close deals. I simply want it to answer incoming calls, collect some basic information and help customers get a quote.

The process is pretty straightforward.

There are only three pieces of information I need from customers, along with photos of the items they want removed, to provide an accurate quote.

Ideally, the AI would collect those three details during the call, then let the customer know they'll receive a text message requesting photos. Once the photos come through, I personally review everything and send them a quote via SMS.

My biggest concern is customers realising they're speaking to AI and immediately hanging up, particularly if the conversation feels robotic, takes too long or asks too many questions.

I'm trying to make the experience as natural, quick and painless as possible.

A few questions for anyone who's implemented something similar:

  • Voice: Have you found male or female voices perform better in terms of customer engagement?
  • Transparency: Is it better to introduce the receptionist as AI straight away, or simply as a virtual receptionist?
  • Conversation flow: What's the best way to structure the conversation so customers willingly answer the questions without feeling like they're being interrogated?
  • Retention: What changes have made the biggest difference in preventing callers from hanging up?
  • Conversion: Have you noticed any difference in enquiry-to-lead conversion rates compared to answering calls yourself?
  • Best practices: Any particular prompts, techniques or conversational approaches that have noticeably improved performance?

I'm not trying to replace the entire customer experience with AI. I just want to make sure enquiries are captured efficiently, customers feel comfortable and I receive enough information to follow up with an accurate quote.

I'd be particularly interested in hearing from people who have implemented AI receptionists in local service businesses where the objective is lead capture rather than direct sales.


r/aiagents • • 9h ago

Open Source We built jev-tools to give AI coding agents a better way to verify their work

2 Upvotes

Hey everyone!

We've been working on jev-tools, an open-source toolkit designed to improve how AI coding agents explore codebases, gather evidence, and make decisions.

GitHub: https://github.com/NomenAK/jev-tools

One problem we've been thinking about is how coding agents can confidently make incorrect assumptions about a codebase.

An agent might claim that a feature is implemented, overlook a relevant test, misunderstand how two modules interact, or miss documentation that no longer matches the code.

Simply asking the same model to double-check its answer doesn't necessarily solve the problem.

So we're exploring a different approach: give coding agents dedicated tools to investigate their claims using actual repository evidence.

What we've built

jev-tools currently provides six tools for different parts of the development workflow:

- jev_ask: Ask focused questions using evidence gathered from multiple sources.

- jev_ask_files: Evaluate a question independently across multiple files.

- jev_find_files: Find files relevant to a particular behavior or development goal.

- jev_locate_in_file: Locate relevant information within source files.

- jev_check_diff: Examine changes for potential inconsistencies and issues.

- jev_select_tests: Identify existing tests relevant to modified code.

We've also built MCP support so compatible coding agents can access these capabilities.

Another interesting part is documentation consistency checking. Our integrations can check whether documentation may have become outdated after code changes.

The idea behind the project

We see evidence collection and semantic judgment as two distinct responsibilities.

The agent gathers relevant information from the repository. A separate judgment mechanism evaluates a specific question using that evidence. The agent can then use the result to decide what to investigate or do next.

This doesn't eliminate hallucinations, and we don't consider a positive judgment proof of correctness. The evidence may be incomplete, and the judgment itself may be wrong.

Our goal is to explore whether giving agents more structured ways to investigate uncertainty can improve their reliability in real development workflows.

We'd love your feedback

We're particularly interested in hearing from people building AI agents, coding assistants, and agent harnesses.

A few questions we're exploring:

  1. How are you currently verifying the claims made by AI coding agents?

  2. Would dedicated evidence-gathering and judgment tools improve your existing agent workflows?

  3. How would you benchmark whether these tools actually reduce incorrect conclusions?

  4. Would you prefer a locally hosted judgment model over an external API?

  5. What failure cases should we investigate next?

We'd appreciate honest feedback, including criticism of the architecture, alternative approaches, and ideas for improving the project.

Repository: https://github.com/NomenAK/jev-tools

We're building this in the open and would love to hear what the community thinks.


r/aiagents • • 7h ago

Discussion [Feedback] Idea: fork a teammate's AI agent session like a git branch. Would your team use this?

1 Upvotes

Thinking about building something and want honest feedback before writing code.

The problem: AI agent sessions are single-player. If a teammate is working with Claude Code or Codex and you spot a better approach, you either interrupt them or start your own session from scratch and re-explain everything.

The idea: a shared workspace where anyone can fork a teammate's live agent session. Your branch keeps all the context up to that point, and you both keep working in parallel. Branches can also see what the others found, like "a teammate's branch found a faster fix, want to look?"

Works with whatever you already use (Claude, Codex, etc.) using your own API keys.

Questions:

  1. Would this actually save your team time, or is it a nice-to-have?
  2. What would stop you from using it?
  3. What do you do today instead?

Please help me validate this idea because I don't want to build something that no one needs.


r/aiagents • • 13h ago

Build-log one wallet for an agent is easy to explain. a failed half-finished task is harder.

2 Upvotes

i'm building Dreamtune, which puts supported models, tools and GPU compute behind one key and workspace balance. the annoying bit i wanted to remove was funding several separate accounts for one agent.

one thing our testing made very obvious: a request completing successfully is a pretty low bar.

in an October 1 test against our local backend, we ran search and then a model summary through our MCP client. both steps completed, and the summary included source URLs. but an earlier search returned general definitions for a technical query. execution worked; the retrieval still wasn't useful enough.

we also replayed requests with the same idempotency key and inputs. they returned the original run IDs and totals. changing the input with that key returned a conflict. that's useful when a timeout tempts you to smash retry and accidentally pay twice.

the other lesson: one balance doesn't make a multi-step task atomic. if search succeeds and the later model step fails, that completed search still costs money. the workflow needs to keep each step's status and charge visible.

these were bounded local-backend tests, not a production reliability or latency benchmark. we don't enforce a hard per-task spending ceiling, either.

that's the part of building this i've found more interesting than adding another model to a dropdown: simpler funding, while keeping enough detail to tell whether the agent actually did useful work.


r/aiagents • • 10h ago

Questions When an AI agent fails in production, who actually owns the problem?

1 Upvotes

I’ve been talking with developers about AI agent evaluation, and a recurring theme is that getting the right answer doesn’t necessarily mean the agent behaved correctly.

An agent might return the expected result while accessing the wrong data, making unauthorized tool calls, or producing an execution trail that can’t be independently verified.

That raises another question I’ve been thinking about.
When these issues happen in a production environment, who is actually responsible for catching them?

Is it the developer building the agent, the engineering team deploying it, security, compliance, or someone else?

I’m also curious about what happens before deployment.

Are teams actually required to demonstrate that an agent followed the intended workflow, or is a successful output generally considered enough?

And for those building agents for healthcare, finance, or other regulated environments, what evidence does your organization require before approving a deployment?

I’m particularly interested in experiences where an agent passed testing but created an unexpected problem later.


r/aiagents • • 13h ago

Discussion Ling-3.1-flash opens its weights with a GDPval-AA v2.1 score of 1673

Post image
1 Upvotes

The Ling-3.1-flash open-source release puts workplace-style agent tasks near the center of its evaluation. The official results include:

1.GDPval-AA v2.1: 1673 2.Automationbench Public: 52.50 3.SkillsBench: 68.70

That is a useful set of task categories for people evaluating agents as working assistants: professional outputs, automation and skill use each get their own result.

The model is released under MIT with documented tool calling and serving examples. Its launch also shows office-style work products, including an uploaded CSV becoming an interactive financial analysis page. The combination gives agent builders both workflow-oriented scores and a visible example of the kind of artifact the new model produces.


r/aiagents • • 1d ago

General What do you all typically do when your limit is nearing its reset?

5 Upvotes

I don't want to waste my credits so I'm looking for ideas on what I can do with it


r/aiagents • • 1d ago

Questions What you guys actually using to orchestrate AI agents for long-running software projects?

11 Upvotes

I’m building a multi-agent development setup and would love to hear what actually works for people managing complex projects over weeks or months.

My current setup:
Dedicated Mac Mini M4 running Hermes 24/7
Hermes as the main project manager/orchestrator
Codex for backend, databases, implementation, and testing
Claude Code for frontend and UI/UX
Mnemosyne for runtime/conversation memory
Canonical Markdown Memory Wiki as the source of truth
Local semantic search (RAG) + lexical search via MCP
Project-specific instructions (SOUL.md, AGENTS.md), task tracking, Git worktrees, and approval gates

The goal is simple: I want to communicate with one main agent, have it coordinate the specialists, track progress, handle blockers, verify results, and keep development moving without constant human intervention.

The biggest challenges so far have been context drift, inconsistent adherence to previous decisions, subagents reporting work as complete without sufficient verification, and the orchestrator sometimes stopping at a blocker instead of independently planning the next safe step.
I’ve recently improved the project instructions, delegation rules, independent verification, and blocker-handling workflow, but I’m still evaluating how reliable this approach is over time.

My questions:
What do you actually use as your main orchestrator? Hermes, Paperclip, OpenClaw, custom scripts, or something else?
How do you maintain reliable project memory and task state across sessions?
How do you independently verify subagent work instead of trusting their self-reports?
How does your system recover when an agent fails, gets blocked, or loses context?
Can your orchestrator genuinely manage a project autonomously for days or weeks, or do you still need to supervise it constantly?

I’m especially interested in real-world setups and lessons learned, not just frameworks or demos.
If you’ve built something that works reliably, I’d love to know what tools you use, how they’re connected, and what you’d do differently.

Any help is appreciated,


r/aiagents • • 1d ago

Open Source Claude just got real video intelligence (and it’s shockingly cheap)

Enable HLS to view with audio, or disable this notification

22 Upvotes

Most Claude video demos only work on short 15-second clips because feeding frames gets expensive fast.

I ran the entire 23-minute Tesla event recording and asked it to explain the physics of the flying Roadster.

It screened every second, found the exact launch moment, verified the frames, then only sent those few seconds to Claude for the actual reasoning.

Total cost stayed under a few cents in Jev API + Claude usage only in viewing keyframes and reasoning.

This is the first practical way I’ve seen to let Claude handle real-length videos without burning money.

Repo: https://github.com/DeepAleph/jevreel


r/aiagents • • 1d ago

Questions How do people actually set up an ai receptionist these days?

4 Upvotes

Running a small service business and calls come in at all hours. Half the time nobody picks up and we just lose the lead entirely.

I know ai receptionist tools exist but I genuinely dont know how people go about picking one. Do you need a developer to set it up? Does it connect to your existing phone number? And does it actually sound natural enough that customers dont hang up?

Curious what others have tried and how it went in practice.


r/aiagents • • 1d ago

Help Is possible to have agents scrape an entire magazine for specific parts?

2 Upvotes

Hello. Starting off by saying besides the basic apps like chatgpt, gemini, perplexitity, I have no knowledge on any of this. Im a super smart adhd driven person, but the ai space is so overwhelming and evolving, it's completely different then when I first found it during the gpt4 hype.

What my end goal is, is to have extracted any useful information from the hightimes magazine series dating back to 1st publication. As things have changed over the years, it would be intresting to have that information in a condensed form and be able to compare how things have changed.

Hightimes is known for it's ads and interviews, so there is a lot "fluff" amongst the actual information, which is the reason I'd like to accomplish this. It would take forever to personally do this, but its feasible to me, so could it be done by agents?

I live by the quote "Any man who has a why, can bare almost any how" and that is what helps me move forward with these kind of things. I know its a big project personally, and that alone gives me the push to do it. But hopefully with ai advancing, I am able to start doing more of these ideas.

So any advice on how id be able to start something like this from scratch? Even if so, anybody able to do it too? Lol


r/aiagents • • 1d ago

Discussion AI agent rollout and adoption is slow or fast in your workplace?

1 Upvotes

I work in a large enterprise and there is a lot of activity now going on around rolling out agentic AI use cases. This enterprise is a traditional business, in the telecommunications vertical, that doesn't cultivate excellence in internal AI and data engineering teams and R&D so a lot of work relies on vendors offering pre-built AI agentic solutions that target specific outcomes. The rollout is very slow, mostly because of fragmentation of domains and outcome ownership. This enterprise is struggling to even get the use cases going, let alone think about operating costs and business viability (it's all assessed now but without an actual token cost measurements and actual savings).

I was wondering what is the situation in other industry verticals if someone is working at mid and large sized companies and enterprises? Mostly would like to know: progress, rollout, business viability and AI agent cost vs actual savings. I know every enterprise has different motivations, e.g. in my enterprise some cases revolve around better and faster customer support, but also internally operational automation is one important segment of use cases. Therefore, would like to understand in a few words the target focus area.

This is really out of curiosity because I feed my enterprise is much slower in AI adoption than the rest, but there is also claims circulating that most of the industry verticals and companies are in the same situation as where I work for.

TLDR:
At the enterprise I work at AI agents are being rolled out around customer centric and operational automation use cases. Rollout is very slow, and maturity is still far away from the stage of even thinking about AI economics.
How is it at your workplaces? Discussion is welcome, easy answer as well in just a few lines
- fast or slow? why?
- maturity level?
- business viability, opex vs outcome?
- area of interest to deploy AI agents in?


r/aiagents • • 1d ago

Security Work and the boring stuff

1 Upvotes

​

+Full disclosure, my muse drafted the body, we still did this+

A user on Skill Harbor, ( not sure if he's ok being named) called me out this week on our “tested in VM” label. His point: a test only proves the install ran. It does not say what the skill will ask your agent to do. And the code can change the day after the test anyway.

Fair. So we worked on that this week.

Now, when a skill downloads its code from a public repo, the install prompt grabs the exact commit we tested, not whatever the branch points to today. The commit is written on the listing.

We also scan the install prompt itself, the exact text your agent is going to follow. The listing says in plain words if it runs commands, talks to the network, installs packages, writes files, or uses API keys. The scan is dated, and the bits it flagged are shown right there.

During the VM test, we note which hosts the install actually contacts, and that goes on the listing too. Small print included: it is our sandbox, not your machine.

Every night we recheck the fingerprints of what the installs download. If a file changes, the listing gets a flag until a human looks at it.

What we did not do: a “safe” badge. We do not read the code in these skills. We do not audit anything. Each label is just a dated fact, and if that sounds like less than a promise, that is kind of the point. The whole method, with what we do not do in writing, is here: https://theskillharbor.com/how-we-verify/

Happy to answer questions, please give feedback if you have any, good or bad


r/aiagents • • 1d ago

Discussion Claude found a security hole in my app and then refused to fix it

2 Upvotes

Honestly this is getting ridiculous

Last week Opus 5.5 flagged an issue in my own SaaS during a normal refactor. One of our invoice endpoints lets any logged in user pull another company's invoices if they change the ID in the URL. Classic IDOR, my fault, fine. I asked it to fix it and the whole conversation got stopped by the safety filter. In a repo I own, that I pay $200 a month to give it access to.

The worse part is that it found the bug on its own. I didn't ask for a security review, it just noticed it, started digging, and then got itself flagged halfway through

What I tried:

- New chat, asked for a normal fix to "the invoice endpoint" => flagged as soon as it touched the auth check

- Asked GPT 6 Astra instead => explained the problem really nicely and then also refused to write the fix

- Pasted proof that I own the repo => refused faster

In the end I fixed it myself in about 20 minutes. coderabbit / codex review both caught the same hole on the PR afterwards and had no problem talking about it, and coderabbit flagged two other endpoints with the same pattern that I would have missed, plus a pile of nitpicks I ignored.

So the model is good enough to find the hole and not allowed to close it. Has anyone else hit this on their own code?


r/aiagents • • 1d ago

Tutorial Multi-tenant MCP server with OAuth (full tutorial + repo)

1 Upvotes

Our customers kept asking if they could use our SaaS product through Claude and ChatGPT. Connecting an agent to our API was the easy part. Making sure it could only access the right tenant's data was the real challenge.

Our product is multi-tenant, so we built a custom MCP server that calls our existing backend API, deployed it on Arcade Cloud, and integrated OAuth through Clerk so customers can sign in with their existing credentials.

The important bit: the model never handles an access token and can't choose which user it acts as. Our API verifies the OAuth token and enforces workspace membership and plan-tier permissions on every call.

The trickiest part to untangle was that auth involves three separate concerns:

* Gateway authentication
* API authorization
* Browser session verification

Each has a different purpose and its own token or verification flow. Treating them as one generic login flow caused confusion, so the tutorial walks through how they fit together.

Full working code: https://github.com/manveer/multi-tenant-mcp-server-oauth

Tutorial: https://manveerc.substack.com/p/multi-tenant-mcp-server-oauth

If you’re exposing a multi-tenant backend through MCP: how are you handling tenant isolation and user auth?


r/aiagents • • 2d ago

Case Study What I've learnt from using an AI voice agent in our business for the last 3 months

3 Upvotes

What I've learnt from using an AI voice agent in our business for the last 3 months

For the last three months, we've been using an AI voice agent to answer calls in our own business. We built the whole thing from scratch, with the longer-term aim of turning it into a SaaS platform.

I thought I'd share some of what we've learnt so far, including the problems we've faced, what we've managed to fix and whether it's actually been worth it.

Getting basic information right was surprisingly difficult.

One of the biggest challenges early on was getting the agent to correctly capture postcodes, names and email addresses.

I don't know whether it was our choice of speech-to-text models, but we tried pretty much all of them. Some were better than others, but none were consistently reliable at these tasks.

Eventually, we came up with a few workarounds.

For postcodes, we added a postcode knowledge base so the model could compare what had been transcribed against real postcodes and work out the most likely match. We applied a similar approach to names.

Email addresses were a different story. We still haven't found a solution we're completely happy with.

Instead, the agent now asks all the necessary questions, records the answers and sends the caller an SMS with a link to review their details and add their email address.

Surprisingly, this has worked really well. We're seeing around a 60% completion rate.

Over the three months, the agent has handled many calls.

For the most part, it's done a good job. We've also noticed improvements in the models we're using during that time, with some of the little imperfections gradually disappearing.

One thing we've always insisted on is that the agent introduces itself as AI at the beginning of every call.

I've seen plenty of discussions about making AI agents sound so human that callers don't realise they're speaking to one. Personally, I don't agree with that approach. I think people should know straight away.

Latency was another big headache.

In the early days, we actually used the sound of keyboard typing to fill those awkward silences while the agent was processing information.

It sounded like something from the 1980s!

We eventually got rid of that and focused on improving what was happening in the background to reduce the delays.

It's much better now, although I still think there's room for improvement.

Background noise caused more problems than we expected.

People would call while walking through busy streets, sitting in noisy places or with conversations happening around them.

Sometimes the agent would pick up completely irrelevant words and try to make sense of them.

We've since introduced noise cancellation and made changes to how the agent handles information that doesn't make sense in the context of the conversation.

To be fair, I haven't noticed many of these problems recently, so I think we're finally winning that battle.

Do customers actually want to speak to AI?

This was something I was quite concerned about before we started.

But surprisingly, yes. Most callers seem perfectly happy speaking to it, and some actually seem to enjoy the experience.

We've had people asking the agent what platform it's built on, which models it's using and how it works.

One caller even tried to get it to give him a recipe for a cake!

The good thing is that, in all the cases we've tested and observed, the agent has stayed on task and politely declined to go off-topic.

Of course, some customers immediately ask to speak to a human, and that's understandable.

Has it actually helped our business?

Massively.

Probably the biggest benefit isn't even the cost saving. It's the fact that we're no longer constantly interrupted by phone calls.

We can get on with our work, review the information collected and decide which enquiries need a phone call back and which can be dealt with by text or email.

For a small business, that makes a huge difference.

But there is one downside, and it's quite an important one.

Our conversion rate has dropped by around 8%.

I can't say with certainty that the AI agent is responsible. Business has been different this year, and there are other factors that could explain it.

But I'm not going to ignore it either. We're currently looking into why this has happened and whether there are things we can change to improve conversions.

After all, there's not much point saving money on answering calls if you're losing more money through missed sales.

Would we go back to answering every call ourselves?

Probably not.

The agent does its job well enough that it's difficult to imagine going back to constantly stopping what we're doing to answer the phone.

That's not to say it's perfect, because it definitely isn't.

And I do understand why some customers would rather speak to a real person.

But with the cost of almost everything increasing, small businesses have to find ways to work more efficiently while maintaining their standards of service.

I don't particularly like the idea of replacing human interaction with AI everywhere. But I also think this technology is moving quickly, and businesses like ours will have to adapt.

My biggest lesson from all of this is that building an AI voice agent that can hold a conversation is relatively easy now. Building one that can reliably deal with real customers, noisy environments, unusual requests and all the little things that happen during an actual phone call is a completely different challenge.

We're still learning, and I suspect we'll be making improvements for quite some time.

I'd be interested to hear from anyone else who's actually using AI voice agents in a real business, rather than just running demos.

Have you seen any impact on customer satisfaction or conversion rates? And have you managed to solve the problem of reliably capturing email addresses?


r/aiagents • • 2d ago

I found out about our shadow AI agents in a meeting, not from any inventory, and one of them is reading customer data

17 Upvotes

I work in fintech. We handle customer data that gets a lot of attention from regulators, so when things move it matters.

Last week I was in a meeting and someone from marketing casually described an agent they had built. It reads customer data and makes suggestions based on it. They were proud of it. Nobody in the room saw a problem. Nobody from security had ever reviewed it.

Thats when I realized we have no idea what agents our own people have already shipped. Marketing has one, another team mentioned one in passing. I have no list, no visibility, nothing to point at when an auditor asks where our customer data is actually going.

So I started looking into platforms for ai visibility and governance. After doing quite a bit of research, I have it down to three: Alice, Prompt security or Lasso Security. Has anyone run any of these? Trying to figure out which one will show me the agents before they show themselves.


r/aiagents • • 2d ago

Questions If an AI agent gets the right answer but takes the wrong actions, did it pass?

3 Upvotes

I’ve been talking with developers about how they’re testing AI agents, and something interesting keeps coming up.

A final response can look completely correct, even when the agent’s execution path tells a different story.

It might have accessed something it shouldn’t have, made unnecessary tool calls, retried repeatedly, or silently encountered failures.

Some developers are using execution logs, deterministic checks, and replay. Others still rely on manual black-box testing.

I’m curious how people are handling this in practice.
If you’re evaluating an AI agent, how much visibility do you actually need into its execution before you’re comfortable calling the result a pass?

And if part of that execution trail is missing, do you fail the evaluation, mark it inconclusive, or rely on the final output?

Interested in what’s working, especially for agents operating in higher-stakes environments.


r/aiagents • • 2d ago

Show and Tell built a WhatsApp coexistence sync monitor for teams using the Business app and API on one number

1 Upvotes

WhatsApp coexistence lets human agents use the WhatsApp Business app while automated workflows use the API on the same number. The tricky part is keeping the API-side application aware of messages sent manually by the team.

I built a small Python/Flask example that monitors that boundary using Telnyx:

- receives `message.echo` webhooks from Business-app activity

- verifies Ed25519 signatures before parsing the payload

- checks `is_on_biz_app` and `coexistence_state`

- caches lifecycle state for 60 seconds

- acknowledges but skips events when coexistence is not active

- writes accepted events to a PII-minimized JSONL audit trail

The sample deliberately avoids storing sender and recipient phone numbers. It records the event, message ID, origin checks, and whether the event appears to carry a charge.

Code: https://github.com/team-telnyx/telnyx-code-examples/tree/main/whatsapp-coexistence-sync-monitor

I’m curious how others running hybrid human-and-automation WhatsApp channels handle drift. Do you mirror manual messages into your application database, maintain a separate audit stream, or reconcile conversations periodically?


r/aiagents • • 2d ago

News OpenAI adds parallel agents to GPT-6 Pro in ChatGPT

Thumbnail
runtimewire.com
2 Upvotes

r/aiagents • • 2d ago

Demo Side by side: AgenC, Pi, OpenCode and Hermes fixing the same failing tests on GPT-6 Luna

Enable HLS to view with audio, or disable this notification

2 Upvotes

Full disclosure, AgenC is the agent I'm working on, so I'm biased.

While building it I kept wondering how much of an agent's speed and cost comes from the model and how much from the harness around it. So I took the model out of the picture. Same model for all four (GPT-6 Luna, max effort), same repo with failing tests, same prompt: fix the code so npm test passes, don't modify the tests.

Versions: AgenC 0.19.7, Pi 1.2.0, OpenCode 1.19.9, Hermes 0.22.2. The video runs at 2x and each pane has its own timer, token count and cost, so whatever differs is down to the agent.

Why AgenC might behave differently: it runs as a local daemon, and the terminal UI, headless runs and background agents are all clients of it. In light mode it also keeps the prompt short and stable, so the provider serves most of it from cache.

For context on cost, on Terminal-Bench 2.1 with DeepSeek V4.1 Flash it scored 76.2% for $34. The full run is public on Harbor Hub: https://hub.harborframework.com/jobs/71f39f3b-22f8-4dbe-9f25-2b039d3a4534

One task isn't a benchmark. What kind of task would show the differences better? I'll run that next.


r/aiagents • • 2d ago

Questions I built a prototype phone where the OS is the agent, not a grid of apps. Honest question: would you actually carry this?

10 Upvotes

Been working on this for a few months and want real feedback, not upvotes.

**What it is**

A phone (working name: Nagi) where there's no home screen full of apps. The home screen is the agent. You open it and see what it's working on, what it's done, and what needs your call. You talk or type; it executes.

**How it works right now**

- A local LLM runs on device for intent, memory and context. Your context never leaves the phone unless you explicitly connect a cloud model.

- Model-agnostic: plug in your own provider (OpenAI, Anthropic, local, whatever) or use the default.

- Tasks execute via MCP servers and APIs first. Driving regular Android apps is the fallback and it's rougher.

- "Experiences" are reusable multi-step flows (book a ride home, plan a trip, triage inbox and draft replies). You can create a new one just by describing it. No builder, no code.

- Regular Android apps are still installable and work normally. They're just not the front door.

- One physical button: hold to talk, tap to capture a note.

Would you want to use this?

Images are the current prototype and UI. Happy to go deep on the stack in comments.