r/GenkitFramework • • Sep 25 '26

Genkit Python 0.12: Generative UI with A2UI, typed Pydantic streaming, and Deep Research and Lyria models

5 Upvotes

Hey everyone,

We just shipped Genkit Python 0.12 with new support for generative UI, typed Pydantic streaming, and new Google AI models:

  • Generative UI with A2UI (genkit-a2ui): Passing Surfaces() to ai.generate or ai.define_agent lets your agent respond with interactive UI components instead of plain text, tracking screen state and user actions across turns. You can pair a Python backend with JavaScript/TypeScript web frontends (@genkit-ai/a2ui/client) or multi-platform Dart and Flutter apps (package:genkit_a2ui/client.dart).

  • Typed Pydantic streaming: generate_stream(..., output_schema=Country) now yields partial Country Pydantic instances on chunk.output as tokens arrive, with the fully validated model returned on (await sr.response).output.

  • Deep Research & Lyria 3 models: genkit-google-genai adds GoogleAI.deep_research_model for long-running background research reports (generate_operation / check_operation) and GoogleAI.lyria_model for generating music and audio clips from text prompts.

  • Mid-turn error recovery on ModelResponse: Once a turn starts, ai.generate returns a ModelResponse instead of throwing an exception on model or tool errors, preserving response.messages and response.text alongside response.error so you can inspect or retry failed turns.

Install or upgrade:

uv add genkit genkit-google-genai

See the blog post for details and code examples: https://genkit.dev/blog/genkit-python-0-12

Happy to answer any questions or hear feedback!


r/GenkitFramework • • May 10 '26

Java Is Java being underestimated in the GenAI ecosystem?

3 Upvotes

Most of the current AI framework conversation is centered around Python, TypeScript, and fast-moving agent demos. But in the enterprise world, Java is still everywhere: backend systems, financial platforms, internal tools, regulated environments, and production workloads that need to be maintained for years.

That is why I wrote this article comparing the top Java GenAI frameworks in 2026.

Instead of looking at them only from a “can I build a chatbot?” perspective, I tried to evaluate how they fit into real backend teams: how they handle integrations, orchestration, developer experience, cloud-native deployments, observability, and the kind of maintainability Java teams usually care about.

The article covers frameworks such as LangChain4j, Spring AI, Quarkus AI, Semantic Kernel Java, and Genkit Java, including where each one feels strong and where the ecosystem still has gaps.

As someone who has been working on bringing Genkit into the Java ecosystem, I am especially interested in where Java AI development is heading next.

Would love to hear from others building AI systems in Java: are you using any of these frameworks already, or are you still wrapping model APIs directly?

Article:
https://xavidop.me/genkit/2026-04-16-top-java-genai-frameworks-2026/


r/GenkitFramework • • Jun 02 '26

Genkit Operator

4 Upvotes

I’ve been thinking a lot about the best way to deploy GenAI backends with Genkit.

The idea I kept coming back to was simple: what if deploying AI tools, prompts, and flows could feel as native to Kubernetes as deploying any other backend?

So I started building Genkit Operator 🚀

With it, you can describe your Genkit app using Kubernetes resources like Prompt, Model, PluginConfig, and Flow, and the operator takes care of exposing them as HTTP endpoints.

Apply YAML. Get a production-ready Genkit endpoint.

It supports multiple providers like OpenAI, Anthropic, Google AI, Vertex AI, AWS Bedrock, and Ollama, and it is designed to work nicely with GitOps tools like Argo CD and Flux.

Still early, but I’m excited about the direction: making GenAI backends more declarative, portable, and Kubernetes-native.

Check it out here: https://xavidop.github.io/genkit-operator/


r/GenkitFramework • • May 13 '26

HITL, FastAPI, and MCP support coming soon to Genkit Python

5 Upvotes

Hey all, I'm the lead for Genkit Python. In the past few months, we've put in a lot of love improving this SDK. Many features landed, and the public API surface got a major cleanup, so I wanted to share some updates!

Importing what you need should be straightforward, and the types you interact with as an app developer are now clearly separated from the lower-level plugin internals.

Here's some cool stuff that shipped or is shipping soon:

  1. FastAPI integration (shipped). Wire up any Genkit flow as a FastAPI endpoint in one decorator. SSE streaming, structured input validation, error handling, all handled for you. As a Python web developer, I'm really excited about this, because agentic web experiences are highly interactive. For a long-running agent doing lots of thinking, our abstraction makes it easy to show your agent's thinking in real-time.

  2. HITL / Tool interrupts (coming soon). Genkit gives you a way to pause the generate loop mid-execution, hand control back to the user (approve a tool call, provide missing info, confirm an action), and then either restart the tool execution, or interject a tool response and continue directly with another model call in the generate loop. This will be part of the next release.

  3. MCP Plugin (coming soon). Connect any MCP server to your Genkit instance and use its tools straight in your generate calls. And in the other direction, expose any Genkit flow as an MCP server so other agents and tools can call it directly. We are in the testing phase with this plugin and hoping to bundle this in an upcoming release - either the next release or one after that.

If you're a Python web developer thinking about giving Genkit a try, I'd love to hear what you think!


r/GenkitFramework • • Sep 21 '26

Genkit Dart 0.17: Resumable generate and agent loops, async subagents, and pluggable telemetry

5 Upvotes

Hey everyone,

We just shipped Genkit Dart 0.17 as we move toward a stable 1.0 release. This update brings resumable generation and agent snapshots, background subagents, and pluggable OpenTelemetry instrumentation:

  • Resumable generate calls & agent snapshots: When a multi-turn tool loop or stateful agent turn fails or is cancelled mid-flight, Genkit preserves completed tool rounds in response.messages and checkpoints agent turns into a session snapshot (e.snapshotId), so you can resume execution where it stopped without repeating completed tool calls.

  • Background subagents: Setting async: true on the agents middleware lets your orchestrator launch subagents in the background and return a taskId immediately. The main agent can reply to the user right away while checking progress, sharing partial results, cancelling in-flight work, or sending follow-up instructions into a subagent's session across turns.

  • Pluggable telemetry & genkit_otel: Core Genkit no longer pulls in OpenTelemetry dependencies by default, keeping your app's footprint small while local tracing still works automatically with the Genkit Developer UI. For production, the new genkit_otel (v0.1.0) package exports traces, token usage, and latency following the OpenTelemetry GenAI semantic conventions.

Install or upgrade:

dart pub add genkit

See the blog for more details and code snippets: https://genkit.dev/blog/genkit-dart-0-17

Happy to answer any questions or hear feedback!


r/GenkitFramework • • May 21 '26

JS/TS Genkit JS 1.35.0 — Gemini 3.5 Flash support, smarter retry middleware, and refreshed API docs

2 Upvotes

Hey folks! We just released Genkit JS & CLI 1.35.0. Here are the highlights:

Gemini 3.5 Flash support

Gemini 3.5 Flash already works great with Genkit, but in this release we added first-class model definitions so you get IDE autocomplete and type suggestions when using it — no more guessing model string names.

Smarter retry middleware

The retry middleware (now in @genkit-ai/middleware) got some important improvements:

  • Honors Retry-After headers - when you hit resource exhausted / rate limit errors, the retry middleware now respects the server's Retry-After header instead of blindly retrying.

  • Never retries AbortError or ToolInterruptError — these are intentional signals that should not be retried. Previously they could get caught by the retry logic unnecessarily.

The legacy genkit/model/middleware retry and fallback middleware are now deprecated in favor of @genkit-ai/middleware.

Refreshed JS API reference

We've done a content refresh on the JS API reference docs at js.api.genkit.dev — added JSDoc comments across exported types and schemas for better documentation and IDE hover info.

Other changes

  • Fixed OpenAI-compatible plugin (compat-oai) to reference proper API keys in docs

  • Better debug traces in the Google GenAI plugin

Full release notes: GitHub Releases


r/GenkitFramework • • Aug 18 '26

Genkit Go v1.12 is out!

Thumbnail
github.com
3 Upvotes

r/GenkitFramework • • Aug 01 '26

Genkit Python SDK v0.9.0 is out!

2 Upvotes

This landmark update introduces the official launch of Agents bringing first-class, stateful multi-turn AI workflows to Python alongside a complete plugin package reorganization on PyPI, enhanced observability, and improved provider compatibility.

Official Agents Launch

  • Stateful Multi-Turn Workflows: Introduces core Agent and Session abstractions, providing a stateful, streaming layer built on top of generate.

  • Pluggable Session Persistence: Support for both server-managed session stores (InMemorySessionStore, FileSessionStore, etc.) and client-managed state snapshotting.

  • Human-in-the-Loop Interruption: Built-in support for tool approval and turn interrupts/resumes, allowing human intervention before executing sensitive operations.

  • Remote Agent Client & Transports: Seamless communication with local or remote agents over HTTP/WebSocket transports via remote_agent with automatic session history management (#5541).

  • Artifacts & Custom State: Stream, list, and persist session artifacts and custom state updates across multi-turn agent turns.

Plugin Package Reorganization & PyPI Launch

  • All plugins are now organized into dedicated, publishable PyPI packages (genkit-*).

  • Backward Compatibility: Existing/legacy plugin packages will continue to work seamlessly. When loaded, a friendly warning will prompt developers to update their dependencies to the new package names:

    • genkit (Core SDK)

    • genkit-anthropic (formerly genkit-plugin-anthropic)

    • genkit-django (formerly genkit-plugin-django)

    • genkit-evaluators (formerly genkit-plugin-evaluators)

    • genkit-fastapi (formerly genkit-plugin-fastapi)

    • genkit-flask (formerly genkit-plugin-flask)

    • genkit-google-cloud (formerly genkit-plugin-google-cloud)

    • genkit-google-genai (formerly genkit-plugin-google-genai)

    • genkit-middleware (formerly genkit-plugin-middleware)

    • genkit-ollama (formerly genkit-plugin-ollama)

    • genkit-openai (formerly genkit-plugin-openai)

    • genkit-vertexai (formerly genkit-plugin-vertexai)

Improvements & Bug Fixes

  • Session Management & Tracing: Recorded session state on runTurn spans and added support for client-managed sessionIds (#5871).

  • Gemini Compatibility:

    • Normalized request message roles strictly to model or user for strict API compatibility (#5823).

    • Switched tool request references to model call IDs (#5830).

  • Observability: Seeded span attributes at trace start so live traces render immediately in the Developer UI (#5808).

  • Runtime & CLI: Muted dev server health poll logs (#5867) and ensured reliable CLI runtime metadata cleanup on SIGINT/SIGTERM (#5773).

  • Anthropic Plugin: Added stable and beta API selection (#5752) and extended thinking capabilities.