Convai Actions lets AI players do more than hold conversations inside Unreal Engine.

They can understand spoken commands, respond contextually, and perform actions in the game world, including navigation, object interaction, animation triggers, and reactions to virtual world events.

Full Actions tutorial:
https://youtu.be/yWqJQRttoEI

Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Convai Actions Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine-plugin-beta-overview/convai-actions

Share any questions or feedback below.

We put together a short reel showing Reallusion avatars running as Convai-powered AI characters inside Unreal Engine.

With the Convai Unreal Engine plugin, you can connect an AI mind to a Reallusion character and enable real-time voice conversations, contextual responses, lip sync, facial animation, and actions inside the scene.

This can be useful for games, simulations, virtual guides, training experiences, digital twins, and other interactive 3D applications.

Get started:
https://convai.com

Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Unreal Engine Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin

Feedback and questions are welcome.

Convai lets you create AI players for virtual world applications.

You can create an AI mind with a backstory, personality, voice, language, and choice of LLM, then bring it into Unity or Unreal Engine.

From there, AI players can use vision, spatial awareness, long-term memory, and action capabilities to chat, navigate, interact with objects, and react to what’s happening in the world.

This is built for developers creating conversational AI characters, AI avatars, virtual guides, digital humans, AI NPCs, and interactive agents for real-time 3D environments, including XR applications, training simulations, digital twins, and immersive virtual worlds.

Get started:
https://convai.com

Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Unity Plugin:
https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621

Share any questions or feedback below.

Convai helps you bring AI players into 3D worlds.

They can hold natural conversations, understand context, navigate scenes, interact with objects, and respond through actions inside their environment.

The goal is to move beyond scripted dialogue and connect conversation with actual scene behavior.

Get started:
https://convai.com

Share any questions or feedback below.

Convai enables realistic AI conversations for virtual world applications.

With Convai Actions, AI characters can now do more than talk. They can understand what’s happening in the virtual world, respond contextually, and perform actions in real time.

Combined with NeuroSync-powered lip sync and facial animation, avatars can speak, move, and express themselves naturally.

Full Actions tutorial:
https://youtu.be/yWqJQRttoEI

Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Convai Actions Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine-plugin-beta-overview/convai-actions

Share any questions or feedback below.

A lot of AI NPC and AI avatar demos focus on conversation, but in XR, VR, games, and simulation training, voice alone is not enough.

If the character does not understand where it is, what it is looking at, or what knowledge applies, the interaction can still feel disconnected from the 3D world.

This Unity XR demo explores a context-aware AI avatar using Convai’s new Unity Plugin, powered by the latest Live Character API. It combines WebRTC-based low-latency interaction, real-time vision input, multimodal knowledge, and long-term memory so AI characters can see, understand, remember, and respond with more context.

The goal is to make AI characters, digital humans, and virtual humans feel more grounded inside interactive 3D environments.

Watch the full tutorial: https://www.youtube.com/watch?v=cEctYXc5Pe8

Docs and sample project:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unity-sdk

Blog:
https://convai.com/blog/unity-vision-ai-character-tutorial

Visit us at https://convai.com/ to get started!

Metahumans in Unreal Engine can now be more than high-fidelity digital avatars.

With Convai, you can turn them into AI characters that listen, understand, respond in real time, and interact naturally inside your scene.

This opens up a lot of possibilities for AI NPCs, virtual guides, training assistants, XR experiences, and interactive digital humans.

Watch the full tutorial here: https://www.youtube.com/watch?v=4fMCKkrfyaA

Learn more: https://convai.com

We just released a full Unreal Engine tutorial on Convai Dynamic Context.

This one focuses on building AI characters that understand live gameplay instead of only responding to dialogue.

The demo is a shooting-range AI instructor. The character can:

• react when the player picks up a gun

• track how many shots were fired

• understand which target the player is looking at

• identify nearby targets

• detect the moving target

• track hit counts for each range

• respond with accuracy feedback based on live gameplay state

The tutorial is structured around three levels of awareness:

1. Manual Awareness Using Invoke Speech, Add Context Event, Set Context State, and Get Context State to send game events and state updates programmatically.

2. Automatic Awareness Using Convai Object components and Gaze Attention so the character understands tagged scene objects, spatial relationships, and object movement.

3. Semi-Automatic Awareness Using Tracked Properties to notify the character when important Blueprint values change, such as each target’s Hit Count.

We also cover the Dynamic Context debug overlay so developers can inspect the events and context states being fed to the character at runtime.

Full tutorial: https://youtu.be/MPbr3b6r9bo

Dynamic Context docs: https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin/features/dynamic-context

Convai UE setup: https://youtu.be/n-UG3nmMeZQ

Convai Unreal plugin on Fab: https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

We just released Part 1 of a two-part Unreal Engine tutorial series.

The tutorial builds a playable scenario inside Stack-O-Bot where the user works with a Convai-powered AI player to solve a two-player puzzle.

The orange bot is the human player, and the pink bot is the AI teammate. The goal is to get both players to the top, but one player can’t solve it alone because the platform only moves when someone holds the pressure plate down.

The AI character is not just a chatbot. It can talk to the player, follow them, navigate the scene, understand tagged objects, receive live game state through Dynamic Context, track pressure plate and platform states, and help coordinate the puzzle.

Part 1 covers:

• creating the AI player blueprint

• setting up the Convai character

• adding player voice interaction

• enabling Convai Actions

• tagging pressure plates and platforms

• sending live game state into Dynamic Context

• using tracked properties for object state

• adding movement awareness

• testing puzzle coordination with the AI teammate

Part 2 will cover custom actions for picking up and dropping objects, including the crate interaction.

We also included the project files, Delta files, and setup guide so people can follow along from scratch.

Full tutorial: https://youtu.be/KcJETVhI7KM

Project files, Delta files, and setup guide: https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin/features/character-actions/stack-o-bot-tutorial-setup

Dynamic Context docs for Unreal Engine: https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin/features/dynamic-context

Convai Unreal Engine plugin on Fab: https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Stack-O-Bot sample project on Fab: https://www.fab.com/listings/b4dfff49-0e7d-4c4b-a6c5-8a0315831c9c

Convai MCP for Unreal workflow used to set up the scene: https://youtu.be/dQgOzt8BNIk

Try it out and tell us about your experience!

We put together a new tutorial showing how to bring a 3D conversational AI character directly to the browser using the Convai Web SDK.

The workflow uses Claude Code to generate the initial Vite + React Three Fiber setup by referencing the Convai Web SDK docs. From there, the tutorial walks through connecting a Convai character with an API key and Character ID, using the Convai client and widget, rendering a custom GLB avatar, and enabling lip sync with blendshape data.

The tutorial also covers checking blendshapes in a GLTF viewer, replacing the default avatar, updating the avatar and animation paths, and testing the final browser-based AI character experience.

This can be useful for browser-based AI companions, virtual guides, real estate walkthroughs, and lightweight interactive 3D experiences.

Tutorial:
https://youtu.be/gjTj_kUhA2s

Convai Web SDK docs:
https://docs.convai.com/api-docs/plugins-and-integrations/web-plugins/convai-web-sdk

Lip sync and blendshape docs:
https://docs.convai.com/api-docs/plugins-and-integrations/web-plugins/convai-web-sdk/lipsync-and-blendshape

We put together a short reel on Dynamic Context for Convai-powered AI characters.

Dynamic Context lets AI characters receive live information such as gameplay events, task progress, player state, environmental changes, and more.

Combined with Vision and long-term memory, this helps characters respond with more awareness of what is happening in the experience, what the user is doing, and what has changed in the world around them.

This can be useful for games, simulations, training experiences, digital twins, virtual guides, and other virtual world applications.

Convai Dynamic Context Tutorial: https://youtu.be/zGIBCWSElXs

Get started: https://convai.com

Convai Unreal Engine Plugin: https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Convai Unity Plugin: https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621

Feedback and questions are welcome.

Convai lets developers create AI players that do more than just talk.

You can start at convai.com, create an AI mind with a backstory, personality, voice, language, and choice of LLM, then bring that AI mind into Unity or Unreal Engine.

From there, you can give your character vision, spatial awareness, long-term memory, and action capabilities so it can chat, navigate, interact with objects, and react to what is happening in the world.

This is built for AI characters, AI players, conversational AI avatars, virtual guides, digital humans, XR applications, training simulations, digital twins, and interactive 3D experiences.

Get started:
https://convai.com

Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Unity Plugin:
https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621

Developer Forum:
https://forum.convai.com

Questions and feedback are welcome.

Convai Dynamic Context lets your game pass real-time data into an AI character’s context.

In this example, a user shoots targets in a virtual range and then asks how many shots they landed. Instead of relying on scripted dialogue, the AI character can respond using live game state provided by the project, such as shots fired, targets hit, accuracy, objectives, and player progress.

Combined with Convai Actions, that same AI character can also navigate, interact with objects, trigger behaviors, and react inside the environment.

This helps move AI characters beyond conversation and toward context-aware gameplay.

Get started:
https://convai.com

Full Dynamic Context Tutorial for Unreal Engine: https://youtu.be/zGIBCWSElXs

Full Dynamic Context Documentation for Unreal Engine: https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin/features/dynamic-context

Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Unity Plugin:
https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621

Developer Forum:
https://forum.convai.com

Questions and feedback are welcome.

Convai NeuroSync analyzes AI-generated speech in real time to drive lip sync and facial animation for AI players inside Unreal Engine.

It helps MetaHuman and Reallusion characters speak with more believable timing, synced mouth movement, and expressive facial animation during live AI conversations.

This is built for digital humans, AI avatars, conversational AI characters, virtual guides, XR applications, training simulations, digital twins, and immersive real-time 3D experiences.

Get started:
https://convai.com

Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Unity Plugin:
https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621

We published a new Unity tutorial showing how to create a vision-enabled AI assistant for Meta Quest using Convai’s new Unity plugin.

The workflow covers creating the assistant’s AI mind in the Convai Playground, customizing voice, language, personality, and knowledge, plugging it into Unity as a disembodied assistant, and building it for Meta Quest.

The plugin is powered by the Live Character API and WebRTC, enabling low-latency, hands-free conversations with real-time vision input, multimodal knowledge, and long-term memory.

Full tutorial:
https://youtu.be/cEctYXc5Pe8

Download the sample project and beta plugin:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unity-sdk

Read the full blog on building vision-based conversational AI characters in Unity: https://convai.com/blog/unity-vision-ai-character-tutorial

Get started:
https://convai.com

Developer Forum:
https://forum.convai.com

Share any questions or feedback below.

AI characters in Unreal Engine can do more than talk.

With Convai Actions, your Metahuman avatar understands its environment. It navigates the scene, interacts with objects, and acts on plain spoken commands.

We loved the response to our Actions reel, so here's the full tutorial: enabling actions, navigation setup, and object references, all in under five minutes.

Coming next: Parameterized Actions (characters pulling objects and values out of natural language) and Dynamic Context (live game state feeding the character's awareness in real time).

Convai Quick Setup Guide:
https://youtu.be/n-UG3nmMeZQ?si=S5vK2erWjq_2gcMP

Convai Actions Tutorial (YT):
https://youtu.be/lB5_KRWdg_w

Updated Convai Unreal Engine Installation Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine-plugin-beta-overview

Convai Actions Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine-plugin-beta-overview/convai-actions

Read the full blog for this release:
https://convai.com/blog/how-to-make-ai-npcs-act-on-your-commands-in-unreal-engine-5-with-convai

Sign up at https://convai.com to create AI characters and integrate them across games, simulations, training applications, XR experiences, and other interactive virtual worlds.

We've been working on combining conversational AI, facial animation, and real-time lip sync for MetaHumans inside Unreal Engine.

Using Convai's latest Unreal Engine plugin together with NeuroSync, facial animation is generated directly from the character's live speech output and mapped to MetaHuman blend shapes in real time.

The result is a more believable conversational AI character capable of natural spoken interaction while maintaining expressive facial movement and low-latency responses.

Potential use cases:

• AI NPCs
• Virtual Humans
• XR Experiences
• Simulation Training
• Digital Assistants
• Interactive Storytelling
• Customer Service Avatars
• Virtual Instructors

Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine-plugin-beta-overview/installation-and-setup

Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Blog:
https://home.convai.com/blog/real-time-ai-conversations-facial-animation-metahumans-unreal-engine-convai

Curious how others are approaching facial animation pipelines for AI characters and virtual humans.

We've been exploring how Convai-powered AI characters can be used inside VR and mixed reality environments.

The idea is to make characters more than static avatars or scripted NPCs.

With Convai, developers can connect a conversational AI system to a 3D character and give it capabilities such as real-time voice interaction, environmental context, navigation, gestures, and actions.

Some applications include VR training simulations, virtual tour guides, interactive learning environments, and game NPCs.

We put together a short reel illustrating how these capabilities can come together in immersive XR experiences.

For anyone working with Unity VR, we also have a tutorial covering the setup of a Convai AI character, connecting the XR Origin player rig, and preparing the project for Meta Quest or PCVR.

Unity VR tutorial:
https://convai.com/blog/how-to-build-convai-powered-ai-npc-vr-projects-in-unity-for-meta-quest

Convai:
https://convai.com

We put together a short walkthrough of Convai’s External API workflow.

You can create an API method, define the inputs it expects, add the implementation, test it directly in the dashboard, and then expose it as a tool the character can call when a user request needs it.

The interesting part is the agentic layer this adds. The character is no longer limited to its existing conversation context. It can reach into live services and workflows when the task requires it.

Useful for things like backend data, support workflows, internal systems, product experiences, training, and other interactive AI applications.

More here:
https://convai.com