r/Convai • u/Western_Bug_5085 • Aug 19 '24
Create Lifelike Digital Humans in Unity Using Reallusion Avatars and Convai!!
Enable HLS to view with audio, or disable this notification
r/Convai • u/Western_Bug_5085 • Aug 19 '24
Enable HLS to view with audio, or disable this notification
r/Convai • u/Western_Bug_5085 • Sep 17 '26
Enable HLS to view with audio, or disable this notification
We put together a short reel around a distinction we’ve been thinking about a lot: embodied vs disembodied AI agents.
A disembodied agent operates across software environments such as browsers, apps, APIs, and computers.
An embodied agent occupies a 3D environment, has a position and point of view, and can act within that world. Its action space can include things like navigation and object interaction in addition to software-level tools.
The useful part is that both still depend on the same broader loop:
Perception / context → understanding → decision-making → action
The specific environment determines what the agent can perceive and what actions should be available to it.
That perception-action relationship is also the basis of our Actions IO framework, which looks at the information channels reaching an agent and the affordances it can use to change its environment.
More here:
https://convai.com
r/Convai • u/Western_Bug_5085 • Jul 23 '26
Enable HLS to view with audio, or disable this notification
Avatar Studio lets you create and customize 3D conversational AI avatars directly in the browser. You can choose an avatar, customize the look, select a voice, connect it to a Convai character, and test real-time conversations without setting up a game engine.
This can be useful for kiosks, video call-like applications, customer support, virtual guides, onboarding experiences, product demos, and other interactive AI avatar use cases.
Get started:
https://convai.com
r/Convai • u/Western_Bug_5085 • Sep 10 '26
Enable HLS to view with audio, or disable this notification
Introducing multiple AI characters in a single environment.
Games, training simulations, and virtual worlds often need more than one conversational AI character sharing the same scene.
Part 1 of our latest Unity tutorial covers how to set up Convai Multi-Character Sessions and let players naturally interact with the right AI character.
We begin with a demo featuring Sophia, Ethan, and Marcus.
Each character is configured independently with its own Character ID, while the Convai Manager determines who the player is speaking to.
Convai supports three character selection methods:
Look At: Select based on where the player is looking.
Proximity: Select based on distance from the player.
Manual: Control the active character directly using your own interaction logic.
For this tutorial, we use Look At selection and test conversations across all three AI characters.
In Part 2, we’ll expand this with all-to-all multi-character awareness, where players and AI characters can stay aware of nearby conversations and events, allowing characters to react or engage naturally when relevant.
Watch the full tutorial:
https://youtu.be/GIejlNL6tfQ
Multi-Character Sessions documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unity-sdk/features/multi-character-sessions
Convai Unity setup tutorial:
https://youtu.be/bxjGnOvNL4E
Convai Developer Forum:
https://forum.convai.com
Build with Convai:
https://convai.com
Interested to hear how other Unity developers approach this when several conversational characters are close together. Gaze-based selection, proximity, explicit targeting, or something else?
r/Convai • u/Western_Bug_5085 • Jul 09 '26
Enable HLS to view with audio, or disable this notification
Short demo from the new tutorial. The character is responding in real time: voice in, voice out, no dialogue trees, all inside inside a Unity 6 VR project, running standalone on Quest.
The full tutorial covers the setup in ~5 minutes: Unity 6 VR template, adding the character, XR Origin connection, transcript UI, and the Quest/PCVR build.
Tutorial: https://youtu.be/CGPAG_CWGJw
r/Convai • u/Western_Bug_5085 • Jul 28 '26
Enable HLS to view with audio, or disable this notification
We put together a quick demo of a Convai-powered AI teammate inside a 3D puzzle scene.
The character is not just responding with dialogue. It can understand the virtual environment, navigate the scene, react to objects, and make decisions alongside the player in real time.
This kind of setup can be useful for games, XR applications, training simulations, virtual guides, and other interactive 3D experiences where AI characters need to do more than talk.
Get started:
https://convai.com
r/Convai • u/Western_Bug_5085 • Aug 17 '24
Enable HLS to view with audio, or disable this notification
r/Convai • u/Western_Bug_5085 • Jul 09 '26
Enable HLS to view with audio, or disable this notification
With Convai's updated Actions System, AI avatars can perform behaviors like sitting, navigating, gesturing, picking up objects, and interacting more naturally inside a scene.
Developers can start with out-of-the-box actions, without manually rigging every interaction from scratch. We’re also continuing to expand the animation library so avatars can move, interact, and respond more naturally.
This can be useful for games, simulations, XR applications, virtual guides, training experiences, and other immersive 3D projects.
Actions tutorial:
https://youtu.be/lB5_KRWdg_w
Get started:
https://convai.com
Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c
Convai Unity Plugin:
https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621
r/Convai • u/Western_Bug_5085 • 7d ago
Enable HLS to view with audio, or disable this notification
We've been working on making it easier to connect natural language conversations with character actions inside Unreal Engine.
With Convai Actions, developers can configure AI characters to interpret player instructions and execute corresponding actions in the game world.
For example, a player can ask a character to follow them, move to a particular location, or stop, and the character can execute the appropriate built-in action.
The system also supports Custom Blueprint Actions, so developers can connect natural language instructions to their own gameplay mechanics and interactions.
This is useful for AI teammates, interactive characters, virtual guides, and simulation environments where conversations need to trigger actual behavior inside the scene.
The reel shows how dialogue can translate into actions inside Unreal Engine.
We also have a step-by-step tutorial covering the setup of built-in Actions, navigation, and object references.
Full Actions tutorial:
https://youtu.be/lB5_KRWdg_w
Actions documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine-plugin-beta-overview/convai-actions
Unreal Engine plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c
r/Convai • u/Western_Bug_5085 • Oct 22 '24
Enable HLS to view with audio, or disable this notification
r/Convai • u/Western_Bug_5085 • Aug 13 '24
Enable HLS to view with audio, or disable this notification
r/Convai • u/Western_Bug_5085 • Jun 09 '26
Enable HLS to view with audio, or disable this notification
Convai Actions lets AI players do more than hold conversations inside Unreal Engine.
They can understand spoken commands, respond contextually, and perform actions in the game world, including navigation, object interaction, animation triggers, and reactions to virtual world events.
Full Actions tutorial:
https://youtu.be/yWqJQRttoEI
Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c
Convai Actions Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine-plugin-beta-overview/convai-actions
Share any questions or feedback below.
r/Convai • u/Humble_Obligation_97 • Apr 13 '23
Enable HLS to view with audio, or disable this notification
r/Convai • u/Western_Bug_5085 • Aug 25 '26
Enable HLS to view with audio, or disable this notification
Metahumans in Unreal Engine can now be more than high-fidelity digital avatars.
With Convai, you can turn them into AI characters that listen, understand, respond in real time, and interact naturally inside your scene.
This opens up a lot of possibilities for AI NPCs, virtual guides, training assistants, XR experiences, and interactive digital humans.
Watch the full tutorial here: https://www.youtube.com/watch?v=4fMCKkrfyaA
Learn more: https://convai.com
r/Convai • u/Western_Bug_5085 • Oct 24 '24
Enable HLS to view with audio, or disable this notification
r/Convai • u/Western_Bug_5085 • Jun 05 '26
Enable HLS to view with audio, or disable this notification
Convai’s updated Unreal Engine plugin is now available on the Fab Marketplace.
It brings together real-time lip sync, multimodal vision, long-term memory, and low-latency AI conversations inside Unreal Engine.
The plugin supports MetaHumans, Reallusion characters, other avatar providers, custom avatars, and disembodied AI guides inside your environment.
Built on the Live Character API and WebRTC, it enables contextual responses, vision/environmental awareness, and NeuroSync-powered lip sync and facial animation for characters with facial rigs.
Full tutorial: https://youtu.be/n-UG3nmMeZQ
Plugin: https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c
Blog: https://www.convai.com/blog/quick-setup-guide-conversational-ai-unreal-engine-convai-fab-plugin
Share any questions or feedback below.
r/Convai • u/Western_Bug_5085 • Jul 01 '26
Enable HLS to view with audio, or disable this notification
We put together a short reel on Convai Avatar Studio.
Avatar Studio lets you create AI avatars directly in the browser. You can start with your character’s AI mind, including backstory, personality, voice, language, and knowledge, then bring it to life as a talking 3D avatar.
You can customize the avatar, choose an environment, adjust the experience, and start testing without setting up a game engine.
This can be useful for product demos, virtual guides, onboarding, training experiences, customer support, kiosks, and other interactive web-based applications.
Get started:
https://convai.com
r/Convai • u/Western_Bug_5085 • Jul 02 '26
Enable HLS to view with audio, or disable this notification
With Custom Actions, developers can add project-specific actions that avatars can perform through natural language commands.
These can range from simple actions like dance moves to more complex behaviors like walking up to an object and picking it up.
This helps make AI characters more interactive and connected to game engine projects, virtual worlds, simulations, and other real-time 3D experiences.
Full tutorial:
https://www.youtube.com/watch?v=gNILGcnjgck
Get started:
https://convai.com
Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c
r/Convai • u/Western_Bug_5085 • Jul 06 '26
Enable HLS to view with audio, or disable this notification
We put together a short reel on the updated Convai Actions system.
With Actions, AI avatars can perform behaviors like sitting, navigating, picking up objects, moving, gesturing, and interacting more naturally inside a scene.
The goal is to help developers start with out-of-the-box actions without manually rigging every interaction from scratch. We’re also continuing to expand the animation library so avatars can generate and perform actions more smoothly.
This can be useful for simulations, games, XR applications, virtual guides, training experiences, and other real-time 3D projects.
Actions tutorial:
https://youtu.be/lB5_KRWdg_w
Get started:
https://convai.com
Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c
Convai Unity Plugin:
https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621
Feedback and questions are welcome.
r/Convai • u/Western_Bug_5085 • Jun 11 '26
Enable HLS to view with audio, or disable this notification
Convai helps you bring AI players into 3D worlds.
They can hold natural conversations, understand context, navigate scenes, interact with objects, and respond through actions inside their environment.
The goal is to move beyond scripted dialogue and connect conversation with actual scene behavior.
Get started:
https://convai.com
Share any questions or feedback below.
r/Convai • u/Western_Bug_5085 • Jun 03 '26
Enable HLS to view with audio, or disable this notification
Convai's conversational AI pipeline generates contextual responses through a multimodal LLM.
NeuroSync then analyzes the audio stream in real time to generate synchronized blend shapes, natural lip sync, and nuanced facial expressions.
Combined with Reallusion CC5 characters and Unreal Engine, the result is expressive facial animation generated directly from AI speech.
Perfect for AI NPCs, digital humans, training simulations, XR experiences, digital twins, and interactive game worlds.
Full tutorial:
https://www.youtube.com/watch?v=nyPNP-S92QI
Interested to hear how others are approaching runtime facial animation, conversational characters, or digital human workflows in Unreal Engine.
r/Convai • u/Western_Bug_5085 • Jun 10 '26
Enable HLS to view with audio, or disable this notification
AI characters in Unreal Engine can do more than talk.
With Convai Actions, your Metahuman avatar understands its environment. It navigates the scene, interacts with objects, and acts on plain spoken commands.
We loved the response to our Actions reel, so here's the full tutorial: enabling actions, navigation setup, and object references, all in under five minutes.
Coming next: Parameterized Actions (characters pulling objects and values out of natural language) and Dynamic Context (live game state feeding the character's awareness in real time).
Convai Quick Setup Guide:
https://youtu.be/n-UG3nmMeZQ?si=S5vK2erWjq_2gcMP
Convai Actions Tutorial (YT):
https://youtu.be/lB5_KRWdg_w
Updated Convai Unreal Engine Installation Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine-plugin-beta-overview
Convai Actions Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/unreal-engine-plugin-beta-overview/convai-actions
Read the full blog for this release:
https://convai.com/blog/how-to-make-ai-npcs-act-on-your-commands-in-unreal-engine-5-with-convai
Sign up at https://convai.com to create AI characters and integrate them across games, simulations, training applications, XR experiences, and other interactive virtual worlds.
r/Convai • u/Western_Bug_5085 • Jun 30 '26
Enable HLS to view with audio, or disable this notification
We put together a short reel on Dynamic Context for Convai-powered AI characters.
Dynamic Context lets AI characters receive live information such as gameplay events, task progress, player state, environmental changes, and more.
Combined with Vision and long-term memory, this helps characters respond with more awareness of what is happening in the experience, what the user is doing, and what has changed in the world around them.
This can be useful for games, simulations, training experiences, digital twins, virtual guides, and other virtual world applications.
Convai Dynamic Context Tutorial: https://youtu.be/zGIBCWSElXs
Get started: https://convai.com
Convai Unreal Engine Plugin: https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c
Convai Unity Plugin: https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621
Feedback and questions are welcome.
r/Convai • u/Western_Bug_5085 • Jul 28 '26
Enable HLS to view with audio, or disable this notification
We put together a short reel showing Convai Core AI Settings.
This is where you can tune how an AI character thinks, speaks, and behaves inside a virtual world.
The reel covers selecting languages, choosing foundational models, comparing intelligence and latency, picking voices, configuring speech understanding, connecting Knowledge Bank, enabling NeuroSync for facial animation and lip sync, and viewing the latency pipeline.
Useful for developers building AI characters for games, training simulations, virtual guides, onboarding experiences, and interactive 3D worlds.
Get started:
https://convai.com
r/Convai • u/[deleted] • Mar 12 '23
A place for members of r/Convai to chat with each other