Conversational AI in Unreal Engine Quick Setup Guide | MetaHumans, ReadyPlayerMe, and more | Convai 

📌HEADS UP!: We've removed basic lip-sync from recent plugin versions. Learn how to add lip-sync to your MetaHuman or Reallusion characters by following the steps in this guide: docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/guides/creating-metahuman-characters/adding-lipsync-to-metahuman-from-plugin-version-3.0.0-or-later. Don't miss out!

Works perfectly in 5.2 as well! I made a project in 5.1 and opened a copy of that project in 5.2.

Always waiting for new features and updates! Keep going convai you guys and your developments are great!

absolutely great, works perfect, every new game should have npcs like this

Honestly just waiting for an ElevenLabs API plugin for our own voices and everything will be complete. Also Android for the Convai Plugin lol

I hope you will have more views, likes, and attention in the future. You are such a revolution maker 👍👍

Helpfull tutorial, thanks a lot! Very cool! Though I would recommend people to back-up their project up front since putting back the class settings to character is pretty difficult. In overall very happy with the result! Awesome feature.

This is awesome, would be great to see these NPCs trained by developers for more unique and robust interactions. I know there's definitely competition in the NPC-AI space with InWorld. It's great to see all the technology coming out, hope to the audio quality improves to be more natural (like Spotify's DJ AI).

This is the future can’t wait for the voice to action tutorial grabbing weapons and cooperate in a fps situation

the amount of stupid questons asked here by supposed developers makes me feel alot better about myself thanks

Awesome! I can't wait to try this out.

i would love to see convai and elevenlabs do a colab

@6:34 _"If you have your own player class, you can inherit the components from this class into your own blueprint, we cover this more in our tutorials that take a deep dive into this functionality."_

Just tried it Awesome work. For Me it seems I have to put a 200 to 300 ms delay in the voice 0utput to get in sync. How would i implement? maybe a new video?

this is AMAZING ! i like this plugin and I want to learn as soon as possible!

how can i remove the chatbox, when the player is not nerby?

Any idea how to change the microphone source in Unreal Engine? My voice doesn't get picked up, I had the same problem in Firefox, but I selected a different source and it worked. Also, I'm using Unreal Engine 5.2 so maybe that is the problem? Everything else works great. Edit: Found it, press F10. It works now :)

I am trying to implement a convai npc but when I am adding walking animations to the npc, it is going inside the ground while following the player and it's happening probably cause of floating pawn movement. Any fixes to this?

Hi there. This is epic! Great tutorial and so easy to follow. I'm needing a few talking AI characters for a game I'm working on. So, all I really need are some modular characters from the Marketplace and this free Plugin? You provide the animations etc?

Hi, is it possible to also type in case player does not use a mic? Also, is the update for 5.2 coming? Keep up the great work! :)

I nees help it says something went wrong and check the output logs

Well, this is frustrating, never fails I follow step by step instructions, and then I come to a part where I don't have an option or setting shown in the tutorial, either I missed something that was glossed over or something's changed in the process and I don't have the updated process. I get to the point where you are creating the blueprint, I noticed that when you say "inherit" you're blueprint becomes a pawn, but when I click on the same option, mines becomes a face, and instead of a box I see a cylinder. When i go over to the character to look for the char ID I don't see it at all. Was there a specific way I'm supposed to select the convai base player, because whenever I click on it, it stays as the face, so I don't know if that's what the issue is. But I'm on 5.01 (my 5.1 isn't working which is another issue altogether) but I should in theory be able to do this in 5.0 correct? I'm not seeing the Char ID field anywhere though....

For me the lip sync is working but not the gestures ( body movements )

Great tutorial! Thanks! How can I speak without the need to press a button? Is it possible? Thanks!

what about giving him a quest? and have player talk to him with text like preset responses , like an rpg game, how do i tell the AI what role he will handle in the game and what he will respond to the player ?

Fantastic, thank you. I cant seem to get the mouth to move on my Metahuman. Tried a custom character and a default and neither seem to work

you are smart and done amazing work!

Hey guys. I had success when creating a new project, but am having issues whed adding a metahuman into my existing project. Character looks good, but I don’t see the Talk Window that usually pops up. I've added the two lines of text in the .ini file also. Don't I need to add other files to tell my project what to do when I hit the T button to talk? I followed your tutorials, but these are only for new projects aren't they? The convai plugin is good to go also. I have only pasted the Content folder from the Convai folder into my project. Don't we need the other folders also?

ANy chance for a redo of this one for 5.3 , including maybe a bit more detail on the Metahuman import aspect ? love sent.

Hi, I tried to follow this tutorial on MacOS, but when it comes to testing it around minute 4, when I press T nothing happens. Any idea why?

3:45 how do you do this when you already have an existing player character that relies on it's parent class?

how can i interact with the npc's without changing my player settings? changing my player blue print class breaks a lot of the interactions i already have set up, like grabbing a flashlight or working a door... is there a workaround?

tried for hours follwed every word, nothing.

Incredible !

THis is so cool! Can be used in a different language or it can only be used in English?

Awesome easy to follow tutorial. Although mine fails and gives off a error. lol

Fascinating. Is there a possibility to change their behavior on the fly depending on certain values? For exemple have a good standing system affected by a player's actions that would impact how obedient or polite the AI is.

This does not work I don't know if this needs to be updated I don't know if you change the 5.4 but this simply does not work

I don't understand I follow the protocol to the letter it worked before but since the unreal 5.1.1 update it no longer works

I couldn't login to the Quixel Bridge on UE5. Seems like many people are having the same issues☹

I came here trying to learn how to upload my own voices to the character. This is the closest title I've found to what I'm looking for, but it still doesn't answer my question.

How do i get them to follow me. This doesn't seem to work as explained above anymore. I see there is a reference action, but I am not sure how I would get him to follow a spawned character

when i change the parent class on third person character i lost all inputs. The character and camera dont move. UE5.1

It works but for some reason my metahuman keeps staring at the floor when I come near

it only works with first person template? Is there any tutorial to TPC?

To use this ai... Need to change character to convai base player... But if i want to use character how so?

i cant find the character id on unreal i have the id but i cant find where to put it??

Is the AI limited to the characters backstory or can it find information it needs and fill in any gaps? for example if you set it as a historical character, could it scrape the internet to find information it needs?

After getting this all sorted, would it be much more work to replace the mesh with my own, it has no mouth component, I'm fine with only the audio and the animations

can this plugin be used to trigger events and not only talk to ai ? for example, when i say a certain phrase (for example "start fire", that will trigger an event somewhere in the world, and a fire will appear in a certain location.

In the creation of brueplints I do not have a convai character I need help and that I followed the step by step someone else happens I need help please

does the player have to be online for the ai to work?

Would the AI NPC be able to talk offline? Like in a single player game?

Can this be used with your own characters as I have a vampire girl character I purchased off epic market place

command follow me not works in metahuman character

I'm already using parent from another plugin for PlayerCharacter, how to i add canvai features to a player without setting a parent?

Teach me please. Metahumans I created There is no default for details, and Convai's CharID cannot be entered. What should I do?

Is there anyway to use the NPC in a 3dps game as an enemy?

Hi there ! Nice, how can we use that with a non metahuman skeleton ? thanks !

Can we integrate our custom STT and TTS api

Can I implement chatgpt with this?

"Hi, is it possible to package a project in Unreal Engine? And how, please? Thank you very much!"

How can i hide the talk box

Until languages other than English are not supported - this will not be used on the market, since games are published with at least 3 languages localizations, and 8 on average.

can we just typing word in chat dialogue, not a voice

hi, Is it possible to make package project for windows? it gives me "failed" and does not specify the error :/ thanks

how do i interact with convai metahuman without changing the player's current parent class in class settings? Ive looked thru the ConvaiBasePlayer Blueprint as previously suggested but im not finding a solution. The Ai model is in game and doing the animations as the tutorial shows. My problem is im currently using horror engine on unreal engine 5.2, changing the parent class breaks everything already interactable. The T key is already mapped for another item. Ive searched google for your discord channel as well but only finding broken links.

Well done team Convai! Love your work. I tested it out today and although not perfect, it was quite clever. Maybe I need to do some tweaking on my end and provide more information for the characters. They didn't always follow specific commands. Still good fun. Keep up the excellent work and look forward to what you bring to the table next. Exciting times! ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-1OgBy_mBVfs.html

in blueprint creation i dont have a convai character to choose did i do something wrong?

How to set"hould T to talk"

Hie how can i hide the talk menu when im not with a pnj

Azure TTS voices??

hi,when i create the blueprint class i only get convai environment and convai actioncontext

it is not working wit 5.2.1

nice. but u bond ur game to service of other company... and that never end well.

Wow

so complicated also you do everthing so fast that i cant follow i dont know how to use UE but i wanted to try setting up my caracter but you were going so fast and skiping a few basic steps that i didnt know about it. I wish there was a file that did all of this for me like plug and play just needed to insert the API keys.

Hello guys! When i try to open the newest convai metahuman demo project (where i think is the version can use your newest updated features) but when i try to open it i got an error about the convai OVRlipsync that is not supported by UE versions newer than 5.0 and im unable to get the 5.0 i just get the 5.0.3 and i cant open it because is made for a newer version but when i try in this or in the 5.1.1 i got the errors mentioned. UnrealEditor.exe - Entry Point Not Found.

the character does not follow me how to fix it?