Location-aware AI characters in Augmented Reality (AR) | Convai Unity Tutorial

Подписаться 4,3 тыс.

Просмотров 6 тыс.

50% 1

In this structured guide, we'll show you how you can integrate Convai-powered AI NPCs for an immersive augmented reality (AR) experience! This guide will help you bring your characters to life with AI, enabling natural conversations and interactions. AI NPCs in an Augmented Reality app can be connected with real-world location-aware knowledge, AR games and so much more.
Use it for augmented reality(AR), mixed reality(MR), or any XR projects. Should work for Android-based setups (e.g. android phones, Meta Quest 3, or any Android XR devices), and iOS/Vision Pro coming soon!
Convai plugin for Unity: docs.convai.com/api-docs/plug...
Convai AR Documentation: docs.convai.com/api-docs/plug...
Unity Pathway Project: learn.unity.com/project/creat...
Subscribe for upcoming demos and tutorials, and join our Discord channel for support. / discord
Sign up at convai.com to try it out.
Write to us at support@convai.com for any queries, bug reports, collab, or business-related engagement.
Chapters:
0:00 Intro
0:33 Getting Started with Convai for Unity AR
1:05 Automatic Set-Up for Convai AR
3:15 Build AR Project with Automatic Set-Up
3:52 Manual Set-Up for Convai AR
7:03 Build AR Project with Manual Set-Up
7:29 Outro
Follow us on your favorite platforms to stay in touch:
Discord: / discord
LinkedIn: / convaitech
Reddit: / convai
Twitter: / convaitech
Instagram: / conv.ai
Facebook: / convaiofficial
TikTok: / conv.ai
ArtStation: www.artstation.com/convai

Опубликовано:

22 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 38

@imblakehotz 5 месяцев назад

Oh hell yes!!! Well done my friends!! I cannot wait to test this!!

@carlo.riente 5 месяцев назад

Really Cool !

@OmarMaciasarevalo Месяц назад

wow, I congratulate you, excellent work, this opens my mind to develop great ideas, thanks for sharing the tutorial

@AL3DStudio Месяц назад

Awesome!!

@convai Месяц назад

We're glad you like it!

@AL3DStudio Месяц назад

@@convai but I do have problems with my avatar being too small and too far away but the best part about the video was you were in the street with Google Maps working that’s what I wanted to say. Can you please do a tutorial and show that right to the end where it’s working like you had it in the video? Thank you.

@imamupayanto 5 месяцев назад

Wow, this is exactly what I needed!

@convai 5 месяцев назад

Glad it helped! Feel free to join the discord channel in description for any help. :)

@fedisalhi911 5 месяцев назад

ty for the video 🥰🥰, but can u make a tutorial about how to make my character that i created using blender to do this ?

@insomniac7532 Месяц назад

well done! can this be modified to work for web AR projects as well or not yet?

@user-lk9yg5yu3t 4 месяца назад

Hi, the base avatar works fine. But how do I change the Amy avatar with another CC4 character? When I imported an FBX clothed character of another avatar , the mesh loads but its just in a static T-Pose and cannot talk. Could you help on this?

@adriangarces91 2 месяца назад

Me pasa lo mismo

@TronikXR 4 месяца назад

Is there anyway to use this feature with the WebGL SDK?

@nicolasportu Месяц назад

I spent a lot of time sending Avatars to WebGL and that just do not worth the time... The latency and time to load is awfull. R3F or Three J's is a better option definitely.

@Iamnotheretocompete День назад

will the character identify the current location as shown in the start, as the tutorial a different example

@natgeo1416 5 месяцев назад

amazing!! wish it was on unreal

@convai 5 месяцев назад

Here's a tutorial for doing in in Unreal Engine for VR - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-HHhkBd6NOlo.htmlsi=C2rNfwE_ML1PJ52_ Should give you a path to do it for AR as well. Happy Building! :)

@7sdrgn 2 месяца назад

HI there Convai , I tried to build for apple and It seems like impossible ..? is it available to be built on IOS operating system or Not ( regarding the AR package + Convai).

@convai 2 месяца назад

Hello @m7mdrf3t, We are excited to announce that we will release iOS Support in our next update. If you need any help, feel free to join our Discord server. We will be happy to help you. discord.gg/Tm9b3FWFJG

@7sdrgn 2 месяца назад

Thanks for response, hope you are doing well ✌️

@user-gy2mv3xh2g 4 месяца назад

Can you please do it UE?

@tonywhite4476 19 дней назад

tested this with a couple issues, first the avatar was very small and it was not aware of it's surrounding. Is there some kind of gps script I'm missing?

@convai 19 дней назад

Hello tonywhite4476, Thank you for using Convai. It is up to the user to set the character size. We explain how to do this in our documentation. Documentation Link: docs.convai.com/api-docs/plugins-and-integrations/unity-plugin/building-for-supported-platforms/building-for-ar#how-to-add-and-adjust-size-of-my-own-character You need to provide information to the character about the environment. You can do this by uploading the necessary details to the Backstory and Knowledge Bank. If you want it to be dynamic, you will need to use extra SDKs and pass it to the character dynamically. If you have any further questions, feel free to ask!

@tonywhite4476 13 дней назад

@@convai Then the video is kinda misleading, right? Maybe in the future we could integrate Google Maps and other SDKs right from the convai playground. I think is a great program though. I'm also testing InWorld in Unity. They both have pros and cons.

@ckjames238 5 месяцев назад

Will there be an Unreal plugin?

@convai 5 месяцев назад

Yes Android is already supported on the Unreal Engine plugin. Docs: docs.convai.com/api-docs/plugins-and-integrations/unreal-engine/supported-platforms UE Plugin: www.unrealengine.com/marketplace/en-US/product/convai

@123thebestmusic 5 месяцев назад

now make a video to create the app on ios please 🤞I want to do this to be able to see with my apple vision pro and be able to create any character cloning the voice with eleven labs this would be the beginning of something big

@convai 5 месяцев назад

Hey there! It's so great to see your enthusiasm! I have some exciting news to share with you. We've started developing VisionOS and we can't wait to keep you updated on all the latest developments. To stay in the loop, I recommend joining our Discord server and following us for all the latest announcements.

@sridharansivacoumar9549 24 дня назад

Will Convai work in Hololens?

@convai 19 дней назад

Hello sridharansivacoumar9549, Thank you for using Convai. Currently, we do not have official support for Hololens. It will be added in future updates. Please follow our Discord channel for updates. discord.gg/Tm9b3FWFJG