Тёмный

Adding ChatGPT in Home Assistant for Natural Language Control of A Smart Home 

KPeyanski
Подписаться 28 тыс.
Просмотров 6 тыс.
50% 1

ESP32-S3-BOX-3 (AliExpress Affiliate) - s.click.aliexpress.com/e/_DDL...
M5Stack Atom Echo (Amazon Affiliate) - amzn.to/3F7C6fO
► MY ARTICLE ABOUT THAT TOPIC - peyanski.com/home-assistant-c...
► MY HOME ASSISTANT INSTALLATION METHODS FREE WEBINAR - automatelike.pro/webinar
► DOWNLOAD MY FREE SMART HOME GLOSSARY - automatelike.pro/glossary
► MY RECORDING GEAR
MAIN CAMERA: amzn.to/3UKinKV
MAIN CAMERA LENS: amzn.to/3yoR2X9
2ND ANGLE CAMERA: amzn.to/44KbVYX
2ND CAMER LENS: amzn.to/48bhxMZ
SD CARDS: amzn.to/3sT7fRy & amzn.to/3sS0wHu
MICROPHONE: amzn.to/466Kxne
BACKUP MIC: amzn.to/468BSkb
EDITING MACHINE: amzn.to/45LWdvS
► SUPPORT MY WORK
Paypal - www.paypal.me/kpeyanski
Patreon - / kpeyanski
Bitcoin - 1GnUtPEXaeCUVWdJxCfDaKkvcwf247akva
Revolut - revolut.me/kiriltk3x
Join this channel to get access to perks - / @kpeyanski
✅ Don't Forget to like 👍 comment ✍ and subscribe to my channel!
► MY ESP32-S3-BOX-3 VIDEO - • Local Voice Assistant ...
► MY M5 ATOM ECHO VIDEO - • Local Control of Home ...
► ADDING OPENAI CHATGPT AS CONVERSATION AGENT - www.home-assistant.io/integra...
► DISCLAIMER
Some of the links above are affiliate links. If you click on these links and purchase an item I will earn a small commission with no additional cost for you. Of course, you don’t have to do so in case you don’t want to support my work!

Хобби

Опубликовано:

 

18 июн 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 29   
@deadadam666
@deadadam666 Месяц назад
good video but i thought the point of using home assistant was to avoid relying on cloud products with horrifying security risks like llms
@KPeyanski
@KPeyanski Месяц назад
Home Assistant allow all options, Cloud, Local Only and Hybrid so you can do whatever you like. I will not use this Cloud AI on my main Home Assistant for now. This video is just for fun...
@arnoldbencz6886
@arnoldbencz6886 Месяц назад
@@KPeyanski Vobec ma to nepobavilo, sorry
@galdakaMusic
@galdakaMusic Месяц назад
Would be great all in local mode with two Rpi5. One of them for HAOS with SSD and Hailo 8L with Frigate and second one with Ollama server and AI kit. All in a special case with liquid refrigeration. May be would be possible in near future.
@KPeyanski
@KPeyanski Месяц назад
Sounds good indeed. And maybe that will be even possible on one device in the near future :)
@NicksStuff
@NicksStuff 22 дня назад
Wouldn't *one* fanless Intel N100 do all that for cheaper, while being more flexible, more powerful and more reliable (no water cooling)?
@MrDenisJoshua
@MrDenisJoshua Месяц назад
I just want to add Piper and it ask me a server address and port ... What I must put there please ? Thanks
@justlama0
@justlama0 2 дня назад
Is it possible to use homepods only like speakers and micro to build this system?
@l0gic23
@l0gic23 Месяц назад
Was hoping you would leverage that Fabric thing Network Chuck discussed... But yes, this was interesting and entertaining, thank you.
@KPeyanski
@KPeyanski Месяц назад
Thank you, didn't watched that video of Network Chuck
@l0gic23
@l0gic23 Месяц назад
@@KPeyanski worth the time investment I think.
@oj488
@oj488 Месяц назад
Hello sir, can you pls show me how to integrate MIPC cameras into home assistant
@rogeriocamargo1984
@rogeriocamargo1984 Месяц назад
Hi Kiril, good video! Do you think it is possible to run AI in local mode some day with Piper and Whisper, without using the internet? I'm saying this because I think it doesn't make sense to use the voice control over the internet since the philosophy of HA is to run locally.
@JoshFisher567
@JoshFisher567 Месяц назад
You can do that now. I use an integration I had to add to HACs names "extended OpenAI Conversation" and setup is the same but as long as you have a local LLM based on OpenAI with a URL, which all do, it's just a local one. You can point to it and just put in 1234 as the API key. Nabu Casa has also been working with Nvidia using one of their Jetson computers for local AI but they have to port stuff from x86/CPU based to GPU based processing. Some has been done, some hasn't. The problem with a local LLM right now is coats. Can you have HA work with an LLM and get fast response times? Yes, but you need an Nvidia GPU or response times can take up to 30 seconds or more when using anything CPU based depending on the question. Heck, you can install an LLM on Windows using Linux subsystem and have it work. Probably not ideal though. Honestly, I got my voice controls working, I can create timers and it can tell me the weather outside with no AI. That's honestly all I personally need from my voice assistant. I can open a web browser and type in a question if it's more complicated than that but I can see the appeal of an all in one local solution. I'm using an Espressif Korvo-1 as my voice assistant using micro wake word.
@KPeyanski
@KPeyanski Месяц назад
Yes, you can by using Ollama and I have a video tutorial. The only problem for now is that is in "read only" mode and it cannot turn on/off things yet, but I guess this will be fixed soon. Here is the link to my HA Ollama video - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-yp1IkUavVvc.html
@KPeyanski
@KPeyanski Месяц назад
@JoshFisher567 thanks for this comment it was informative!
@JoshFisher567
@JoshFisher567 Месяц назад
@@KPeyanski This can be done with the manually added repository to HACs. With that said, I have no idea what it takes to be an "official" HACs integration vs a native HA integration but I imagine lots of testing is involved. The extended OpenAI conversation integration makes you go into HACs and add it via the GitHub link. By default, it only exposes entities already exposed to voice assistants. It won't even answer general questions without some very minor changes. It can do some neat stuff like if you ask "how many lights are on" and it will tell you. There is a query you can change that allows you to control what can be sent to openAI. The issue is everything now goes to Open AI and paying for API calls to turn off lights and other minor stuff ads up. I set a 1 dollar limit and you can burn through that quickly. It still works perfectly although the repo doesn't appear to have been updated in a while. It also though it was smarter then me and when I tried to play a media player sometimes it would tell me it was already playing when it was paused. It did do some neat things like let me say "unpause media player" when I have no s eats or aliases using "unpause" I'm looking forward to local LLM's but right now it's just the cost issue and to the fact that it's in it's early stages but the guy who created HA said they are working on a LLM specifically for HA. Nvidia reached out to them because a lot of people at Nvidia use HA. Time will tell how that works out. Below are some of the features of the integration I'm talking about. I just don't trust anyone that mass collects data anymore, especially after all the stuff FB and Google among others has been caught doing, and how that data it's used. At least outside Apple but that's because of different business models used as apples main revenue stream is from hardware sales. In fact, Nvidia passed Apple and MS to become the world's largest company (3.3 trillion or somewhere around there). In January that was 2 trillion. Pretty insane that's all from AI and video cards seem to be taking a backseat for actual gamers. I'm just waiting to see how things pan out as things can change quickly, especially with new technology. Ability to call service of Home Assistant Ability to create automation Ability to get data from external API or web page Ability to retrieve state history of entities Option to pass the current user's name to OpenAI via the user message context
@NicksStuff
@NicksStuff 22 дня назад
Why show only examples where the condition is met? Does it work if you ask it to make you a coffee if it's before noon (if it's 1 PM)?
@KPeyanski
@KPeyanski 20 дней назад
yes, it does work if conditions are not met
@NightHawkATL
@NightHawkATL Месяц назад
Use Ollama locally. Wait for next month or so for them to allow local LLMs to control home assistant and then you can control it more.
@KPeyanski
@KPeyanski Месяц назад
Yes, I have a Home Assistant Ollama video as well - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-yp1IkUavVvc.html
@Buy_YT_Views.8677
@Buy_YT_Views.8677 Месяц назад
Can we get a round of applause?
@KPeyanski
@KPeyanski Месяц назад
Yes, we can, but why?
@avanaraveloson5017
@avanaraveloson5017 Месяц назад
Yes I'd be glad to see the Google generative ai intégration video
@KPeyanski
@KPeyanski Месяц назад
Noted & thanks for you comment. Was the OpenAI GPT integration interesting?
@avanaraveloson5017
@avanaraveloson5017 Месяц назад
@@KPeyanski Yes definitely interesting
@arnoldbencz6886
@arnoldbencz6886 Месяц назад
Hi. Nabu Casa should be a free application and not a paid one. He can do no more than an experienced homeassistant user! We have to pay for the fact that he uses the free GPT chat???
@KPeyanski
@KPeyanski Месяц назад
I’m not sure if I understand you correctly, but Nabu Casa subscription is optional you can subscribe or not it is not a must.
@arnoldbencz6886
@arnoldbencz6886 Месяц назад
@@KPeyanski That's clear to me, my friend. I just don't like the approach of the Nabu Casa itself to the homeassistant app! Well, that's just my opinion, sorry...
Далее
Free and Local AI in Home Assistant using Ollama
13:10
Elden Ring DLC - ПОДОЖГЛО ПОПУ!
07:26
Просмотров 492 тыс.
2DROTS vs WYLSACOM! КУБОК ФИФЕРОВ 1 ТУР
07:25
Adding Google Generative AI in Home Assistant for FUN
20:20
GPT-4o in a Smart Home with Josh.ai
5:41
Просмотров 7 тыс.
15 Home Assistant Tips You MUST Do
14:28
Просмотров 351 тыс.
AI Took Over My Smart Home (and how you can do it too)
15:51
How My New Smart Home Dashboard is GENIUS
9:00
Просмотров 147 тыс.
Perfect Entry Touchscreen Home Assistant Controls!
12:22
20 июля 2024 г.
0:58
Просмотров 2,7 млн
ТАТУ пришлось ПЕРЕКРАСИТЬ
0:20