Both will be possible! I'll address this in a Q&A video, but mmWave can be added easily since all the GPIOs are exposed and the future enclosures will give us mmWave too. Also, a PoE to USB-C adapter will be available.
Shout out from one of the Music Assistant devs. Great to see MA enabled products like these come to fruition. I would love to get my hands on one to start playing around with it🎉
@@FutureProofHomesdrywall ceiling is fairly common in many places around the word or at least all the places I’ve been living, but there might be some additional requirements regarding inset devices compared to US.
Sounds too good to be true.. I subscribed and will be waiting on new updates.. So far amazing job. Quick question? I know this is work in progress, but what's the chance of being able to integrate AI into the voice assistant?
Yes. The Sat1 will work with all of today's AI/LLM experiments. Set up a local LLM and connect it to HA (see HA's Ollama Integration) or use HA's OpenAI Conversation Integration to hook into ChatGPT (always be weary of connecting your home to any AI though, especially cloud based ones).
Hey congrats on your launch! This is some really exciting tech. It’s at times like this I wish I was a hardware dev but I look forward to creating dope software around this though 😁
Thanks @technithusiast! I'll send you one for review during private beta if you're interested? Hack away on it and push the thing to it's limit! You have my email. Cheers man!
very interesting, waiting for more updates about the hardware. one question, are you using nvidia jetson nano for home assistant and openAI ? the delay on the responses are very low, I am impress.
I running all forms of the AI pipeline in many places. What you witnessed in this particular video is me using the standard Home Assistant conversation agent (no AI) on standard server hardware (not Jetson).
This is going to be such an awesome kit. I love all the companies developing for a future-proof home. The market is really beginning to value products like this.
Thank you. Yes, I want FPH to be a full-blown consumer electronics startup for regular consumer electronics. It's a lofty goal, but that is where we're heading.
This looks really nice. Looking forward for what's to come in the future! Any reason you went with an ESP32 chip instead of something that could run on-board wake word like a Pi Zero? I know Micro Wake Word is now a thing but can an ESP32 do multi-room audio, audio ducking etc? Is it running ESPHome?
Our Hat board is compatible with RPI Zero. I’ll demo this in upcoming video. Basically we’re platform agnostic and this could be a great Wyoming Satellite too!
Great project, congrats! Would it be possible to program the Satellite to play the response/sounds on another, media player speaker also integrated in HA like Sonos for example? I have Sonos speakers in every room and two Sonos Amp, so I would like to use them.
Can you think of competing with Movi Audeme on this? It hasn't had an upgrade since 2017. Can the voice be tinkered with an oscilloscope. Still have it be able to work with an arduino, stm32, or rpi5? 😊😊😊
Looking forward to get the final consumer products😆!!! I know that's a little bit early but, Man, what you'v done is so cool and perfectly matchs my thoughts. I'm a software engeener also a fan of homelabing, but I have no idea about hardware things...I really need a stable product that has features like satellite1 to build my smart home. No joke, I'm planing pre install some cables (poe) on my new house celling for your products🤣. So keep going pls!!!
Have you made an initial estimation of the price, with the case, speaker etc? It might be worth to have two versions, one simple, (only speaker) and a second one with all the sencors/features, just for the sake of diversifying the product line (...just saying).
Congratulations on this!!! I do have a suggestion for gen 2… if you integrate POE into the board it would make a in ceiling option a lot easier and probably enable a longer longevity. I can’t imagine having to dig in a ceiling to replace a hidden 120 to usb adapter would be very fun. Yet having a cat5/6 dongle that has POE to it can remain dormant in the ceiling with no drawbacks.
Noice. On the waitlist. Just wondering, given the shape, would this maybe fit into a Google Nest mini shell? I'm guessing it's probably bigger though 🤔
Looks dope! Mostly commenting for the algorithm :) This is my first exposure to your channel but I've been hoping to migrate to home assistant from a Google Home setup, and the last thing I really need for a complete replacement is solid voice control. I used home automation for accessibility/assisting in managing a chronic health condition, and I'm really excited by the prospect of a private, self hosted system that still helps me in the way I'm used to with my google home setup! Really excited to see the eventual final product!
Looking forward to this! Glad you’re thinking of it as a music player - that’s a core piece of a voice assistant that many esp based devices aren’t supporting (yet). Would be a perfect device if you can add Spotify Connect functionality and/or chromecast audio. Keep up the good work on this device!
I am so looking forward to this. I had the exact same product idea 2 years ago but I lacked the experience to build it. I am even leaning into the idea that this should be standard in every future house!
If built with top notch hardware and software to give a flawless user-experience (will take years of R&D) I too believe this product would transform the common home.
Yes, audio playback is aiming to be best in industry. The Amp1 product will help us achieve this. See the roadmap on FPH website. Music playback is critical for me too. It's coming.
This is already so awesome. Really excited to see how this develops. I appreciate all the time and effort you have put into making this product. I think it has the potential to be huge. Especially if more sensors like PIR/mmwave are added. Great work demo and professional Brad.
First year or so is within the community. But I REALLY want to take HA and our suite of products out to average consumers in primary markets. To hit that goal we must build a great team and something very reliable and intuitive. That will take years and I would love to do exactly this for many years to come.
I'm just thinking this device could be as an amazing all-in-one room device, including using it as thermostat... Not sure how feasible would be to install it in the wall. Thinking on it as you can use the Sonoff NS-Panel that come with European and American versions (for the standard size).... So looking forward for the development. I would totally install one per room.
Dude, this is amazing. I plan on buying several if the first dev kit works well. I already use Assist more than Alexa while sitting at the PC, would love to have a good solution off the shelf for all rooms (so I don't have to build 10 DIYs)
Ah! I gotcha. Cool. Glad the decision to accept their sponsorship resonated on your guy's end too. Perhaps JLC will do larger sponsorship with us and help the startup make a little $$ to speed up our roadmap. :)
I know you have a 3.5 to connect external speakers but I would prefer not to run wire (whole home audio amp in basement), will we have the ability to still modify the yaml in the esphome setup of the device so that I can set the output speaker to a home assistant media player? I currently have some m5 atoms that do this by specifying VLC media player ironically which is hooked in as a source to my whole home audio (already have speakers in many rooms throughout house) through my home assistant server. I use the on_tts_end: and on_tts_start I specify the entity_id of the vlc media player. The m5s work pretty well but the accuracy is very hit and miss as far as hearing you and they definitely can't hear you if other sound is going on in the room. The device looks awesome by the way and good luck with the launch!
Can't wait to cut Alexa out of my life! Listens about as well as a teenager these days! Price is roughly what I would expect for a finished product, great to see a dev kit for a accessible amount.
We're really trying to keep the prices low, but we need to make some profit to keep the lights on and continue building. Keep in mind everyone that Amazon and Google loose money on their voice assistant hardware sales because they make money on the backend from your data. That's not the kind of business we're trying to run here so privacy and good hardware will cost a bit more.
I don't think the big-tech companies will ever give us this type of offline voice solution either. It's just not in their DNA. People want it though! So here we are...
We will be shipping to Europe upon launch and have inventory there. Shipping across all of Europe looks like it will be less than $10 and 3-5 business days.
@@FutureProofHomes absolutely awesome. I currently have 15 mmWave sensors ceiling mounted and they are so chatty that I had to create a zigbee network just for them and they all have different controls....nightmare. Absolutely looking for a better alternative
This is quite cool! So... will it be able to be powered by POE, or just the USB-C options? I like the concept of in ceiling installation and running another POE Cat6e cable is so much easier than running a power outlet!
Definitely didn’t forget about that. You’ll be able to connect externally amplified speakers via the 3.5mm headphone jack on the Sat1. Also, after our AMP1 product launches later in 2025 you’ll be able to connect speakers directly to the amplifier.
This is a very exciting development! I'm not tech savvy enough to buy and set up the dev kit, but I'll be following closely and eagerly await a fully fledged commercial product!
That sounds great, happy to be a guinea pig if you need a test subject 😂 the idea of having an AI voice assistant is very exciting. I currently use Alexa and have a lot of smart home devices. All my lights, thermostat, smart plugs, fans. But I'd love to ditch Alexa! I'm a huge advocate for not relying on cloud services. However, at the moment I still need them.
Two reasons. No enclosure & we can't afford (yet) all the regulatory electronics certifications needed to be considered a full consumer electronics product (CE, FCC, etc. etc.). This is the the next step though. Heading in that direction!
@@FutureProofHomes this all makes sense. So to your certification point, no UL listed either. Loving this though, have you thought about also putting out a 3D printed case design? I mean until you get to the point of releasing a case. I know you said this is open source so it might be there or someone working on it. Edit: you updated the description to link to your page! Jumped on the waitlist.
Yea, 3D printed enclosure design is already in flight. the form-factor of the PCBs might change a bit so the enclosure naturally comes a bit after the PCBs.
Thanks for jumping on the list! I'll do that same kinda waitlist thing when the enclosure is in the store and close to mass manufacturing. That'll be you time to jump in. :)
Can I ask what you use for speech to text recognition? So far I see this is the biggest issue… I was playing with it so far and it is just not good enough, especially for non-English language… I suppose you use homeassistant cloud speech to text, right?
Amazon too. They seem to be abandoning their existing solutions and moving to an “AI-in-the-cloud w/ monthly fees” strategy I hear. We shall see what they do, but perhaps it will help the Sat1 and Home Assistant flourish.
Very excited for this. It's exactly what I wanted and then some. I'd really like to see how you get responses faster from a local AI server. I wonder if there is a slimed down version. Where you can select categories of information. I'd be very interested what information you could pass from the web, like weather and air quality. Maybe that's just buikt into HA with other intigrations
If there is enough demand, yes. I'll put a widget on the website to ask for future markets. Let me know if you're interested in being a inventory hub in Japan for us. :)
This is awesome! With something like this that's planned to be placed evenly all around the house I've always wondered if it could also be a Zigbee/Thread router as well? Google/Apple Home products are starting to add that in their satellites.
ESP32... so will it have the same limitations demoed on the S3box? IE you can't dismiss an alarm by voice or pause a song if audio or an alarm is already playing? Also at least in my experience music streaming will be ASS on 2.4Ghz.. Google Minis and Amazon Echos connect to 5Ghz for a reason, I have them all on a 5Ghz SSID because I get cutouts all the time if they fall back to 2.4Ghz.
I can demo this, but you can absolutely interrupt music playing with your wake word and pause or change the volume. If 2.4Ghz wifi causes music streaming problems then I'd recommend PoE connection. More info to come here.
@@FutureProofHomes POE would not work as I don’t have connections in every room. We currently have a Google mini in every bedroom and the living room and kitchen. Well hopefully 2.4ghz works better than on my Google minis.
This seems pretty much identical to the ReSpeaker mic array boards, just with an ESP32 inside. Seeed never delivered a firmware with working beamforming for the XMOS IC, let's hope this guy does better.
If we're thinking of the same ReSpeaker, then the Sat1 should be quiet a bit more versatile and powerful. e.g. Has better audio processing, music streaming, bluetooth presence detection, extra sensors, etc. Not to mention this will work with ESP32 and RPI. :)
The integrated ESP32 and the resulting form factor is very nice for sure. But for me a voice assistant gadget hinges on rock solid speech recognition (mainly wake word but also STT) no matter if there's music playing or water running in the room. The ReSpeaker didn't have that, despite also using an XMOS chip, that's why I'm having reservations if you can do it. (But very much hope so!)
Last time I checked the problem with all those Satellites is that the server running Home Assistant still needs to be powerful enough. e.g.: I tried the "$13 voice assistant for Home Assistant" (ATOM Echo) and it was horrible. Not because of the hardware in the ATOM Echo but because the server running my Home Assistant instance uses a low powered Intel J4105 Prozessor which is simply not powerful enough. I could only run the lowest whisper model and voice processing took minutes and was horrible inaccurate. I wish someone would invent a private Voice Assistant which is able to do all the voice processing on device. Satellites are nice but you still need a nice server for Home Assistant. A Pi 4 / 5 or my Intel processor are just too weak.
Fair enough. You do need an adequate home assistant server to power the home voice interactions. That is true. See our roadmap on the website, the AI Base Station (might be late 2025 or even 2026, unless we can get big revenue to scale the team and move faster) will provide more than enough horse power to power this system.
I get that. Hang tight then. We’re heading in the direction you desire, but we need revenue today to get us to the more complete product. Therefore this devkit is the initial release and actual foundation for that future product.
@@FutureProofHomes haha sorry my comment probably came across patronising. I actually was trying to say this is pretty neat so I've subscribed for when the full product is out. Sorry 😅. Not sure why I wrote it the way I did.
great device, but will it be possible to have more immediate answers like on alexa? You ask the question and Jarvis immediately there is the answer... without lag. Will it be possible? being local and not going through the cloud secondly it could also be faster than Alexe in responding
Yes. It is certainly possible. We will get there! Sometimes I experience sub-second response times. I won’t explain here why there can be more latency sometimes and other times it is super fast, but suffice it to say the user experience will eventually be almost instant as the technology matures.
Wyoming satellite is powered by Raspberry Pi, while the Dev Kit we're showing here is ESP32-based and therefore quite a bit easier to set up and configure. That said (and THIS IS IMPORTANT TO UNDERSTAND), you can attach our HAT to a Raspberry Pi Zero 2w and build a really powerful Wyoming Satellite too. It's the best of both worlds.
I'm on the waitlist and really looking forward to this hardware. You're doing an awesome job, thank you and best of luck! I do have one request/suggestion, as an electronics engineer it drives me insane when companies make stupid design choices for powering equipment. I have seen a trend toward powering sensors with USB power supplies, what are people thinking? I know it's easy and simple to use a USB power supply when many of the designs incorporate an ESP32 or similar inside and all you have to do is jam in a micro USB connector to power it but you have to think about the practical aspects of form and function. When you want to place a sensor like a millimeter-wave sensor or any other occupancy or motion sensors it's ridiculous that with so many products on the market now you have to use a USB power supply and then try hide the power supply and cable going to the sensor. What am I missing? I want a nice clean installation and not have a sensor on my wall with a cable running down to an electrical outlet where it's plugged in. In a perfect world the device would support PoE, not an adaptor that I saw mentioned in another post, you want it integrated into the PCB design. RJ45 connectors are, unfortunately, large and I concede that is not ideal and a challenge to keep the device form factor small but this hardware is going to be a little larger because of everything it supports so I feel a RJ45 connector can be accommodated. If PoE proves to be too much of a challenge then please, please, please make provision for DC power terminals. A lot of homes don't have CAT5/6/7 running everywhere but most do have basic, two conductor security wiring that you can send 12 or 24VDC over (5VDC not ideal over long, small gauge copper). I frequently replace old PIR motion sensors with newer technology and use the 12 or 24VDC that was previously powering the device to power the new hardware which then keeps the installation of the device nice and clean and aesthetically pleasing (no stupid power cables hanging down the wall). Thanks to PoE being a power and low latency data/network solution it is ideal but at the very least it would be nice to have flexible power options. A while ago I purchased an ESP32 PoE Development Kit (EST-PoE-32) from Everything Smart Technology (EST) and it supports PoE, USB-C and 9-28VDC for power, it is a great, flexible, little board and proof that it can be done. One final point I'll add to this comment, that has become rather long, I really like being able to power all my devices in my home with a single PoE Ethernet switch which means I only have to worry about a single power source that is plugged into a UPS and not dozens of USB power adaptors plugged in all over the home. Great solution to keep everything protected and operational no matter what happens with mains power. Keeping a spare PoE Ethernet switch also makes for easy redundancy in place of dozens of USB power supplies that easily have their cords pulled out. Okay, perhaps I went a little overboard making my point 😁.
Great comment. I hear you. Here’s what is happening behind the scenes. Let me know your thoughts. What you saw in the video is the “HAT” and “CORE” boards. Behind the scenes we have a third board we call the “SHOE”. This SHOE board is responsible for all the I/O connections at the bottom of the hockey puck enclosure (3.5mm headphone jack, USB-C, 30w PoE+, and the available GPIOs). So if you’re running the CORE and HAT “naked” (with no enclosure) then you don’t get PoE unless you add-on the third SHOE board dangling from a ribbon cable. Obviously this decision is being made so that all the boards can fit in the enclosure. I know this isn’t ideal for hackers but we’re trying to avoid two variants of the HAT. Thoughts on this?
