After what feels like 45000 tutorials, thank you - you finally gave me the insight needed to strip out unnecessary data and CHANGE the incoming data into a payload that influx was happy with. I now have a happy little chart of how bad the air is during the Canadian wildfire season.
Amazing Video, cannot thank you enough. I tried it myself and here is feedback. The github code you shared is having issue with NodeRed, see error below - I managed to install other containers by skipping nodered and later installed nodered as systemd. It would be nice if you can make your github repo public in that way users can report issue and can pull the working code. ############ Start Stack: docker-compose up -d --remove-orphans WARNING: Some networks were defined but are not used by any service: nextcloud Creating network "iotstack_default" with driver "bridge" Building nodered ERROR: Cannot locate specified Dockerfile: Dockerfile
This is a really excellent tutorial. Every step is clearly explained in detail. Just one issue: it is generally not advised to use a leading forward slash '/' for the root an MQTT topic. But that's a minor quibble
After struggling for a whole day trying to get mosquitto to work on my raspberry pi, following your video had me up and running within half an hour. This is a fantastic tutorial, thank you so much for the help ❤
Last week on a Friday night I was in micro center and the kid behind the counter told me they had none and they sell out in about 30 minutes. Saw about 8 in the glass case and asked a worker to grab me one, checked out with the same kid and told him there's 7 more if you want one lol. Just saying, they were there that entire day at least and didn't sell out. I'm sure by the end of the day Saturday they were gone. NYC area
Great tutorial to get started with IoT stack in R-Pi4. I am going to use this in a CM4 and use node red + mosquito talking to IO module downstream. Docker surely makes things flexible and easy.
Great Video, I am bumbling through this on my own system, I intend to use this to monitor my solar install, hopefully remotely, so much to learn so it may be sometime before it goes live. Thanks for posting ;)
Hey quick question, so when you get to the menu part and have to select nodered to install in the build list, do you have to download every single package that nodered has or can you just install the default ones shown?
Thank you! Very nice, well explained and easy to follow, bookmarking and saving your website tut too. I've got a couple renewable energy projects that I'm designing, and this should work perfectly for some monitoring hardware (tachometers on wind turbines and voltage readers on solar arrays). Also thinking about a few other metrics around the house I could definitely appreciate collecting :D.
That's an excellent tutorial !! Congratulations !! I would like to ask in case we have many sensors in /home/sensors. How can we get the unique id of each sensor and show in grafana? I've implemented your project with wemos D1 mini + DHT22 sensor + LCD 16x2 (parallel connection) and raspberry pi 4 (8Gb) as the server. The point is that viewing grafana i only see that data comes from sensor_data which is the db name from influxdb.
Based on my 3+y expirience InfluxDB wrong choice for time-series data. It can't be used on production setup. The better way - prometheus, or graphite with clickhouse backend.
Do you have any suggestion to decrease power usage to change it to make a reading every 1 mins instead of few seconds. And using only solar energy from a panel? To make sure its fully autonomous
You could look into lower-power mode on the device you are using, and use a watchdog timer or some other peripheral on the microcontroller to power it back on after X time to take another measurement.
Was so hopeful - but hit a big problem. When i run the Start Stack command, it dies quickly at the Grafana step "ERROR: no matching manifest for linux/arm/v7 in the manifest list entries" (FYI - i'm installing onto Rpi 4B) I googled that error, and found multiple questions about it for other packages, but i really don't understand enough to know how to fix it here. I'm stuck. Anybody willing to lead me out of this road block?
this video is supposing all devices are connected to the same network, right? Is there a way to implement same solution you provided, but with devices that are around 20-40 metres away from each other. either by somehow giving them same network or by working it out without same network.
Amazing tutorial. May i have a question ? Say i finish all the installation above, is it possible that my system can operate completely offline ? ( reading, workflow, visualization, modifying … ) Like i connect those 2 boards to the same network which doesnt have internet connection.
It should be set within your router, otherwise it will change the next time the raspberry pi power cycles. The video didn't mention that. Go to the IP address for your router, type the username and password (the very first time, it should be "admin" , "password"), find the raspberry pi in the list of devices on the router, view more info, and set "reserve" IP address.
So one topic is for each arduino with the sensor suite, so each room has a different topic? or is it a bunch of sensors sending data to one arduino and it is transmitting different topics per room?
Each arduino is an individual sensor node in the video. There are cheaper microcontroller alternatives with more IoT features (timers, power modes, WiFi, BLE), such as the ESP32. Arduino in this case was used as an example.
Hi, thx for the nice tutorial but as some people said earlier, I think there is an issue with th IOTStack and Node-red. Indeed while installing the stack the installation gets stuck and Node-red is not installed. I found out the reason was because I have configured the Raspberry IP as Static ( like shown in your previous tutorial :) ) It seems that during installation an IP has to be assigned to the containers and without DHCP it gets blocked... Can it be?
The problem with this is in most scenarios you will not have a Wi-Fi network or any kind of network, imagine a farm. This would need to be achieved with Lora. So this needs to be all Lora and only one master with Internet connectivity. And raspberries are unobtanium 😢
Just a note, when setting up the MQTT server in Node-Red you can type in the name of the docker container as it is running in the same stack as Node-Red.
Very cool video on the Pi. For Arduino the ESP8266 NodeMCU is a cheaper option as it already have Wifi built-in and better power management. ESP32 would work too. Both very small form factor.
100% esp devices are better for 95% of iot projects and they are cheaper and smaller. Only problem is they are 3.3v devices so you might need a logic level shifter.
Obligatory warning! @4:00 using curl to download a script and running it with bash is an awful security practice. I don't think we should assume that everyone knows this.
Amazing guide! I watched it a couple of times and after a few hours I had my Grafana up and running, mind you I had never done anything MQTT before. For now I am just logging the room temp with an ESP32 and an LM35 temp sensor but I will be adding a lot of stuff soon and hopefully some solar production data in the future. Thanks a lot!
Hello! Great tutorial, thanks! However, when I build the docker-compose.yml.file containing Mosquitto, Influxdb, Grafana, Node-RED, and Portainer-CE and I type the command "docker-compose ps" I don't get any list of Mosquitto, Influxdb, and so on. I get the following error responses (see the attached picture). I've been trying to troubleshoot it and rewrite everything from the beginning, but the issue persists. I've tried to add some other commands found on the internet, but no luck yet. Let me know if you have any ideas on how I might solve this problem. Thanks :)
Hello, excellent video! I'm Brazilian and I don't speak English (I'm using Google Translate lol) and I would like to know if I can use a conventional computer with the Raspberry Pi system installed in place of the Raspberry Pi board. Thank you in advance!I would also like to know if I can use the ESP8266 ESP-01 WiFi Module for the wireless connection, as I use an Arduino board without a built-in WiFi module.
Hey I also noticed that the "influxdb out" pink dragbox you used in the video at around 7:48 no longer seems to be in the storage tab, or in the left toolbox space at all. What happened to it?
Can I ask a question, how do you enable the USB serial ports in docker, I want to use Arduino nodes to collect and send data over serial, is there a file I can edit for the Node Red container?
If I'm using influxdb on web browser instead of installing it to my pc, will it not work? Because when I'm connecting nodered with influxdb it's not binding with influxdb. I've used the host name for influxdb as my url and port as 8086.
help i got stucked in this situation. IOTstack Installation Enter in the sudo password when prompted, to install dependencies Reading package lists... Done Building dependency tree Reading state information... Done git is already the newest version (1:2.20.1-2+deb10u7). 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. fatal: destination path 'IOTstack' already exists and is not an empty directory. IOTstack cloned Python virtualenv found. Python Version: 'Python 3.7.3'. Python and virtualenv is up to date. Error getting docker version. Error when running docker command. Check that docker is installed correctly. Docker version 23.0.1 >= 18.2.0. Docker is good to go. Setting up environment: pi@raspberrypi:~ $
Hi. This is very good work However, I'm trying to develop this with my raspberry pi and an arduino MKR. It happens that the WiFi library has its init method as private method, so no way you can start the WiFi in AP+STA mode (at least, I've not been able ot do it). Is there any work around. I think this is the cause the sensor node only gets one data through the node red workflow.
Hi there, after running the linked IoT install script and script was processed, my Raspi boots up into blackscreen, no GUI available any longer. Luckily, I had a VNC server running, so I am able to connect via VNC viewer from my PC, although with a very poor resolution, that makes it nearly impossible to operate it this way. I have tried several reboots, with no success, obviously the script has "broken" my GUI, do you know how to make it available again ? I can access ssh via VNC. I'd like to avoid having to reformat my SD card again, Cheers mate !
Please note: In the video, you state that you can check what containers are running with the command 'docker-compose ps' while on the related web page you show the command as 'docker-compose up'
docker-compose ps shows you status of docker containers, docker-compose up execute the docker-compose.yml file(that is something like a config dile for docker) you also use this command only when starting docker
Well this video was exepsional congrats! It worked fine for me, however for some reason I can't add the libraries of the functions on the pallet in node-red.
Mine did not work as when i want to start the stack it returns an error that three of the apps are obsolete. Just wondering if you had an issue like this or any way to resolve
Almost every single thing is very good explained in this video an exception of HOW CAN I MAKE THE INTERFACE COMMUNICATION BETWEEN MY ESP32 (WHICH IS READING THE DATA SENSOR) AND NODERED?
Resumo do vídeo "Raspberry Pi IoT Server Tutorial: InfluxDB, MQTT, Grafana, Node-RED & Docker" em 5 pontos: 1. *Objetivo do Projeto:* O tutorial visa criar um servidor IoT utilizando um Raspberry Pi para coletar dados de sensores, como temperatura, pressão, umidade e qualidade do ar, através de um Arduino Uno emparelhado com um sensor BME680. 2. *Protocolos e Ferramentas Utilizados:* Utiliza o protocolo MQTT para enviar dados em formato JSON pela rede para o servidor Raspberry Pi. Explora aplicativos como Mosquitto (broker MQTT), Node-RED (interpretação e envio de dados para um banco de dados), InfluxDB (armazenamento de dados do sensor) e Grafana (interface gráfica para visualização dos dados). 3. *Configuração do Ambiente:* Emprega o Docker para rodar os aplicativos em contêineres, facilitando a configuração e implantação dos componentes, tornando possível a execução desses aplicativos em diferentes dispositivos. 4. *Passos para Implementação:* - Atualização do sistema do Raspberry Pi e instalação do "iot stack". - Seleção dos pacotes desejados (Grafana, InfluxDB, Mosquitto, Node-RED, Portainer) usando o menu interativo. - Configuração do InfluxDB para armazenar os dados do sensor. - Configuração do Node-RED para interpretar e enviar os dados para o InfluxDB. - Configuração do Grafana para criar um painel visual dos dados coletados. 5. *Finalização do Projeto:* Após a configuração de todos os componentes, é possível visualizar e monitorar os dados dos sensores em um painel gráfico oferecido pelo Grafana, consolidando assim a criação de um servidor IoT funcional. É importante ressaltar que o vídeo fornece um guia detalhado de passo a passo, incluindo comandos e configurações específicas para implementar esse servidor IoT com Raspberry Pi.
Hello, I want to set the parameters of an industrial drive using a node through RS485 serial communication. In this project, I need to use the hex codes of an industrial drive and control the drive using the hex codes. Can you help me with this project with node-red-node-serialport?
This is a very useful tutorial and a nice presentation!! Just to be clear regarding viewing the containers using Portainer, 1) do I need to have an account in Portainer? 2) Is there any limitation on device numbers under the free account?
Thank you. Nice; quick and succinct. One comment.Why skip over Portainer when - and this is from limited knowledge - I think you could have set everything up from within Portainer
very useful video, I did this Iot Server, but with DHT22 temperature sensor with ESP32. Did anyone have the problem that at 7.30 am and pm for some reason grafana stop saving data? Any suggestion?
Hi, Thank you for this professional tutorial. I followed it and my ESP32 client can connect to the MQTT server jus if both the Raspberry pi and ESP32 on same wifi network. What am I missing?
@@LearnEmbeddedSystems Is it possible to build this stack in the cloud? In other words can this container be ported to the cloud? A video on it would be helpful.
