Grafana Weather Dashboard on a Raspberry Pi using InfluxDB and an ESP32 - In-Depth Tutorial

Подписаться 87 тыс.

Просмотров 89 тыс.

50% 1

Following one of my previous projects where I built a weather station dashboard on the reTerminal, I had quite a few requests to do a more in-depth tutorial on how to get each part set up and running. So in this tutorial, I’m going to be going through each part of the process, step-by-step, so that you can get a similar setup running on your Raspberry Pi.
ADDITIONAL INFORMATION
---------------------------------------------------
Visit my blog for the full written tutorial - www.the-diy-life.com/grafana-...
PURCHASE LINKS
---------------------------------------------------
Raspberry Pi 4b (A Pi 3b/Pi 400/CM4 can also be used) - amzn.to/3dYeVqg
Power Supply - amzn.to/3EhPts8
ESP32 Microcontroller - amzn.to/3obvOV7
MicroUSB Cable - amzn.to/32oxy54
Grove Sensor's From Beginner Kit - amzn.to/31my42U
Breadboard - amzn.to/3lnrqAB
Breadboard Jumpers - amzn.to/3xFop3f
Equipment Used
Portable Monitor (Shown at the end) - amzn.to/3n4Lk3X
Some of the above parts are affiliate links. By purchasing products through the above links, you’ll be supporting this channel, with no additional cost to you.
CHAPTERS
---------------------------------------------------
0:00 Intro
0:55 Setting Up The ESP32 & Sensors
2:45 Sending Our Sensor Data To InfluxDB
6:35 Creating Our InfluxDB Database
11:06 Installing Grafana On Our Raspberry Pi
14:45 Creating Our Weather Dashboard
18:01 Resizing The Dashboard For Fullscreen Mode
18:35 Final Thoughts
If you've got any ideas for Raspberry Pi, Arduino, or other Electronics projects or tutorials you'd like to see, let me know in the comments section.
#influxdb #raspberrypi #grafana #esp32

Наука

Опубликовано:

10 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 83

@jacocoetzee762 2 года назад

Fantastic! I’m using the nano 33 sense with the esp32. Been looking exactly for this tutorial. Thanks so much!

@MichaelKlements 2 года назад

That's great!

@TheRoeckie 2 года назад

Exactly what I'm looking for. I'm going to put a bunch of sensors inside and outside my greenhouse to see how environmental parameters influence the growth. Great explanation!

@MichaelKlements 2 года назад

That's great! Try using BME280 sensors, they accurate and each does temperature, pressure and humidity all in one.

@BillEason Год назад

@@MichaelKlements In my experience with BME280 over the past 6-7 years, I find that the part has 1-2 degrees (F) of self-heating. If you're looking for reliable temperature sensing, I'd go with something else, but the barometric pressure sensing is amazing. It's able to detect changes in elevation of under 1/2 meter just based on the air pressure. Hard to believe, but true. To test the self-heating, (1) compare temp readings vs. other parts, like the SHT30 or (2) set it up to display temperature at short intervals -- like a couple of seconds apart. When you first power on the device, the temperature reading will be fairly accurate, but just watch it climb a degree or two within the first minute or so that it's turned on, then stabilize. Obviously, you'll have to turn it off and let it reach ambient temperature before doing that second test.

@alvarogascon9161 2 года назад

great video! Just what I was looking for!

@PoisonWaffle3 2 года назад

Nifty! I've used similar hardware for a similar project, but used a completely different software approach. I've got a Pi hosting Home Assistant + ESPHome, InfluxDB, and Grafana (both HA add-ons), and it all runs locally. It's pretty straightforward to take the temperature/humidity from DHT22s connected to ESP8266 or ESP32 boards and display it in Grafana. I also have various other temperature sensors for my ecobee thermostat and inside my SmartThings buttons that I can pipe right into Grafana as well. I followed a few different guides on RU-vid for the general concept, but did a few things a bit differently.

@MichaelKlements 2 года назад

That's awesome, sounds like you've got a pretty neat setup running!

@georgeboydratcliff1036 8 месяцев назад

Absolutely brilliant! Thank you!

@GeekendZone 2 месяца назад

Thanks it works, I make some modifications and used it with a BME280 sensor.

@gensys244 2 года назад

Amazing beyond interesting 🧐 great job very much enjoy your projects !

@MichaelKlements 2 года назад

Thank you!

@mohammedrezk8072 Месяц назад

Very useful and straight forward many thanks

@extremeroom7u7 2 года назад

i really likes your videos the are very informative

@muhammadrizkhi8428 Месяц назад

Wow greate video!! Thanks for tutor

@DavRH 8 месяцев назад

Very nice!

@KawaiRonin Год назад

Great work here man! I also noticed for ease of use, maybe include the libraries. I used a different set of sensors and libraries.

@MichaelKlements Год назад

Thanks for the suggestion and feedback!

@zuwei8490 2 года назад

谢谢. Thank you

@nielsnelson3570 Год назад

Hey thank you for this tutorial it was very helpful. I want to ask if it is possible to show me how you added the measurements into fields in Influxdb?

@kulaniscap 22 дня назад

10/10🙂

@kayezero703 2 года назад

Nice

@SmithyScotland 2 года назад

When using graphana the most important thing to remember is to click the save button. Nothing auto saves. Very easy to throw away hours work. I speak from bitter experience. Also to say the dht11 is incredibly unreliable and inaccurate. Best to use an i2c sensor or at a push a dht22.

@MichaelKlements 2 года назад

Yeah I probably should have mentioned this a few more times, I have also lost a few hours work on Grafana because I didn't save and simply closed the browser. I agree, the DHT11 sensor is quite poor, but it was just one that I had lying around for this tutorial. My weather station uses a BMP280 sensor.

@YuxiangChi 2 года назад

agree, also their 'newer' python library is very unreliable. Do you have any i2c sensor recommended?

@MichaelKlements 2 года назад

The BME280 and BMP280 sensors often have I2C interfaces (all of Adafruits ones do).

@bigpickles 2 года назад

@@MichaelKlements The BME280 is the best choice out of all the above mentioned. Excellent little sensor and it's cheap!

@legion9826 2 месяца назад

Hi, thnks for whare it. How did you transfer the grafana dashboard to the tablet? simple browser or what?

@TexanMechanicus 4 дня назад

I have followed your tutorial all the way through and it was very well explained. I am running into one issue and it is that I can not get grafana to display the temperature in Fahrenheit. Is there something I'm missing?

@nicklaspersson4687 2 года назад

Great video and update to PI as a data collector. However in my experience the sensor DHT22 does not seem to survive below 0 dgr C. It will work for a few months and then crash your system. See others who also have had similar problems with it used outdoors, also it does have very low accuracy for humidity. Imho. its not worth the trouble.

@MichaelKlements 2 года назад

Thanks Nicklas! Yeah the sensors I've used here are just for the tutorial, they're not particularly accurate or reliable. I use BME280 sensors in my weather station and air quality monitoring setups.

@FSISThakurAshish Год назад

Pls make a separate video for grafana with prothemus using esp32,since no tutorial are available on RU-vid 🙏

@radish6691 2 года назад

Nice! What is the little screen shown at the beginning, the one with the F1, F2, and F3 buttons?

@MichaelKlements 2 года назад

It's called a reTerminal by Seeed studios. It's a full Raspberry Pi based touch panel, it's got an embedded CM4 module.

@gregruthenium Год назад

Hi. Can this be used with ESp8266? Also, can you direct to which library you used for MultiWifi.h

@abhijithnscs1364 10 месяцев назад

Can i use multiple esp32 as input

@laszlobanyik2175 Год назад

Hi, it's a great and resourceful video. When I am trying to search for Arduino Client Library nothing comes up. Only Python Client library. Could you please help me out if you know the answer?

@doncucumber Год назад

Same problem here! Is it now only in the paid plans, maybe?

@DamianMyszko Год назад

Okay, I had same problem, but found a solution. Pick different library and change ending of URL adres. If you picked python, the ending should look like this ..../new-user-setup/python. Now just change "python" to "Arduino" and you'll see a page for arduino setup. I have no idea why it's hidden but it works.

@dukara702 21 день назад

Great video! Can I use a raspberry pi rather than ESP32 to collect sensor data following this tutorial?

@MichaelKlements 20 дней назад

Yes you could log the data to InfluxDB using the Pi directly.

@noeliafernanda1061 Год назад

Good project 👍 But, one question: Where do I configure so that the panel updates in real time or refresh the screen automatically??? 🤔

@MichaelKlements Год назад

In your dashboard settings there is an option to refresh the dashboard in a set time period

@vishnudpillai Год назад

so to store data, do we need a cloud provider's support like aws or azure? can we store data in influxDB? or can we setup only with esp32+influxDB+grafana?

@MichaelKlements Год назад

Both influxDB and Grafana have local or cloud options, so you can decide whether you want the data to be stored locally or in the cloud. You don't need to use aws or azure as well.

@vishnudpillai Год назад

@@MichaelKlements so which is more cost efficient for a new entrepreneur? using influXDB+grafana or aws_iot _core+aws_timestream+grafana ? which is best to scale the devices in future?

@laidbackobs 2 года назад

Great video! Quick question. If I want to view the Grafana dashboard from any website instead of on my localhost how can I do that?

@MichaelKlements 2 года назад

Do you mean embed the dashboard on another site? Or just access it remotely?

@raphaelf.martins7455 2 года назад

@@MichaelKlements He asked a good question. Please, I would also like to know how to remotely access Graphana dashboards through a website too, which I can access from anywhere. And thank you for ur detailed tutorial, it's all what I needed.

@Armand79th Год назад

The well-documented method would be to configure a reverse proxy.

@Armand79th Год назад

You're immediately correct... I don't know what "dah-ta" is. pLeAsE eXpLaIn. 😅

@MrCentrax 4 месяца назад

Excelent tutorial. Just one question. Why did you chose InfluxDB instead of Prometheus?

@MichaelKlements 4 месяца назад

InfluxDB is a better choice for time series logging, like weather metrics changing with time.

@FSISThakurAshish Год назад

Pls bro make a another short video for grafana with prothemus for air quality monitor no one else has made it ,so it will be of great use to many others like me since prothemus is very popular and effective 🙏🙏🙏🤝

@FSISThakurAshish Год назад

How can we do it with Prometheus pls help??pls

@FSISThakurAshish Год назад

Confused 🤔 Can we see our database on computer 💻 after configuring it with the esp as you shown?

@MichaelKlements Год назад

Yes, by going to the Grafana web dashboard on any computer on your local network

@scrody33 Год назад

I am trying to figure out how to use grafana on my ras pi locally with no internet connection. Any one know how to do that ?

@laszlobanyik2175 Год назад

Pls, help would be greatly appreciated. I don't understand, I created an account just like on the video, but I do not have the same dashboard and I do not have Arduino Client Library. The question is that something to do with my OS environment? Do I need to install something on the windows machine?

@sussyimposter6994 Год назад

I have the same problem.... Have you got a solution yet?

@DamianMyszko Год назад

@thewatchmaker. 10 месяцев назад

Isn't it possible to make influxdb/grafana take MY timestamp (e.g. a field named "timestamp") instead of what it creates itself when data is added to the database? Since I am collecting sensor data for about 10 minutes every 3 seconds and I need to send this data every 10 minutes to reduce the impact of Wi-Fi on the battery. Thanks!

@MichaelKlements 10 месяцев назад

I don't see why you couldn't create a new field for your own timestamp just like any other data field. The issue you'll probably run into is that most standard visualisation tools are designs around their time series and a data field so you'd have to modify these to be across two fields rather.

@kelgar1 2 года назад

Hi, great tutorial, could you do a video with the BME280? Would be great to have these outside (in an appropriate case) and then multiple sensors indoors in each room, then feed all of that to the dashboard 👍🏼

@MichaelKlements 2 года назад

Thank you! My weather station project uses a BME280 sensor, so you could combine the two to get what you're after. All the code on the InfluxDB and Grafana side is the same regardless of what sensor is used.

@kelgar1 2 года назад

@@MichaelKlements okay thanks for the reply

@srikumarc Год назад

Can I use nodemcu instead of esp32?

@MichaelKlements Год назад

Yes you can use any microcontroller with WiFi

@srikumarc Год назад

Thanks Micheal for your excellent guide. Exactly what I was looking for. Great resource indeed.

@srikumarc Год назад

Micheal, I am trying to implement your code as it is but am running into errors. One specific error is "assert failed:XqueGenericSend queue.c820 (pxQueue). There are other lines in the serial monitor too.

@srikumarc Год назад

Micheal, disregard my earlier comment. I could resolve the issue. Everthing works ! perfect ! Thanks a lot for the video

@srikumarc Год назад

Michael, can you modify this video to include Mosquitto & Nodered (on the web) so that the data from ESP32 is passed through Nodered to InfluxDB using Mosquitto? . This will be wonderful because all elements of the stack will be on the web.

@generalknowledge9555 2 года назад

ESP 32 with used to connect water flow sensor. This sensor value is stored in the InfluxDB database. while the below-shown Arduino code is removed we can get the correct accurate flow rate. But in this code is removed, then data can not be sent to the InfluxDB database. (water flow sensor is connected with an interrupt pin). if (!client.writePoint(sensor)) { Serial.print("InfluxDB write failed: "); Serial.println(client.getLastErrorMessage()); } Please give me the correct solution as soon as possible. It will be a big help for me.

@MichaelKlements 2 года назад

Have a look at my code that I've used for this example, you should be able to use the parts of the code that write to the database to get yours to work. The above is only a small portion of your code, there could be a number of issues in other areas.

@Juliodonadello 2 года назад

can you share the code?

@MichaelKlements 2 года назад

The code for the ESP32 is available on my blog post, linked in the video description

@bewingbewing 2 года назад

Thanks for this. I'm a little unclear about where you install influx. You're apparently working on a Windows machine at install time (06:38), but toward the end of the video (14:26), it seems to be co-located with Grafana on the Raspberry Pi. I'd rather it all be in the Pi, not cluttering up my PC. BTW, I'm trying to set up a CO2 sensor to establish the effectivity of my Covid-inspired ventilation system, using an AirGradient setup. It works great but just displaying a value isn't enough; I need to see the effect, over time, of people in the room (or not) with and without ventilation.

@MichaelKlements 2 года назад

I run through the two options for each near the beginning, I'm not installing Influx locally, I'm using their cloud server in this tutorial. Yes, I use both a Windows PC and Raspberry Pi - I don't like working with Arduino programming on a Raspberry Pi so I do this from the Windows PC. It sounds like this sort of data logging setup would be perfect for what you're trying to achieve!