Logging into Elasticsearch using Serilog and viewing logs in Kibana | .NET Core Tutorial

Подписаться 295 тыс.

Просмотров 88 тыс.

50% 1

Become a Patreon and get source code access: / nickchapsas
Check out my courses: dometrain.com
Hello everybody I'm Nick and in this video I will show you how you can very easily get started with logging into Elasticsearch in your .NET core application. We won't go in depth on how Elasticsearch works and why it is a good fit for a log sink but instead I am going to show you how you can quickly use Serilog to replace Microsoft's built in logging mechanism and start pushing logs into Elasticsearch, which you can then use Kibana to view and analyse. There will be a second video coming showing some of the cool stuff that you can do in Kibana with those logs.
Don't forget to comment, like and subscribe :)
Social Media:
Follow me on GitHub: bit.ly/ChapsasGitHub
Follow me on Twitter: bit.ly/ChapsasTwitter
Connect on LinkedIn: bit.ly/ChapsasLinkedIn
#dotnet #elasticsearch #logging #kibana

Опубликовано:

24 авг 2020

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 65

@ianf765 2 года назад

Thank you - I have been trying to get started with elasticsearch logging for a while without success. This was the video where I finally got it :) Great video, and just the right level of detail to your explanations.

@paragsarin2177 3 года назад

I really appreciate the way you explain things, keep up the good work. thanks

@lemurza5236 3 года назад

Very nice. Excited for the full elastic search video

@Pampua84 3 года назад

Hello, first of all congratulations for your videos, they are simple and very clear and always touch on very interesting topics, also I really like your way of explaining, you can see that you love what you do and that you do it well Today I saw this video, and it would be nice if you made one on elastic stack and how would you structure your logs (real cases) in case of using filebeat. Great, keep it up

@piotrkowalski3460 3 года назад

log templates with custom properties are working when using ILogger interface as well

@romanhrytskiv5598 3 года назад

Thank you for this video. TIP: you can search trough commands history in terminal emulator with CTRL+R and then typing, way faster that up/down arrows.

@evilroxxx 3 года назад

Nick, you can also add serilog as a default logging provider into Microsoft extensions logging. So you won’t have to change from the ms implementation of Ilogger into serilog logger and continue to record your logs in the serilog format.

@infotips2475 2 года назад

where can i get an example ?

@yossisternlicht21 Год назад

@@infotips2475 Here is a minimal example in dotnet 6 Minimal API using Serilog; var builder = WebApplication.CreateBuilder(args); builder.Host.UseSerilog((context, config) => { config.WriteTo.Console(); }); var app = builder.Build(); app.MapGet("/", (ILogger _logger) => { _logger.LogWarning("TEST"); return "Hello World!"; } ); app.Run(); You must install Serilog.AspNetCore nuget package for this to work.

@matiascasag 3 года назад

Awesome! Thanks!. Waiting for the Elasticsearch tuto. I have a question for you. Does this logging to elasticsearch have a retry in case the service is down or in case of error trying to log?

@ahmeddan7734 3 года назад

Thanks and great job. waiting for your next Elastic search video

@daa82 2 года назад

These videos are great! I am learning so much!

@clearlyunwell 3 года назад

This is really great, thank you for all the videos you make - please never stop making videos and remember: keep coding :)

@mestrestephane9087 Год назад

Excellent explanation. Thank you Nick.

2 года назад

Nick, another perfect video Thank you so much! You're the guy!

@emlplsn 3 года назад

Awesome video, thanks for sharing.

@mortware 3 года назад

This is great - thank you. I'm really interested in trying it out myself, but I came unstuck with the docker/yaml stuff. I can't get hold of your repo as there seems to be a problem with the invite system. Can you help?

@denisosipenko7413 3 года назад

Thanks a lot. Really useful knowledge 👍

@whoiam6395 2 года назад

So useful! Thanks 👍🏻

@shreneekpatil220 3 года назад

Nick, you are simply awesome, i don't it is coincident or what, your all videos are linked to my current work like. Net core, serilog, reflections, redis cache, elastic search, system. Text.Json, logger etc etc... Thanks a lot for helping in directely us to building a Product

@irinamurmur 2 года назад

Thank you! Very useful

@Ajmal_Yazdani 3 года назад

super cool. Thanks for it.

@ricardo190988 2 года назад

Hi Nick, thanks for the video. Are you still planning on doing a video on ElasticSearch only (or maybe OpenSearch)? That'd be awesome:)

@suryanarayanbaliarsingh5363 3 года назад

very nice. Thanks for sharing.

@trocomerlo 3 года назад

Great content. Is it possible to configure a retention policy of the logs in elastic search? So like if you want to keep only the last 2 months of logs.

@MartinHAndersen 3 года назад

Thanks for another great video. Really learning a lot from you. First it's freaking awesome that you can have all that functionality with so little code, awesome. I would like to have Serilog to log to different devices dependent on the environment the program are running in. localmachine to console, TEST, QA and PROD to Elastic. What would be the best approach?

@arianquentin6985 2 года назад

instablaster.

@ADSNGreenLife 3 года назад

really useful video!!!!!

@noelfrancisco5778 3 года назад

This is great tool, is it possible to replace with this tool the logging from SQL (through SQL trigger, during create, update, and delete transaction)? TIA :)

@yanaraldaghestani6305 2 года назад

amazing man

@LetsLearnWithA.R 3 года назад

Awesome !!

@benlewies8828 3 года назад

Would be great if you would cover the NEST library as well

@darkydrone 3 года назад

Can you use that with the Serlilogs Log.Error also?

@TheraPi 3 года назад

nice and practical tutorial. However, I'm not seeing my index pattern in Kibana. I followed the exact steps, bus used the official E-L-K docker containers

@zoran123456 2 года назад

you omitted logstash, how would you refactor the code to support logstash? Thanks for the tutorial.

@sps014 3 года назад

Nick Please do a tutorial on MS Search integration.

@89chiponline 3 года назад

thanks

@pranavpandey7163 2 года назад

Hi Nick, As you said you are going to create a video on Elastisearch, when you are planning to upload that?

@yurimelo3404 2 месяца назад

What are the nuigets that you used?

@smrsgv 2 года назад

Logging not working when i publish it to IIS, but work normally locally, there is no restriction in network, how can i solve it? maybe i missed some config for production?

@llindeberg 3 года назад

Have you tried elmah.io? How does it compare?

@MarkStoddard 3 года назад

Ha. I just started getting familiar with ELK stack. While I generally loathe Java, there's a lot of good tools built with Java

@volodia9509 3 года назад

Hi. Why when using method logger.information("very bad request") or logger.error("something bad") does not display my message in kibana? I got message "request finished http 1.1 post... " MessageTemplate {HostingRequestFinished:l}

@furqan-safdar 3 месяца назад

I tried to follow the steps but finding difficulty because elasticsearch version 8 has introduced major changes perhaps. Kindly post a video complying new version to use Serilog with elasticsearch

@christianista 3 года назад

How can we use Elasticsearch/Serilog when API is hosted on Azure?

@jfpinero 3 года назад

We do AppInsights/Serilog with stuff hosted in kubernets/azure, so definitely

@UstinBelarus 2 года назад

in case someone faces the issue with elastic service run - add "discovery.type=single-node" to the elastic service's environment

@CutePoisonization 2 года назад

my elastic server is remotely hosted and need username and password to authenticate, where do i specify these credentials in my .net core application?

@kartheeknandini3767 3 года назад

Nice video. I have one question. How Kibana accessing Elastic search DB. where you have configured it

@nickchapsas 3 года назад

That is part of the docker-compose that I'm using

@feelingeverfine 2 года назад

What does this have over just using Serilog and Seq? What did Elastic and Kibana get over this?

@nickchapsas 2 года назад

I've seen Seq at scale and it just doesn't play nicely.

@kevinli9212 3 года назад

Personally I reckon having the configuration all coming from appsettings is a better approach

@nickchapsas 3 года назад

It's definitely a more convenient approach but it is also definitely not a secure one

@ayasaber2567 6 месяцев назад

Thanks for video, but I find the Index Pattern tab

@mdzakariamasud8326 3 месяца назад

how to add authentication

@CRBarchager 3 года назад

We're already doing this in all of our applications internally :D

@sunnyokoro 3 года назад

is it free please? Do you need to pay for any of the elastic search or Kibana?

@evilroxxx 3 года назад

@@sunnyokoro it’s completely free

@aronsz Год назад

one container, elasticsearch doesn't work for me for some reason. It starts and runs for a bit but then stops with "ERROR: Elasticsearch exited unexpectedly". Nick, do you have the sourcecode available somewhere perhaps? (Although I'm pretty sure I copied correctly.)

@aronsz Год назад

Nevermind, I had a "too low max virtual memory" issue. To fix, run: > wsl -d docker-desktop > sysctl -w vm.max_map_count=262144 > exit (to exit the wsl)