Тёмный

Installing and Configuring Logstash to Ingest Fortinet Syslogs 

Ali Younes
Подписаться 5 тыс.
Просмотров 36 тыс.
50% 1

#elasticsearch #kibana #logstash #fortigate
In this video, we install and configure Logstash to receive Syslogs from FortiGate, parse them, and send them to Elasticsearch.
Watch how I installed and configured Elasticsearch and Kibana:
• Installing and Configu...
Thank you for watching!
Follow my Twitter: / ayounes9
Follow my Blog: www.thelionpin...

Наука

Опубликовано:

 

15 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 68   
@chokfulla
@chokfulla 7 месяцев назад
This helped a LOT. Thank you, sir.
@seniortaco100
@seniortaco100 10 месяцев назад
Hello Ali - @ 9:18 - how do you know that is the format? can you explain a bit more how you identify such a format?
@bilelbenzerafa253
@bilelbenzerafa253 4 месяца назад
كل الشكر و التقدير على هدا العمل الجميل شكرا اخي
@bucksera475
@bucksera475 Месяц назад
wonderfull video
@ElyasSalman-p9n
@ElyasSalman-p9n 6 месяцев назад
HI Ali , i have FortiAnalyzer and want to ingest the log to security onion , could i send it directly or should i have syslog vm between FAZ and security onion . what is the best scenario to do this . thanks for your help
@silentreader8426
@silentreader8426 3 месяца назад
which one is better depends on performance, send log via filebeat or via logstash?
@tobiashelbing1233
@tobiashelbing1233 Год назад
Great! Many thanks for this Video
@MrSalFav
@MrSalFav 2 года назад
This is very helpful thank you !!
@AliYounesGo4IT
@AliYounesGo4IT 2 года назад
Glad it was helpful!
@seniortaco100
@seniortaco100 10 месяцев назад
Nice Vid Ali - very helpful - Question - can Logstash conect securely to Elasticsearch using an API key instead of sending a username and password thru the .conf file? perhaps configuring such API key in the logstash.yml or placing it in the filexyz.conf file used to connect to elasticsearch. Generate the API key in Kibana with logstash-user role and index permissions to publish such logs from logstash into Elasticsearch. Thanks for your previous response to making such video series in Windows servers. - Cheers
@anatchaisamretsin8770
@anatchaisamretsin8770 2 года назад
thanks a lot bro. it very useful. Can you explain more about create index for firewall log?
@AliYounesGo4IT
@AliYounesGo4IT 2 года назад
Will work on that, thanks!
@moinakbhattacharya878
@moinakbhattacharya878 8 месяцев назад
Great video
@seniortaco100
@seniortaco100 11 месяцев назад
Nice Vid Ali Can you make this Elastic, Kibana, Logstash Videos for Windows Server 2019/2022 or Windows 10?; and perhaps ingest data from an SQL Database server; if at all possible. Thank You.
@youk1824
@youk1824 2 года назад
High quality content :) Keep up the good work +1 sub
@UntungRaharjo
@UntungRaharjo 11 месяцев назад
Hi Ali, thank you for this video. Right now, we are facing issue to integrate log of Fortigate using Logstash+Elasticsearch+Kibana. We have an issue with the grok from Logstash to create indexing in Elasticsearch.
@AliYounesGo4IT
@AliYounesGo4IT 11 месяцев назад
What is the issue?
@davidraymond7420
@davidraymond7420 2 года назад
Nice one, continue good work
@tiagoolv5115
@tiagoolv5115 2 года назад
Perfect. Thanks!
@moe-bash
@moe-bash Год назад
thank u. it was Grate and useful
@نادرنادری-ز9ض
@نادرنادری-ز9ض 5 месяцев назад
Hi, This is very helpful thank you but It would be much better if you could upload the config file as well.
@pmorenos
@pmorenos 2 года назад
Muy buen trabajo, te felicito 👏
@ati43888
@ati43888 Год назад
Very nice. Thank you. Esselamu Aleykum.
@iswariafala
@iswariafala 6 месяцев назад
how we can get the log from more thaan 1 network device forti ?
@samiyamusthafa
@samiyamusthafa 10 месяцев назад
logs are not coming to elastic search from syslog server. we done as "enroll in fleet" way? can u pls help me with this issue ?
@띵수-s3e
@띵수-s3e 2 года назад
I would like to see data from DB being pipelined with logstash and loaded into Elasticsearch 8.2.2
@muhammedajsal1816
@muhammedajsal1816 2 года назад
Thank you Can you please do cisco routers and switches integration
@ToadRash-mu3ln
@ToadRash-mu3ln Год назад
Great video, tnx! But why you use this primitive Putty instead let's say... MobaXTerm or another handy client?
@AliYounesGo4IT
@AliYounesGo4IT Год назад
I'm glad you like the video! Putty works Ok, I will look into MobaXTerm!
@TeenaKohli
@TeenaKohli Год назад
Thank you for the information video, can you suggest if in case i have multiple pods running and i am capturing logs of all application pods on one common persistent storage mounted /var/log what could be possible input string
@SnakeFredy
@SnakeFredy Год назад
Hi Ali. Thank´s for the video. At this moment I am getting an error which does not allow me to continue. The port is occupied by java, therefore when starting the logstash it tells me "The address is already being used (bind) port: 5144". (Address already in use - bind)
@AliYounesGo4IT
@AliYounesGo4IT Год назад
I think that happened to me once, Logstash was already running, maybe try to stop all Logstash processes and try again (run: ps -aux | grep logstash)
@zaylinhtun3423
@zaylinhtun3423 Год назад
What can I do if I don’t want to define the hosts for fortinet? because I want to send the logs from multiple fortinet FW Can I remove hosts line?
@sleba96
@sleba96 Год назад
Can you pls help whats the rest of the filter in the fortigate.conf? I cant see the whole code. mutate{ remove_field => ["@timestamp", "host", "@version",................................
@abdenourguellati3124
@abdenourguellati3124 Год назад
you can use this remove_field => ["@timestamp", "path", "host", "@version", "log", "event"]
@sleba96
@sleba96 Год назад
@@abdenourguellati3124 thank you so much!
@Wolfhound_81
@Wolfhound_81 10 месяцев назад
Why is that required? I'm new to elastic but I understand from their documents that they have Fortinet integration so I would expect them to be able to parse that without me doing all that stuff manually?
@AliYounesGo4IT
@AliYounesGo4IT 10 месяцев назад
That's right, you can use the Fortinet integration and it does a great job. This is a demo on how to install Logstash, you can also use it to ingest and enrich the Fortinet logs with other data from other sources.
@aminazgol3918
@aminazgol3918 Год назад
Wonderful, thank you sir very informative
@Hunti21
@Hunti21 Год назад
i have the error: Failed to perform request {:message=>"PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target"
@deepti_priya_panigrahy
@deepti_priya_panigrahy Год назад
is the issue fixed? I am also getting the same error
@jameseduard2092
@jameseduard2092 Год назад
can you check and work with opnsense as well?
@AliYounesGo4IT
@AliYounesGo4IT Год назад
I will look into it!
@jameseduard2092
@jameseduard2092 Год назад
@@AliYounesGo4IT ok great thanks sir, do you have linkedin'?
@dv7045
@dv7045 Год назад
Hi, it is possible to write SNMP input plugin or it is hard work?
@AliYounesGo4IT
@AliYounesGo4IT Год назад
I will try that and make a video!
@ryaddraou851
@ryaddraou851 Год назад
Hi man, thanks for the video it's excellent but can you pls give me more explanation about the command in min 7:30 I didn't get it
@AliYounesGo4IT
@AliYounesGo4IT Год назад
Thank you! The command is starting Logstash from the source binary /usr/share/logstash/bin/logstash and then specifying the configuration file with -f that tells Logstash where to get the data from (input plugin), filters the events (filter plugin) and send to an Elasticsearch output (output plugin)
@dinhhoangvietminh
@dinhhoangvietminh 2 года назад
Could you demo how to use fortigate agent on ELK?
@AliYounesGo4IT
@AliYounesGo4IT 2 года назад
I will do that soon!
@LeyviGarcia
@LeyviGarcia 6 месяцев назад
Hello, thank you for the tutorial, it was fine until I had to start the logstash service, from then on I no longer received the logs, in my case from a Cisco switch, even though I also gave permissions to the certificate and I still do not receive the logs. I runt again the command /usr/share/logstash/bin/logstash -f /etc/logstash/conf.d/cisco.conf -r and there I receive the logs , I don't know what I did wrong, but it doesn't work normally for me
@LeyviGarcia
@LeyviGarcia 6 месяцев назад
Sorry I had port 514, I watched the video again to listen to your comments and I solved it, thanks
@jamaaberdihna1076
@jamaaberdihna1076 2 года назад
When I run logstash I get this error no configuration found in the configured source
@AliYounesGo4IT
@AliYounesGo4IT 2 года назад
I can think of the path to the .conf file, make sure that it is the full path, example: /etc/logstash/conf.d/example.conf
@jamaaberdihna1076
@jamaaberdihna1076 2 года назад
I resolve this problem how u generate logs with firewall my firewall is empty
@AliYounesGo4IT
@AliYounesGo4IT 2 года назад
@@jamaaberdihna1076 I setup Syslog on the firewall to send to a specific UDP port on Logstash server, and on Logstash I open that port. It should start sending
@eytest1555
@eytest1555 2 года назад
match => {"message" => "%{SYSLOG5424PRI}%{GREEDY$} is truncated from the video, the window size is hide the rest.
@AliYounesGo4IT
@AliYounesGo4IT 2 года назад
match => {"message" => "%{SYSLOG5424PRI}%{GREEDYDATA:message}" }
@Lukaszorr
@Lukaszorr Год назад
@@AliYounesGo4IT Could You please tell me what is in the mutate{ remove_field as it is not shown on video? ( ["@timestamp","host","@version"......... Thanks!
@abdenourguellati3124
@abdenourguellati3124 Год назад
@@Lukaszorr remove_field => ["@timestamp", "path", "host", "@version", "log", "event"]
@RobertoRamirez-wh3zm
@RobertoRamirez-wh3zm Год назад
Hello Ali, I'm new to ELK and wanted to ask if you've ran into the problem I am encountering or if you can provide guidance. I am experiencing the issue you encountered at the end of the video where the logstash service stops and stops presenting data on Kibana. I've attempted to restart the logstash services and modify permissions for logstash, but I continue to encounter an issue. I ran a journalctl with logstash.service and notice the error below. Would you be able to provide guidance on this? [INFO ][logstash.config.source.local.configpathloader] No config files found in path {:path=>"/etc/logstash/conf.d/*"} [ERROR][logstash.config.sourceloader] No configuration found in the configured sources.
@AliYounesGo4IT
@AliYounesGo4IT Год назад
I never encountered this error, but can you double check the pipelines.yml file if it has the path to the conf file, and that there are no syntax errors in the file as well Hope that helps
@RobertoRamirez-wh3zm
@RobertoRamirez-wh3zm Год назад
@@AliYounesGo4IT Thank you! I was missing the ca path and fingerprint for Logstash. All good now!
@AhmedEid-lr6xe
@AhmedEid-lr6xe 6 месяцев назад
hi Roberto i face the same issue could you provide me how to solved it
Далее
Installing and Configuring Filebeat Fortinet Module
21:00
Monitor Elasticsearch with Metricbeat
19:54
Просмотров 15 тыс.
Set up Fleet Server and Install Elastic Agent
23:13
Просмотров 40 тыс.
Securing the Elasticsearch Cluster
33:27
Просмотров 14 тыс.
The cloud is over-engineered and overpriced (no music)
14:39
NixOS is Mindblowing
12:02
Просмотров 702 тыс.
how did I NOT know about this?
23:06
Просмотров 916 тыс.
iPhone 16 - презентация Apple 2024
1:00
Просмотров 188 тыс.
Тараканы убили ПК за 200к
0:45
Просмотров 181 тыс.
ГЛАВНЫЙ МИНУС #iPhone16ProMax 🤡
0:40
Просмотров 280 тыс.
Intel. Это конец?
51:01
Просмотров 131 тыс.