Hello awesome video, I used your guide to deploy it in a 3 node cluster and its working perfectly. But I have a log file in a nfs directory accessed by all the nodes and now there are 4 duplicates of these logs in flunetd. If you have any idea how to fix that I would appreciate it. Thank you again for the tutorial!!
Hello.. thanks for taking the time to put together this video. It’s excellent, it really does help with conceptualizing how to utilize fluentd.. I got it up and running and I am capturing logs from several of my back up processes and syslogs from few servers. Something I’ve not been able to figure out is how to dynamically assign labels to my Loki match blocks. I’ve used the rewrite_tag_filter plugin to push log lines to different match blocks where I have different labels but that feels like I’m hard coding the same thing over and over just to get one label to be different. I’d like to store the program or process name in a variable based on the log line and use it as a label. Is that possible? I’ve tried several different ways but I have not been successful doing that as yet. Any info would be greatly appreciated. Thanks again *edit when I say labels I’m referring to labels used in Loki and visible in Grafana
Hi Mark, It's an excellent question. There are lots of environment variables that could be helpful for your use case. Let me search for a link describing all those variables. I will get back to you asap.
Hi, I need to centralize the log's into the open search dashboard by using only fluentbit or fluentd in windows OS for my project and should not use K8S. Can anyone help me out here.
Hi. can you help me with how to insert the certificates path in my td-agent.conf file. I have to pass Syslog to open search so I am using the Syslog input plugin and OpenSearch output plugin. I have to pass a certificate to prevent SSL errors can you please help me with how to do it?
Hi, Sure .I guess you have enabled SSL communication on Opensearch? What type of error do you have? Let me also add a dedicated content related to OpenSearch in my backlog
@@isitobservable yes, error i am receving is"Could not communicate to OpenSearch, resetting connection and trying again. EOFError (EOFError)". How to overcome this.
@@isitobservable I need to report the logs to a API using the fluentD, it is possible? I know it is possible to use a input plugin and take logs from a API
@@marcellasilvasanches2915 Sure you simply need to collect the logs (using the tail plugin) from your microservice or application exposing your API. You just need to make sure that your application is generating useful logs. is your API exposed by a webserver? if yes you can also collect the logs of the webserver.
