Fluent Bit tail 输入插件在 Windows Server 2019 上内存使用率高且日志未转发

发布于 2025-01-15 21:09:24 字数 1516 浏览 3 评论 0原文

我在 Windows Server 2019 主机上安装了 Fluent Bit 1.9,并使用以下配置将 .NET 应用程序生成的日志转发到 New Relic。

C:\Program Files\ Fluent-bit\conf\ Fluent-bit.conf

@INCLUDE new-relic-fluent-bit.conf

C:\Program Files\ Fluent-bit\conf\new-relic-fluence-bit.conf em>

[INPUT]
    Name tail
    Tag iotprocessor
    Path D:\Logs\iotprocessor\Log*.log
    Skip_Empty_Lines On
    Skip_Long_Lines On
    Ignore_Older 1h

[FILTER]
    Name modify
    Match iotprocessor
    Add hostname ${COMPUTERNAME}
    Add application iotprocessor

[INPUT]
    Name tail
    Tag iottransformer
    Path D:\Logs\iottransformer\Log*.log
    Skip_Empty_Lines On
    Skip_Long_Lines On
    Ignore_Older 1h

[FILTER]
    Name modify
    Match iottransformer
    Add hostname ${COMPUTERNAME}
    Add application iottransformer


[INPUT]
    Name tail
    Tag iotformatter
    Path D:\Logs\iotformatter\Log*.log
    Skip_Empty_Lines On
    Skip_Long_Lines On
    Ignore_Older 1h

[FILTER]
    Name modify
    Match iotformatter
    Add hostname ${COMPUTERNAME}
    Add application iotformatter

[FILTER]
    Name grep
    Match *
    Exclude log /.*Catalog.*/

[OUTPUT]
    Name newrelic
    Match *
    licenseKey mylicencekeyforNewRelic

我可以看到日志出现在 New Relic 中,但最终它们还是出现了。在主机上,我可以看到 Fluent-bit.exe 正在运行,并且内存逐渐增加(800MB +)。

跟踪受监控文件的本地数据库会在这里提供帮助吗?另外,我可以为所有尾部输入指定一个数据库,还是每个尾部输入都需要自己的实例以避免数据库锁定?

DB C:\Program Files\fluent-bit\iotprocesser.db

I have Fluent Bit 1.9 installed on a Windows Server 2019 host with the following configuration to forward logs generated by .NET apps to New Relic.

C:\Program Files\fluent-bit\conf\fluent-bit.conf

@INCLUDE new-relic-fluent-bit.conf

C:\Program Files\fluent-bit\conf\new-relic-fluent-bit.conf

[INPUT]
    Name tail
    Tag iotprocessor
    Path D:\Logs\iotprocessor\Log*.log
    Skip_Empty_Lines On
    Skip_Long_Lines On
    Ignore_Older 1h

[FILTER]
    Name modify
    Match iotprocessor
    Add hostname ${COMPUTERNAME}
    Add application iotprocessor

[INPUT]
    Name tail
    Tag iottransformer
    Path D:\Logs\iottransformer\Log*.log
    Skip_Empty_Lines On
    Skip_Long_Lines On
    Ignore_Older 1h

[FILTER]
    Name modify
    Match iottransformer
    Add hostname ${COMPUTERNAME}
    Add application iottransformer


[INPUT]
    Name tail
    Tag iotformatter
    Path D:\Logs\iotformatter\Log*.log
    Skip_Empty_Lines On
    Skip_Long_Lines On
    Ignore_Older 1h

[FILTER]
    Name modify
    Match iotformatter
    Add hostname ${COMPUTERNAME}
    Add application iotformatter

[FILTER]
    Name grep
    Match *
    Exclude log /.*Catalog.*/

[OUTPUT]
    Name newrelic
    Match *
    licenseKey mylicencekeyforNewRelic

I can see logs are appearing in New Relic but eventually they seize to appear. On the host, I can see fluent-bit.exe is running and memory is increasing gradually (800MB +).

Would a local database to track monitored files help here. Also, can I specify a single DB for all tail inputs or each one needs its own instance to avoid database locking?

DB C:\Program Files\fluent-bit\iotprocesser.db

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。
列表为空,暂无数据
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文