无法在Docker中的日志文件中写入日志信息

Question

我在Docker工作时生成日志信息有问题。在Localhost中的日志文件中编写日志没有问题。

在Docker期间实现CRUD过程时，我看不到任何新日志。

如何将日志文件（ springboot-elk.log ）连接到docker？

我该如何修复？

是显示屏幕截图的文件：

这 我的项目链接：我的项目

这是 docker-compose.yml 显示下面

version: '3.8'
services:
  logstash:
    image: docker.elastic.co/logstash/logstash:7.15.2
    user: root
    command: -f /etc/logstash/conf.d/
    volumes:
      - ./elk/logstash/:/etc/logstash/conf.d/
      - ./Springboot-Elk.log:/tmp/logs/Springboot-Elk.log
    ports:
      - "5000:5000"
    environment:
      LS_JAVA_OPTS: "-Xmx256m -Xms256m"
    depends_on:
      - elasticsearch

  filebeat:
    build:
      context: ./filebeat
      dockerfile: Dockerfile
    links:
      - "logstash:logstash"
    volumes:
      - /var/run/docker.sock:/host_docker/docker.sock
      - /var/lib/docker:/host_docker/var/lib/docker
    depends_on:
      - logstash
  kibana:
    image: docker.elastic.co/kibana/kibana:7.15.2
    user: root
    volumes:
      - ./elk/kibana/:/usr/share/kibana/config/
    ports:
      - "5601:5601"
    depends_on:
      - elasticsearch
    entrypoint: ["./bin/kibana", "--allow-root"]

  elasticsearch:
    image: docker.elastic.co/elasticsearch/elasticsearch:7.15.2
    user: root
    volumes:
      - ./elk/elasticsearch/elasticsearch.yml:/usr/share/elasticsearch/config/elasticsearch.yml
    ports:
      - "9200:9200"
      - "9300:9300"
    environment:
      ES_JAVA_OPTS: "-Xmx256m -Xms256m"
  app:
    image: 'springbootelk:latest'
    build:
      context: .
      dockerfile: Dockerfile
    container_name: SpringBootElk
    depends_on:
      - db
      - logstash
    ports:
      - '8077:8077'
    environment:
      - SPRING_DATASOURCE_URL=jdbc:mysql://db:3306/springbootexample?useSSL=false&allowPublicKeyRetrieval=true&serverTimezone=Turkey
      - SPRING_DATASOURCE_USERNAME=springexample
      - SPRING_DATASOURCE_PASSWORD=111111
      - SPRING_JPA_HIBERNATE_DDL_AUTO=update
  db:
    container_name: db
    image: 'mysql:latest'
    ports:
      - "3366:3306"
    restart: always
    environment:
      MYSQL_DATABASE: ${MYSQL_DATABASE}
      MYSQL_USER: ${MYSQL_USER}
      MYSQL_PASSWORD: ${MYSQL_PASSWORD}
      MYSQL_ROOT_PASSWORD: ${MYSQL_ROOT_PASSWORD}
    volumes:
      - db-data:/var/lib/mysql

# Volumes
volumes:
  db-data:

是 logstash.conf 如下所示

    input {
        beats {
                port => 5000
        }
        file {
                path => "/tmp/logs/Springboot-Elk.log"
                sincedb_path => "/dev/null"
                start_position => "beginning"
        }
}
output {
        stdout{
                codec => rubydebug
        }
        elasticsearch {
                hosts => "elasticsearch:9200"
                index => "dockerlogs"
        }
}

filebeat.yml 文件如下所示。

filebeat.inputs:
  - type: docker
    enabled: true
    containers:
      ids:
        - "*"
      path: "/host_docker/var/lib/docker/containers"


processors:
  - add_docker_metadata:
      host: "unix:///host_docker/docker.sock"

filebeat.config.modules:
  path: ${path.config}/modules.d/*.yml
  reload.enabled: false

output.logstash:
  hosts: ["logstash:5000"]

log files:
logging.level: info
logging.to_files: false
logging.to_syslog: false
loggins.metrice.enabled: false
logging.files:
  path: /var/log/filebeat
  name: filebeat
  keepfiles: 7
  permissions: 0644
ssl.verification_mode: none

这是 dockerfile filebeat.yml ，

FROM docker.elastic.co/beats/filebeat:7.15.2

COPY filebeat.yml /usr/share/filebeat/filebeat.yml

USER root
RUN mkdir /usr/share/filebeat/dockerlogs
RUN chown -R root /usr/share/filebeat/
RUN chmod -R go-w /usr/share/filebeat/

因为我想在 logstash中看到logs ，我运行此命令docker容器logs -f。 我看不到在Person Controller和PersonService中定义的任何日志。 这是屏幕截图

Answer 1

这是我的回答下面所示。

在我修订了下面显示的logstash.conf文件之后，我的问题被消失了。

input {
        tcp {
                port => 5000
        }
        beats {
                port => 5044
        }
        file {
                path => "/tmp/logs/Springboot-Elk.log"
                sincedb_path => "/dev/null"
                start_position => "beginning"
        }
}
output {
        stdout{
                codec => rubydebug
        }
        elasticsearch {
                hosts => "elasticsearch:9200"
                index => "dockerlogs"
        }
}

Answer 2

与Docker合作时，最好将所有日志写入控制台。这将使在Kubernetes或其他Ochestrators中运行时，可以公开日志。在春季框架上，您可以通过更改为consoleappender来实现这一目标。示例Bellow显示了如何在log4j.xml中实现这一目标。将文件放在您的资源文件夹中并添加log4j依赖项（ref： https：//www.baeldungungungungungungungungungungungungungungungungungung .com/spring-boot-logging ）：

<configuration>
<appender name="consoleAppender" class="ch.qos.logback.core.ConsoleAppender">
    <encoder class="net.logstash.logback.encoder.LogstashEncoder">
        <timeZone>UTC</timeZone>
    </encoder>
</appender>
<logger name="com.yourcompany.packagename" level="INFO">
    <appender-ref ref="consoleAppender" />
</logger>
<root level="ERROR">
    <appender-ref ref="consoleAppender" />
</root>
</configuration>

您仍然可以通过在上面的配置中添加另一个appender将日志配置为磁盘，但是您需要在docker-compose文件中添加一个安装点，以指向日志目录在您的申请上。

很高兴注意到Docker是无状态的，因此当您重新启动容器时，日志会丢失。

Answer 3

对我来说，它有效。但是我的麋鹿堆在Docker中不运行。

这是我的LogStash配置（TCP和UDP的相同配置）：

input {
    tcp {
        port => 5144
        codec => "json"
        type => "logback"
    }

    udp {
        port => 5144
        codec => "json"
        type => "logback"
    }
}

output {
    if [type]=="logback" {
         elasticsearch {
             hosts => ["localhost:9200"]
             index => "logback-%{+YYYY.MM.dd}"
        }
    }
}

您也必须在Kibana中设置记录索引。

这是我的logback-spring.xml：

<?xml version="1.0" encoding="UTF-8"?>
<configuration>
    <springProperty name="mvnVersion" source="info.app.version"/>
    <springProperty name="appName" source="info.app.name"/>
    <springProperty name="tcpLogHost" source="logstash.tcpHost"/>
    <springProperty name="udpLogHost" source="logstash.udpHost"/>
    <springProperty name="udpLogPort" source="logstash.udpPort"/>

    <appender name="stashUdp" class="net.logstash.logback.appender.LogstashUdpSocketAppender">
        <host>${udpLogHost}</host>
        <port>${udpLogPort}</port>
        <layout class="net.logstash.logback.layout.LogstashLayout">
            <customFields>{"appName":"${appName}","env":"${env}","mvnVersion":"${mvnVersion}"}</customFields>
        </layout>
    </appender>

    <appender name="stdout" class="ch.qos.logback.core.ConsoleAppender">
        <encoder>
            <pattern>%d{HH:mm:ss.SSS} [%thread] %-5level %logger{100} - %msg%n</pattern>
        </encoder>
    </appender>

    <root level="debug">
        <appender-ref ref="stashUdp" />
        <appender-ref ref="stdout" />
    </root>

</configuration>

我正在直接记录（UDP）到麋鹿堆栈。

你需要

<dependency>
    <groupId>net.logstash.logback</groupId>
    <artifactId>logstash-logback-encoder</artifactId>
    <version>${logstash.logback.version}</version>
</dependency>

Answer 4

根据您的存储库，您具有logBack用于日志记录的配置，但示例logback 并添加了log4j在您的Maven依赖项中支持。要使logBack工作您只需不排除默认的日志库，然后添加logBack dependenty的较新版本（因为由弹簧启动依赖项的LogBack的Spring Boot依赖版本指定了在您的配置logstash appender -net.logstash.logback.appender.logstashtcpsocketappender中指定。
FE：

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
    <parent>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-parent</artifactId>
        <version>2.6.6</version>
        <relativePath/> <!-- lookup parent from repository -->
    </parent>
    <groupId>com.spingbootelk</groupId>
    <artifactId>main</artifactId>
    <version>0.0.1-SNAPSHOT</version>
    <name>main</name>
    <description>The usage of ELK in Spring Boot</description>
    <properties>
        <java.version>11</java.version>
    </properties>
    <dependencies>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter</artifactId>
        </dependency>

        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-test</artifactId>
            <scope>test</scope>
        </dependency>

        <dependency>
            <groupId>mysql</groupId>
            <artifactId>mysql-connector-java</artifactId>
            <scope>runtime</scope>
        </dependency>

        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-data-jpa</artifactId>
        </dependency>

        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-web</artifactId>
        </dependency>

        <dependency>
            <groupId>org.projectlombok</groupId>
            <artifactId>lombok</artifactId>
            <optional>true</optional>
        </dependency>

        <dependency>
            <groupId>net.logstash.logback</groupId>
            <artifactId>logstash-logback-encoder</artifactId>
            <version>7.1.1</version>
        </dependency>
    </dependencies>

    <build>
        <plugins>
            <plugin>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-maven-plugin</artifactId>
            </plugin>
        </plugins>
    </build>

</project>

但是最好在Internet上找到一个好的指南如何将Spring Boot应用程序记录到正确的LogStash。而且我不建议您将存储库中的配置用于生产目的。