如何将跟踪和测量结果从 ECS 传输到 ElasticSearch？

Question

我想传输 AWS ECS 的跟踪和测量。我制作了一个脚本，使用 aws-otel-collector 收集跟踪和测量结果。

export const service = new awsx.ecs.FargateService("backend", {
    taskDefinitionArgs: { 
                          taskRole: role,  
                          containers: {  
                                         otelCollector: {   
                                                             image: image: "docker.io/amazon/aws-otel-collector",
                                                             essential: true,
                                                             logConfiguration: {
                                                                                   logDriver: "awslogs",
                                                                                   options: {
                                                                                               "awslogs-group": "/ecs/ecs-aws-otel-sidecar-collector",
                                                                                               "awslogs-region": region,
                                                                                               "awslogs-stream-prefix": "ecs",
                                                                                               "awslogs-create-group": "true"
                                                                                            }
                                                                               }
                                                          },
                                      
    
                                         logRuter: {          
                                         
                                           image: "docker.io/amazon/aws-for-fluent-bit:latest",
                                           essential: true,
                                           firelensConfiguration: {
                                                                    "type": "fluentbit",
                                                                    "options":{
                                                                                 "enable-ecs-log-metadata":"true"
                                                                               }
                                                                   },
                                           logConfiguration: {
                                                                logDriver: "awslogs",
                                                                options: {
                                                                            "awslogs-create-group": "true",
                                                                            "awslogs-group": "bakend-log",
                                                                            "awslogs-region": region,
                                                                            "awslogs-stream-prefix": "fluentbit"
                                                                         }
                                                              },
                                            memoryReservation: 50
                                            },

                                           backend: { 
                                                       image: 'steinko/helloworld-backend',
                                                       portMappings: [ backendLb ],
                                                       logConfiguration: {
                                                                            logDriver: "awsfirelens",
                                                                            options: { 
                                                                                         "Name":"es",
                                                                                         "match":"*",
                                                                                         "Port": "9200",
                                                                                         "Host":"efk-elastic",
                                                                                         "Logstash_format":"on",
                                                                                         "Replace_dots" :"on",
                                                                                         "Retry_limit":"false",
                                                                                         "Type":"doc",
                                                                                         "Suppress_Type_Name": "On",
                                                                                         "Cloud_ID": "My_deployment:xxxxxxxxxx",
                                                                                         "Cloud_Auth":"elastic:xxxxxxxxx",
                                                                                         "Index": "backend-index",
                                                                                         "tls": "On",
                                                                                         "tls.verify": "Off"
                                                                                         
                                                                                     }
                                                                        },
                                                       dependsOn: [
                                                                      {
                                                                           containerName: "otelCollector",
                                                                           condition: "START"
                                                                      }
                                                                 ]
                                                     }   
                                                
                                    },                
                                  
                        },
......

我发现可以使用 Dataprepper 传输 痕迹。如何将轨迹和测量结果传输到 eleaticsearch？

Answer 1

在 OTLP 导出器 https://www.elastic.co/guide/en/apm/get-started/current/open-telemetry-elastic.html" rel="nofollow noreferrer">aws-otel-collector 并将其指向您的 Elasticsearch APM 服务器。请参阅您的 ES APM 文档 如何做到这一点。