Flink Rest API： /JARS /上传返回404

发布于 2025-01-27 04:58:11 字数 1523 浏览 3 评论 0原文

以下是我的代码片段，用于将jar上传到弗林克中。我正在为此帖子请求获得404响应。以下是请求的输出。我还尝试使用/v1/jars/上传更新URL，但响应相同。与罐子相关的所有API都给了我同样的回应。我在AWS Lambda中运行此代码，该代码在同一VPC中存在，其中EMR存在，该代码正在运行我的flink工作。 API喜欢 /config， /在此lambda中工作的工作，只有apis，例如上传jar，提交作业不起作用，并获得404

＆lt;响应[404]＆gt; {“错误”：[“找不到：/jars/upload”]}

也通过直接登录工作管理器节点和运行curl命令来尝试相同的事情，但得到了相同的响应。我在EMR群集上使用Flink 1.14.2版本

curl -x post -h“期望：” -f “ jarfile=@/home/hadoop/test-1.0-global-14-dyn.jar” http：// ip-10-0-1-xxx：8081/jars/upload
{“ errors”：[“找不到：＆gt;/jars/upload”]}

import json
import requests
import boto3
import os

def lambda_handler(event, context):
    
  config = dict(
    service_name="s3",
    region_name="us-east-1"
  )
  s3_ = boto3.resource(**config)

  bucket = "dv-stream-processor-na-gamma"
  prefix = ""
  file = "Test-1.0-global-14-dyn.jar"
  path = "/tmp/"+file;

  try:
    s3_.Bucket(bucket).download_file(f"{file}", "/tmp/"+file)
  except botocore.exceptions.ClientError as e:
    print(e.response['Error']['Code'])   
    if e.response['Error']['Code'] == "404":
        print("The object does not exist.")
        
  print(os.path.isfile('/tmp/' + file))
  response = requests.post(
     "http://ip-10-0-1-xx.ec2.internal:8081/jars/upload",
     files={
              "jarfile": (
                os.path.basename(path), 
                open(path, "rb"),
                "application/x-java-archive"
            )
     }
  )

print(response)
print(response.text)

原文

Following is my code snippet used for uploading Jar in Flink. I am getting 404 response for this post request. Following is the output for request. I also tried updating the url with /v1/jars/upload but same response. All the API related to jars is giving me same response. I am running this code inside AWS lambda which is present in same vpc where EMR exists which is runing my Flink Job. APIs like /config, /jobs working in this lambda, only APIs like upload jar, submit jobs not working and getting 404 for them

<Response [404]> {"errors":["Not found: /jars/upload"]}

Also tried the same thing by directly logging into job manager node and running curl command, but got the same response. I am using Flink 1.14.2 version on EMR cluster

curl -X POST -H "Expect:" -F
"jarfile=@/home/hadoop/test-1.0-global-14-dyn.jar"
http://ip-10-0-1-xxx:8081/jars/upload
{"errors":["Not found:> /jars/upload"]}

import json
import requests
import boto3
import os

def lambda_handler(event, context):
    
  config = dict(
    service_name="s3",
    region_name="us-east-1"
  )
  s3_ = boto3.resource(**config)

  bucket = "dv-stream-processor-na-gamma"
  prefix = ""
  file = "Test-1.0-global-14-dyn.jar"
  path = "/tmp/"+file;

  try:
    s3_.Bucket(bucket).download_file(f"{file}", "/tmp/"+file)
  except botocore.exceptions.ClientError as e:
    print(e.response['Error']['Code'])   
    if e.response['Error']['Code'] == "404":
        print("The object does not exist.")
        
  print(os.path.isfile('/tmp/' + file))
  response = requests.post(
     "http://ip-10-0-1-xx.ec2.internal:8081/jars/upload",
     files={
              "jarfile": (
                os.path.basename(path), 
                open(path, "rb"),
                "application/x-java-archive"
            )
     }
  )

print(response)
print(response.text)

分享到QQ

分享到微博