从URL KubeFlow管道下载

发布于 2025-02-09 11:41:15 字数 938 浏览 3 评论 0原文

我一直在尝试在本地计算机上创建KubeFlow管道，并创建一个简单的一个组件管道来从给定的URL下载数据。

import kfp
import kfp.components as comp

downloader_op = kfp.components.load_component_from_url(path)

def my_pipeline(url):
  downloader_task = downloader_op(url = url)

如果我通过Python代码执行此管道，则可以正常工作，

client = kfp.Client() 

client.create_run_from_pipeline_func(my_pipeline,arguments=
     {
        'url': 'https://storage.googleapis.com/ml-pipeline-playground/iris-csv-files.tar.gz'
     })

但是当我尝试通过KubeFlow UI执行相同的代码时，它显示出错误。首先，我执行上述代码，该代码使用以下行创建YAML文件，然后在Kubeflow UI中上传YAML文件以创建新运行。 kfp.compiler.compiler（）。compile（pipeline_func = my_pipeline，package_path ='pipeline.yaml'）

它给出以下错误，

This step is in Error state with this message: Error (exit code 1): cannot enter chroot for container named "main": no PID known - maybe short running container

我无法理解为什么它通过UI造成问题以及解决方案是什么。

原文

I have been trying to create a kubeflow pipeline in my local machine and created a simple one component pipeline to download data from a given url.

import kfp
import kfp.components as comp

downloader_op = kfp.components.load_component_from_url(path)

def my_pipeline(url):
  downloader_task = downloader_op(url = url)

This works fine if I execute this pipeline through python code

client = kfp.Client() 

client.create_run_from_pipeline_func(my_pipeline,arguments=
     {
        'url': 'https://storage.googleapis.com/ml-pipeline-playground/iris-csv-files.tar.gz'
     })

But It shows an error when I try to execute the same code through Kubeflow UI.
First I execute the above code which create a yaml file using below line and then upload the yaml file in kubeflow UI to create a new run.
kfp.compiler.Compiler().compile(pipeline_func=my_pipeline,package_path='pipeline.yaml')

It give below error

This step is in Error state with this message: Error (exit code 1): cannot enter chroot for container named "main": no PID known - maybe short running container

I am not able to understand why it creates problems through UI and what is the solution.

分享到QQ

分享到微博