是否有日志分析查询以获取运行超过24小时的ADF Pipleine细节?

发布于 2025-02-05 09:23:12 字数 427 浏览 2 评论 0原文

我尝试了以下查询以获取正在进行超过1天的管道。 但是,它检索了过去24小时以来一直在进行的管道的结果。

ADFActivityRun
| where TimeGenerated > ago(1d)
| where Status contains "progress"
| extend dataFactory=split(ResourceId, '/')[-1]
| project TimeGenerated, dataFactory, OperationName,Status, PipelineName
| summarize count() by PipelineName, tostring(dataFactory), Status,TimeGenerated

我的要求是仅获取运行超过24小时的管道结果。 有人可以让我知道这是否可能吗?

谢谢!

I tried the below query to get the pipelines that are in progress for more than 1 day.
however it retrieved the results of the pipelines that were once in progress from the past 24 hours.

ADFActivityRun
| where TimeGenerated > ago(1d)
| where Status contains "progress"
| extend dataFactory=split(ResourceId, '/')[-1]
| project TimeGenerated, dataFactory, OperationName,Status, PipelineName
| summarize count() by PipelineName, tostring(dataFactory), Status,TimeGenerated

My requirement is to get only those pipeline results that are running more than 24 hours.
Could anyone please let me know if this is even possible?

Thanks!

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(2

懒的傷心 2025-02-12 09:23:12

以下查询可能对您有用。

ADFPipelineRun
| where TimeGenerated > ago(1d)
| where Status == 'InProgress'
| where RunId !in (( ADFPipelineRun | where Status in ("Succeeded","Failed","Cancelled") | project RunId ))
| where datetime_diff('hour',now(),Start) > 24
| extend dataFactory=split(ResourceId, '/')[-1]
| project TimeGenerated, dataFactory, OperationName,Status, PipelineName
| summarize count() by PipelineName, tostring(dataFactory), Status,TimeGenerated

它将提供inprogress的管道,即使在24小时后也无法完成。

请检查此输出以获取您的参考:

​运行超过24小时,没有显示任何细节。

请检查下面的结果,其中我的管道在一段时间内被输入并失败,但执行时间超过1秒钟。

您可以尝试上述查询以获取运行超过24小时且仍在运行的管道详细信息。

参考:

https:https:// www。 techtalkcorner.com/long-running-azure-data-factory-pipelines/

The below query may work for you.

ADFPipelineRun
| where TimeGenerated > ago(1d)
| where Status == 'InProgress'
| where RunId !in (( ADFPipelineRun | where Status in ("Succeeded","Failed","Cancelled") | project RunId ))
| where datetime_diff('hour',now(),Start) > 24
| extend dataFactory=split(ResourceId, '/')[-1]
| project TimeGenerated, dataFactory, OperationName,Status, PipelineName
| summarize count() by PipelineName, tostring(dataFactory), Status,TimeGenerated

It will give the pipelines which are InProgress and not completed even after 24 hours.

Please check this output for your reference:

enter image description here

As I don’t have any pipelines which are running more than 24 hours, It is not displaying any details.

Please check the below result where my pipelines are InProgress for some time and failed but the execution time is more than 1 second here.
enter image description here

You can try the above query to get pipeline details which are running more than 24 hours and still running.

Reference:

https://www.techtalkcorner.com/long-running-azure-data-factory-pipelines/

汹涌人海 2025-02-12 09:23:12

我建议使用总结Arg_max(...),通过...查找每个ADF管道详细信息的最新状态。查看更多信息在这里

I'd recommend using summarize arg_max(...) by ... to find the latest state of every ADF pipeline details. See more info here.

~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文