是否可以在Azure托管实例上执行数据工厂管道作为SQL代理作业的一步?
我目前有一个ETL流程,可以动态构建和执行SQL代理作业,
基于保存在我的数据库中的工作步骤。
这些作业中包含的步骤是调用SSIS软件包,这些软件包将数据从一台服务器移动到另一台服务器和/或在目标服务器上调用已存储的Procs以进行进一步处理。
我正在研究将我们的流程从SQL Server迁移到Azure托管实例所需的内容。
我正在看的具体事情之一是
替换称为SSIS软件包的步骤的可行性
通过执行Azure数据工厂管道或其他实现相同结果的ADF操作的步骤。
到目前为止,我还没有遇到任何例子。
任何人都有使用SQL代理作业访问数据工厂功能的经验吗?
I've currently got an ETL process that dynamically builds and executes SQL Agent Jobs,
based on job Steps that are saved in my database.
Included in these jobs are steps to call SSIS packages that move data from one server to another and/or call stored procs on target servers to do further processing.
I'm looking at what it would take to migrate our process from SQL Server to a Azure Managed Instance.
One of the specific things I'm looking at is
the feasibility of replacing the steps that call the SSIS packages
with steps that execute Azure Data Factory pipelines or other ADF actions that accomplish the same results.
So far I have not run across any examples of this.
Anyone have any experience with accessing Data Factory functionality with SQL Agent Jobs?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
您可以通过SQL代理运行PowerShell脚本,如下MSFT文档中所述:
https://learn.microsoft.com/en-us/sql/powershell/run-windows-powershell-steps-in-sql-sql-server-agent?view = sql-server-server-server-ver16
and and通过PowerShell和ADF REST API,您可以触发ADF管道
You can run powershell scripts via SQL agent as mentioned in below MSFT docs:
https://learn.microsoft.com/en-us/sql/powershell/run-windows-powershell-steps-in-sql-server-agent?view=sql-server-ver16
And via powershell and ADF REST APIS, you can trigger the ADF pipelines