无法使用数据工厂管道将数据从Azure Data Lake Gen2复制到Azure SQL DB
失败在“水槽”一侧发生。 ERRORCODE = USERERRINVALIDCOLUMNNAME,'type = Microsoft.datatransfer.common.shared.hybriddeliveryexception,message = column prop_0在目标方面找不到列prop_0,source = microsoft.datatatransfer.clientlibrary。
ADLS Gen2中的所有零件文件都有8列,而接收器表也有8列,并且在部分文件中没有称为prop_0的列。
adf上的映射 -
=“ nofollow noreferrer”>
Failure happened on 'Sink' side. ErrorCode=UserErrorInvalidColumnName,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The column Prop_0 is not found in target side,Source=Microsoft.DataTransfer.ClientLibrary.
All the part files in the ADLS GEN2 have 8 columns and the sink table also has 8 columns and there is no such column called Prop_0 in part files.
Inputs are part files saved in ADLS GEN2 -
Content of one of the part file -
Mapping on ADF -
Output of sql query executed on Azure query editor -
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
当源文件没有标头时(或在源文件标题时将第一行作为标头)并且未启用列映射选项时,您会收到此错误。
prop_0
,prop_1
等,当源文件没有标头(或未启用)时,将充当列名。在这种情况下,当您禁用列映射选项(清除或跳过)时,仅在匹配您的水槽时,复制活动才会尝试使用源插入列(表)。在下面的图像中,我没有导入架构(跳过),并且在运行管道时会出现相同的错误。
由于您的目标没有
prop_0
列,因此会引发以下错误:请按照下面指定的步骤进行纠正此错误:
导入schemas
(如果需要,请再次清除并导入)。根据您的要求,如有必要,对映射进行更改。You get this error when your source files don’t have a header (or consider first row as header when you have a header for source files) and you have not enabled the column mapping option.
Prop_0
,Prop_1
etc., will act as column names when the source file does not have a header (or not enabled).In this case, when you disable the column mapping option (cleared or skipped), the copy activity will try to insert columns from source using the name, only when they match your sink (table). In the following image, I have not imported the schema (skipped) and it throws the same error when I run the pipeline.
Since your destination does not have
Prop_0
column, it throws the following error:Follow the steps specified below to rectify this error:
import schemas
(Clear and import again if required). Make changes in the mapping if necessary, according to your requirements.