SSIS - 迁移数据准确性
除了校验和之外,是否还有其他解决方案来检查通过 SSIS 迁移后的数据准确性?
基本上我们需要检查大型数据库的源数据和目标数据是否相同。 谢谢。
Is there any alternate solution beside checksum to check the data accuracy after migration via SSIS?
Basically we need to check the source and target data are same for a huge database.
Thanks.
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
这里有一些想法,其中一些不如其他的好...
创建一些审计表并为您的源和目的地插入一些汇总值(可能是美元金额总和或记录计数)。如果值不匹配,您就需要找出问题。您可以使用 where 语句结合总和来检查其他标志或值。如果可以检查聚合值,则无需检查每一行。
您可以对源表和目标表进行计数。
您可以尝试在源之间的数据源之间进行联接 - 外部联接可能会提供不匹配的数据。
从每个系统导出 .csv 并比较文件 - 做小样本,因为您的数据“巨大”。
Here are some ideas, some not as good as others...
Create some audit tables and insert some summary values (summed dollar amts perhaps or record counts) for your source and destination. If values don't match, you have problems to track down. You can use where statements to check other flags or values in combination with the sum. It is not necessary to check every row if you can check aggregate values.
You could do counts on the source and destination tables.
You could try joins between the data sources between the sources - outer joins could provide non-matching data.
Export .csv from each system and compare files - do small samples since your data is 'huge'.