将平面文件加载到 SQL Server 的框架
我必须将平面文件导入 SQL Server。到目前为止,我已经使用 SSIS 包和 Delphi 程序来完成这项工作,但我要加载的文件越来越多。许多都非常宽(超过 90 个字段),并且都有自己的特点:有些是固定宽度的,有些是使用用作字段和行分隔符的宽字符集来分隔的,有些使用“始终插入”模式,而另一些则使用“始终插入”模式使用“更新或插入”等。许多文件的大小为几千兆字节,这使得处理它们变得更加困难。
现在我开始想知道是否有更好的方法来处理这个问题:一些专门用于完成此类工作的工具可以以合理的方式使用:SSIS 很好,但坦率地说,使用 GUI完成 99% 的工作使得在处理非琐碎任务时完全不切实际。
有人愿意提出解决方案吗?
I have to import flat files into SQL Server. So far, I've used SSIS packages and Delphi programs to do the job but I'm getting more and more files to load. Many are very wide (more than 90 fields) and they all have their own specifics: some are fixed-width, some are delimited with a wide set of characters used as field and row delimiter, some use a "always insert" pattern while others use "update or insert", etc. many of these files are several gigabytes in size making it even harder to handle them.
Now I'm starting to wonder if there isn't a better way to handle this: some tool dedicated to doing that kind of work that could be used in a rational way: SSIS is nice but, frankly, the use of a GUI to do 99% of the work makes it completely impractical when dealing with non-trivial tasks.
Would anyone care to suggest a solution ?
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(1)
您可以使用批量加载格式文件。
描述:
http://msdn.microsoft.com/en-us/library/ms189636。 ASPX
You may use the format file bulk load.
Description:
http://msdn.microsoft.com/en-us/library/ms189636.aspx