It's a 'classic' ETL scenario and you can certainly do it all in SSIS, the only question is whether you want to or not. With the exception of loading data from a flat file into the database, the steps you describe would probably be easier to implement in Perl, PowerShell or whatever other scripting language you prefer.
Having said that, SSIS does offer some very nice features (logging, configuration, debugging, workflow) and if you might expand the process in future to include extra steps then SSIS is a great way to tie the whole process together and control the execution of those steps.
Personally, I would decide based on the file processing. If it's a simple CSV file, I would probably use SSIS; if it requires regexes or other text parsing, I would do it all in an external script. Or possibly mix the two, and do the parsing in an external script and call it from the SSIS package.
And if you're interested in learning SSIS then this is obviously a good opportunity to start, especially since your boss can't complain about you spending time on 'playing around' with something new.
发布评论
评论(1)
这是一个“经典”的 ETL 场景,您当然可以在 SSIS 中完成这一切,唯一的问题是您是否愿意。除了将数据从平面文件加载到数据库中之外,您描述的步骤可能会更容易在 Perl、PowerShell 或您喜欢的其他脚本语言中实现。
话虽如此,SSIS 确实提供了一些非常好的功能(日志记录、配置、调试、工作流程),如果您将来可能扩展该流程以包含额外的步骤,那么 SSIS 是将整个流程结合在一起并控制执行的好方法。那些步骤。
就我个人而言,我会根据文件处理来决定。如果是简单的 CSV 文件,我可能会使用 SSIS;如果它需要正则表达式或其他文本解析,我会在外部脚本中完成这一切。或者可能将两者混合,并在外部脚本中进行解析并从 SSIS 包中调用它。
如果您有兴趣学习 SSIS,那么这显然是一个很好的开始机会,特别是因为您的老板不能抱怨您花时间“玩弄”新东西。
It's a 'classic' ETL scenario and you can certainly do it all in SSIS, the only question is whether you want to or not. With the exception of loading data from a flat file into the database, the steps you describe would probably be easier to implement in Perl, PowerShell or whatever other scripting language you prefer.
Having said that, SSIS does offer some very nice features (logging, configuration, debugging, workflow) and if you might expand the process in future to include extra steps then SSIS is a great way to tie the whole process together and control the execution of those steps.
Personally, I would decide based on the file processing. If it's a simple CSV file, I would probably use SSIS; if it requires regexes or other text parsing, I would do it all in an external script. Or possibly mix the two, and do the parsing in an external script and call it from the SSIS package.
And if you're interested in learning SSIS then this is obviously a good opportunity to start, especially since your boss can't complain about you spending time on 'playing around' with something new.