考虑 DECS 与 SSIS?
我需要将数据从 Lotus Notes 泵送到 SqlServer 的解决方案。数据将以 2 种模式传输
- 存档数据传输
- 当前数据传输
Sql 中数据的可用性并不重要,数据用于报告。可以每天、每周或每月创建报告。
我正在考虑选择以下解决方案之一:DESC 和 SSIS。您能给我一些关于这两种技术的优缺点的建议吗?如果您提出其他建议,也可以考虑。
DECS - Domino 企业连接服务 SSIS - Sql Sever 集成服务
I need solution to pump data from Lotus Notes to SqlServer. Data will be transfered in 2 modes
- Archive data transfer
- Current data transfer
Availability of data in Sql is not critical, data is used for reports. Reports could be created daily, weekly or monthly.
I am considering to choose from one of those solutions: DESC and SSIS. Could You please give me some tips about prons and cons of both technologies. If You suggest something else it could be also taken into consideration.
DECS - Domino Enterprise Connection Services
SSIS - Sql Sever Integration Services
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。
绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论
评论(3)
我个人经常使用 XML 以其他系统可以轻松读取的方式从 Lotus Notes 获取数据。我建议您看一下,看看是否符合您的需求。您可以创建发出 XML 的视图或使用 NotesAgents 或 Java Servlet,所有这些都可以使用 HTTP 进行访问。
I've personally used XML frequently to get data out of Lotus Notes in a way that can be read easily by other systems. I'd suggest you take a look and see if that fits your needs. You can create views that emit XML or use NotesAgents or Java Servlets, all of which can be accessed using HTTP.
SSIS 是执行复杂 ETL 任务的绝佳工具。如果需要,您甚至可以编写 C# 代码。如果您愿意,已经有许多预先编写的可用数据清理组件可供您下载。它几乎可以做任何你需要做的事情。然而,它确实有一个相当陡峭的学习曲线。 SSIS 随 SQL Server 一起免费提供,因此这是一个优点。我真正喜欢 SSIS 的几件事是记录错误的能力及其处理配置的方式,这样一旦设置好后,将包从开发环境移动到 QA 和 Prod 就很容易了。
我们还建立了一个元数据数据库来记录有关导入的大量信息,例如开始和停止时间、收到文件的时间、处理的记录数、错误类型等。这确实有助于我们的研究数据问题,并帮助我们编写了一些当文件超出正常参数一定量时自动停止的进程。如果您通常收到包含 200 万条记录的文件,而该文件在一天内收到包含 1000 条记录的文件,那么这会很方便。比因为文件损坏而删除 2,000,000 条潜在客户记录要好得多。我们现在还能够对已收到但未处理的文件或预期但未收到的文件进行报告。这极大地改善了我们的进口流程(我们的系统中有数百个进出口)。如果您是从头开始设计,您可能需要花一些时间思考您想要拥有哪些元数据以及随着时间的推移它将如何帮助您。
现在,根据您的工作情况,如果数据也有可能从 Lotus Notes 以外的来源发送到 SQL Server 数据库,以及从您正在开发的 Notes 导入数据,我建议这可能是值得的现在是时候开始使用 SSIS 了,因为其他导入可能就是这样完成的。作为一名数据库人员,我希望我支持的所有导入都使用相同的技术。
我不能对 DECS 说什么,因为我从未使用过它。
SSIS is a terrific tool for complex ETL tasks. You can even write C# code if you need to. There are lots of pre-written available data cleaning components already out there for you to download if you want. It can pretty much do anything you need to do. It does however have a fairly steep learning curve. SSIS comes free with SQL Server so that is a plus. A couple of things I really like about SSIS are the ability to log errors and the way it handles configuration so that moving the package from the dev environment to QA and Prod is easy once you have set it up.
We have also set up a meta data database to record a lot of information about our imports such as the start and stop time, when the file was recieved, the number of records processed, types of errors etc. This has really helped us in researching data issues and has helped us write some processes that are automatically stopped when the file exceeds the normal parameters by a set amount. This is handy if you normally recive a file with 2 million records and the file comes in one day with 1000 records. Much better than delting 2,000,000 potential customer records because you got a bad file. We also now have the ability to do reporting on files that were received but not processed or files that were expected but not received. This has tremendously improved our importing porcesses (we have hundreds of imports and exports in our system). If you are designing from sratch, you might want to take some time and think about what meta data you want to have and how it will help you over time.
Now depending on your situation at work, if there is a possibility that data will also be sent to the SQL Server database from sources other than Lotus Notes as well as the imports from Notes that you are developing for, I would suggest it might be worth your time to go ahead and start using SSIS as that is how the other imports are likely to be done. As a database person, I would prefer to have all the imports I support using the same technology.
I can't say anything about DECS as I have never used it.
只是一个想法 - 但由于 Lotus Notes 的行为往往与关系数据库(或其他任何数据库)有点“不同”,因此使用来自 Notes 世界的工具可能比使用来自 sql 世界的工具更安全。
(我过去使用过 DECS(Domino 8 之前的版本),它在将数据抽取到 SQL Server 数据库方面工作得很好。我没有使用过 SSIS)。
Just a thought - but as Lotus Notes tends to behave a bit "different" than relational databases (or anything else), you might be safer going with a tool which comes out of the Notes world, versus a tool from the sql world.
(I have used DECS in the past (prior to Domino 8) and it has worked fine for pumping data out into a SQL Server database. I have not used SSIS).