如何使用 SSIS 包将 MS Access 数据导入 SQL Server?

发布于 2024-11-24 08:02:14 字数 1239 浏览 0 评论 0原文

我花了一天的大部分时间四处寻找任何可以帮助我的东西,但是 SSIS 是一个如此庞大的工具,到目前为止没有任何用处,或者也许我只是不理解它。

我需要将一个有问题的旧 Access 数据库移至 SQL Server 中。我已经在 SQL 数据库中设置了架构。旧数据需要修复,例如标准化和删除重复项。我的老板坚持使用 SSIS 来完成这项工作,因为我们需要有人知道如何使用它,而目前几乎没有人知道(一位经理很久以前就使用过它)。

所以,我在 BDIS、视觉工作室或任何这个应用程序中设置了一个项目。我创建了一个到 Access 数据库的连接管理器,并设法将 OLE DB 源拖到设计器上并将其设置为连接到该数据库。我还发现我可以从那里选择数据。

现在怎么办?我真的更喜欢有一种方法,只编写一个巨大的 SQL 脚本来从 Access 数据库中获取我需要的所有数据,按照我想要的方式转换它,然后将其推送到 SQL Server 数据库中。但看起来我需要在设计器中使用所有这些时髦的转换工具。我也不知道如何将结果数据输入 SQL Server。我在服务器资源管理器窗格中设置了连接,但网上的每个人都说永远不要使用 SQL Server 目标。所以我也在那里迷路了。

我的老板说联机丛书帮助文件非常有用。到目前为止,这就像在沼泽下大海捞针一样,上面坐着三座城堡。信息太多了,但对我来说似乎没有什么用处。

编辑

希望更多信息会有用。我认为 SSIS 附带的向导对于我想要的东西来说不够强大,所以如果它们足够强大,你就必须解释一下。这是我必须做的一个例子,但我的现实是有更多的表和更多的转换。

假设我有一个如下所示的源表:

Companies
====================================================
| Name    | Address    | WidgetOne   | WidgetTwo   |
|--------------------------------------------------|
| ACME    | 123 etc.   | Trampoline  | Cannon      |
====================================================

我需要将其规范化为两个表。显然,它必须跟踪 ID,以便小部件与正确的公司相关联。如果您可以提供一个示例来说明如何使用 SSIS(从 Access 到 SQL Server)处理这种情况,那么我可能可以从那里获取它。谢谢!

I've spend the better part of a day looking around for anything to help me, but SSIS is such a huge tool that nothing is of any use so far, or maybe I just don't understand it.

I need to take an old Access db that has some problems and move it into SQL server. I already have the schema set up in my SQL db. The old data needs to be fixed up, things like normalization and removing duplicates. My boss insists on using SSIS for this job, because we need someone here who knows how to use it, and currently almost no one does (one manager used it a long time ago).

So, I have a project set up in BDIS, or visual studio, or whatever this app actually is. I created a connection manager to my Access db, and I managed to drag an OLE DB Source onto the designer and set it up to connect to that db. I also figured out that I can select data from there.

Now what? I'd really prefer to have a way to just write a giant SQL script to grab all the data I need from the Access db, transform it how I want, and shove it into the SQL server database. But it looks like I'll need to use all these funky transformation tools in the designer. I also can't figure out how I'll get the resulting data into SQL server. I have the connection set up in the Server Explorer pane, but everyone online says never use the SQL Server Destination. So I'm lost there as well.

My boss said the Books Online help files would be very useful. So far, it's been like finding a needle in a haystack submerged under a swamp, with three castles sitting on top of it. There's just too much information, and none of it seems useful to me.

Edit

Hopefully some more information will be useful. I think the wizards that come with SSIS aren't powerful enough for what I want, so if they are, you'll have to please explain it. Here's an example of what I have to do, except my reality is a lot more tables with more transformations.

Say I have a source table that looks like this:

Companies
====================================================
| Name    | Address    | WidgetOne   | WidgetTwo   |
|--------------------------------------------------|
| ACME    | 123 etc.   | Trampoline  | Cannon      |
====================================================

I need to normalize this into two tables. And it will obviously have to track the IDs so that the widgets are associated with the correct company. If you could help with an example of how this case would be handled with SSIS, from Access to SQL server, then I can probably take it from there. Thanks!

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(2

岁月打碎记忆 2024-12-01 08:02:14

以下示例可能会给您提供从 MS Access 到 SQL Server 的数据迁移的想法。该示例使用 MS Access 2010SQL Server 2008 R2 数据库。该包是用 SSIS 2008 R2 编写的。与之前提供的解决方案不同,此答案不使用 SQL Server 导入和导出向导,并且该包是从头开始构建的。

分步过程:

  1. 假设 Access 表如屏幕截图 #1 所示,其中包含一个名为 Companies 的表,其中包含以非规范化方式包含两行。

  2. 还假设 SQL Server 中的表结构如屏幕截图 #2 和 #3 所示,其中有两个名为 dbo.CompanyInfo 和 dbo.WidgetInfo。 SQL 脚本部分下提供了创建表脚本。表是空的,如屏幕截图 #4 所示。

  3. 创建一个新的 SSIS 包。在 SSIS 包上,右键单击连接管理器并选择“新建 OLE DB 连接”,如屏幕截图 #5 所示。在“配置 OLE DB 连接管理器”上,单击“新建...”按钮,如屏幕截图 #6 所示。

  4. 在连接管理器上,选择本机 OLE DB/Microsoft Jet 4.0 OLE DB 提供程序 并提供 Access 文件路径。在此示例中,我的文件位于 C:\temp\Source.mdb 中。单击“确定”。请参阅屏幕截图#7。在“配置 OLE DB 连接管理器”上,单击“确定”,如屏幕截图 #8 所示。将连接管理器名称更改为 AccessDB(该名称可以是您偏好的任何名称)。请参阅屏幕截图 #9

  5. 再次右键单击“连接管理器”并选择“新建 OLE DB 连接”,如屏幕截图 #10 所示。这次我们将为 SQL Server 创建一个连接字符串。选择 Native OLE DB\SQL Server Native Client 10.0 并提供服务器名称和数据库名称,如屏幕截图 #11 所示。将连接管理器重命名为 SQLServer(同样,名称是您的选择)。请参阅屏幕截图 #12

  6. 在 SSIS 包的控制流选项卡上,放置一个数据流任务并将其命名为 Populate CompanyInfo。双击数据流任务,切换到“数据流”选项卡。在数据流任务中,放置一个 OLE DB Source、一个 Derived Transformation 和一个 OLE DB Destination,如屏幕截图 #13 所示注意:您需要按照显示的顺序一项一项地配置任务。不要同时放置所有任务并尝试连接它们。

  7. 配置 OLE DB 源以读取 Access 数据库表,如屏幕截图 #14 和 #15 所示。配置派生转换以将字符串文本从 Access 数据库转换为 Unicode,如屏幕截图 #16 所示。配置 OLE DB 目标以将数据插入 SQL 表,如屏幕截图 #17 和 #18 所示。

  8. 返回“控制流”选项卡并放置另一个数据流任务,如屏幕截图 #19 所示。

  9. 在第二个数据流任务中,我们读取 Access 数据库中的同一个 Companies 表,并尝试在 SQL 中填充 WidgetInfo 表。

  10. 放置一个 OLE DB Source 来读取 Access 表并按照屏幕截图 #20 和 #21 中所示进行配置。放置派生转换以将字符串转换为 Unicode,如屏幕截图 #22 所示。放置查找转换以根据名称和地址获取 CompanyId 并配置任务,如屏幕截图 #23 和 #24 所示。如果找不到匹配项,默认情况下查找任务将会失败。我们需要标准化 Widget 数据。因此,放置一个Unpivot 转换并按屏幕截图#25 所示进行配置。放置一个 OLE DB 目标,将数据插入到 SQL 中并按屏幕截图 #26 和 #27 所示进行配置。第二个数据流任务如屏幕截图所示 #28

  11. 屏幕截图 #29 - #31 显示示例包执行情况。

  12. 屏幕截图 #32 显示包执行后 SQL 表中的数据。

我希望这能够提供将数据从 Access 数据库导出到 SQL Server 的想法。您可以在 Access 中对表进行分组,并将它们加载到单个数据流任务中。如果存在依赖于其他表的表,则您可以将其放置在单独的数据流任务中,如此示例中所示。

希望有帮助。

SQL 脚本:

CREATE TABLE [dbo].[CompanyInfo](
    [Id] [int] IDENTITY(1,1) NOT NULL,
    [CompanyName] [nvarchar](80) NOT NULL,
    [CompanyAddress] [nvarchar](255) NOT NULL,
CONSTRAINT [PK_CompanyInfo] PRIMARY KEY CLUSTERED ([Id] ASC)) ON [PRIMARY]
GO

CREATE TABLE [dbo].[WidgetInfo](
    [Id] [int] IDENTITY(1,1) NOT NULL,
    [CompanyId] [int] NOT NULL,
    [WidgetName] [nvarchar](40) NOT NULL,
CONSTRAINT [PK_WidgetInfo] PRIMARY KEY CLUSTERED ([Id] ASC)) ON [PRIMARY]
GO

屏幕截图 #1:

1

屏幕截图#2:

2

屏幕截图 #3:

3

屏幕截图 #4:

4

屏幕截图 #5:

5

屏幕截图 # 6:

6

屏幕截图 #7:

7

屏幕截图 #8:

8

屏幕截图#9:

9

屏幕截图 #10:

10

屏幕截图 #11:

11

截屏#12:

12

屏幕截图 #13:

13

屏幕截图 #14:

“14”

屏幕截图 #15:

15

屏幕截图 #16:

16

屏幕截图 #17:

17

屏幕截图 #18:

18

屏幕截图 #19:

19

屏幕截图#20:

20

屏幕截图 #21:

21

屏幕截图 #22:

22

屏幕截图 #23:

23

屏幕截图 #24:< /strong>

24

屏幕截图#25:

25

屏幕截图 #26:

26

屏幕截图 #27:

27

屏幕截图#28:

28

屏幕截图 #29:

29

屏幕截图 #30:

“30”

屏幕截图 #31:

31

屏幕截图 #32:

32

Following example probably might give you an idea to perform data migration from MS Access to SQL Server. The example uses MS Access 2010 and SQL Server 2008 R2 database. The package was written in SSIS 2008 R2. Unlike the previously provided solution, This answer doesn't use the SQL Server Import and Export Wizard and the package was built from ground-up.

Step-by-step process:

  1. Let's assume that the Access table is as shown in screenshot #1 with a table named Companies containing two rows in a de-normalized fashion.

  2. And also assuming that the table structure in SQL Server is as shown in screenshots #2 and #3 with two tables named dbo.CompanyInfo and dbo.WidgetInfo. Create table scripts are provided under SQL Scripts section. The tables are empty as shown in screenshot #4.

  3. Create a new SSIS package. On the SSIS package, right-click on the connection manager and select New OLE DB Connection as shown in screenshot #5. On the Configure OLE DB Connection Manager, click New... button as shown in screenshot #6.

  4. On the Connection Manager, select Native OLE DB/Microsoft Jet 4.0 OLE DB Provider and provide the Access file path. In this example, I have the file in C:\temp\Source.mdb. Click OK. Refer screenshot #7. On the Configure OLE DB Connection Manager, click OK as shown in screenshot #8. Change the connection manager name to AccessDB (the name could be anything of your preference). Refer screenshot #9.

  5. Again, right-click on the Connection manager and select New OLE DB Connection as shown in screenshot #10. This time we are going to create a connection string for SQL Server. Select Native OLE DB\SQL Server Native Client 10.0 and provide the Server name and database name as shown in screenshot #11. Rename the connection manager to SQLServer (again, name is your choice). Refer screenshot #12.

  6. On the SSIS package's Control Flow tab, place a Data Flow Task and name it as Populate CompanyInfo. Double-click on the data flow task to switch to the Data Flow tab. Within the Data Flow Task, place an OLE DB Source, a Derived Transformation and an OLE DB Destination as shown in screenshot #13. NOTE: You need to configure the tasks one by one in the order shown. Don't place all the tasks at the same time and try to connect them.

  7. Configure the OLE DB source to read the Access database table as shown in screenshots #14 and #15. Configure the Derived transformation to convert the string text from Access database to Unicode as shown in screenshot #16. Configure the OLE DB Destination to insert the data into SQL table as shown in screenshots #17 and #18.

  8. Go back to Control Flow tab and place another Data Flow Task as shown in screenshot #19.

  9. In the second data flow task, we read the same Companies table in Access database and try to populate the WidgetInfo table in SQL.

  10. Place an OLE DB Source to read the Access table and configure it as hown in screenshots #20 and #21. Place a Derived transformation to convert the string to Unicode as shown in screenshot #22. Place a Lookup transformation to fetch the CompanyId based on the name and address and configure the task as shown in screenshots #23 and #24. Lookup task by default will fail if it can't find a match. We need to normalize the Widget data. So, place an Unpivot transformation and configure it as shown in screenshot #25. Place an OLE DB Destination to insert the data into SQL and configure it as shown in screenshots #26 and #27. Second data flow task would be as shown in screenshot #28

  11. Screenshots #29 - #31 show sample package execution.

  12. Screenshot #32 shows data in the SQL tables after the package execution.

I hope that this should give an idea of exporting data from Access database to SQL server. You can group the tables in Access and load them within a single data flow task. If there are tables depending on other tables, then you can place the in separate data flow task as demonstrated in this example.

Hope that helps.

SQL Scripts:

CREATE TABLE [dbo].[CompanyInfo](
    [Id] [int] IDENTITY(1,1) NOT NULL,
    [CompanyName] [nvarchar](80) NOT NULL,
    [CompanyAddress] [nvarchar](255) NOT NULL,
CONSTRAINT [PK_CompanyInfo] PRIMARY KEY CLUSTERED ([Id] ASC)) ON [PRIMARY]
GO

CREATE TABLE [dbo].[WidgetInfo](
    [Id] [int] IDENTITY(1,1) NOT NULL,
    [CompanyId] [int] NOT NULL,
    [WidgetName] [nvarchar](40) NOT NULL,
CONSTRAINT [PK_WidgetInfo] PRIMARY KEY CLUSTERED ([Id] ASC)) ON [PRIMARY]
GO

Screenshot #1:

1

Screenshot #2:

2

Screenshot #3:

3

Screenshot #4:

4

Screenshot #5:

5

Screenshot #6:

6

Screenshot #7:

7

Screenshot #8:

8

Screenshot #9:

9

Screenshot #10:

10

Screenshot #11:

11

Screenshot #12:

12

Screenshot #13:

13

Screenshot #14:

14

Screenshot #15:

15

Screenshot #16:

16

Screenshot #17:

17

Screenshot #18:

18

Screenshot #19:

19

Screenshot #20:

20

Screenshot #21:

21

Screenshot #22:

22

Screenshot #23:

23

Screenshot #24:

24

Screenshot #25:

25

Screenshot #26:

26

Screenshot #27:

27

Screenshot #28:

28

Screenshot #29:

29

Screenshot #30:

30

Screenshot #31:

31

Screenshot #32:

32

凌乱心跳 2024-12-01 08:02:14

这可能会有所帮助:

  1. 您将需要连接到源数据库和目标数据库。听起来您已经有了源。

  2. 您需要在“控制流”选项卡中执行数据流任务。拖动其中一个并双击 - 您将进入“数据流”选项卡。

  3. 这里添加一个“数据源”(听起来您已经完成了)并添加一个“OLE DB 目标”。

  4. 双击您的来源。您应该能够指定连接(再次看起来您已经这样做了),

  5. “数据访问模式”指定您想要如何检索数据。即直接从表中获取数据,或编写返回数据的查询

  6. 如果它是到目标的直接一对一映射,您应该能够使用绿线(优先约束)将两者连接起来。< /p>

如果您想要执行任何转换,则可以在源查询中执行此操作,或者将转换对象之一放在源和目标之间并相应地连接它们。

This might help:

  1. You'll need connection2 to you source and desination database. It sounds like you already have your source.

  2. You'll need a data flow task in the 'Control Flow' tab. Drag one of these on and double cli ck - you'll be taken to the 'data flow' tab.

  3. here add a 'data source' (which it sounds like you have done) and also add an 'OLE DB Destination'.

  4. Double-click your source. You shoud be able to specify the connection (again it looks like you've done that),

  5. 'Data Access Mode' specifes how you want to retrieve the data. I.e. straight from a table, or write a query that returns the data

  6. if it is a straight one-one mapping to the destination, you should be able to connect the two with a the green line (a precidence constraint).

If you want to do any transformations then you can do so in the query on the soruce, or put one of the transformation obejcts in between the source and destination and connect them accoringly.

~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文