数据集成问题——如何集成相似的实体

发布于 2024-10-09 07:56:00 字数 636 浏览 7 评论 0原文

我有一个数据库，在同一个表中有非常相似的行。这些行很相似，因为它们具有几乎相同的列值。我需要将这些相应的行集成到一行中。

例如，这两个用户（u1 和 u2）应该集成：

 u1 = User(name = "William Henry Gates III",
           age = 55,
           nationality = "american",
           alma_mater = "Harvard Univesity")

 u2 = User(name: "William Henry 'Bill' Gates III",
           age: 55,
           nationality: "America",
           alma_mater: "Harvard U.")

我正在考虑使用一些编辑距离和词干提取技术。其他算法和技术建议？有什么有用的库可以使用（最好是 Python 或 Java）？

原文

I have a database which has very similar rows within the same table. Those rows are similar because they have nearly equal column values. I need to integrate those corresponding rows into one single row.

For example, those two users (u1 and u2) should be integrated:

 u1 = User(name = "William Henry Gates III",
           age = 55,
           nationality = "american",
           alma_mater = "Harvard Univesity")

 u2 = User(name: "William Henry 'Bill' Gates III",
           age: 55,
           nationality: "America",
           alma_mater: "Harvard U.")

I am thinking of using some edit distance and stemming techniques. Other algorithms and techniques suggestions? Any helpful libraries to use (preferably in Python or Java)?

分享到QQ

分享到微博