Azure认知搜索的工具类似于Logstash?

发布于 2025-01-23 06:33:19 字数 286 浏览 0 评论 0 原文

我公司有很多数据(数据库:PostgreSQL),现在要求添加搜索功能,我们被要求使用Azure认知搜索。 我想知道我们如何转换数据并将其发送到Azure搜索引擎。 我们必须处理的情况很少:

  1. 我们将如何转移和上传搜索引擎的索引以获取现有数据?
  2. 在我们的生产数据库中使用新记录更新搜索引擎上的数据的简便方法是什么? 3.当现有数据库结构有更新时,管理哪种方法是什么?我们将如何通过每次创建索引器来更新索引器而无需进行大量工作?

无论如何,我们是否可以在数据库记录中发生更改时自动更新索引。

My company has lots of data(Database: PostgreSQL) and now the requirement is to add search feature in that,we have been asked to use Azure cognitive search.
I want to know that how we can transform the data and send it to the Azure search engine.
There are few cases which we have to handle:

  1. How will we transfer and upload on index of search engine for existing data?
  2. What will be the easy way to update the data on search engine with new records in our Production Database?(For now we are using Java back end code for transforming the data and updating the index, but it is very time consuming.)
    3.What will be the best way to manage when there's an update on existing database structure? How will we update the indexer without doing lots of work by creating the indexers every time?

Is there anyway we can automatically update the index whenever there is change in database records.

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。

评论(2

不疑不惑不回忆 2025-01-30 06:33:19

您可以通过/doc/index api ,或者您可以配置Azure搜索索引器来进行数据摄入。配置索引器进行摄入的好处是,您还可以将其配置为在时间表上监视数据源以进行更新,并将这些更新反映在搜索索引中。例如,通过 sql集成更改跟踪策略

PostgreSQL是一个支持的数据源对于Azure搜索索引器,尽管DataSource在预览中(通常不可用)。

You can either write code to push data from your PostgreSQL database into the Azure Search index via the /docs/index API, or you can configure an Azure Search Indexer to do the data ingestion. The upside of configuring an Indexer to do the ingestion is that you can also configure it to monitor the datasource on a schedule for updates, and have those updates reflected into the search index automatically. For example via SQL Integrated Change Tracking Policy

PostgreSQL is a supported datasource for Azure Search Indexers, although the datasource is in preview (not get generally available).

放飞的风筝 2025-01-30 06:33:19

除了上面的答案涉及在您的末尾进行编码之外,您还可以使用 azure数据出厂后的postgresql连接器带有自定义查询,该查询跟踪最近的记录,并创建一个陷入Azure Blob存储帐户的管道活动。
然后,在数据工厂内您可以链接到在管道中添加一个触发器以在指定的时间运行。

一旦上演数据以delimitedText格式在存储帐户中,您也可以使用inden in https://learn.microsoft.com/en-us/azure/search /search-howto-indexing-azure-blob-storage“ rel =“ nofollow noreferrer”> azure blob indexer 启用了更改跟踪。

Besides the answer above that involves coding on your end, there is a solution you may implement using Azure Data Factory PostgreSQL connector with a custom query that tracks for recent records and create a Pipeline Activity that sinks to an Azure Blob Storage account.
Then within Data Factory you can link to a Pipeline Activity that copies to an Azure Cognitive Search index and add a trigger to the pipeline to run at specified times.
enter image description here

Once the staged data is in the storage account in delimitedText format, you can also use built-in Azure Blob indexer with change tracking enabled.

~没有更多了~
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文