Solr 代码索引经常失败但没有任何错误

发布于 2025-01-17 12:05:44 字数 3336 浏览 3 评论 0原文

我有大约8-10个核心,可以定期进行索引。最近,这些内核(随机)停止了索引,而Solr日志中没有任何错误。我所能看到的即使在几个小时后仍在进行索引。这是如此随机,以至于我什至无法在这里找出模式或根本原因。

以下是Solr Docker容器的日志线:

对于成功的Delta Import,Solrlog生成如下: 时间:2022-03-23 10:55:41(SuccessLog)

2022-03-23 10:55:41.525 INFO  (qtp136157810-3850) [   x:OMSearch] o.a.s.h.d.DataImporter Loading DIH  Configuration: db-data-config.xml
2022-03-23 10:55:41.526 INFO  (qtp136157810-3850) [   x:OMSearch] o.a.s.h.d.DataImporter Data Configuration loaded successfully
2022-03-23 10:55:41.528 INFO  (qtp136157810-3850) [   x:OMSearch] o.a.s.c.S.Request [OMSearch] webapp=/solr path=/dataimport params={command=delta-import} status=0 QTime=3
2022-03-23 10:55:41.528 INFO  (Thread-5342) [   ] o.a.s.h.d.DataImporter Starting Delta Import
2022-03-23 10:55:41.531 INFO  (Thread-5342) [   ] o.a.s.h.d.SimplePropertiesWriter Read dataimport.properties
2022-03-23 10:55:41.532 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Starting delta collection.
2022-03-23 10:55:41.534 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Running ModifiedRowKey() for Entity: OMSearch
2022-03-23 10:55:41.534 INFO  (Thread-5342) [   ] o.a.s.h.d.JdbcDataSource Creating a connection for entity OMSearch with
 URL: jdbc:mysql://ip:port/database?useSSL=false

- 下几行在失败日志中缺少

2022-03-23 10:55:41.549 INFO  (Thread-5342) [   ] o.a.s.h.d.JdbcDataSource Time taken for getConnection(): 14
2022-03-23 10:55:41.550 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Completed ModifiedRowKey for Entity: OMSearch rows obtained : 0
2022-03-23 10:55:41.550 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Completed DeletedRowKey for Entity: OMSearch rows obtained : 0
2022-03-23 10:55:41.550 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Completed parentDeltaQuery for Entity: OMSearch
2022-03-23 10:55:41.550 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Delta Import completed successfully
2022-03-23 10:55:41.550 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Time taken = 0:0:0.18
2022-03-23 10:55:41.551 INFO  (Thread-5342) [   ] o.a.s.u.p.LogUpdateProcessorFactory [OMSearch]  webapp=/solr path=/dataimport params={command=delta-import} status=0 QTime=3{} 0 25

时间:2022-03-23 10:56:01(在失败时间)solr log以下为OMSearch 生成

2022-03-23 10:56:01.594 INFO  (qtp136157810-4414) [   x:OMSearch] o.a.s.h.d.DataImporter Loading DIH Configuration:db-data-config.xml
2022-03-23 10:56:01.595 INFO  (qtp136157810-4414) [   x:OMSearch] o.a.s.h.d.DataImporter Data Configuration loaded successfully
2022-03-23 10:56:01.595 INFO  (Thread-5344) [   ] o.a.s.h.d.DataImporter Starting Delta Import
2022-03-23 10:56:01.598 INFO  (qtp136157810-4414) [   x:OMSearch] o.a.s.c.S.Request [OMSearch] webapp=/solr path=/dataimport params={command=delta-import} status=0 QTime=4
2022-03-23 10:56:01.601 INFO  (Thread-5344) [   ] o.a.s.h.d.SimplePropertiesWriter Read dataimport.properties
2022-03-23 10:56:01.602 INFO  (Thread-5344) [   ] o.a.s.h.d.DocBuilder Starting delta collection.
2022-03-23 10:56:01.607 INFO  (Thread-5344) [   ] o.a.s.h.d.DocBuilder Running ModifiedRowKey() for Entity: OMSearch
2022-03-23 10:56:01.607 INFO  (Thread-5344) [   ] o.a.s.h.d.JdbcDataSource Creating a connection for entity OMSearch  with URL: jdbc:mysql://ip:port/database?useSSL=false

I have around 8-10 cores which does index periodically. Recently these cores(randomly) have stopped indexing without any error in the solr logs. All I can see is ongoing indexing even after several hours. This is so random that I could not even figure out the pattern or root cause here.

Here are the log lines from solr docker container :

For Successful Delta import, SolrLog generated as below:
Time:2022-03-23 10:55:41 (SuccessLog)

2022-03-23 10:55:41.525 INFO  (qtp136157810-3850) [   x:OMSearch] o.a.s.h.d.DataImporter Loading DIH  Configuration: db-data-config.xml
2022-03-23 10:55:41.526 INFO  (qtp136157810-3850) [   x:OMSearch] o.a.s.h.d.DataImporter Data Configuration loaded successfully
2022-03-23 10:55:41.528 INFO  (qtp136157810-3850) [   x:OMSearch] o.a.s.c.S.Request [OMSearch] webapp=/solr path=/dataimport params={command=delta-import} status=0 QTime=3
2022-03-23 10:55:41.528 INFO  (Thread-5342) [   ] o.a.s.h.d.DataImporter Starting Delta Import
2022-03-23 10:55:41.531 INFO  (Thread-5342) [   ] o.a.s.h.d.SimplePropertiesWriter Read dataimport.properties
2022-03-23 10:55:41.532 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Starting delta collection.
2022-03-23 10:55:41.534 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Running ModifiedRowKey() for Entity: OMSearch
2022-03-23 10:55:41.534 INFO  (Thread-5342) [   ] o.a.s.h.d.JdbcDataSource Creating a connection for entity OMSearch with
 URL: jdbc:mysql://ip:port/database?useSSL=false

-- the below lines are missing in failure log

2022-03-23 10:55:41.549 INFO  (Thread-5342) [   ] o.a.s.h.d.JdbcDataSource Time taken for getConnection(): 14
2022-03-23 10:55:41.550 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Completed ModifiedRowKey for Entity: OMSearch rows obtained : 0
2022-03-23 10:55:41.550 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Completed DeletedRowKey for Entity: OMSearch rows obtained : 0
2022-03-23 10:55:41.550 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Completed parentDeltaQuery for Entity: OMSearch
2022-03-23 10:55:41.550 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Delta Import completed successfully
2022-03-23 10:55:41.550 INFO  (Thread-5342) [   ] o.a.s.h.d.DocBuilder Time taken = 0:0:0.18
2022-03-23 10:55:41.551 INFO  (Thread-5342) [   ] o.a.s.u.p.LogUpdateProcessorFactory [OMSearch]  webapp=/solr path=/dataimport params={command=delta-import} status=0 QTime=3{} 0 25

At Time:2022-03-23 10:56:01(At time of failure) solr log generated as below for OMSearch

2022-03-23 10:56:01.594 INFO  (qtp136157810-4414) [   x:OMSearch] o.a.s.h.d.DataImporter Loading DIH Configuration:db-data-config.xml
2022-03-23 10:56:01.595 INFO  (qtp136157810-4414) [   x:OMSearch] o.a.s.h.d.DataImporter Data Configuration loaded successfully
2022-03-23 10:56:01.595 INFO  (Thread-5344) [   ] o.a.s.h.d.DataImporter Starting Delta Import
2022-03-23 10:56:01.598 INFO  (qtp136157810-4414) [   x:OMSearch] o.a.s.c.S.Request [OMSearch] webapp=/solr path=/dataimport params={command=delta-import} status=0 QTime=4
2022-03-23 10:56:01.601 INFO  (Thread-5344) [   ] o.a.s.h.d.SimplePropertiesWriter Read dataimport.properties
2022-03-23 10:56:01.602 INFO  (Thread-5344) [   ] o.a.s.h.d.DocBuilder Starting delta collection.
2022-03-23 10:56:01.607 INFO  (Thread-5344) [   ] o.a.s.h.d.DocBuilder Running ModifiedRowKey() for Entity: OMSearch
2022-03-23 10:56:01.607 INFO  (Thread-5344) [   ] o.a.s.h.d.JdbcDataSource Creating a connection for entity OMSearch  with URL: jdbc:mysql://ip:port/database?useSSL=false

如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

扫码二维码加入Web技术交流群

发布评论

需要 登录 才能够评论, 你可以免费 注册 一个本站的账号。
列表为空,暂无数据
我们使用 Cookies 和其他技术来定制您的体验包括您的登录状态等。通过阅读我们的 隐私政策 了解更多相关信息。 单击 接受 或继续使用网站,即表示您同意使用 Cookies 和您的相关数据。
原文