Solr 代码索引经常失败但没有任何错误
我有大约8-10个核心,可以定期进行索引。最近,这些内核(随机)停止了索引,而Solr日志中没有任何错误。我所能看到的即使在几个小时后仍在进行索引。这是如此随机,以至于我什至无法在这里找出模式或根本原因。
以下是Solr Docker容器的日志线:
对于成功的Delta Import,Solrlog生成如下: 时间:2022-03-23 10:55:41(SuccessLog)
2022-03-23 10:55:41.525 INFO (qtp136157810-3850) [ x:OMSearch] o.a.s.h.d.DataImporter Loading DIH Configuration: db-data-config.xml
2022-03-23 10:55:41.526 INFO (qtp136157810-3850) [ x:OMSearch] o.a.s.h.d.DataImporter Data Configuration loaded successfully
2022-03-23 10:55:41.528 INFO (qtp136157810-3850) [ x:OMSearch] o.a.s.c.S.Request [OMSearch] webapp=/solr path=/dataimport params={command=delta-import} status=0 QTime=3
2022-03-23 10:55:41.528 INFO (Thread-5342) [ ] o.a.s.h.d.DataImporter Starting Delta Import
2022-03-23 10:55:41.531 INFO (Thread-5342) [ ] o.a.s.h.d.SimplePropertiesWriter Read dataimport.properties
2022-03-23 10:55:41.532 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Starting delta collection.
2022-03-23 10:55:41.534 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Running ModifiedRowKey() for Entity: OMSearch
2022-03-23 10:55:41.534 INFO (Thread-5342) [ ] o.a.s.h.d.JdbcDataSource Creating a connection for entity OMSearch with
URL: jdbc:mysql://ip:port/database?useSSL=false
- 下几行在失败日志中缺少
2022-03-23 10:55:41.549 INFO (Thread-5342) [ ] o.a.s.h.d.JdbcDataSource Time taken for getConnection(): 14
2022-03-23 10:55:41.550 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Completed ModifiedRowKey for Entity: OMSearch rows obtained : 0
2022-03-23 10:55:41.550 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Completed DeletedRowKey for Entity: OMSearch rows obtained : 0
2022-03-23 10:55:41.550 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Completed parentDeltaQuery for Entity: OMSearch
2022-03-23 10:55:41.550 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Delta Import completed successfully
2022-03-23 10:55:41.550 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Time taken = 0:0:0.18
2022-03-23 10:55:41.551 INFO (Thread-5342) [ ] o.a.s.u.p.LogUpdateProcessorFactory [OMSearch] webapp=/solr path=/dataimport params={command=delta-import} status=0 QTime=3{} 0 25
时间:2022-03-23 10:56:01(在失败时间)solr log以下为OMSearch 生成
2022-03-23 10:56:01.594 INFO (qtp136157810-4414) [ x:OMSearch] o.a.s.h.d.DataImporter Loading DIH Configuration:db-data-config.xml
2022-03-23 10:56:01.595 INFO (qtp136157810-4414) [ x:OMSearch] o.a.s.h.d.DataImporter Data Configuration loaded successfully
2022-03-23 10:56:01.595 INFO (Thread-5344) [ ] o.a.s.h.d.DataImporter Starting Delta Import
2022-03-23 10:56:01.598 INFO (qtp136157810-4414) [ x:OMSearch] o.a.s.c.S.Request [OMSearch] webapp=/solr path=/dataimport params={command=delta-import} status=0 QTime=4
2022-03-23 10:56:01.601 INFO (Thread-5344) [ ] o.a.s.h.d.SimplePropertiesWriter Read dataimport.properties
2022-03-23 10:56:01.602 INFO (Thread-5344) [ ] o.a.s.h.d.DocBuilder Starting delta collection.
2022-03-23 10:56:01.607 INFO (Thread-5344) [ ] o.a.s.h.d.DocBuilder Running ModifiedRowKey() for Entity: OMSearch
2022-03-23 10:56:01.607 INFO (Thread-5344) [ ] o.a.s.h.d.JdbcDataSource Creating a connection for entity OMSearch with URL: jdbc:mysql://ip:port/database?useSSL=false
I have around 8-10 cores which does index periodically. Recently these cores(randomly) have stopped indexing without any error in the solr logs. All I can see is ongoing indexing even after several hours. This is so random that I could not even figure out the pattern or root cause here.
Here are the log lines from solr docker container :
For Successful Delta import, SolrLog generated as below:
Time:2022-03-23 10:55:41 (SuccessLog)
2022-03-23 10:55:41.525 INFO (qtp136157810-3850) [ x:OMSearch] o.a.s.h.d.DataImporter Loading DIH Configuration: db-data-config.xml
2022-03-23 10:55:41.526 INFO (qtp136157810-3850) [ x:OMSearch] o.a.s.h.d.DataImporter Data Configuration loaded successfully
2022-03-23 10:55:41.528 INFO (qtp136157810-3850) [ x:OMSearch] o.a.s.c.S.Request [OMSearch] webapp=/solr path=/dataimport params={command=delta-import} status=0 QTime=3
2022-03-23 10:55:41.528 INFO (Thread-5342) [ ] o.a.s.h.d.DataImporter Starting Delta Import
2022-03-23 10:55:41.531 INFO (Thread-5342) [ ] o.a.s.h.d.SimplePropertiesWriter Read dataimport.properties
2022-03-23 10:55:41.532 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Starting delta collection.
2022-03-23 10:55:41.534 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Running ModifiedRowKey() for Entity: OMSearch
2022-03-23 10:55:41.534 INFO (Thread-5342) [ ] o.a.s.h.d.JdbcDataSource Creating a connection for entity OMSearch with
URL: jdbc:mysql://ip:port/database?useSSL=false
-- the below lines are missing in failure log
2022-03-23 10:55:41.549 INFO (Thread-5342) [ ] o.a.s.h.d.JdbcDataSource Time taken for getConnection(): 14
2022-03-23 10:55:41.550 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Completed ModifiedRowKey for Entity: OMSearch rows obtained : 0
2022-03-23 10:55:41.550 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Completed DeletedRowKey for Entity: OMSearch rows obtained : 0
2022-03-23 10:55:41.550 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Completed parentDeltaQuery for Entity: OMSearch
2022-03-23 10:55:41.550 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Delta Import completed successfully
2022-03-23 10:55:41.550 INFO (Thread-5342) [ ] o.a.s.h.d.DocBuilder Time taken = 0:0:0.18
2022-03-23 10:55:41.551 INFO (Thread-5342) [ ] o.a.s.u.p.LogUpdateProcessorFactory [OMSearch] webapp=/solr path=/dataimport params={command=delta-import} status=0 QTime=3{} 0 25
At Time:2022-03-23 10:56:01(At time of failure) solr log generated as below for OMSearch
2022-03-23 10:56:01.594 INFO (qtp136157810-4414) [ x:OMSearch] o.a.s.h.d.DataImporter Loading DIH Configuration:db-data-config.xml
2022-03-23 10:56:01.595 INFO (qtp136157810-4414) [ x:OMSearch] o.a.s.h.d.DataImporter Data Configuration loaded successfully
2022-03-23 10:56:01.595 INFO (Thread-5344) [ ] o.a.s.h.d.DataImporter Starting Delta Import
2022-03-23 10:56:01.598 INFO (qtp136157810-4414) [ x:OMSearch] o.a.s.c.S.Request [OMSearch] webapp=/solr path=/dataimport params={command=delta-import} status=0 QTime=4
2022-03-23 10:56:01.601 INFO (Thread-5344) [ ] o.a.s.h.d.SimplePropertiesWriter Read dataimport.properties
2022-03-23 10:56:01.602 INFO (Thread-5344) [ ] o.a.s.h.d.DocBuilder Starting delta collection.
2022-03-23 10:56:01.607 INFO (Thread-5344) [ ] o.a.s.h.d.DocBuilder Running ModifiedRowKey() for Entity: OMSearch
2022-03-23 10:56:01.607 INFO (Thread-5344) [ ] o.a.s.h.d.JdbcDataSource Creating a connection for entity OMSearch with URL: jdbc:mysql://ip:port/database?useSSL=false
如果你对这篇内容有疑问,欢迎到本站社区发帖提问 参与讨论,获取更多帮助,或者扫码二维码加入 Web 技术交流群。

绑定邮箱获取回复消息
由于您还没有绑定你的真实邮箱,如果其他用户或者作者回复了您的评论,将不能在第一时间通知您!
发布评论