Skip to content

Instantly share code, notes, and snippets.

@gordyt
Created May 24, 2018 19:52
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save gordyt/c768d844c2da639db282e3dbb6f4a39b to your computer and use it in GitHub Desktop.
Save gordyt/c768d844c2da639db282e3dbb6f4a39b to your computer and use it in GitHub Desktop.
Testing with feature/ZCS-4437-rebased
2018-05-24 19:44:53,713 WARN [qtp1644443712-152:https:https://zmc.com:8443/service/soap/AutoCompleteRequest] [name=test1@zmc.com;mid=2;ip=10.0.0.19;port=44140;ua=ZimbraWebClient - GC66 (Win)/8.9.0_beta_1000;soapId=61232334;] CloudSolrClient - Re-trying request to collection(s) [mailbox_index] after stale state error from server.
2018-05-24 19:44:53,714 ERROR [qtp1644443712-152:https:https://zmc.com:8443/service/soap/AutoCompleteRequest] [name=test1@zmc.com;mid=2;ip=10.0.0.19;port=44140;ua=ZimbraWebClient - GC66 (Win)/8.9.0_beta_1000;soapId=61232334;] CloudSolrClient - Request to collection [mailbox_index] failed due to (510) org.apache.solr.common.SolrException: Could not find a healthy node to handle the request., retry? 5
2018-05-24 19:44:53,714 WARN [qtp1644443712-152:https:https://zmc.com:8443/service/soap/AutoCompleteRequest] [name=test1@zmc.com;mid=2;ip=10.0.0.19;port=44140;ua=ZimbraWebClient - GC66 (Win)/8.9.0_beta_1000;soapId=61232334;] SoapEngine - handler exception
com.zimbra.common.service.ServiceException: system failure: unexpected error running command com.zimbra.cs.index.solr.SolrUtils$4
ExceptionId:qtp1644443712-152:https:https://zmc.com:8443/service/soap/AutoCompleteRequest:1527191093714:837a94e1243e4726
Code:service.FAILURE
at com.zimbra.common.service.ServiceException.FAILURE(ServiceException.java:288)
at com.zimbra.cs.util.RetryUtil$RequestWithRetry.execute(RetryUtil.java:39)
at com.zimbra.cs.index.solr.SolrUtils.executeCloudRequestWithRetry(SolrUtils.java:305)
at com.zimbra.cs.index.solr.SolrCloudHelper.executeQueryRequest(SolrCloudHelper.java:48)
at com.zimbra.cs.index.solr.SolrIndex$SolrIndexSearcher.docFreq(SolrIndex.java:470)
at com.zimbra.cs.index.LuceneQueryOperation.shouldExecuteDbFirst(LuceneQueryOperation.java:233)
at com.zimbra.cs.index.DBQueryOperation.shouldExecuteDbFirst(DBQueryOperation.java:681)
at com.zimbra.cs.index.DBQueryOperation.peekNext(DBQueryOperation.java:518)
at com.zimbra.cs.index.QueryOperation.hasNext(QueryOperation.java:169)
at com.zimbra.cs.index.ItemPreloadingGrouper.bufferHits(ItemPreloadingGrouper.java:54)
at com.zimbra.cs.index.BufferingResultsGrouper.peekNext(BufferingResultsGrouper.java:73)
at com.zimbra.cs.index.UngroupedQueryResults.peekNext(UngroupedQueryResults.java:57)
at com.zimbra.cs.index.FilteredQueryResults.peekNext(FilteredQueryResults.java:195)
at com.zimbra.cs.index.FilteredQueryResults.hasNext(FilteredQueryResults.java:145)
at com.zimbra.cs.mailbox.ContactAutoComplete.queryFolders(ContactAutoComplete.java:806)
at com.zimbra.cs.mailbox.ContactAutoComplete.query(ContactAutoComplete.java:433)
at com.zimbra.cs.service.mail.AutoComplete.query(AutoComplete.java:95)
at com.zimbra.cs.service.mail.AutoComplete.handle(AutoComplete.java:57)
at com.zimbra.soap.SoapEngine.dispatchRequest(SoapEngine.java:643)
at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:488)
at com.zimbra.soap.SoapEngine.dispatch(SoapEngine.java:275)
at com.zimbra.soap.SoapServlet.doWork(SoapServlet.java:303)
at com.zimbra.soap.SoapServlet.doPost(SoapServlet.java:213)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:707)
at com.zimbra.cs.servlet.ZimbraServlet.service(ZimbraServlet.java:211)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:790)
at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:821)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1685)
at com.zimbra.cs.servlet.CsrfFilter.doFilter(CsrfFilter.java:169)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at com.zimbra.cs.servlet.RequestStringFilter.doFilter(RequestStringFilter.java:54)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at com.zimbra.cs.servlet.SetHeaderFilter.doFilter(SetHeaderFilter.java:59)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at com.zimbra.cs.servlet.ETagHeaderFilter.doFilter(ETagHeaderFilter.java:47)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at com.zimbra.cs.servlet.ContextPathBasedThreadPoolBalancerFilter.doFilter(ContextPathBasedThreadPoolBalancerFilter.java:107)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at com.zimbra.cs.servlet.ZimbraQoSFilter.doFilter(ZimbraQoSFilter.java:125)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at com.zimbra.cs.servlet.ZimbraInvalidLoginFilter.doFilter(ZimbraInvalidLoginFilter.java:117)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at org.eclipse.jetty.servlets.DoSFilter.doFilterChain(DoSFilter.java:473)
at org.eclipse.jetty.servlets.DoSFilter.doFilter(DoSFilter.java:318)
at org.eclipse.jetty.servlets.DoSFilter.doFilter(DoSFilter.java:288)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1668)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:581)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:226)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1158)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:511)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1090)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:213)
at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:109)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:318)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:437)
at org.eclipse.jetty.server.handler.DebugHandler.handle(DebugHandler.java:84)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:119)
at org.eclipse.jetty.server.Server.handle(Server.java:517)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:306)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:242)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:192)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:261)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:95)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:75)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceAndRun(ExecuteProduceConsume.java:213)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:654)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.common.SolrException: Could not find a healthy node to handle the request.
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1097)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:883)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:990)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:990)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:990)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:990)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:990)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:816)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:211)
at com.zimbra.cs.index.solr.SolrUtils$4.execute(SolrUtils.java:284)
at com.zimbra.cs.index.solr.SolrUtils$4.execute(SolrUtils.java:280)
at com.zimbra.cs.util.RetryUtil$RequestWithRetry.execute(RetryUtil.java:22)
... 74 more
@gordyt
Copy link
Author

gordyt commented May 24, 2018

This branch built and deployed fine. All services came up. Was able to provision accounts and login. Got this error when attempting auto-complete of email address when composing a new email message.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment