Navigation Menu

Skip to content

Instantly share code, notes, and snippets.

View umeshdangat's full-sized avatar

Umesh Dangat umeshdangat

View GitHub Profile
@umeshdangat
umeshdangat / Missing_Impl
Created November 29, 2021 23:11
Guice Named Annotation
com.google.inject.CreationException: Unable to create injector, see the following errors:
1) [Guice/MissingImplementation]: No implementation for ContentDownloader was bound.
Did you mean?
ContentDownloader annotated with @Named("contentDownloaderNoTar") bound at ArchiverModule.providesContentDownloaderNoTar(ArchiverModule.java:94)
\_ installed by: LuceneServerModule -> ArchiverModule
ContentDownloader annotated with @Named("contentDownloaderWithTar") bound at ArchiverModule.providesContentDownloaderWithTar(ArchiverModule.java:112)
\_ installed by: LuceneServerModule -> ArchiverModule
@umeshdangat
umeshdangat / Invalid_primaryGenException
Created July 20, 2020 20:22
Invalid_primaryGenException
WARNING: error while trying to start index talk_v1 [3/1064]
com.yelp.nrtsearch.server.luceneserver.StartIndexHandler$StartIndexHandlerException: org.apache.lucene.replicator.nrt.NodeCommunicationException: exc while reading files to copy
at com.yelp.nrtsearch.server.luceneserver.StartIndexHandler.handle(StartIndexHandler.java:103)
at com.yelp.nrtsearch.server.grpc.LuceneServer$LuceneServerImpl.startIndex(LuceneServer.java:438)
at com.yelp.nrtsearch.server.grpc.LuceneServerGrpc$MethodHandlers.invoke(LuceneServerGrpc.java:2352)
at io.grpc.stub.ServerCalls$UnaryServerCallHandler$UnaryServerCallListener.onHalfClose(ServerCalls.java:172)
at io.grpc.PartialForwardingServerCallListener.onHalfClose(PartialForwardingServerCallListener.java:35)
at io.grpc.ForwardingServerCallListener.onHalfClose(ForwardingServerCallLi
umesh@C02VR3V9HTD8:~/pg/nrtsearch$ curl localhost:8081/status/metrics
# HELP grpc_server_handled_latency_seconds Histogram of response latency (seconds) of gRPC that had been application-level handled by the server.
# TYPE grpc_server_handled_latency_seconds histogram
grpc_server_handled_latency_seconds_bucket{grpc_type="UNARY",grpc_service="luceneserver.LuceneServer",grpc_method="metrics",le="0.005",} 1.0
grpc_server_handled_latency_seconds_bucket{grpc_type="UNARY",grpc_service="luceneserver.LuceneServer",grpc_method="metrics",le="0.01",} 1.0
grpc_server_handled_latency_seconds_bucket{grpc_type="UNARY",grpc_service="luceneserver.LuceneServer",grpc_method="metrics",le="0.025",} 2.0
grpc_server_handled_latency_seconds_bucket{grpc_type="UNARY",grpc_service="luceneserver.LuceneServer",grpc_method="metrics",le="0.05",} 2.0
grpc_server_handled_latency_seconds_bucket{grpc_type="UNARY",grpc_service="luceneserver.LuceneServer",grpc_method="metrics",le="0.075",} 2.0
grpc_server_handled_latency_seconds_bucket{grpc_type
umesh@C02VR3V9HTD8:~/pg/platypus$ ./gradlew buildDocs [14/1859]
Error during callback
java.net.SocketException: Cannot find method "setCreated" in java.net.Socket. Unsupported JVM?
at org.newsclub.net.unix.NativeUnixSocket.setCreated(Native Method)
at org.newsclub.net.unix.AFUNIXSocket.setIsCreated(AFUNIXSocket.java:54)
at org.newsclub.net.unix.AFUNIXSocket.<init>(AFUNIXSocket.java:48)
at org.newsclub.net.unix.AFUNIXSocket.newInstance(AFUNIXSocket.java:77)
at org.newsclub.net.unix.AFUNIXSocket.newInstance(AFUNIXSocket.java:72)
at com.github.dockerjava.jaxrs.ApacheUnixSocket.<init>(ApacheUnixSocket.java:51)
at com.github.dockerjava.jaxrs.UnixConnectionSocketFactory.createSocket(UnixConnectionSocketFactory.java:66)
diff --git a/src/main/java/org/apache/platypus/server/luceneserver/ShardState.java b/src/main/java/org/apache/platypus/server/luceneserver/ShardState.java
index 273c352..5403c61 100644
--- a/src/main/java/org/apache/platypus/server/luceneserver/ShardState.java
+++ b/src/main/java/org/apache/platypus/server/luceneserver/ShardState.java
@@ -314,17 +314,21 @@ public class ShardState implements Closeable {
*/
public synchronized long commit() throws IOException {
- long gen;
+ long gen = -1;
@umeshdangat
umeshdangat / platypus_api.png
Last active October 4, 2019 19:35
platypus protobuff api
platypus_api.png
@umeshdangat
umeshdangat / platypus_api.png
Created October 4, 2019 19:24
Platypus API
snapshot of platypus api
@umeshdangat
umeshdangat / concurrent modification exception
Created September 21, 2018 15:37
concurrent modification exception
[2018-09-18T14:58:39,115][DEBUG][o.e.a.s.TransportSearchAction] [10-40-23-13-uswest1cdevc.dev.yelpcorp.com] [2018-08-17-americas_west_south_dev][18], node[dw3mfBeQSGiDt5Ti7Y7jCA], [R], s[STARTED], a[id=O0t1MmPWTKSbLV9gxu2FuA]: Failed to execute [SearchRequest{searchType=QUERY_THEN_FETCH, indices=[americas_west_south_dev], indicesOptions=IndicesOptions[id=38, ignore_unavailable=false, allow_no_indices=true, expand_wildcards_open=true, expand_wildcards_closed=false, allow_aliases_to_multiple_indices=true, forbid_closed_indices=true, ignore_aliases=false], types=[], routing='null', preference='null', requestCache=null, scroll=null, maxConcurrentShardRequests=80, batchedReduceSize=512, preFilterShardSize=128, allowPartialSearchResults=true, source={"from":0,"size":10,"query":{"function_score":{"query":{"bool":{"filter":[{"geo_bounding_box":{"location":{"top_left":[-117.56195068359376,33.135251282563836],"bottom_right":[-116.74346923828124,32.442567075075075]},"validation_method":"STRICT","type":"MEMORY","ignore_u
dcausse [8:05 AM]
@umesh do you use ScriptFeature in the scenario where the query cache fails? This is the only query in the ltr plugin that may perform a hashCode/equals on a mutable object.
Also when you said you returned false from isCacheable() you also had to do it from the ConstantScoreWeight returned from RankerQuery::createWeight ?
For me the scenario for this to happen would be:
you use named filters to do logging (using _name = 'ltr_query_log' on sltr) under a filter, this will force the query to be cached
when logging it'll reuse the same Query object but will populate the FeatureSupplier in LtrScript query causing hashCode to change (edited)
umesh [8:15 AM]
do you use ScriptFeature in the scenario where the query cache fails? yes