Skip to content

Instantly share code, notes, and snippets.

View vthacker's full-sized avatar

Varun Thacker vthacker

  • Slack
  • San Francisco
View GitHub Profile
@vthacker
vthacker / StructuredConcurrencyTest
Last active October 8, 2023 01:59
Fan out queries and aggregate results. Some queries can take too long and some might throw exception.
class StructuredConcurrencyTest {
public static void main(String[] args) {
Test test = new Test();
test.query();
}
}
class Test {
public void query() {
try (CollectingScope<String> scope = new CollectingScope<>()) {
public static void main(String args[]) {
Jep338FullMaskVectorOperations test = new Jep338FullMaskVectorOperations();
float[] a = new float[]{1.0f, 2.0f, 2.0f, 1.0f, 1.0f, 1.0f, 1.0f};
float[] b = new float[]{3.0f, 4.0f, 8.0f, 9.9f, 1.0f, 1.0f, 1.0f};
// this returns NaN
// That's because "int bound = species.loopBound(v1.length);" returns 0 when length <=7 on my macbook pro
// which means the for loop is never executed.
// I think in this example we'd need to change the for loop to be v1.length?
System.out.println(test.cosineSimilarity(a,b));
}
// Method that overrides the gRPC
@Override
public void search(
SearchRequest request,
StreamObserver<SearchResult> responseObserver) {
doSearch(request)
.whenCompleteAsync(
(result, t) -> {
{
"@timestamp": {
"$resolver": "timestamp",
"pattern": {
"format": "yyyy-MM-dd'T'HH:mm:ss.SSS'Z'",
"timeZone": "UTC"
}
},
"level": {
"$resolver": "level",
[junit4] 2> 1954119 WARN (zkConnectionManagerCallback-3743-thread-1-EventThread) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed
[junit4] 2> 1954119 INFO (zkConnectionManagerCallback-3743-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient Connected:false
[junit4] 2> 1954120 INFO (zkConnectionManagerCallback-3743-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1954120 INFO (zkConnectionManagerCallback-3743-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
[junit4] 2> 1954120 INFO (zkConnectionManagerCallback-3743-thread-1-EventThread) [ ] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration.
[junit4] 2> 1954124 INFO (zkConnectionManagerCallback-3743-thread-1-EventThread) [ ] o.a.s.c.OverseerElectionContext I am going to be the leader dummy.host.com:8984_solr
[junit4] 2> 1954125 INFO
2017-12-14 17:42:40.079 INFO (updateExecutor-2-thread-88620-processing-n:host05.domain:8985_solr) [c:collection_name s:shard4_3 r:core_node86 x:collection_name_shard4_3_replica2] o.a.s.u.DefaultSolrCoreState Running recovery
2017-12-14 17:42:40.083 INFO (recoveryExecutor-3-thread-11-processing-n:host05.domain:8985_solr x:collection_name_shard4_3_replica2 s:shard4_3 c:collection_name r:core_node86) [c:collection_name s:shard4_3 r:core_node86 x:collection_name_shard4_3_replica2] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=false
2017-12-14 17:44:20.269 INFO (recoveryExecutor-3-thread-11-processing-n:host05.domain:8985_solr x:collection_name_shard4_3_replica2 s:shard4_3 c:collection_name r:core_node86) [c:collection_name s:shard4_3 r:core_node86 x:collection_name_shard4_3_replica2] o.a.s.u.PeerSync PeerSync: core=collection_name_shard4_3_replica2 url=https://host05.domain:8985/solr Received 199819 versions from https://host04.domain:8983/solr/collection_name_shard4_3_replica1/
INFO - 2017-11-14 23:17:27.309; [ ] org.apache.solr.handler.admin.CollectionsHandler; Invoked Collection Action :splitshard with params action=splitshard&shard=shard1_1&collection=test_split and sendToOCPQueue=true
DEBUG - 2017-11-14 23:17:27.336; [ ] org.apache.solr.cloud.OverseerCollectionMessageHandler; OverseerCollectionMessageHandler.processMessage : splitshard , {
"collection":"test_split",
"shard":"shard1_1",
"operation":"splitshard"}
INFO - 2017-11-14 23:17:27.336; [ ] org.apache.solr.cloud.SplitShardCmd; Split shard invoked
DEBUG - 2017-11-14 23:17:27.336; [ ] org.apache.solr.common.cloud.ZkStateReader; Refreshing lazily-loaded state for collection test_split
INFO - 2017-11-14 23:17:27.359; [ ] org.apache.solr.cloud.SplitShardCmd; Creating slice shard1_1_0 of collection test_split on 192.168.10.101:8984_solr
DEBUG - 2017-11-14 23:17:27.382; [ ] org.apache.solr.cloud.OverseerCollectionMessageHandler; Waiting for slice shard1_1_0 of collection test_split to be available
DEBUG - 201
@vthacker
vthacker / gist:ac9bc34681aa56b3a89f
Last active August 29, 2015 14:16
Ref Guide Fusion Crawl
{
"responseHeader":{
"status":0,
"QTime":0,
"params":{
"q":"*",
"indent":"on",
"wt":"json"}},
"response":{"numFound":1,"start":0,"docs":[
{
@vthacker
vthacker / gist:971d7f2d3ff472746b53
Created March 11, 2015 09:19
getBestCreateUrl AutoAddReplicas
static String getBestCreateUrl(ZkStateReader zkStateReader, DownReplica badReplica, Integer maxCoreCount) {
assert badReplica != null;
assert badReplica.collection != null;
assert badReplica.slice != null;
Map<String,Counts> counts = new HashMap<>();
ValueComparator vc = new ValueComparator(counts);
Set<String> liveNodes = new HashSet<>(zkStateReader.getClusterState().getLiveNodes());
Map<String, Integer> coresPerNode = new HashMap<>();
import java.io.IOException;
import java.nio.charset.Charset;
import java.nio.file.Files;
import java.nio.file.Paths;
import java.nio.file.StandardOpenOption;
import java.util.ArrayList;
import java.util.List;
public class ParseWordNet {