Skip to content

Instantly share code, notes, and snippets.

View janhoy's full-sized avatar

Jan Høydahl janhoy

View GitHub Profile
@janhoy
janhoy / solr-dependency-report.txt
Created February 25, 2022 09:38
Solr dependency scan
> Task :dependencyUpdates
------------------------------------------------------------
: Project Dependency Updates (report to plain text file)
------------------------------------------------------------
The following dependencies are using the latest milestone version:
- ca.cutterslade.analyze:ca.cutterslade.analyze.gradle.plugin:1.8.3
- com.cybozu.labs:langdetect:1.1-20120112
- com.diffplug.spotless:com.diffplug.spotless.gradle.plugin:6.3.0
@janhoy
janhoy / Solr dependencies main.txt
Created February 23, 2022 13:09
Solr dependencies
runtimeClasspath - Runtime classpath of source set 'main'.
+--- project :solr:core
| +--- org.apache.lucene:lucene-core:9.0.0
| +--- org.apache.lucene:lucene-analysis-common:9.0.0
| | \--- org.apache.lucene:lucene-core:9.0.0
| +--- org.apache.lucene:lucene-queries:9.0.0
| | \--- org.apache.lucene:lucene-core:9.0.0
| +--- org.slf4j:slf4j-api:1.7.36
| +--- project :solr:solrj
| | +--- org.eclipse.jetty.http2:http2-client:9.4.44.v20210927
@janhoy
janhoy / branchToTag.sh
Last active March 10, 2021 22:21
branchToTag.sh
#!/bin/bash
branctotag() {
BRANCH=$1
REMOTE=$2
if [[ $# -lt 2 ]]; then
echo "Usage: ./branchToTag.sh <branch-name> <remote>"
echo "Example: ./branchToTag.sh jira/SOLR-123 origin"
echo " ...will create tag history/branches/lucene-solr/jira/SOLR-123 and delete the branch"
exit 0
@janhoy
janhoy / split_shard.md
Created March 4, 2021 13:12
Splitting a shard in Solr
@janhoy
janhoy / solr_redirects.conf
Created March 4, 2021 10:38
solr_redirects.conf
#### https://issues.apache.org/jira/browse/SOLR-10595
# ############# NOTE TO INFRA ##################
#
# The RewriteCond/RewriteRules below were tested in a mocked up system where
# they were placed in an .htaccess, and the following RewriteMap directives existed
# for the VirtualHost being used...
#
RewriteMap solr_id_to_new "txt:/home/hossman/tmp/solr_id_to_new.map.txt"
@janhoy
janhoy / PYRAMID.txt
Created March 1, 2021 14:57
failures-pdf
This file has been truncated, but you can view the full file.
sia-crawler_1 | 2021-02-26 16:53:09.205 [pool-2-thread-2] WARN no.ra.sia.crawler.util.PyramidTiffConverter - /mnt/arkiv/foto/ra3/Fotografer/Arve_Kjersheim/Kåfjord/2018_okt/_DSC0764.tif -- convert-im6.q16: Sanity check on directory count failed, zero tag directories not supported. `TIFFFetchDirectory' @ error/tiff.c/TIFFErrors/604.
sia-crawler_1 | 2021-02-26 16:53:09.205 [pool-2-thread-2] WARN no.ra.sia.crawler.util.PyramidTiffConverter - /mnt/arkiv/foto/ra3/Fotografer/Arve_Kjersheim/Kåfjord/2018_okt/_DSC0764.tif -- convert-im6.q16: Failed to read directory at offset 108485848. `TIFFReadDirectory' @ error/tiff.c/TIFFErrors/604.
sia-crawler_1 | 2021-02-26 16:53:09.205 [pool-2-thread-2] WARN no.ra.sia.crawler.util.PyramidTiffConverter - /mnt/arkiv/foto/ra3/Fotografer/Arve_Kjersheim/Kåfjord/2018_okt/_DSC0764.tif -- convert-im6.q16: no images defined `ptif:/mnt/sia/ptif/4/4f/4fWwUNZm7ZorYykAUasH6K.tif' @ error/convert.c/ConvertImageCommand/3258.
sia-crawler_1 | 2021-02-26 16:53:14.504 [pool-2-thread-2] WARN

Start Solr with Docker and create a core with our config:

docker run --rm --name solr-example -v $(pwd):/docker -p 8983:8983 -d solr:8.5
docker exec solr-example solr create -p 8983 -c Collection -d /docker/Collection/conf

Index one nested block-join document with two children, each having each one child.

@janhoy
janhoy / docker-compose.prod.yml.diff
Created June 10, 2020 12:33
Quepid docker-compose with AWS RDS
Index: docker-compose.prod.yml
IDEA additional info:
Subsystem: com.intellij.openapi.diff.impl.patch.CharsetEP
<+>UTF-8
===================================================================
--- docker-compose.prod.yml (revision 6d9f483b484d920e577a2ff1c4fe185067dcbe69)
+++ docker-compose.prod.yml (date 1591792329875)
@@ -1,18 +1,8 @@
# Docker Compose file for running Quepid in Production mode.
# Allows you to update your Quepid installation over time.
@janhoy
janhoy / log.txt
Created June 10, 2020 11:20
Upgrade to 6.2 prerelease migration failure
$ docker-compose run --rm app bin/rake db:migrate
Pulling app (o19s/quepid:6.2-prerelease)...
6.2-prerelease: Pulling from o19s/quepid
7568c21980bd: Pull complete
4a9f2207c812: Pull complete
6fe350d2b140: Pull complete
d95a2fdc8b3d: Pull complete
760eb225f9e8: Pull complete
6ba1f6b9517b: Pull complete
ce86e3018f7e: Pull complete
@janhoy
janhoy / Dockerfile
Last active June 10, 2020 10:18
quepid-full-failure
FROM o19s/quepid:latest
# Install dependencies
WORKDIR /srv/app
COPY Gemfile Gemfile.lock ./
RUN bundle install
# Install dependencies
WORKDIR /srv/app
COPY Gemfile Gemfile.lock ./
RUN bundle install