Skip to content

Instantly share code, notes, and snippets.

View etiennedi's full-sized avatar
🖥️
enjoying GitHub

Etienne Dilocker etiennedi

🖥️
enjoying GitHub
View GitHub Profile
@etiennedi
etiennedi / output.txt
Created January 5, 2023 20:59
Experimenting with serialized roaring bitmaps
inserting 88000000 elem took 3.651875417s
bm size is 10.525871MB
initializing from buffer took 1.350084ms
sanity check: 10=true 11=false 12=true
build a second bitmap so we can do some intersecting...done
intersecting AND took 8.853708ms
sanity check: 10=true 11=false 12=false
resetting bm
@etiennedi
etiennedi / run_everything.py
Last active July 26, 2023 03:49
Weaviate DistilBERT - Full example
import nltk
import os
import random
import time
import torch
import weaviate
from transformers import AutoModel, AutoTokenizer
from nltk.tokenize import sent_tokenize
torch.set_grad_enabled(False)
package main
import (
"fmt"
"os"
"github.com/creativesoftwarefdn/weaviate/contextionary"
"github.com/creativesoftwarefdn/weaviate/database/schema"
schemaContextionary "github.com/creativesoftwarefdn/weaviate/database/schema_contextionary"
"github.com/creativesoftwarefdn/weaviate/models"