alonisser

1. Uncomment vb.gui=true in the vagrantfile and log in from there. solves a lot of problems, can also sudo reboot from there.
2. To unlock 'guru meditation' mode: navigate to the virtualbox folder and: VBoxManage controlvm <vm> poweroff (notice this the virtualbox full vm name and not the vagrant name)
3. Upgrade to virtualbox 4.16 ,solves 4.14 problems with vagrant 1.2.2
4. Add more memory to the virtualbox (not more than the host machine has)
5. check the bios setting allowing virtualization is enabled

alonisser

bootstrap.servers={{ kafka_cluster.boostrap_servers }}
ssl.endpoint.identification.algorithm=https
security.protocol=SASL_SSL
sasl.mechanism=PLAIN
sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule required username="{{kafka_cluster.username}}" password="{{kafka_cluster.password}}";

alonisser

developing

• vite as a webpack alternative

tools

• valtio - state proxy
• formik forms handling
• react query http queries (or other async with caching

Testing

• mirage.js
• cypress - check integration with mirage

alonisser

# Create the read stream
dataitemsAppendDf =  spark.readStream.format("delta")\
 .option("maxFilesPerTrigger", 25)\
 .table(f"{database_name}.{table_name}")

# Initiate the write stream
dataitemsAppendDf.writeStream \
 .trigger(processingTime='15 seconds') \ # note, you can also have different modes here
 .option("checkpointLocation", f"{checkpoint_name}") \
 .foreachBatch(processRawStreamBatch) \ #Callback that would handle each batch

alonisser

FROM python:3.6-alpine
# Opted for alpine to get a lean docker image as possible
RUN apk add --no-cache openssl

ENV DOCKERIZE_VERSION v0.6.1
RUN wget https://github.com/jwilder/dockerize/releases/download/$DOCKERIZE_VERSION/dockerize-alpine-linux-amd64-$DOCKERIZE_VERSION.tar.gz \
    && tar -C /usr/local/bin -xzvf dockerize-alpine-linux-amd64-$DOCKERIZE_VERSION.tar.gz \
    && rm dockerize-alpine-linux-amd64-$DOCKERIZE_VERSION.tar.gz

# Python deps for alpine

alonisser

alias ll="ls -lhA"
alias cd..="cd .."
alias psg="ps aux | grep -v grep | grep -i -e VSZ -e"
alias ps="ps auxf"
alias mkdir="mkdir -pv"
alias wget="wget -c"
alias histg="history | grep"
alias kedit-secret="KUBE_EDITOR=kube-secret-editor.py kubectl edit secret"

alonisser

#!/bin/bash
#
# Bash script to setup headless Selenium (uses Xvfb and Chrome)
# (Tested on Ubuntu 12.04) trying on ubuntu server 14.04

# Add Google Chrome's repo to sources.list
echo "deb http://dl.google.com/linux/chrome/deb/ stable main" | sudo tee -a /etc/apt/sources.list

# Install Google's public key used for signing packages (e.g. Chrome)
# (Source: http://www.google.com/linuxrepositories/)

alonisser

echo iptables-persistent iptables-persistent/autosave_v4 boolean true | sudo debconf-set-selections
echo iptables-persistent iptables-persistent/autosave_v4 boolean true | sudo debconf-set-selections

sudo apt-get -y install iptables-persistent