Schm1tz1

WireGuard Site-to-Site

Accessing a subnet that is behind a WireGuard client using a site-to-site setup

Problem Summary

We want to access a local subnet remotely, but it is behind a NAT firewall and we can't setup port forwarding. Outgoing connections work, but all incoming connections get DROPPED by the ISP's routing policy.

Solution Summary

Schm1tz1

Docker compose environment with Confluent REST Proxy and Control Center

• Control center on http://localhost:9021
• REST proxy listening on localhost:8082

Usage

docker compose up -d 
# please be patient...

Schm1tz1

There doesn't seem to be a good resource online describing the issues with protocol buffers and deterministic serialization (or lack thereof). This is a collection of links on the subject.

Protocol Buffers v3.0.0. release notes:

The deterministic serialization is, however, NOT canonical across languages; it is also unstable across different builds with schema changes due to unknown fields.

Maps documentation:

Wire format ordering and map iteration ordering of map values is undefined, so you cannot rely on your map items being in a particular order.

Schm1tz1

(auth) {
    basicauth {
        docker $2a$14$YzNJVypCD8tl3PidqRs.N.qI1pVMIAGDyAEAnJ/Kwb.bRCId1Hdrq
    }
}

https:// {
    import auth
    reverse_proxy registry-ui:80
    tls /etc/caddy/docker-registry.pem /etc/caddy/docker-registry.key

Schm1tz1

# explicitly define host-ip mappings
address=/myapp.local/172.16.1.2
# dnsmasq entries are always wildcard entries, so this maps both myapp.local and *.myapp.local

# (yes, it's fine for this to be your entire dnsmasq config. the defaults are pretty sensible)

Schm1tz1

Migration from Postman to Insomnia

This describes the steps I performed for my Migration from Postman to Insomnia which I did for several reasons (open vs. closed source, UI and handling, usage of proxies in corporate environments...)

Postman Export

• You need to export each collection / environemnt on its onw. Please select a version that is supported by Insomnia (currently v2). Currently there is no tool for batch-conversion of the dumps so you need to perform this step.

Conversion of Environment Exports

• Postman exports enviroments with quite some metadata - e.g.:

Schm1tz1

Postman / Insomnia with Proxy based on SSH-tunnel

In general, ssh is a powerful tool when it comes to tunneling and (reverse) proxying. All proxy functionalities offered by dynamic port formwarding with -D (or the reverse -R) are limited to SOCKS proxies.

Postman

Postman only supports HTTP proxies. One way to solve this is using https://github.com/oyyd/http-proxy-to-socks.

• Installation and example usage:

Schm1tz1

#!/usr/bin/env bash

echo "Downloading latest release of Julie Ops..."

curl -s https://api.github.com/repos/kafka-ops/julie/releases/latest \
| grep -e "browser_download_url.*FAT.jar.zip" \
| cut -d ":" -f2,3 | tr -d \" \
| wget -q --show-progress -O julie-ops.jar -i -

Schm1tz1

Maven Examples for fat JARs

Maven POM examples to create a (fat) JAR that will pull all dependencies for example projects. It will also create a directory of dependencies.

Examples here: Sentry for log4J v1 and a custom connector in Clojars Artifactory

Usage Example

Run Maven:

mvn package --file pom-clojars.xml

Schm1tz1

#!/bin/bash
set -e

usage="$(basename "$0") [-h] [-i PROJECT] [-v VM] [-p PYTHON] [-d NOTEBOOKS]
Make a user provide SSH key and jupyter notebooks (in roles/bootstrap/files/notebooks) to each user listed in var/common.yml
where:
    -h  show this help text
    -i  google cloud project id
    -v  name of instance/virtual machine
    -p  python path