Skip to content

Instantly share code, notes, and snippets.

@dzlab
dzlab / text.sh
Last active April 14, 2016 16:29
Some useful text manipulation commands (sed, gawk, etc.)
# print the number of columns
gawk '{print NF}' file | sort -nu | tail -n 1
# Use head -n 1 for lowest column count, tail -n 1 for highest column count.
# print columns
gawk '{print $0}' file # all columns
gawk '{print $4}' file # 4th column
gawk -F "," '{print $2}' file # specific separator
# split a string with a delimiter into lines
@dzlab
dzlab / commands.sh
Last active April 14, 2016 16:29
A collection of commands
# Virtualbox: Mount the shared folder
sudo mount -t vboxsf temp Shared
# process listening on a port (e.g. 5000)
lsof -i :5000 # find the process
lsof -i :80 # find the program running on a port
kill -9 PID # kill process
sudo netstat -lpn |grep :5000
netstat -tan | grep ':80 ' | awk '{print $6}' | sort | uniq -c # view list of connections and their states
ss -rota | less # list all connections and timers
@dzlab
dzlab / bosh-lite-cf-installer
Last active June 8, 2018 17:22
CloudFoundry Bosh Lite installer script
#!/usr/bin/env bash
##
## This script install prerequisites: git, virtualbox, vagrant, ruby/rubygems.
## Then, it boots up bosh-lite in a local Vagrant/Virtualbox VM,
## then uploads and deploys Cloud Foundry into it.
## Finally, it logs into Cloud Foundry as an admin user,
## creates an initial organization and space,
## then deploys an example application.
##
apiVersion: v1
kind: Namespace
metadata:
name: spark-operator
---
apiVersion: v1
kind: Namespace
metadata:
name: spark-apps
---
@dzlab
dzlab / kubectl_describe_tfjob_mnist-tensorflow-job.txt
Created July 18, 2020 22:12
TensorFlow Distributed Training on Kubeflow with TFJob
Name: mnist-tensorflow-job
Namespace: default
Labels: <none>
Annotations: API Version: kubeflow.org/v1
Kind: TFJob
Metadata:
Creation Timestamp: 2020-07-18T18:54:31Z
Generation: 1
Resource Version: 43041
Self Link: /apis/kubeflow.org/v1/namespaces/default/tfjobs/mnist-tensorflow-job
@dzlab
dzlab / go_sftp.go
Created May 6, 2016 10:38
an example of sftp in golang
package main
import (
"github.com/pkg/sftp"
"golang.org/x/crypto/ssh"
)
func main() {
addr := “my_ftp_server:22"
config := &ssh.ClientConfig{
@dzlab
dzlab / build.sh
Last active January 22, 2024 17:13
Configure NGINX to log HTTP POST request's body
#!/bin/bash
echo "Building NGINX along with Echo module"
# install prerequisites
yum -y install gcc gcc-c++ make zlib-devel pcre-devel openssl-devel
# download the Echo module
curl -L -O 'https://github.com/openresty/echo-nginx-module/archive/v0.58.tar.gz'
tar -xzvf v0.58.tar.gz && rm v0.58.tar.gz
mv echo-nginx-module-0.58 /tmp/echo-nginx-module