Skip to content

Instantly share code, notes, and snippets.

View austinorth's full-sized avatar
🧋

Austin Orth austinorth

🧋
View GitHub Profile
@austinorth
austinorth / query.txt
Created May 15, 2019 20:55
Sumo Logic query to find bots and crawlers and display their activity over time
_sourceCategory=your/ALB/logs ("Googlebot" OR "AskJeeves" OR "Digger" OR "Lycos"
OR "msnbot" OR "Inktomi Slurp" OR "Yahoo" OR "Nutch" OR "bingbot" OR
"BingPreview" OR "Mediapartners-Google" OR "proximic" OR "AhrefsBot" OR
"AdsBot-Google" OR "Ezooms" OR "AddThis.com" OR "facebookexternalhit" OR
"MetaURI" OR "Feedfetcher-Google" OR "PaperLiBot" OR "TweetmemeBot" OR
"Sogou web spider" OR "GoogleProducer" OR "RockmeltEmbedder" OR
"ShareThisFetcher" OR "YandexBot" OR "rogerbot-crawler" OR "ShowyouBot" OR
"Baiduspider" OR "Sosospider" OR "Exabot" OR "www.comscore.com/Web-Crawler" OR "mj12bot.com"
OR "GrapeshotCrawler" OR "NTENTbot" OR "BLEXBot" OR "Clickagy Intelligence Bot v2" OR "Applebot"
OR "AmazonAdBot" OR "SemrushBot" OR "Cliqzbot" OR "alexa site audit" OR "MailChimp" OR "Yeti" OR "PiplBot"
@austinorth
austinorth / backup-schemas-separately.sh
Created February 27, 2019 22:05
Bash script to backup each schema in a database in a separate backup file.
#!/bin/bash
if [ $# -eq 0 ]; then
echo "Usage: ./backup-schemas-separately.sh yourdatabasename" 1>&2
exit 1;
fi;
db=$1
@austinorth
austinorth / docker-compose-es-6.yml
Created February 27, 2019 21:35
A docker-compose file for spinning up a single node of Elasticsearch version locked at 6.2.4.
version: "3.7"
services:
elasticsearch:
image: docker.elastic.co/elasticsearch/elasticsearch:6.2.4
container_name: elasticsearch
network_mode: host
restart: always
environment:
- cluster.name=dev-elasticsearch
- bootstrap.memory_lock=true
@austinorth
austinorth / docker-compose-pghero.yml
Last active April 27, 2020 20:21
A docker-compose file for pghero with config file mounted from host machine.
version: "3.7"
services:
pghero:
image: ankane/pghero
container_name: pghero
network_mode: host
ports:
- 8080:8080
environment:
DATABASE_URL: postgres://postgres:postgres@localhost:5432