Skip to content

Instantly share code, notes, and snippets.

@semyont
semyont / aiohttp_trace_exporter.py
Last active May 15, 2022 18:00
prometheus exporter async python http trace #python #prometheus #aiohttp #tracing #blackbox #synthetics #asyncio #scrape #probe
import logging
import time
import asyncio
import aiohttp
from prometheus_client import start_http_server, Counter, Histogram
# Prometheus Metrics
h = Histogram('requests_latency', 'latency histogram', ["url", "method"])
c = Counter("requests_total", "Total count of requests", ["code", "url"])
@semyont
semyont / .bash_profile
Created February 17, 2020 10:35 — forked from natelandau/.bash_profile
Mac OSX Bash Profile
# ---------------------------------------------------------------------------
#
# Description: This file holds all my BASH configurations and aliases
#
# Sections:
# 1. Environment Configuration
# 2. Make Terminal Better (remapping defaults and adding functionality)
# 3. File and Folder Management
# 4. Searching
# 5. Process Management
@semyont
semyont / mac-ops-essentials.md
Last active July 20, 2023 16:34
[mac essentials] #devops #mac #setup #install #osx #python #node #javascript #enviorment #fresh

Mac Ops Essentials

Fresh start your Mac, install the following to get essential developer tools.

Config Enviorment Vars

export LANG=en_US.UTF-8 export LC_ALL=en_US.UTF-8

Install & Update macOS

softwareupdate -i -a

@semyont
semyont / git.sh
Created April 17, 2019 18:21
reset git user
git config --local --unset credential.helper
git config --global --unset credential.helper
git config --system --unset credential.helper
@semyont
semyont / pandas_weighted_avg_example.py
Created January 17, 2019 10:27
Pandas Group By Aggregate CTR Weighted Average on Campaigns Mediums Example
#!/usr/bin/python
__author__='Semyon Teplisky'
import functools
import pandas as pd
import numpy as np
raw_data = [{'campaign_id':1111,'medium_id':'msn','campaign_name': 'viral #1', 'clicks':100, 'ctr':0.7},
{'campaign_id':1111,'medium_id':'aol','campaign_name': 'viral #1', 'clicks':250, 'ctr':0.4},
{'campaign_id':1111,'medium_id':'google','campaign_name': 'viral #1', 'clicks':500, 'ctr':0.1}]
@semyont
semyont / example_etl.py
Created January 2, 2019 08:39 — forked from dlstadther/example_etl.py
Example ETL Using Luigi
# import python core modules
import datetime
import logging
# import external modules
import pandas as pd
import requests
# import luigi modules
import luigi
@semyont
semyont / s3_to_redshift_upsert.py
Created December 5, 2018 10:02
Redshift Upsert
import uuid
import psycopg2
from secret import REDSHIFT_CREDS
from secret import AWS_ACCESS_KEY, AWS_SECRET_KEY
def get_primary_keys(tablename, db):
c = db.cursor()
sql = "select indexdef from pg_indexes where tablename = '%s';" % tablename
c.execute(sql)
result = c.fetchall()[0][0]
@semyont
semyont / clean.sh
Last active December 25, 2018 11:04
Clean UBUNTU Space
sudo apt-get clean
sudo apt-get autoremove --purge -y
@semyont
semyont / World_Map_Service_url_kibana_map_coordinates.txt
Last active February 8, 2018 12:36
Free WMS Kibana Map Coordinates
WMS url => http://ows.mundialis.de/services/service?
WMS layers => TOPO-OSM-WMS
WMS version => 1.1.1
WMS format => image/png
@semyont
semyont / s3_bucket_policy.json
Created June 20, 2017 12:43
IAM Simple Bucket Policy For AWS
"Statement": [
{
"Effect": "Allow",
"Action": "s3:ListAllMyBuckets",
"Resource": "arn:aws:s3:::*"
},
{
"Effect": "Allow",
"Action": "s3:*",
"Resource": [