Skip to content

Instantly share code, notes, and snippets.

Avatar

vagelim vagelim

View GitHub Profile
View keybase.md

Keybase proof

I hereby claim:

  • I am vagelim on github.
  • I am vageli (https://keybase.io/vageli) on keybase.
  • I have a public key whose fingerprint is A666 5608 1D75 8C56 AE63 7317 17C4 68D6 A639 3F33

To claim this, I am signing this object:

@vagelim
vagelim / amazon_scrape.py
Last active Dec 2, 2015
scrape Amazon multiple price page for lowest price
View amazon_scrape.py
#Configuration variables
BASE_URL = "http://www.amazon.com/gp/offer-listing/"
XPATH_SELECTOR = '//body//*[@class="a-size-large a-color-price olpOfferPrice a-text-bold"]'
USER_AGENT = {'User-agent': 'Mozilla/5.0'}
ITEM = '1429218274'
@vagelim
vagelim / find_nth.py
Last active Nov 30, 2015
Find the nth occurrence of a substring in a given string
View find_nth.py
def find_nth(haystack, needle, n):
"""Take a string (haystack) and find start the nth occurrence of the substring (needle)"""
start = haystack.find(needle)
while start >= 0 and n > 1:
start = haystack.find(needle, start+len(needle))
n -= 1
return start
@vagelim
vagelim / openstackEvents.py
Last active Jul 30, 2020
Event notification listener for OpenStack
View openstackEvents.py
########################################
# Required changes to nova.conf #
########################################
# notification_driver=nova.openstack.common.notifier.rpc_notifier
# notification_topics = notifications
# notify_on_state_change = vm_and_task_state
# instance_usage_audit_period = hour
# instance_usage_audit = True
# default_notification_level = INFO
# notify_api_faults = true
@vagelim
vagelim / stress.sh
Created Dec 1, 2015
CPU stress test
View stress.sh
#!/bin/bash
# Usage: lc [number_of_cpus_to_load [number_of_seconds] ]
lc() {
(
pids=""
cpus=${1:-1}
seconds=${2:-60}
echo loading $cpus CPUs for $seconds seconds
trap 'for p in $pids; do kill $p; done' 0
for ((i=0;i<cpus;i++)); do while : ; do : ; done & pids="$pids $!"; done
@vagelim
vagelim / event_env.sh
Last active Jan 30, 2019
Sets up a virtual environment, installs kombu, and runs the event listener
View event_env.sh
#!/bin/bash
# Requires pip
pip install virtualenv
virtualenv listener
listener/bin/pip install kombu
listener/bin/python openstackEvents.py
View create-stack-user
#!/usr/bin/env bash
# **create-stack-user.sh**
# Create a user account suitable for running DevStack
# - create a group named $STACK_USER if it does not exist
# - create a user named $STACK_USER if it does not exist
#
# - home is $DEST
#
@vagelim
vagelim / copytoredshift.py
Last active Feb 25, 2016
Luigi job to copy S3 data to Redshift
View copytoredshift.py
import luigi
from luigi import configuration
import datetime
from luigi.contrib import redshift
from mortar.luigi import mortartask
from dd_tasks import DatadogPigscriptTask
from luigi.s3 import S3Target, S3PathTask
from mortar.luigi.s3transfer import S3ToLocalTask
import dd_utils
#from redshift_utils import CopyToRedshiftTask
@vagelim
vagelim / findSubstring.py
Created Feb 19, 2016
Find all substrings
View findSubstring.py
def locations_of_substring(string, substring):
"""Return a list of locations of a substring."""
substring_length = len(substring)
def recurse(locations_found, start):
location = string.find(substring, start)
if location != -1:
return recurse(locations_found + [location], location+substring_length)
else:
return locations_found
@vagelim
vagelim / burrow.cfg
Created Feb 25, 2016
Example Burrow configuration file for local deployment (bare minimum configuration)
View burrow.cfg
[general]
logdir=/home/kafka/burrow/log
[zookeeper]
hostname=localhost
[kafka "local"]
broker=localhost
zookeeper=localhost
zookeeper-path=/kafka-cluster