Skip to content

Instantly share code, notes, and snippets.

👋
looking for new opportunities

Karl Lorey lorey

👋
looking for new opportunities
View GitHub Profile
@lorey
lorey / block-slack-user.js
Last active Apr 16, 2020
Block a user in Slack
View block-slack-user.js
//
// This will hide all messages from a specific user in Slack. Enjoy the silence.
//
// get the owner id of a message
// -> loops back through list to find owner
function getOwnerId(i) {
var current = i
var sender = current.querySelector(".c-message__sender_link");
var ownerId = sender ? sender.dataset.messageSender : null;
@lorey
lorey / delete-files-that-contain-specific-string.sh
Created Jul 11, 2019
Delete all files that contain a specific string via command line
View delete-files-that-contain-specific-string.sh
# say we want to delete all files that contain the string "trash"
# source: https://stackoverflow.com/a/4529138
# 1) create a file that lists all files to delete
find .cache/ | xargs grep -l "trash" | awk '{print "rm "$1}' > delete.sh
# 2) check for errors and stuff
vim delete.sh
# 3) make the file executable and execute
@lorey
lorey / pandas-nested-parameters.py
Created May 29, 2019
Function to flatten hierarchical parameters when training a pandas pipeline
View pandas-nested-parameters.py
def hierarchical_to_flattened_parameters(parameters_dict):
"""
Flatten an hierarchical dict to an sklearn parameter set.
:param parameters_dict: hierarchical dict
:return: flattened dict
"""
return json_normalize(parameters_dict, sep='__').to_dict(orient='records')[0]
@lorey
lorey / avoiding-https-connection-pool-errors.py
Created May 21, 2019
Dealing with HTTPSConnectionPool errors in requests with adapters and backoff
View avoiding-https-connection-pool-errors.py
# this snippet will deal with errors like HTTPSConnectionPool: Max retries exceeded with url...
# by using a backoff factor
# further reading:
# - docs: https://2.python-requests.org/en/master/user/advanced/#transport-adapters
# - stack overflow issue: https://stackoverflow.com/a/47475019
import requests
from requests.adapters import HTTPAdapter
from requests.packages.urllib3.util.retry import Retry
@lorey
lorey / basic.py
Created Mar 16, 2019
Keeping Pandas DataFrames clean when importing JSON
View basic.py
from pandas.io.json import json_normalize
df = json_normalize(data)
@lorey
lorey / markdown_to_text.py
Created Aug 27, 2017
Markdown to Plaintext in Python
View markdown_to_text.py
from bs4 import BeautifulSoup
from markdown import markdown
def markdown_to_text(markdown_string):
""" Converts a markdown string to plaintext """
# md -> html -> text since BeautifulSoup can extract text cleanly
html = markdown(markdown_string)
# remove code snippets
@lorey
lorey / postgres_pandas_backup.py
Last active Jul 24, 2017
PostgreSQL tables to csv (Backup database tables as CSV with Pandas)
View postgres_pandas_backup.py
import os
import pandas as pd
import psycopg2
from dotenv import find_dotenv
from dotenv import load_dotenv
from psycopg2.extras import DictCursor
def main():
@lorey
lorey / firefox-profile-with-automatic-download.py
Created Apr 1, 2017
Selenium: Prevent download dialog and download file automatically
View firefox-profile-with-automatic-download.py
# adapted from http://stackoverflow.com/a/25251803
profile = webdriver.FirefoxProfile()
profile.set_preference('browser.download.folderList', 2) # custom location
profile.set_preference('browser.download.manager.showWhenStarting', False)
profile.set_preference('browser.helperApps.neverAsk.saveToDisk', 'text/vcard') # type of file to download
# use the out folder of the script path
profile.set_preference('browser.download.dir', os.path.join(os.path.dirname(os.path.abspath(__file__)), 'out'))
View rs.sh
#!/bin/bash
mkdir -p ./rs/
for semester in $(seq -f "%02g" 4 15); do
wget -O ./rs/20${semester}_SS_aufgaben.pdf --user "rs" --password "rechner.strukturen" https://capp.itec.kit.edu/teaching/rs/ss${semester}/kl/aufgaben.pdf ;
wget -O ./rs/20${semester}_WS_aufgaben.pdf --user "rs" --password "rechner.strukturen" https://capp.itec.kit.edu/teaching/rs/ws${semester}/kl/aufgaben.pdf ;
wget -O ./rs/20${semester}_SS_loesung.pdf --user "rs" --password "rechner.strukturen" https://capp.itec.kit.edu/teaching/rs/ss${semester}/kl/loesung.pdf ;
wget -O ./rs/20${semester}_WS_loesung.pdf --user "rs" --password "rechner.strukturen" https://capp.itec.kit.edu/teaching/rs/ws${semester}/kl/loesung.pdf ;
done
You can’t perform that action at this time.