Skip to content

Instantly share code, notes, and snippets.

View yogendratamang48's full-sized avatar

Yogendra Tamang yogendratamang48

  • Bremen, Germany
View GitHub Profile
@yogendratamang48
yogendratamang48 / Utils.py
Created April 24, 2020 09:17
Selenium plus some generic functions
import time
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.firefox.options import Options
import logging
from datetime import datetime
import csv
import os
from datetime import datetime, timedelta
from nltk import word_tokenize
MOMENTS = {
'seconds': ['seconds', 'second', 'sec', 'just'],
'minutes': ['mins', 'minutes', 'today'],
'hours': ['hours', 'hour'],
'days': ['day', 'days', 'veröffentlicht', 'Tagen' ],
'today': ['today',],
'weeks': ['week', 'weeks'],
"""
uploads file from `SOURCE_DIR` to S3. The path in S3 will follow
`TARGET_DIR` key name.
"""
import boto3
from datetime import datetime
import os
from config import AWS_ACCESS_KEY_ID, AWS_SECRET_ACCES_KEY
session = boto3.Session(
aws_access_key_id=AWS_ACCESS_KEY_ID,
#! /usr/bin/python3
import json
import sys
try:
jdata = json.loads(open(sys.argv[1], 'r').read())
with open(sys.argv[1], 'w', encoding='utf-8') as fp:
fp.write(json.dumps(jdata, ensure_ascii=False, indent=2))
except Exception as e:
@yogendratamang48
yogendratamang48 / request_helper.py
Last active June 15, 2020 07:47
Request Helper. Proxy in Selenium, [Make sure your ip is in whitelist of proxy provider]
import ast
import random
from fake_useragent import UserAgent
import requests
from selenium import webdriver
from selenium.common.exceptions import WebDriverException
from lxml import html
import time
@yogendratamang48
yogendratamang48 / postgres.yaml
Created August 10, 2020 07:51
Postgres docker compose
version: "3"
services:
database:
image: "postgres:10" # use latest official postgres version
env_file:
- database.env # configure postgres
ports:
- "5432:5432"
volumes:
- database-data:/var/lib/postgresql/data/ # persist data even if container shuts downvolumes:
@yogendratamang48
yogendratamang48 / pdf_mergers.py
Last active September 17, 2020 12:23
pdf merger script
"""
merges pdf files provided in given directory
### Install
`pip install pypdf2`
### Merging files
- provide files using `-f or --files flag`
>`python3 merger.py --files 1_OriginalAndFirstExt.pdf 2_OriginalAndFirstExt.pdf `
### Merging files from directory
- provide input directory (`-i or --input_dir`) which contains pdf
@yogendratamang48
yogendratamang48 / track_git_single_file.sh
Last active September 17, 2020 12:22
Gist Track File from particular branch using script
#! /bin/bash
cd "$(dirname "$0")"
echo "Starting file sync program..."
echo "Start time: $(date)"
GIT_TOKEN=""
GIT_OWNER=""
GIT_BRANCH=""
GIT_REPO=""
GIT_FILE="<git_file_you_want_to_track>"
TMP_FILE="/var/tmp/file_sync.txt"
@yogendratamang48
yogendratamang48 / .zshenv
Last active June 4, 2021 11:26
Kubectl Aliases
# eksctl
alias ek="eksctl"
alias ekcc="eksctl create cluster"
alias ekccf="eksctl create cluster -f"
alias ekrm="eksctl delete cluster"
alias ekrmf="eksctl delete cluster -f"
# Stack Master
alias sm="stack_master"
alias sma="stack_master apply"
alias smo="stack_master outputs"
@yogendratamang48
yogendratamang48 / Free-Udemy-Courses-Crawler.md
Last active September 14, 2021 10:50
Udemy Free Course

Install Dependencies

pip3 install requests
pip3 install lxml

Run script

>python3 smartybro.py