Skip to content

Instantly share code, notes, and snippets.

View iamaziz's full-sized avatar
🎲

Aziz Alto iamaziz

🎲
View GitHub Profile
@iamaziz
iamaziz / ipynb2html.py
Created September 27, 2018 06:50
snippet: convert all Jupyter notebooks in current directory and its subdirectories "recursively"
from subprocess import check_output
from glob import glob
notebooks = glob('./**/*.ipynb', recursive=True)
for n in notebooks:
cmd = f'jupyter nbconvert --to html {n}'
check_output(cmd.split())
@iamaziz
iamaziz / read_csv_files_in_tar_gz_from_s3_bucket.py
Last active November 22, 2022 14:45
Read csv files from tar.gz in S3 into pandas dataframes without untar or download (using with S3FS, tarfile, io, and pandas)
# -- read csv files from tar.gz in S3 with S3FS and tarfile (https://s3fs.readthedocs.io/en/latest/)
bucket = 'mybucket'
key = 'mycompressed_csv_files.tar.gz'
import s3fs
import tarfile
import io
import pandas as pd
import tensorflow as tf
import numpy as np
corpus_raw = 'He is the king . The king is royal . She is the royal queen '
# convert to lower case
corpus_raw = corpus_raw.lower()
words = []
for word in corpus_raw.split():
@iamaziz
iamaziz / explore_word2vec_in_Spark.ipynb
Created November 10, 2018 08:24
Exploring word2vec in PySpark
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@iamaziz
iamaziz / using_args_kwargs.py
Created November 15, 2018 17:44
How to use *args and **kwargs with a wrapper function
# how to use *args and **kwargs with wrapper
def main_function(a: int, b: int):
print(f'a: {a} + b: {b} = {a+b}')
def my_wrapper(*args, **kwargs):
print(f'wrapper recieved: {len(args)} args and {len(kwargs)} kwargs')
if 'a' not in kwargs: kwargs.update({'a': 6})
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@iamaziz
iamaziz / case_insinsitive_compare.py
Last active March 20, 2019 05:37
An implementation of string equality comparison case-insensitive e.g. s1.upper() == s2.upper()
def case_insensitive(s1, s2):
"""
returns True if both s1 and s2
contain the same letters and letters in the same order,
regardless of letters case.
In other words,
this is an implementation for either
s1.upper() == s2.upper()
or s1.lower() == s2.lower()
"""
@iamaziz
iamaziz / comparison-sort_algorithms_compared.ipynb
Created March 21, 2019 22:10
comparison-sort algorithms compared and visualized
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@iamaziz
iamaziz / k_means.ipynb
Last active June 15, 2019 06:28
k_means.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.