Skip to content

Instantly share code, notes, and snippets.

View data4sci's full-sized avatar

Robert Samarek data4sci

  • VSB - Technical University of Ostrava
  • Ostrava, Czech Republic
View GitHub Profile
@data4sci
data4sci / .sh
Created May 25, 2021 09:29
list CRON jobs from syslog
grep CRON /var/log/syslog
@data4sci
data4sci / .sh
Created May 25, 2021 09:30
CRON
crontab -l # LIST
crontab -e # EDIT
@data4sci
data4sci / .sh
Created May 25, 2021 09:32
Fulltext search over #Jupyter notebooks
grep --include='*.ipynb' --exclude-dir='.ipynb_checkpoints' -rliw . -e 'SEARCH QUERY ...'
# https://groups.google.com/forum/#!topic/jupyter/Qi9b7z_sgRU
# https://stackoverflow.com/questions/16956810/how-do-i-find-all-files-containing-specific-text-on-linux
# možno spustit i v integrovaném terminále
@data4sci
data4sci / print_list.py
Created May 25, 2021 09:35
print list without quotes #python
# vypsat obsah seznamu (list) oddělený čárkami bez uvozovek
print('[%s]' % ', '.join(map(str, my_list)))
@data4sci
data4sci / memory.py
Created May 25, 2021 10:57
#Jupyter #python memory management
%whos # magic - vypíše alokované proměnné
del var1 # smaže proměnnou var1
import gc
gc.collect() # uvolní paměť po smazaných proměnných (okamžitě, jinak řeší Garbage Collector až když je potřeba...)
@data4sci
data4sci / jupyter_shortcuts.js
Created May 25, 2021 10:59
Jupyter - custom shortcuts
# https://stackoverflow.com/questions/49280261/jupyter-lab-shortcuts
{
// Move cell up
"notebook:move-cell-up": {
"selector": ".jp-Notebook:focus",
"command": "notebook:move-cell-up",
"keys": [
"Ctrl ArrowUp"
]
@data4sci
data4sci / matplotlib_size.py
Created May 25, 2021 11:00
Set matplotlib plot size #Jupyter #python (%matplotlib inline)
# změna velikosti jednoho obrázku
import matplotlib.pyplot as plt
fig=plt.figure(figsize=(15, 15))
# To change the default settings, and therefore all your plots:
import matplotlib.pyplot as plt
plt.rcParams['figure.figsize'] = [15, 15]
@data4sci
data4sci / normalization.py
Created May 25, 2021 11:02
#python #pandas column normalization (values 0..1)
#one easy way by using Pandas: (here I want to use mean normalization)
normalized_df=(df-df.mean())/df.std()
#to use min-max normalization:
normalized_df=(df-df.min())/(df.max()-df.min())
@data4sci
data4sci / memory_usage.sh
Created May 25, 2021 11:03
total memory usage #bash
# jednotlivé procesy
smem -t -P chromium-browser
# celkový součet
smem -t -k -c pss -P chromium-browser | tail -n 1
# nebo
ps aux | grep "chromium-browser" | awk '{print $5}' | awk '{sum += $1 } END { print sum }'
@data4sci
data4sci / df_styling.py
Created May 25, 2021 11:04
#python #pandas styling, conditional formating
# https://pandas.pydata.org/pandas-docs/stable/user_guide/style.html
# https://towardsdatascience.com/style-pandas-dataframe-like-a-master-6b02bf6468b0
# https://stackoverflow.com/questions/41203959/conditionally-format-python-pandas-cell
# https://stackoverflow.com/questions/38931566/pandas-style-background-gradient-both-rows-and-columns
# https://kanoki.org/2019/01/02/pandas-trick-for-the-day-color-code-columns-rows-cells-of-dataframe/
df.style.background_gradient(cmap='coolwarm')