Skip to content

Instantly share code, notes, and snippets.

View martinsotir's full-sized avatar

Martin Sotir martinsotir

5 followers · 12 following
View GitHub Profile
@martinsotir
martinsotir / outlier2021.md
Last active February 21, 2022 02:06
Outlier 2021 conference notes
@martinsotir
martinsotir / _hydra_kedro.md
Last active February 22, 2024 08:57

Hydra configuration loader for Kedro

⚠️ 2021-03-07: WIP / Unmaintained. This project is a proof of concept, not recommend for general use.

Tested with Kedro 0.17.1 and Hydra 1.0.6.

Author: Martin Sotir

@martinsotir
martinsotir / vis2020.md
Last active February 16, 2022 21:53
vis2020 notes
@martinsotir
martinsotir / juptercon2020.md
Created October 17, 2020 15:44
Juytercon2020 notes

Jupytercon 2020

Day 1

  • Datasette: Simple tabular data cataloging et sharing tool, with extensible data exploration and wrangling UI.
  • QRI: Slithly similar to Datasette, with versioning and a cloud offering.
  • ❤️ ipyannotator: Extensible annotation tool based on Jupyter widgets.
  • ipython-sql and jupyterlab-sql Ipython magic for SQL.
@martinsotir
martinsotir / check_openstack.py
Last active October 6, 2020 09:18
A quick way to check if the we are running within openstack from python
def _is_host_openstack():
product_name = Path("/sys/devices/virtual/dmi/id/product_name")
return product_name.exists() and "OpenStack" in product_name.read_text()
@martinsotir
martinsotir / high_level_dl_frameworks.md
Last active January 27, 2021 23:47
List of high level deep learning frameworks (mostly for pytorch)

High level deep learning framework list

Updated: 2020-12-04

All in one frameworks / boilerplate libraries:All in one frameworks / boilerplate libraries:

Framework Github Stars Contributors Commit frequency
[PyTorch Ignite](http
@martinsotir
martinsotir / pytorch_params_treemap.md
Last active March 1, 2021 12:21
Quick function to display pytorch model's parameters in a plotly TreeMap

Pytorch Model Parameters in plotly TreeMap

Requirement: plotly, pandas and pytorch

import pandas as pd
import plotly.express as px

def plot_weights_treemap(model, max_levels=10):
    """Display pytorch module hierchachy in a treemap diagram
@martinsotir
martinsotir / chrome_heapsnapshot_loaders.py
Last active August 10, 2020 01:03
Loading Chrome devtoools heap snapshots in Python
"""
2 helper classes that can load Google Chrome Heap Snapshots files.
Both implementations are experimentals, only tested on one example.
"""
import collections
import json
from typing import Dict, Any
import numpy as np
@martinsotir
martinsotir / ml-ds-podcasts.md
Last active September 27, 2020 15:37
Machine learning and data science podcasts
@martinsotir
martinsotir / google_ai_notebooks_tips.md
Last active July 8, 2023 13:29
Google AI notebook tips

Google AI Platform Notebook tips

AI Notebooks vs Colab

Google Colab: https://colab.research.google.com/

  • Free compute! and interesting, fixed cost, 10$/month Google Colab Pro version.
  • Notebooks are very easy to share, with ability to control permissions (integration in google drive/doc ecosystem).
  • Instant availability. No requirement other than a regular google account.
  • Idle time limit : 1h in free version.