Skip to content

Instantly share code, notes, and snippets.

View datlife's full-sized avatar

Dat Nguyen datlife

View GitHub Profile
datlife / gist:4819a1774de689916dcaa8fca2c42c86
Created February 20, 2018 23:05
Convert list of images into a MP4 H264
ffmpeg -framerate 25 -i img%05d.jpg -c:v libx264 -profile:v high -crf 20 -pix_fmt yuv420p output.mp4
datlife /
Last active March 14, 2018 19:41
Comparisons: How to efficiently iterate in pandas data frames by row.
We would like to explore which method perform row iteration in the most efficient way.
Create a data frammes with 3 columns and 100,000 rows
vector: Iterated over 100000 rows in 0.029180 | Sample at idx [0]: (1, 100000)
zip: Iterated over 100000 rows in 0.073447 | Sample at idx [0]: [1, 100000]
datlife /
Last active June 29, 2018 21:46 — forked from Chaser324/
GitHub Standard Fork & Pull Request Workflow

Whether you're trying to give back to the open source community or collaborating on your own projects, knowing how to properly fork and generate pull requests is essential. Unfortunately, it's quite easy to make mistakes or not know what you should do when you're initially learning the process. I know that I certainly had considerable initial trouble with it, and I found a lot of the information on GitHub and around the internet to be rather piecemeal and incomplete - part of the process described here, another there, common hangups in a different place, and so on.

In an attempt to coallate this information for myself and others, this short tutorial is what I've found to be fairly standard procedure for creating a fork, doing your work, issuing a pull request, and merging that pull request back into the original project.

Creating a Fork

Just head over to the GitHub page and click the "Fork" button. It's just that simple. Once you've done that, you can use your favorite git client to clone your repo or j

datlife /
Last active July 9, 2018 18:25
Compute mean and standard deviation (std) per channel give a list of images
"""Give a list of image filenames, this script compute the mean and std over all the images.
* OpenCV
* tqdm
In this example, I use `Stanford Dogs Datasets" (~20k images)
Example Outputs: (8 cores CPU i7 4970K)
(env) dat@desktop:****/StanfordDogs$ python
"""Move Forward
Start from the first element in the array (A), index is i. Move forward by A[i] steps max.
The algorithm is to return true/false, to indicate whether we can move from the first element
to the last element in the array
A = [2, 0, 1, 2, 0, 3] --> True
# Assumption:
* A[i] > 0 and there are [1 ... N] possible steps A[i] can move if A[i] = N.
datlife / trie.h
Created December 3, 2018 03:10
Trie Implementation in Modern C++ (Kind of, I am learning)
* MIT License
* Copyright (c) 2018 Dat Nguyen
* Trie (aka Prefix Tree) is a type of Tree Data Structure. A node contains a
* list of child Nodes.
* Applications:
* ============
* * Word completion: quickly validate if a word is correctly type.
datlife / async.jsx
Last active May 19, 2019 01:45
Event Loop
// Async should be first priority over callbacks and promises
// High level idea:
// - Avoid .then .catch in promise
// - Syntatic sugar to make async programming similar to sequential code
const axios = require('axios');
async function getUser(id) {
let resp = await axios.get(`${DEFAULT_URL}/users/${id}`)
datlife /
Created October 7, 2019 05:46
Spark on K8s using helm

Status: alpha

alias k=kubectl

# Add microsoft charts to heml
helm repo add msftcharts
helm repo update

# Launch spark cluster with custom config
datlife / dga.dat
Created February 1, 2020 22:43
Extract all DGA data to a file