Skip to content

Instantly share code, notes, and snippets.

View zhanwenchen's full-sized avatar
🤠
Howdy y'all

Zhanwen Chen zhanwenchen

🤠
Howdy y'all
View GitHub Profile
@zhanwenchen
zhanwenchen / ffmpeg_nvidia_conda_install.sh
Created October 25, 2023 23:17 — forked from kiyoon/ffmpeg_nvidia_conda_install.sh
Install nvidia accelerated ffmpeg in a conda environment.
git clone https://git.videolan.org/git/ffmpeg/nv-codec-headers.git
cd nv-codec-headers
vi Makefile # change the first line to PREFIX = ${CONDA_PREFIX}
make install
cd ..
git clone https://git.ffmpeg.org/ffmpeg.git
cd ffmpeg
git checkout n4.2.2
conda install nasm
@zhanwenchen
zhanwenchen / magma-readme.md
Last active August 9, 2023 20:53 — forked from Birch-san/magma-readme.md
Build magma from source

I wrote these instructions as part of "installing PyTorch with CUDA 12.1.1".

Anyway, if you still need to compile from source… here's how:

Build Magma from source

This is a dependency of PyTorch, which is sensitive to CUDA version.

Clone Magma:

@zhanwenchen
zhanwenchen / demo.py
Created July 24, 2023 01:00 — forked from apdavison/demo.py
Demonstration of parallel writing to file using h5py and mpi4py
"""
Creates an HDF5 file with a single dataset of shape (channels, n),
filled with random numbers.
Writing to the different channels (rows) is parallelized using MPI.
Usage:
mpirun -np 8 python demo.py
Small shell script to run timings with different numbers of MPI processes:
@zhanwenchen
zhanwenchen / build-hdf5.sh
Last active June 14, 2022 19:58
Build HDF5 Library with Parallel Support on Linux
# https://github.com/HDFGroup/hdf5/blob/hdf5-1_13_1/release_docs/INSTALL_parallel
# https://docs.olcf.ornl.gov/software/python/parallel_h5py.html
# https://www.pism.io/docs/installation/parallel-io-libraries.html
# using ~/local/build/hdf5 as the build directory.
# Install HDF5 1.13.1 with parallel I/O in ~/local/hdf5,
version=1.13.1
prefix=$HOME/local/hdf5
build_dir=~/local/build/hdf5
hdf5_site=https://support.hdfgroup.org/ftp/HDF5/releases/hdf5-1.13
@zhanwenchen
zhanwenchen / conda_environment_rename.sh
Created May 26, 2022 15:34 — forked from Mukei/conda_environment_rename.sh
How to rename a conda environment (workaround)
#One workaround is to create clone environment, and then remove original one:
#(remember about deactivating current environment with deactivate on Windows and source deactivate on macOS/Linux)
conda create --name new_name --clone old_name --offline #use --offline flag to disable the redownload of all your packages
conda remove --name old_name --all # or its alias: `conda env remove --name old_name`
#There are several drawbacks of this method:
# time consumed on copying environment's files,
# temporary double disk usage.
@zhanwenchen
zhanwenchen / translate_web_app.py
Created January 9, 2019 00:35
A Flask web app that uses the Server class defined in translate_client.py
# -*- coding: utf-8 -*-
import os
import sys
import logging
from flask import Flask, request, jsonify
from flask_cors import CORS, cross_origin
from translate_client import Server
@zhanwenchen
zhanwenchen / translate_client.py
Last active January 9, 2019 00:31
A low-level API to connect with a running gRPC server and pass to it a TensorFlow-Serving prediction request
"""
Adapted from https://github.com/Vetal1977/tf_serving_example/blob/master/svnh_semi_supervised_client.py
"""
# -*- coding: utf-8 -*-
import time
from argparse import ArgumentParser
import numpy as np
@zhanwenchen
zhanwenchen / export_tf_model.py
Last active August 31, 2021 22:51
Minimal code to load a trained TensorFlow model from a checkpoint and export it with SavedModelBuilder
import os
import tensorflow as tf
trained_checkpoint_prefix = 'checkpoints/dev'
export_dir = os.path.join('models', '0') # IMPORTANT: each model folder must be named '0', '1', ... Otherwise it will fail!
loaded_graph = tf.Graph()
with tf.Session(graph=loaded_graph) as sess:
# Restore from checkpoint
loader = tf.train.import_meta_graph(trained_checkpoint_prefix + '.meta')
@zhanwenchen
zhanwenchen / sequelize-schema-file-generator.js
Created October 19, 2017 01:08 — forked from ahelord/sequelize-schema-file-generator.js
Automatically generates migration files from your sequelize models
'use strict';
//////////////////////////////////
// How to use?
// 1. Create `sequelize-schema-file-generator.js` in your app root
// 2. Make sure you've ran the `sequelize init` before (It should create `config`,`seeders`,`migrations` folders).
// 3. Update `DATABASE_DSN` below to match your connection string (works with any database adapter that Sequelize supports)
// 4. Run it with `node sequelize-schema-file-generator.js`
// 5. Review the generated migrations inside of the `migrations` folder.
//////////////////////////////////
@zhanwenchen
zhanwenchen / Install NVIDIA Driver and CUDA.md
Last active March 13, 2024 23:42 — forked from wangruohui/Install NVIDIA Driver and CUDA.md
Install NVIDIA CUDA 9.0 on Ubuntu 16.04.4 LTS