Skip to content

Instantly share code, notes, and snippets.

View matsui528's full-sized avatar

Yusuke Matsui matsui528

256 followers · 0 following
View GitHub Profile
@matsui528
matsui528 / aws_ec2_action.yaml
Created January 15, 2020 14:42
name: Run python test on an EC2 GPU instance
on: [push]
jobs:
build:
runs-on: ubuntu-latest
steps:
- name: Configure AWS credentials
uses: aws-actions/configure-aws-credentials@v1
@matsui528
matsui528 / config
Created June 11, 2019 14:11
VSCode Remote SSH on ABCI
Host abci
HostName es1
User aaaXXXXXxx
ProxyCommand ssh -W %h:%p aaaXXXXXxx@as.abci.ai
@matsui528
matsui528 / faiss_optuna.py
Created December 3, 2018 16:25
Hyper-parameter tuning for faiss using optuna
# Test for faiss with optuna using siftsmall data
#
# (1) install libs:
# $ pip install optuna
# $ conda install faiss-cpu -c pytorch
#
# (2) Put the following util scripts in the same directory
# https://github.com/matsui528/rii/blob/master/examples/benchmark/util.py
#
# (3) download siftsmall data
@matsui528
matsui528 / l2sqr_functions.cpp
Last active October 23, 2023 05:17
Runtime evaluation for squared Euclidean distances with SSE, AVX, AVX512 implementations
#include <iostream>
#include <random>
#include <chrono>
#include <x86intrin.h>
#include <cassert>
// Runtime evaluation for squared Eucliden distance functions
// - fvec_L2_sqr_ref: naive reference impl from Faiss
// - fvec_L2_sqr_sse: SSE impl from Faiss
// - fvec_L2_sqr_avx: AVX impl from Faiss
@matsui528
matsui528 / install_caffe2_detectron.sh
Last active December 25, 2019 07:44
Install script of caffe2 and detectron on AWS EC2 instance with Deep Learning Base AMI
# Install script of Caffe2 and Detectron on AWS EC2
#
# Tested environment:
# - AMI: Deep Learning Base AMI (Ubuntu) Version 6.0 - ami-ce3673b6 (CUDA is already installed)
# - Instance: p3.2xlarge (V100 * 1)
# - Caffe2: https://github.com/pytorch/pytorch/commit/731273b8d61dfa2aa8b2909f27c8810ede103952
# - Detectron: https://github.com/facebookresearch/Detectron/commit/cd447c77c96f5752d6b37761d30bbdacc86989a2
#
# Usage:
# Launch a fresh EC2 instance, put this script on the /home/ubuntu/, and run the following command.