Skip to content

Instantly share code, notes, and snippets.

View hideojoho's full-sized avatar

Hideo Joho hideojoho

View GitHub Profile
@hideojoho
hideojoho / How-to-run-PyTerrier-on-NTCIR1.md
Last active September 13, 2023 15:53
PyTerrier on NTCIR-1

PyTerrier on NTCIR-1

NTCIR-1 テストコレクション

情報検索用テストコレクションとして、文書データ(学会発表データベース著者抄録(1988-1997)=国内65学会の発表論文著者抄録約33万件。半数以上は日英対訳)、検索課題83件(日本語)、正解判定を含みます。日本語検索、日->英の言語横断検索、日->日本語+英語 の検索の実験に使用できます。用語抽出研究用コレクションとして、情報検索用テストコレクションから抽出した日本語文書データ2000件に言語タグを付加したものを含みます。テストコレクション全体をNIIから研究目的で提供します。

@hideojoho
hideojoho / azure_vm_command.md
Last active December 29, 2021 03:45
Azure VM command

Azure VM Command

Settings

  • Name: [your vm name]
  • Resource Group: [your resource group]
  • Region: japaneast
  • OS: Linux Ubuntu 20.04 LTS
  • Size: Standard_F4s_v2
    • Core: 4
@hideojoho
hideojoho / indexed-job.yaml
Created December 14, 2021 11:28
How to pass JOB_COMPLETION_INDEX to a pod as an environment variable
apiVersion: batch/v1
kind: Job
metadata:
name: indexed-job
spec:
completions: 5
parallelism: 3
completionMode: Indexed
template:
spec:
@hideojoho
hideojoho / how-to-disable-ctrlb-shortcut-in-jupterlab.md
Created December 2, 2021 13:29
How to disable Ctrl+B shortcut in JupyerLab

How to disable Ctrl+B shortcut in JupyerLab

  • Why do we want to do that?
    • Because we want to use tmux in the terminal

How?

  • Top Menu > Settings > Advanced Settings Editor
  • Copy and paste the following snippet
@hideojoho
hideojoho / How-to-run-sparse-retrieval-on-japanese-texts-with-pyserini.md
Last active November 9, 2021 02:48
How to run sparse retrieval on Japanese texts with Pyserini

How to run sparse retrieval on Japanese texts with Pyserini

VM Environments

  • Java 11.0.13
  • Maven 3.8.3
  • Lucene 8.10.1
  • Python 3.9.2

Get a VM with JDK11 and Maven

@hideojoho
hideojoho / how-to-make-ja-likert-figure.md
Last active November 29, 2022 01:13
日本語リッカート尺度のグラフ生成(Python)

日本語リッカート尺度のグラフ生成方法(Python)

環境

  • Python v3.8
    • pandas
    • matplotlib
    • japanize_matplotlib
    • plot_likert
@hideojoho
hideojoho / How-to-create-k8s-user-and-namespace.md
Last active August 27, 2020 04:38
How to create a k8s user and assign a namespace

How to create a k8s user and assign a namespace

⚠️ Use it with your own risk

$ bash make-k8s-user.sh USER
@hideojoho
hideojoho / 0-from-zero-to-k8s-via-dockerhub.md
Last active October 2, 2020 04:17
From Zero to k8s via Docker Hub

From Zero to k8s via Docker Hub

GitHub -> Local -> Docker Hub -> GitHub -> Docker Hub -> k8s

Environment

  • Windows 10
  • WSL2 + Docker for Windows
  • VSCode
  • GitHub account
@hideojoho
hideojoho / 0-4-steps-get-docker-with-gpu-on-ubuntu-2004.md
Last active October 3, 2023 06:39
4 steps to get a docker running with GPU on Ubuntu 20.04

⚠️ The following instruction is written on 25 Jul 2020 (= old).

4 steps to get a docker running with GPU on Ubuntu 20.04

Environment

  • Ubuntu 20.04
  • CUDA 10.2
  • Docker Latest
@hideojoho
hideojoho / master-playbook.yml
Created July 20, 2020 23:29
Ansible playbook for GPU nodes
---
- hosts: all
vars:
ansible_connect_timeout: 300
become: true
tasks:
- name: Update and upgrade apt packages
apt:
update_cache: yes
upgrade: yes