This is a cheat sheet for how to perform various actions to ZSH, which can be tricky to find on the web as the syntax is not intuitive and it is generally not very well-documented.
| Description | Syntax |
|---|---|
| Get the length of a string | ${#VARNAME} |
| Get a single character | ${VARNAME[index]} |
| import datetime | |
| import json | |
| import re | |
| import string | |
| import unicodedata | |
| from transformers import AutoModelForCausalLM, AutoTokenizer | |
| from peft import PeftModelForCausalLM | |
| import torch | |
| import time | |
| import fire |
| import time | |
| import argparse | |
| import numpy as np | |
| import mxnet as mx | |
| import gluonnlp as nlp | |
| import tvm | |
| from tvm import relay | |
| import tvm.contrib.graph_runtime as runtime | |
| def timer(thunk, repeat=1, number=10, dryrun=3, min_repeat_ms=1000): |
containerizing job environment, apptainer is recommended by Hyak team for both speeding up python startup time and reproducibility
copying frequently used data to /tmp dir on the node, /tmp as described by Hyak team has around 400GB isolated fast SSD storage, and loading/saving data there won't affect others' jobs or slowdown hyak
using alloc to create an interactive session, e.g. salloc -c 8 -p ckpt --time=5-00:00 -n 1 --mem=64G --gpus=a40:1
| """ | |
| crawl images: | |
| pip install img2dataset==1.11.0 | |
| img2dataset --url_list cc3m.tsv\ | |
| --output_folder cc3m-img --input_format "tsv"\ | |
| --url_col "url" --caption_col "caption"\ | |
| --output_format files --resize_mode=no\ | |
| --processes_count 10 --thread_count 64 --number_sample_per_shard 2000\ | |
| --enable_wandb True --save_metadata False |
| # # Install Zsh on Sherlock | |
| # Installs Zsh with Oh-My-Zsh without root privileges | |
| # on Stanford's Sherlock (https://sherlock.stanford.edu) for use in tmux | |
| # | |
| # ## Instructions | |
| # 1) bash install_zsh.sh | |
| # 2) edit .zshrc (add the path to your Zsh binary to the PATH variable, etc.) | |
| # 3) add `set-option -g default-shell <path to zsh>/bin/zsh` to `~/.tmux.conf` | |
| # 4) also see comments for potential further notes | |
| # |
Hi Dannis, the embassy link (in Chinese) is http://www.china-embassy.org/chn/lszj/zytz/t1869583.htm. You could see the google translated version, it's pretty accurate: https://translate.google.com/translate?sl=auto&tl=en&u=http://www.china-embassy.org/chn/lszj/zytz/t1869583.htm
At the end of the webpage, they provide a Word document that contains the RealtimeLab website: http://www.china-embassy.org/chn/lszj/zytz/P020210420801553510835.doc
The Google-translated version is: https://qurb4mpbooafdksra6y5daz4ha-ac4c6men2g7xr2a-china-embassy-org.translate.goog/chn/lszj/zytz/P020210420801553510835.doc
Ubuntu: may need to export libjvm.so
ls -l /etc/alternatives/java will output something like: /etc/alternatives/java -> /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java
then do:
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/
export JCC_JDK=/usr/lib/jvm/java-8-openjdk-amd64
for macOS:
easy_install JCC-3.2-py3.6-macosx-10.13-x86_64.egg lucene-7.5.0-py3.6-macosx-10.13-x86_64.egg
