Skip to content

Instantly share code, notes, and snippets.

@vuiseng9

vuiseng9/hf_machine_translation.md

Created January 14, 2022 23:41
Show Gist options
  • Save vuiseng9/b3b974bc42bc40883663169216250ebe to your computer and use it in GitHub Desktop.
Save vuiseng9/b3b974bc42bc40883663169216250ebe to your computer and use it in GitHub Desktop.
Download ZIP
Raw
hf_machine_translation.md 
export CUDA_VISIBLE_DEVICES=0
cd transformers/examples/pytorch/translation/
python run_translation.py  \
    --model_name_or_path Helsinki-NLP/opus-mt-de-en  \
    --dataset_name wmt16  \
    --dataset_config_name de-en  \
    --source_lang de  \
    --target_lang en  \
    --run_name opus-mt-de-en-test  \
    --do_predict  \
    --predict_with_generate  \
    --num_beams 8  \
    --per_device_eval_batch_size 8  \
    --overwrite_output_dir  \
    --output_dir /tmp/mt-de-en/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment