Skip to content

Instantly share code, notes, and snippets.

@ysyun
Last active August 28, 2018 06:59
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save ysyun/89e2e0be292c63f529e7980783350c29 to your computer and use it in GitHub Desktop.
Save ysyun/89e2e0be292c63f529e7980783350c29 to your computer and use it in GitHub Desktop.
create model checkpoint of data2vis
# export DATA_DIR=project-directory
export DATA_DIR=.
python -m bin.train \
--config_paths="
$DATA_DIR/example_configs/nmt_large.yml,
$DATA_DIR/example_configs/train_seq2seq.yml,
$DATA_DIR/example_configs/text_metrics_bpe.yml" \
--model_params "
vocab_source: $DATA_DIR/sourcedata/vocab.source
vocab_target: $DATA_DIR/sourcedata/vocab.target"
--input_pipeline_train "
class: ParallelTextInputPipeline
params:
source_delimiter: ''
target_delimiter: ''
source_files:
- $DATA_DIR/sourcedata/train.sources
target_files:
- $DATA_DIR/sourcedata/train.targets"
--input_pipeline_dev "
class: ParallelTextInputPipeline
params:
source_delimiter: ''
target_delimiter: ''
source_files:
- $DATA_DIR/sourcedata/dev.sources
target_files:
- $DATA_DIR/sourcedata/dev.targets"
--batch_size 32 \
--train_steps 100000 \
# --output_dir $DATA_DIR/model_directory
--output_dir $DATA_DIR/vizmodel
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment