Skip to content

Instantly share code, notes, and snippets.

@ohnishiakira
Last active July 15, 2016 07:32
Show Gist options
  • Save ohnishiakira/e26bc1e0ac7154466c7a1edcb06f6c55 to your computer and use it in GitHub Desktop.
Save ohnishiakira/e26bc1e0ac7154466c7a1edcb06f6c55 to your computer and use it in GitHub Desktop.
# config.yml.liquid
in:
  type: file
  path_prefix: /Users/akira/sketch/embulk/sample/try1/csv/sample_
  decoders:
  - {type: gzip}
  parser:
    charset: UTF-8
    newline: CRLF
    type: csv
    delimiter: ','
    quote: '"'
    escape: '"'
    null_string: 'NULL'
    trim_if_not_quoted: false
    skip_header_lines: 1
    allow_extra_columns: false
    allow_optional_columns: false
    columns:
    - {name: id, type: long}
    - {name: account, type: long}
    - {name: time, type: timestamp, format: '%Y-%m-%d %H:%M:%S'}
    - {name: purchase, type: timestamp, format: '%Y%m%d'}
    - {name: comment, type: string}
filters:
  - type: column
    add_columns:
      - { name: x_date, type: string, default: "{{ env.X_DATE }}" }
  - type: eval
    eval_columns:
      - comment: comment ? "NULL" : "NOT NULL"
out:
  type: stdout
$ embulk preview -G config.yml.liquid
2016-07-15 16:24:02.532 +0900: Embulk v0.8.9
mapping values are not allowed here
 in 'string', line 30, column 35:
          - comment: comment ? "NULL" : "NOT NULL"
                                      ^

	at org.yaml.snakeyaml.scanner.ScannerImpl.fetchValue(org/yaml/snakeyaml/scanner/ScannerImpl.java:871)
	at org.yaml.snakeyaml.scanner.ScannerImpl.fetchMoreTokens(org/yaml/snakeyaml/scanner/ScannerImpl.java:360)
	at org.yaml.snakeyaml.scanner.ScannerImpl.checkToken(org/yaml/snakeyaml/scanner/ScannerImpl.java:226)
	at org.yaml.snakeyaml.parser.ParserImpl$ParseBlockMappingKey.produce(org/yaml/snakeyaml/parser/ParserImpl.java:558)
	at org.yaml.snakeyaml.parser.ParserImpl.peekEvent(org/yaml/snakeyaml/parser/ParserImpl.java:158)
	at org.yaml.snakeyaml.parser.ParserImpl.checkEvent(org/yaml/snakeyaml/parser/ParserImpl.java:143)
	at org.yaml.snakeyaml.composer.Composer.composeMappingNode(org/yaml/snakeyaml/composer/Composer.java:226)
	at org.yaml.snakeyaml.composer.Composer.composeNode(org/yaml/snakeyaml/composer/Composer.java:155)
	at org.yaml.snakeyaml.composer.Composer.composeSequenceNode(org/yaml/snakeyaml/composer/Composer.java:200)
	at org.yaml.snakeyaml.composer.Composer.composeNode(org/yaml/snakeyaml/composer/Composer.java:153)
	at org.yaml.snakeyaml.composer.Composer.composeMappingNode(org/yaml/snakeyaml/composer/Composer.java:231)
	at org.yaml.snakeyaml.composer.Composer.composeNode(org/yaml/snakeyaml/composer/Composer.java:155)
	at org.yaml.snakeyaml.composer.Composer.composeSequenceNode(org/yaml/snakeyaml/composer/Composer.java:200)
	at org.yaml.snakeyaml.composer.Composer.composeNode(org/yaml/snakeyaml/composer/Composer.java:153)
	at org.yaml.snakeyaml.composer.Composer.composeMappingNode(org/yaml/snakeyaml/composer/Composer.java:231)
	at org.yaml.snakeyaml.composer.Composer.composeNode(org/yaml/snakeyaml/composer/Composer.java:155)
	at org.yaml.snakeyaml.composer.Composer.composeDocument(org/yaml/snakeyaml/composer/Composer.java:122)
	at org.yaml.snakeyaml.composer.Composer.getSingleNode(org/yaml/snakeyaml/composer/Composer.java:105)
	at org.yaml.snakeyaml.constructor.BaseConstructor.getSingleData(org/yaml/snakeyaml/constructor/BaseConstructor.java:120)
	at org.yaml.snakeyaml.Yaml.loadFromReader(org/yaml/snakeyaml/Yaml.java:481)
	at org.yaml.snakeyaml.Yaml.load(org/yaml/snakeyaml/Yaml.java:400)
	at org.embulk.config.ConfigLoader.fromYamlString(org/embulk/config/ConfigLoader.java:66)
	at java.lang.reflect.Method.invoke(java/lang/reflect/Method.java:498)
	at RUBY.read_config(/Users/akira/.embulk/bin/embulk!/embulk/runner.rb:129)
	at RUBY.preview(/Users/akira/.embulk/bin/embulk!/embulk/runner.rb:32)
	at RUBY.run(/Users/akira/.embulk/bin/embulk!/embulk/command/embulk_run.rb:304)
	at RUBY.<top>(/Users/akira/.embulk/bin/embulk!/embulk/command/embulk_main.rb:2)
	at org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:937)
	at RUBY.(root)(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:1)
	at Users.akira.$_dot_embulk.bin.embulk.embulk.command.embulk_bundle.<top>(file:/Users/akira/.embulk/bin/embulk!/embulk/command/embulk_bundle.rb:51)
	at java.lang.invoke.MethodHandle.invokeWithArguments(java/lang/invoke/MethodHandle.java:627)
	at org.embulk.cli.Main.main(org/embulk/cli/Main.java:23)

Error: mapping values are not allowed here
 in 'string', line 30, column 35:
          - comment: comment ? "NULL" : "NOT NULL"
                                      ^
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment