Skip to content

Instantly share code, notes, and snippets.

@maiha
Created October 4, 2018 14:40
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save maiha/1f2a960734386ea21a2f145533808236 to your computer and use it in GitHub Desktop.
Save maiha/1f2a960734386ea21a2f145533808236 to your computer and use it in GitHub Desktop.

目的

  • 任意の日本語文章(UTF-8)を「ひらがな化」する

結論

  • ipadic-utf8 で mecab -Oyomi | nkf --hiragana がバランスよさげ
$ ls -l dic
合計 0
lrwxrwxrwx 1 maiha maiha 31 Oct  4 23:08 ipadic-utf8 -> /var/lib/mecab/dic/ipadic-utf8//
lrwxrwxrwx 1 maiha maiha 30 Oct  4 23:08 juman-utf8 -> /var/lib/mecab/dic/juman-utf8//
lrwxrwxrwx 1 maiha maiha 30 Oct  4 23:08 naist-jdic -> /var/lib/mecab/dic/naist-jdic//
lrwxrwxrwx 1 maiha maiha 35 Oct  4 23:28 unidic -> /mnt/volume0/mecab/unidic-cwj-2.3.0/

$ cat text
欅坂46
乃木坂46

$ for x in dic/*; (echo "# $x"; cat text | mecab -Oyomi -d $x)
# dic/ipadic-utf8
ケヤキザカ46
ノギザカ46
# dic/juman-utf8
けやきさか46
乃木さか46
# dic/naist-jdic
ケヤキザカヨンロク
ノギザカヨンロク
# dic/unidic
ケヤキサカヨンロク
ノギザカヨンロク

$ for x in dic/*; (echo "# $x"; cat text | mecab -Oyomi -d $x | nkf --hiragana)
# dic/ipadic-utf8
けやきざか46
のぎざか46
# dic/juman-utf8
けやきさか46
乃木さか46
# dic/naist-jdic
けやきざかよんろく
のぎざかよんろく
# dic/unidic
けやきさかよんろく
のぎざかよんろく

インストール

mecabと辞書(deb)

$ apt install mecab mecab-jumandic-utf8 mecab-ipadic-utf8 mecab-naist-jdic -y

unidic辞書

$ wget http://unidic.ninjal.ac.jp/dictionaries/UniDic-gendai/stable/src/unidic-cwj-2.3.0.zip
$ unzip unidic-cwj-2.3.0.zip
$ cat >> unidic-cwj-2.3.0/dicrc
node-format-yomi = %f[9]
unk-format-yomi = %m
eos-format-yomi  = \n

参考

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment