Antigen遅そうだしあんまり使ってないので該当行削除した
$ time (source ~/.zshrc)
( source ~/.zshrc; ) 0.32s user 0.16s system 94% cpu 0.509 total
# 以下削除
----------------------------------------
source ~/.zsh/antigen/antigen.zsh
antigen-bundle bundler
antigen-apply
----------------------------------------
$ time (source ~/.zshrc)
( source ~/.zshrc; ) 0.16s user 0.09s system 94% cpu 0.263 total
rbenv rehashしないようにした
$ time (eval "$(rbenv init -)")
( eval "$(rbenv init -)"; ) 0.09s user 0.08s system 92% cpu 0.176 total
$ time (eval "$(rbenv init - --no-rehash)")
( eval "$(rbenv init - --no-rehash)"; ) 0.05s user 0.05s system 94% cpu 0.099 total
大体1/3程度の時間になった
$ time (source ~/.zshrc)
( source ~/.zshrc; ) 0.11s user 0.05s system 96% cpu 0.165 total