Skip to content

Instantly share code, notes, and snippets.

@aviator19941
Created November 15, 2024 00:24
Show Gist options
  • Save aviator19941/d49e0baca5c6f64a93f8926f99cd111f to your computer and use it in GitHub Desktop.
Save aviator19941/d49e0baca5c6f64a93f8926f99cd111f to your computer and use it in GitHub Desktop.
compile_llama_3.1_tp1.txt
../iree-build-no-trace/tools/iree-compile <path-to-mlir> \
--iree-hip-target=gfx942 \
--iree-hal-target-backends=rocm \
--iree-dispatch-creation-enable-aggressive-fusion=true \
--iree-global-opt-propagate-transposes=true \
--iree-opt-aggressively-propagate-transposes=true \
--iree-opt-data-tiling=false \
--iree-preprocessing-pass-pipeline="builtin.module(util.func(iree-preprocessing-generalize-linalg-matmul-experimental))" \
-o=<path-to-vmfb>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment