Skip to content

Instantly share code, notes, and snippets.

@dwf
Created April 8, 2024 21:30
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save dwf/f071422e3d3e09a4024a70c649b7cd51 to your computer and use it in GitHub Desktop.
Save dwf/f071422e3d3e09a4024a70c649b7cd51 to your computer and use it in GitHub Desktop.
Error log from attempted jax-rocm build
Python 3.11.8 (main, Feb 6 2024, 21:21:21) [GCC 13.2.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import jax
2024-04-08 22:23:25.127712: E external/xla/xla/stream_executor/plugin_registry.cc:91] Invalid plugin kind specified: DNN
>>> X = jax.numpy.zeros((5000, 6000))
:1:hip_code_object.cpp :516 : 809713991079 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991085 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991086 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991091 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991092 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991095 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991097 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991100 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd61d5000
:1:hip_code_object.cpp :516 : 809713991107 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991109 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991110 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991113 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991115 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991117 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991120 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991123 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd61b0000
:1:hip_code_object.cpp :516 : 809713991130 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991132 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991133 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991137 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991140 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991142 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991144 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991147 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd618a000
:1:hip_code_object.cpp :516 : 809713991153 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991155 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991156 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991159 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991161 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991165 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991168 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991171 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd6163000
:1:hip_code_object.cpp :516 : 809713991177 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991180 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991181 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991183 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991185 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991187 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991191 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991194 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd60d7000
:1:hip_code_object.cpp :516 : 809713991200 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991203 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991205 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991207 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991208 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991210 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991213 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991216 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd6026000
:1:hip_code_object.cpp :516 : 809713991222 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! [206/3507]
:1:hip_code_object.cpp :517 : 809713991225 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991226 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991228 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991229 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991232 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991235 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991236 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd6004000
:1:hip_code_object.cpp :516 : 809713991243 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991245 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991247 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991250 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991252 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991255 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991259 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991262 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd5f85000
:1:hip_code_object.cpp :516 : 809713991268 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991270 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991272 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991274 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991276 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991278 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991281 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991283 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd5f63000
:1:hip_code_object.cpp :516 : 809713991290 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991292 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991293 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991295 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991296 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991299 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991302 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991306 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd5f3b000
:1:hip_code_object.cpp :516 : 809713991312 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991315 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991317 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991320 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991322 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991324 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991326 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991329 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd5eb7000
:1:hip_code_object.cpp :516 : 809713991335 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991337 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991339 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991342 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991344 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991347 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991350 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991352 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd5e52000
:1:hip_code_object.cpp :516 : 809713991356 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991358 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991359 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713991361 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713991363 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713991366 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713991368 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713991371 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd5dc8000
:1:hip_code_object.cpp :516 : 809713991402 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713991403 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713991406 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713993228 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713993229 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713993231 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713993233 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713993236 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0x56725000
:1:hip_code_object.cpp :516 : 809713993256 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices!
:1:hip_code_object.cpp :517 : 809713993258 us: [pid:3362424 tid:0x7ffff7eaf740] Devices:
:1:hip_code_object.cpp :520 : 809713993260 us: [pid:3362424 tid:0x7ffff7eaf740] amdgcn-amd-amdhsa--gfx1100 - [Not Found]
:1:hip_code_object.cpp :524 : 809713993262 us: [pid:3362424 tid:0x7ffff7eaf740] Bundled Code Objects:
:1:hip_code_object.cpp :540 : 809713993263 us: [pid:3362424 tid:0x7ffff7eaf740] host-x86_64-unknown-linux-- - [Unsupported]
:1:hip_code_object.cpp :538 : 809713993266 us: [pid:3362424 tid:0x7ffff7eaf740] hipv4-amdgcn-amd-amdhsa--gfx906 - [code object targetID is amdgcn-amd-amdhsa--gfx906]
:1:hip_code_object.cpp :544 : 809713993268 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Unable to find code object for all current devices! - 209
:1:hip_fatbin.cpp :274 : 809713993271 us: [pid:3362424 tid:0x7ffff7eaf740] hipErrorNoBinaryForGpu: Couldn't find binary for ptr: 0xd3bb8000
>>> X.dot(X.T)
:1:hip_code_object.cpp :616 : 810061383535 us: [pid:3362424 tid:0x7ffff7eaf740] Cannot find the function: Cijk_Ailk_Bljk_SB_MT128x256x16_SN_1LDSB0_AMAS3_BL1_BS1_EPS0_GRVW4_GSU1_GSUAMB_ISA1100_IU1_K1_KLA_LBSPP0_LPA0_LPB0_LRVW4_MIAV0_MMFGLC_NLCA1_NLCB1_PGR1_PLR1_SIA1_SS0_SU32_SUM3_SUS128_SVW4_TT8_16_TLDS0_UMLDSA0_UMLDSB0_USFGROn1_VAW1_VSn1_VW4_WSGRA0_WSGRB0_WS32_WG16_16_1_WGM4
:1:hip_module.cpp :83 : 810061383549 us: [pid:3362424 tid:0x7ffff7eaf740] Cannot find the function: Cijk_Ailk_Bljk_SB_MT128x256x16_SN_1LDSB0_AMAS3_BL1_BS1_EPS0_GRVW4_GSU1_GSUAMB_ISA1100_IU1_K1_KLA_LBSPP0_LPA0_LPB0_LRVW4_MIAV0_MMFGLC_NLCA1_NLCB1_PGR1_PLR1_SIA1_SS0_SU32_SUM3_SUS128_SVW4_TT8_16_TLDS0_UMLDSA0_UMLDSB0_USFGROn1_VAW1_VSn1_VW4_WSGRA0_WSGRB0_WS32_WG16_16_1_WGM4 for module: 0x23de950
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
jaxlib.xla_extension.XlaRuntimeError: INTERNAL: Failed to launch ROCm kernel: redzone_checker with block dimensions: 1024x1x1: hipError_t(98)
--------------------
For simplicity, JAX has removed its internal frames from the traceback of the following exception. Set JAX_TRACEBACK_FILTERING=off to include these.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment