Skip to content

Instantly share code, notes, and snippets.

@junaruga
Created November 6, 2023 22:32
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save junaruga/1bb934710d8e06be8a3bd4ed906a7f18 to your computer and use it in GitHub Desktop.
Save junaruga/1bb934710d8e06be8a3bd4ed906a7f18 to your computer and use it in GitHub Desktop.
(venv3) $ pip3 install transformers==3.0.0
Collecting transformers==3.0.0
Using cached transformers-3.0.0-py3-none-any.whl (754 kB)
Collecting numpy
Using cached numpy-1.26.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (18.2 MB)
Collecting tokenizers==0.8.0-rc4
Using cached tokenizers-0.8.0rc4.tar.gz (96 kB)
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Collecting packaging
Using cached packaging-23.2-py3-none-any.whl (53 kB)
Collecting filelock
Using cached filelock-3.13.1-py3-none-any.whl (11 kB)
Collecting requests
Using cached requests-2.31.0-py3-none-any.whl (62 kB)
Collecting tqdm>=4.27
Using cached tqdm-4.66.1-py3-none-any.whl (78 kB)
Collecting regex!=2019.12.17
Using cached regex-2023.10.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (785 kB)
Collecting sentencepiece
Using cached sentencepiece-0.1.99-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.3 MB)
Collecting sacremoses
Using cached sacremoses-0.1.1-py3-none-any.whl (897 kB)
Collecting charset-normalizer<4,>=2
Using cached charset_normalizer-3.3.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (140 kB)
Collecting idna<4,>=2.5
Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting urllib3<3,>=1.21.1
Using cached urllib3-2.0.7-py3-none-any.whl (124 kB)
Collecting certifi>=2017.4.17
Using cached certifi-2023.7.22-py3-none-any.whl (158 kB)
Collecting click
Using cached click-8.1.7-py3-none-any.whl (97 kB)
Collecting joblib
Using cached joblib-1.3.2-py3-none-any.whl (302 kB)
Building wheels for collected packages: tokenizers
Building wheel for tokenizers (pyproject.toml) ... error
error: subprocess-exited-with-error
× Building wheel for tokenizers (pyproject.toml) did not run successfully.
│ exit code: 1
╰─> [216 lines of output]
/tmp/pip-build-env-kl9x6sq4/overlay/lib/python3.11/site-packages/setuptools/dist.py:314: InformationOnly: Normalizing '0.8.0.rc4' to '0.8.0rc4'
self.metadata.version = self._normalize_version(
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-x86_64-cpython-311
creating build/lib.linux-x86_64-cpython-311/tokenizers
copying tokenizers/__init__.py -> build/lib.linux-x86_64-cpython-311/tokenizers
creating build/lib.linux-x86_64-cpython-311/tokenizers/models
copying tokenizers/models/__init__.py -> build/lib.linux-x86_64-cpython-311/tokenizers/models
creating build/lib.linux-x86_64-cpython-311/tokenizers/decoders
copying tokenizers/decoders/__init__.py -> build/lib.linux-x86_64-cpython-311/tokenizers/decoders
creating build/lib.linux-x86_64-cpython-311/tokenizers/normalizers
copying tokenizers/normalizers/__init__.py -> build/lib.linux-x86_64-cpython-311/tokenizers/normalizers
creating build/lib.linux-x86_64-cpython-311/tokenizers/pre_tokenizers
copying tokenizers/pre_tokenizers/__init__.py -> build/lib.linux-x86_64-cpython-311/tokenizers/pre_tokenizers
creating build/lib.linux-x86_64-cpython-311/tokenizers/processors
copying tokenizers/processors/__init__.py -> build/lib.linux-x86_64-cpython-311/tokenizers/processors
creating build/lib.linux-x86_64-cpython-311/tokenizers/trainers
copying tokenizers/trainers/__init__.py -> build/lib.linux-x86_64-cpython-311/tokenizers/trainers
creating build/lib.linux-x86_64-cpython-311/tokenizers/implementations
copying tokenizers/implementations/sentencepiece_bpe.py -> build/lib.linux-x86_64-cpython-311/tokenizers/implementations
copying tokenizers/implementations/char_level_bpe.py -> build/lib.linux-x86_64-cpython-311/tokenizers/implementations
copying tokenizers/implementations/byte_level_bpe.py -> build/lib.linux-x86_64-cpython-311/tokenizers/implementations
copying tokenizers/implementations/bert_wordpiece.py -> build/lib.linux-x86_64-cpython-311/tokenizers/implementations
copying tokenizers/implementations/base_tokenizer.py -> build/lib.linux-x86_64-cpython-311/tokenizers/implementations
copying tokenizers/implementations/__init__.py -> build/lib.linux-x86_64-cpython-311/tokenizers/implementations
copying tokenizers/__init__.pyi -> build/lib.linux-x86_64-cpython-311/tokenizers
copying tokenizers/models/__init__.pyi -> build/lib.linux-x86_64-cpython-311/tokenizers/models
copying tokenizers/decoders/__init__.pyi -> build/lib.linux-x86_64-cpython-311/tokenizers/decoders
copying tokenizers/normalizers/__init__.pyi -> build/lib.linux-x86_64-cpython-311/tokenizers/normalizers
copying tokenizers/pre_tokenizers/__init__.pyi -> build/lib.linux-x86_64-cpython-311/tokenizers/pre_tokenizers
copying tokenizers/processors/__init__.pyi -> build/lib.linux-x86_64-cpython-311/tokenizers/processors
copying tokenizers/trainers/__init__.pyi -> build/lib.linux-x86_64-cpython-311/tokenizers/trainers
running build_ext
running build_rust
Updating crates.io index
Updating git repository `https://github.com/n1t0/rayon-cond`
Downloading crates ...
Downloaded serde_derive v1.0.191
Downloaded serde v1.0.191
Downloaded syn v2.0.39
cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml --release -v --features pyo3/extension-module --crate-type cdylib --
warning: unused manifest key: target.x86_64-apple-darwin.rustflags
Compiling proc-macro2 v1.0.69
Compiling unicode-ident v1.0.12
Compiling libc v0.2.150
Compiling autocfg v1.1.0
Compiling syn v1.0.109
Compiling serde v1.0.191
Compiling cfg-if v1.0.0
Compiling scopeguard v1.2.0
Running `rustc --crate-name unicode_ident --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/unicode-ident-1.0.12/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=240eac7f644422c0 -C extra-filename=-240eac7f644422c0 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Running `rustc --crate-name build_script_build --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/proc-macro2-1.0.69/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="proc-macro"' -C metadata=5ac45fe52b994906 -C extra-filename=-5ac45fe52b994906 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/proc-macro2-5ac45fe52b994906 -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Running `rustc --crate-name build_script_build /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/libc-0.2.150/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=634ac2afcacd44f0 -C extra-filename=-634ac2afcacd44f0 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/libc-634ac2afcacd44f0 -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Running `rustc --crate-name build_script_build --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/syn-1.0.109/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="clone-impls"' --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="extra-traits"' --cfg 'feature="full"' --cfg 'feature="parsing"' --cfg 'feature="printing"' --cfg 'feature="proc-macro"' --cfg 'feature="quote"' -C metadata=3f9c38869d3749ab -C extra-filename=-3f9c38869d3749ab --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/syn-3f9c38869d3749ab -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Running `rustc --crate-name autocfg /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/autocfg-1.1.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=3c121ed8f6732ba5 -C extra-filename=-3c121ed8f6732ba5 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Running `rustc --crate-name build_script_build --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/serde-1.0.191/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="serde_derive"' --cfg 'feature="std"' -C metadata=d60bc7bd0632e75a -C extra-filename=-d60bc7bd0632e75a --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/serde-d60bc7bd0632e75a -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Running `rustc --crate-name cfg_if --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/cfg-if-1.0.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=3b6e64d080f30e07 -C extra-filename=-3b6e64d080f30e07 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Running `rustc --crate-name scopeguard /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/scopeguard-1.2.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=1d6dee74c8567c3a -C extra-filename=-1d6dee74c8567c3a --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling crossbeam-utils v0.8.16
Running `rustc --crate-name build_script_build --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/crossbeam-utils-0.8.16/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=4f4ea370fdf094e9 -C extra-filename=-4f4ea370fdf094e9 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/crossbeam-utils-4f4ea370fdf094e9 -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling serde_json v1.0.108
Running `rustc --crate-name build_script_build --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/serde_json-1.0.108/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=c7567658002f4a10 -C extra-filename=-c7567658002f4a10 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/serde_json-c7567658002f4a10 -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling proc-macro-hack v0.5.20+deprecated
Running `rustc --crate-name build_script_build --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/proc-macro-hack-0.5.20+deprecated/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off -C metadata=19443236c91f333f -C extra-filename=-19443236c91f333f --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/proc-macro-hack-19443236c91f333f -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling getrandom v0.1.16
Running `rustc --crate-name build_script_build --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/getrandom-0.1.16/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="std"' -C metadata=afb6618231de3082 -C extra-filename=-afb6618231de3082 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/getrandom-afb6618231de3082 -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling memchr v2.6.4
Running `rustc --crate-name memchr --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/memchr-2.6.4/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="alloc"' --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=507de59c9138e562 -C extra-filename=-507de59c9138e562 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/crossbeam-utils-4f4ea370fdf094e9/build-script-build`
Running `rustc --crate-name crossbeam_utils --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/crossbeam-utils-0.8.16/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=2ffcc72f075ea29f -C extra-filename=-2ffcc72f075ea29f --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern cfg_if=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libcfg_if-3b6e64d080f30e07.rmeta --cap-lints allow`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/syn-3f9c38869d3749ab/build-script-build`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/serde-d60bc7bd0632e75a/build-script-build`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/proc-macro2-5ac45fe52b994906/build-script-build`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/serde-d60bc7bd0632e75a/build-script-build`
Running `rustc --crate-name proc_macro2 --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/proc-macro2-1.0.69/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="proc-macro"' -C metadata=76f8ada0def45bbb -C extra-filename=-76f8ada0def45bbb --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern unicode_ident=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libunicode_ident-240eac7f644422c0.rmeta --cap-lints allow --cfg wrap_proc_macro`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/proc-macro-hack-19443236c91f333f/build-script-build`
Compiling pkg-config v0.3.27
Running `rustc --crate-name pkg_config /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/pkg-config-0.3.27/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=1a2e0fbb1f246043 -C extra-filename=-1a2e0fbb1f246043 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Running `rustc --crate-name proc_macro_hack --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/proc-macro-hack-0.5.20+deprecated/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debug-assertions=off -C metadata=9ea8952802b4cf88 -C extra-filename=-9ea8952802b4cf88 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern proc_macro --cap-lints allow`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/libc-634ac2afcacd44f0/build-script-build`
Running `rustc --crate-name libc /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/libc-0.2.150/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=0a085ba9422fa4aa -C extra-filename=-0a085ba9422fa4aa --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow --cfg freebsd11 --cfg libc_priv_mod_use --cfg libc_union --cfg libc_const_size_of --cfg libc_align --cfg libc_int128 --cfg libc_core_cvoid --cfg libc_packedN --cfg libc_cfg_target_vendor --cfg libc_non_exhaustive --cfg libc_long_array --cfg libc_ptr_addr_of --cfg libc_underscore_const_names --cfg libc_const_extern_fn`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/libc-634ac2afcacd44f0/build-script-build`
Running `rustc --crate-name libc /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/libc-0.2.150/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=3d41badb9da77d9f -C extra-filename=-3d41badb9da77d9f --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow --cfg freebsd11 --cfg libc_priv_mod_use --cfg libc_union --cfg libc_const_size_of --cfg libc_align --cfg libc_int128 --cfg libc_core_cvoid --cfg libc_packedN --cfg libc_cfg_target_vendor --cfg libc_non_exhaustive --cfg libc_long_array --cfg libc_ptr_addr_of --cfg libc_underscore_const_names --cfg libc_const_extern_fn`
Compiling memoffset v0.9.0
Running `rustc --crate-name build_script_build /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/memoffset-0.9.0/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' -C metadata=38c46b15de66ffdb -C extra-filename=-38c46b15de66ffdb --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/memoffset-38c46b15de66ffdb -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern autocfg=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libautocfg-3c121ed8f6732ba5.rlib --cap-lints allow`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/memoffset-38c46b15de66ffdb/build-script-build`
Compiling crossbeam-epoch v0.9.15
Running `rustc --crate-name build_script_build --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/crossbeam-epoch-0.9.15/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="alloc"' --cfg 'feature="std"' -C metadata=659ac7288c5b5a4e -C extra-filename=-659ac7288c5b5a4e --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/crossbeam-epoch-659ac7288c5b5a4e -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern autocfg=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libautocfg-3c121ed8f6732ba5.rlib --cap-lints allow`
Compiling quote v1.0.33
Running `rustc --crate-name quote --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/quote-1.0.33/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="proc-macro"' -C metadata=9122a2cc62b326a7 -C extra-filename=-9122a2cc62b326a7 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern proc_macro2=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libproc_macro2-76f8ada0def45bbb.rmeta --cap-lints allow`
Compiling syn v2.0.39
Running `rustc --crate-name syn --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/syn-2.0.39/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="clone-impls"' --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="parsing"' --cfg 'feature="printing"' --cfg 'feature="proc-macro"' --cfg 'feature="quote"' -C metadata=f8e13b70dca15716 -C extra-filename=-f8e13b70dca15716 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern proc_macro2=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libproc_macro2-76f8ada0def45bbb.rmeta --extern quote=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libquote-9122a2cc62b326a7.rmeta --extern unicode_ident=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libunicode_ident-240eac7f644422c0.rmeta --cap-lints allow`
Running `rustc --crate-name syn --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/syn-1.0.109/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="clone-impls"' --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="extra-traits"' --cfg 'feature="full"' --cfg 'feature="parsing"' --cfg 'feature="printing"' --cfg 'feature="proc-macro"' --cfg 'feature="quote"' -C metadata=7a0bf51b296fe2fc -C extra-filename=-7a0bf51b296fe2fc --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern proc_macro2=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libproc_macro2-76f8ada0def45bbb.rmeta --extern quote=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libquote-9122a2cc62b326a7.rmeta --extern unicode_ident=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libunicode_ident-240eac7f644422c0.rmeta --cap-lints allow --cfg syn_disable_nightly_tests`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/crossbeam-epoch-659ac7288c5b5a4e/build-script-build`
Running `rustc --crate-name memoffset /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/memoffset-0.9.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' -C metadata=e1459cac056e0481 -C extra-filename=-e1459cac056e0481 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow --cfg tuple_ty --cfg allow_clippy --cfg maybe_uninit --cfg doctests --cfg raw_ref_macros --cfg stable_const`
Running `rustc --crate-name crossbeam_epoch --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/crossbeam-epoch-0.9.15/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="alloc"' --cfg 'feature="std"' -C metadata=a5793fed1b201a41 -C extra-filename=-a5793fed1b201a41 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern cfg_if=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libcfg_if-3b6e64d080f30e07.rmeta --extern crossbeam_utils=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libcrossbeam_utils-2ffcc72f075ea29f.rmeta --extern memoffset=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libmemoffset-e1459cac056e0481.rmeta --extern scopeguard=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libscopeguard-1d6dee74c8567c3a.rmeta --cap-lints allow`
Compiling cc v1.0.83
Compiling aho-corasick v1.1.2
Running `rustc --crate-name aho_corasick --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/aho-corasick-1.1.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="perf-literal"' --cfg 'feature="std"' -C metadata=5bcf0e453be2bd59 -C extra-filename=-5bcf0e453be2bd59 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern memchr=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libmemchr-507de59c9138e562.rmeta --cap-lints allow`
Running `rustc --crate-name cc --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/cc-1.0.83/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=f61f9764d339429a -C extra-filename=-f61f9764d339429a --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern libc=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/liblibc-3d41badb9da77d9f.rmeta --cap-lints allow`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/getrandom-afb6618231de3082/build-script-build`
Running `rustc --crate-name memchr --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/memchr-2.6.4/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="alloc"' --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=d71915baa5ef97a2 -C extra-filename=-d71915baa5ef97a2 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling smallvec v1.11.1
Running `rustc --crate-name smallvec --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/smallvec-1.11.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=2237d9b4bcae972b -C extra-filename=-2237d9b4bcae972b --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling rayon-core v1.12.0
Running `rustc --crate-name build_script_build --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rayon-core-1.12.0/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off -C metadata=d34f91f2f6d46323 -C extra-filename=-d34f91f2f6d46323 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/rayon-core-d34f91f2f6d46323 -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling regex-syntax v0.8.2
Running `rustc --crate-name regex_syntax --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/regex-syntax-0.8.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="std"' --cfg 'feature="unicode"' --cfg 'feature="unicode-age"' --cfg 'feature="unicode-bool"' --cfg 'feature="unicode-case"' --cfg 'feature="unicode-gencat"' --cfg 'feature="unicode-perl"' --cfg 'feature="unicode-script"' --cfg 'feature="unicode-segment"' -C metadata=615b75d8e9ea7ce6 -C extra-filename=-615b75d8e9ea7ce6 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling unicode-width v0.1.11
Running `rustc --crate-name unicode_width /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/unicode-width-0.1.11/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' -C metadata=a51b82a097b7ad5e -C extra-filename=-a51b82a097b7ad5e --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/rayon-core-d34f91f2f6d46323/build-script-build`
Compiling crossbeam-deque v0.8.3
Running `rustc --crate-name crossbeam_deque --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/crossbeam-deque-0.8.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="crossbeam-epoch"' --cfg 'feature="crossbeam-utils"' --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=cd104589bb1bf718 -C extra-filename=-cd104589bb1bf718 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern cfg_if=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libcfg_if-3b6e64d080f30e07.rmeta --extern crossbeam_epoch=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libcrossbeam_epoch-a5793fed1b201a41.rmeta --extern crossbeam_utils=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libcrossbeam_utils-2ffcc72f075ea29f.rmeta --cap-lints allow`
Running `rustc --crate-name aho_corasick --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/aho-corasick-1.1.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="perf-literal"' --cfg 'feature="std"' -C metadata=5f4a0e4fcdce2fec -C extra-filename=-5f4a0e4fcdce2fec --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern memchr=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libmemchr-d71915baa5ef97a2.rmeta --cap-lints allow`
Running `rustc --crate-name getrandom --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/getrandom-0.1.16/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="std"' -C metadata=c0958b589cf88007 -C extra-filename=-c0958b589cf88007 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern cfg_if=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libcfg_if-3b6e64d080f30e07.rmeta --extern libc=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/liblibc-0a085ba9422fa4aa.rmeta --cap-lints allow`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/serde_json-c7567658002f4a10/build-script-build`
Compiling ryu v1.0.15
Running `rustc --crate-name ryu --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/ryu-1.0.15/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=e253777e7f6df676 -C extra-filename=-e253777e7f6df676 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling either v1.9.0
Running `rustc --crate-name either --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/either-1.9.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="use_std"' -C metadata=6285153e3b923a65 -C extra-filename=-6285153e3b923a65 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Running `rustc --crate-name regex_syntax --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/regex-syntax-0.8.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' --cfg 'feature="unicode"' --cfg 'feature="unicode-age"' --cfg 'feature="unicode-bool"' --cfg 'feature="unicode-case"' --cfg 'feature="unicode-gencat"' --cfg 'feature="unicode-perl"' --cfg 'feature="unicode-script"' --cfg 'feature="unicode-segment"' -C metadata=e5cdcc9979e7db3a -C extra-filename=-e5cdcc9979e7db3a --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling onig_sys v69.8.1
Running `rustc --crate-name build_script_build --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/onig_sys-69.8.1/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off -C metadata=f8f42429484847d0 -C extra-filename=-f8f42429484847d0 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/onig_sys-f8f42429484847d0 -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern cc=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libcc-f61f9764d339429a.rlib --extern pkg_config=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libpkg_config-1a2e0fbb1f246043.rlib --cap-lints allow`
Compiling itoa v1.0.9
Running `rustc --crate-name itoa --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/itoa-1.0.9/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=e7a4404cafd749c4 -C extra-filename=-e7a4404cafd749c4 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/onig_sys-f8f42429484847d0/build-script-build`
Compiling rand_core v0.5.1
Running `rustc --crate-name rand_core --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rand_core-0.5.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="alloc"' --cfg 'feature="getrandom"' --cfg 'feature="std"' -C metadata=18c07394131572e8 -C extra-filename=-18c07394131572e8 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern getrandom=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libgetrandom-c0958b589cf88007.rmeta --cap-lints allow`
Running `rustc --crate-name rayon_core --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rayon-core-1.12.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=2daacfb9b2f92ceb -C extra-filename=-2daacfb9b2f92ceb --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern crossbeam_deque=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libcrossbeam_deque-cd104589bb1bf718.rmeta --extern crossbeam_utils=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libcrossbeam_utils-2ffcc72f075ea29f.rmeta --cap-lints allow`
Compiling regex-automata v0.4.3
Running `rustc --crate-name regex_automata --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/regex-automata-0.4.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="alloc"' --cfg 'feature="dfa-onepass"' --cfg 'feature="hybrid"' --cfg 'feature="meta"' --cfg 'feature="nfa-backtrack"' --cfg 'feature="nfa-pikevm"' --cfg 'feature="nfa-thompson"' --cfg 'feature="perf-inline"' --cfg 'feature="perf-literal"' --cfg 'feature="perf-literal-multisubstring"' --cfg 'feature="perf-literal-substring"' --cfg 'feature="std"' --cfg 'feature="syntax"' --cfg 'feature="unicode"' --cfg 'feature="unicode-age"' --cfg 'feature="unicode-bool"' --cfg 'feature="unicode-case"' --cfg 'feature="unicode-gencat"' --cfg 'feature="unicode-perl"' --cfg 'feature="unicode-script"' --cfg 'feature="unicode-segment"' --cfg 'feature="unicode-word-boundary"' -C metadata=06a69b9697898730 -C extra-filename=-06a69b9697898730 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern aho_corasick=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libaho_corasick-5bcf0e453be2bd59.rmeta --extern memchr=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libmemchr-507de59c9138e562.rmeta --extern regex_syntax=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libregex_syntax-615b75d8e9ea7ce6.rmeta --cap-lints allow`
Compiling serde_derive v1.0.191
Running `rustc --crate-name serde_derive /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/serde_derive-1.0.191/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' -C metadata=498abe123b2a8d73 -C extra-filename=-498abe123b2a8d73 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern proc_macro2=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libproc_macro2-76f8ada0def45bbb.rlib --extern quote=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libquote-9122a2cc62b326a7.rlib --extern syn=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libsyn-f8e13b70dca15716.rlib --extern proc_macro --cap-lints allow`
Compiling ghost v0.1.16
Running `rustc --crate-name ghost --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/ghost-0.1.16/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debug-assertions=off -C metadata=d90a38102c98dbd8 -C extra-filename=-d90a38102c98dbd8 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern proc_macro2=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libproc_macro2-76f8ada0def45bbb.rlib --extern quote=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libquote-9122a2cc62b326a7.rlib --extern syn=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libsyn-f8e13b70dca15716.rlib --extern proc_macro --cap-lints allow`
Running `rustc --crate-name regex_automata --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/regex-automata-0.4.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="alloc"' --cfg 'feature="dfa-onepass"' --cfg 'feature="hybrid"' --cfg 'feature="meta"' --cfg 'feature="nfa-backtrack"' --cfg 'feature="nfa-pikevm"' --cfg 'feature="nfa-thompson"' --cfg 'feature="perf-inline"' --cfg 'feature="perf-literal"' --cfg 'feature="perf-literal-multisubstring"' --cfg 'feature="perf-literal-substring"' --cfg 'feature="std"' --cfg 'feature="syntax"' --cfg 'feature="unicode"' --cfg 'feature="unicode-age"' --cfg 'feature="unicode-bool"' --cfg 'feature="unicode-case"' --cfg 'feature="unicode-gencat"' --cfg 'feature="unicode-perl"' --cfg 'feature="unicode-script"' --cfg 'feature="unicode-segment"' --cfg 'feature="unicode-word-boundary"' -C metadata=a7103ec43d415ef1 -C extra-filename=-a7103ec43d415ef1 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern aho_corasick=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libaho_corasick-5f4a0e4fcdce2fec.rmeta --extern memchr=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libmemchr-d71915baa5ef97a2.rmeta --extern regex_syntax=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libregex_syntax-e5cdcc9979e7db3a.rmeta --cap-lints allow`
Compiling num-traits v0.2.17
Running `rustc --crate-name build_script_build --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/num-traits-0.2.17/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=5d2d18599a2de590 -C extra-filename=-5d2d18599a2de590 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/num-traits-5d2d18599a2de590 -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern autocfg=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libautocfg-3c121ed8f6732ba5.rlib --cap-lints allow`
Compiling version_check v0.9.4
Running `rustc --crate-name version_check /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/version_check-0.9.4/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=aa2d71d9596fb858 -C extra-filename=-aa2d71d9596fb858 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling regex v1.10.2
Running `rustc --crate-name regex --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/regex-1.10.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="perf"' --cfg 'feature="perf-backtrack"' --cfg 'feature="perf-cache"' --cfg 'feature="perf-dfa"' --cfg 'feature="perf-inline"' --cfg 'feature="perf-literal"' --cfg 'feature="perf-onepass"' --cfg 'feature="std"' --cfg 'feature="unicode"' --cfg 'feature="unicode-age"' --cfg 'feature="unicode-bool"' --cfg 'feature="unicode-case"' --cfg 'feature="unicode-gencat"' --cfg 'feature="unicode-perl"' --cfg 'feature="unicode-script"' --cfg 'feature="unicode-segment"' -C metadata=692da07523c3eb26 -C extra-filename=-692da07523c3eb26 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern aho_corasick=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libaho_corasick-5bcf0e453be2bd59.rmeta --extern memchr=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libmemchr-507de59c9138e562.rmeta --extern regex_automata=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libregex_automata-06a69b9697898730.rmeta --extern regex_syntax=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libregex_syntax-615b75d8e9ea7ce6.rmeta --cap-lints allow`
Compiling lazy_static v1.4.0
Running `rustc --crate-name lazy_static /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/lazy_static-1.4.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=236354b50450343b -C extra-filename=-236354b50450343b --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling inventory v0.1.11
Running `rustc --crate-name build_script_build --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/inventory-0.1.11/build.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type bin --emit=dep-info,link -C embed-bitcode=no -C debug-assertions=off -C metadata=2399af1e2381215a -C extra-filename=-2399af1e2381215a --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/inventory-2399af1e2381215a -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling ppv-lite86 v0.2.17
Running `rustc --crate-name ppv_lite86 --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/ppv-lite86-0.2.17/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="simd"' --cfg 'feature="std"' -C metadata=1f45f6adf1819b85 -C extra-filename=-1f45f6adf1819b85 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling cfg-if v0.1.10
Running `rustc --crate-name cfg_if --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/cfg-if-0.1.10/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=2bf6e4348c40920a -C extra-filename=-2bf6e4348c40920a --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling once_cell v1.18.0
Running `rustc --crate-name once_cell --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/once_cell-1.18.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="alloc"' --cfg 'feature="default"' --cfg 'feature="race"' --cfg 'feature="std"' -C metadata=906a01d506597d08 -C extra-filename=-906a01d506597d08 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling bitflags v1.3.2
Running `rustc --crate-name bitflags --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/bitflags-1.3.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' -C metadata=7e73ab5e335b995a -C extra-filename=-7e73ab5e335b995a --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling unindent v0.1.11
Running `rustc --crate-name unindent --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/unindent-0.1.11/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=fb83c51ceccc3069 -C extra-filename=-fb83c51ceccc3069 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
Compiling ctor v0.1.26
Running `rustc --crate-name ctor --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/ctor-0.1.26/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debug-assertions=off -C metadata=cc5de7b44092e743 -C extra-filename=-cc5de7b44092e743 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern quote=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libquote-9122a2cc62b326a7.rlib --extern syn=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libsyn-7a0bf51b296fe2fc.rlib --extern proc_macro --cap-lints allow`
Compiling indoc-impl v0.3.6
Running `rustc --crate-name indoc_impl --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/indoc-impl-0.3.6/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debug-assertions=off -C metadata=e0eb5f14c3a70b0c -C extra-filename=-e0eb5f14c3a70b0c --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern proc_macro_hack=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libproc_macro_hack-9ea8952802b4cf88.so --extern proc_macro2=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libproc_macro2-76f8ada0def45bbb.rlib --extern quote=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libquote-9122a2cc62b326a7.rlib --extern syn=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libsyn-7a0bf51b296fe2fc.rlib --extern unindent=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libunindent-fb83c51ceccc3069.rlib --extern proc_macro --cap-lints allow`
Running `rustc --crate-name regex --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/regex-1.10.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="perf"' --cfg 'feature="perf-backtrack"' --cfg 'feature="perf-cache"' --cfg 'feature="perf-dfa"' --cfg 'feature="perf-inline"' --cfg 'feature="perf-literal"' --cfg 'feature="perf-onepass"' --cfg 'feature="std"' --cfg 'feature="unicode"' --cfg 'feature="unicode-age"' --cfg 'feature="unicode-bool"' --cfg 'feature="unicode-case"' --cfg 'feature="unicode-gencat"' --cfg 'feature="unicode-perl"' --cfg 'feature="unicode-script"' --cfg 'feature="unicode-segment"' -C metadata=eb182aa81eaa8503 -C extra-filename=-eb182aa81eaa8503 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern aho_corasick=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libaho_corasick-5f4a0e4fcdce2fec.rmeta --extern memchr=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libmemchr-d71915baa5ef97a2.rmeta --extern regex_automata=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libregex_automata-a7103ec43d415ef1.rmeta --extern regex_syntax=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libregex_syntax-e5cdcc9979e7db3a.rmeta --cap-lints allow`
Compiling inventory v0.2.3
Running `rustc --crate-name inventory --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/inventory-0.2.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=bb38db63a7ce1861 -C extra-filename=-bb38db63a7ce1861 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern ctor=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libctor-cc5de7b44092e743.so --extern ghost=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libghost-d90a38102c98dbd8.so --cap-lints allow`
Compiling inventory-impl v0.1.11
Running `rustc --crate-name inventory_impl --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/inventory-impl-0.1.11/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debug-assertions=off -C metadata=b15068748d7f4f63 -C extra-filename=-b15068748d7f4f63 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern proc_macro2=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libproc_macro2-76f8ada0def45bbb.rlib --extern quote=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libquote-9122a2cc62b326a7.rlib --extern syn=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libsyn-7a0bf51b296fe2fc.rlib --extern proc_macro --cap-lints allow`
Compiling typetag-impl v0.1.8
Running `rustc --crate-name typetag_impl --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/typetag-impl-0.1.8/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debug-assertions=off -C metadata=5fe50e3d389c8b45 -C extra-filename=-5fe50e3d389c8b45 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern proc_macro2=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libproc_macro2-76f8ada0def45bbb.rlib --extern quote=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libquote-9122a2cc62b326a7.rlib --extern syn=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libsyn-7a0bf51b296fe2fc.rlib --extern proc_macro --cap-lints allow`
Running `rustc --crate-name serde --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/serde-1.0.191/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="serde_derive"' --cfg 'feature="std"' -C metadata=077e199dbd167540 -C extra-filename=-077e199dbd167540 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern serde_derive=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libserde_derive-498abe123b2a8d73.so --cap-lints allow`
Running `rustc --crate-name serde --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/serde-1.0.191/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="derive"' --cfg 'feature="serde_derive"' --cfg 'feature="std"' -C metadata=2a87357517b93c49 -C extra-filename=-2a87357517b93c49 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern serde_derive=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libserde_derive-498abe123b2a8d73.so --cap-lints allow`
Compiling parking_lot_core v0.7.3
Running `rustc --crate-name parking_lot_core --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/parking_lot_core-0.7.3/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="nightly"' -C metadata=c61f5a46755c6b27 -C extra-filename=-c61f5a46755c6b27 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern cfg_if=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libcfg_if-2bf6e4348c40920a.rmeta --extern libc=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/liblibc-0a085ba9422fa4aa.rmeta --extern smallvec=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libsmallvec-2237d9b4bcae972b.rmeta --cap-lints allow`
Compiling rand_chacha v0.2.2
Running `rustc --crate-name rand_chacha --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rand_chacha-0.2.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="std"' -C metadata=297dfcba52f85cf1 -C extra-filename=-297dfcba52f85cf1 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern ppv_lite86=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libppv_lite86-1f45f6adf1819b85.rmeta --extern rand_core=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/librand_core-18c07394131572e8.rmeta --cap-lints allow`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/inventory-2399af1e2381215a/build-script-build`
Compiling console v0.15.7
Running `rustc --crate-name console --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/console-0.15.7/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="ansi-parsing"' --cfg 'feature="default"' --cfg 'feature="unicode-width"' -C metadata=e55ab89fc8f2d449 -C extra-filename=-e55ab89fc8f2d449 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern lazy_static=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/liblazy_static-236354b50450343b.rmeta --extern libc=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/liblibc-0a085ba9422fa4aa.rmeta --extern unicode_width=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libunicode_width-a51b82a097b7ad5e.rmeta --cap-lints allow`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/num-traits-5d2d18599a2de590/build-script-build`
Compiling pyo3-derive-backend v0.9.2
Running `rustc --crate-name pyo3_derive_backend --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/pyo3-derive-backend-0.9.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off -C metadata=87caec6d90f022dd -C extra-filename=-87caec6d90f022dd --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern proc_macro2=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libproc_macro2-76f8ada0def45bbb.rmeta --extern quote=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libquote-9122a2cc62b326a7.rmeta --extern syn=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libsyn-7a0bf51b296fe2fc.rmeta --cap-lints allow`
Running `rustc --crate-name onig_sys --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/onig_sys-69.8.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=56b9dfa283909d07 -C extra-filename=-56b9dfa283909d07 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow -L native=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/onig_sys-628d58b2e1c4148f/out -l static=onig`
Compiling rayon v1.8.0
Running `rustc --crate-name rayon --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/rayon-1.8.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=e377174dbcaaa885 -C extra-filename=-e377174dbcaaa885 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern either=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libeither-6285153e3b923a65.rmeta --extern rayon_core=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/librayon_core-2daacfb9b2f92ceb.rmeta --cap-lints allow`
Running `rustc --crate-name serde_json --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/serde_json-1.0.108/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C embed-bitcode=no -C debug-assertions=off --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=99eba96a6354a662 -C extra-filename=-99eba96a6354a662 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern itoa=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libitoa-e7a4404cafd749c4.rmeta --extern ryu=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libryu-e253777e7f6df676.rmeta --extern serde=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libserde-077e199dbd167540.rmeta --cap-lints allow --cfg limb_width_64`
Compiling itertools v0.8.2
Running `rustc --crate-name itertools /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/itertools-0.8.2/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="use_std"' -C metadata=fe8b3b8a0c081024 -C extra-filename=-fe8b3b8a0c081024 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern either=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libeither-6285153e3b923a65.rmeta --cap-lints allow`
Compiling textwrap v0.11.0
Running `rustc --crate-name textwrap /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/textwrap-0.11.0/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=067190a687d7743f -C extra-filename=-067190a687d7743f --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern unicode_width=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libunicode_width-a51b82a097b7ad5e.rmeta --cap-lints allow`
Compiling erased-serde v0.3.31
Running `rustc --crate-name erased_serde --edition=2021 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/erased-serde-0.3.31/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="default"' --cfg 'feature="std"' -C metadata=b576c04566c487ca -C extra-filename=-b576c04566c487ca --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern serde=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libserde-2a87357517b93c49.rmeta --cap-lints allow`
Compiling paste-impl v0.1.18
Running `rustc --crate-name paste_impl --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/paste-impl-0.1.18/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type proc-macro --emit=dep-info,link -C prefer-dynamic -C embed-bitcode=no -C debug-assertions=off -C metadata=2b7e5d8d7765597b -C extra-filename=-2b7e5d8d7765597b --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern proc_macro_hack=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libproc_macro_hack-9ea8952802b4cf88.so --extern proc_macro --cap-lints allow`
Compiling atty v0.2.14
Running `rustc --crate-name atty /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/atty-0.2.14/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=2959510665c6bed1 -C extra-filename=-2959510665c6bed1 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern libc=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/liblibc-0a085ba9422fa4aa.rmeta --cap-lints allow`
Running `/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/build/serde_json-c7567658002f4a10/build-script-build`
Compiling lock_api v0.3.4
Running `rustc --crate-name lock_api --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/lock_api-0.3.4/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="nightly"' -C metadata=127ef18477241ef2 -C extra-filename=-127ef18477241ef2 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern scopeguard=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libscopeguard-1d6dee74c8567c3a.rmeta --cap-lints allow`
error[E0557]: feature has been removed
--> /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/lock_api-0.3.4/src/lib.rs:91:42
|
91 | #![cfg_attr(feature = "nightly", feature(const_fn))]
| ^^^^^^^^ feature has been removed
|
= note: split into finer-grained feature gates
Compiling ansi_term v0.12.1
Running `rustc --crate-name ansi_term /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/ansi_term-0.12.1/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C metadata=6096edb26cdacb30 -C extra-filename=-6096edb26cdacb30 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --cap-lints allow`
For more information about this error, try `rustc --explain E0557`.
error: could not compile `lock_api` (lib) due to previous error
Caused by:
process didn't exit successfully: `rustc --crate-name lock_api --edition=2018 /home/jaruga/.cargo/registry/src/index.crates.io-6f17d22bba15001f/lock_api-0.3.4/src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="nightly"' -C metadata=127ef18477241ef2 -C extra-filename=-127ef18477241ef2 --out-dir /tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps -L dependency=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps --extern scopeguard=/tmp/pip-install-nz0lv_gw/tokenizers_1af7515df9604352aa5432e02bc8e6ef/target/release/deps/libscopeguard-1d6dee74c8567c3a.rmeta --cap-lints allow` (exit status: 1)
warning: build failed, waiting for other jobs to finish...
error: `cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml --release -v --features pyo3/extension-module --crate-type cdylib --` failed with code 101
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for tokenizers
Failed to build tokenizers
ERROR: Could not build wheels for tokenizers, which is required to install pyproject.toml-based projects
[notice] A new release of pip available: 22.3.1 -> 23.3.1
[notice] To update, run: pip install --upgrade pip
(venv3) $
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment