Error when building Swift on Exherbo (2022-05-17-a)

swift-build-exherbo-error-2022-05-17-a

$ utils/build-script --release-debuginfo --skip-early-swift-driver
[utils/build-script] NOTE: Using toolchain default
+ cmake --version
+ mkdir -p /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert
--- Building cmark ---
+ mkdir -p /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/cmark-linux-x86_64
+ /usr/host/bin/cmake --build /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/cmark-linux-x86_64 --config RelWithDebInfo -- all
[0/1][  0%][0.000s] Re-running CMake...
-- Configuring done
-- Generating done
-- Build files have been written to: /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/cmark-linux-x86_64
ninja: no work to do.
Building the standard library for: swift-test-stdlib-linux-x86_64
symlinking the system headers (/usr/include/c++) into the local clang build directory (/home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/llvm-linux-x86_64/include).
+ ln -s -f /usr/include/c++ /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/llvm-linux-x86_64/include
+ /usr/host/bin/cmake --build /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/llvm-linux-x86_64 -- -j56 all
[0/3][  0%][0.000s] Performing build step for 'compiler-rt'
[0/1][  0%][0.000s] Performing build step for 'libcxx_fuzzer_x86_64'
ninja: no work to do.
[1/3][ 33%][0.073s] No install step for 'compiler-rt'
[3/3][100%][0.098s] Completed 'compiler-rt'
+ /usr/host/bin/cmake --build /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/swift-linux-x86_64 -- -j56 all swift-test-stdlib-linux-x86_64
[1/942][  0%][0.010s] Generating ../share/swift/diagnostics/generated
FAILED: share/swift/diagnostics/generated /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/swift-linux-x86_64/share/swift/diagnostics/generated
cd /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/swift-linux-x86_64/localization && /usr/x86_64-pc-linux-gnu/bin/cmake -E copy_directory /home/bas/swift-project/swift/localization/diagnostics/ /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/swift-linux-x86_64/share/swift/diagnostics/ && /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/swift-linux-x86_64/./bin/swift-def-to-yaml-converter --output-directory /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/swift-linux-x86_64/share/swift/diagnostics/ && /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/swift-linux-x86_64/./bin/swift-serialize-diagnostics --input-file-path /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/swift-linux-x86_64/share/swift/diagnostics/en.yaml --output-directory /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/swift-linux-x86_64/share/swift/diagnostics/ && /usr/x86_64-pc-linux-gnu/bin/cmake -E touch /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/swift-linux-x86_64/share/swift/diagnostics/generated
/bin/sh: line 1: /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/swift-linux-x86_64/./bin/swift-def-to-yaml-converter: No such file or directory
[2/942][  0%][0.014s] Performing build step for 'libdispatch-linux-x86_64'
ninja: no work to do.
[7/942][  0%][0.419s] Linking CXX static library lib/swift/linux/x86_64/libswiftReflection.a
ninja: build stopped: subcommand failed.
ERROR: command terminated with a non-zero exit status 1, aborting



$ utils/update-checkout --dump-hashes
{
    "ssh-clone-pattern": "git@github.com:%s.git",
    "https-clone-pattern": "https://github.com/%s.git",
    "repos": {
        "swift": {
            "remote": {
                "id": "apple/swift"
            }
        },
        "cmark": {
            "remote": {
                "id": "apple/swift-cmark"
            }
        },
        "llbuild": {
            "remote": {
                "id": "apple/swift-llbuild"
            }
        },
        "swift-argument-parser": {
            "remote": {
                "id": "apple/swift-argument-parser"
            }
        },
        "swift-atomics": {
            "remote": {
                "id": "apple/swift-atomics"
            }
        },
        "swift-collections": {
            "remote": {
                "id": "apple/swift-collections"
            }
        },
        "swift-crypto": {
            "remote": {
                "id": "apple/swift-crypto"
            }
        },
        "swift-driver": {
            "remote": {
                "id": "apple/swift-driver"
            }
        },
        "swift-numerics": {
            "remote": {
                "id": "apple/swift-numerics"
            }
        },
        "swift-tools-support-core": {
            "remote": {
                "id": "apple/swift-tools-support-core"
            }
        },
        "swiftpm": {
            "remote": {
                "id": "apple/swift-package-manager"
            }
        },
        "swift-syntax": {
            "remote": {
                "id": "apple/swift-syntax"
            }
        },
        "swift-system": {
            "remote": {
                "id": "apple/swift-system"
            }
        },
        "swift-stress-tester": {
            "remote": {
                "id": "apple/swift-stress-tester"
            }
        },
        "swift-corelibs-xctest": {
            "remote": {
                "id": "apple/swift-corelibs-xctest"
            }
        },
        "swift-corelibs-foundation": {
            "remote": {
                "id": "apple/swift-corelibs-foundation"
            }
        },
        "swift-corelibs-libdispatch": {
            "remote": {
                "id": "apple/swift-corelibs-libdispatch"
            }
        },
        "swift-integration-tests": {
            "remote": {
                "id": "apple/swift-integration-tests"
            }
        },
        "swift-xcode-playground-support": {
            "remote": {
                "id": "apple/swift-xcode-playground-support"
            }
        },
        "ninja": {
            "remote": {
                "id": "ninja-build/ninja"
            }
        },
        "icu": {
            "remote": {
                "id": "unicode-org/icu"
            },
            "platforms": [
                "Linux"
            ]
        },
        "yams": {
            "remote": {
                "id": "jpsim/Yams"
            }
        },
        "cmake": {
            "remote": {
                "id": "KitWare/CMake"
            },
            "platforms": [
                "Linux"
            ]
        },
        "indexstore-db": {
            "remote": {
                "id": "apple/indexstore-db"
            }
        },
        "sourcekit-lsp": {
            "remote": {
                "id": "apple/sourcekit-lsp"
            }
        },
        "swift-format": {
            "remote": {
                "id": "apple/swift-format"
            }
        },
        "swift-installer-scripts": {
            "remote": {
                "id": "apple/swift-installer-scripts"
            }
        },
        "swift-docc": {
            "remote": {
                "id": "apple/swift-docc"
            }
        },
        "swift-lmdb": {
            "remote": {
                "id": "apple/swift-lmdb"
            }
        },
        "swift-docc-render-artifact": {
            "remote": {
                "id": "apple/swift-docc-render-artifact"
            }
        },
        "swift-docc-symbolkit": {
            "remote": {
                "id": "apple/swift-docc-symbolkit"
            }
        },
        "swift-markdown": {
            "remote": {
                "id": "apple/swift-markdown"
            }
        },
        "swift-cmark-gfm": {
            "remote": {
                "id": "apple/swift-cmark"
            }
        },
        "swift-nio": {
            "remote": {
                "id": "apple/swift-nio"
            }
        },
        "swift-nio-ssl": {
            "remote": {
                "id": "apple/swift-nio-ssl"
            }
        },
        "llvm-project": {
            "remote": {
                "id": "apple/llvm-project"
            }
        }
    },
    "branch-schemes": {
        "repro": {
            "aliases": [
                "repro"
            ],
            "repos": {
                "cmake": "0ecd9de6ddcaf951968d053ae491949d68d6175f",
                "cmark": "9c8096a23f44794bde297452d87c455fc4f76d42",
                "icu": "fd123bf023882f07bfacf51c39111be2f946d8f8",
                "indexstore-db": "47aa228fa4d47ab90e8a3b8d9468d2ca99434463",
                "llbuild": "acd686530e56122d916acd49a166beb9198e9b87",
                "llvm-project": "f765bf5b71fd3637a6f6d1d3e6ab95ca91892a0c",
                "ninja": "51edeeb063a82693573db43782d9e3733b2840e4",
                "sourcekit-lsp": "489da496c46e01746ea5158ea0b8ec6e4a8a1f97",
                "swift": "2a79777e46504ecc809e1141bad710458f25bf1c",
                "swift-argument-parser": "e394bf350e38cb100b6bc4172834770ede1b7232",
                "swift-atomics": "919eb1d83e02121cdb434c7bfc1f0c66ef17febe",
                "swift-cmark-gfm": "9c8096a23f44794bde297452d87c455fc4f76d42",
                "swift-collections": "2d33a0ea89c961dcb2b3da2157963d9c0370347e",
                "swift-corelibs-foundation": "e82400e0d7dd06bf3adfbd47ad95eb983910eb63",
                "swift-corelibs-libdispatch": "880bf655b65595862bed8fc5cbd922f60765e8b0",
                "swift-corelibs-xctest": "2f64db1fdcc600d26566fe67ffceca7d76226b8b",
                "swift-crypto": "0141f53dd525706c803b0c20aa8ad36f9ecd45e5",
                "swift-docc": "ed41ca7bdd3adb59702285e7ca94b60d6ba6f3c4",
                "swift-docc-render-artifact": "a6507a5a9b35c4f29178807dec35ba9437449089",
                "swift-docc-symbolkit": "aab31e5bfe39775e1b8555fe6d91255559bf5a5f",
                "swift-driver": "9982f32f96a2e0e597d1b4a0af4a7e997dc471be",
                "swift-format": "e6b8c60c7671066d229e30efa1e31acf57be412e",
                "swift-installer-scripts": "1bbce8e71627e3cae4b14ae51213e9c85a0739d0",
                "swift-integration-tests": "3670ed08b57bd1c1b6dffc677cd93ffcfd1ddd48",
                "swift-lmdb": "6ea45a7ebf6d8f72bd299dfcc3299e284bbb92ee",
                "swift-markdown": "16ebb0ccea68c0009f550bd48cca1df8675685dc",
                "swift-nio": "1d425b0851ffa2695d488cce1d68df2539f42500",
                "swift-nio-ssl": "2e74773972bd6254c41ceeda827f229bccbf1c0f",
                "swift-numerics": "0a23770641f65a4de61daf5425a37ae32a3fd00d",
                "swift-stress-tester": "d3662a456d7f1bd95ca56627cc38ebc54d149f53",
                "swift-syntax": "3ee10cc2225ac77a492f5dcb64edfbdb8b12a48a",
                "swift-system": "836bc4557b74fe6d2660218d56e3ce96aff76574",
                "swift-tools-support-core": "f6c8048a76e280d0f14cc378b8b5c3cfb77c61fb",
                "swift-xcode-playground-support": "dd0d8c8d121d2f20664e4779a3d29482a55908bb",
                "swiftpm": "376bed01fba16ea4cd9821793b0f153eb2d29f2f",
                "yams": "51ef46468fda5a0fa1a201b8843791d0149d3c01"
            }
        }
    }
}

The file is there, and executable

$ ls -l /home/bas/swift-project/build/Ninja-RelWithDebInfoAssert/swift-linux-x86_64/./bin/
total 21960
-rwxr-xr-x  1 root root     106 May 17 08:28 lldb-with-tools
-rwxr-xr-x  1 root root 5817600 May 17 08:28 swift-def-to-yaml-converter
-rwxr-xr-x  1 root root 5526224 May 17 08:28 swift-demangle
-rwxr-xr-x  1 root root 5662696 May 17 08:28 swift-demangle-yamldump
-rwxr-xr-x  1 root root 5456592 May 17 08:28 swift-serialize-diagnostics

Just as a note

$ rg swift-def-to-yaml-converter
tools/CMakeLists.txt
25:add_swift_tool_subdirectory(swift-def-to-yaml-converter)

tools/swift-def-to-yaml-converter/swift-def-to-yaml-converter.cpp
1://===--- swift-def-to-yaml-converter.cpp ----------------------------------===//
52:static llvm::cl::OptionCategory Category("swift-def-to-yaml-converter Options");

tools/swift-def-to-yaml-converter/CMakeLists.txt
1:add_swift_host_tool(swift-def-to-yaml-converter
2:  swift-def-to-yaml-converter.cpp
6:target_link_libraries(swift-def-to-yaml-converter PRIVATE

validation-test/BuildSystem/extractsymbols-darwin-symroot-path-filters.test
15:# RUN: %swiftc_driver %t/hello.swift -o %t/destdir/bin/swift-def-to-yaml-converter
62:# CHECK-DAG: strip {{.*}}swift-def-to-yaml-converter
79:# CHECK-SKIPPED-NOT: swift-def-to-yaml-converter
85:# CHECK-SKIPPED-NOT: dsymutil {{.*}}swift-def-to-yaml-converter
101:# CHECK-SKIPPED-NOT: codesign {{.*}}swift-def-to-yaml-converter

localization/CMakeLists.txt
9:    "${SWIFT_NATIVE_SWIFT_TOOLS_PATH}/swift-def-to-yaml-converter"
18:    swift-def-to-yaml-converter

Same issue with --debug, not more logs

$ utils/build-script --debug --skip-early-swift-driver
[237/1222][ 19%][18.635s] Generating ../share/swift/diagnostics/generated
FAILED: share/swift/diagnostics/generated /home/bas/swift-project/build/Ninja-DebugAssert/swift-linux-x86_64/share/swift/diagnostics/generated
cd /home/bas/swift-project/build/Ninja-DebugAssert/swift-linux-x86_64/localization && /usr/x86_64-pc-linux-gnu/bin/cmake -E copy_directory /home/bas/swift-project/swift/localization/diagnostics/ /home/bas/swift-project/build/Ninja-DebugAssert/swift-linux-x86_64/share/swift/diagnostics/ && /home/bas/swift-project/build/Ninja-DebugAssert/swift-linux-x86_64/./bin/swift-def-to-yaml-converter --output-directory /home/bas/swift-project/build/Ninja-DebugAssert/swift-linux-x86_64/share/swift/diagnostics/ && /home/bas/swift-project/build/Ninja-DebugAssert/swift-linux-x86_64/./bin/swift-serialize-diagnostics --input-file-path /home/bas/swift-project/build/Ninja-DebugAssert/swift-linux-x86_64/share/swift/diagnostics/en.yaml --output-directory /home/bas/swift-project/build/Ninja-DebugAssert/swift-linux-x86_64/share/swift/diagnostics/ && /usr/x86_64-pc-linux-gnu/bin/cmake -E touch /home/bas/swift-project/build/Ninja-DebugAssert/swift-linux-x86_64/share/swift/diagnostics/generated
/bin/sh: line 1: /home/bas/swift-project/build/Ninja-DebugAssert/swift-linux-x86_64/./bin/swift-def-to-yaml-converter: No such file or directory

Tried on:

• swift-5.6.1-RELEASE
  • --release-debuginfo --skip-early-swift-driver
  • --preset=buildbot_incremental
• main
• ea86221d41e1970c6237c92b550c461156a1ef39 (before apple/swift#37507)

Tried different combinations of tags (--debug, --release-debuginfo, --skip-early-swift-driver…)

Always the same error