This is a list of issues found while making the D ecosystem available on Linux distributions such as Debian and Fedora. It is a smaller, but priorized list of the general list of issues I find while working with D that can be viewed at dlang-quirks.md.
This list is ordered by priority, more pressing issues being at the top.
-
D has no stable ABI. This kind of enforces recompiling all D shared libraries and binaries in a Linux distribution with every new compiler version. This is possible, but a major pain which requires quite some amount of manpower (Debian does this for OCaml and Haskell) - getting people to use D if it is that much extra work is harder. It also means that you can not use the libraries which were compiled with LDC in an application that is compiled with GDC and vice versa. This is a real PITA for distros and users who might have binaries compiled with the "wrong" compiler. It reduces the usefulness of development D packages in distributions a lot, if you need to recompile everything again anyway. Static linking is also frowned upon by distributions, because it triggers rebuild cascades on every bugfix that we introduce, making devlivering security updates much harder and error-prone (embedded code copies are very difficult to handle). A stable D ABI, or at least a guarantee that the ABI will not change unless there is a good reason (and the ABI change will be announced in the release notes) would help a lot. Having a D ABI that is shared between DMD, LDC and GDC would be even better.
-
Dub doesn't use packages installed to system locations (dlang/dub#838) - this renders dub pretty much unusable for using it as part of the Linux distribution package tooling. Dub also writes into
$HOME
as part of the build process which is considered bad practice and is disallowed on build daemons at Debian (you need to add a hack for tools which expect$HOME
to be available) -
Dub: Can not version dependencies on other libraries (dlang/dub#906) - this makes it hard to determine compatibility if we package software written in D.
-
dub test
overrides the binary created bydub build
(prevents automatically running tests as part of the build process) (dlang/dub#840) -
No working Make/Ninja compatible depfile generation in LDC, DMD or GDC - this is especially important when not using dub (see the dub issues) and some other build system (Automake/CMake/Meson/..) is used instead. See ldc-developers/ldc#1802 for the LDC bug report.
-
There is no
dub install
command (dlang/dub#839) -
LDC doesn't support a lot of architectures / architecture support breaks from time to time. It would be quite nice to have D tools available on as many architectures as possible. (see ldc-developers/ldc#1636 for a bug report, build logs are here: https://buildd.debian.org/status/package.php?p=ldc)
The GDC issues have been separated out to not clutter the priorized overview.
-
GDC is not part of official GCC. This makes it difficult (or actually sometimes impossible) to ship it with some Linux distributions, e.g. RHEL and Fedora. On Debian, we inject GDC into the GCC build, which is also a bit weird. Having GDC in GCC proper would also give D much higher visibility.
-
GDC only supports an ancient version of the D standard library, which has many nice classes and also bugfixes missing. Because of that, it is almost impossible to compile modern D applications with GDC, and when developing a new application, support for GDC needs to be added explicitly and handled with a lot of care. This is an issue LDC doesn't have, and which is fragmenting the D ecosystem.
-
GDC does not support creating shared libraries at time, which is a big deal for distros which need it to reduce duplicate code and make security fixes easier.
- DMD is completely free software now, there is no obstacle to ship it in distributions anymore.
Right, sorry I should have mentioned that my attempt to reach out was to offer any help with packaging that I could provide from my side (package-wise or D-wise), but I guess it makes sense that these are not really monitored.
I think
--skip-registry=all --cache=system
will do this.I found two things that I should point out:
However, it does have an
add-local
command. I'm not sure if it is suitable or not, though.A pertinent question here would be how other languages do it. E.g., for Pypi packages, does Debian get the package from pypi.org, or from the upstream (git repository etc.)? If it is acceptable to use
dub fetch
to obtain packages' source code and populate the--cache=system
cache then that may make things simpler.I think that's how Dub already works, it creates a
./.dub
directory for temporary files and puts the final binary in the current directory.That sounds like something that may make sense to push to upstream CI systems. If we can catch changes that break Debian packaging before they are merged or at least released, I think that would make everyone happier.
I don't know if this is helpful at all, but I played a bit with a
docker.io/debian:latest
container to see how far I can get. I got my program to build with two methods, both of which I think satisfy some of the above constraints. First method is to clone the dependencies and add them withdub add-local
:Dockerfile
build.sh
Second method is to use
dub fetch
with--cache=system
:build.sh
(second half only)BTW, are you in contact with the D foundation? I think they are interested in allocating resources for D packaging.