Skip to content

Instantly share code, notes, and snippets.

@fliiiix
Created August 23, 2017 16:01
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save fliiiix/ffa6a8d18ff86fb554b3fc562346aeb3 to your computer and use it in GitHub Desktop.
Save fliiiix/ffa6a8d18ff86fb554b3fc562346aeb3 to your computer and use it in GitHub Desktop.
iocage broken?

The iocage list command displays all jails as not running and truncates the names. Also I can not use any name for commands like console, start and many more only the uuid works.

$ iocage --version
0.9.9.1 08/01/2017
[root@titan:/home/l33tname]$ iocage list          
+-----+----------+-------+--------------+---------------+
| JID |   NAME   | STATE |   RELEASE    |      IP4      |                                                                                     
+=====+==========+=======+==============+===============+                                                                                     
| -   | aegir.l3 | down  | 11.0-RELEASE | 192.168.17.14 |                                                                                     
+-----+----------+-------+--------------+---------------+                                                                                     
| -   | helene.l | down  | 11.0-RELEASE | 192.168.17.17 |                                                                                     
+-----+----------+-------+--------------+---------------+                                                                                     
| -   | hyperion | down  | 11.0-RELEASE | 192.168.17.15 |                                                                                     
+-----+----------+-------+--------------+---------------+                                                                                     
| -   | narvi.l3 | down  | 11.0-RELEASE | 192.168.17.13 |                                                                                     
+-----+----------+-------+--------------+---------------+                                                                                     
| -   | pan.l33t | down  | 11.0-RELEASE | 192.168.17.11 |                                                                                     
+-----+----------+-------+--------------+---------------+                                                                                     
| -   | skoll.l3 | down  | 11.0-RELEASE | 192.168.17.16 |                                                                                     
+-----+----------+-------+--------------+---------------+                                                                                     
| -   | ymir.l33 | down  | 11.0-RELEASE | 192.168.17.12 |                                                                                     
+-----+----------+-------+--------------+---------------+   

[root@titan:/home/l33tname]$ iocage start aegir.l3
aegir.l3 not found!
[root@titan:/home/l33tname]$ iocage start aegir.l33t.network
aegir.l33t.network not found!
[root@titan:/home/l33tname]$ jls
   JID  IP Address      Hostname                      Path
   121  192.168.17.13   narvi.l33t.network            /ssdboot/iocage/jails/38e6688a-90a8-4575-8431-5d517827c5ea/root
   and more

Update fails also:

sudo iocage upgrade -r 11.1-RELEASE bd30b340-0854-45f0-9bf1-510e4986f5a6
Please rebuild all installed 3rd party software (e.g., programs
installed from the ports tree) and then run "/tmp/tmp0juovxyx install"
again to finish installing updates.
Installing updates... done.
No updates are available to install.
Run '/tmp/tmp0juovxyx fetch' first.
Traceback (most recent call last):
  File "/usr/local/bin/iocage", line 10, in <module>
    sys.exit(cli())
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 722, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 697, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 895, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 535, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/iocage/cli/upgrade.py", line 91, in cli
    root_path).upgrade_jail()
  File "/usr/local/lib/python3.6/site-packages/iocage/lib/ioc_upgrade.py", line 97, in upgrade_jail
    with open(self._freebsd_version, "r") as r:
FileNotFoundError: [Errno 2] No such file or directory: '/ssdboot/iocage/releases/11.1-RELEASE/root/bin/freebsd-version'
@skarekrow
Copy link

Hey man, I need steps from you. Last things you did, etc.

But first thing's first, is the iocage dataset actually mounted? My guess is it's not. Try rebooting your host and see how you pan out real quick. That will help us remove a lot of possibilities.

@fliiiix
Copy link
Author

fliiiix commented Aug 23, 2017

The last thing I did was update Freebsd from 11.0-RELEASE-pXY to 11.1-RELEASE-p1.

I think the datasets are mounted

$ ls -la /ssdboot/iocage/jails    
total 7
drwxr-xr-x  9 root  wheel  9 15 Apr 16:58 .
drwxr-xr-x  9 root  wheel  9  7 Feb  2017 ..
drwxr-xr-x  3 root  wheel  5 23 Aug 18:27 38e6688a-90a8-4575-8431-5d517827c5ea

And I see them also listen in the zfs list output as mounted.

I also tried to re-install py36-iocage

@fliiiix
Copy link
Author

fliiiix commented Aug 23, 2017

Also if I interact with sudo service iocage start/stop/restart it works fine.

@skarekrow
Copy link

Well restart the host first like I said, and see how things work. This is likely related to the name migration that happened.

@fliiiix
Copy link
Author

fliiiix commented Aug 24, 2017

@skarekrow shit I forgot to mention that I rebooted the system as well without change

@skarekrow
Copy link

Ok, let's try a few debugging things.

Can you supply me with:
mount
zfs list -r ssdboot/iocage
jls (not truncated please)
iocage list -l

@fliiiix
Copy link
Author

fliiiix commented Aug 24, 2017

Mount

$ mount
ssdboot/ROOT/default on / (zfs, local, nfsv4acls)
devfs on /dev (devfs, local, multilabel)
ssdboot/home on /home (zfs, local, nfsv4acls)
ssdboot/iocage on /ssdboot/iocage (zfs, local, nfsv4acls)
ssdboot/iocage/download on /ssdboot/iocage/download (zfs, local, nfsv4acls)
ssdboot/iocage/download/11.0-RELEASE on /ssdboot/iocage/download/11.0-RELEASE (zfs, local, nfsv4acls)
ssdboot/iocage/images on /ssdboot/iocage/images (zfs, local, nfsv4acls)
ssdboot/iocage/jails on /ssdboot/iocage/jails (zfs, local, nfsv4acls)
ssdboot/iocage/jails/38e6688a-90a8-4575-8431-5d517827c5ea on /ssdboot/iocage/jails/38e6688a-90a8-4575-8431-5d517827c5ea (zfs, local, nfsv4acls)
ssdboot/iocage/jails/38e6688a-90a8-4575-8431-5d517827c5ea/root on /ssdboot/iocage/jails/38e6688a-90a8-4575-8431-5d517827c5ea/root (zfs, local, nfsv4acls)
ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357 on /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357 (zfs, local, nfsv4acls)
ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root on /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root (zfs, local, nfsv4acls)
ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176 on /ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176 (zfs, local, nfsv4acls)
ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176/root on /ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176/root (zfs, local, nfsv4acls)
ssdboot/iocage/jails/75a46752-0e54-4967-9e08-ac30956942aa on /ssdboot/iocage/jails/75a46752-0e54-4967-9e08-ac30956942aa (zfs, local, nfsv4acls)
ssdboot/iocage/jails/75a46752-0e54-4967-9e08-ac30956942aa/root on /ssdboot/iocage/jails/75a46752-0e54-4967-9e08-ac30956942aa/root (zfs, local, nfsv4acls)
ssdboot/iocage/jails/82a8a117-880f-4336-9821-2cd9d3daf004 on /ssdboot/iocage/jails/82a8a117-880f-4336-9821-2cd9d3daf004 (zfs, local, nfsv4acls)
ssdboot/iocage/jails/82a8a117-880f-4336-9821-2cd9d3daf004/root on /ssdboot/iocage/jails/82a8a117-880f-4336-9821-2cd9d3daf004/root (zfs, local, nfsv4acls)
ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c on /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c (zfs, local, nfsv4acls)
ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root on /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root (zfs, local, nfsv4acls)
ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6 on /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6 (zfs, local, nfsv4acls)
ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root on /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root (zfs, local, nfsv4acls)
ssdboot/iocage/log on /ssdboot/iocage/log (zfs, local, nfsv4acls)
ssdboot/iocage/releases on /ssdboot/iocage/releases (zfs, local, nfsv4acls)
ssdboot/iocage/releases/11.0-RELEASE on /ssdboot/iocage/releases/11.0-RELEASE (zfs, local, nfsv4acls)
ssdboot/iocage/releases/11.0-RELEASE/root on /ssdboot/iocage/releases/11.0-RELEASE/root (zfs, local, nfsv4acls)
ssdboot/iocage/templates on /ssdboot/iocage/templates (zfs, local, nfsv4acls)
ssdboot/tmp on /tmp (zfs, local, nfsv4acls)
ssdboot/usr on /usr (zfs, local, nfsv4acls)
ssdboot/var on /var (zfs, local, nfsv4acls)
usbboot/boot on /uboot (zfs, local, nfsv4acls)
tank on /tank (zfs, local, noatime, noexec, nfsv4acls)
tank/audiobook on /tank/audiobook (zfs, local, noatime, noexec, nfsv4acls)
tank/backup on /tank/backup (zfs, local, noatime, noexec, nfsv4acls)
tank/data on /tank/data (zfs, local, noatime, noexec, nfsv4acls)
tank/image on /tank/image (zfs, local, noatime, noexec, nfsv4acls)
tank/movie on /tank/movie (zfs, local, noatime, noexec, nfsv4acls)
tank/music on /tank/music (zfs, local, noatime, noexec, nfsv4acls)
tank/podcast on /tank/podcast (zfs, local, noatime, noexec, nfsv4acls)
tank/series on /tank/series (zfs, local, noatime, noexec, nfsv4acls)
tank/tvshows on /tank/tvshows (zfs, local, noatime, noexec, nfsv4acls)
fdescfs on /dev/fd (fdescfs)
devfs on /ssdboot/iocage/jails/38e6688a-90a8-4575-8431-5d517827c5ea/root/dev (devfs, local, multilabel)
fdescfs on /ssdboot/iocage/jails/38e6688a-90a8-4575-8431-5d517827c5ea/root/dev/fd (fdescfs)
devfs on /ssdboot/iocage/jails/75a46752-0e54-4967-9e08-ac30956942aa/root/dev (devfs, local, multilabel)
fdescfs on /ssdboot/iocage/jails/75a46752-0e54-4967-9e08-ac30956942aa/root/dev/fd (fdescfs)
/tank/movie on /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root/media/movies (nullfs, local)
/tank/music on /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root/media/music (nullfs, local)
/tank/series on /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root/media/series (nullfs, local)
/tank/tvshows on /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root/media/tvshows (nullfs, local)
/tank/podcast on /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root/media/podcasts (nullfs, local)
/tank/data on /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root/media/data (nullfs, local)
/tank/audiobook on /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root/media/audiobook (nullfs, local)
devfs on /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root/dev (devfs, local, multilabel)
fdescfs on /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root/dev/fd (fdescfs)
devfs on /ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176/root/dev (devfs, local, multilabel)
fdescfs on /ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176/root/dev/fd (fdescfs)
/tank/movie on /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root/media/movies (nullfs, local)
/tank/music on /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root/media/music (nullfs, local)
/tank/series on /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root/media/series (nullfs, local)
/tank/tvshows on /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root/media/tvshows (nullfs, local)
/tank/podcast on /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root/media/podcasts (nullfs, local)
/tank/backup on /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root/media/mambackup (nullfs, local)
devfs on /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root/dev (devfs, local, multilabel)
fdescfs on /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root/dev/fd (fdescfs)
devfs on /ssdboot/iocage/jails/82a8a117-880f-4336-9821-2cd9d3daf004/root/dev (devfs, local, multilabel)
fdescfs on /ssdboot/iocage/jails/82a8a117-880f-4336-9821-2cd9d3daf004/root/dev/fd (fdescfs)
/tank/movie on /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root/media/movies (nullfs, local)
/tank/music on /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root/media/music (nullfs, local)
/tank/series on /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root/media/series (nullfs, local)
/tank/tvshows on /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root/media/tvshows (nullfs, local)
/tank/podcast on /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root/media/podcasts (nullfs, local)
/tank/data/Photo/Handy-Sync-plex on /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root/media/Handy-Sync-plex (nullfs, local)
devfs on /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root/dev (devfs, local, multilabel)
fdescfs on /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root/dev/fd (fdescfs)

ZFS list

$  zfs list -r ssdboot/iocage
NAME                                                             USED  AVAIL  REFER  MOUNTPOINT
ssdboot/iocage                                                  43.5G  44.9G    23K  /ssdboot/iocage
ssdboot/iocage/download                                          111M  44.9G    19K  /ssdboot/iocage/download
ssdboot/iocage/download/11.0-RELEASE                             111M  44.9G   111M  /ssdboot/iocage/download/11.0-RELEASE
ssdboot/iocage/images                                             19K  44.9G    19K  /ssdboot/iocage/images
ssdboot/iocage/jails                                            43.1G  44.9G    21K  /ssdboot/iocage/jails
ssdboot/iocage/jails/38e6688a-90a8-4575-8431-5d517827c5ea       3.25G  44.9G    22K  /ssdboot/iocage/jails/38e6688a-90a8-4575-8431-5d517827c5ea
ssdboot/iocage/jails/38e6688a-90a8-4575-8431-5d517827c5ea/root  3.25G  44.9G  3.33G  /ssdboot/iocage/jails/38e6688a-90a8-4575-8431-5d517827c5ea/root
ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357       21.3G  44.9G  22.5K  /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357
ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root  21.3G  44.9G  21.4G  /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root
ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176       12.3G  44.9G    22K  /ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176
ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176/root  12.3G  44.9G  12.5G  /ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176/root
ssdboot/iocage/jails/75a46752-0e54-4967-9e08-ac30956942aa        980M  44.9G    22K  /ssdboot/iocage/jails/75a46752-0e54-4967-9e08-ac30956942aa
ssdboot/iocage/jails/75a46752-0e54-4967-9e08-ac30956942aa/root   980M  44.9G  1.03G  /ssdboot/iocage/jails/75a46752-0e54-4967-9e08-ac30956942aa/root
ssdboot/iocage/jails/82a8a117-880f-4336-9821-2cd9d3daf004       1.43G  44.9G    22K  /ssdboot/iocage/jails/82a8a117-880f-4336-9821-2cd9d3daf004
ssdboot/iocage/jails/82a8a117-880f-4336-9821-2cd9d3daf004/root  1.43G  44.9G  1.51G  /ssdboot/iocage/jails/82a8a117-880f-4336-9821-2cd9d3daf004/root
ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c       3.04G  44.9G  23.5K  /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c
ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root  3.04G  44.9G  3.11G  /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root
ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6        823M  44.9G  23.5K  /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6
ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root   823M  44.9G   900M  /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root
ssdboot/iocage/log                                                34K  44.9G    34K  /ssdboot/iocage/log
ssdboot/iocage/releases                                          290M  44.9G    19K  /ssdboot/iocage/releases
ssdboot/iocage/releases/11.0-RELEASE                             290M  44.9G    19K  /ssdboot/iocage/releases/11.0-RELEASE
ssdboot/iocage/releases/11.0-RELEASE/root                        290M  44.9G   284M  /ssdboot/iocage/releases/11.0-RELEASE/root
ssdboot/iocage/templates                                          19K  44.9G    19K  /ssdboot/iocage/templates

JLS

$ jls
   JID  IP Address      Hostname                      Path
     8  192.168.17.13   narvi.l33t.network            /ssdboot/iocage/jails/38e6688a-90a8-4575-8431-5d517827c5ea/root
     9  192.168.17.14   aegir.l33t.network            /ssdboot/iocage/jails/75a46752-0e54-4967-9e08-ac30956942aa/root
    10  192.168.17.11   pan.l33t.network              /ssdboot/iocage/jails/bd30b340-0854-45f0-9bf1-510e4986f5a6/root
    11  192.168.17.15   hyperion.l33t.network         /ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176/root
    12  192.168.17.16   skoll.l33t.network            /ssdboot/iocage/jails/ba0fe752-adfb-49cf-ba19-044e5091bd8c/root
    13  192.168.17.17   helene.l33t.network           /ssdboot/iocage/jails/82a8a117-880f-4336-9821-2cd9d3daf004/root
    14  192.168.17.12   ymir.l33t.network             /ssdboot/iocage/jails/41850504-923f-4b29-a482-d81aae978357/root

iocage list

$  iocage list -l
+-----+-----------------------+------+-------+------+-----------------+----------------------+-----+----------+
| JID |         NAME          | BOOT | STATE | TYPE |     RELEASE     |         IP4          | IP6 | TEMPLATE |                               
+=====+=======================+======+=======+======+=================+======================+=====+==========+                               
| -   | aegir.l33t.network    | on   | down  | jail | 11.0-RELEASE-p7 | em0|192.168.17.14/24 | -   | -        |                               
+-----+-----------------------+------+-------+------+-----------------+----------------------+-----+----------+                               
| -   | helene.l33t.network   | on   | down  | jail | 11.0-RELEASE-p7 | em0|192.168.17.17/24 | -   | -        |                               
+-----+-----------------------+------+-------+------+-----------------+----------------------+-----+----------+                               
| -   | hyperion.l33t.network | on   | down  | jail | 11.0-RELEASE-p7 | em0|192.168.17.15/24 | -   | -        |                               
+-----+-----------------------+------+-------+------+-----------------+----------------------+-----+----------+                               
| -   | narvi.l33t.network    | on   | down  | jail | 11.0-RELEASE-p7 | em0|192.168.17.13/24 | -   | -        |                               
+-----+-----------------------+------+-------+------+-----------------+----------------------+-----+----------+                               
| -   | pan.l33t.network      | on   | down  | jail | 11.0-RELEASE-p7 | em0|192.168.17.11/24 | -   | -        |                               
+-----+-----------------------+------+-------+------+-----------------+----------------------+-----+----------+                               
| -   | skoll.l33t.network    | on   | down  | jail | 11.0-RELEASE-p7 | em0|192.168.17.16/24 | -   | -        |                               
+-----+-----------------------+------+-------+------+-----------------+----------------------+-----+----------+                               
| -   | ymir.l33t.network     | on   | down  | jail | 11.0-RELEASE-p7 | em0|192.168.17.12/24 | -   | -        |                               
+-----+-----------------------+------+-------+------+-----------------+----------------------+-----+----------+   

still the same problem

$ iocage console hyperion.l33t.network
hyperion.l33t.network not found!

@skarekrow
Copy link

Ok, the upgrade failure you hit is a known regression, and was fixed a couple days ago. So let's not worry about that, but I'm getting the sense that the migration did not go well for you.

It sounds a lot like iocage/iocage#307 to me. Can you paste hyperion's /ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176/config.json please?

You may have hit an odd issue, I have two ideas. Once you reply back, I'll tell you how we should proceed.

@fliiiix
Copy link
Author

fliiiix commented Aug 25, 2017

$ cat /ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176/config.json 
{
    "CONFIG_VERSION": "8",
    "allow_chflags": "0",
    "allow_mount": "0",
    "allow_mount_devfs": "0",
    "allow_mount_nullfs": "0",
    "allow_mount_procfs": "0",
    "allow_mount_tmpfs": "0",
    "allow_mount_zfs": "0",
    "allow_quotas": "0",
    "allow_raw_sockets": "0",
    "allow_set_hostname": "1",
    "allow_socket_af": "0",
    "allow_sysvipc": "0",
    "available": "readonly",
    "basejail": "no",
    "boot": "on",
    "bpf": "off",
    "children_max": "0",
    "cloned_release": "11.0-RELEASE",
    "comment": "none",
    "compression": "lz4",
    "compressratio": "readonly",
    "coredumpsize": "off",
    "count": "1",
    "cpuset": "off",
    "cputime": "off",
    "datasize": "off",
    "dedup": "off",
    "defaultrouter": "none",
    "defaultrouter6": "none",
    "depends": "none",
    "devfs_ruleset": "4",
    "dhcp": "off",
    "enforce_statfs": "2",
    "exec_clean": "1",
    "exec_fib": "0",
    "exec_jail_user": "root",
    "exec_poststart": "/usr/bin/true",
    "exec_poststop": "/usr/bin/true",
    "exec_prestart": "/usr/bin/true",
    "exec_prestop": "/usr/bin/true",
    "exec_start": "/bin/sh /etc/rc",
    "exec_stop": "/bin/sh /etc/rc.shutdown",
    "exec_system_jail_user": "0",
    "exec_system_user": "root",
    "exec_timeout": "60",
    "gitlocation": "https://github.com",
    "hack88": "0",
    "host_domainname": "none",
    "host_hostname": "hyperion.l33t.network",
    "host_hostuuid": "hyperion.l33t.network",
    "host_time": "yes",
    "hostid": "4c4c4544-0039-4b10-8058-b3c04f5a5a31",
    "interfaces": "vnet0:bridge0,vnet1:bridge1",
    "ip4": "new",
    "ip4_addr": "em0|192.168.17.15/24",
    "ip4_autoend": "none",
    "ip4_autostart": "none",
    "ip4_autosubnet": "none",
    "ip4_saddrsel": "1",
    "ip6": "new",
    "ip6_addr": "none",
    "ip6_saddrsel": "1",
    "ipv6": "off",
    "istemplate": "no",
    "jail_zfs": "off",
    "jail_zfs_dataset": "iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176/data",
    "jail_zfs_mountpoint": "none",
    "last_started": "2017-08-23 17:36:42",
    "login_flags": "-f root",
    "mac_prefix": "02ff60",
    "maxproc": "off",
    "memorylocked": "off",
    "memoryuse": "8G:log",
    "mount_devfs": "1",
    "mount_fdescfs": "1",
    "mount_linprocfs": "0",
    "mount_procfs": "0",
    "mountpoint": "readonly",
    "msgqqueued": "off",
    "msgqsize": "off",
    "nmsgq": "off",
    "notes": "none",
    "nsemop": "off",
    "nshm": "off",
    "nthr": "off",
    "openfiles": "off",
    "origin": "readonly",
    "owner": "root",
    "pcpu": "off",
    "priority": "99",
    "pseudoterminals": "off",
    "quota": "none",
    "release": "11.0-RELEASE-p7",
    "reservation": "none",
    "resolver": "/etc/resolv.conf",
    "rlimits": "off",
    "securelevel": "2",
    "shmsize": "off",
    "stacksize": "off",
    "stop_timeout": "30",
    "swapuse": "off",
    "sync_state": "none",
    "sync_target": "none",
    "sync_tgt_zpool": "none",
    "sysvmsg": "new",
    "sysvsem": "new",
    "sysvshm": "new",
    "tag": "hyperion.l33t.network",
    "template": "none",
    "type": "jail",
    "used": "readonly",
    "vmemoryuse": "off",
    "vnet": "off",
    "vnet0_mac": "none",
    "vnet1_mac": "none",
    "vnet2_mac": "none",
    "vnet3_mac": "none",
    "wallclock": "off"
}%

@skarekrow
Copy link

skarekrow commented Aug 25, 2017

Alright, so that's what I was hoping to see. The migration should be relatively painless for you.

  • Stop all your jails by iocage stop ALL, if that doesn't work do it manually via UUID, not the tag.
  • You then have to go through and zfs rename SOURCE DEST for each jail from the UUID to their TAG. Example ("zfs rename ssdboot/iocage/jails/4cad07c3-a076-4bfc-904f-58ee416be176 ssdboot/iocage/jails/hyperion.l33t.network")

Then you should be good to go!

@fliiiix
Copy link
Author

fliiiix commented Aug 26, 2017

I renamed all the datasets

$ zfs list -r ssdboot/iocage/jails 
NAME                                              USED  AVAIL  REFER  MOUNTPOINT
ssdboot/iocage/jails                             43.1G  44.9G    21K  /ssdboot/iocage/jails
ssdboot/iocage/jails/aegir.l33t.network           980M  44.9G    22K  /ssdboot/iocage/jails/aegir.l33t.network
ssdboot/iocage/jails/aegir.l33t.network/root      980M  44.9G  1.03G  /ssdboot/iocage/jails/aegir.l33t.network/root
ssdboot/iocage/jails/helene.l33t.network         1.42G  44.9G    22K  /ssdboot/iocage/jails/helene.l33t.network
ssdboot/iocage/jails/helene.l33t.network/root    1.42G  44.9G  1.49G  /ssdboot/iocage/jails/helene.l33t.network/root
ssdboot/iocage/jails/hyperion.l33t.network       12.3G  44.9G    22K  /ssdboot/iocage/jails/hyperion.l33t.network
ssdboot/iocage/jails/hyperion.l33t.network/root  12.3G  44.9G  12.5G  /ssdboot/iocage/jails/hyperion.l33t.network/root
ssdboot/iocage/jails/narvi.l33t.network          3.26G  44.9G    22K  /ssdboot/iocage/jails/narvi.l33t.network
ssdboot/iocage/jails/narvi.l33t.network/root     3.26G  44.9G  3.33G  /ssdboot/iocage/jails/narvi.l33t.network/root
ssdboot/iocage/jails/pan.l33t.network             823M  44.9G  22.5K  /ssdboot/iocage/jails/pan.l33t.network
ssdboot/iocage/jails/pan.l33t.network/root        823M  44.9G   900M  /ssdboot/iocage/jails/pan.l33t.network/root
ssdboot/iocage/jails/skoll.l33t.network          3.04G  44.9G  22.5K  /ssdboot/iocage/jails/skoll.l33t.network
ssdboot/iocage/jails/skoll.l33t.network/root     3.04G  44.9G  3.11G  /ssdboot/iocage/jails/skoll.l33t.network/root
ssdboot/iocage/jails/ymir.l33t.network           21.3G  44.9G  22.5K  /ssdboot/iocage/jails/ymir.l33t.network
ssdboot/iocage/jails/ymir.l33t.network/root      21.3G  44.9G  21.4G  /ssdboot/iocage/jails/ymir.l33t.network/root

Updated all fstab entry's and jail_zfs_dataset.

and now I have a new problem no jails is starting 😒

$ iocage start hyperion.l33t.network 
* Starting hyperion.l33t.network
  + Start FAILED
jail: jail "ioc-hyperion.l33t" not found

full config:

$ cat /ssdboot/iocage/jails/hyperion.l33t.network/config.json 
{
    "CONFIG_VERSION": "8",
    "allow_chflags": "0",
    "allow_mount": "0",
    "allow_mount_devfs": "0",
    "allow_mount_nullfs": "0",
    "allow_mount_procfs": "0",
    "allow_mount_tmpfs": "0",
    "allow_mount_zfs": "0",
    "allow_quotas": "0",
    "allow_raw_sockets": "0",
    "allow_set_hostname": "1",
    "allow_socket_af": "0",
    "allow_sysvipc": "0",
    "available": "readonly",
    "basejail": "no",
    "boot": "on",
    "bpf": "off",
    "children_max": "0",
    "cloned_release": "11.0-RELEASE",
    "comment": "none",
    "compression": "lz4",
    "compressratio": "readonly",
    "coredumpsize": "off",
    "count": "1",
    "cpuset": "off",
    "cputime": "off",
    "datasize": "off",
    "dedup": "off",
    "defaultrouter": "none",
    "defaultrouter6": "none",
    "depends": "none",
    "devfs_ruleset": "4",
    "dhcp": "off",
    "enforce_statfs": "2",
    "exec_clean": "1",
    "exec_fib": "0",
    "exec_jail_user": "root",
    "exec_poststart": "/usr/bin/true",
    "exec_poststop": "/usr/bin/true",
    "exec_prestart": "/usr/bin/true",
    "exec_prestop": "/usr/bin/true",
    "exec_start": "/bin/sh /etc/rc",
    "exec_stop": "/bin/sh /etc/rc.shutdown",
    "exec_system_jail_user": "0",
    "exec_system_user": "root",
    "exec_timeout": "60",
    "gitlocation": "https://github.com",
    "hack88": "0",
    "host_domainname": "none",
    "host_hostname": "hyperion.l33t.network",
    "host_hostuuid": "hyperion.l33t.network",
    "host_time": "yes",
    "hostid": "4c4c4544-0039-4b10-8058-b3c04f5a5a31",
    "interfaces": "vnet0:bridge0,vnet1:bridge1",
    "ip4": "new",
    "ip4_addr": "em0|192.168.17.15/24",
    "ip4_autoend": "none",
    "ip4_autostart": "none",
    "ip4_autosubnet": "none",
    "ip4_saddrsel": "1",
    "ip6": "new",
    "ip6_addr": "none",
    "ip6_saddrsel": "1",
    "ipv6": "off",
    "istemplate": "no",
    "jail_zfs": "off",
    "jail_zfs_dataset": "iocage/jails/hyperion.l33t.network/data",
    "jail_zfs_mountpoint": "none",
    "last_started": "2017-08-23 17:36:42",
    "login_flags": "-f root",
    "mac_prefix": "02ff60",
    "maxproc": "off",
    "memorylocked": "off",
    "memoryuse": "8G:log",
    "mount_devfs": "1",
    "mount_fdescfs": "1",
    "mount_linprocfs": "0",
    "mount_procfs": "0",
    "mountpoint": "readonly",
    "msgqqueued": "off",
    "msgqsize": "off",
    "nmsgq": "off",
    "notes": "none",
    "nsemop": "off",
    "nshm": "off",
    "nthr": "off",
    "openfiles": "off",
    "origin": "readonly",
    "owner": "root",
    "pcpu": "off",
    "priority": "99",
    "pseudoterminals": "off",
    "quota": "none",
    "release": "11.0-RELEASE-p7",
    "reservation": "none",
    "resolver": "/etc/resolv.conf",
    "rlimits": "off",
    "securelevel": "2",
    "shmsize": "off",
    "stacksize": "off",
    "stop_timeout": "30",
    "swapuse": "off",
    "sync_state": "none",
    "sync_target": "none",
    "sync_tgt_zpool": "none",
    "sysvmsg": "new",
    "sysvsem": "new",
    "sysvshm": "new",
    "tag": "hyperion.l33t.network",
    "template": "none",
    "type": "jail",
    "used": "readonly",
    "vmemoryuse": "off",
    "vnet": "off",
    "vnet0_mac": "none",
    "vnet1_mac": "none",
    "vnet2_mac": "none",
    "vnet3_mac": "none",
    "wallclock": "off"
}

@fliiiix
Copy link
Author

fliiiix commented Aug 26, 2017

It has something to do with the name because this works:

jail -c 'ip4.addr=em0|192.168.17.15/24' 'ip4.saddrsel=1' 'ip4=new' 'ip6.addr=' 'ip6.saddrsel=1' 'ip6=new' 'name=ioc-hyperion' 'host.domainname=none' 'host.hostname=hyperion.l33t.network' 'path=/ssdboot/iocage/jails/hyperion.l33t.network/root' 'securelevel=2' 'host.hostuuid=hyperion.l33t.network' 'devfs_ruleset=4' 'enforce_statfs=2' 'children.max=0' 'allow.set_hostname=1' 'allow.sysvipc=0' 'sysvmsg=new' 'sysvsem=new' 'sysvshm=new' 'allow.raw_sockets=0' 'allow.chflags=0' 'allow.mount=0' 'allow.mount.devfs=0' 'allow.mount.nullfs=0' 'allow.mount.procfs=0' 'allow.mount.tmpfs=0' 'allow.mount.zfs=0' 'allow.quotas=0' 'allow.socket_af=0' 'exec.prestart=/usr/bin/true' 'exec.poststart=/usr/bin/true' 'exec.prestop=/usr/bin/true' 'exec.stop=/bin/sh /etc/rc.shutdown' 'exec.clean=1' 'exec.timeout=60' 'stop.timeout=30' 'mount.fstab=/ssdboot/iocage/jails/hyperion.l33t.network/fstab' 'mount.devfs=1' 'mount.fdescfs=1' 'allow.dying' 'exec.consolelog=/ssdboot/iocage/log/ioc-hyperion.l33t.network-console.log' 'persist'

and this does not

ail -c 'ip4.addr=em0|192.168.17.15/24' 'ip4.saddrsel=1' 'ip4=new' 'ip6.addr=' 'ip6.saddrsel=1' 'ip6=new' 'name=ioc-hyperion.l33t.network' 'host.domainname=none' 'host.hostname=hyperion.l33t.network' 'path=/ssdboot/iocage/jails/hyperion.l33t.network/root' 'securelevel=2' 'host.hostuuid=hyperion.l33t.network' 'devfs_ruleset=4' 'enforce_statfs=2' 'children.max=0' 'allow.set_hostname=1' 'allow.sysvipc=0' 'sysvmsg=new' 'sysvsem=new' 'sysvshm=new' 'allow.raw_sockets=0' 'allow.chflags=0' 'allow.mount=0' 'allow.mount.devfs=0' 'allow.mount.nullfs=0' 'allow.mount.procfs=0' 'allow.mount.tmpfs=0' 'allow.mount.zfs=0' 'allow.quotas=0' 'allow.socket_af=0' 'exec.prestart=/usr/bin/true' 'exec.poststart=/usr/bin/true' 'exec.prestop=/usr/bin/true' 'exec.stop=/bin/sh /etc/rc.shutdown' 'exec.clean=1' 'exec.timeout=60' 'stop.timeout=30' 'mount.fstab=/ssdboot/iocage/jails/hyperion.l33t.network/fstab' 'mount.devfs=1' 'mount.fdescfs=1' 'allow.dying' 'exec.consolelog=/ssdboot/iocage/log/ioc-hyperion.l33t.network-console.log' 'persist'

@fliiiix
Copy link
Author

fliiiix commented Aug 26, 2017

I found the problem should I open a bug report that iocage tests that?

     name    The jail name.  This is an arbitrary string that identifies a
             jail (except it may not contain a ‘.’).  Like the jid, it can be
             passed to later jail commands, or to jls(8) or jexec(8).  If no
             name is supplied, a default is assumed that is the same as the
             jid.  The name parameter is implied by the jail.conf(5) file
             format, and need not be explicitly set when using the
             configuration file.

@skarekrow
Copy link

Oh right you have dots in your name, I spaced that, sorry! No need to open a bug report, that's actually been fixed. Grab the latest code on Github, or wait for the next release and you will be able to start those jails.

You've done all the hard work, so now it's easy street to finish fixing.

@fliiiix
Copy link
Author

fliiiix commented Aug 26, 2017

Grab the latest code on Github, or wait for the next release and you will be able to start those jails.

Actually I changed the name now to only hostnames which looks nicer and is less to type.
Thanks for all your help 👍

I assume that upgrade is also only fixed on the master branch but not in the 0.9.9.1 version

$ iocage upgrade -r 11.1 aegir 
Looking up update.FreeBSD.org mirrors... 4 mirrors found.
Fetching metadata signature for 11.0-RELEASE from update5.freebsd.org... done.
Fetching metadata index... done.
Fetching 1 metadata patches. done.
Applying metadata patches... done.
Fetching 1 metadata files... done.
Inspecting system... done.

The following components of FreeBSD seem to be installed:
kernel/generic world/base world/doc world/lib32

The following components of FreeBSD do not seem to be installed:
kernel/generic-dbg src/src world/base-dbg world/lib32-dbg


Fetching metadata signature for 11.1-RELEASE from update5.freebsd.org... done.
Fetching metadata index... done.
Fetching 1 metadata patches. done.
Applying metadata patches... done.
Fetching 1 metadata files... done.
Inspecting system... done.
Fetching files from 11.0-RELEASE for merging... done.
Preparing to download files... done.
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
/tmp/tmpv4rwukez: cannot open files/.gz: No such file or directory
Attempting to automatically merge changes in files... done.

The following file will be removed, as it no longer exists in
FreeBSD 11.1-RELEASE: /boot/device.hints
Does this look reasonable (y/n)? 

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment