dfarrell07/logs.txt

## logs.txt
2021-07-19T08:04:42.6859045Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-19T08:04:42.6859098Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-19T08:09:24.3877110Z Current runner version: '2.278.0'
2021-07-19T08:09:24.3906532Z ##[group]Operating System
2021-07-19T08:09:24.3907588Z Ubuntu
2021-07-19T08:09:24.3908040Z 20.04.2
2021-07-19T08:09:24.3908524Z LTS
2021-07-19T08:09:24.3908991Z ##[endgroup]
2021-07-19T08:09:24.3909845Z ##[group]Virtual Environment
2021-07-19T08:09:24.3910601Z Environment: ubuntu-20.04
2021-07-19T08:09:24.3911215Z Version: 20210712.0
2021-07-19T08:09:24.3912240Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210712.0/images/linux/Ubuntu2004-README.md
2021-07-19T08:09:24.3913677Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210712.0
2021-07-19T08:09:24.3914641Z ##[endgroup]
2021-07-19T08:09:24.3916938Z ##[group]GITHUB_TOKEN Permissions
2021-07-19T08:09:24.3918293Z Actions: write
2021-07-19T08:09:24.3918899Z Checks: write
2021-07-19T08:09:24.3919485Z Contents: write
2021-07-19T08:09:24.3920115Z Deployments: write
2021-07-19T08:09:24.3920859Z Discussions: write
2021-07-19T08:09:24.3921521Z Issues: write
2021-07-19T08:09:24.3922079Z Metadata: read
2021-07-19T08:09:24.3922700Z Packages: write
2021-07-19T08:09:24.3923287Z PullRequests: write
2021-07-19T08:09:24.3924030Z RepositoryProjects: write
2021-07-19T08:09:24.3924735Z SecurityEvents: write
2021-07-19T08:09:24.3925607Z Statuses: write
2021-07-19T08:09:24.3926342Z ##[endgroup]
2021-07-19T08:09:24.3929661Z Prepare workflow directory
2021-07-19T08:09:24.4578425Z Prepare all required actions
2021-07-19T08:09:24.4591402Z Getting action download info
2021-07-19T08:09:24.9028751Z Download action repository 'actions/checkout@v2'
2021-07-19T08:09:26.8456359Z Download action repository 'submariner-io/shipyard@devel'
2021-07-19T08:09:27.5555528Z ##[group]Run actions/checkout@v2
2021-07-19T08:09:27.5556077Z with:
2021-07-19T08:09:27.5556602Z   repository: submariner-io/submariner-operator
2021-07-19T08:09:27.5557553Z   token: ***
2021-07-19T08:09:27.5557889Z   ssh-strict: true
2021-07-19T08:09:27.5558340Z   persist-credentials: true
2021-07-19T08:09:27.5558780Z   clean: true
2021-07-19T08:09:27.5559131Z   fetch-depth: 1
2021-07-19T08:09:27.5559466Z   lfs: false
2021-07-19T08:09:27.5559814Z   submodules: false
2021-07-19T08:09:27.5560163Z ##[endgroup]
2021-07-19T08:09:28.3502241Z Syncing repository: submariner-io/submariner-operator
2021-07-19T08:09:28.3676832Z ##[group]Getting Git version info
2021-07-19T08:09:28.3680267Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-19T08:09:28.3681267Z [command]/usr/bin/git version
2021-07-19T08:09:28.3681764Z git version 2.32.0
2021-07-19T08:09:28.3682728Z ##[endgroup]
2021-07-19T08:09:28.3683892Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-19T08:09:28.3685546Z ##[group]Initializing the repository
2021-07-19T08:09:28.3686713Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-19T08:09:28.3687939Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-19T08:09:28.3688850Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-19T08:09:28.3689721Z hint: of your new repositories, which will suppress this warning, call:
2021-07-19T08:09:28.3690350Z hint:
2021-07-19T08:09:28.3691105Z hint: 	git config --global init.defaultBranch <name>
2021-07-19T08:09:28.3691673Z hint:
2021-07-19T08:09:28.3692443Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-19T08:09:28.3693560Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-19T08:09:28.3694172Z hint:
2021-07-19T08:09:28.3694687Z hint: 	git branch -m <name>
2021-07-19T08:09:28.3695768Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-19T08:09:28.3697202Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-19T08:09:28.3698020Z ##[endgroup]
2021-07-19T08:09:28.3698573Z ##[group]Disabling automatic garbage collection
2021-07-19T08:09:28.3699699Z [command]/usr/bin/git config --local gc.auto 0
2021-07-19T08:09:28.3700207Z ##[endgroup]
2021-07-19T08:09:28.3701770Z ##[group]Setting up auth
2021-07-19T08:09:28.3702664Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-19T08:09:28.3704141Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-19T08:09:28.3705646Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-19T08:09:28.3707532Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-19T08:09:28.3709359Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-19T08:09:28.3710200Z ##[endgroup]
2021-07-19T08:09:28.3710687Z ##[group]Fetching the repository
2021-07-19T08:09:28.3712322Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +0105e4d08ef7236073547f1383566fc76c548f6d:refs/remotes/origin/devel
2021-07-19T08:09:28.3713549Z remote: Enumerating objects: 486, done.
2021-07-19T08:09:28.3714129Z remote: Counting objects:   0% (1/486)
2021-07-19T08:09:28.3714649Z remote: Counting objects:   1% (5/486)
2021-07-19T08:09:28.3715186Z remote: Counting objects:   2% (10/486)
2021-07-19T08:09:28.3715709Z remote: Counting objects:   3% (15/486)
2021-07-19T08:09:28.3716383Z remote: Counting objects:   4% (20/486)
2021-07-19T08:09:28.3716910Z remote: Counting objects:   5% (25/486)
2021-07-19T08:09:28.3717673Z remote: Counting objects:   6% (30/486)
2021-07-19T08:09:28.3718237Z remote: Counting objects:   7% (35/486)
2021-07-19T08:09:28.3718918Z remote: Counting objects:   8% (39/486)
2021-07-19T08:09:28.3719494Z remote: Counting objects:   9% (44/486)
2021-07-19T08:09:28.3720053Z remote: Counting objects:  10% (49/486)
2021-07-19T08:09:28.3720631Z remote: Counting objects:  11% (54/486)
2021-07-19T08:09:28.3721196Z remote: Counting objects:  12% (59/486)
2021-07-19T08:09:28.3721770Z remote: Counting objects:  13% (64/486)
2021-07-19T08:09:28.3722330Z remote: Counting objects:  14% (69/486)
2021-07-19T08:09:28.3722900Z remote: Counting objects:  15% (73/486)
2021-07-19T08:09:28.3723459Z remote: Counting objects:  16% (78/486)
2021-07-19T08:09:28.3724038Z remote: Counting objects:  17% (83/486)
2021-07-19T08:09:28.3724605Z remote: Counting objects:  18% (88/486)
2021-07-19T08:09:28.3725349Z remote: Counting objects:  19% (93/486)
2021-07-19T08:09:28.3725922Z remote: Counting objects:  20% (98/486)
2021-07-19T08:09:28.3726484Z remote: Counting objects:  21% (103/486)
2021-07-19T08:09:28.3727078Z remote: Counting objects:  22% (107/486)
2021-07-19T08:09:28.3727643Z remote: Counting objects:  23% (112/486)
2021-07-19T08:09:28.3728223Z remote: Counting objects:  24% (117/486)
2021-07-19T08:09:28.3728785Z remote: Counting objects:  25% (122/486)
2021-07-19T08:09:28.3729360Z remote: Counting objects:  26% (127/486)
2021-07-19T08:09:28.3729940Z remote: Counting objects:  27% (132/486)
2021-07-19T08:09:28.3730504Z remote: Counting objects:  28% (137/486)
2021-07-19T08:09:28.3731077Z remote: Counting objects:  29% (141/486)
2021-07-19T08:09:28.3731645Z remote: Counting objects:  30% (146/486)
2021-07-19T08:09:28.3732218Z remote: Counting objects:  31% (151/486)
2021-07-19T08:09:28.3732779Z remote: Counting objects:  32% (156/486)
2021-07-19T08:09:28.3733350Z remote: Counting objects:  33% (161/486)
2021-07-19T08:09:28.3733914Z remote: Counting objects:  34% (166/486)
2021-07-19T08:09:28.3734601Z remote: Counting objects:  35% (171/486)
2021-07-19T08:09:28.3735161Z remote: Counting objects:  36% (175/486)
2021-07-19T08:09:28.3735738Z remote: Counting objects:  37% (180/486)
2021-07-19T08:09:28.3736314Z remote: Counting objects:  38% (185/486)
2021-07-19T08:09:28.3736871Z remote: Counting objects:  39% (190/486)
2021-07-19T08:09:28.3737443Z remote: Counting objects:  40% (195/486)
2021-07-19T08:09:28.3738008Z remote: Counting objects:  41% (200/486)
2021-07-19T08:09:28.3738581Z remote: Counting objects:  42% (205/486)
2021-07-19T08:09:28.3739153Z remote: Counting objects:  43% (209/486)
2021-07-19T08:09:28.3739727Z remote: Counting objects:  44% (214/486)
2021-07-19T08:09:28.3740291Z remote: Counting objects:  45% (219/486)
2021-07-19T08:09:28.3740865Z remote: Counting objects:  46% (224/486)
2021-07-19T08:09:28.3741435Z remote: Counting objects:  47% (229/486)
2021-07-19T08:09:28.3742005Z remote: Counting objects:  48% (234/486)
2021-07-19T08:09:28.3742579Z remote: Counting objects:  49% (239/486)
2021-07-19T08:09:28.3743254Z remote: Counting objects:  50% (243/486)
2021-07-19T08:09:28.3743787Z remote: Counting objects:  51% (248/486)
2021-07-19T08:09:28.3744316Z remote: Counting objects:  52% (253/486)
2021-07-19T08:09:28.3744856Z remote: Counting objects:  53% (258/486)
2021-07-19T08:09:28.3745373Z remote: Counting objects:  54% (263/486)
2021-07-19T08:09:28.3745903Z remote: Counting objects:  55% (268/486)
2021-07-19T08:09:28.3746507Z remote: Counting objects:  56% (273/486)
2021-07-19T08:09:28.3747031Z remote: Counting objects:  57% (278/486)
2021-07-19T08:09:28.3747601Z remote: Counting objects:  58% (282/486)
2021-07-19T08:09:28.3748123Z remote: Counting objects:  59% (287/486)
2021-07-19T08:09:28.3748657Z remote: Counting objects:  60% (292/486)
2021-07-19T08:09:28.3749182Z remote: Counting objects:  61% (297/486)
2021-07-19T08:09:28.3749732Z remote: Counting objects:  62% (302/486)
2021-07-19T08:09:28.3750265Z remote: Counting objects:  63% (307/486)
2021-07-19T08:09:28.3750782Z remote: Counting objects:  64% (312/486)
2021-07-19T08:09:28.3751311Z remote: Counting objects:  65% (316/486)
2021-07-19T08:09:28.3751832Z remote: Counting objects:  66% (321/486)
2021-07-19T08:09:28.3752361Z remote: Counting objects:  67% (326/486)
2021-07-19T08:09:28.3752879Z remote: Counting objects:  68% (331/486)
2021-07-19T08:09:28.3753413Z remote: Counting objects:  69% (336/486)
2021-07-19T08:09:28.3753954Z remote: Counting objects:  70% (341/486)
2021-07-19T08:09:28.3754472Z remote: Counting objects:  71% (346/486)
2021-07-19T08:09:28.3755004Z remote: Counting objects:  72% (350/486)
2021-07-19T08:09:28.3755522Z remote: Counting objects:  73% (355/486)
2021-07-19T08:09:28.3756061Z remote: Counting objects:  74% (360/486)
2021-07-19T08:09:28.3756580Z remote: Counting objects:  75% (365/486)
2021-07-19T08:09:28.3757109Z remote: Counting objects:  76% (370/486)
2021-07-19T08:09:28.3757629Z remote: Counting objects:  77% (375/486)
2021-07-19T08:09:28.3758157Z remote: Counting objects:  78% (380/486)
2021-07-19T08:09:28.3758693Z remote: Counting objects:  79% (384/486)
2021-07-19T08:09:28.3759212Z remote: Counting objects:  80% (389/486)
2021-07-19T08:09:28.3759742Z remote: Counting objects:  81% (394/486)
2021-07-19T08:09:28.3760257Z remote: Counting objects:  82% (399/486)
2021-07-19T08:09:28.3760791Z remote: Counting objects:  83% (404/486)
2021-07-19T08:09:28.3761316Z remote: Counting objects:  84% (409/486)
2021-07-19T08:09:28.3761851Z remote: Counting objects:  85% (414/486)
2021-07-19T08:09:28.3762603Z remote: Counting objects:  86% (418/486)
2021-07-19T08:09:28.3763244Z remote: Counting objects:  87% (423/486)
2021-07-19T08:09:28.3763879Z remote: Counting objects:  88% (428/486)
2021-07-19T08:09:28.3764448Z remote: Counting objects:  89% (433/486)
2021-07-19T08:09:28.3765234Z remote: Counting objects:  90% (438/486)
2021-07-19T08:09:28.3765805Z remote: Counting objects:  91% (443/486)
2021-07-19T08:09:28.3766381Z remote: Counting objects:  92% (448/486)
2021-07-19T08:09:28.3766940Z remote: Counting objects:  93% (452/486)
2021-07-19T08:09:28.3767512Z remote: Counting objects:  94% (457/486)
2021-07-19T08:09:28.3768074Z remote: Counting objects:  95% (462/486)
2021-07-19T08:09:28.3768706Z remote: Counting objects:  96% (467/486)
2021-07-19T08:09:28.3769269Z remote: Counting objects:  97% (472/486)
2021-07-19T08:09:28.3769841Z remote: Counting objects:  98% (477/486)
2021-07-19T08:09:28.3770411Z remote: Counting objects:  99% (482/486)
2021-07-19T08:09:28.3770970Z remote: Counting objects: 100% (486/486)
2021-07-19T08:09:28.3771571Z remote: Counting objects: 100% (486/486), done.
2021-07-19T08:09:28.3772191Z remote: Compressing objects:   0% (1/353)
2021-07-19T08:09:28.3772824Z remote: Compressing objects:   1% (4/353)
2021-07-19T08:09:28.3773478Z remote: Compressing objects:   2% (8/353)
2021-07-19T08:09:28.3774106Z remote: Compressing objects:   3% (11/353)
2021-07-19T08:09:28.3774724Z remote: Compressing objects:   4% (15/353)
2021-07-19T08:09:28.3775348Z remote: Compressing objects:   5% (18/353)
2021-07-19T08:09:28.3775979Z remote: Compressing objects:   6% (22/353)
2021-07-19T08:09:28.3776681Z remote: Compressing objects:   7% (25/353)
2021-07-19T08:09:28.3777315Z remote: Compressing objects:   8% (29/353)
2021-07-19T08:09:28.3777971Z remote: Compressing objects:   9% (32/353)
2021-07-19T08:09:28.3778599Z remote: Compressing objects:  10% (36/353)
2021-07-19T08:09:28.3779217Z remote: Compressing objects:  11% (39/353)
2021-07-19T08:09:28.3779841Z remote: Compressing objects:  12% (43/353)
2021-07-19T08:09:28.3780462Z remote: Compressing objects:  13% (46/353)
2021-07-19T08:09:28.3781083Z remote: Compressing objects:  14% (50/353)
2021-07-19T08:09:28.3781710Z remote: Compressing objects:  15% (53/353)
2021-07-19T08:09:28.3782322Z remote: Compressing objects:  16% (57/353)
2021-07-19T08:09:28.3782946Z remote: Compressing objects:  17% (61/353)
2021-07-19T08:09:28.3783563Z remote: Compressing objects:  18% (64/353)
2021-07-19T08:09:28.3784193Z remote: Compressing objects:  19% (68/353)
2021-07-19T08:09:28.3784803Z remote: Compressing objects:  20% (71/353)
2021-07-19T08:09:28.3785428Z remote: Compressing objects:  21% (75/353)
2021-07-19T08:09:28.3786040Z remote: Compressing objects:  22% (78/353)
2021-07-19T08:09:28.3786662Z remote: Compressing objects:  23% (82/353)
2021-07-19T08:09:28.3787294Z remote: Compressing objects:  24% (85/353)
2021-07-19T08:09:28.3787903Z remote: Compressing objects:  25% (89/353)
2021-07-19T08:09:28.3788627Z remote: Compressing objects:  26% (92/353)
2021-07-19T08:09:28.3789195Z remote: Compressing objects:  27% (96/353)
2021-07-19T08:09:28.3789773Z remote: Compressing objects:  28% (99/353)
2021-07-19T08:09:28.3790342Z remote: Compressing objects:  29% (103/353)
2021-07-19T08:09:28.3790929Z remote: Compressing objects:  30% (106/353)
2021-07-19T08:09:28.3791501Z remote: Compressing objects:  31% (110/353)
2021-07-19T08:09:28.3792093Z remote: Compressing objects:  32% (113/353)
2021-07-19T08:09:28.3792679Z remote: Compressing objects:  33% (117/353)
2021-07-19T08:09:28.3793247Z remote: Compressing objects:  34% (121/353)
2021-07-19T08:09:28.3793829Z remote: Compressing objects:  35% (124/353)
2021-07-19T08:09:28.3794399Z remote: Compressing objects:  36% (128/353)
2021-07-19T08:09:28.3795067Z remote: Compressing objects:  37% (131/353)
2021-07-19T08:09:28.3795636Z remote: Compressing objects:  38% (135/353)
2021-07-19T08:09:28.3796222Z remote: Compressing objects:  39% (138/353)
2021-07-19T08:09:28.3796790Z remote: Compressing objects:  40% (142/353)
2021-07-19T08:09:28.3797371Z remote: Compressing objects:  41% (145/353)
2021-07-19T08:09:28.3797955Z remote: Compressing objects:  42% (149/353)
2021-07-19T08:09:28.3798523Z remote: Compressing objects:  43% (152/353)
2021-07-19T08:09:28.3799102Z remote: Compressing objects:  44% (156/353)
2021-07-19T08:09:28.3799674Z remote: Compressing objects:  45% (159/353)
2021-07-19T08:09:28.3800254Z remote: Compressing objects:  46% (163/353)
2021-07-19T08:09:28.3800821Z remote: Compressing objects:  47% (166/353)
2021-07-19T08:09:28.3801401Z remote: Compressing objects:  48% (170/353)
2021-07-19T08:09:28.3801976Z remote: Compressing objects:  49% (173/353)
2021-07-19T08:09:28.3804044Z remote: Compressing objects:  50% (177/353)
2021-07-19T08:09:28.3804636Z remote: Compressing objects:  51% (181/353)
2021-07-19T08:09:28.3805368Z remote: Compressing objects:  52% (184/353)
2021-07-19T08:09:28.3805953Z remote: Compressing objects:  53% (188/353)
2021-07-19T08:09:28.3806527Z remote: Compressing objects:  54% (191/353)
2021-07-19T08:09:28.3807107Z remote: Compressing objects:  55% (195/353)
2021-07-19T08:09:28.3807692Z remote: Compressing objects:  56% (198/353)
2021-07-19T08:09:28.3808262Z remote: Compressing objects:  57% (202/353)
2021-07-19T08:09:28.3809070Z remote: Compressing objects:  58% (205/353)
2021-07-19T08:09:28.3809649Z remote: Compressing objects:  59% (209/353)
2021-07-19T08:09:28.3810235Z remote: Compressing objects:  60% (212/353)
2021-07-19T08:09:28.3811000Z remote: Compressing objects:  61% (216/353)
2021-07-19T08:09:28.3811635Z remote: Compressing objects:  62% (219/353)
2021-07-19T08:09:28.3812250Z remote: Compressing objects:  63% (223/353)
2021-07-19T08:09:28.3812878Z remote: Compressing objects:  64% (226/353)
2021-07-19T08:09:28.3813507Z remote: Compressing objects:  65% (230/353)
2021-07-19T08:09:28.3814120Z remote: Compressing objects:  66% (233/353)
2021-07-19T08:09:28.3814741Z remote: Compressing objects:  67% (237/353)
2021-07-19T08:09:28.3815351Z remote: Compressing objects:  68% (241/353)
2021-07-19T08:09:28.3815976Z remote: Compressing objects:  69% (244/353)
2021-07-19T08:09:28.3816591Z remote: Compressing objects:  70% (248/353)
2021-07-19T08:09:28.3817214Z remote: Compressing objects:  71% (251/353)
2021-07-19T08:09:28.3817822Z remote: Compressing objects:  72% (255/353)
2021-07-19T08:09:28.3818449Z remote: Compressing objects:  73% (258/353)
2021-07-19T08:09:28.3819079Z remote: Compressing objects:  74% (262/353)
2021-07-19T08:09:28.3819698Z remote: Compressing objects:  75% (265/353)
2021-07-19T08:09:28.3820325Z remote: Compressing objects:  76% (269/353)
2021-07-19T08:09:28.3820933Z remote: Compressing objects:  77% (272/353)
2021-07-19T08:09:28.3821561Z remote: Compressing objects:  78% (276/353)
2021-07-19T08:09:28.3822176Z remote: Compressing objects:  79% (279/353)
2021-07-19T08:09:28.3822799Z remote: Compressing objects:  80% (283/353)
2021-07-19T08:09:28.3823408Z remote: Compressing objects:  81% (286/353)
2021-07-19T08:09:28.3824038Z remote: Compressing objects:  82% (290/353)
2021-07-19T08:09:28.3824670Z remote: Compressing objects:  83% (293/353)
2021-07-19T08:09:28.3825283Z remote: Compressing objects:  84% (297/353)
2021-07-19T08:09:28.3825910Z remote: Compressing objects:  85% (301/353)
2021-07-19T08:09:28.3826526Z remote: Compressing objects:  86% (304/353)
2021-07-19T08:09:28.3827229Z remote: Compressing objects:  87% (308/353)
2021-07-19T08:09:28.3827872Z remote: Compressing objects:  88% (311/353)
2021-07-19T08:09:28.3828489Z remote: Compressing objects:  89% (315/353)
2021-07-19T08:09:28.3829118Z remote: Compressing objects:  90% (318/353)
2021-07-19T08:09:28.3829729Z remote: Compressing objects:  91% (322/353)
2021-07-19T08:09:28.3830349Z remote: Compressing objects:  92% (325/353)
2021-07-19T08:09:28.3830979Z remote: Compressing objects:  93% (329/353)
2021-07-19T08:09:28.3831595Z remote: Compressing objects:  94% (332/353)
2021-07-19T08:09:28.3832228Z remote: Compressing objects:  95% (336/353)
2021-07-19T08:09:28.3832837Z remote: Compressing objects:  96% (339/353)
2021-07-19T08:09:28.3833463Z remote: Compressing objects:  97% (343/353)
2021-07-19T08:09:28.3834074Z remote: Compressing objects:  98% (346/353)
2021-07-19T08:09:28.3834700Z remote: Compressing objects:  99% (350/353)
2021-07-19T08:09:28.3835315Z remote: Compressing objects: 100% (353/353)
2021-07-19T08:09:28.3835964Z remote: Compressing objects: 100% (353/353), done.
2021-07-19T08:09:28.3856378Z Receiving objects:   0% (1/486)
2021-07-19T08:09:28.3856959Z Receiving objects:   1% (5/486)
2021-07-19T08:09:28.3857478Z Receiving objects:   2% (10/486)
2021-07-19T08:09:28.3858006Z Receiving objects:   3% (15/486)
2021-07-19T08:09:28.3858524Z Receiving objects:   4% (20/486)
2021-07-19T08:09:28.3859092Z Receiving objects:   5% (25/486)
2021-07-19T08:09:28.3859609Z Receiving objects:   6% (30/486)
2021-07-19T08:09:28.3860547Z Receiving objects:   7% (35/486)
2021-07-19T08:09:28.3861233Z Receiving objects:   8% (39/486)
2021-07-19T08:09:28.3892396Z Receiving objects:   9% (44/486)
2021-07-19T08:09:28.3894288Z Receiving objects:  10% (49/486)
2021-07-19T08:09:28.3896099Z Receiving objects:  11% (54/486)
2021-07-19T08:09:28.3898061Z Receiving objects:  12% (59/486)
2021-07-19T08:09:28.3899881Z Receiving objects:  13% (64/486)
2021-07-19T08:09:28.3900498Z Receiving objects:  14% (69/486)
2021-07-19T08:09:28.3902257Z Receiving objects:  15% (73/486)
2021-07-19T08:09:28.3904093Z Receiving objects:  16% (78/486)
2021-07-19T08:09:28.3904665Z Receiving objects:  17% (83/486)
2021-07-19T08:09:28.3906447Z Receiving objects:  18% (88/486)
2021-07-19T08:09:28.3911068Z Receiving objects:  19% (93/486)
2021-07-19T08:09:28.3912943Z Receiving objects:  20% (98/486)
2021-07-19T08:09:28.3914736Z Receiving objects:  21% (103/486)
2021-07-19T08:09:28.3916606Z Receiving objects:  22% (107/486)
2021-07-19T08:09:28.3918405Z Receiving objects:  23% (112/486)
2021-07-19T08:09:28.3920537Z Receiving objects:  24% (117/486)
2021-07-19T08:09:28.3921117Z Receiving objects:  25% (122/486)
2021-07-19T08:09:28.3921638Z Receiving objects:  26% (127/486)
2021-07-19T08:09:28.3922155Z Receiving objects:  27% (132/486)
2021-07-19T08:09:28.3923904Z Receiving objects:  28% (137/486)
2021-07-19T08:09:28.3924467Z Receiving objects:  29% (141/486)
2021-07-19T08:09:28.3926451Z Receiving objects:  30% (146/486)
2021-07-19T08:09:28.3998010Z Receiving objects:  31% (151/486)
2021-07-19T08:09:28.4000198Z Receiving objects:  32% (156/486)
2021-07-19T08:09:28.4002279Z Receiving objects:  33% (161/486)
2021-07-19T08:09:28.4005849Z Receiving objects:  34% (166/486)
2021-07-19T08:09:28.4008032Z Receiving objects:  35% (171/486)
2021-07-19T08:09:28.4010060Z Receiving objects:  36% (175/486)
2021-07-19T08:09:28.4012150Z Receiving objects:  37% (180/486)
2021-07-19T08:09:28.4014183Z Receiving objects:  38% (185/486)
2021-07-19T08:09:28.4016185Z Receiving objects:  39% (190/486)
2021-07-19T08:09:28.4018511Z Receiving objects:  40% (195/486)
2021-07-19T08:09:28.4019319Z Receiving objects:  41% (200/486)
2021-07-19T08:09:28.4062217Z Receiving objects:  42% (205/486)
2021-07-19T08:09:28.4195555Z Receiving objects:  43% (209/486)
2021-07-19T08:09:28.4196530Z Receiving objects:  44% (214/486)
2021-07-19T08:09:28.4197062Z Receiving objects:  45% (219/486)
2021-07-19T08:09:28.4198066Z Receiving objects:  46% (224/486)
2021-07-19T08:09:28.4198702Z Receiving objects:  47% (229/486)
2021-07-19T08:09:28.4199330Z Receiving objects:  48% (234/486)
2021-07-19T08:09:28.4199956Z Receiving objects:  49% (239/486)
2021-07-19T08:09:28.4200570Z Receiving objects:  50% (243/486)
2021-07-19T08:09:28.4201198Z Receiving objects:  51% (248/486)
2021-07-19T08:09:28.4201811Z Receiving objects:  52% (253/486)
2021-07-19T08:09:28.4202436Z Receiving objects:  53% (258/486)
2021-07-19T08:09:28.4261910Z Receiving objects:  54% (263/486)
2021-07-19T08:09:28.4262575Z Receiving objects:  55% (268/486)
2021-07-19T08:09:28.4263071Z Receiving objects:  56% (273/486)
2021-07-19T08:09:28.4263712Z Receiving objects:  57% (278/486)
2021-07-19T08:09:28.4264292Z Receiving objects:  58% (282/486)
2021-07-19T08:09:28.4264901Z Receiving objects:  59% (287/486)
2021-07-19T08:09:28.4265386Z Receiving objects:  60% (292/486)
2021-07-19T08:09:28.4266236Z Receiving objects:  61% (297/486)
2021-07-19T08:09:28.4266775Z Receiving objects:  62% (302/486)
2021-07-19T08:09:28.4267471Z Receiving objects:  63% (307/486)
2021-07-19T08:09:28.4271518Z Receiving objects:  64% (312/486)
2021-07-19T08:09:28.4275734Z Receiving objects:  65% (316/486)
2021-07-19T08:09:28.4285574Z Receiving objects:  66% (321/486)
2021-07-19T08:09:28.4295628Z Receiving objects:  67% (326/486)
2021-07-19T08:09:28.4296303Z Receiving objects:  68% (331/486)
2021-07-19T08:09:28.4296886Z Receiving objects:  69% (336/486)
2021-07-19T08:09:28.4653384Z Receiving objects:  70% (341/486)
2021-07-19T08:09:28.4658213Z Receiving objects:  71% (346/486)
2021-07-19T08:09:28.4658858Z Receiving objects:  72% (350/486)
2021-07-19T08:09:28.4659461Z Receiving objects:  73% (355/486)
2021-07-19T08:09:28.4660169Z Receiving objects:  74% (360/486)
2021-07-19T08:09:28.4660970Z Receiving objects:  75% (365/486)
2021-07-19T08:09:28.4666141Z Receiving objects:  76% (370/486)
2021-07-19T08:09:28.4670343Z Receiving objects:  77% (375/486)
2021-07-19T08:09:28.4673599Z Receiving objects:  78% (380/486)
2021-07-19T08:09:28.4676870Z Receiving objects:  79% (384/486)
2021-07-19T08:09:28.4680885Z Receiving objects:  80% (389/486)
2021-07-19T08:09:28.4685213Z Receiving objects:  81% (394/486)
2021-07-19T08:09:28.4689231Z Receiving objects:  82% (399/486)
2021-07-19T08:09:28.4693267Z Receiving objects:  83% (404/486)
2021-07-19T08:09:28.4696283Z Receiving objects:  84% (409/486)
2021-07-19T08:09:28.4831518Z Receiving objects:  85% (414/486)
2021-07-19T08:09:28.4835076Z Receiving objects:  86% (418/486)
2021-07-19T08:09:28.4882705Z Receiving objects:  87% (423/486)
2021-07-19T08:09:28.4886757Z Receiving objects:  88% (428/486)
2021-07-19T08:09:28.4892671Z Receiving objects:  89% (433/486)
2021-07-19T08:09:28.4896114Z Receiving objects:  90% (438/486)
2021-07-19T08:09:28.4900863Z Receiving objects:  91% (443/486)
2021-07-19T08:09:28.4901608Z Receiving objects:  92% (448/486)
2021-07-19T08:09:28.4986517Z Receiving objects:  93% (452/486)
2021-07-19T08:09:28.4988271Z remote: Total 486 (delta 154), reused 304 (delta 87), pack-reused 0
2021-07-19T08:09:28.4988950Z Receiving objects:  94% (457/486)
2021-07-19T08:09:28.4989480Z Receiving objects:  95% (462/486)
2021-07-19T08:09:28.4989988Z Receiving objects:  96% (467/486)
2021-07-19T08:09:28.4991157Z Receiving objects:  97% (472/486)
2021-07-19T08:09:28.4993029Z Receiving objects:  98% (477/486)
2021-07-19T08:09:28.4994574Z Receiving objects:  99% (482/486)
2021-07-19T08:09:28.4995345Z Receiving objects: 100% (486/486)
2021-07-19T08:09:28.4996018Z Receiving objects: 100% (486/486), 349.02 KiB | 2.93 MiB/s, done.
2021-07-19T08:09:28.4998590Z Resolving deltas:   0% (0/154)
2021-07-19T08:09:28.4999813Z Resolving deltas:   1% (2/154)
2021-07-19T08:09:28.5000508Z Resolving deltas:   2% (4/154)
2021-07-19T08:09:28.5000922Z Resolving deltas:   3% (5/154)
2021-07-19T08:09:28.5001938Z Resolving deltas:   4% (7/154)
2021-07-19T08:09:28.5003144Z Resolving deltas:   5% (8/154)
2021-07-19T08:09:28.5004147Z Resolving deltas:   6% (10/154)
2021-07-19T08:09:28.5005742Z Resolving deltas:   7% (11/154)
2021-07-19T08:09:28.5006800Z Resolving deltas:   8% (13/154)
2021-07-19T08:09:28.5007583Z Resolving deltas:   9% (14/154)
2021-07-19T08:09:28.5008672Z Resolving deltas:  10% (16/154)
2021-07-19T08:09:28.5009172Z Resolving deltas:  11% (17/154)
2021-07-19T08:09:28.5009987Z Resolving deltas:  12% (19/154)
2021-07-19T08:09:28.5010759Z Resolving deltas:  13% (21/154)
2021-07-19T08:09:28.5011262Z Resolving deltas:  14% (22/154)
2021-07-19T08:09:28.5012093Z Resolving deltas:  15% (24/154)
2021-07-19T08:09:28.5012583Z Resolving deltas:  16% (25/154)
2021-07-19T08:09:28.5013364Z Resolving deltas:  17% (27/154)
2021-07-19T08:09:28.5013852Z Resolving deltas:  18% (28/154)
2021-07-19T08:09:28.5014687Z Resolving deltas:  19% (30/154)
2021-07-19T08:09:28.5015464Z Resolving deltas:  20% (31/154)
2021-07-19T08:09:28.5016073Z Resolving deltas:  21% (33/154)
2021-07-19T08:09:28.5016524Z Resolving deltas:  22% (34/154)
2021-07-19T08:09:28.5017295Z Resolving deltas:  23% (36/154)
2021-07-19T08:09:28.5017849Z Resolving deltas:  24% (37/154)
2021-07-19T08:09:28.5020058Z Resolving deltas:  25% (39/154)
2021-07-19T08:09:28.5021258Z Resolving deltas:  26% (41/154)
2021-07-19T08:09:28.5023074Z Resolving deltas:  27% (42/154)
2021-07-19T08:09:28.5025247Z Resolving deltas:  28% (44/154)
2021-07-19T08:09:28.5025657Z Resolving deltas:  29% (45/154)
2021-07-19T08:09:28.5027098Z Resolving deltas:  30% (47/154)
2021-07-19T08:09:28.5028240Z Resolving deltas:  31% (48/154)
2021-07-19T08:09:28.5029094Z Resolving deltas:  32% (50/154)
2021-07-19T08:09:28.5029830Z Resolving deltas:  33% (51/154)
2021-07-19T08:09:28.5030826Z Resolving deltas:  34% (53/154)
2021-07-19T08:09:28.5031490Z Resolving deltas:  35% (54/154)
2021-07-19T08:09:28.5032297Z Resolving deltas:  36% (56/154)
2021-07-19T08:09:28.5033220Z Resolving deltas:  37% (57/154)
2021-07-19T08:09:28.5033723Z Resolving deltas:  38% (59/154)
2021-07-19T08:09:28.5034537Z Resolving deltas:  39% (61/154)
2021-07-19T08:09:28.5035318Z Resolving deltas:  40% (62/154)
2021-07-19T08:09:28.5035820Z Resolving deltas:  41% (64/154)
2021-07-19T08:09:28.5036645Z Resolving deltas:  42% (65/154)
2021-07-19T08:09:28.5037420Z Resolving deltas:  43% (67/154)
2021-07-19T08:09:28.5037922Z Resolving deltas:  44% (68/154)
2021-07-19T08:09:28.5038771Z Resolving deltas:  45% (70/154)
2021-07-19T08:09:28.5039548Z Resolving deltas:  46% (71/154)
2021-07-19T08:09:28.5040088Z Resolving deltas:  47% (73/154)
2021-07-19T08:09:28.5040576Z Resolving deltas:  48% (74/154)
2021-07-19T08:09:28.5041970Z Resolving deltas:  49% (76/154)
2021-07-19T08:09:28.5042826Z Resolving deltas:  50% (77/154)
2021-07-19T08:09:28.5043332Z Resolving deltas:  51% (79/154)
2021-07-19T08:09:28.5043923Z Resolving deltas:  52% (81/154)
2021-07-19T08:09:28.5045111Z Resolving deltas:  53% (82/154)
2021-07-19T08:09:28.5045536Z Resolving deltas:  54% (84/154)
2021-07-19T08:09:28.5045929Z Resolving deltas:  55% (85/154)
2021-07-19T08:09:28.5046335Z Resolving deltas:  56% (87/154)
2021-07-19T08:09:28.5049444Z Resolving deltas:  57% (88/154)
2021-07-19T08:09:28.5052686Z Resolving deltas:  59% (91/154)
2021-07-19T08:09:28.5053158Z Resolving deltas:  60% (93/154)
2021-07-19T08:09:28.5053624Z Resolving deltas:  61% (94/154)
2021-07-19T08:09:28.5054077Z Resolving deltas:  62% (96/154)
2021-07-19T08:09:28.5054538Z Resolving deltas:  63% (98/154)
2021-07-19T08:09:28.5057725Z Resolving deltas:  64% (99/154)
2021-07-19T08:09:28.5058838Z Resolving deltas:  65% (101/154)
2021-07-19T08:09:28.5059270Z Resolving deltas:  66% (102/154)
2021-07-19T08:09:28.5059670Z Resolving deltas:  67% (104/154)
2021-07-19T08:09:28.5060079Z Resolving deltas:  68% (105/154)
2021-07-19T08:09:28.5060476Z Resolving deltas:  69% (107/154)
2021-07-19T08:09:28.5060901Z Resolving deltas:  70% (108/154)
2021-07-19T08:09:28.5061299Z Resolving deltas:  71% (110/154)
2021-07-19T08:09:28.5061706Z Resolving deltas:  72% (111/154)
2021-07-19T08:09:28.5062103Z Resolving deltas:  73% (113/154)
2021-07-19T08:09:28.5062508Z Resolving deltas:  74% (114/154)
2021-07-19T08:09:28.5062917Z Resolving deltas:  75% (116/154)
2021-07-19T08:09:28.5065085Z Resolving deltas:  76% (118/154)
2021-07-19T08:09:28.5066045Z Resolving deltas:  77% (119/154)
2021-07-19T08:09:28.5066460Z Resolving deltas:  78% (121/154)
2021-07-19T08:09:28.5066869Z Resolving deltas:  79% (122/154)
2021-07-19T08:09:28.5067268Z Resolving deltas:  80% (124/154)
2021-07-19T08:09:28.5067676Z Resolving deltas:  81% (125/154)
2021-07-19T08:09:28.5068070Z Resolving deltas:  82% (127/154)
2021-07-19T08:09:28.5068483Z Resolving deltas:  83% (128/154)
2021-07-19T08:09:28.5069889Z Resolving deltas:  84% (130/154)
2021-07-19T08:09:28.5070581Z Resolving deltas:  85% (131/154)
2021-07-19T08:09:28.5071005Z Resolving deltas:  86% (133/154)
2021-07-19T08:09:28.5071399Z Resolving deltas:  87% (134/154)
2021-07-19T08:09:28.5071811Z Resolving deltas:  88% (136/154)
2021-07-19T08:09:28.5075334Z Resolving deltas:  89% (138/154)
2021-07-19T08:09:28.5075797Z Resolving deltas:  90% (139/154)
2021-07-19T08:09:28.5076196Z Resolving deltas:  91% (141/154)
2021-07-19T08:09:28.5076625Z Resolving deltas:  92% (142/154)
2021-07-19T08:09:28.5077025Z Resolving deltas:  93% (144/154)
2021-07-19T08:09:28.5077849Z Resolving deltas:  94% (145/154)
2021-07-19T08:09:28.5078265Z Resolving deltas:  95% (147/154)
2021-07-19T08:09:28.5078661Z Resolving deltas:  96% (148/154)
2021-07-19T08:09:28.5079320Z Resolving deltas:  97% (150/154)
2021-07-19T08:09:28.5079940Z Resolving deltas:  98% (151/154)
2021-07-19T08:09:28.5080400Z Resolving deltas:  99% (153/154)
2021-07-19T08:09:28.5081010Z Resolving deltas: 100% (154/154)
2021-07-19T08:09:28.5081617Z Resolving deltas: 100% (154/154), done.
2021-07-19T08:09:28.5214105Z From https://github.com/submariner-io/submariner-operator
2021-07-19T08:09:28.5215401Z  * [new ref]         0105e4d08ef7236073547f1383566fc76c548f6d -> origin/devel
2021-07-19T08:09:28.5235548Z ##[endgroup]
2021-07-19T08:09:28.5236150Z ##[group]Determining the checkout info
2021-07-19T08:09:28.5238426Z ##[endgroup]
2021-07-19T08:09:28.5238928Z ##[group]Checking out the ref
2021-07-19T08:09:28.5243904Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-19T08:09:28.5483479Z Switched to a new branch 'devel'
2021-07-19T08:09:28.5492305Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-19T08:09:28.5510651Z ##[endgroup]
2021-07-19T08:09:28.5540553Z [command]/usr/bin/git log -1 --format='%H'
2021-07-19T08:09:28.5567581Z '0105e4d08ef7236073547f1383566fc76c548f6d'
2021-07-19T08:09:28.5825823Z ##[group]Run submariner-io/shipyard/gh-actions/e2e@devel
2021-07-19T08:09:28.5826395Z with:
2021-07-19T08:09:28.5826763Z   k8s_version: 1.17
2021-07-19T08:09:28.5827220Z   using: libreswan globalnet
2021-07-19T08:09:28.5827733Z   working-directory: .
2021-07-19T08:09:28.5828189Z   target: e2e
2021-07-19T08:09:28.5828545Z   focus: \[.*\]
2021-07-19T08:09:28.5829024Z   skip: \[external-dataplane\]
2021-07-19T08:09:28.5829523Z   testdir: test/e2e
2021-07-19T08:09:28.5829929Z ##[endgroup]
2021-07-19T08:09:28.5994973Z ##[group]Reclaiming free space
2021-07-19T08:09:40.5626643Z Filesystem      Size  Used Avail Use% Mounted on
2021-07-19T08:09:40.5635963Z /dev/root        84G   42G   43G  50% /
2021-07-19T08:09:40.5638319Z devtmpfs        3.4G     0  3.4G   0% /dev
2021-07-19T08:09:40.5639808Z tmpfs           3.4G   12K  3.4G   1% /dev/shm
2021-07-19T08:09:40.5640960Z tmpfs           696M  1.1M  695M   1% /run
2021-07-19T08:09:40.5642235Z tmpfs           5.0M     0  5.0M   0% /run/lock
2021-07-19T08:09:40.5646755Z tmpfs           3.4G     0  3.4G   0% /sys/fs/cgroup
2021-07-19T08:09:40.5648053Z /dev/loop1       68M   68M     0 100% /snap/lxd/20326
2021-07-19T08:09:40.5649073Z /dev/loop0       56M   56M     0 100% /snap/core18/2074
2021-07-19T08:09:40.5650240Z /dev/sda15      105M  7.9M   97M   8% /boot/efi
2021-07-19T08:09:40.5651228Z /dev/loop2       33M   33M     0 100% /snap/snapd/12159
2021-07-19T08:09:40.5652400Z /dev/loop3       56M   56M     0 100% /snap/core18/2066
2021-07-19T08:09:40.5653431Z /dev/loop4       33M   33M     0 100% /snap/snapd/12398
2021-07-19T08:09:40.5654964Z /dev/sdb1        14G  4.1G  9.0G  32% /mnt
2021-07-19T08:09:40.5656741Z ##[endgroup]
2021-07-19T08:09:40.5799994Z ##[group]Disable swap
2021-07-19T08:09:40.6112714Z ##[endgroup]
2021-07-19T08:09:40.6267011Z ##[group]Report available RAM
2021-07-19T08:09:40.6292288Z               total        used        free      shared  buff/cache   available
2021-07-19T08:09:40.6293051Z Mem:          6.8Gi       486Mi       5.2Gi       7.0Mi       1.1Gi       6.0Gi
2021-07-19T08:09:40.6301015Z Swap:            0B          0B          0B
2021-07-19T08:09:40.6302780Z ##[endgroup]
2021-07-19T08:09:40.6888872Z Downloading Makefile.dapper
2021-07-19T08:09:40.7390197Z Downloading dapper
2021-07-19T08:09:41.2981247Z .dapper.tmp version v0.5.6
2021-07-19T08:09:41.3014621Z Downloading Dockerfile.dapper
2021-07-19T08:09:41.3481971Z docker network create -d bridge kind
2021-07-19T08:09:41.7097832Z 099dc62ede433d1bb14032e1efa856ef7c3026f633b049d029d7ccd08ad11132
2021-07-19T08:09:41.7105469Z ./.dapper -m bind  make --debug=b e2e
2021-07-19T08:09:41.9456860Z Sending build context to Docker daemon  7.517MB
2021-07-19T08:09:41.9457553Z
2021-07-19T08:09:41.9602635Z Step 1/8 : ARG BASE_BRANCH
2021-07-19T08:09:41.9604733Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-19T08:09:42.7589045Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-19T08:09:42.7598823Z b1495d80d526: Pulling fs layer
2021-07-19T08:09:42.7609297Z fb3037ce215d: Pulling fs layer
2021-07-19T08:09:42.7613951Z 95344349df1d: Pulling fs layer
2021-07-19T08:09:42.7615351Z a3e11b0fdbf6: Pulling fs layer
2021-07-19T08:09:42.7619555Z b2d0ef6cbe4f: Pulling fs layer
2021-07-19T08:09:42.7620549Z fa188fe30729: Pulling fs layer
2021-07-19T08:09:42.7621359Z 05ca4b0545ef: Pulling fs layer
2021-07-19T08:09:42.7622140Z b17ce80b21da: Pulling fs layer
2021-07-19T08:09:42.7622919Z a3e11b0fdbf6: Waiting
2021-07-19T08:09:42.7623805Z b2d0ef6cbe4f: Waiting
2021-07-19T08:09:42.7624533Z fa188fe30729: Waiting
2021-07-19T08:09:42.7625278Z 05ca4b0545ef: Waiting
2021-07-19T08:09:42.7630642Z b17ce80b21da: Waiting
2021-07-19T08:09:43.6567738Z b1495d80d526: Verifying Checksum
2021-07-19T08:09:43.6591364Z b1495d80d526: Download complete
2021-07-19T08:09:44.3478752Z 95344349df1d: Verifying Checksum
2021-07-19T08:09:44.3480088Z 95344349df1d: Download complete
2021-07-19T08:09:44.3481783Z a3e11b0fdbf6: Verifying Checksum
2021-07-19T08:09:44.3483087Z a3e11b0fdbf6: Download complete
2021-07-19T08:09:44.3483962Z b2d0ef6cbe4f: Verifying Checksum
2021-07-19T08:09:44.3484720Z b2d0ef6cbe4f: Download complete
2021-07-19T08:09:44.3485728Z 05ca4b0545ef: Verifying Checksum
2021-07-19T08:09:44.3486523Z 05ca4b0545ef: Download complete
2021-07-19T08:09:44.3487242Z fa188fe30729: Verifying Checksum
2021-07-19T08:09:44.3488063Z fa188fe30729: Download complete
2021-07-19T08:09:44.4041403Z b17ce80b21da: Verifying Checksum
2021-07-19T08:09:44.4042837Z b17ce80b21da: Download complete
2021-07-19T08:09:46.6406051Z b1495d80d526: Pull complete
2021-07-19T08:09:48.4497667Z fb3037ce215d: Verifying Checksum
2021-07-19T08:09:48.4575823Z fb3037ce215d: Download complete
2021-07-19T08:09:58.8030798Z fb3037ce215d: Pull complete
2021-07-19T08:10:00.2113158Z 95344349df1d: Pull complete
2021-07-19T08:10:00.2882405Z a3e11b0fdbf6: Pull complete
2021-07-19T08:10:00.3670402Z b2d0ef6cbe4f: Pull complete
2021-07-19T08:10:00.5408986Z fa188fe30729: Pull complete
2021-07-19T08:10:00.6129390Z 05ca4b0545ef: Pull complete
2021-07-19T08:10:00.7027702Z b17ce80b21da: Pull complete
2021-07-19T08:10:00.7078204Z Digest: sha256:29762595cdd1efd22ed179cd45188c3fef4adc232f27415f2ad4f15e621053b8
2021-07-19T08:10:00.7096097Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-19T08:10:00.7111906Z  ---> 92b726655a41
2021-07-19T08:10:00.7112332Z Step 3/8 : ARG PROJECT
2021-07-19T08:10:00.7315520Z  ---> Running in 06e9eb2b38e3
2021-07-19T08:10:01.7203900Z Removing intermediate container 06e9eb2b38e3
2021-07-19T08:10:01.7218192Z  ---> 551b0fa4568c
2021-07-19T08:10:01.7220154Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR"     DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-19T08:10:01.7505199Z  ---> Running in 3b5f70691829
2021-07-19T08:10:02.6728292Z Removing intermediate container 3b5f70691829
2021-07-19T08:10:02.6729509Z  ---> 4e71206127a6
2021-07-19T08:10:02.6730084Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-19T08:10:02.6904297Z  ---> Running in 01255435bad1
2021-07-19T08:10:03.6371295Z Removing intermediate container 01255435bad1
2021-07-19T08:10:03.6373192Z  ---> 8ff3e573ceca
2021-07-19T08:10:03.6374117Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-19T08:10:03.6581456Z  ---> Running in 74d2b942fac5
2021-07-19T08:10:05.3530599Z Removing intermediate container 74d2b942fac5
2021-07-19T08:10:05.3531801Z  ---> 569eef06627e
2021-07-19T08:10:05.3532353Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-19T08:10:05.3533098Z  ---> Running in 985a03a5d9a1
2021-07-19T08:10:05.6140459Z Removing intermediate container 985a03a5d9a1
2021-07-19T08:10:05.6144989Z  ---> 91d428287d5d
2021-07-19T08:10:05.6148725Z Step 8/8 : CMD ["sh"]
2021-07-19T08:10:05.6402040Z  ---> Running in cd572f05c852
2021-07-19T08:10:06.5970175Z Removing intermediate container cd572f05c852
2021-07-19T08:10:06.5971463Z  ---> 5b7524774389
2021-07-19T08:10:06.6103802Z Successfully built 5b7524774389
2021-07-19T08:10:06.6147008Z Successfully tagged submariner-operator:devel
2021-07-19T08:10:07.1206214Z [36m[submariner-operator]$ trap chown -R 1001:121 . exit[0m
2021-07-19T08:10:07.1207202Z [36m[submariner-operator]$ mkdir -p bin dist output[0m
2021-07-19T08:10:07.1211828Z [36m[submariner-operator]$ make --debug=b e2e[0m
2021-07-19T08:10:07.1225093Z GNU Make 4.3
2021-07-19T08:10:07.1225929Z Built for x86_64-redhat-linux-gnu
2021-07-19T08:10:07.1226775Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-19T08:10:07.1227673Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-19T08:10:07.1228559Z This is free software: you are free to change and redistribute it.
2021-07-19T08:10:07.1229340Z There is NO WARRANTY, to the extent permitted by law.
2021-07-19T08:10:07.1235600Z Reading makefiles...
2021-07-19T08:10:07.2405439Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-19T08:10:07.2406711Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-19T08:10:07.4708361Z Updating makefiles....
2021-07-19T08:10:07.4717388Z Updating goal targets....
2021-07-19T08:10:07.4718506Z  File 'e2e' does not exist.
2021-07-19T08:10:07.4719156Z      File 'clusters' does not exist.
2021-07-19T08:10:07.4719819Z     Must remake target 'clusters'.
2021-07-19T08:10:07.4721228Z /opt/shipyard/scripts/clusters.sh --k8s_version="1.17" --globalnet --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T08:10:07.4751040Z Downloading shflags 1.0.3
2021-07-19T08:10:07.4810689Z   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
2021-07-19T08:10:07.4811488Z                                  Dload  Upload   Total   Spent    Left  Speed
2021-07-19T08:10:07.4811863Z
2021-07-19T08:10:07.5253369Z   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
2021-07-19T08:10:07.5254185Z 100 31091  100 31091    0     0   690k      0 --:--:-- --:--:-- --:--:--  690k
2021-07-19T08:10:07.5981251Z Running with: k8s_version=1.17.17, olm_version=0.14.1, olm=false, globalnet=true, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-19T08:10:07.6004073Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/utils[0m
2021-07-19T08:10:07.6019105Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:10:07.6031943Z [36m[submariner-operator]$ script_name=utils[0m
2021-07-19T08:10:07.6044351Z [36m[submariner-operator]$ exec_name=clusters.sh[0m
2021-07-19T08:10:07.6063970Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings[0m
2021-07-19T08:10:07.6075617Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:10:07.6088653Z [36m[submariner-operator]$ script_name=cluster_settings[0m
2021-07-19T08:10:07.6097668Z [36m[submariner-operator]$ exec_name=clusters.sh[0m
2021-07-19T08:10:07.6120040Z [36m[submariner-operator]$ broker=cluster1[0m
2021-07-19T08:10:07.6132830Z [36m[submariner-operator]$ declare -gA cluster_nodes[0m
2021-07-19T08:10:07.6146547Z [36m[submariner-operator]$ cluster_nodes[cluster1]=control-plane worker[0m
2021-07-19T08:10:07.6160899Z [36m[submariner-operator]$ cluster_nodes[cluster2]=control-plane worker[0m
2021-07-19T08:10:07.6173854Z [36m[submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker[0m
2021-07-19T08:10:07.6186331Z [36m[submariner-operator]$ declare -gA cluster_subm[0m
2021-07-19T08:10:07.6199442Z [36m[submariner-operator]$ cluster_subm[cluster1]=true[0m
2021-07-19T08:10:07.6213115Z [36m[submariner-operator]$ cluster_subm[cluster2]=true[0m
2021-07-19T08:10:07.6227251Z [36m[submariner-operator]$ cluster_subm[cluster3]=true[0m
2021-07-19T08:10:07.6239828Z [36m[submariner-operator]$ declare -gA cluster_cni[0m
2021-07-19T08:10:07.6253148Z [36m[submariner-operator]$ cluster_cni[cluster2]=weave[0m
2021-07-19T08:10:07.6271002Z [36m[submariner-operator]$ cluster_cni[cluster3]=weave[0m
2021-07-19T08:10:07.6284688Z [36m[submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings[0m
2021-07-19T08:10:07.6297995Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:10:07.6311592Z [36m[submariner-operator]$ script_name=cluster_settings[0m
2021-07-19T08:10:07.6322375Z [36m[submariner-operator]$ exec_name=clusters.sh[0m
2021-07-19T08:10:07.6341024Z [36m[submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker[0m
2021-07-19T08:10:07.6352166Z [36m[submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker[0m
2021-07-19T08:10:07.6380742Z [36m[submariner-operator]$ cat <<EOM
2021-07-19T08:10:07.6381782Z Cluster settings::
2021-07-19T08:10:07.6382548Z   broker - ${broker@Q}
2021-07-19T08:10:07.6383115Z   clusters - ${clusters[*]@Q}
2021-07-19T08:10:07.6384004Z   cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-19T08:10:07.6384835Z   nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-19T08:10:07.6385687Z   install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-19T08:10:07.6386315Z EOM[0m
2021-07-19T08:10:07.6409953Z [36m[submariner-operator]$ typeset -p cluster_cni[0m
2021-07-19T08:10:07.6424411Z [36m[submariner-operator]$ cut -f 2- -d=[0m
2021-07-19T08:10:07.6455227Z [36m[submariner-operator]$ typeset -p cluster_nodes[0m
2021-07-19T08:10:07.6471153Z [36m[submariner-operator]$ cut -f 2- -d=[0m
2021-07-19T08:10:07.6501366Z [36m[submariner-operator]$ typeset -p cluster_subm[0m
2021-07-19T08:10:07.6517485Z [36m[submariner-operator]$ cut -f 2- -d=[0m
2021-07-19T08:10:07.6541107Z Cluster settings::
2021-07-19T08:10:07.6541885Z   broker - 'cluster1'
2021-07-19T08:10:07.6542577Z   clusters - 'cluster1' 'cluster2'
2021-07-19T08:10:07.6543337Z   cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-19T08:10:07.6544737Z   nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-19T08:10:07.6546058Z   install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-19T08:10:07.6560043Z [36m[submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs[0m
2021-07-19T08:10:07.6579651Z [36m[submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs[0m
2021-07-19T08:10:07.6606417Z [36m[submariner-operator]$ run_local_registry[0m
2021-07-19T08:10:07.6619854Z [36m[submariner-operator]$ run_local_registry[0m
2021-07-19T08:10:07.6632547Z [36m[submariner-operator]$ registry_running[0m
2021-07-19T08:10:07.6645768Z [36m[submariner-operator]$ registry_running[0m
2021-07-19T08:10:07.6658732Z [36m[submariner-operator]$ docker ps --filter name=^/?kind-registry$[0m
2021-07-19T08:10:07.6674866Z [36m[submariner-operator]$ grep kind-registry[0m
2021-07-19T08:10:07.9223052Z [36m[submariner-operator]$ return 0[0m
2021-07-19T08:10:07.9225990Z Deploying local registry kind-registry to serve images centrally.
2021-07-19T08:10:07.9238541Z [36m[submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry[0m
2021-07-19T08:10:07.9248650Z [36m[submariner-operator]$ selinuxenabled[0m
2021-07-19T08:10:07.9273477Z [36m[submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2[0m
2021-07-19T08:10:08.1864809Z Unable to find image 'registry:2' locally
2021-07-19T08:10:08.9926431Z 2: Pulling from library/registry
2021-07-19T08:10:09.2958541Z ddad3d7c1e96: Already exists
2021-07-19T08:10:09.3005388Z 6eda6749503f: Pulling fs layer
2021-07-19T08:10:09.3006056Z 363ab70c2143: Pulling fs layer
2021-07-19T08:10:09.3007184Z 5b94580856e6: Pulling fs layer
2021-07-19T08:10:09.3007628Z 12008541203a: Pulling fs layer
2021-07-19T08:10:09.3008042Z 12008541203a: Waiting
2021-07-19T08:10:09.5202362Z 5b94580856e6: Verifying Checksum
2021-07-19T08:10:09.5203153Z 5b94580856e6: Download complete
2021-07-19T08:10:09.5457760Z 6eda6749503f: Verifying Checksum
2021-07-19T08:10:09.5458357Z 6eda6749503f: Download complete
2021-07-19T08:10:09.6121548Z 363ab70c2143: Verifying Checksum
2021-07-19T08:10:09.6122163Z 363ab70c2143: Download complete
2021-07-19T08:10:09.6766237Z 6eda6749503f: Pull complete
2021-07-19T08:10:09.7441685Z 12008541203a: Verifying Checksum
2021-07-19T08:10:09.7442280Z 12008541203a: Download complete
2021-07-19T08:10:10.0083618Z 363ab70c2143: Pull complete
2021-07-19T08:10:10.0761977Z 5b94580856e6: Pull complete
2021-07-19T08:10:10.1455683Z 12008541203a: Pull complete
2021-07-19T08:10:10.1500408Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-19T08:10:10.1521097Z Status: Downloaded newer image for registry:2
2021-07-19T08:10:10.1727565Z f5dbd3fc68a3bfb45a9289e64d4cca4485556aee00e1c5f05944cf0a580fbcac
2021-07-19T08:10:10.4891993Z [36m[submariner-operator]$ docker network connect kind kind-registry[0m
2021-07-19T08:10:10.8953827Z [36m[submariner-operator]$ declare_cidrs[0m
2021-07-19T08:10:10.8968258Z [36m[submariner-operator]$ declare_cidrs[0m
2021-07-19T08:10:10.8982463Z [36m[submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs[0m
2021-07-19T08:10:10.8996960Z [36m[submariner-operator]$ i=1[0m
2021-07-19T08:10:10.9002742Z [36m[submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1[0m
2021-07-19T08:10:10.9007108Z [36m[submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1[0m
2021-07-19T08:10:10.9011805Z [36m[submariner-operator]$ [cluster1] val=0[0m
2021-07-19T08:10:10.9024026Z [36m[submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.0.0.0/16[0m
2021-07-19T08:10:10.9026033Z [36m[submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.0.0.0/16[0m
2021-07-19T08:10:10.9040361Z [36m[submariner-operator]$ [cluster1] global_CIDRs[cluster1]=242.254.1.0/24[0m
2021-07-19T08:10:10.9054825Z [36m[submariner-operator]$ [cluster1] i=$(("$i"+1))[0m
2021-07-19T08:10:10.9065736Z [36m[submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2[0m
2021-07-19T08:10:10.9077713Z [36m[submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2[0m
2021-07-19T08:10:10.9088296Z [36m[submariner-operator]$ [cluster2] val=0[0m
2021-07-19T08:10:10.9099787Z [36m[submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.0.0.0/16[0m
2021-07-19T08:10:10.9106882Z [36m[submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.0.0.0/16[0m
2021-07-19T08:10:10.9118933Z [36m[submariner-operator]$ [cluster2] global_CIDRs[cluster2]=242.254.2.0/24[0m
2021-07-19T08:10:10.9124136Z [36m[submariner-operator]$ [cluster2] i=$(("$i"+1))[0m
2021-07-19T08:10:10.9141298Z [36m[submariner-operator]$ [cluster2] wait 240[0m
2021-07-19T08:10:10.9148929Z [36m[submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster[0m
2021-07-19T08:10:10.9156975Z [36m[submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster[0m
2021-07-19T08:10:10.9168765Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster[0m
2021-07-19T08:10:10.9180193Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster[0m
2021-07-19T08:10:10.9194203Z [36m[submariner-operator]$ [cluster2] declare -A pids[0m
2021-07-19T08:10:10.9213660Z [36m[submariner-operator]$ [cluster2] eval echo cluster1 cluster2[0m
2021-07-19T08:10:10.9234688Z [36m[submariner-operator]$ [cluster1] set -o pipefail[0m
2021-07-19T08:10:10.9239551Z [36m[submariner-operator]$ [cluster1] pids[cluster1]=249[0m
2021-07-19T08:10:10.9248921Z [36m[submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster[0m
2021-07-19T08:10:10.9262570Z [36m[submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /[0m
2021-07-19T08:10:10.9267409Z [36m[submariner-operator]$ [cluster2] pids[cluster2]=253[0m
2021-07-19T08:10:10.9291443Z [36m[submariner-operator]$ [cluster2] wait 253[0m
2021-07-19T08:10:10.9298751Z [36m[submariner-operator]$ [cluster2] set -o pipefail[0m
2021-07-19T08:10:10.9313118Z [36m[submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster[0m
2021-07-19T08:10:10.9339223Z [36m[submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /[0m
2021-07-19T08:12:14.1626348Z [36m[submariner-operator]$ [cluster1] with_retries[0m
2021-07-19T08:12:14.1627260Z [36m[submariner-operator]$ [cluster1] iteration=1[0m
2021-07-19T08:12:14.1628062Z [36m[submariner-operator]$ [cluster1] wait 267[0m
2021-07-19T08:12:14.1628880Z [36m[submariner-operator]$ [cluster1] create_kind_cluster[0m
2021-07-19T08:12:14.1629723Z [36m[submariner-operator]$ [cluster1] create_kind_cluster[0m
2021-07-19T08:12:14.1631420Z [36m[submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-19T08:12:14.1633633Z [36m[submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-19T08:12:14.1635071Z [36m[submariner-operator]$ [cluster1] kind get clusters[0m
2021-07-19T08:12:14.1636081Z [36m[submariner-operator]$ [cluster1] grep -q ^cluster1$[0m
2021-07-19T08:12:14.1636658Z [cluster1] No kind clusters found.
2021-07-19T08:12:14.1637383Z [cluster1] Creating KIND cluster...
2021-07-19T08:12:14.1638247Z [36m[submariner-operator]$ [cluster1] generate_cluster_yaml[0m
2021-07-19T08:12:14.1639255Z [36m[submariner-operator]$ [cluster1] generate_cluster_yaml[0m
2021-07-19T08:12:14.1640212Z [36m[submariner-operator]$ [cluster1] disable_cni=true[0m
2021-07-19T08:12:14.1641106Z [36m[submariner-operator]$ [cluster1] nodes=
2021-07-19T08:12:14.1641891Z [cluster1] - role: control-plane[0m
2021-07-19T08:12:14.1642671Z [36m[submariner-operator]$ [cluster1] nodes=
2021-07-19T08:12:14.1643435Z [cluster1] - role: control-plane
2021-07-19T08:12:14.1644072Z [cluster1] - role: worker[0m
2021-07-19T08:12:14.1644811Z [36m[submariner-operator]$ [cluster1] nodes=
2021-07-19T08:12:14.1646140Z [cluster1] - role: control-plane
2021-07-19T08:12:14.1646785Z [cluster1] - role: worker
2021-07-19T08:12:14.1647372Z [cluster1] - role: worker[0m
2021-07-19T08:12:14.1647933Z [cluster1] [36m[0m
2021-07-19T08:12:14.1648435Z [cluster1] [36m[0m
2021-07-19T08:12:14.1649319Z [36m[submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""[0m
2021-07-19T08:12:14.1650263Z [36m[submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml[0m
2021-07-19T08:12:14.1651496Z [36m[submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.17.17[0m
2021-07-19T08:12:14.1652265Z [36m[submariner-operator]$ [cluster1] kind version[0m
2021-07-19T08:12:14.1652752Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-19T08:12:14.1653582Z [36m[submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml[0m
2021-07-19T08:12:14.1654263Z [cluster1] ---
2021-07-19T08:12:14.1654601Z [cluster1] kind: Cluster
2021-07-19T08:12:14.1655302Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-19T08:12:14.1655821Z [cluster1] networking:
2021-07-19T08:12:14.1656319Z [cluster1]   disableDefaultCNI: true
2021-07-19T08:12:14.1657193Z [cluster1]   podSubnet: 10.0.0.0/16
2021-07-19T08:12:14.1657769Z [cluster1]   serviceSubnet: 100.0.0.0/16
2021-07-19T08:12:14.1658461Z [cluster1] containerdConfigPatches:
2021-07-19T08:12:14.1659208Z [cluster1]   - |-
2021-07-19T08:12:14.1660058Z [cluster1]     [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-19T08:12:14.1661318Z [cluster1]       endpoint = ["http://kind-registry:5000"]
2021-07-19T08:12:14.1662123Z [cluster1] kubeadmConfigPatches:
2021-07-19T08:12:14.1662822Z [cluster1]   - |
2021-07-19T08:12:14.1663400Z [cluster1]     apiVersion: kubeadm.k8s.io/v1beta2
2021-07-19T08:12:14.1664145Z [cluster1]     kind: ClusterConfiguration
2021-07-19T08:12:14.1664904Z [cluster1]     metadata:
2021-07-19T08:12:14.1665390Z [cluster1]       name: config
2021-07-19T08:12:14.1665901Z [cluster1]     networking:
2021-07-19T08:12:14.1666416Z [cluster1]       podSubnet: 10.0.0.0/16
2021-07-19T08:12:14.1666998Z [cluster1]       serviceSubnet: 100.0.0.0/16
2021-07-19T08:12:14.1667621Z [cluster1]       dnsDomain: cluster1.local
2021-07-19T08:12:14.1668184Z [cluster1] nodes:
2021-07-19T08:12:14.1668946Z [cluster1] - role: control-plane
2021-07-19T08:12:14.1669588Z [cluster1] - role: worker
2021-07-19T08:12:14.1670168Z [cluster1] - role: worker
2021-07-19T08:12:14.1671530Z [36m[submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.17.17 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml[0m
2021-07-19T08:12:14.1672778Z [cluster1] Creating cluster "cluster1" ...
2021-07-19T08:12:14.1674470Z [cluster1]  • Ensuring node image (kindest/node:v1.17.17) 🖼  ...
2021-07-19T08:12:14.1675660Z [cluster1]  ✓ Ensuring node image (kindest/node:v1.17.17) 🖼
2021-07-19T08:12:14.1676250Z [cluster1]  • Preparing nodes 📦 📦 📦   ...
2021-07-19T08:12:14.1676777Z [cluster1]  ✓ Preparing nodes 📦 📦 📦
2021-07-19T08:12:14.1677564Z [cluster1]  • Writing configuration 📜  ...
2021-07-19T08:12:14.1678297Z [cluster1]  ✓ Writing configuration 📜
2021-07-19T08:12:14.1679043Z [cluster1]  • Starting control-plane 🕹️  ...
2021-07-19T08:12:14.1679804Z [cluster1]  ✓ Starting control-plane 🕹️
2021-07-19T08:12:14.1680551Z [cluster1]  • Installing StorageClass 💾  ...
2021-07-19T08:12:14.1681514Z [cluster1]  ✓ Installing StorageClass 💾
2021-07-19T08:12:14.1682555Z [cluster1]  • Joining worker nodes 🚜  ...
2021-07-19T08:12:14.1683282Z [cluster1]  ✓ Joining worker nodes 🚜
2021-07-19T08:12:14.1684110Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-19T08:12:14.1684788Z [cluster1] You can now use your cluster with:
2021-07-19T08:12:14.1686861Z [cluster1]
2021-07-19T08:12:14.1687821Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-19T08:12:14.1688481Z [cluster1]
2021-07-19T08:12:14.1689252Z [cluster1] Thanks for using kind! 😊
2021-07-19T08:12:14.1690444Z [36m[submariner-operator]$ [cluster1] kind_fixup_config[0m
2021-07-19T08:12:14.1691451Z [36m[submariner-operator]$ [cluster1] kind_fixup_config[0m
2021-07-19T08:12:14.1693277Z [36m[submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane[0m
2021-07-19T08:12:14.1694651Z [36m[submariner-operator]$ [cluster1] head -n 1[0m
2021-07-19T08:12:14.1903270Z [36m[submariner-operator]$ [cluster1] sed -i -- s/server: .*/serve[36m[submariner-operator]$ [cluster2] with_retries[0m
2021-07-19T08:12:14.1904686Z [36m[submariner-operator]$ [cluster2] iteration=1[0m
2021-07-19T08:12:14.1905478Z [36m[submariner-operator]$ [cluster2] wait 273[0m
2021-07-19T08:12:14.1906271Z [36m[submariner-operator]$ [cluster2] create_kind_cluster[0m
2021-07-19T08:12:14.1907138Z [36m[submariner-operator]$ [cluster2] create_kind_cluster[0m
2021-07-19T08:12:14.1908495Z [36m[submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-19T08:12:14.1910216Z [36m[submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-19T08:12:14.1911435Z [36m[submariner-operator]$ [cluster2] kind get clusters[0m
2021-07-19T08:12:14.1912391Z [36m[submariner-operator]$ [cluster2] grep -q ^cluster2$[0m
2021-07-19T08:12:14.1913199Z [cluster2] No kind clusters found.
2021-07-19T08:12:14.1913741Z [cluster2] Creating KIND cluster...
2021-07-19T08:12:14.1914630Z [36m[submariner-operator]$ [cluster2] generate_cluster_yaml[0m
2021-07-19T08:12:14.1915759Z [36m[submariner-operator]$ [cluster2] generate_cluster_yaml[0m
2021-07-19T08:12:14.1916731Z [36m[submariner-operator]$ [cluster2] disable_cni=true[0m
2021-07-19T08:12:14.1917606Z [36m[submariner-operator]$ [cluster2] nodes=
2021-07-19T08:12:14.1918395Z [cluster2] - role: control-plane[0m
2021-07-19T08:12:14.1919191Z [36m[submariner-operator]$ [cluster2] nodes=
2021-07-19T08:12:14.1919943Z [cluster2] - role: control-plane
2021-07-19T08:12:14.1920592Z [cluster2] - role: worker[0m
2021-07-19T08:12:14.1921503Z [36m[submariner-operator]$ [cluster2] nodes=
2021-07-19T08:12:14.1922323Z [cluster2] - role: control-plane
2021-07-19T08:12:14.1923085Z [cluster2] - role: worker
2021-07-19T08:12:14.1923683Z [cluster2] - role: worker[0m
2021-07-19T08:12:14.1924224Z [cluster2] [36m[0m
2021-07-19T08:12:14.1924750Z [cluster2] [36m[0m
2021-07-19T08:12:14.1926062Z [36m[submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""[0m
2021-07-19T08:12:14.1927323Z [36m[submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml[0m
2021-07-19T08:12:14.1928634Z [36m[submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.17.17[0m
2021-07-19T08:12:14.1929771Z [36m[submariner-operator]$ [cluster2] kind version[0m
2021-07-19T08:12:14.1930434Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-19T08:12:14.1931520Z [36m[submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml[0m
2021-07-19T08:12:14.1932441Z [cluster2] ---
2021-07-19T08:12:14.1932861Z [cluster2] kind: Cluster
2021-07-19T08:12:14.1933584Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-19T08:12:14.1934152Z [cluster2] networking:
2021-07-19T08:12:14.1934718Z [cluster2]   disableDefaultCNI: true
2021-07-19T08:12:14.1935277Z [cluster2]   podSubnet: 10.0.0.0/16
2021-07-19T08:12:14.1935813Z [cluster2]   serviceSubnet: 100.0.0.0/16
2021-07-19T08:12:14.1936473Z [cluster2] containerdConfigPatches:
2021-07-19T08:12:14.1937155Z [cluster2]   - |-
2021-07-19T08:12:14.1937953Z [cluster2]     [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-19T08:12:14.1939104Z [cluster2]       endpoint = ["http://kind-registry:5000"]
2021-07-19T08:12:14.1939852Z [cluster2] kubeadmConfigPatches:
2021-07-19T08:12:14.1940508Z [cluster2]   - |
2021-07-19T08:12:14.1941057Z [cluster2]     apiVersion: kubeadm.k8s.io/v1beta2
2021-07-19T08:12:14.1941740Z [cluster2]     kind: ClusterConfiguration
2021-07-19T08:12:14.1942309Z [cluster2]     metadata:
2021-07-19T08:12:14.1942757Z [cluster2]       name: config
2021-07-19T08:12:14.1943234Z [cluster2]     networking:
2021-07-19T08:12:14.1943733Z [cluster2]       podSubnet: 10.0.0.0/16
2021-07-19T08:12:14.1944255Z [cluster2]       serviceSubnet: 100.0.0.0/16
2021-07-19T08:12:14.1944847Z [cluster2]       dnsDomain: cluster2.local
2021-07-19T08:12:14.1945439Z [cluster2] nodes:
2021-07-19T08:12:14.1946242Z [cluster2] - role: control-plane
2021-07-19T08:12:14.1946869Z [cluster2] - role: worker
2021-07-19T08:12:14.1947455Z [cluster2] - role: worker
2021-07-19T08:12:14.1948804Z [36m[submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.17.17 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml[0m
2021-07-19T08:12:14.1949965Z [cluster2] Creating cluster "cluster2" ...
2021-07-19T08:12:14.1950810Z [cluster2]  • Ensuring node image (kindest/node:v1.17.17) 🖼  ...
2021-07-19T08:12:14.1951661Z [cluster2]  ✓ Ensuring node image (kindest/node:v1.17.17) 🖼
2021-07-19T08:12:14.1952424Z [cluster2]  • Preparing nodes 📦 📦 📦   ...
2021-07-19T08:12:14.1953103Z [cluster2]  ✓ Preparing nodes 📦 📦 📦
2021-07-19T08:12:14.1953818Z [cluster2]  • Writing configuration 📜  ...
2021-07-19T08:12:14.1954539Z [cluster2]  ✓ Writing configuration 📜
2021-07-19T08:12:14.1955299Z [cluster2]  • Starting control-plane 🕹️  ...
2021-07-19T08:12:14.1956058Z [cluster2]  ✓ Starting control-plane 🕹️
2021-07-19T08:12:14.1956829Z [cluster2]  • Installing StorageClass 💾  ...
2021-07-19T08:12:14.1957575Z [cluster2]  ✓ Installing StorageClass 💾
2021-07-19T08:12:14.1967147Z [cluster2]  • Joining worker nodes 🚜  ...
2021-07-19T08:12:14.1967902Z [cluster2]  ✓ Joining worker nodes 🚜
2021-07-19T08:12:14.1968866Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-19T08:12:14.1969592Z [cluster2] You can now use your cluster with:
2021-07-19T08:12:14.1970101Z [cluster2]
2021-07-19T08:12:14.1970888Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-19T08:12:14.1971499Z [cluster2]
2021-07-19T08:12:14.1972555Z [cluster2] Not sure what to do next? 😅  Check out https://kind.sigs.k8s.io/docs/user/quick-start/
2021-07-19T08:12:14.1973768Z [36m[submariner-operator]$ [cluster2] kind_fixup_config[0m
2021-07-19T08:12:14.1974787Z [36m[submariner-operator]$ [cluster2] kind_fixup_config[0m
2021-07-19T08:12:14.1976396Z [36m[submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane[0m
2021-07-19T08:12:14.1977757Z [36m[submariner-operator]$ [cluster2] head -n 1[0m
2021-07-19T08:12:44.8046989Z [36m[submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-19T08:12:44.8049864Z [36m[submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-19T08:12:44.8052382Z [36m[submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-19T08:12:44.8054777Z [36m[submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-19T08:12:44.8057195Z [36m[submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-19T08:12:44.8059399Z [36m[submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-19T08:12:44.8060677Z [36m[submariner-operator]$ [cluster2] deploy_cluster_capabilities[0m
2021-07-19T08:12:44.8061809Z [36m[submariner-operator]$ [cluster2] wait 1587[0m
2021-07-19T08:12:44.8064083Z [36m[submariner-operator]$ [cluster2] deploy_cluster_capabilities[0m
2021-07-19T08:12:44.8065191Z [36m[submariner-operator]$ [cluster2] deploy_cni[0m
2021-07-19T08:12:44.8066091Z [36m[submariner-operator]$ [cluster2] deploy_cni[0m
2021-07-19T08:12:44.8067024Z [36m[submariner-operator]$ [cluster2] eval deploy_weave_cni[0m
2021-07-19T08:12:44.8068185Z [36m[submariner-operator]$ [cluster2] deploy_weave_cni[0m
2021-07-19T08:12:44.8069119Z [36m[submariner-operator]$ [cluster2] deploy_weave_cni[0m
2021-07-19T08:12:44.8069973Z [cluster2] Applying weave network...
2021-07-19T08:12:44.8071316Z [36m[submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.0.0.0/16[0m
2021-07-19T08:12:44.8073196Z [36m[submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.0.0.0/16[0m
2021-07-19T08:12:44.8074955Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.0.0.0/16[0m
2021-07-19T08:12:44.8076146Z [cluster2] serviceaccount/weave-net created
2021-07-19T08:12:44.8077178Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-19T08:12:44.8079079Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-19T08:12:44.8080578Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-19T08:12:44.8081924Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-19T08:12:44.8083052Z [cluster2] daemonset.apps/weave-net created
2021-07-19T08:12:44.8083890Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-19T08:12:44.8085400Z [36m[submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m[0m
2021-07-19T08:12:44.8086940Z [36m[submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m[0m
2021-07-19T08:12:44.8088563Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m[0m
2021-07-19T08:12:44.8089809Z [cluster2] pod/weave-net-dslwg condition met
2021-07-19T08:12:44.8090643Z [cluster2] pod/weave-net-ncmj8 condition met
2021-07-19T08:12:44.8091469Z [cluster2] pod/weave-net-pnsvl condition met
2021-07-19T08:12:44.8092334Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-19T08:12:44.8093481Z [36m[submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m[0m
2021-07-19T08:12:44.8094852Z [36m[submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m[0m
2021-07-19T08:12:44.8096532Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m[0m
2021-07-19T08:12:44.8097752Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-19T08:12:44.8098650Z [cluster2] deployment "coredns" successfully rolled out
2021-07-19T08:12:44.8099548Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-19T08:12:44.8101173Z [36m[submariner-operator]$ [cluster2] wait 249[0m
2021-07-19T08:12:50.7109220Z r: https:\/\/172.18.0.6:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-19T08:12:50.7111023Z [36m[submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-19T08:12:50.7124285Z [36m[submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-19T08:12:50.7127275Z [36m[submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-19T08:12:50.7130036Z [36m[submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-19T08:12:50.7132584Z [36m[submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-19T08:12:50.7134313Z [36m[submariner-operator]$ [cluster1] wait 1567[0m
2021-07-19T08:12:50.7135392Z [36m[submariner-operator]$ [cluster1] deploy_cluster_capabilities[0m
2021-07-19T08:12:50.7136571Z [36m[submariner-operator]$ [cluster1] deploy_cluster_capabilities[0m
2021-07-19T08:12:50.7137629Z [36m[submariner-operator]$ [cluster1] deploy_cni[0m
2021-07-19T08:12:50.7138690Z [36m[submariner-operator]$ [cluster1] deploy_cni[0m
2021-07-19T08:12:50.7139628Z [36m[submariner-operator]$ [cluster1] eval deploy_weave_cni[0m
2021-07-19T08:12:50.7140599Z [36m[submariner-operator]$ [cluster1] deploy_weave_cni[0m
2021-07-19T08:12:50.7141533Z [36m[submariner-operator]$ [cluster1] deploy_weave_cni[0m
2021-07-19T08:12:50.7142235Z [cluster1] Applying weave network...
2021-07-19T08:12:50.7143571Z [36m[submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.0.0.0/16[0m
2021-07-19T08:12:50.7145382Z [36m[submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.0.0.0/16[0m
2021-07-19T08:12:50.7147291Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.0.0.0/16[0m
2021-07-19T08:12:50.7148655Z [cluster1] serviceaccount/weave-net created
2021-07-19T08:12:50.7149867Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-19T08:12:50.7151270Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-19T08:12:50.7152565Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-19T08:12:50.7153722Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-19T08:12:50.7154711Z [cluster1] daemonset.apps/weave-net created
2021-07-19T08:12:50.7155447Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-19T08:12:50.7156506Z [36m[submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m[0m
2021-07-19T08:12:50.7157938Z [36m[submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m[0m
2021-07-19T08:12:50.7159511Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m[0m
2021-07-19T08:12:50.7160611Z [cluster1] pod/weave-net-gq7xq condition met
2021-07-19T08:12:50.7161341Z [cluster1] pod/weave-net-tsw4g condition met
2021-07-19T08:12:50.7162052Z [cluster1] pod/weave-net-zqzwg condition met
2021-07-19T08:12:50.7187923Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-19T08:12:50.7196557Z [36m[submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m[0m
2021-07-19T08:12:50.7197976Z [36m[submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m[0m
2021-07-19T08:12:50.7199760Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m[0m
2021-07-19T08:12:50.7201075Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-19T08:12:50.7202209Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-19T08:12:50.7203162Z [cluster1] deployment "coredns" successfully rolled out
2021-07-19T08:12:50.7204137Z [36m[submariner-operator]$ [cluster1] return 0[0m
2021-07-19T08:12:50.7205729Z [36m[submariner-operator]$ [cluster2] print_clusters_message[0m
2021-07-19T08:12:50.7206862Z [36m[submariner-operator]$ [cluster2] print_clusters_message[0m
2021-07-19T08:12:50.7226377Z [36m[submariner-operator]$ [cluster2] cat <<EOM
2021-07-19T08:12:50.7227412Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-19T08:12:50.7228090Z
2021-07-19T08:12:50.7228999Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-19T08:12:50.7229603Z
2021-07-19T08:12:50.7230317Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-19T08:12:50.7230779Z
2021-07-19T08:12:50.7231420Z To clean everthing up, just run: make clean-clusters
2021-07-19T08:12:50.7246160Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-19T08:12:50.7246746Z
2021-07-19T08:12:50.7247979Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-19T08:12:50.7248594Z
2021-07-19T08:12:50.7249319Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-19T08:12:50.7249769Z
2021-07-19T08:12:50.7250424Z To clean everthing up, just run: make clean-clusters
2021-07-19T08:12:50.7251039Z EOM[0m
2021-07-19T08:12:50.7251674Z     Successfully remade target file 'clusters'.
2021-07-19T08:12:50.7259117Z      File 'preload-images' does not exist.
2021-07-19T08:12:50.7259800Z        File 'images' does not exist.
2021-07-19T08:12:50.7272441Z          File 'package/.image.submariner-operator' does not exist.
2021-07-19T08:12:50.7448912Z find: 'bin/submariner-operator': No such file or directory
2021-07-19T08:12:51.0595957Z              File 'bin/submariner-operator' does not exist.
2021-07-19T08:12:51.0596948Z                File 'vendor/modules.txt' does not exist.
2021-07-19T08:12:51.0597718Z               Must remake target 'vendor/modules.txt'.
2021-07-19T08:12:51.0598235Z go mod download
2021-07-19T08:13:49.3128949Z go mod vendor
2021-07-19T08:13:51.2054004Z go mod tidy
2021-07-19T08:13:51.8712209Z               Successfully remade target file 'vendor/modules.txt'.
2021-07-19T08:13:51.8714993Z                File 'generate-embeddedyamls' does not exist.
2021-07-19T08:13:51.8715762Z                  File 'generate' does not exist.
2021-07-19T08:13:51.8716741Z                    File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-19T08:13:51.8717965Z                   Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-19T08:13:51.8719351Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-19T08:13:51.8754126Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-19T08:14:11.6160039Z                   Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-19T08:14:11.6161307Z                 Must remake target 'generate'.
2021-07-19T08:14:11.6217085Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-19T08:14:23.9243781Z                 Successfully remade target file 'generate'.
2021-07-19T08:14:23.9245322Z                  File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-19T08:14:23.9250417Z                    File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-19T08:14:23.9253496Z                   Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-19T08:14:23.9255940Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-19T08:14:26.0754451Z                   Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-19T08:14:26.0763692Z                    File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-19T08:14:26.0765374Z                   Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-19T08:14:26.0767338Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-19T08:14:27.4433458Z                   Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-19T08:14:27.4542993Z                 Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-19T08:14:27.4543986Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-19T08:14:28.1809774Z Generating yamls.go
2021-07-19T08:14:28.1810571Z deploy/crds/submariner.io_brokers.yaml
2021-07-19T08:14:28.1813420Z deploy/crds/submariner.io_submariners.yaml
2021-07-19T08:14:28.1839481Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-19T08:14:28.1844727Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-19T08:14:28.1848227Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-19T08:14:28.1851303Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-19T08:14:28.1852369Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-19T08:14:28.1856361Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-19T08:14:28.1863755Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-19T08:14:28.1867424Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-19T08:14:28.1874249Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-19T08:14:28.1882752Z config/broker/broker-admin/service_account.yaml
2021-07-19T08:14:28.1886832Z config/broker/broker-admin/role.yaml
2021-07-19T08:14:28.1890161Z config/broker/broker-admin/role_binding.yaml
2021-07-19T08:14:28.1893158Z config/broker/broker-client/service_account.yaml
2021-07-19T08:14:28.1896828Z config/broker/broker-client/role.yaml
2021-07-19T08:14:28.1900575Z config/broker/broker-client/role_binding.yaml
2021-07-19T08:14:28.1906119Z config/rbac/submariner-operator/service_account.yaml
2021-07-19T08:14:28.1907448Z config/rbac/submariner-operator/role.yaml
2021-07-19T08:14:28.1911404Z config/rbac/submariner-operator/role_binding.yaml
2021-07-19T08:14:28.1914418Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-19T08:14:28.1917764Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-19T08:14:28.1922979Z config/rbac/submariner-gateway/service_account.yaml
2021-07-19T08:14:28.1924136Z config/rbac/submariner-gateway/role.yaml
2021-07-19T08:14:28.1930900Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-19T08:14:28.1932845Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-19T08:14:28.1933960Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-19T08:14:28.1936208Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-19T08:14:28.1939585Z config/rbac/submariner-route-agent/role.yaml
2021-07-19T08:14:28.1943443Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-19T08:14:28.1946008Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-19T08:14:28.1949452Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-19T08:14:28.1951990Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-19T08:14:28.1954254Z config/rbac/submariner-globalnet/role.yaml
2021-07-19T08:14:28.1957661Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-19T08:14:28.1960219Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-19T08:14:28.1964324Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-19T08:14:28.1967220Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-19T08:14:28.1972572Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-19T08:14:28.1975251Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-19T08:14:28.1977779Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-19T08:14:28.1980228Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-19T08:14:28.1997333Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-19T08:14:28.1998173Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-19T08:14:28.1999062Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-19T08:14:28.1999850Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-19T08:14:28.2004277Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-19T08:14:28.2006030Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-19T08:14:28.2033031Z                 Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-19T08:14:28.2034156Z               Must remake target 'generate-embeddedyamls'.
2021-07-19T08:14:28.2035473Z               Successfully remade target file 'generate-embeddedyamls'.
2021-07-19T08:14:28.2036697Z             Must remake target 'bin/submariner-operator'.
2021-07-19T08:14:28.2037365Z /opt/shipyard/scripts/compile.sh \
2021-07-19T08:14:28.2038472Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d" \
2021-07-19T08:14:28.2039579Z bin/submariner-operator main.go
2021-07-19T08:14:28.2652997Z [36m[submariner-operator]$ mkdir -p bin[0m
2021-07-19T08:14:28.2668590Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d')
2021-07-19T08:14:28.2679038Z [36m[submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d[0m
2021-07-19T08:14:28.2691780Z [36m[submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -o bin/submariner-operator main.go[0m
2021-07-19T08:16:00.9542954Z [36m[submariner-operator]$ upx bin/submariner-operator[0m
2021-07-19T08:16:06.5103680Z                        Ultimate Packer for eXecutables
2021-07-19T08:16:06.5105545Z                           Copyright (C) 1996 - 2020
2021-07-19T08:16:06.5106808Z UPX 3.96        Markus Oberhumer, Laszlo Molnar & John Reiser   Jan 23rd 2020
2021-07-19T08:16:06.5107322Z
2021-07-19T08:16:06.5107763Z         File size         Ratio      Format      Name
2021-07-19T08:16:06.5109020Z    --------------------   ------   -----------   -----------
2021-07-19T08:16:06.5109909Z   34459648 ->   9933112   28.83%   linux/amd64   submariner-operator
2021-07-19T08:16:06.5110364Z
2021-07-19T08:16:06.5110744Z Packed 1 file.
2021-07-19T08:16:06.5119725Z             Successfully remade target file 'bin/submariner-operator'.
2021-07-19T08:16:06.5122154Z            Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-19T08:16:06.5123977Z           Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-19T08:16:06.5125798Z           Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-19T08:16:06.5127076Z            File 'FORCE_IMAGE' does not exist.
2021-07-19T08:16:06.5127949Z           Must remake target 'FORCE_IMAGE'.
2021-07-19T08:16:06.5128940Z           Successfully remade target file 'FORCE_IMAGE'.
2021-07-19T08:16:06.5130108Z         Must remake target 'package/.image.submariner-operator'.
2021-07-19T08:16:06.5132335Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator
2021-07-19T08:16:06.5622097Z flags:WARN flag short name (h) already defined
2021-07-19T08:16:06.6195680Z [36m[submariner-operator]$ set -e[0m
2021-07-19T08:16:06.6211195Z [36m[submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel[0m
2021-07-19T08:16:06.6221964Z [36m[submariner-operator]$ cache_flag=[0m
2021-07-19T08:16:06.6234310Z [36m[submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel[0m
2021-07-19T08:16:06.6253076Z [36m[submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel[0m
2021-07-19T08:16:06.9098768Z [36m[submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel[0m
2021-07-19T08:16:08.0067228Z devel: Pulling from submariner/submariner-operator
2021-07-19T08:16:08.0068708Z 9aabc6bb514c: Pulling fs layer
2021-07-19T08:16:08.7514868Z 9aabc6bb514c: Verifying Checksum
2021-07-19T08:16:08.7515599Z 9aabc6bb514c: Download complete
2021-07-19T08:16:09.1380728Z 9aabc6bb514c: Pull complete
2021-07-19T08:16:09.1423717Z Digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b
2021-07-19T08:16:09.1442628Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-19T08:16:09.1478215Z quay.io/submariner/submariner-operator:devel
2021-07-19T08:16:09.1513480Z [36m[submariner-operator]$ grep FROM package/Dockerfile.submariner-operator[0m
2021-07-19T08:16:09.1523851Z [36m[submariner-operator]$ cut -f2 -d [0m
2021-07-19T08:16:09.1526155Z [36m[submariner-operator]$ grep -v scratch[0m
2021-07-19T08:16:09.1545513Z [36m[submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel[0m
2021-07-19T08:16:09.1557231Z [36m[0m
2021-07-19T08:16:09.9945799Z [36m[submariner-operator]$ docker buildx use buildx_builder[0m
2021-07-19T08:16:10.8203328Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-19T08:16:10.8277362Z [36m[submariner-operator]$ docker buildx create --name buildx_builder --use[0m
2021-07-19T08:16:11.6843620Z buildx_builder
2021-07-19T08:16:11.6917887Z [36m[submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .[0m
2021-07-19T08:16:12.5234081Z #1 [internal] booting buildkit
2021-07-19T08:16:12.5235547Z #1 sha256:1813ca6ab923ab9a734ae573d1b88b7acd44a2fdee878ea68f7c47c29e953317
2021-07-19T08:16:12.6735086Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-19T08:16:16.9852965Z #1 pulling image moby/buildkit:buildx-stable-1 4.5s done
2021-07-19T08:16:17.1361603Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-19T08:16:17.5878108Z #1 creating container buildx_buildkit_buildx_builder0 0.5s done
2021-07-19T08:16:17.5878902Z #1 DONE 5.0s
2021-07-19T08:16:17.8881421Z
2021-07-19T08:16:17.8883553Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-19T08:16:17.8885363Z #2 sha256:1d876370b2aa137a778a334a7e939a44c7b0faca3030f8447bf2fdbdf725e9e9
2021-07-19T08:16:17.8886661Z #2 transferring dockerfile: 230B done
2021-07-19T08:16:17.8887287Z #2 DONE 0.0s
2021-07-19T08:16:17.8887672Z
2021-07-19T08:16:17.8888146Z #3 [internal] load .dockerignore
2021-07-19T08:16:17.8889227Z #3 sha256:018df0553f3638139a1cf460ab12aef6c90d6f9ec5fe76556370063b58d72c35
2021-07-19T08:16:17.8890335Z #3 transferring context: 2B done
2021-07-19T08:16:17.8890855Z #3 DONE 0.0s
2021-07-19T08:16:17.8891080Z
2021-07-19T08:16:17.8891585Z #4 [internal] load build context
2021-07-19T08:16:17.8892753Z #4 sha256:11056989810caa0a233d55fb495d51b6653a2260efa51f9d1eec0181a3f782a9
2021-07-19T08:16:17.8893604Z #4 DONE 0.0s
2021-07-19T08:16:17.8893898Z
2021-07-19T08:16:17.8894911Z #6 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-19T08:16:17.8896415Z #6 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-19T08:16:18.5921444Z #6 DONE 0.8s
2021-07-19T08:16:18.7003225Z
2021-07-19T08:16:18.7004157Z #4 [internal] load build context
2021-07-19T08:16:18.7005439Z #4 sha256:11056989810caa0a233d55fb495d51b6653a2260efa51f9d1eec0181a3f782a9
2021-07-19T08:16:18.9505943Z #4 transferring context: 9.94MB 0.2s done
2021-07-19T08:16:18.9506528Z #4 DONE 0.2s
2021-07-19T08:16:18.9509171Z
2021-07-19T08:16:18.9510989Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-19T08:16:18.9512171Z #5 sha256:1b78d5cfb2f81086820f7ceb05b8b48a52512b689760fd73e4cab5ceaaef22b7
2021-07-19T08:16:18.9513041Z #5 CACHED
2021-07-19T08:16:18.9513282Z
2021-07-19T08:16:18.9513676Z #7 exporting to oci image format
2021-07-19T08:16:18.9514953Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-19T08:16:18.9515917Z #7 exporting layers done
2021-07-19T08:16:18.9517027Z #7 exporting manifest sha256:de9bbdc497e579259a39507af2f25bbb63c3b0a7ac43576fa382f07e1dd99e1f done
2021-07-19T08:16:18.9518729Z #7 exporting config sha256:2d7e862e7c9a7cf6d0fff86d715882397631fcc6b1ba617b2d8a8d78322e83b7 done
2021-07-19T08:16:19.1015259Z #7 ...
2021-07-19T08:16:19.1015615Z
2021-07-19T08:16:19.1017057Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-19T08:16:19.1018363Z #5 sha256:1b78d5cfb2f81086820f7ceb05b8b48a52512b689760fd73e4cab5ceaaef22b7
2021-07-19T08:16:19.1023304Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 0B / 9.62MB 0.2s
2021-07-19T08:16:19.1024424Z #5 CACHED
2021-07-19T08:16:19.2519082Z
2021-07-19T08:16:19.2522180Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-19T08:16:19.2523472Z #5 sha256:1b78d5cfb2f81086820f7ceb05b8b48a52512b689760fd73e4cab5ceaaef22b7
2021-07-19T08:16:19.2535674Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 9.62MB / 9.62MB 0.3s done
2021-07-19T08:16:19.2536832Z #5 CACHED
2021-07-19T08:16:19.2537077Z
2021-07-19T08:16:19.2537669Z #7 exporting to oci image format
2021-07-19T08:16:19.2538650Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-19T08:16:19.2539587Z #7 sending tarball
2021-07-19T08:16:19.4271960Z #7 sending tarball 0.2s done
2021-07-19T08:16:19.4275067Z #7 DONE 0.6s
2021-07-19T08:16:19.4275449Z
2021-07-19T08:16:19.4275859Z #9 exporting cache
2021-07-19T08:16:19.4276821Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-19T08:16:19.4278006Z #9 preparing build cache for export done
2021-07-19T08:16:19.4278697Z #9 DONE 0.0s
2021-07-19T08:16:19.4282407Z
2021-07-19T08:16:19.4283067Z #8 importing to docker
2021-07-19T08:16:19.4284174Z #8 sha256:d2b156abd293e457ce65afc26c89d1ae4cd7e229fbc30a9f8ef16181030a2fbb
2021-07-19T08:16:19.4285728Z #8 DONE 0.0s
2021-07-19T08:16:19.4459103Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel[0m
2021-07-19T08:16:19.7280136Z         Successfully remade target file 'package/.image.submariner-operator'.
2021-07-19T08:16:19.7281268Z          File 'build' does not exist.
2021-07-19T08:16:19.7281986Z            File 'bin/subctl' does not exist.
2021-07-19T08:16:19.7283322Z              File 'bin/subctl-devel-0105e4d-linux-amd64' does not exist.
2021-07-19T08:16:19.7512235Z             Must remake target 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-19T08:16:19.7513143Z mkdir -p bin
2021-07-19T08:16:19.7536052Z target=bin/subctl-devel-0105e4d-linux-amd64; \
2021-07-19T08:16:19.7536723Z target=${target%.exe}; \
2021-07-19T08:16:19.7537276Z components=($(echo ${target//-/ })); \
2021-07-19T08:16:19.7537827Z GOOS=${components[-2]}; \
2021-07-19T08:16:19.7538334Z GOARCH=${components[-1]}; \
2021-07-19T08:16:19.7538737Z export GOARCH GOOS; \
2021-07-19T08:16:19.7539195Z /opt/shipyard/scripts/compile.sh \
2021-07-19T08:16:19.7540176Z 	--ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \
2021-07-19T08:16:19.7541924Z 		   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-19T08:16:19.7543442Z 	--noupx bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-19T08:16:19.8089041Z [36m[submariner-operator]$ mkdir -p bin[0m
2021-07-19T08:16:19.8104789Z Building 'bin/subctl-devel-0105e4d-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \t\t   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-19T08:16:19.8115985Z [36m[submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d 		   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel[0m
2021-07-19T08:16:19.8134798Z [36m[submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d 		   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go[0m
2021-07-19T08:16:54.4367700Z             Successfully remade target file 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-19T08:16:54.4368614Z           Must remake target 'bin/subctl'.
2021-07-19T08:16:54.4369391Z ln -sf subctl-devel-0105e4d-linux-amd64 bin/subctl
2021-07-19T08:16:54.4410934Z           Successfully remade target file 'bin/subctl'.
2021-07-19T08:16:54.4411792Z         Must remake target 'build'.
2021-07-19T08:16:54.4412524Z         Successfully remade target file 'build'.
2021-07-19T08:16:54.4413211Z       Must remake target 'images'.
2021-07-19T08:16:54.4413931Z       Successfully remade target file 'images'.
2021-07-19T08:16:54.4414730Z     Must remake target 'preload-images'.
2021-07-19T08:16:54.4415331Z set -e;\
2021-07-19T08:16:54.4415807Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-19T08:16:54.4416427Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-19T08:16:54.4417971Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns submariner-globalnet; do\
2021-07-19T08:16:54.4419267Z 	import_image quay.io/submariner/${image};\
2021-07-19T08:16:54.4419751Z done
2021-07-19T08:16:54.4456482Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-operator[0m
2021-07-19T08:16:54.4465049Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-operator[0m
2021-07-19T08:16:54.4480124Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local[0m
2021-07-19T08:16:54.7062475Z [36m[submariner-operator]$ docker push localhost:5000/submariner-operator:local[0m
2021-07-19T08:16:54.9826129Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-19T08:16:55.0174663Z f9269f9cee12: Preparing
2021-07-19T08:16:55.6435679Z f9269f9cee12: Pushed
2021-07-19T08:16:55.6646764Z local: digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b size: 528
2021-07-19T08:16:55.6692899Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-gateway[0m
2021-07-19T08:16:55.6707305Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-gateway[0m
2021-07-19T08:16:55.6724240Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local[0m
2021-07-19T08:16:55.9552228Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-19T08:16:55.9586823Z [36m[submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel[0m
2021-07-19T08:16:56.9797650Z devel: Pulling from submariner/submariner-gateway
2021-07-19T08:16:56.9798548Z 8c741e919b67: Pulling fs layer
2021-07-19T08:16:56.9799069Z 13495efbbac4: Pulling fs layer
2021-07-19T08:16:56.9799616Z 6df6df193f2d: Pulling fs layer
2021-07-19T08:16:56.9800329Z 3afbe9ee7387: Pulling fs layer
2021-07-19T08:16:56.9800867Z 3afbe9ee7387: Waiting
2021-07-19T08:16:57.3958804Z 13495efbbac4: Verifying Checksum
2021-07-19T08:16:57.3973547Z 13495efbbac4: Download complete
2021-07-19T08:16:57.7464126Z 6df6df193f2d: Verifying Checksum
2021-07-19T08:16:57.7464771Z 6df6df193f2d: Download complete
2021-07-19T08:16:58.0926910Z 3afbe9ee7387: Verifying Checksum
2021-07-19T08:16:58.0927962Z 3afbe9ee7387: Download complete
2021-07-19T08:16:58.4109633Z 8c741e919b67: Verifying Checksum
2021-07-19T08:16:58.4122433Z 8c741e919b67: Download complete
2021-07-19T08:17:00.9274601Z 8c741e919b67: Pull complete
2021-07-19T08:17:02.6363767Z 13495efbbac4: Pull complete
2021-07-19T08:17:04.4540170Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev[0m
2021-07-19T08:17:04.4542269Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local[0m
2021-07-19T08:17:04.4543718Z [36m[submariner-operator]$ docker push localhost:5000/submariner-gateway:local[0m
2021-07-19T08:17:04.4544491Z 6df6df193f2d: Pull complete
2021-07-19T08:17:04.4545001Z 3afbe9ee7387: Pull complete
2021-07-19T08:17:04.4545913Z Digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895
2021-07-19T08:17:04.4547256Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-19T08:17:04.4548430Z quay.io/submariner/submariner-gateway:devel
2021-07-19T08:17:04.7005514Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-19T08:17:04.7062525Z 71972a942ed4: Preparing
2021-07-19T08:17:04.7062964Z 3c7f2d60eacb: Preparing
2021-07-19T08:17:04.7070253Z 00c5f6897675: Preparing
2021-07-19T08:17:04.7070603Z b3b62c837788: Preparing
2021-07-19T08:17:05.0254097Z 00c5f6897675: Pushed
2021-07-19T08:17:06.2384464Z 71972a942ed4: Pushed
2021-07-19T08:17:09.2715482Z 3c7f2d60eacb: Pushed
2021-07-19T08:17:15.8725777Z b3b62c837788: Pushed
2021-07-19T08:17:15.8924372Z local: digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895 size: 1159
2021-07-19T08:17:15.8973537Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-route-agent[0m
2021-07-19T08:17:15.8983057Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-route-agent[0m
2021-07-19T08:17:15.8991036Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local[0m
2021-07-19T08:17:16.1734496Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-19T08:17:16.1762220Z [36m[submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel[0m
2021-07-19T08:17:17.1951556Z devel: Pulling from submariner/submariner-route-agent
2021-07-19T08:17:17.1958086Z 8c741e919b67: Already exists
2021-07-19T08:17:17.1968405Z 13495efbbac4: Already exists
2021-07-19T08:17:17.1991274Z 70cc6422093d: Pulling fs layer
2021-07-19T08:17:17.1991764Z 7ba74d821748: Pulling fs layer
2021-07-19T08:17:17.1992177Z 62b0802bcf90: Pulling fs layer
2021-07-19T08:17:17.1992602Z 3e9c83283ee4: Pulling fs layer
2021-07-19T08:17:17.1993171Z 3e9c83283ee4: Waiting
2021-07-19T08:17:17.5226345Z 62b0802bcf90: Verifying Checksum
2021-07-19T08:17:17.5227035Z 62b0802bcf90: Download complete
2021-07-19T08:17:17.5304433Z 7ba74d821748: Verifying Checksum
2021-07-19T08:17:17.5305569Z 7ba74d821748: Download complete
2021-07-19T08:17:17.7110742Z 70cc6422093d: Verifying Checksum
2021-07-19T08:17:17.7111452Z 70cc6422093d: Download complete
2021-07-19T08:17:17.7375834Z 3e9c83283ee4: Verifying Checksum
2021-07-19T08:17:17.7376895Z 3e9c83283ee4: Download complete
2021-07-19T08:17:19.1753653Z 70cc6422093d: Pull complete
2021-07-19T08:17:19.3468072Z 7ba74d821748: Pull complete
2021-07-19T08:17:19.4299208Z 62b0802bcf90: Pull complete
2021-07-19T08:17:19.5062550Z 3e9c83283ee4: Pull complete
2021-07-19T08:17:19.5113353Z Digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c
2021-07-19T08:17:19.5135480Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-19T08:17:19.5206453Z quay.io/submariner/submariner-route-agent:devel
2021-07-19T08:17:19.5287511Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev[0m
2021-07-19T08:17:19.7973193Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local[0m
2021-07-19T08:17:20.0748382Z [36m[submariner-operator]$ docker push localhost:5000/submariner-route-agent:local[0m
2021-07-19T08:17:20.3510981Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-19T08:17:20.3738334Z 1d810a4c0610: Preparing
2021-07-19T08:17:20.3739106Z 7a86b74623fc: Preparing
2021-07-19T08:17:20.3739550Z 26de773c4486: Preparing
2021-07-19T08:17:20.3739998Z 6931e591f8e2: Preparing
2021-07-19T08:17:20.3740428Z 00c5f6897675: Preparing
2021-07-19T08:17:20.3740868Z b3b62c837788: Preparing
2021-07-19T08:17:20.3741346Z b3b62c837788: Waiting
2021-07-19T08:17:20.7543214Z 00c5f6897675: Mounted from submariner-gateway
2021-07-19T08:17:20.9617037Z 1d810a4c0610: Pushed
2021-07-19T08:17:20.9797368Z 26de773c4486: Pushed
2021-07-19T08:17:20.9797878Z 7a86b74623fc: Pushed
2021-07-19T08:17:20.9799031Z b3b62c837788: Mounted from submariner-gateway
2021-07-19T08:17:24.7656276Z 6931e591f8e2: Pushed
2021-07-19T08:17:24.7823386Z local: digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c size: 1575
2021-07-19T08:17:24.7864065Z [36m[submariner-operator]$ import_image quay.io/submariner/lighthouse-agent[0m
2021-07-19T08:17:24.7875177Z [36m[submariner-operator]$ import_image quay.io/submariner/lighthouse-agent[0m
2021-07-19T08:17:24.7892190Z [36m[submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local[0m
2021-07-19T08:17:25.0529151Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-19T08:17:25.0555028Z [36m[submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel[0m
2021-07-19T08:17:26.0700567Z devel: Pulling from submariner/lighthouse-agent
2021-07-19T08:17:26.0701402Z ecd69139dc76: Pulling fs layer
2021-07-19T08:17:26.0701932Z 8261c1767de3: Pulling fs layer
2021-07-19T08:17:26.3767917Z ecd69139dc76: Verifying Checksum
2021-07-19T08:17:26.3768556Z ecd69139dc76: Download complete
2021-07-19T08:17:26.4422636Z ecd69139dc76: Pull complete
2021-07-19T08:17:26.6248528Z 8261c1767de3: Verifying Checksum
2021-07-19T08:17:26.6252874Z 8261c1767de3: Download complete
2021-07-19T08:17:26.8029682Z 8261c1767de3: Pull complete
2021-07-19T08:17:26.8078811Z Digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f
2021-07-19T08:17:26.8102576Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-19T08:17:26.8123585Z quay.io/submariner/lighthouse-agent:devel
2021-07-19T08:17:26.8139265Z [36m[submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev[0m
2021-07-19T08:17:27.0905203Z [36m[submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local[0m
2021-07-19T08:17:27.3579445Z [36m[submariner-operator]$ docker push localhost:5000/lighthouse-agent:local[0m
2021-07-19T08:17:27.6403876Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-19T08:17:27.6456491Z 83c79e393e11: Preparing
2021-07-19T08:17:27.6457091Z 0026d2f62bbf: Preparing
2021-07-19T08:17:27.6942334Z 0026d2f62bbf: Pushed
2021-07-19T08:17:28.1891700Z 83c79e393e11: Pushed
2021-07-19T08:17:28.2064246Z local: digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f size: 735
2021-07-19T08:17:28.2106495Z [36m[submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns[0m
2021-07-19T08:17:28.2120571Z [36m[submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns[0m
2021-07-19T08:17:28.2131589Z [36m[submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local[0m
2021-07-19T08:17:28.4906015Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-19T08:17:28.4932808Z [36m[submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel[0m
2021-07-19T08:17:29.5029151Z devel: Pulling from submariner/lighthouse-coredns
2021-07-19T08:17:29.5030752Z 088e56360f76: Pulling fs layer
2021-07-19T08:17:29.5031655Z 18aed70882d2: Pulling fs layer
2021-07-19T08:17:30.0314216Z 088e56360f76: Verifying Checksum
2021-07-19T08:17:30.0314839Z 088e56360f76: Download complete
2021-07-19T08:17:30.1332936Z 088e56360f76: Pull complete
2021-07-19T08:17:30.2053874Z 18aed70882d2: Verifying Checksum
2021-07-19T08:17:30.2054864Z 18aed70882d2: Download complete
2021-07-19T08:17:30.4736144Z 18aed70882d2: Pull complete
2021-07-19T08:17:30.4778429Z Digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595
2021-07-19T08:17:30.4808989Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-19T08:17:30.4843643Z quay.io/submariner/lighthouse-coredns:devel
2021-07-19T08:17:30.4889266Z [36m[submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev[0m
2021-07-19T08:17:30.7536797Z [36m[submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local[0m
2021-07-19T08:17:31.0312470Z [36m[submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local[0m
2021-07-19T08:17:31.2990996Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-19T08:17:31.3047403Z 7fca351e51be: Preparing
2021-07-19T08:17:31.3053271Z 4fa0ece06e25: Preparing
2021-07-19T08:17:31.3466685Z 4fa0ece06e25: Pushed
2021-07-19T08:17:32.0620321Z 7fca351e51be: Pushed
2021-07-19T08:17:32.0798148Z local: digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595 size: 739
2021-07-19T08:17:32.0840854Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-globalnet[0m
2021-07-19T08:17:32.0858300Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-globalnet[0m
2021-07-19T08:17:32.0887920Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-globalnet:dev localhost:5000/submariner-globalnet:local[0m
2021-07-19T08:17:32.3534627Z Error response from daemon: No such image: quay.io/submariner/submariner-globalnet:dev
2021-07-19T08:17:32.3560877Z [36m[submariner-operator]$ docker pull quay.io/submariner/submariner-globalnet:devel[0m
2021-07-19T08:17:33.3744586Z devel: Pulling from submariner/submariner-globalnet
2021-07-19T08:17:33.3745341Z 8c741e919b67: Already exists
2021-07-19T08:17:33.3759604Z 13495efbbac4: Already exists
2021-07-19T08:17:33.3783127Z bb77c1f3f2df: Pulling fs layer
2021-07-19T08:17:33.3783888Z 8d0ffdb5918e: Pulling fs layer
2021-07-19T08:17:33.3784406Z bcf8fc53d486: Pulling fs layer
2021-07-19T08:17:33.3784883Z 218c178ba1a9: Pulling fs layer
2021-07-19T08:17:33.7719520Z bcf8fc53d486: Verifying Checksum
2021-07-19T08:17:33.7720172Z bcf8fc53d486: Download complete
2021-07-19T08:17:34.0593718Z 218c178ba1a9: Verifying Checksum
2021-07-19T08:17:34.0594625Z 218c178ba1a9: Download complete
2021-07-19T08:17:34.1262279Z bb77c1f3f2df: Verifying Checksum
2021-07-19T08:17:34.1262910Z bb77c1f3f2df: Download complete
2021-07-19T08:17:34.1510465Z 8d0ffdb5918e: Verifying Checksum
2021-07-19T08:17:34.1511315Z 8d0ffdb5918e: Download complete
2021-07-19T08:17:34.6802345Z bb77c1f3f2df: Pull complete
2021-07-19T08:17:34.8480729Z 8d0ffdb5918e: Pull complete
2021-07-19T08:17:34.9358780Z bcf8fc53d486: Pull complete
2021-07-19T08:17:35.0120403Z 218c178ba1a9: Pull complete
2021-07-19T08:17:35.0167140Z Digest: sha256:623e38998e0624d9a74f0c3638833e968ba472ef2ae235b724a67de11f113a69
2021-07-19T08:17:35.0205880Z Status: Downloaded newer image for quay.io/submariner/submariner-globalnet:devel
2021-07-19T08:17:35.0230956Z quay.io/submariner/submariner-globalnet:devel
2021-07-19T08:17:35.0326858Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-globalnet:devel quay.io/submariner/submariner-globalnet:dev[0m
2021-07-19T08:17:35.3003783Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-globalnet:dev localhost:5000/submariner-globalnet:local[0m
2021-07-19T08:17:35.5687990Z [36m[submariner-operator]$ docker push localhost:5000/submariner-globalnet:local[0m
2021-07-19T08:17:35.8356313Z The push refers to repository [localhost:5000/submariner-globalnet]
2021-07-19T08:17:35.8442229Z a395ed568a2f: Preparing
2021-07-19T08:17:35.8442968Z 39ac285976a0: Preparing
2021-07-19T08:17:35.8443423Z de48a84fa0cb: Preparing
2021-07-19T08:17:35.8443898Z 70c3bf07b5e8: Preparing
2021-07-19T08:17:35.8444620Z 00c5f6897675: Preparing
2021-07-19T08:17:35.8445496Z b3b62c837788: Preparing
2021-07-19T08:17:35.8445930Z b3b62c837788: Waiting
2021-07-19T08:17:35.9471102Z 00c5f6897675: Mounted from submariner-route-agent
2021-07-19T08:17:36.4364473Z a395ed568a2f: Pushed
2021-07-19T08:17:36.4462717Z b3b62c837788: Mounted from submariner-route-agent
2021-07-19T08:17:36.4493295Z 39ac285976a0: Pushed
2021-07-19T08:17:36.4539996Z de48a84fa0cb: Pushed
2021-07-19T08:17:37.3982667Z 70c3bf07b5e8: Pushed
2021-07-19T08:17:37.4159715Z local: digest: sha256:623e38998e0624d9a74f0c3638833e968ba472ef2ae235b724a67de11f113a69 size: 1574
2021-07-19T08:17:37.4206040Z     Successfully remade target file 'preload-images'.
2021-07-19T08:17:37.4207311Z    Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-19T08:17:37.4208838Z    Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-19T08:17:37.4210553Z    Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-19T08:17:37.4211574Z   Must remake target 'deploy'.
2021-07-19T08:17:37.4222110Z /opt/shipyard/scripts/deploy.sh --cable_driver libreswan --globalnet --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T08:17:37.5181162Z Running with: globalnet='true', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=false
2021-07-19T08:17:37.5219720Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/utils[0m
2021-07-19T08:17:37.5237329Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:17:37.5249412Z [36m[submariner-operator]$ script_name=utils[0m
2021-07-19T08:17:37.5263519Z [36m[submariner-operator]$ exec_name=deploy.sh[0m
2021-07-19T08:17:37.5285314Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs[0m
2021-07-19T08:17:37.5299456Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:17:37.5313415Z [36m[submariner-operator]$ script_name=deploy_funcs[0m
2021-07-19T08:17:37.5330812Z [36m[submariner-operator]$ exec_name=deploy.sh[0m
2021-07-19T08:17:37.5351526Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings[0m
2021-07-19T08:17:37.5370857Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:17:37.5385227Z [36m[submariner-operator]$ script_name=cluster_settings[0m
2021-07-19T08:17:37.5398517Z [36m[submariner-operator]$ exec_name=deploy.sh[0m
2021-07-19T08:17:37.5422723Z [36m[submariner-operator]$ broker=cluster1[0m
2021-07-19T08:17:37.5436499Z [36m[submariner-operator]$ declare -gA cluster_nodes[0m
2021-07-19T08:17:37.5451049Z [36m[submariner-operator]$ cluster_nodes[cluster1]=control-plane worker[0m
2021-07-19T08:17:37.5465901Z [36m[submariner-operator]$ cluster_nodes[cluster2]=control-plane worker[0m
2021-07-19T08:17:37.5478912Z [36m[submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker[0m
2021-07-19T08:17:37.5491104Z [36m[submariner-operator]$ declare -gA cluster_subm[0m
2021-07-19T08:17:37.5500658Z [36m[submariner-operator]$ cluster_subm[cluster1]=true[0m
2021-07-19T08:17:37.5514464Z [36m[submariner-operator]$ cluster_subm[cluster2]=true[0m
2021-07-19T08:17:37.5529266Z [36m[submariner-operator]$ cluster_subm[cluster3]=true[0m
2021-07-19T08:17:37.5541760Z [36m[submariner-operator]$ declare -gA cluster_cni[0m
2021-07-19T08:17:37.5556921Z [36m[submariner-operator]$ cluster_cni[cluster2]=weave[0m
2021-07-19T08:17:37.5572033Z [36m[submariner-operator]$ cluster_cni[cluster3]=weave[0m
2021-07-19T08:17:37.5587709Z [36m[submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings[0m
2021-07-19T08:17:37.5602852Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:17:37.5617579Z [36m[submariner-operator]$ script_name=cluster_settings[0m
2021-07-19T08:17:37.5632118Z [36m[submariner-operator]$ exec_name=deploy.sh[0m
2021-07-19T08:17:37.5657619Z [36m[submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker[0m
2021-07-19T08:17:37.5669588Z [36m[submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker[0m
2021-07-19T08:17:37.5698598Z [36m[submariner-operator]$ declare_cidrs[0m
2021-07-19T08:17:37.5709802Z [36m[submariner-operator]$ declare_cidrs[0m
2021-07-19T08:17:37.5722340Z [36m[submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs[0m
2021-07-19T08:17:37.5735281Z [36m[submariner-operator]$ i=1[0m
2021-07-19T08:17:37.5748650Z [36m[submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1[0m
2021-07-19T08:17:37.5761292Z [36m[submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1[0m
2021-07-19T08:17:37.5775836Z [36m[submariner-operator]$ [cluster1] val=0[0m
2021-07-19T08:17:37.5787082Z [36m[submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.0.0.0/16[0m
2021-07-19T08:17:37.5799354Z [36m[submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.0.0.0/16[0m
2021-07-19T08:17:37.5813526Z [36m[submariner-operator]$ [cluster1] global_CIDRs[cluster1]=242.254.1.0/24[0m
2021-07-19T08:17:37.5827062Z [36m[submariner-operator]$ [cluster1] i=$(("$i"+1))[0m
2021-07-19T08:17:37.5844808Z [36m[submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2[0m
2021-07-19T08:17:37.5859165Z [36m[submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2[0m
2021-07-19T08:17:37.5873726Z [36m[submariner-operator]$ [cluster2] val=0[0m
2021-07-19T08:17:37.5888407Z [36m[submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.0.0.0/16[0m
2021-07-19T08:17:37.5902621Z [36m[submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.0.0.0/16[0m
2021-07-19T08:17:37.5918000Z [36m[submariner-operator]$ [cluster2] global_CIDRs[cluster2]=242.254.2.0/24[0m
2021-07-19T08:17:37.5933586Z [36m[submariner-operator]$ [cluster2] i=$(("$i"+1))[0m
2021-07-19T08:17:37.5950540Z [36m[submariner-operator]$ [cluster2] declare_kubeconfig[0m
2021-07-19T08:17:37.5965819Z [36m[submariner-operator]$ [cluster2] declare_kubeconfig[0m
2021-07-19T08:17:37.5980499Z [36m[submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg[0m
2021-07-19T08:17:37.6001894Z [36m[submariner-operator]$ [cluster2] export KUBECONFIG[0m
2021-07-19T08:17:37.6017579Z [36m[submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)[0m
2021-07-19T08:17:37.6036593Z [36m[submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:[0m
2021-07-19T08:17:37.6072640Z [36m[submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash[0m
2021-07-19T08:17:37.7622747Z Installing subctl version devel
2021-07-19T08:17:37.7623314Z   OS detected:           linux
2021-07-19T08:17:37.7623845Z   Architecture detected: amd64
2021-07-19T08:17:37.7626017Z   Download URL:          https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-19T08:17:37.7627080Z
2021-07-19T08:17:37.7627481Z Downloading...
2021-07-19T08:17:38.9275032Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-19T08:17:38.9498325Z This provides subctl version: devel
2021-07-19T08:17:38.9514424Z
2021-07-19T08:17:38.9516123Z please update your path (and consider adding it to ~/.profile):
2021-07-19T08:17:38.9516743Z     export PATH=$PATH:/go/bin
2021-07-19T08:17:38.9517123Z
2021-07-19T08:17:38.9621575Z [36m[submariner-operator]$ [cluster2] load_deploytool operator[0m
2021-07-19T08:17:38.9635547Z [36m[submariner-operator]$ [cluster2] load_deploytool operator[0m
2021-07-19T08:17:38.9642922Z Will deploy submariner using operator
2021-07-19T08:17:38.9656497Z [36m[submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator[0m
2021-07-19T08:17:38.9675524Z [36m[submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:17:38.9688149Z [36m[submariner-operator]$ [cluster2] script_name=deploy_operator[0m
2021-07-19T08:17:38.9700633Z [36m[submariner-operator]$ [cluster2] exec_name=deploy.sh[0m
2021-07-19T08:17:38.9717229Z [36m[submariner-operator]$ [cluster2] deploytool_prereqs[0m
2021-07-19T08:17:38.9727099Z [36m[submariner-operator]$ [cluster2] deploytool_prereqs[0m
2021-07-19T08:17:38.9741797Z [36m[0m
2021-07-19T08:17:38.9755616Z [36m[submariner-operator]$ [cluster2] subctl version[0m
2021-07-19T08:17:38.9980116Z subctl version: devel-0105e4d
2021-07-19T08:17:39.0011876Z [36m[submariner-operator]$ [cluster2] run_if_defined pre_deploy[0m
2021-07-19T08:17:39.0023028Z [36m[submariner-operator]$ [cluster2] run_if_defined pre_deploy[0m
2021-07-19T08:17:39.0039025Z [36m[submariner-operator]$ [cluster2] type -t pre_deploy[0m
2021-07-19T08:17:39.0056825Z [36m[submariner-operator]$ [cluster2] grep -q function[0m
2021-07-19T08:17:39.0084286Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-19T08:17:39.0098821Z [36m[submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster[0m
2021-07-19T08:17:39.0111946Z [36m[submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster[0m
2021-07-19T08:17:39.0126117Z [36m[submariner-operator]$ [cluster2] declare -a subm_clusters[0m
2021-07-19T08:17:39.0156634Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster[0m
2021-07-19T08:17:39.0171286Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster[0m
2021-07-19T08:17:39.0187436Z [36m[submariner-operator]$ [cluster2] declare -A pids[0m
2021-07-19T08:17:39.0203935Z [36m[submariner-operator]$ [cluster2] eval echo cluster1 cluster2[0m
2021-07-19T08:17:39.0222272Z [36m[submariner-operator]$ [cluster1] pids[cluster1]=7234[0m
2021-07-19T08:17:39.0223121Z [36m[submariner-operator]$ [cluster1] set -o pipefail[0m
2021-07-19T08:17:39.0232869Z [36m[submariner-operator]$ [cluster1] prepare_cluster[0m
2021-07-19T08:17:39.0246401Z [36m[submariner-operator]$ [cluster2] pids[cluster2]=7238[0m
2021-07-19T08:17:39.0250059Z [36m[submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /[0m
2021-07-19T08:17:39.0269798Z [36m[submariner-operator]$ [cluster2] wait 7238[0m
2021-07-19T08:17:39.0277764Z [36m[submariner-operator]$ [cluster2] set -o pipefail[0m
2021-07-19T08:17:39.0296471Z [36m[submariner-operator]$ [cluster2] prepare_cluster[0m
2021-07-19T08:17:39.0310041Z [36m[submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /[0m
2021-07-19T08:17:39.3932843Z [36m[submariner-operator]$ [cluster2] prepare_cluster[0m
2021-07-19T08:17:39.3934574Z [36m[submariner-operator]$ [cluster2] add_subm_gateway_label[0m
2021-07-19T08:17:39.3935962Z [36m[submariner-operator]$ [cluster2] add_subm_gateway_label[0m
2021-07-19T08:17:39.3937634Z [36m[submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite[0m
2021-07-19T08:17:39.3941201Z [36m[submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite[0m
2021-07-19T08:17:39.3942906Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite[0m
2021-07-19T08:17:39.3944165Z [cluster2] node/cluster2-worker labeled
2021-07-19T08:17:39.3963648Z [36m[submariner-operator]$ [cluster2] wait 7234[0m
2021-07-19T08:17:39.4281128Z [36m[submariner-operator]$ [cluster1] prepare_cluster[0m
2021-07-19T08:17:39.4282494Z [36m[submariner-operator]$ [cluster1] add_subm_gateway_label[0m
2021-07-19T08:17:39.4283708Z [36m[submariner-operator]$ [cluster1] add_subm_gateway_label[0m
2021-07-19T08:17:39.4285527Z [36m[submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite[0m
2021-07-19T08:17:39.4287227Z [36m[submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite[0m
2021-07-19T08:17:39.4289326Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite[0m
2021-07-19T08:17:39.4290553Z [cluster1] node/cluster1-worker labeled
2021-07-19T08:17:39.4300283Z [36m[submariner-operator]$ [cluster2] with_context cluster1 setup_broker[0m
2021-07-19T08:17:39.4311786Z [36m[submariner-operator]$ [cluster2] with_context cluster1 setup_broker[0m
2021-07-19T08:17:39.4324184Z [36m[submariner-operator]$ [cluster1] setup_broker[0m
2021-07-19T08:17:39.4337627Z [36m[submariner-operator]$ [cluster1] setup_broker[0m
2021-07-19T08:17:39.4352217Z [36m[submariner-operator]$ [cluster1] gn=--globalnet[0m
2021-07-19T08:17:39.4357621Z Installing broker...
2021-07-19T08:17:39.4369276Z [36m[submariner-operator]$ [cluster1] subctlrepver=[0m
2021-07-19T08:17:39.4386164Z [36m[submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local[0m
2021-07-19T08:17:39.4406576Z [36m[submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output[0m
2021-07-19T08:17:39.4419066Z [36m[output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local --globalnet[0m
2021-07-19T08:17:39.4653774Z  • Setting up broker RBAC  ...
2021-07-19T08:17:39.5445738Z  ✓ Setting up broker RBAC
2021-07-19T08:17:39.5446630Z  • Deploying the Submariner operator  ...
2021-07-19T08:17:50.7785324Z  ✓ Deploying the Submariner operator
2021-07-19T08:17:50.7790091Z  ✓ Created operator CRDs
2021-07-19T08:17:50.7794143Z  ✓ Created operator namespace: submariner-operator
2021-07-19T08:17:50.7799179Z  ✓ Created operator service account and role
2021-07-19T08:17:50.7804117Z  ✓ Created lighthouse service account and role
2021-07-19T08:17:50.7809227Z  ✓ Created Lighthouse service accounts and roles
2021-07-19T08:17:50.7814215Z  ✓ Deployed the operator successfully
2021-07-19T08:17:50.7818987Z  • Deploying the broker  ...
2021-07-19T08:17:50.8029558Z  ✓ Deploying the broker
2021-07-19T08:17:50.8030854Z  ✓ The broker has been deployed
2021-07-19T08:17:50.8031776Z  • Creating broker-info.subm file  ...
2021-07-19T08:17:50.8187845Z  ✓ Creating broker-info.subm file
2021-07-19T08:17:50.8195162Z  ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-19T08:17:50.8252103Z [36m[submariner-operator]$ [cluster2] install_subm_all_clusters[0m
2021-07-19T08:17:50.8272564Z [36m[submariner-operator]$ [cluster2] install_subm_all_clusters[0m
2021-07-19T08:17:50.8288844Z [36m[submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm[0m
2021-07-19T08:17:50.8303604Z [36m[submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm[0m
2021-07-19T08:17:50.8321284Z [36m[submariner-operator]$ [cluster2] declare -a subm_clusters[0m
2021-07-19T08:17:50.8360037Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm[0m
2021-07-19T08:17:50.8380490Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm[0m
2021-07-19T08:17:50.8419777Z [36m[submariner-operator]$ [cluster2] declare -A pids[0m
2021-07-19T08:17:50.8442614Z [36m[submariner-operator]$ [cluster2] eval echo cluster1 cluster2[0m
2021-07-19T08:17:50.8471099Z [36m[submariner-operator]$ [cluster1] pids[cluster1]=7300[0m
2021-07-19T08:17:50.8493721Z [36m[submariner-operator]$ [cluster2] pids[cluster2]=7302[0m
2021-07-19T08:17:50.8507144Z [36m[submariner-operator]$ [cluster2] wait 7302[0m
2021-07-19T08:17:50.8541898Z [36m[submariner-operator]$ [cluster1] set -o pipefail[0m
2021-07-19T08:17:50.8543007Z [36m[submariner-operator]$ [cluster2] set -o pipefail[0m
2021-07-19T08:17:50.8554114Z [36m[submariner-operator]$ [cluster2] subctl_install_subm[0m
2021-07-19T08:17:50.8563520Z [36m[submariner-operator]$ [cluster1] subctl_install_subm[0m
2021-07-19T08:17:50.8584856Z [36m[submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /[0m
2021-07-19T08:17:50.8652272Z [36m[submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /[0m
2021-07-19T08:17:57.3933470Z [36m[submariner-operator]$ [cluster1] subctl_install_subm[0m
2021-07-19T08:17:57.3934590Z [36m[submariner-operator]$ [cluster1] subctlrepver=[0m
2021-07-19T08:17:57.3935896Z [36m[submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local[0m
2021-07-19T08:17:57.3937116Z [36m[submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false[0m
2021-07-19T08:17:57.3940188Z [36m[submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr 242.254.1.0/24 --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm[0m
2021-07-19T08:17:57.3943353Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-19T08:17:57.3944510Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-19T08:17:57.3945424Z [cluster1]   - cluster1-worker
2021-07-19T08:17:57.3946204Z [cluster1]  • Discovering network details  ...
2021-07-19T08:17:57.3947046Z [cluster1]         Network plugin:  weave-net
2021-07-19T08:17:57.3947616Z [cluster1]         Service CIDRs:   [100.0.0.0/16]
2021-07-19T08:17:57.3948131Z [cluster1]         Cluster CIDRs:   [10.0.0.0/16]
2021-07-19T08:17:57.3948847Z [cluster1]  ✓ Discovering network details
2021-07-19T08:17:57.3949626Z [cluster1]  • Discovering multi cluster details  ...
2021-07-19T08:17:57.3950476Z [cluster1]  • Validating Globalnet configurations  ...
2021-07-19T08:17:57.3951332Z [cluster1]  ✓ Validating Globalnet configurations
2021-07-19T08:17:57.3952121Z [cluster1]  • Assigning Globalnet IPs  ...
2021-07-19T08:17:57.3952846Z [cluster1]  ✓ Assigning Globalnet IPs
2021-07-19T08:17:57.3953552Z [cluster1]  ✓ GlobalCIDR is: 242.254.1.0/24
2021-07-19T08:17:57.3954293Z [cluster1]  ✓ Discovering multi cluster details
2021-07-19T08:17:57.3955096Z [cluster1]  • Deploying the Submariner operator  ...
2021-07-19T08:17:57.3955920Z [cluster1]  ✓ Deploying the Submariner operator
2021-07-19T08:17:57.3957035Z [cluster1]  ✓ Created Lighthouse service accounts and roles
2021-07-19T08:17:57.3957865Z [cluster1]  • Creating SA for cluster  ...
2021-07-19T08:17:57.3958535Z [cluster1]  ✓ Creating SA for cluster
2021-07-19T08:17:57.3959241Z [cluster1]  • Deploying Submariner  ...
2021-07-19T08:17:57.3959933Z [cluster1]  ✓ Deploying Submariner
2021-07-19T08:17:57.3960649Z [cluster1]  ✓ Submariner is up and running
2021-07-19T08:18:04.1337901Z [36m[submariner-operator]$ [cluster2] subctl_install_subm[0m
2021-07-19T08:18:04.1338961Z [36m[submariner-operator]$ [cluster2] subctlrepver=[0m
2021-07-19T08:18:04.1340248Z [36m[submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local[0m
2021-07-19T08:18:04.1341397Z [36m[submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false[0m
2021-07-19T08:18:04.1344622Z [36m[submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr 242.254.2.0/24 --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm[0m
2021-07-19T08:18:04.1347793Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-19T08:18:04.1348881Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-19T08:18:04.1349638Z [cluster2]   - cluster2-worker
2021-07-19T08:18:04.1350409Z [cluster2]  • Discovering network details  ...
2021-07-19T08:18:04.1351421Z [cluster2]         Network plugin:  weave-net
2021-07-19T08:18:04.1351981Z [cluster2]         Service CIDRs:   [100.0.0.0/16]
2021-07-19T08:18:04.1352510Z [cluster2]         Cluster CIDRs:   [10.0.0.0/16]
2021-07-19T08:18:04.1353256Z [cluster2]  ✓ Discovering network details
2021-07-19T08:18:04.1354045Z [cluster2]  • Discovering multi cluster details  ...
2021-07-19T08:18:04.1354906Z [cluster2]  • Validating Globalnet configurations  ...
2021-07-19T08:18:04.1355781Z [cluster2]  ✓ Validating Globalnet configurations
2021-07-19T08:18:04.1356633Z [cluster2]  • Assigning Globalnet IPs  ...
2021-07-19T08:18:04.1357245Z [cluster2]  ✓ Assigning Globalnet IPs
2021-07-19T08:18:04.1358199Z [cluster2]  ✓ GlobalCIDR is: 242.254.2.0/24
2021-07-19T08:18:04.1358919Z [cluster2]  ✓ Discovering multi cluster details
2021-07-19T08:18:04.1359742Z [cluster2]  • Deploying the Submariner operator  ...
2021-07-19T08:18:04.1360546Z [cluster2]  ✓ Deploying the Submariner operator
2021-07-19T08:18:04.1361492Z [cluster2]  ✓ Created operator CRDs
2021-07-19T08:18:04.1362443Z [cluster2]  ✓ Created operator namespace: submariner-operator
2021-07-19T08:18:04.1363460Z [cluster2]  ✓ Created operator service account and role
2021-07-19T08:18:04.1364385Z [cluster2]  ✓ Created lighthouse service account and role
2021-07-19T08:18:04.1365486Z [cluster2]  ✓ Created Lighthouse service accounts and roles
2021-07-19T08:18:04.1368230Z [cluster2]  ✓ Deployed the operator successfully
2021-07-19T08:18:04.1369055Z [cluster2]  • Creating SA for cluster  ...
2021-07-19T08:18:04.1369801Z [cluster2]  ✓ Creating SA for cluster
2021-07-19T08:18:04.1370538Z [cluster2]  • Deploying Submariner  ...
2021-07-19T08:18:04.1371304Z [cluster2]  ✓ Deploying Submariner
2021-07-19T08:18:04.1372604Z [cluster2]  ✓ Submariner is up and running
2021-07-19T08:18:04.1399818Z [36m[submariner-operator]$ [cluster2] wait 7300[0m
2021-07-19T08:18:04.1432985Z [36m[submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status[0m
2021-07-19T08:18:04.1460681Z [36m[submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status[0m
2021-07-19T08:18:04.1490349Z [36m[submariner-operator]$ [cluster2] with_retries 30 verify_gw_status[0m
2021-07-19T08:18:04.1506473Z [36m[submariner-operator]$ [cluster2] with_retries[0m
2021-07-19T08:18:04.1519627Z [36m[submariner-operator]$ [cluster2] iteration=1[0m
2021-07-19T08:18:04.1596112Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:04.1606225Z [36m[submariner-operator]$ [cluster2] wait 7346[0m
2021-07-19T08:18:04.1680659Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:04.1720275Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-19T08:18:04.1732993Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:04.1871805Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-19T08:18:04.5093729Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:04.5133812Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-19T08:18:04.7240758Z  • Showing Connections  ...
2021-07-19T08:18:04.7281146Z  ✗ Showing Connections
2021-07-19T08:18:04.7281939Z  ✗ There are no gateways detected
2021-07-19T08:18:04.9444514Z  • Showing Connections  ...
2021-07-19T08:18:05.2474149Z  ✗ Showing Connections
2021-07-19T08:18:05.2475031Z  ✗ There are no gateways detected
2021-07-19T08:18:05.2517732Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-19T08:18:05.2559022Z [36m[submariner-operator]$ [cluster2] sleep 6[0m
2021-07-19T08:18:11.2597560Z [36m[submariner-operator]$ [cluster2] return 1[0m
2021-07-19T08:18:11.2636044Z [36m[submariner-operator]$ [cluster2] wait 7373[0m
2021-07-19T08:18:11.2654941Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:11.2682650Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:11.2706050Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-19T08:18:11.2733128Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:11.2754152Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-19T08:18:11.5903191Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:11.5920201Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-19T08:18:11.6784504Z  • Showing Connections  ...
2021-07-19T08:18:11.6976102Z  ✗ Showing Connections
2021-07-19T08:18:11.6976714Z  ✗ There are no gateways detected
2021-07-19T08:18:11.7157799Z  • Showing Connections  ...
2021-07-19T08:18:11.7176580Z  ✗ Showing Connections
2021-07-19T08:18:11.7177302Z  ✗ There are no gateways detected
2021-07-19T08:18:11.7223598Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-19T08:18:11.7263500Z [36m[submariner-operator]$ [cluster2] sleep 6[0m
2021-07-19T08:18:17.7329285Z [36m[submariner-operator]$ [cluster2] return 1[0m
2021-07-19T08:18:17.7502071Z [36m[submariner-operator]$ [cluster2] wait 7400[0m
2021-07-19T08:18:17.7609770Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:17.7703626Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:17.7776635Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-19T08:18:17.7785797Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:17.7812095Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-19T08:18:19.4691738Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:19.4720899Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-19T08:18:19.6835049Z  • Showing Connections  ...
2021-07-19T08:18:19.7060517Z  ✗ Showing Connections
2021-07-19T08:18:19.7065726Z  ✗ No connections found
2021-07-19T08:18:19.8630293Z  • Showing Connections  ...
2021-07-19T08:18:20.2895778Z  ✗ Showing Connections
2021-07-19T08:18:20.2900181Z  ✗ There are no gateways detected
2021-07-19T08:18:20.2932688Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-19T08:18:20.2947844Z [36m[submariner-operator]$ [cluster2] sleep 6[0m
2021-07-19T08:18:26.2977184Z [36m[submariner-operator]$ [cluster2] return 1[0m
2021-07-19T08:18:26.3025166Z [36m[submariner-operator]$ [cluster2] wait 7426[0m
2021-07-19T08:18:26.3040113Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:26.3052195Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:26.3062399Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-19T08:18:26.3083636Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:26.3221340Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-19T08:18:26.8656169Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:26.8683374Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-19T08:18:27.1866991Z  • Showing Connections  ...
2021-07-19T08:18:27.2463858Z  ✗ Showing Connections
2021-07-19T08:18:27.2468667Z  ✗ No connections found
2021-07-19T08:18:27.4126250Z  • Showing Connections  ...
2021-07-19T08:18:27.4278137Z  ✗ Showing Connections
2021-07-19T08:18:27.4278931Z  ✗ There are no gateways detected
2021-07-19T08:18:27.4311528Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-19T08:18:27.4320435Z [36m[submariner-operator]$ [cluster2] sleep 6[0m
2021-07-19T08:18:33.4348474Z [36m[submariner-operator]$ [cluster2] return 1[0m
2021-07-19T08:18:33.4445909Z [36m[submariner-operator]$ [cluster2] wait 7452[0m
2021-07-19T08:18:33.4469966Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:33.4506358Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:33.4571443Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-19T08:18:33.4590486Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:33.4633211Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-19T08:18:33.9322409Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:33.9344867Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-19T08:18:34.1375800Z  • Showing Connections  ...
2021-07-19T08:18:34.1422985Z  ✗ Showing Connections
2021-07-19T08:18:34.1427994Z  ✗ No connections found
2021-07-19T08:18:34.1654862Z  • Showing Connections  ...
2021-07-19T08:18:34.1778302Z  ✗ Showing Connections
2021-07-19T08:18:34.1787529Z  ✗ There are no gateways detected
2021-07-19T08:18:34.1836711Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-19T08:18:34.1853322Z [36m[submariner-operator]$ [cluster2] sleep 6[0m
2021-07-19T08:18:40.4748537Z [36m[submariner-operator]$ [cluster2] return 1[0m
2021-07-19T08:18:40.4749329Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-19T08:18:40.4758044Z [36m[submariner-operator]$ [cluster2] wait 7479[0m
2021-07-19T08:18:40.4759273Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:40.4760439Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:40.4761578Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-19T08:18:40.4762803Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:40.4764203Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-19T08:18:40.4766157Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:40.4767369Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-19T08:18:40.4768484Z  • Showing Connections  ...
2021-07-19T08:18:40.4769268Z  ✗ Showing Connections
2021-07-19T08:18:40.4770036Z  ✗ No connections found
2021-07-19T08:18:40.4770788Z  • Showing Connections  ...
2021-07-19T08:18:40.4771569Z  ✗ Showing Connections
2021-07-19T08:18:40.4772380Z  ✗ No connections found
2021-07-19T08:18:40.4789606Z [36m[submariner-operator]$ [cluster2] sleep 6[0m
2021-07-19T08:18:46.4815819Z [36m[submariner-operator]$ [cluster2] return 1[0m
2021-07-19T08:18:46.4852776Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:46.4854564Z [36m[submariner-operator]$ [cluster2] wait 7506[0m
2021-07-19T08:18:46.4869465Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-19T08:18:46.4880291Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-19T08:18:46.4893123Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:46.4908020Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-19T08:18:46.5582512Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-19T08:18:46.5604785Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-19T08:18:46.6071605Z  • Showing Connections  ...
2021-07-19T08:18:46.6103356Z  ✓ Showing Connections
2021-07-19T08:18:46.6223194Z  • Showing Connections  ...
2021-07-19T08:18:46.6247980Z  ✓ Showing Connections
2021-07-19T08:18:46.6284062Z cluster2-worker  cluster2  172.18.0.7  no   libreswan     242.254.2.0/24  connected  250.569µs
2021-07-19T08:18:46.6286218Z cluster1-worker  cluster1  172.18.0.5  no   libreswan     242.254.1.0/24  connected  0s
2021-07-19T08:18:46.6295728Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-19T08:18:46.6314760Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-19T08:18:46.6331580Z [36m[submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1[0m
2021-07-19T08:18:46.6346104Z [36m[submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1[0m
2021-07-19T08:18:46.6364603Z [36m[submariner-operator]$ [cluster2] connectivity_tests cluster1[0m
2021-07-19T08:18:46.6381640Z [36m[submariner-operator]$ [cluster2] connectivity_tests[0m
2021-07-19T08:18:46.6397746Z [36m[submariner-operator]$ [cluster2] target_cluster=cluster1[0m
2021-07-19T08:18:46.6413732Z [36m[submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest[0m
2021-07-19T08:18:46.6427966Z [36m[submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest[0m
2021-07-19T08:18:46.6444458Z [36m[submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local[0m
2021-07-19T08:18:46.9420187Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-19T08:18:46.9495369Z [36m[submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel[0m
2021-07-19T08:18:48.0257375Z devel: Pulling from submariner/nettest
2021-07-19T08:18:48.0262720Z 5843afab3874: Already exists
2021-07-19T08:18:48.0288636Z 9565bb92f43f: Pulling fs layer
2021-07-19T08:18:48.0293466Z a31c0d5b4ad6: Pulling fs layer
2021-07-19T08:18:48.0294815Z dc3d13650205: Pulling fs layer
2021-07-19T08:18:48.2717539Z 9565bb92f43f: Verifying Checksum
2021-07-19T08:18:48.2718155Z 9565bb92f43f: Download complete
2021-07-19T08:18:48.2970154Z dc3d13650205: Verifying Checksum
2021-07-19T08:18:48.2972082Z dc3d13650205: Download complete
2021-07-19T08:18:48.3699310Z a31c0d5b4ad6: Verifying Checksum
2021-07-19T08:18:48.3707098Z a31c0d5b4ad6: Download complete
2021-07-19T08:18:48.4963323Z 9565bb92f43f: Pull complete
2021-07-19T08:18:48.8384647Z a31c0d5b4ad6: Pull complete
2021-07-19T08:18:48.9317656Z dc3d13650205: Pull complete
2021-07-19T08:18:48.9367469Z Digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f
2021-07-19T08:18:48.9390395Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-19T08:18:48.9403183Z quay.io/submariner/nettest:devel
2021-07-19T08:18:48.9469843Z [36m[submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev[0m
2021-07-19T08:18:49.2630539Z [36m[submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local[0m
2021-07-19T08:18:49.5636465Z [36m[submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local[0m
2021-07-19T08:18:49.8559940Z The push refers to repository [localhost:5000/nettest]
2021-07-19T08:18:49.8671268Z 4f2cdf68c81d: Preparing
2021-07-19T08:18:49.8671835Z 1f803d62c8b3: Preparing
2021-07-19T08:18:49.8672353Z 80c9eaab4c9e: Preparing
2021-07-19T08:18:49.8673152Z 72e830a4dff5: Preparing
2021-07-19T08:18:50.0479771Z 80c9eaab4c9e: Pushed
2021-07-19T08:18:50.6044268Z 4f2cdf68c81d: Pushed
2021-07-19T08:18:50.6212461Z 72e830a4dff5: Pushed
2021-07-19T08:18:51.1553260Z 1f803d62c8b3: Pushed
2021-07-19T08:18:51.1744747Z local: digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f size: 1155
2021-07-19T08:18:51.1833887Z [36m[submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-19T08:18:51.1847876Z [36m[submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-19T08:18:51.1854701Z [36m[submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")[0m
2021-07-19T08:18:51.1875943Z [36m[submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml[0m
2021-07-19T08:18:51.1906323Z [36m[submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-19T08:18:51.1920056Z [36m[submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-19T08:18:51.1934356Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-19T08:18:51.7052153Z deployment.apps/netshoot created
2021-07-19T08:18:51.7142795Z Waiting for netshoot pods to be ready.
2021-07-19T08:18:51.7215008Z [36m[submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m[0m
2021-07-19T08:18:51.7226918Z [36m[submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m[0m
2021-07-19T08:18:51.7240684Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m[0m
2021-07-19T08:18:52.0797167Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-19T08:18:53.9274313Z deployment "netshoot" successfully rolled out
2021-07-19T08:18:53.9334192Z [36m[submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-19T08:18:53.9345534Z [36m[submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-19T08:18:53.9360567Z [36m[submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-19T08:18:53.9377025Z [36m[submariner-operator]$ [cluster1] deploy_resource[0m
2021-07-19T08:18:53.9394603Z [36m[submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")[0m
2021-07-19T08:18:53.9417774Z [36m[submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml[0m
2021-07-19T08:18:53.9440216Z [36m[submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-19T08:18:53.9459230Z [36m[submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-19T08:18:53.9476587Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-19T08:18:54.6128900Z deployment.apps/nginx-demo created
2021-07-19T08:18:54.6286321Z service/nginx-demo created
2021-07-19T08:18:54.6903488Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-19T08:18:54.6974615Z Waiting for nginx-demo pods to be ready.
2021-07-19T08:18:54.6993060Z [36m[submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m[0m
2021-07-19T08:18:54.7013502Z [36m[submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m[0m
2021-07-19T08:18:54.7027296Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m[0m
2021-07-19T08:18:55.3862377Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-19T08:19:00.8111180Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-19T08:19:00.9374371Z deployment "nginx-demo" successfully rolled out
2021-07-19T08:19:00.9429643Z [36m[submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')[0m
2021-07-19T08:19:00.9500688Z [36m[submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot[0m
2021-07-19T08:19:00.9534799Z [36m[submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot[0m
2021-07-19T08:19:00.9543180Z [36m[submariner-operator]$ [cluster2] awk FNR == 2 {print $1}[0m
2021-07-19T08:19:00.9555251Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot[0m
2021-07-19T08:19:01.3695887Z [36m[submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)[0m
2021-07-19T08:19:01.3717888Z [36m[submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo[0m
2021-07-19T08:19:01.3730996Z [36m[submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo[0m
2021-07-19T08:19:01.3745500Z [36m[submariner-operator]$ [cluster1] get_svc_ip nginx-demo[0m
2021-07-19T08:19:01.3770388Z [36m[submariner-operator]$ [cluster1] get_svc_ip[0m
2021-07-19T08:19:01.3788219Z [36m[submariner-operator]$ [cluster1] svc_ip=$(with_retries 30 get_globalip "${svc_name}")[0m
2021-07-19T08:19:01.3812384Z [36m[submariner-operator]$ [cluster1] with_retries 30 get_globalip nginx-demo[0m
2021-07-19T08:19:01.3825202Z [36m[submariner-operator]$ [cluster1] with_retries 30 get_globalip nginx-demo[0m
2021-07-19T08:19:01.3838848Z [36m[submariner-operator]$ [cluster1] iteration=1[0m
2021-07-19T08:19:01.3868179Z [36m[submariner-operator]$ [cluster1] get_globalip nginx-demo[0m
2021-07-19T08:19:01.3869301Z [36m[submariner-operator]$ [cluster1] wait 7645[0m
2021-07-19T08:19:01.3884180Z [36m[submariner-operator]$ [cluster1] get_globalip[0m
2021-07-19T08:19:01.3902527Z [36m[submariner-operator]$ [cluster1] gip=$(kubectl get svc "$svc_name" -o jsonpath='{.metadata.annotations.submariner\.io/globalIp}')[0m
2021-07-19T08:19:01.3921214Z [36m[submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}[0m
2021-07-19T08:19:01.3936266Z [36m[submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}[0m
2021-07-19T08:19:01.3950413Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}[0m
2021-07-19T08:19:01.6958205Z [36m[submariner-operator]$ [cluster1] gip=$(kubectl get giip "$svc_name" -o jsonpath='{.status.allocatedIP}')[0m
2021-07-19T08:19:01.6977521Z [36m[submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}[0m
2021-07-19T08:19:01.6990940Z [36m[submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}[0m
2021-07-19T08:19:01.7005600Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get giip nginx-demo -o jsonpath={.status.allocatedIP}[0m
2021-07-19T08:19:01.9769725Z Error from server (NotFound): globalingressips.submariner.io "nginx-demo" not found
2021-07-19T08:19:01.9826219Z [36m[submariner-operator]$ [cluster1] sleep 1[0m
2021-07-19T08:19:02.9857104Z [36m[submariner-operator]$ [cluster1] return 1[0m
2021-07-19T08:19:02.9899432Z [36m[submariner-operator]$ [cluster1] wait 7674[0m
2021-07-19T08:19:02.9914206Z [36m[submariner-operator]$ [cluster1] get_globalip nginx-demo[0m
2021-07-19T08:19:02.9933872Z [36m[submariner-operator]$ [cluster1] get_globalip[0m
2021-07-19T08:19:02.9950396Z [36m[submariner-operator]$ [cluster1] gip=$(kubectl get svc "$svc_name" -o jsonpath='{.metadata.annotations.submariner\.io/globalIp}')[0m
2021-07-19T08:19:02.9976649Z [36m[submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}[0m
2021-07-19T08:19:03.0000179Z [36m[submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}[0m
2021-07-19T08:19:03.0024114Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}[0m
2021-07-19T08:19:03.2880630Z [36m[submariner-operator]$ [cluster1] gip=$(kubectl get giip "$svc_name" -o jsonpath='{.status.allocatedIP}')[0m
2021-07-19T08:19:03.2901131Z [36m[submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}[0m
2021-07-19T08:19:03.2913899Z [36m[submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}[0m
2021-07-19T08:19:03.2931465Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get giip nginx-demo -o jsonpath={.status.allocatedIP}[0m
2021-07-19T08:19:03.5780460Z Error from server (NotFound): globalingressips.submariner.io "nginx-demo" not found
2021-07-19T08:19:03.5848860Z [36m[submariner-operator]$ [cluster1] sleep 1[0m
2021-07-19T08:19:04.5878519Z [36m[submariner-operator]$ [cluster1] return 1[0m
2021-07-19T08:19:04.5914816Z [36m[submariner-operator]$ [cluster1] get_globalip nginx-demo[0m
2021-07-19T08:19:04.5918648Z [36m[submariner-operator]$ [cluster1] wait 7703[0m
2021-07-19T08:19:04.5925799Z [36m[submariner-operator]$ [cluster1] get_globalip[0m
2021-07-19T08:19:04.5943077Z [36m[submariner-operator]$ [cluster1] gip=$(kubectl get svc "$svc_name" -o jsonpath='{.metadata.annotations.submariner\.io/globalIp}')[0m
2021-07-19T08:19:04.5961070Z [36m[submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}[0m
2021-07-19T08:19:04.5972742Z [36m[submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}[0m
2021-07-19T08:19:04.5984281Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}[0m
2021-07-19T08:19:04.8793870Z [36m[submariner-operator]$ [cluster1] gip=$(kubectl get giip "$svc_name" -o jsonpath='{.status.allocatedIP}')[0m
2021-07-19T08:19:04.8815456Z [36m[submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}[0m
2021-07-19T08:19:04.8828680Z [36m[submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}[0m
2021-07-19T08:19:04.8842765Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get giip nginx-demo -o jsonpath={.status.allocatedIP}[0m
2021-07-19T08:19:05.1951237Z [36m[submariner-operator]$ [cluster1] return 0[0m
2021-07-19T08:19:05.1974021Z [36m[submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-789f6cf54f-drzcm 242.254.1.252[0m
2021-07-19T08:19:05.1990089Z [36m[submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-789f6cf54f-drzcm 242.254.1.252[0m
2021-07-19T08:19:05.2009151Z [36m[submariner-operator]$ [cluster2] iteration=1[0m
2021-07-19T08:19:05.2064567Z [36m[submariner-operator]$ [cluster2] test_connection netshoot-789f6cf54f-drzcm 242.254.1.252[0m
2021-07-19T08:19:05.9825923Z [36m[submariner-operator]$ [cluster2] test_connection[0m
2021-07-19T08:19:05.9827354Z Attempting connectivity between clusters - netshoot-789f6cf54f-drzcm --> 242.254.1.252
2021-07-19T08:19:05.9828550Z [36m[submariner-operator]$ [cluster2] wait_time=30[0m
2021-07-19T08:19:05.9829668Z [36m[submariner-operator]$ [cluster2] start_time=$(date +%s)[0m
2021-07-19T08:19:05.9830681Z [36m[submariner-operator]$ [cluster2] wait 7733[0m
2021-07-19T08:19:05.9831614Z [36m[submariner-operator]$ [cluster2] date +%s[0m
2021-07-19T08:19:05.9833057Z [36m[submariner-operator]$ [cluster2] kubectl exec netshoot-789f6cf54f-drzcm -- curl --output /dev/null -m 30 --silent --head --fail 242.254.1.252[0m
2021-07-19T08:19:05.9835208Z [36m[submariner-operator]$ [cluster2] kubectl exec netshoot-789f6cf54f-drzcm -- curl --output /dev/null -m 30 --silent --head --fail 242.254.1.252[0m
2021-07-19T08:19:05.9837214Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-789f6cf54f-drzcm -- curl --output /dev/null -m 30 --silent --head --fail 242.254.1.252[0m
2021-07-19T08:19:05.9838921Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-19T08:19:05.9840221Z [36m[submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-19T08:19:05.9841723Z [36m[submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-19T08:19:05.9843471Z [36m[submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-19T08:19:05.9845519Z [36m[submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-19T08:19:05.9847443Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-19T08:19:05.9849788Z Connection test was successful!
2021-07-19T08:19:06.1092979Z deployment.apps "netshoot" deleted
2021-07-19T08:19:06.1167155Z [36m[submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-19T08:19:06.1187448Z [36m[submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-19T08:19:06.1205395Z [36m[submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-19T08:19:06.1218127Z [36m[submariner-operator]$ [cluster1] remove_resource[0m
2021-07-19T08:19:06.1243357Z [36m[submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-19T08:19:06.1256653Z [36m[submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-19T08:19:06.1279642Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-19T08:19:06.4271476Z deployment.apps "nginx-demo" deleted
2021-07-19T08:19:06.5816310Z service "nginx-demo" deleted
2021-07-19T08:19:06.6073902Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-19T08:19:06.6214358Z [36m[submariner-operator]$ [cluster2] run_if_defined post_deploy[0m
2021-07-19T08:19:06.6256424Z [36m[submariner-operator]$ [cluster2] run_if_defined post_deploy[0m
2021-07-19T08:19:06.6284519Z [36m[submariner-operator]$ [cluster2] type -t post_deploy[0m
2021-07-19T08:19:06.6428985Z [36m[submariner-operator]$ [cluster2] grep -q function[0m
2021-07-19T08:19:06.6474575Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-19T08:19:06.6487193Z   Successfully remade target file 'deploy'.
2021-07-19T08:19:06.6487999Z Must remake target 'e2e'.
2021-07-19T08:19:06.6488668Z scripts/kind-e2e/e2e.sh
2021-07-19T08:19:06.6571193Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/utils[0m
2021-07-19T08:19:06.6612663Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:19:06.6631679Z [36m[submariner-operator]$ script_name=utils[0m
2021-07-19T08:19:06.6674271Z [36m[submariner-operator]$ exec_name=e2e.sh[0m
2021-07-19T08:19:06.6748135Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs[0m
2021-07-19T08:19:06.6778994Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:19:06.6798125Z [36m[submariner-operator]$ script_name=deploy_funcs[0m
2021-07-19T08:19:06.6813811Z [36m[submariner-operator]$ exec_name=e2e.sh[0m
2021-07-19T08:19:06.6846206Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_operator[0m
2021-07-19T08:19:06.6878967Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:19:06.6923323Z [36m[submariner-operator]$ script_name=deploy_operator[0m
2021-07-19T08:19:06.6943509Z [36m[submariner-operator]$ exec_name=e2e.sh[0m
2021-07-19T08:19:06.6967786Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings[0m
2021-07-19T08:19:06.6994754Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:19:06.7007535Z [36m[submariner-operator]$ script_name=cluster_settings[0m
2021-07-19T08:19:06.7022237Z [36m[submariner-operator]$ exec_name=e2e.sh[0m
2021-07-19T08:19:06.7047705Z [36m[submariner-operator]$ broker=cluster1[0m
2021-07-19T08:19:06.7061417Z [36m[submariner-operator]$ declare -gA cluster_nodes[0m
2021-07-19T08:19:06.7074844Z [36m[submariner-operator]$ cluster_nodes[cluster1]=control-plane worker[0m
2021-07-19T08:19:06.7087304Z [36m[submariner-operator]$ cluster_nodes[cluster2]=control-plane worker[0m
2021-07-19T08:19:06.7100057Z [36m[submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker[0m
2021-07-19T08:19:06.7111664Z [36m[submariner-operator]$ declare -gA cluster_subm[0m
2021-07-19T08:19:06.7126364Z [36m[submariner-operator]$ cluster_subm[cluster1]=true[0m
2021-07-19T08:19:06.7140059Z [36m[submariner-operator]$ cluster_subm[cluster2]=true[0m
2021-07-19T08:19:06.7161756Z [36m[submariner-operator]$ cluster_subm[cluster3]=true[0m
2021-07-19T08:19:06.7177406Z [36m[submariner-operator]$ declare -gA cluster_cni[0m
2021-07-19T08:19:06.7189244Z [36m[submariner-operator]$ cluster_cni[cluster2]=weave[0m
2021-07-19T08:19:06.7202169Z [36m[submariner-operator]$ cluster_cni[cluster3]=weave[0m
2021-07-19T08:19:06.7217364Z [36m[submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings[0m
2021-07-19T08:19:06.7246870Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-19T08:19:06.7266587Z [36m[submariner-operator]$ script_name=cluster_settings[0m
2021-07-19T08:19:06.7282398Z [36m[submariner-operator]$ exec_name=e2e.sh[0m
2021-07-19T08:19:06.7341741Z [36m[submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker[0m
2021-07-19T08:19:06.7358180Z [36m[submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker[0m
2021-07-19T08:19:06.7399460Z [36m[submariner-operator]$ globalnet=true[0m
2021-07-19T08:19:06.7419002Z [36m[submariner-operator]$ timeout=2m[0m
2021-07-19T08:19:06.7434034Z [36m[submariner-operator]$ declare_kubeconfig[0m
2021-07-19T08:19:06.7453159Z [36m[submariner-operator]$ declare_kubeconfig[0m
2021-07-19T08:19:06.7467670Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg[0m
2021-07-19T08:19:06.7495675Z [36m[submariner-operator]$ export KUBECONFIG[0m
2021-07-19T08:19:06.7512948Z [36m[submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)[0m
2021-07-19T08:19:06.7535737Z [36m[submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:[0m
2021-07-19T08:19:06.7593848Z [36m[submariner-operator]$ . /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/lib_operator_verify_subm.sh[0m
2021-07-19T08:19:06.7625313Z [36m[submariner-operator]$ create_subm_vars[0m
2021-07-19T08:19:06.7636515Z [36m[submariner-operator]$ create_subm_vars[0m
2021-07-19T08:19:06.7652127Z [36m[submariner-operator]$ deployment_name=submariner[0m
2021-07-19T08:19:06.7664502Z [36m[submariner-operator]$ operator_deployment_name=submariner-operator[0m
2021-07-19T08:19:06.7680213Z [36m[submariner-operator]$ gateway_deployment_name=submariner-gateway[0m
2021-07-19T08:19:06.7693191Z [36m[submariner-operator]$ routeagent_deployment_name=submariner-routeagent[0m
2021-07-19T08:19:06.7703660Z [36m[submariner-operator]$ broker_deployment_name=submariner-k8s-broker[0m
2021-07-19T08:19:06.7714952Z [36m[submariner-operator]$ globalnet_deployment_name=submariner-globalnet[0m
2021-07-19T08:19:06.7728564Z [36m[submariner-operator]$ declare_cidrs[0m
2021-07-19T08:19:06.7742734Z [36m[submariner-operator]$ declare_cidrs[0m
2021-07-19T08:19:06.7757009Z [36m[submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs[0m
2021-07-19T08:19:06.7772937Z [36m[submariner-operator]$ i=1[0m
2021-07-19T08:19:06.7789061Z [36m[submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1[0m
2021-07-19T08:19:06.7806728Z [36m[submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1[0m
2021-07-19T08:19:06.7820596Z [36m[submariner-operator]$ [cluster1] val=0[0m
2021-07-19T08:19:06.7831563Z [36m[submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.0.0.0/16[0m
2021-07-19T08:19:06.7848100Z [36m[submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.0.0.0/16[0m
2021-07-19T08:19:06.7860989Z [36m[submariner-operator]$ [cluster1] global_CIDRs[cluster1]=242.254.1.0/24[0m
2021-07-19T08:19:06.7873883Z [36m[submariner-operator]$ [cluster1] i=$(("$i"+1))[0m
2021-07-19T08:19:06.7885789Z [36m[submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2[0m
2021-07-19T08:19:06.7901402Z [36m[submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2[0m
2021-07-19T08:19:06.7916683Z [36m[submariner-operator]$ [cluster2] val=0[0m
2021-07-19T08:19:06.7930116Z [36m[submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.0.0.0/16[0m
2021-07-19T08:19:06.7946725Z [36m[submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.0.0.0/16[0m
2021-07-19T08:19:06.7974242Z [36m[submariner-operator]$ [cluster2] global_CIDRs[cluster2]=242.254.2.0/24[0m
2021-07-19T08:19:06.7984987Z [36m[submariner-operator]$ [cluster2] i=$(("$i"+1))[0m
2021-07-19T08:19:06.7995983Z [36m[submariner-operator]$ [cluster2] natEnabled=false[0m
2021-07-19T08:19:06.8007258Z [36m[submariner-operator]$ [cluster2] subm_gateway_image_repo=localhost:5000[0m
2021-07-19T08:19:06.8017481Z [36m[submariner-operator]$ [cluster2] subm_gateway_image_tag=local[0m
2021-07-19T08:19:06.8030762Z [36m[submariner-operator]$ [cluster2] subm_gateway_size=3[0m
2021-07-19T08:19:06.8044877Z [36m[submariner-operator]$ [cluster2] subm_colorcodes=blue[0m
2021-07-19T08:19:06.8057267Z [36m[submariner-operator]$ [cluster2] subm_debug=false[0m
2021-07-19T08:19:06.8071297Z [36m[submariner-operator]$ [cluster2] subm_broker=k8s[0m
2021-07-19T08:19:06.8089566Z [36m[submariner-operator]$ [cluster2] ce_ipsec_debug=false[0m
2021-07-19T08:19:06.8102528Z [36m[submariner-operator]$ [cluster2] ce_ipsec_ikeport=500[0m
2021-07-19T08:19:06.8114786Z [36m[submariner-operator]$ [cluster2] ce_ipsec_nattport=4500[0m
2021-07-19T08:19:06.8129008Z [36m[submariner-operator]$ [cluster2] subm_ns=submariner-operator[0m
2021-07-19T08:19:06.8139832Z [36m[submariner-operator]$ [cluster2] SUBMARINER_BROKER_NS=submariner-k8s-broker[0m
2021-07-19T08:19:06.8161177Z [36m[submariner-operator]$ [cluster2] with_context cluster1 broker_vars[0m
2021-07-19T08:19:06.8175431Z [36m[submariner-operator]$ [cluster2] with_context cluster1 broker_vars[0m
2021-07-19T08:19:06.8191788Z [36m[submariner-operator]$ [cluster1] broker_vars[0m
2021-07-19T08:19:06.8206369Z [36m[submariner-operator]$ [cluster1] broker_vars[0m
2021-07-19T08:19:06.8221533Z [36m[submariner-operator]$ [cluster1] SUBMARINER_BROKER_URL=$(kubectl -n default get endpoints kubernetes -o jsonpath="{.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}")[0m
2021-07-19T08:19:06.8242158Z [36m[submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}[0m
2021-07-19T08:19:06.8256307Z [36m[submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}[0m
2021-07-19T08:19:06.8272478Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}[0m
2021-07-19T08:19:07.2373799Z [36m[submariner-operator]$ [cluster1] SUBMARINER_BROKER_CA=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data['ca\.crt']}")[0m
2021-07-19T08:19:07.2399818Z [36m[submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}[0m
2021-07-19T08:19:07.2414158Z [36m[submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}[0m
2021-07-19T08:19:07.2432680Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}[0m
2021-07-19T08:19:07.5429231Z [36m[submariner-operator]$ [cluster1] SUBMARINER_BROKER_TOKEN=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data.token}"|base64 --decode)[0m
2021-07-19T08:19:07.5450416Z [36m[submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}[0m
2021-07-19T08:19:07.5472921Z [36m[submariner-operator]$ [cluster1] base64 --decode[0m
2021-07-19T08:19:07.5475194Z [36m[submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}[0m
2021-07-19T08:19:07.5487752Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}[0m
2021-07-19T08:19:07.8909656Z [36m[submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets[0m
2021-07-19T08:19:07.8923076Z [36m[submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets[0m
2021-07-19T08:19:07.8937358Z [36m[submariner-operator]$ [cluster1] verify_subm_broker_secrets[0m
2021-07-19T08:19:07.8949816Z [36m[submariner-operator]$ [cluster1] verify_subm_broker_secrets[0m
2021-07-19T08:19:07.9556147Z [36m[submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEE0TVRFeE1Gb1hEVE14TURjeE56QTRNVEV4TUZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHdICnF5a0h5TFhlRmFUZmNoNlNRb25iL0FqTUNOZ21tVUZvS0duc1JwdWlEem03Q1ZtcDdtUlJQUkQ4SEN2dThUOTcKcHFTVjFRYmNaTWFuMXFhZGhRQlhxWFVnRGlqQXhBN0ZzMlZzcjZZNEU2b2NiTWZOMXZPVDNrMkRZUFE0MVhHcQpucmVYSjdpQzVYT0VKK0ZlUTNKL0RZK3JmUk4vUmh1Um9icHV2eWFqQnB5QzEyWWpvb2ZpWEVURGhDTjNUcWxlCnMvNGJPSE00dTBGWEhESERvZkE2SmRaVnFYYkZpcytLZUJBL2VobkJ6Y2t1ekpYcTlFOVhtZVRFUFNlMG00N3kKT1RMVTFabHFobStIdDl4dWViWEpiWFozamF4dHgvRGoxeVRnQk8xZUpINzFWRW5VdTRObjhNQUxuZU8rbklaeApFV0Z4NHdEalIvN081WEdxdnYwQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFET3ExSFZHbHJxdGNjYy9ZbUc1ZnVJWGdkb2MKK3huOGhKRjJiOUNiQU5rR2syVmJ5dmNRUzgwNU9wcHJmN2JnSEF2UmI5cjJXVmZPYzBBdHI4L3d3d2FOaEZYawpRMkhJcVo0SlhoZEg4S2pFbTFEekM3ODYvRDBUUEZOcGJ1MCtuQk00Z0JwTk1Ed3QzUlludldiZUQ0OFdGS1hDCk1DUi82Vk8rRk5nRk9kaTVVbVBqQlA4Z1ljTDZudHNTa0poY04rUE9WTm9sVklaVHIxWitmcnphRE9ya1VNZEcKNDI3SWppem0zU3NtUWJaZ0pjcW1aVTZPbEx3M05UcXQwNEl3bmRUaFJ4cU1WWC9BYVhXZlRtSVducDZYZmVCWApKbEZJWDg0UFFoTE9Sd3ZObEQrazMrWUsralM5cDlPT1c3TFpnUEUvdUhKbU8rUmZONUwzRE1hTEJ3QT0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-19T08:19:08.0600729Z [36m[submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEE0TVRFeE1Gb1hEVE14TURjeE56QTRNVEV4TUZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHdICnF5a0h5TFhlRmFUZmNoNlNRb25iL0FqTUNOZ21tVUZvS0duc1JwdWlEem03Q1ZtcDdtUlJQUkQ4SEN2dThUOTcKcHFTVjFRYmNaTWFuMXFhZGhRQlhxWFVnRGlqQXhBN0ZzMlZzcjZZNEU2b2NiTWZOMXZPVDNrMkRZUFE0MVhHcQpucmVYSjdpQzVYT0VKK0ZlUTNKL0RZK3JmUk4vUmh1Um9icHV2eWFqQnB5QzEyWWpvb2ZpWEVURGhDTjNUcWxlCnMvNGJPSE00dTBGWEhESERvZkE2SmRaVnFYYkZpcytLZUJBL2VobkJ6Y2t1ekpYcTlFOVhtZVRFUFNlMG00N3kKT1RMVTFabHFobStIdDl4dWViWEpiWFozamF4dHgvRGoxeVRnQk8xZUpINzFWRW5VdTRObjhNQUxuZU8rbklaeApFV0Z4NHdEalIvN081WEdxdnYwQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFET3ExSFZHbHJxdGNjYy9ZbUc1ZnVJWGdkb2MKK3huOGhKRjJiOUNiQU5rR2syVmJ5dmNRUzgwNU9wcHJmN2JnSEF2UmI5cjJXVmZPYzBBdHI4L3d3d2FOaEZYawpRMkhJcVo0SlhoZEg4S2pFbTFEekM3ODYvRDBUUEZOcGJ1MCtuQk00Z0JwTk1Ed3QzUlludldiZUQ0OFdGS1hDCk1DUi82Vk8rRk5nRk9kaTVVbVBqQlA4Z1ljTDZudHNTa0poY04rUE9WTm9sVklaVHIxWitmcnphRE9ya1VNZEcKNDI3SWppem0zU3NtUWJaZ0pjcW1aVTZPbEx3M05UcXQwNEl3bmRUaFJ4cU1WWC9BYVhXZlRtSVducDZYZmVCWApKbEZJWDg0UFFoTE9Sd3ZObEQrazMrWUsralM5cDlPT1c3TFpnUEUvdUhKbU8rUmZONUwzRE1hTEJ3QT0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-19T08:19:08.1197696Z [36m[submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker[0m
2021-07-19T08:19:08.1199202Z [36m[submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker[0m
2021-07-19T08:19:08.1200801Z [36m[submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker[0m
2021-07-19T08:19:08.1201677Z [36m[submariner-operator]$ [cluster1] grep -q submariner-[0m
2021-07-19T08:19:08.1202546Z [36m[submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker[0m
2021-07-19T08:19:08.1203644Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret -n submariner-k8s-broker[0m
2021-07-19T08:19:08.3473632Z [36m[submariner-operator]$ [cluster1] return[0m
2021-07-19T08:19:08.3492092Z [36m[submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker[0m
2021-07-19T08:19:08.3509534Z [36m[submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker[0m
2021-07-19T08:19:08.3541529Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker[0m
2021-07-19T08:19:08.6369624Z NAME                                       TYPE                                  DATA   AGE
2021-07-19T08:19:08.6373723Z cluster-cluster1-token-85ftr               kubernetes.io/service-account-token   3      71s
2021-07-19T08:19:08.6375382Z cluster-cluster2-token-qn65x               kubernetes.io/service-account-token   3      65s
2021-07-19T08:19:08.6376866Z default-token-dbkjw                        kubernetes.io/service-account-token   3      89s
2021-07-19T08:19:08.6378559Z submariner-k8s-broker-admin-token-9kzhf    kubernetes.io/service-account-token   3      89s
2021-07-19T08:19:08.6380514Z submariner-k8s-broker-client-token-mkk44   kubernetes.io/service-account-token   3      89s
2021-07-19T08:19:08.6439176Z [36m[submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}[0m
2021-07-19T08:19:08.6452566Z [36m[submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}[0m
2021-07-19T08:19:08.6503753Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}[0m
2021-07-19T08:19:08.9758890Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/submariner-k8s-broker-client-token-mkk44.cluster1.json[0m
2021-07-19T08:19:08.9772786Z [36m[submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-mkk44 -n submariner-k8s-broker -o json[0m
2021-07-19T08:19:08.9791905Z [36m[submariner-operator]$ [cluster1] tee /tmp/submariner-k8s-broker-client-token-mkk44.cluster1.json[0m
2021-07-19T08:19:08.9824915Z [36m[submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-mkk44 -n submariner-k8s-broker -o json[0m
2021-07-19T08:19:08.9844816Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret submariner-k8s-broker-client-token-mkk44 -n submariner-k8s-broker -o json[0m
2021-07-19T08:19:09.2655611Z {
2021-07-19T08:19:09.2656078Z     "apiVersion": "v1",
2021-07-19T08:19:09.2656457Z     "data": {
2021-07-19T08:19:09.3398651Z         "ca.crt": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEE0TVRFeE1Gb1hEVE14TURjeE56QTRNVEV4TUZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHdICnF5a0h5TFhlRmFUZmNoNlNRb25iL0FqTUNOZ21tVUZvS0duc1JwdWlEem03Q1ZtcDdtUlJQUkQ4SEN2dThUOTcKcHFTVjFRYmNaTWFuMXFhZGhRQlhxWFVnRGlqQXhBN0ZzMlZzcjZZNEU2b2NiTWZOMXZPVDNrMkRZUFE0MVhHcQpucmVYSjdpQzVYT0VKK0ZlUTNKL0RZK3JmUk4vUmh1Um9icHV2eWFqQnB5QzEyWWpvb2ZpWEVURGhDTjNUcWxlCnMvNGJPSE00dTBGWEhESERvZkE2SmRaVnFYYkZpcytLZUJBL2VobkJ6Y2t1ekpYcTlFOVhtZVRFUFNlMG00N3kKT1RMVTFabHFobStIdDl4dWViWEpiWFozamF4dHgvRGoxeVRnQk8xZUpINzFWRW5VdTRObjhNQUxuZU8rbklaeApFV0Z4NHdEalIvN081WEdxdnYwQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFET3ExSFZHbHJxdGNjYy9ZbUc1ZnVJWGdkb2MKK3huOGhKRjJiOUNiQU5rR2syVmJ5dmNRUzgwNU9wcHJmN2JnSEF2UmI5cjJXVmZPYzBBdHI4L3d3d2FOaEZYawpRMkhJcVo0SlhoZEg4S2pFbTFEekM3ODYvRDBUUEZOcGJ1MCtuQk00Z0JwTk1Ed3QzUlludldiZUQ0OFdGS1hDCk1DUi82Vk8rRk5nRk9kaTVVbVBqQlA4Z1ljTDZudHNTa0poY04rUE9WTm9sVklaVHIxWitmcnphRE9ya1VNZEcKNDI3SWppem0zU3NtUWJaZ0pjcW1aVTZPbEx3M05UcXQwNEl3bmRUaFJ4cU1WWC9BYVhXZlRtSVducDZYZmVCWApKbEZJWDg0UFFoTE9Sd3ZObEQrazMrWUsralM5cDlPT1c3TFpnUEUvdUhKbU8rUmZONUwzRE1hTEJ3QT0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=",
2021-07-19T08:19:09.4176887Z         "namespace": "c3VibWFyaW5lci1rOHMtYnJva2Vy",
2021-07-19T08:19:09.4785565Z         "token": "ZXlKaGJHY2lPaUpTVXpJMU5pSXNJbXRwWkNJNklsVmlPVmhwVDJ0NFVqVXpWM1ZwWlV4WmFHTllWalpVV2xsemNFWmpSVXAxTjJ0ck1qUkZjUzFqVEVFaWZRLmV5SnBjM01pT2lKcmRXSmxjbTVsZEdWekwzTmxjblpwWTJWaFkyTnZkVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXVZVzFsYzNCaFkyVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJaUxDSnJkV0psY201bGRHVnpMbWx2TDNObGNuWnBZMlZoWTJOdmRXNTBMM05sWTNKbGRDNXVZVzFsSWpvaWMzVmliV0Z5YVc1bGNpMXJPSE10WW5KdmEyVnlMV05zYVdWdWRDMTBiMnRsYmkxdGEyczBOQ0lzSW10MVltVnlibVYwWlhNdWFXOHZjMlZ5ZG1salpXRmpZMjkxYm5RdmMyVnlkbWxqWlMxaFkyTnZkVzUwTG01aGJXVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXpaWEoyYVdObExXRmpZMjkxYm5RdWRXbGtJam9pWldVME1EazVORGN0TkdKaU9TMDBNelUwTFdKaFpqSXRaakJpTUdVME5USmlZbUUwSWl3aWMzVmlJam9pYzNsemRHVnRPbk5sY25acFkyVmhZMk52ZFc1ME9uTjFZbTFoY21sdVpYSXRhemh6TFdKeWIydGxjanB6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSW4wLnllTkx4dDFMelBheEhsRzRFRVFFM1ljczF0TFRyRjB6X0NuNTVCcUlBa2tpMEZ6ZDhVUHpNWVBrWlhybW54Yk12akRFMEZpMFlPVDhhNTd0V190blBnM09Oam5RWjliUHRpQzZsMzZtcEpjV0RDRXlIYnNkVlFST3AyLTA0N0hfRkxkZEotN0xYWGlPb0JnRGRHR3h6X01ERGhIUDFNT3cydm5TZkxjTzZlQTVyeEx5RWFSS28yRWFOdF9OOWhMa0k4MWtBWkRmdElOaFlXM3N3QlgySE9vVy14eEtCYkRDQnY2M0VHRzM4TGEzWm51Z1Z0QjNBU3Z5NU5PZUt3eUZ3V0NtWm9CTzZ1MlNTVjJzcXJQN25rNmxfYkJvZm1RUWU4ZncwaXA4ZXQzVnNpandDcWZGU2JwOGdrcldSc0JFYWIxT01CQ2FLYXk5YThxN1ZfY0JIZw=="
2021-07-19T08:19:09.5272385Z     },
2021-07-19T08:19:09.5272837Z     "kind": "Secret",
2021-07-19T08:19:09.5273268Z     "metadata": {
2021-07-19T08:19:09.5273717Z         "annotations": {
2021-07-19T08:19:09.5275615Z             "kubernetes.io/service-account.name": "submariner-k8s-broker-client",
2021-07-19T08:19:09.5277140Z             "kubernetes.io/service-account.uid": "ee409947-4bb9-4354-baf2-f0b0e452bba4"
2021-07-19T08:19:09.5277900Z         },
2021-07-19T08:19:09.5278581Z         "creationTimestamp": "2021-07-19T08:17:39Z",
2021-07-19T08:19:09.5279740Z         "name": "submariner-k8s-broker-client-token-mkk44",
2021-07-19T08:19:09.5281031Z         "namespace": "submariner-k8s-broker",
2021-07-19T08:19:09.5281656Z         "resourceVersion": "1612",
2021-07-19T08:19:09.5283019Z         "selfLink": "/api/v1/namespaces/submariner-k8s-broker/secrets/submariner-k8s-broker-client-token-mkk44",
2021-07-19T08:19:09.5284489Z         "uid": "a1e94f48-7a0e-4aba-b3ea-2c7a509f9b49"
2021-07-19T08:19:09.5285327Z     },
2021-07-19T08:19:09.5286069Z     "type": "kubernetes.io/service-account-token"
2021-07-19T08:19:09.5286618Z }
2021-07-19T08:19:09.5287525Z [36m[submariner-operator]$ [cluster1] validate_equals .kind Secret[0m
2021-07-19T08:19:09.5288592Z [36m[submariner-operator]$ [cluster1] validate_equals .kind Secret[0m
2021-07-19T08:19:09.5290339Z [36m[submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner-k8s-broker-client-token-mkk44.cluster1.json[0m
2021-07-19T08:19:09.5292316Z [36m[submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token[0m
2021-07-19T08:19:09.5293781Z [36m[submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token[0m
2021-07-19T08:19:09.5295761Z [36m[submariner-operator]$ [cluster1] jq -r -M .type /tmp/submariner-k8s-broker-client-token-mkk44.cluster1.json[0m
2021-07-19T08:19:09.5297971Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-mkk44[0m
2021-07-19T08:19:09.5299739Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-mkk44[0m
2021-07-19T08:19:09.5301742Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner-k8s-broker-client-token-mkk44.cluster1.json[0m
2021-07-19T08:19:09.5303488Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker[0m
2021-07-19T08:19:09.5304827Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker[0m
2021-07-19T08:19:09.5307216Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner-k8s-broker-client-token-mkk44.cluster1.json[0m
2021-07-19T08:19:09.5309772Z [36m[submariner-operator]$ [cluster1] jq -r -M .data["ca.crt"] /tmp/submariner-k8s-broker-client-token-mkk44.cluster1.json[0m
2021-07-19T08:19:09.5399909Z [36m[submariner-operator]$ [cluster1] one_ca_crt_ok=true[0m
2021-07-19T08:19:09.5415970Z [36m[submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed[0m
2021-07-19T08:19:09.5429769Z [36m[submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed[0m
2021-07-19T08:19:09.5445676Z [36m[submariner-operator]$ [cluster2] declare -a subm_clusters[0m
2021-07-19T08:19:09.5478923Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 verify_subm_deployed[0m
2021-07-19T08:19:09.5494319Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 verify_subm_deployed[0m
2021-07-19T08:19:09.5513610Z [36m[submariner-operator]$ [cluster2] declare -A pids[0m
2021-07-19T08:19:09.5536229Z [36m[submariner-operator]$ [cluster2] eval echo cluster1 cluster2[0m
2021-07-19T08:19:09.5559701Z [36m[submariner-operator]$ [cluster1] pids[cluster1]=7985[0m
2021-07-19T08:19:09.5568759Z [36m[submariner-operator]$ [cluster1] set -o pipefail[0m
2021-07-19T08:19:09.5583175Z [36m[submariner-operator]$ [cluster1] verify_subm_deployed[0m
2021-07-19T08:19:09.5594758Z [36m[submariner-operator]$ [cluster2] set -o pipefail[0m
2021-07-19T08:19:09.5599118Z [36m[submariner-operator]$ [cluster2] pids[cluster2]=7988[0m
2021-07-19T08:19:09.5615232Z [36m[submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /[0m
2021-07-19T08:19:09.5625085Z [36m[submariner-operator]$ [cluster2] wait 7988[0m
2021-07-19T08:19:09.5633847Z [36m[submariner-operator]$ [cluster2] verify_subm_deployed[0m
2021-07-19T08:19:09.5703025Z [36m[submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /[0m
2021-07-19T08:19:10.3396806Z [36m[submariner-operator]$ [cluster1] verify_subm_deployed[0m
2021-07-19T08:19:10.3398019Z [36m[submariner-operator]$ [cluster1] verify_endpoints_crd[0m
2021-07-19T08:19:10.3399175Z [36m[submariner-operator]$ [cluster1] verify_endpoints_crd[0m
2021-07-19T08:19:10.3400642Z [36m[submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint[0m
2021-07-19T08:19:10.3402040Z [36m[submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint[0m
2021-07-19T08:19:10.3403374Z [36m[submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io[0m
2021-07-19T08:19:10.3404690Z [36m[submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io[0m
2021-07-19T08:19:10.3406752Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds endpoints.submariner.io[0m
2021-07-19T08:19:10.3407698Z [cluster1] NAME                      CREATED AT
2021-07-19T08:19:10.3408546Z [cluster1] endpoints.submariner.io   2021-07-19T08:17:48Z
2021-07-19T08:19:10.3409908Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-19T08:19:10.3411449Z [36m[submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json[0m
2021-07-19T08:19:10.3413074Z [36m[submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json[0m
2021-07-19T08:19:10.3414466Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd endpoints.submariner.io -o json[0m
2021-07-19T08:19:10.3415895Z [36m[submariner-operator]$ [cluster1] tee /tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-19T08:19:10.3416720Z [cluster1] {
2021-07-19T08:19:10.3417251Z [cluster1]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T08:19:10.3417955Z [cluster1]     "kind": "CustomResourceDefinition",
2021-07-19T08:19:10.3418521Z [cluster1]     "metadata": {
2021-07-19T08:19:10.3418937Z [cluster1]         "annotations": {
2021-07-19T08:19:10.3419764Z [cluster1]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T08:19:10.3420560Z [cluster1]         },
2021-07-19T08:19:10.3421265Z [cluster1]         "creationTimestamp": "2021-07-19T08:17:48Z",
2021-07-19T08:19:10.3421857Z [cluster1]         "generation": 1,
2021-07-19T08:19:10.3422504Z [cluster1]         "name": "endpoints.submariner.io",
2021-07-19T08:19:10.3423202Z [cluster1]         "resourceVersion": "1738",
2021-07-19T08:19:10.3424307Z [cluster1]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/endpoints.submariner.io",
2021-07-19T08:19:10.3425446Z [cluster1]         "uid": "0d490267-79c2-47fd-b577-58162ff148de"
2021-07-19T08:19:10.3425898Z [cluster1]     },
2021-07-19T08:19:10.3426259Z [cluster1]     "spec": {
2021-07-19T08:19:10.3426668Z [cluster1]         "conversion": {
2021-07-19T08:19:10.3427095Z [cluster1]             "strategy": "None"
2021-07-19T08:19:10.3427488Z [cluster1]         },
2021-07-19T08:19:10.3427905Z [cluster1]         "group": "submariner.io",
2021-07-19T08:19:10.3428350Z [cluster1]         "names": {
2021-07-19T08:19:10.3428756Z [cluster1]             "kind": "Endpoint",
2021-07-19T08:19:10.3429249Z [cluster1]             "listKind": "EndpointList",
2021-07-19T08:19:10.3429749Z [cluster1]             "plural": "endpoints",
2021-07-19T08:19:10.3430240Z [cluster1]             "singular": "endpoint"
2021-07-19T08:19:10.3430639Z [cluster1]         },
2021-07-19T08:19:10.3431054Z [cluster1]         "scope": "Namespaced",
2021-07-19T08:19:10.3431506Z [cluster1]         "versions": [
2021-07-19T08:19:10.3431875Z [cluster1]             {
2021-07-19T08:19:10.3432365Z [cluster1]                 "name": "v1",
2021-07-19T08:19:10.3432703Z [cluster1]                 "schema": {
2021-07-19T08:19:10.3433234Z [cluster1]                     "openAPIV3Schema": {
2021-07-19T08:19:10.3433670Z [cluster1]                         "properties": {
2021-07-19T08:19:10.3434085Z [cluster1]                             "apiVersion": {
2021-07-19T08:19:10.3435766Z [cluster1]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T08:19:10.3437097Z [cluster1]                                 "type": "string"
2021-07-19T08:19:10.3437463Z [cluster1]                             },
2021-07-19T08:19:10.3437972Z [cluster1]                             "kind": {
2021-07-19T08:19:10.3439834Z [cluster1]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T08:19:10.3441324Z [cluster1]                                 "type": "string"
2021-07-19T08:19:10.3441733Z [cluster1]                             },
2021-07-19T08:19:10.3442143Z [cluster1]                             "metadata": {
2021-07-19T08:19:10.3442588Z [cluster1]                                 "type": "object"
2021-07-19T08:19:10.3443069Z [cluster1]                             },
2021-07-19T08:19:10.3443461Z [cluster1]                             "spec": {
2021-07-19T08:19:10.3443900Z [cluster1]                                 "properties": {
2021-07-19T08:19:10.3444577Z [cluster1]                                     "backend": {
2021-07-19T08:19:10.3445331Z [cluster1]                                         "type": "string"
2021-07-19T08:19:10.3445833Z [cluster1]                                     },
2021-07-19T08:19:10.3487218Z [cluster1]                                     "backend_config": {
2021-07-19T08:19:10.3487848Z [cluster1]                                         "additionalProperties": {
2021-07-19T08:19:10.3488505Z [cluster1]                                             "type": "string"
2021-07-19T08:19:10.3488935Z [cluster1]                                         },
2021-07-19T08:19:10.3489546Z [cluster1]                                         "type": "object"
2021-07-19T08:19:10.3490037Z [cluster1]                                     },
2021-07-19T08:19:10.3490526Z [cluster1]                                     "cable_name": {
2021-07-19T08:19:10.3491056Z [cluster1]                                         "type": "string"
2021-07-19T08:19:10.3491533Z [cluster1]                                     },
2021-07-19T08:19:10.3492011Z [cluster1]                                     "cluster_id": {
2021-07-19T08:19:10.3492532Z [cluster1]                                         "type": "string"
2021-07-19T08:19:10.3493018Z [cluster1]                                     },
2021-07-19T08:19:10.3493535Z [cluster1]                                     "healthCheckIP": {
2021-07-19T08:19:10.3494106Z [cluster1]                                         "type": "string"
2021-07-19T08:19:10.3494585Z [cluster1]                                     },
2021-07-19T08:19:10.3495054Z [cluster1]                                     "hostname": {
2021-07-19T08:19:10.3495575Z [cluster1]                                         "type": "string"
2021-07-19T08:19:10.3496048Z [cluster1]                                     },
2021-07-19T08:19:10.3496533Z [cluster1]                                     "nat_enabled": {
2021-07-19T08:19:10.3497060Z [cluster1]                                         "type": "boolean"
2021-07-19T08:19:10.3497550Z [cluster1]                                     },
2021-07-19T08:19:10.3498025Z [cluster1]                                     "private_ip": {
2021-07-19T08:19:10.3498744Z [cluster1]                                         "type": "string"
2021-07-19T08:19:10.3499240Z [cluster1]                                     },
2021-07-19T08:19:10.3499704Z [cluster1]                                     "public_ip": {
2021-07-19T08:19:10.3500231Z [cluster1]                                         "type": "string"
2021-07-19T08:19:10.3500707Z [cluster1]                                     },
2021-07-19T08:19:10.3501187Z [cluster1]                                     "subnets": {
2021-07-19T08:19:10.3501675Z [cluster1]                                         "items": {
2021-07-19T08:19:10.3502195Z [cluster1]                                             "type": "string"
2021-07-19T08:19:10.3502693Z [cluster1]                                         },
2021-07-19T08:19:10.3503173Z [cluster1]                                         "type": "array"
2021-07-19T08:19:10.3503661Z [cluster1]                                     }
2021-07-19T08:19:10.3504088Z [cluster1]                                 },
2021-07-19T08:19:10.3504631Z [cluster1]                                 "required": [
2021-07-19T08:19:10.3505255Z [cluster1]                                     "backend",
2021-07-19T08:19:10.3505827Z [cluster1]                                     "cable_name",
2021-07-19T08:19:10.3506270Z [cluster1]                                     "cluster_id",
2021-07-19T08:19:10.3506718Z [cluster1]                                     "hostname",
2021-07-19T08:19:10.3507177Z [cluster1]                                     "nat_enabled",
2021-07-19T08:19:10.3507852Z [cluster1]                                     "private_ip",
2021-07-19T08:19:10.3508462Z [cluster1]                                     "public_ip",
2021-07-19T08:19:10.3508898Z [cluster1]                                     "subnets"
2021-07-19T08:19:10.3509313Z [cluster1]                                 ],
2021-07-19T08:19:10.3509725Z [cluster1]                                 "type": "object"
2021-07-19T08:19:10.3510254Z [cluster1]                             }
2021-07-19T08:19:10.3510614Z [cluster1]                         },
2021-07-19T08:19:10.3511022Z [cluster1]                         "required": [
2021-07-19T08:19:10.3511435Z [cluster1]                             "spec"
2021-07-19T08:19:10.3511823Z [cluster1]                         ],
2021-07-19T08:19:10.3512236Z [cluster1]                         "type": "object"
2021-07-19T08:19:10.3512631Z [cluster1]                     }
2021-07-19T08:19:10.3512987Z [cluster1]                 },
2021-07-19T08:19:10.3513377Z [cluster1]                 "served": true,
2021-07-19T08:19:10.3513821Z [cluster1]                 "storage": true
2021-07-19T08:19:10.3514198Z [cluster1]             }
2021-07-19T08:19:10.3514542Z [cluster1]         ]
2021-07-19T08:19:10.3514873Z [cluster1]     },
2021-07-19T08:19:10.3515236Z [cluster1]     "status": {
2021-07-19T08:19:10.3515659Z [cluster1]         "acceptedNames": {
2021-07-19T08:19:10.3516128Z [cluster1]             "kind": "Endpoint",
2021-07-19T08:19:10.3516608Z [cluster1]             "listKind": "EndpointList",
2021-07-19T08:19:10.3517118Z [cluster1]             "plural": "endpoints",
2021-07-19T08:19:10.3517605Z [cluster1]             "singular": "endpoint"
2021-07-19T08:19:10.3518004Z [cluster1]         },
2021-07-19T08:19:10.3518488Z [cluster1]         "conditions": [
2021-07-19T08:19:10.3518812Z [cluster1]             {
2021-07-19T08:19:10.3519661Z [cluster1]                 "lastTransitionTime": "2021-07-19T08:17:48Z",
2021-07-19T08:19:10.3520156Z [cluster1]                 "message": "no conflicts found",
2021-07-19T08:19:10.3520844Z [cluster1]                 "reason": "NoConflicts",
2021-07-19T08:19:10.3521300Z [cluster1]                 "status": "True",
2021-07-19T08:19:10.3521786Z [cluster1]                 "type": "NamesAccepted"
2021-07-19T08:19:10.3522215Z [cluster1]             },
2021-07-19T08:19:10.3522567Z [cluster1]             {
2021-07-19T08:19:10.3523223Z [cluster1]                 "lastTransitionTime": "2021-07-19T08:17:48Z",
2021-07-19T08:19:10.3523940Z [cluster1]                 "message": "the initial names have been accepted",
2021-07-19T08:19:10.3524615Z [cluster1]                 "reason": "InitialNamesAccepted",
2021-07-19T08:19:10.3525291Z [cluster1]                 "status": "True",
2021-07-19T08:19:10.3708592Z [cluster1]        [36m[submariner-operator]$ [cluster2] verify_subm_deployed[0m
2021-07-19T08:19:10.3709556Z [36m[submariner-operator]$ [cluster2] verify_endpoints_crd[0m
2021-07-19T08:19:10.3710845Z [36m[submariner-operator]$ [cluster2] verify_endpoints_crd[0m
2021-07-19T08:19:10.3712068Z [36m[submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint[0m
2021-07-19T08:19:10.3713469Z [36m[submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint[0m
2021-07-19T08:19:10.3714800Z [36m[submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io[0m
2021-07-19T08:19:10.3716129Z [36m[submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io[0m
2021-07-19T08:19:10.3717593Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds endpoints.submariner.io[0m
2021-07-19T08:19:10.3718524Z [cluster2] NAME                      CREATED AT
2021-07-19T08:19:10.3719351Z [cluster2] endpoints.submariner.io   2021-07-19T08:18:04Z
2021-07-19T08:19:10.3720694Z [36m[submariner-operator]$ [cluster2] json_file=/tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-19T08:19:10.3722394Z [36m[submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json[0m
2021-07-19T08:19:10.3723955Z [36m[submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json[0m
2021-07-19T08:19:10.3725826Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd endpoints.submariner.io -o json[0m
2021-07-19T08:19:10.3727489Z [36m[submariner-operator]$ [cluster2] tee /tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-19T08:19:10.3728426Z [cluster2] {
2021-07-19T08:19:10.3729034Z [cluster2]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T08:19:10.3729843Z [cluster2]     "kind": "CustomResourceDefinition",
2021-07-19T08:19:10.3730500Z [cluster2]     "metadata": {
2021-07-19T08:19:10.3730978Z [cluster2]         "annotations": {
2021-07-19T08:19:10.3731913Z [cluster2]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T08:19:10.3732598Z [cluster2]         },
2021-07-19T08:19:10.3733315Z [cluster2]         "creationTimestamp": "2021-07-19T08:18:04Z",
2021-07-19T08:19:10.3733919Z [cluster2]         "generation": 1,
2021-07-19T08:19:10.3734556Z [cluster2]         "name": "endpoints.submariner.io",
2021-07-19T08:19:10.3735253Z [cluster2]         "resourceVersion": "1764",
2021-07-19T08:19:10.3736334Z [cluster2]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/endpoints.submariner.io",
2021-07-19T08:19:10.3737718Z [cluster2]         "uid": "0c07fb99-aee9-4b54-b7d1-19cdfe4c0128"
2021-07-19T08:19:10.3738330Z [cluster2]     },
2021-07-19T08:19:10.3738923Z [cluster2]     "spec": {
2021-07-19T08:19:10.3739411Z [cluster2]         "conversion": {
2021-07-19T08:19:10.3739949Z [cluster2]             "strategy": "None"
2021-07-19T08:19:10.3740435Z [cluster2]         },
2021-07-19T08:19:10.3740957Z [cluster2]         "group": "submariner.io",
2021-07-19T08:19:10.3741576Z [cluster2]         "names": {
2021-07-19T08:19:10.3742035Z [cluster2]             "kind": "Endpoint",
2021-07-19T08:19:10.3742596Z [cluster2]             "listKind": "EndpointList",
2021-07-19T08:19:10.3743173Z [cluster2]             "plural": "endpoints",
2021-07-19T08:19:10.3743740Z [cluster2]             "singular": "endpoint"
2021-07-19T08:19:10.3744200Z [cluster2]         },
2021-07-19T08:19:10.3744675Z [cluster2]         "scope": "Namespaced",
2021-07-19T08:19:10.3745176Z [cluster2]         "versions": [
2021-07-19T08:19:10.3745608Z [cluster2]             {
2021-07-19T08:19:10.3746022Z [cluster2]                 "name": "v1",
2021-07-19T08:19:10.3746476Z [cluster2]                 "schema": {
2021-07-19T08:19:10.3747141Z [cluster2]                     "openAPIV3Schema": {
2021-07-19T08:19:10.3747710Z [cluster2]                         "properties": {
2021-07-19T08:19:10.3748254Z [cluster2]                             "apiVersion": {
2021-07-19T08:19:10.3750743Z [cluster2]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T08:19:10.3752275Z [cluster2]                                 "type": "string"
2021-07-19T08:19:10.3752697Z [cluster2]                             },
2021-07-19T08:19:10.3753077Z [cluster2]                             "kind": {
2021-07-19T08:19:10.3754948Z [cluster2]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T08:19:10.3756434Z [cluster2]                                 "type": "string"
2021-07-19T08:19:10.3756839Z [cluster2]                             },
2021-07-19T08:19:10.3757246Z [cluster2]                             "metadata": {
2021-07-19T08:19:10.3757685Z [cluster2]                                 "type": "object"
2021-07-19T08:19:10.3758183Z [cluster2]                             },
2021-07-19T08:19:10.3758565Z [cluster2]                             "spec": {
2021-07-19T08:19:10.3759018Z [cluster2]                                 "properties": {
2021-07-19T08:19:10.3759481Z [cluster2]                                     "backend": {
2021-07-19T08:19:10.3759923Z [cluster2]                                         "type": "string"
2021-07-19T08:19:10.3760362Z [cluster2]                                     },
2021-07-19T08:19:10.3760786Z [cluster2]                                     "backend_config": {
2021-07-19T08:19:10.3761361Z [cluster2]                                         "additionalProperties": {
2021-07-19T08:19:10.3761918Z [cluster2]                                             "type": "string"
2021-07-19T08:19:10.3762358Z [cluster2]                                         },
2021-07-19T08:19:10.3762794Z [cluster2]                                         "type": "object"
2021-07-19T08:19:10.3763203Z [cluster2]                                     },
2021-07-19T08:19:10.3763631Z [cluster2]                                     "cable_name": {
2021-07-19T08:19:10.3764077Z [cluster2]                                         "type": "string"
2021-07-19T08:19:10.3764502Z [cluster2]                                     },
2021-07-19T08:19:10.3765130Z [cluster2]                                     "cluster_id": {
2021-07-19T08:19:10.3765604Z [cluster2]                                         "type": "string"
2021-07-19T08:19:10.3766142Z [cluster2]                                     },
2021-07-19T08:19:10.3766546Z [cluster2]                                     "healthCheckIP": {
2021-07-19T08:19:10.3766988Z [cluster2]                                         "type": "string"
2021-07-19T08:19:10.3767345Z [cluster2]                                     },
2021-07-19T08:19:10.3767716Z [cluster2]                                     "hostname": {
2021-07-19T08:19:10.3768346Z [cluster2]                                         "type": "string"
2021-07-19T08:19:10.3768881Z [cluster2]                                     },
2021-07-19T08:19:10.3769387Z [cluster2]                                     "nat_enabled": {
2021-07-19T08:19:10.3769968Z [cluster2]                                         "type": "boolean"
2021-07-19T08:19:10.3770600Z [cluster2]                                     },
2021-07-19T08:19:10.3771136Z [cluster2]                                     "private_ip": {
2021-07-19T08:19:10.3771796Z [cluster2]                                         "type": "string"
2021-07-19T08:19:10.3772312Z [cluster2]                                     },
2021-07-19T08:19:10.3772830Z [cluster2]                                     "public_ip": {
2021-07-19T08:19:10.3773382Z [cluster2]                                         "type": "string"
2021-07-19T08:19:10.3773908Z [cluster2]                                     },
2021-07-19T08:19:10.3774410Z [cluster2]                                     "subnets": {
2021-07-19T08:19:10.3774944Z [cluster2]                                         "items": {
2021-07-19T08:19:10.3775485Z [cluster2]                                             "type": "string"
2021-07-19T08:19:10.3776019Z [cluster2]                                         },
2021-07-19T08:19:10.3776553Z [cluster2]                                         "type": "array"
2021-07-19T08:19:10.3777058Z [cluster2]                                     }
2021-07-19T08:19:10.3777527Z [cluster2]                                 },
2021-07-19T08:19:10.3778030Z [cluster2]                                 "required": [
2021-07-19T08:19:10.3778584Z [cluster2]                                     "backend",
2021-07-19T08:19:10.3779118Z [cluster2]                                     "cable_name",
2021-07-19T08:19:10.3779766Z [cluster2]                                     "cluster_id",
2021-07-19T08:19:10.3780261Z [cluster2]                                     "hostname",
2021-07-19T08:19:10.3780780Z [cluster2]                                     "nat_enabled",
2021-07-19T08:19:10.3781305Z [cluster2]                                     "private_ip",
2021-07-19T08:19:10.3781876Z [cluster2]                                     "public_ip",
2021-07-19T08:19:10.3782381Z [cluster2]                                     "subnets"
2021-07-19T08:19:10.3782831Z [cluster2]                                 ],
2021-07-19T08:19:10.3783310Z [cluster2]                                 "type": "object"
2021-07-19T08:19:10.3783766Z [cluster2]                             }
2021-07-19T08:19:10.3784223Z [cluster2]                         },
2021-07-19T08:19:10.3784681Z [cluster2]                         "required": [
2021-07-19T08:19:10.3785159Z [cluster2]                             "spec"
2021-07-19T08:19:10.3785598Z [cluster2]                         ],
2021-07-19T08:19:10.3786048Z [cluster2]                         "type": "object"
2021-07-19T08:19:10.3786508Z [cluster2]                     }
2021-07-19T08:19:10.3786901Z [cluster2]                 },
2021-07-19T08:19:10.3787508Z [cluster2]                 "served": true,
2021-07-19T08:19:10.3788004Z [cluster2]                 "storage": true
2021-07-19T08:19:10.3788457Z [cluster2]             }
2021-07-19T08:19:10.3788841Z [cluster2]         ]
2021-07-19T08:19:10.3789233Z [cluster2]     },
2021-07-19T08:19:10.3789636Z [cluster2]     "status": {
2021-07-19T08:19:10.3790137Z [cluster2]         "acceptedNames": {
2021-07-19T08:19:10.3790668Z [cluster2]             "kind": "Endpoint",
2021-07-19T08:19:10.3791241Z [cluster2]             "listKind": "EndpointList",
2021-07-19T08:19:10.3791835Z [cluster2]             "plural": "endpoints",
2021-07-19T08:19:10.3792377Z [cluster2]             "singular": "endpoint"
2021-07-19T08:19:10.3792852Z [cluster2]         },
2021-07-19T08:19:10.3793287Z [cluster2]         "conditions": [
2021-07-19T08:19:10.3793737Z [cluster2]             {
2021-07-19T08:19:10.3794617Z [cluster2]                 "lastTransitionTime": "2021-07-19T08:18:04Z",
2021-07-19T08:19:10.3795291Z [cluster2]                 "message": "no conflicts found",
2021-07-19T08:19:10.3795878Z [cluster2]                 "reason": "NoConflicts",
2021-07-19T08:19:10.3796416Z [cluster2]                 "status": "True",
2021-07-19T08:19:10.3796957Z [cluster2]                 "type": "NamesAccepted"
2021-07-19T08:19:10.3797471Z [cluster2]             },
2021-07-19T08:19:10.3797874Z [cluster2]             {
2021-07-19T08:19:10.3798599Z [cluster2]                 "lastTransitionTime": "2021-07-19T08:18:04Z",
2021-07-19T08:19:10.3799482Z [cluster2]                 "message": "the initial names have been accepted",
2021-07-19T08:19:10.3800147Z [cluster2]                 "reason": "InitialNamesAccepted",
2021-07-19T08:19:10.3800706Z [cluster2]                 "status": "True",
2021-07-19T08:19:11.3228115Z [cluster2]                 "type": "Established"
2021-07-19T08:19:11.3229146Z [cluster2]             }
2021-07-19T08:19:11.3229716Z [cluster2]         ],
2021-07-19T08:19:11.3231165Z [cluster2]         "storedVersions": [
2021-07-19T08:19:11.3231760Z [cluster2]             "v1"
2021-07-19T08:19:11.3232214Z [cluster2]         ]
2021-07-19T08:19:11.3232642Z [cluster2]     }
2021-07-19T08:19:11.3233039Z [cluster2] }
2021-07-19T08:19:11.3234686Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io[0m
2021-07-19T08:19:11.3236323Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io[0m
2021-07-19T08:19:11.3238180Z [36m[submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-19T08:19:11.3239836Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced[0m
2021-07-19T08:19:11.3241114Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced[0m
2021-07-19T08:19:11.3242759Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-19T08:19:11.3244416Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io[0m
2021-07-19T08:19:11.3246332Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io[0m
2021-07-19T08:19:11.3248297Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-19T08:19:11.3249818Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint[0m
2021-07-19T08:19:11.3251047Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint[0m
2021-07-19T08:19:11.3252632Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-19T08:19:11.3254323Z [36m[submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint[0m
2021-07-19T08:19:11.3255782Z [36m[submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint[0m
2021-07-19T08:19:11.3257600Z [36m[submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-19T08:19:11.3259154Z [36m[submariner-operator]$ [cluster2] verify_clusters_crd[0m
2021-07-19T08:19:11.3260125Z [36m[submariner-operator]$ [cluster2] verify_clusters_crd[0m
2021-07-19T08:19:11.3261298Z [36m[submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster[0m
2021-07-19T08:19:11.3262832Z [36m[submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster[0m
2021-07-19T08:19:11.3264235Z [36m[submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io[0m
2021-07-19T08:19:11.3265624Z [36m[submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io[0m
2021-07-19T08:19:11.3267149Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds clusters.submariner.io[0m
2021-07-19T08:19:11.3268144Z [cluster2] NAME                     CREATED AT
2021-07-19T08:19:11.3269000Z [cluster2] clusters.submariner.io   2021-07-19T08:18:04Z
2021-07-19T08:19:11.3270591Z [36m[submariner-operator]$ [cluster2] json_file=/tmp/clusters.submariner.io.cluster2.json[0m
2021-07-19T08:19:11.3272542Z [36m[submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json[0m
2021-07-19T08:19:11.3274177Z [36m[submariner-operator]$ [cluster2] tee /tmp/clusters.submariner.io.cluster2.json[0m
2021-07-19T08:19:11.3275896Z [36m[submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json[0m
2021-07-19T08:19:11.3277583Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd clusters.submariner.io -o json[0m
2021-07-19T08:19:11.3278523Z [cluster2] {
2021-07-19T08:19:11.3279156Z [cluster2]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T08:19:11.3280041Z [cluster2]     "kind": "CustomResourceDefinition",
2021-07-19T08:19:11.3280744Z [cluster2]     "metadata": {
2021-07-19T08:19:11.3281256Z [cluster2]         "annotations": {
2021-07-19T08:19:11.3282282Z [cluster2]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T08:19:11.3283029Z [cluster2]         },
2021-07-19T08:19:11.3283800Z [cluster2]         "creationTimestamp": "2021-07-19T08:18:04Z",
2021-07-19T08:19:11.3284441Z [cluster2]         "generation": 1,
2021-07-19T08:19:11.3285218Z [cluster2]         "name": "clusters.submariner.io",
2021-07-19T08:19:11.3285947Z [cluster2]         "resourceVersion": "1759",
2021-07-19T08:19:11.3287113Z [cluster2]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.submariner.io",
2021-07-19T08:19:11.3288573Z [cluster2]         "uid": "9c1e2a9a-14de-4846-8916-fd2fcd8f1050"
2021-07-19T08:19:11.3289223Z [cluster2]     },
2021-07-19T08:19:11.3289669Z [cluster2]     "spec": {
2021-07-19T08:19:11.3290165Z [cluster2]         "conversion": {
2021-07-19T08:19:11.3290709Z [cluster2]             "strategy": "None"
2021-07-19T08:19:11.3291182Z [cluster2]         },
2021-07-19T08:19:11.3291719Z [cluster2]         "group": "submariner.io",
2021-07-19T08:19:11.3292261Z [cluster2]         "names": {
2021-07-19T08:19:11.3292766Z [cluster2]             "kind": "Cluster",
2021-07-19T08:19:11.3293491Z [cluster2]             "listKind": "ClusterList",
2021-07-19T08:19:11.3294111Z [cluster2]             "plural": "clusters",
2021-07-19T08:19:11.3294686Z [cluster2]             "singular": "cluster"
2021-07-19T08:19:11.3295185Z [cluster2]         },
2021-07-19T08:19:11.3295707Z [cluster2]         "scope": "Namespaced",
2021-07-19T08:19:11.3296342Z [cluster2]         "versions": [
2021-07-19T08:19:11.3296778Z [cluster2]             {
2021-07-19T08:19:11.3297199Z [cluster2]                 "name": "v1",
2021-07-19T08:19:11.3297763Z [cluster2]                 "schema": {
2021-07-19T08:19:11.3298310Z [cluster2]                     "openAPIV3Schema": {
2021-07-19T08:19:11.3298887Z [cluster2]                         "properties": {
2021-07-19T08:19:11.3299431Z [cluster2]                             "apiVersion": {
2021-07-19T08:19:11.3301660Z [cluster2]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T08:19:11.3303431Z [cluster2]                                 "type": "string"
2021-07-19T08:19:11.3303919Z [cluster2]                             },
2021-07-19T08:19:11.3304364Z [cluster2]                             "kind": {
2021-07-19T08:19:11.3306519Z [cluster2]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T08:19:11.3308238Z [cluster2]                                 "type": "string"
2021-07-19T08:19:11.3308703Z [cluster2]                             },
2021-07-19T08:19:11.3309177Z [cluster2]                             "metadata": {
2021-07-19T08:19:11.3309690Z [cluster2]                                 "type": "object"
2021-07-19T08:19:11.3310166Z [cluster2]                             },
2021-07-19T08:19:11.3310604Z [cluster2]                             "spec": {
2021-07-19T08:19:11.3311120Z [cluster2]                                 "properties": {
2021-07-19T08:19:11.3311662Z [cluster2]                                     "cluster_cidr": {
2021-07-19T08:19:11.3312256Z [cluster2]                                         "items": {
2021-07-19T08:19:11.3312784Z [cluster2]                                             "type": "string"
2021-07-19T08:19:11.3313274Z [cluster2]                                         },
2021-07-19T08:19:11.3313764Z [cluster2]                                         "type": "array"
2021-07-19T08:19:11.3314442Z [cluster2]                                     },
2021-07-19T08:19:11.3314969Z [cluster2]                                     "cluster_id": {
2021-07-19T08:19:11.3315529Z [cluster2]                                         "type": "string"
2021-07-19T08:19:11.3316071Z [cluster2]                                     },
2021-07-19T08:19:11.3316596Z [cluster2]                                     "color_codes": {
2021-07-19T08:19:11.3317127Z [cluster2]                                         "items": {
2021-07-19T08:19:11.3317686Z [cluster2]                                             "type": "string"
2021-07-19T08:19:11.3318212Z [cluster2]                                         },
2021-07-19T08:19:11.3318745Z [cluster2]                                         "type": "array"
2021-07-19T08:19:11.3319256Z [cluster2]                                     },
2021-07-19T08:19:11.3319776Z [cluster2]                                     "global_cidr": {
2021-07-19T08:19:11.3320319Z [cluster2]                                         "items": {
2021-07-19T08:19:11.3320863Z [cluster2]                                             "type": "string"
2021-07-19T08:19:11.3321404Z [cluster2]                                         },
2021-07-19T08:19:11.3321979Z [cluster2]                                         "type": "array"
2021-07-19T08:19:11.3322501Z [cluster2]                                     },
2021-07-19T08:19:11.3323017Z [cluster2]                                     "service_cidr": {
2021-07-19T08:19:11.3323575Z [cluster2]                                         "items": {
2021-07-19T08:19:11.3324129Z [cluster2]                                             "type": "string"
2021-07-19T08:19:11.3324665Z [cluster2]                                         },
2021-07-19T08:19:11.3359329Z [cluster2]                                         "type": "array"
2021-07-19T08:19:11.3359707Z [cluster2]                                     }
2021-07-19T08:19:11.3360052Z [cluster2]                                 },
2021-07-19T08:19:11.3360408Z [cluster2]                                 "required": [
2021-07-19T08:19:11.3360816Z [cluster2]                                     "cluster_cidr",
2021-07-19T08:19:11.3361366Z [cluster2]                                     "cluster_id",
2021-07-19T08:19:11.3361768Z [cluster2]                                     "color_codes",
2021-07-19T08:19:11.3362153Z [cluster2]                                     "global_cidr",
2021-07-19T08:19:11.3362559Z [cluster2]                                     "service_cidr"
2021-07-19T08:19:11.3362939Z [cluster2]                                 ],
2021-07-19T08:19:11.3363500Z [cluster2]                                 "type": "object"
2021-07-19T08:19:11.3363919Z [cluster2]                             }
2021-07-19T08:19:11.3364279Z [cluster2]                         },
2021-07-19T08:19:11.3364684Z [cluster2]                         "required": [
2021-07-19T08:19:11.3365219Z [cluster2]                             "spec"
2021-07-19T08:19:11.3365610Z [cluster2]                         ],
2021-07-19T08:19:11.3366009Z [cluster2]                         "type": "object"
2021-07-19T08:19:11.3366421Z [cluster2]                     }
2021-07-19T08:19:11.3366774Z [cluster2]                 },
2021-07-19T08:19:11.3367185Z [cluster2]                 "served": true,
2021-07-19T08:19:11.3367632Z [cluster2]                 "storage": true
2021-07-19T08:19:11.3368012Z [cluster2]             }
2021-07-19T08:19:11.3368362Z [cluster2]         ]
2021-07-19T08:19:11.3368696Z [cluster2]     },
2021-07-19T08:19:11.3369066Z [cluster2]     "status": {
2021-07-19T08:19:11.3369660Z [cluster2]         "acceptedNames": {
2021-07-19T08:19:11.4220718Z [cluster2]             "kin         "type": "Established"
2021-07-19T08:19:11.4221372Z [cluster1]             }
2021-07-19T08:19:11.4221792Z [cluster1]         ],
2021-07-19T08:19:11.4222267Z [cluster1]         "storedVersions": [
2021-07-19T08:19:11.4222762Z [cluster1]             "v1"
2021-07-19T08:19:11.4223153Z [cluster1]         ]
2021-07-19T08:19:11.4223549Z [cluster1]     }
2021-07-19T08:19:11.4223924Z [cluster1] }
2021-07-19T08:19:11.4225431Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io[0m
2021-07-19T08:19:11.4226959Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io[0m
2021-07-19T08:19:11.4228652Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-19T08:19:11.4230334Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced[0m
2021-07-19T08:19:11.4231763Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced[0m
2021-07-19T08:19:11.4233422Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-19T08:19:11.4235085Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io[0m
2021-07-19T08:19:11.4236395Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io[0m
2021-07-19T08:19:11.4238067Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-19T08:19:11.4239831Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint[0m
2021-07-19T08:19:11.4241160Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint[0m
2021-07-19T08:19:11.4242849Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-19T08:19:11.4244676Z [36m[submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint[0m
2021-07-19T08:19:11.4246407Z [36m[submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint[0m
2021-07-19T08:19:11.4248371Z [36m[submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-19T08:19:11.4250032Z [36m[submariner-operator]$ [cluster1] verify_clusters_crd[0m
2021-07-19T08:19:11.4251072Z [36m[submariner-operator]$ [cluster1] verify_clusters_crd[0m
2021-07-19T08:19:11.4252340Z [36m[submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster[0m
2021-07-19T08:19:11.4253792Z [36m[submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster[0m
2021-07-19T08:19:11.4255199Z [36m[submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io[0m
2021-07-19T08:19:11.4256588Z [36m[submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io[0m
2021-07-19T08:19:11.4258105Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds clusters.submariner.io[0m
2021-07-19T08:19:11.4259101Z [cluster1] NAME                     CREATED AT
2021-07-19T08:19:11.4259961Z [cluster1] clusters.submariner.io   2021-07-19T08:17:48Z
2021-07-19T08:19:11.4261403Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/clusters.submariner.io.cluster1.json[0m
2021-07-19T08:19:11.4263033Z [36m[submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json[0m
2021-07-19T08:19:11.4264445Z [36m[submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json[0m
2021-07-19T08:19:11.4266011Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd clusters.submariner.io -o json[0m
2021-07-19T08:19:11.4267817Z [36m[submariner-operator]$ [cluster1] tee /tmp/clusters.submariner.io.cluster1.json[0m
2021-07-19T08:19:11.4268752Z [cluster1] {
2021-07-19T08:19:11.4269537Z [cluster1]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T08:19:11.4270583Z [cluster1]     "kind": "CustomResourceDefinition",
2021-07-19T08:19:11.4271225Z [cluster1]     "metadata": {
2021-07-19T08:19:11.4271722Z [cluster1]         "annotations": {
2021-07-19T08:19:11.4272677Z [cluster1]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T08:19:11.4273370Z [cluster1]         },
2021-07-19T08:19:11.4274085Z [cluster1]         "creationTimestamp": "2021-07-19T08:17:48Z",
2021-07-19T08:19:11.4274665Z [cluster1]         "generation": 1,
2021-07-19T08:19:11.4275299Z [cluster1]         "name": "clusters.submariner.io",
2021-07-19T08:19:11.4276153Z [cluster1]         "resourceVersion": "1735",
2021-07-19T08:19:11.4277324Z [cluster1]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.submariner.io",
2021-07-19T08:19:11.4278725Z [cluster1]         "uid": "70f7494b-94f1-419e-a748-df4711e7a139"
2021-07-19T08:19:11.4279327Z [cluster1]     },
2021-07-19T08:19:11.4279775Z [cluster1]     "spec": {
2021-07-19T08:19:11.4280265Z [cluster1]         "conversion": {
2021-07-19T08:19:11.4280826Z [cluster1]             "strategy": "None"
2021-07-19T08:19:11.4281304Z [cluster1]         },
2021-07-19T08:19:11.4281837Z [cluster1]         "group": "submariner.io",
2021-07-19T08:19:11.4282378Z [cluster1]         "names": {
2021-07-19T08:19:11.4282888Z [cluster1]             "kind": "Cluster",
2021-07-19T08:19:11.4283468Z [cluster1]             "listKind": "ClusterList",
2021-07-19T08:19:11.4284088Z [cluster1]             "plural": "clusters",
2021-07-19T08:19:11.4284655Z [cluster1]             "singular": "cluster"
2021-07-19T08:19:11.4285407Z [cluster1]         },
2021-07-19T08:19:11.4285906Z [cluster1]         "scope": "Namespaced",
2021-07-19T08:19:11.4286463Z [cluster1]         "versions": [
2021-07-19T08:19:11.4286935Z [cluster1]             {
2021-07-19T08:19:11.4287382Z [cluster1]                 "name": "v1",
2021-07-19T08:19:11.4287881Z [cluster1]                 "schema": {
2021-07-19T08:19:11.4330772Z [cluster1]                     "openAPIV3Schema": {
2021-07-19T08:19:11.4332825Z [cluster1]                         "properties": {
2021-07-19T08:19:11.4333489Z [cluster1]                             "apiVersion": {
2021-07-19T08:19:11.4336147Z [cluster1]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T08:19:11.4338041Z [cluster1]                                 "type": "string"
2021-07-19T08:19:11.4338578Z [cluster1]                             },
2021-07-19T08:19:11.4339052Z [cluster1]                             "kind": {
2021-07-19T08:19:11.4341371Z [cluster1]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T08:19:11.4343219Z [cluster1]                                 "type": "string"
2021-07-19T08:19:11.4343743Z [cluster1]                             },
2021-07-19T08:19:11.4344373Z [cluster1]                             "metadata": {
2021-07-19T08:19:11.4344885Z [cluster1]                                 "type": "object"
2021-07-19T08:19:11.4345362Z [cluster1]                             },
2021-07-19T08:19:11.4345799Z [cluster1]                             "spec": {
2021-07-19T08:19:11.4346320Z [cluster1]                                 "properties": {
2021-07-19T08:19:11.4346853Z [cluster1]                                     "cluster_cidr": {
2021-07-19T08:19:11.4347370Z [cluster1]                                         "items": {
2021-07-19T08:19:11.4347898Z [cluster1]                                             "type": "string"
2021-07-19T08:19:11.4348560Z [cluster1]                                         },
2021-07-19T08:19:11.4349058Z [cluster1]                                         "type": "array"
2021-07-19T08:19:11.4349532Z [cluster1]                                     },
2021-07-19T08:19:11.4350024Z [cluster1]                                     "cluster_id": {
2021-07-19T08:19:11.4350543Z [cluster1]                                         "type": "string"
2021-07-19T08:19:11.4351037Z [cluster1]                                     },
2021-07-19T08:19:11.4351508Z [cluster1]                                     "color_codes": {
2021-07-19T08:19:11.4352024Z [cluster1]                                         "items": {
2021-07-19T08:19:11.4352551Z [cluster1]                                             "type": "string"
2021-07-19T08:19:11.4353035Z [cluster1]                                         },
2021-07-19T08:19:11.4353523Z [cluster1]                                         "type": "array"
2021-07-19T08:19:11.4354078Z [cluster1]                                     },
2021-07-19T08:19:11.4354505Z [cluster1]                                     "global_cidr": {
2021-07-19T08:19:11.4355080Z [cluster1]                                         "items": {
2021-07-19T08:19:11.4355536Z [cluster1]                                             "type": "string"
2021-07-19T08:19:11.4355973Z [cluster1]                                         },
2021-07-19T08:19:11.4356389Z [cluster1]                                         "type": "array"
2021-07-19T08:19:11.4356814Z [cluster1]                                     },
2021-07-19T08:19:11.4357237Z [cluster1]                                     "service_cidr": {
2021-07-19T08:19:11.4357781Z [cluster1]                                         "items": {
2021-07-19T08:19:11.4358228Z [cluster1]                                             "type": "string"
2021-07-19T08:19:11.4358665Z [cluster1]                                         },
2021-07-19T08:19:11.4359089Z [cluster1]                                         "type": "array"
2021-07-19T08:19:11.4359526Z [cluster1]                                     }
2021-07-19T08:19:11.4359917Z [cluster1]                                 },
2021-07-19T08:19:11.4360327Z [cluster1]                                 "required": [
2021-07-19T08:19:11.4360797Z [cluster1]                                     "cluster_cidr",
2021-07-19T08:19:11.4361243Z [cluster1]                                     "cluster_id",
2021-07-19T08:19:11.4361708Z [cluster1]                                     "color_codes",
2021-07-19T08:19:11.4362150Z [cluster1]                                     "global_cidr",
2021-07-19T08:19:11.4362617Z [cluster1]                                     "service_cidr"
2021-07-19T08:19:11.4363026Z [cluster1]                                 ],
2021-07-19T08:19:11.4363457Z [cluster1]                                 "type": "object"
2021-07-19T08:19:11.4363882Z [cluster1]                             }
2021-07-19T08:19:11.4364245Z [cluster1]                         },
2021-07-19T08:19:11.4364660Z [cluster1]                         "required": [
2021-07-19T08:19:11.4365225Z [cluster1]                             "spec"
2021-07-19T08:19:11.4365617Z [cluster1]                         ],
2021-07-19T08:19:11.4366020Z [cluster1]                         "type": "object"
2021-07-19T08:19:11.4366431Z [cluster1]                     }
2021-07-19T08:19:11.4366782Z [cluster1]                 },
2021-07-19T08:19:11.4367187Z [cluster1]                 "served": true,
2021-07-19T08:19:11.4367617Z [cluster1]                 "storage": true
2021-07-19T08:19:11.4368018Z [cluster1]             }
2021-07-19T08:19:11.4368379Z [cluster1]         ]
2021-07-19T08:19:11.4368710Z [cluster1]     },
2021-07-19T08:19:11.4369245Z [cluster1]     "status": {
2021-07-19T08:19:11.4369735Z [cluster1]         "acceptedNames": {
2021-07-19T08:19:12.2770973Z [cluster1]             "kind": "Cluster",
2021-07-19T08:19:12.2771744Z [cluster2]             "listKind": "ClusterList",
2021-07-19T08:19:12.2772532Z [cluster2]             "plural": "clusters",
2021-07-19T08:19:12.2773329Z [cluster2]             "singular": "cluster"
2021-07-19T08:19:12.2773850Z [cluster2]         },
2021-07-19T08:19:12.2774337Z [cluster2]         "conditions": [
2021-07-19T08:19:12.2774808Z [cluster2]             {
2021-07-19T08:19:12.2776193Z [cluster2]                 "lastTransitionTime": "2021-07-19T08:18:04Z",
2021-07-19T08:19:12.2776858Z [cluster2]                 "message": "no conflicts found",
2021-07-19T08:19:12.2777457Z [cluster2]                 "reason": "NoConflicts",
2021-07-19T08:19:12.2777982Z [cluster2]                 "status": "True",
2021-07-19T08:19:12.2778729Z [cluster2]                 "type": "NamesAccepted"
2021-07-19T08:19:12.2779264Z [cluster2]             },
2021-07-19T08:19:12.2779704Z [cluster2]             {
2021-07-19T08:19:12.2780551Z [cluster2]                 "lastTransitionTime": "2021-07-19T08:18:04Z",
2021-07-19T08:19:12.2781347Z [cluster2]                 "message": "the initial names have been accepted",
2021-07-19T08:19:12.2782179Z [cluster2]                 "reason": "InitialNamesAccepted",
2021-07-19T08:19:12.2782853Z [cluster2]                 "status": "True",
2021-07-19T08:19:12.2783435Z [cluster2]                 "type": "Established"
2021-07-19T08:19:12.2783942Z [cluster2]             }
2021-07-19T08:19:12.2784464Z [cluster2]         ],
2021-07-19T08:19:12.2784940Z [cluster2]         "storedVersions": [
2021-07-19T08:19:12.2785429Z [cluster2]             "v1"
2021-07-19T08:19:12.2785823Z [cluster2]         ]
2021-07-19T08:19:12.2786214Z [cluster2]     }
2021-07-19T08:19:12.2786586Z [cluster2] }
2021-07-19T08:19:12.2787745Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io[0m
2021-07-19T08:19:12.2789207Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io[0m
2021-07-19T08:19:12.2790845Z [36m[submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster2.json[0m
2021-07-19T08:19:12.2792503Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced[0m
2021-07-19T08:19:12.2793865Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced[0m
2021-07-19T08:19:12.2795491Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster2.json[0m
2021-07-19T08:19:12.2797106Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io[0m
2021-07-19T08:19:12.2864079Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io[0m
2021-07-19T08:19:12.2865763Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster2.json[0m
2021-07-19T08:19:12.2867395Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster[0m
2021-07-19T08:19:12.2868711Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster[0m
2021-07-19T08:19:12.2870370Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster2.json[0m
2021-07-19T08:19:12.2872170Z [36m[submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster[0m
2021-07-19T08:19:12.2873746Z [36m[submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster[0m
2021-07-19T08:19:12.2904356Z [36m[submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster2.json[0m
2021-07-19T08:19:12.2906342Z [36m[submariner-operator]$ [cluster2] verify_subm_crd[0m
2021-07-19T08:19:12.2912419Z [36m[submariner-operator]$ [cluster2] verify_subm_crd[0m
2021-07-19T08:19:12.2914175Z [36m[submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner[0m
2021-07-19T08:19:12.2927330Z [36m[submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner[0m
2021-07-19T08:19:12.2936713Z [36m[submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io[0m
2021-07-19T08:19:12.2938988Z [36m[submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io[0m
2021-07-19T08:19:12.2941196Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io[0m
2021-07-19T08:19:12.2942521Z [cluster2] NAME                        CREATED AT
2021-07-19T08:19:12.2943651Z [cluster2] submariners.submariner.io   2021-07-19T08:17:51Z
2021-07-19T08:19:12.2945646Z [36m[submariner-operator]$ [cluster2] json_file=/tmp/submariners.submariner.io.cluster2.json[0m
2021-07-19T08:19:12.2948252Z [36m[submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json[0m
2021-07-19T08:19:12.2977889Z [36m[submariner-operator]$ [cluster2] tee /tmp/submariners.submariner.io.cluster2.json[0m
2021-07-19T08:19:12.2979880Z [36m[submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json[0m
2021-07-19T08:19:12.2981716Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd submariners.submariner.io -o json[0m
2021-07-19T08:19:12.2982700Z [cluster2] {
2021-07-19T08:19:12.2983352Z [cluster2]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T08:19:12.2984236Z [cluster2]     "kind": "CustomResourceDefinition",
2021-07-19T08:19:12.2984944Z [cluster2]     "metadata": {
2021-07-19T08:19:12.2985456Z [cluster2]         "annotations": {
2021-07-19T08:19:12.2986488Z [cluster2]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T08:19:12.2987232Z [cluster2]         },
2021-07-19T08:19:12.2988009Z [cluster2]         "creationTimestamp": "2021-07-19T08:17:51Z",
2021-07-19T08:19:12.2988640Z [cluster2]         "generation": 1,
2021-07-19T08:19:12.2989551Z [cluster2]         "name": "submariners.submariner.io",
2021-07-19T08:19:12.2990317Z [cluster2]         "resourceVersion": "1634",
2021-07-19T08:19:12.2991525Z [cluster2]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/submariners.submariner.io",
2021-07-19T08:19:12.2992996Z [cluster2]         "uid": "7640083a-3a77-40bf-90ce-e92e5030da7a"
2021-07-19T08:19:12.2993591Z [cluster2]     },
2021-07-19T08:19:12.2994034Z [cluster2]     "spec": {
2021-07-19T08:19:12.2994518Z [cluster2]         "conversion": {
2021-07-19T08:19:12.2995060Z [cluster2]             "strategy": "None"
2021-07-19T08:19:12.2995535Z [cluster2]         },
2021-07-19T08:19:12.2996065Z [cluster2]         "group": "submariner.io",
2021-07-19T08:19:12.2996602Z [cluster2]         "names": {
2021-07-19T08:19:12.2997133Z [cluster2]             "kind": "Submariner",
2021-07-19T08:19:12.2997761Z [cluster2]             "listKind": "SubmarinerList",
2021-07-19T08:19:12.2998435Z [cluster2]             "plural": "submariners",
2021-07-19T08:19:12.2999043Z [cluster2]             "singular": "submariner"
2021-07-19T08:19:12.2999621Z [cluster2]         },
2021-07-19T08:19:12.3000137Z [cluster2]         "scope": "Namespaced",
2021-07-19T08:19:12.3000678Z [cluster2]         "versions": [
2021-07-19T08:19:12.3001154Z [cluster2]             {
2021-07-19T08:19:12.3001636Z [cluster2]                 "name": "v1alpha1",
2021-07-19T08:19:12.3002165Z [cluster2]                 "schema": {
2021-07-19T08:19:12.3002735Z [cluster2]                     "openAPIV3Schema": {
2021-07-19T08:19:12.3003567Z [cluster2]                         "description": "Submariner is the Schema for the submariners API",
2021-07-19T08:19:12.3004339Z [cluster2]                         "properties": {
2021-07-19T08:19:12.3005937Z [cluster2]                             "apiVersion": {
2021-07-19T08:19:12.3008369Z [cluster2]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T08:19:12.3010262Z [cluster2]                                 "type": "string"
2021-07-19T08:19:12.3010788Z [cluster2]                             },
2021-07-19T08:19:12.3011403Z [cluster2]                             "kind": {
2021-07-19T08:19:12.3013794Z [cluster2]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T08:19:12.3015735Z [cluster2]                                 "type": "string"
2021-07-19T08:19:12.3016241Z [cluster2]                             },
2021-07-19T08:19:12.3016770Z [cluster2]                             "metadata": {
2021-07-19T08:19:12.3017338Z [cluster2]                                 "type": "object"
2021-07-19T08:19:12.3017835Z [cluster2]                             },
2021-07-19T08:19:12.3018322Z [cluster2]                             "spec": {
2021-07-19T08:19:12.3019127Z [cluster2]                                 "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-19T08:19:12.3019998Z [cluster2]                                 "properties": {
2021-07-19T08:19:12.3020553Z [cluster2]                                     "broker": {
2021-07-19T08:19:12.3021112Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3021644Z [cluster2]                                     },
2021-07-19T08:19:12.3022250Z [cluster2]                                     "brokerK8sApiServer": {
2021-07-19T08:19:12.3022925Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3023524Z [cluster2]                                     },
2021-07-19T08:19:12.3024207Z [cluster2]                                     "brokerK8sApiServerToken": {
2021-07-19T08:19:12.3024923Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3025447Z [cluster2]                                     },
2021-07-19T08:19:12.3025997Z [cluster2]                                     "brokerK8sCA": {
2021-07-19T08:19:12.3026587Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3027120Z [cluster2]                                     },
2021-07-19T08:19:12.3027805Z [cluster2]                                     "brokerK8sRemoteNamespace": {
2021-07-19T08:19:12.3028555Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3029061Z [cluster2]                                     },
2021-07-19T08:19:12.3029608Z [cluster2]                                     "cableDriver": {
2021-07-19T08:19:12.3030189Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3030720Z [cluster2]                                     },
2021-07-19T08:19:12.3031283Z [cluster2]                                     "ceIPSecDebug": {
2021-07-19T08:19:12.3031885Z [cluster2]                                         "type": "boolean"
2021-07-19T08:19:12.3032419Z [cluster2]                                     },
2021-07-19T08:19:12.3033160Z [cluster2]                                     "ceIPSecForceUDPEncaps": {
2021-07-19T08:19:12.3033835Z [cluster2]                                         "type": "boolean"
2021-07-19T08:19:12.3034315Z [cluster2]                                     },
2021-07-19T08:19:12.3034853Z [cluster2]                                     "ceIPSecIKEPort": {
2021-07-19T08:19:12.3035431Z [cluster2]                                         "type": "integer"
2021-07-19T08:19:12.3035935Z [cluster2]                                     },
2021-07-19T08:19:12.3036484Z [cluster2]                                     "ceIPSecNATTPort": {
2021-07-19T08:19:12.3037075Z [cluster2]                                         "type": "integer"
2021-07-19T08:19:12.3037626Z [cluster2]                                     },
2021-07-19T08:19:12.3038058Z [cluster2]                                     "ceIPSecPSK": {
2021-07-19T08:19:12.3038546Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3039014Z [cluster2]                                     },
2021-07-19T08:19:12.3039574Z [cluster2]                                     "ceIPSecPreferredServer": {
2021-07-19T08:19:12.3040183Z [cluster2]                                         "type": "boolean"
2021-07-19T08:19:12.3040773Z [cluster2]                                     },
2021-07-19T08:19:12.3041283Z [cluster2]                                     "clusterCIDR": {
2021-07-19T08:19:12.3041816Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3042303Z [cluster2]                                     },
2021-07-19T08:19:12.3042789Z [cluster2]                                     "clusterID": {
2021-07-19T08:19:12.3043323Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3043798Z [cluster2]                                     },
2021-07-19T08:19:12.3044296Z [cluster2]                                     "colorCodes": {
2021-07-19T08:19:12.3044840Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3045541Z [cluster2]                                     },
2021-07-19T08:19:12.3046338Z [cluster2]                                     "connectionHealthCheck": {
2021-07-19T08:19:12.3047049Z [cluster2]                                         "properties": {
2021-07-19T08:19:12.3047643Z [cluster2]                                             "enabled": {
2021-07-19T08:19:12.3048217Z [cluster2]                                                 "type": "boolean"
2021-07-19T08:19:12.3049417Z [cluster2]                                             },
2021-07-19T08:19:12.3050297Z [cluster2]                                             "intervalSeconds": {
2021-07-19T08:19:12.3051150Z [cluster2]                                                 "description": "The interval at which health check pings are sent.",
2021-07-19T08:19:12.3051940Z [cluster2]                                                 "format": "int64",
2021-07-19T08:19:12.3052536Z [cluster2]                                                 "type": "integer"
2021-07-19T08:19:12.3053089Z [cluster2]                                             },
2021-07-19T08:19:12.3053712Z [cluster2]                                             "maxPacketLossCount": {
2021-07-19T08:19:12.3054750Z [cluster2]                                                 "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-19T08:19:12.3055692Z [cluster2]                                                 "format": "int64",
2021-07-19T08:19:12.3056286Z [cluster2]                                                 "type": "integer"
2021-07-19T08:19:12.3056839Z [cluster2]                                             }
2021-07-19T08:19:12.3057308Z [cluster2]                                         },
2021-07-19T08:19:12.3057847Z [cluster2]                                         "type": "object"
2021-07-19T08:19:12.3058367Z [cluster2]                                     },
2021-07-19T08:19:12.3059001Z [cluster2]                                     "coreDNSCustomConfig": {
2021-07-19T08:19:12.3059699Z [cluster2]                                         "properties": {
2021-07-19T08:19:12.3060407Z [cluster2]                                             "configMapName": {
2021-07-19T08:19:12.3060991Z [cluster2]                                                 "type": "string"
2021-07-19T08:19:12.3061483Z [cluster2]                                             },
2021-07-19T08:19:12.3061983Z [cluster2]                                             "namespace": {
2021-07-19T08:19:12.3062525Z [cluster2]                                                 "type": "string"
2021-07-19T08:19:12.3063020Z [cluster2]                                             }
2021-07-19T08:19:12.3063468Z [cluster2]                                         },
2021-07-19T08:19:12.3063953Z [cluster2]                                         "type": "object"
2021-07-19T08:19:12.3064440Z [cluster2]                                     },
2021-07-19T08:19:12.3065020Z [cluster2]                                     "customDomains": {
2021-07-19T08:19:12.3065568Z [cluster2]                                         "items": {
2021-07-19T08:19:12.3066075Z [cluster2]                                             "type": "string"
2021-07-19T08:19:12.3066574Z [cluster2]                                         },
2021-07-19T08:19:12.3067050Z [cluster2]                                         "type": "array",
2021-07-19T08:19:12.3068041Z [cluster2]                                         "x-kubernetes-list-type": "set"
2021-07-19T08:19:12.3068683Z [cluster2]                                     },
2021-07-19T08:19:12.3069134Z [cluster2]                                     "debug": {
2021-07-19T08:19:12.3069661Z [cluster2]                                         "type": "boolean"
2021-07-19T08:19:12.3070151Z [cluster2]                                     },
2021-07-19T08:19:12.3070647Z [cluster2]                                     "globalCIDR": {
2021-07-19T08:19:12.3071184Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3071671Z [cluster2]                                     },
2021-07-19T08:19:12.3072800Z [cluster2]                                     "imageOverrides": {
2021-07-19T08:19:12.3073527Z [cluster2]                                         "additionalProperties": {
2021-07-19T08:19:12.3074232Z [cluster2]                                             "type": "string"
2021-07-19T08:19:12.3074752Z [cluster2]                                         },
2021-07-19T08:19:12.3075296Z [cluster2]                                         "type": "object"
2021-07-19T08:19:12.3075923Z [cluster2]                                     },
2021-07-19T08:19:12.3076553Z [cluster2]                                     "loadBalancerEnabled": {
2021-07-19T08:19:12.3077224Z [cluster2]                                         "type": "boolean"
2021-07-19T08:19:12.3077765Z [cluster2]                                     },
2021-07-19T08:19:12.3078303Z [cluster2]                                     "namespace": {
2021-07-19T08:19:12.3078867Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3079392Z [cluster2]                                     },
2021-07-19T08:19:12.3079917Z [cluster2]                                     "natEnabled": {
2021-07-19T08:19:12.3080513Z [cluster2]                                         "type": "boolean"
2021-07-19T08:19:12.3081033Z [cluster2]                                     },
2021-07-19T08:19:12.3081577Z [cluster2]                                     "repository": {
2021-07-19T08:19:12.3082154Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3082934Z [cluster2]                                     },
2021-07-19T08:19:12.3083483Z [cluster2]                                     "serviceCIDR": {
2021-07-19T08:19:12.3084063Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3084593Z [cluster2]                                     },
2021-07-19T08:19:12.3085842Z [cluster2]                                     "serviceDiscoveryEnabled": {
2021-07-19T08:19:12.3086593Z [cluster2]                                         "type": "boolean"
2021-07-19T08:19:12.3087215Z [cluster2]                                     },
2021-07-19T08:19:12.3087696Z [cluster2]                                     "version": {
2021-07-19T08:19:12.3088225Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3088698Z [cluster2]                                     }
2021-07-19T08:19:12.3089151Z [cluster2]                                 },
2021-07-19T08:19:12.3089615Z [cluster2]                                 "required": [
2021-07-19T08:19:12.3090127Z [cluster2]                                     "broker",
2021-07-19T08:19:12.3090719Z [cluster2]                                     "brokerK8sApiServer",
2021-07-19T08:19:12.3091481Z [cluster2]                                     "brokerK8sApiServerToken",
2021-07-19T08:19:12.3092244Z [cluster2]                                     "brokerK8sCA",
2021-07-19T08:19:12.3092955Z [cluster2]                                     "brokerK8sRemoteNamespace",
2021-07-19T08:19:12.3093678Z [cluster2]                                     "ceIPSecDebug",
2021-07-19T08:19:12.3094247Z [cluster2]                                     "ceIPSecPSK",
2021-07-19T08:19:12.3094810Z [cluster2]                                     "clusterCIDR",
2021-07-19T08:19:12.3096029Z [cluster2]                                     "clusterID",
2021-07-19T08:19:12.3096801Z [cluster2]                                     "debug",
2021-07-19T08:19:12.3097313Z [cluster2]                                     "namespace",
2021-07-19T08:19:12.3097862Z [cluster2]                                     "natEnabled",
2021-07-19T08:19:12.3098584Z [cluster2]                                     "serviceCIDR"
2021-07-19T08:19:12.3099119Z [cluster2]                                 ],
2021-07-19T08:19:12.3099685Z [cluster2]                                 "type": "object"
2021-07-19T08:19:12.3100187Z [cluster2]                             },
2021-07-19T08:19:12.3100684Z [cluster2]                             "status": {
2021-07-19T08:19:12.3101515Z [cluster2]                                 "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-19T08:19:12.3102397Z [cluster2]                                 "properties": {
2021-07-19T08:19:12.3102985Z [cluster2]                                     "clusterCIDR": {
2021-07-19T08:19:12.3103583Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3104202Z [cluster2]                                     },
2021-07-19T08:19:12.3104733Z [cluster2]                                     "clusterID": {
2021-07-19T08:19:12.3105310Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3105820Z [cluster2]                                     },
2021-07-19T08:19:12.3106366Z [cluster2]                                     "colorCodes": {
2021-07-19T08:19:12.3106940Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3107462Z [cluster2]                                     },
2021-07-19T08:19:12.3108024Z [cluster2]                                     "deploymentInfo": {
2021-07-19T08:19:12.3108667Z [cluster2]                                         "properties": {
2021-07-19T08:19:12.3109301Z [cluster2]                                             "cloudProvider": {
2021-07-19T08:19:12.3109915Z [cluster2]                                                 "type": "string"
2021-07-19T08:19:12.3110459Z [cluster2]                                             },
2021-07-19T08:19:12.3111039Z [cluster2]                                             "kubernetesType": {
2021-07-19T08:19:12.3111680Z [cluster2]                                                 "type": "string"
2021-07-19T08:19:12.3112201Z [cluster2]                                             },
2021-07-19T08:19:12.3112887Z [cluster2]                                             "kubernetesTypeVersion": {
2021-07-19T08:19:12.3113601Z [cluster2]                                                 "type": "string"
2021-07-19T08:19:12.3114143Z [cluster2]                                             },
2021-07-19T08:19:12.3114767Z [cluster2]                                             "kubernetesVersion": {
2021-07-19T08:19:12.3115514Z [cluster2]                                                 "type": "string"
2021-07-19T08:19:12.3116015Z [cluster2]                                             }
2021-07-19T08:19:12.3116461Z [cluster2]                                         },
2021-07-19T08:19:12.3116958Z [cluster2]                                         "type": "object"
2021-07-19T08:19:12.3117435Z [cluster2]                                     },
2021-07-19T08:19:12.3118064Z [cluster2]                                     "gatewayDaemonSetStatus": {
2021-07-19T08:19:12.3118754Z [cluster2]                                         "properties": {
2021-07-19T08:19:12.3119457Z [cluster2]                                             "lastResourceVersion": {
2021-07-19T08:19:12.3120109Z [cluster2]                                                 "type": "string"
2021-07-19T08:19:12.3120595Z [cluster2]                                             },
2021-07-19T08:19:12.3121267Z [cluster2]                                             "mismatchedContainerImages": {
2021-07-19T08:19:12.3122201Z [cluster2]                                                 "type": "boolean"
2021-07-19T08:19:12.3122752Z [cluster2]                                             },
2021-07-19T08:19:12.3123451Z [cluster2]                                             "nonReadyContainerStates": {
2021-07-19T08:19:12.3124160Z [cluster2]                                                 "items": {
2021-07-19T08:19:12.3126383Z [cluster2]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T08:19:12.3127649Z [cluster2]                                                     "properties": {
2021-07-19T08:19:12.3128219Z [cluster2]                                                         "running": {
2021-07-19T08:19:12.3128910Z [cluster2]                                                             "description": "Details about a running container",
2021-07-19T08:19:12.3129617Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.3130310Z [cluster2]                                                                 "startedAt": {
2021-07-19T08:19:12.3131465Z [cluster2]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-19T08:19:12.3132423Z [cluster2]                                                                     "format": "date-time",
2021-07-19T08:19:12.3133039Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3133611Z [cluster2]                                                                 }
2021-07-19T08:19:12.3134033Z [cluster2]                                                             },
2021-07-19T08:19:12.3134483Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.3134952Z [cluster2]                                                         },
2021-07-19T08:19:12.3135419Z [cluster2]                                                         "terminated": {
2021-07-19T08:19:12.3136054Z [cluster2]                                                             "description": "Details about a terminated container",
2021-07-19T08:19:12.3136698Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.3138155Z [cluster2]                                                                 "containerID": {
2021-07-19T08:19:12.3139173Z [cluster2]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T08:19:12.3140040Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3140565Z [cluster2]                                                                 },
2021-07-19T08:19:12.3141101Z [cluster2]                                                                 "exitCode": {
2021-07-19T08:19:12.3141863Z [cluster2]                                                                     "description": "Exit status from the last termination of the container",
2021-07-19T08:19:12.3142647Z [cluster2]                                                                     "format": "int32",
2021-07-19T08:19:12.3143234Z [cluster2]                                                                     "type": "integer"
2021-07-19T08:19:12.3143865Z [cluster2]                                                                 },
2021-07-19T08:19:12.3144415Z [cluster2]                                                                 "finishedAt": {
2021-07-19T08:19:12.3145173Z [cluster2]                                                                     "description": "Time at which the container last terminated",
2021-07-19T08:19:12.3146144Z [cluster2]                                                                     "format": "date-time",
2021-07-19T08:19:12.3146759Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3147282Z [cluster2]                                                                 },
2021-07-19T08:19:12.3147804Z [cluster2]                                                                 "message": {
2021-07-19T08:19:12.3148584Z [cluster2]                                                                     "description": "Message regarding the last termination of the container",
2021-07-19T08:19:12.3149384Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3149916Z [cluster2]                                                                 },
2021-07-19T08:19:12.3150414Z [cluster2]                                                                 "reason": {
2021-07-19T08:19:12.3151185Z [cluster2]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-19T08:19:12.3151950Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3152558Z [cluster2]                                                                 },
2021-07-19T08:19:12.3153068Z [cluster2]                                                                 "signal": {
2021-07-19T08:19:12.3153795Z [cluster2]                                                                     "description": "Signal from the last termination of the container",
2021-07-19T08:19:12.3154556Z [cluster2]                                                                     "format": "int32",
2021-07-19T08:19:12.3155127Z [cluster2]                                                                     "type": "integer"
2021-07-19T08:19:12.3155674Z [cluster2]                                                                 },
2021-07-19T08:19:12.3156206Z [cluster2]                                                                 "startedAt": {
2021-07-19T08:19:12.3156997Z [cluster2]                                                                     "description": "Time at which previous execution of the container started",
2021-07-19T08:19:12.3158041Z [cluster2]                                                                     "format": "date-time",
2021-07-19T08:19:12.3158631Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3159173Z [cluster2]                                                                 }
2021-07-19T08:19:12.3159648Z [cluster2]                                                             },
2021-07-19T08:19:12.3160174Z [cluster2]                                                             "required": [
2021-07-19T08:19:12.3160745Z [cluster2]                                                                 "exitCode"
2021-07-19T08:19:12.3161253Z [cluster2]                                                             ],
2021-07-19T08:19:12.3161787Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.3162299Z [cluster2]                                                         },
2021-07-19T08:19:12.3162806Z [cluster2]                                                         "waiting": {
2021-07-19T08:19:12.3163476Z [cluster2]                                                             "description": "Details about a waiting container",
2021-07-19T08:19:12.3164418Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.3165400Z [cluster2]                                                                 "message": {
2021-07-19T08:19:12.3166233Z [cluster2]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-19T08:19:12.3167681Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3168227Z [cluster2]                                                                 },
2021-07-19T08:19:12.3168745Z [cluster2]                                                                 "reason": {
2021-07-19T08:19:12.3169480Z [cluster2]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-19T08:19:12.3170414Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3170992Z [cluster2]                                                                 }
2021-07-19T08:19:12.3171506Z [cluster2]                                                             },
2021-07-19T08:19:12.3172077Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.3172648Z [cluster2]                                                         }
2021-07-19T08:19:12.3173144Z [cluster2]                                                     },
2021-07-19T08:19:12.3173701Z [cluster2]                                                     "type": "object"
2021-07-19T08:19:12.3174321Z [cluster2]                                                 },
2021-07-19T08:19:12.3174860Z [cluster2]                                                 "type": "array"
2021-07-19T08:19:12.3175387Z [cluster2]                                             },
2021-07-19T08:19:12.3176026Z [cluster2]                                             "status": {
2021-07-19T08:19:12.3176822Z [cluster2]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T08:19:12.3177670Z [cluster2]                                                 "properties": {
2021-07-19T08:19:12.3178708Z [cluster2]                                                     "collisionCount": {
2021-07-19T08:19:12.3180135Z [cluster2]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T08:19:12.3181491Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.3182118Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.3182684Z [cluster2]                                                     },
2021-07-19T08:19:12.3183339Z [cluster2]                                                     "conditions": {
2021-07-19T08:19:12.3184598Z [cluster2]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T08:19:12.3199449Z [cluster2]                                                         "items": {
2021-07-19T08:19:12.3238231Z [cluster2]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T08:19:12.3239153Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.3239739Z [cluster2]                                                                 "lastTransitionTime": {
2021-07-19T08:19:12.3240521Z [cluster2]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-19T08:19:12.3241769Z [cluster2]                                                                     "format": "date-time",
2021-07-19T08:19:12.3242294Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3242760Z [cluster2]                                                                 },
2021-07-19T08:19:12.3243204Z [cluster2]                                                                 "message": {
2021-07-19T08:19:12.3243932Z [cluster2]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-19T08:19:12.3244901Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3245733Z [cluster2]                                                                 },
2021-07-19T08:19:12.3246252Z [cluster2]                                                                 "reason": {
2021-07-19T08:19:12.3247258Z [cluster2]                                                                     "description": "The reason for the condition's last transition.",
2021-07-19T08:19:12.3248013Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3248532Z [cluster2]                                                                 },
2021-07-19T08:19:12.3249040Z [cluster2]                                                                 "status": {
2021-07-19T08:19:12.3249790Z [cluster2]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T08:19:12.3250643Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3251179Z [cluster2]                                                                 },
2021-07-19T08:19:12.3251673Z [cluster2]                                                                 "type": {
2021-07-19T08:19:12.3252366Z [cluster2]                                                                     "description": "Type of DaemonSet condition.",
2021-07-19T08:19:12.3253070Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3253589Z [cluster2]                                                                 }
2021-07-19T08:19:12.3254076Z [cluster2]                                                             },
2021-07-19T08:19:12.3254587Z [cluster2]                                                             "required": [
2021-07-19T08:19:12.3255144Z [cluster2]                                                                 "status",
2021-07-19T08:19:12.3255662Z [cluster2]                                                                 "type"
2021-07-19T08:19:12.3256165Z [cluster2]                                                             ],
2021-07-19T08:19:12.3256696Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.3257203Z [cluster2]                                                         },
2021-07-19T08:19:12.3257794Z [cluster2]                                                         "type": "array"
2021-07-19T08:19:12.3258223Z [cluster2]                                                     },
2021-07-19T08:19:12.3258791Z [cluster2]                                                     "currentNumberScheduled": {
2021-07-19T08:19:12.3260007Z [cluster2]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.3261100Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.3261609Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.3262057Z [cluster2]                                                     },
2021-07-19T08:19:12.3262685Z [cluster2]                                                     "desiredNumberScheduled": {
2021-07-19T08:19:12.3263969Z [cluster2]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.3265393Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.3265971Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.3266497Z [cluster2]                                                     },
2021-07-19T08:19:12.3267047Z [cluster2]                                                     "numberAvailable": {
2021-07-19T08:19:12.3268236Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T08:19:12.3269364Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.3269918Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.3270513Z [cluster2]                                                     },
2021-07-19T08:19:12.3271304Z [cluster2]                                                     "numberMisscheduled": {
2021-07-19T08:19:12.3272736Z [cluster2]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.3274112Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.3274722Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.3275289Z [cluster2]                                                     },
2021-07-19T08:19:12.3275846Z [cluster2]                                                     "numberReady": {
2021-07-19T08:19:12.3276861Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T08:19:12.3277824Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.3278441Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.3279015Z [cluster2]                                                     },
2021-07-19T08:19:12.3279622Z [cluster2]                                                     "numberUnavailable": {
2021-07-19T08:19:12.3280901Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T08:19:12.3282134Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.3282740Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.3283308Z [cluster2]                                                     },
2021-07-19T08:19:12.3283940Z [cluster2]                                                     "observedGeneration": {
2021-07-19T08:19:12.3325352Z [cluster2]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T08:19:12.3326246Z [cluster2]                                                         "format": "int64",
2021-07-19T08:19:12.3326820Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.3327484Z [cluster2]                                                     },
2021-07-19T08:19:12.3328137Z [cluster2]                                                     "updatedNumberScheduled": {
2021-07-19T08:19:12.3329048Z [cluster2]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T08:19:12.3329804Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.3330373Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.3330888Z [cluster2]                                                     }
2021-07-19T08:19:12.3331358Z [cluster2]                                                 },
2021-07-19T08:19:12.3331864Z [cluster2]                                                 "required": [
2021-07-19T08:19:12.3332544Z [cluster2]                                                     "currentNumberScheduled",
2021-07-19T08:19:12.3333366Z [cluster2]                                                     "desiredNumberScheduled",
2021-07-19T08:19:12.3334121Z [cluster2]                                                     "numberMisscheduled",
2021-07-19T08:19:12.3334780Z [cluster2]                                                     "numberReady"
2021-07-19T08:19:12.3335300Z [cluster2]                                                 ],
2021-07-19T08:19:12.3335811Z [cluster2]                                                 "type": "object"
2021-07-19T08:19:12.3336322Z [cluster2]                                             }
2021-07-19T08:19:12.3336840Z [cluster2]                                         },
2021-07-19T08:19:12.3337332Z [cluster2]                                         "required": [
2021-07-19T08:19:12.3338032Z [cluster2]                                             "mismatchedContainerImages"
2021-07-19T08:19:12.3338705Z [cluster2]                                         ],
2021-07-19T08:19:12.3339195Z [cluster2]                                         "type": "object"
2021-07-19T08:19:12.3339692Z [cluster2]                                     },
2021-07-19T08:19:12.3340213Z [cluster2]                                     "gateways": {
2021-07-19T08:19:12.3340848Z [cluster2]                                         "items": {
2021-07-19T08:19:12.3341445Z [cluster2]                                             "properties": {
2021-07-19T08:19:12.3342123Z [cluster2]                                                 "connections": {
2021-07-19T08:19:12.3342748Z [cluster2]                                                     "items": {
2021-07-19T08:19:12.3343386Z [cluster2]                                                         "properties": {
2021-07-19T08:19:12.3344014Z [cluster2]                                                             "endpoint": {
2021-07-19T08:19:12.3344755Z [cluster2]                                                                 "properties": {
2021-07-19T08:19:12.3345305Z [cluster2]                                                                     "backend": {
2021-07-19T08:19:12.3345885Z [cluster2]                                                                         "type": "string"
2021-07-19T08:19:12.3346378Z [cluster2]                                                                     },
2021-07-19T08:19:12.3346947Z [cluster2]                                                                     "backend_config": {
2021-07-19T08:19:12.3347632Z [cluster2]                                                                         "additionalProperties": {
2021-07-19T08:19:12.3348283Z [cluster2]                                                                             "type": "string"
2021-07-19T08:19:12.3406490Z [cluster2]                                                                         },
2021-07-19T08:19:12.3407189Z [cluster2]                                                                         "type": "object"
2021-07-19T08:19:12.3408064Z [cluster2]                                                                     },
2021-07-19T08:19:12.3726932Z [cluster2]                                                                     "cable_name": {
2021-07-19T08:19:12.3727542Z [cluster2]                                                                         "type": "string"
2021-07-19T08:19:12.3728064Z [cluster2]                                                                     },
2021-07-19T08:19:12.3728584Z [cluster2]                                                                     "cluster_id": {
2021-07-19T08:19:12.3729157Z [cluster2]                                                                         "type": "string"
2021-07-19T08:19:12.3729700Z [cluster2]                                                                     },
2021-07-19T08:19:12.3730260Z [cluster2]                                                                     "healthCheckIP": {
2021-07-19T08:19:12.3730862Z [cluster2]                                                                         "type": "string"
2021-07-19T08:19:12.3731388Z [cluster2]                                                                     },
2021-07-19T08:19:12.3731904Z [cluster2]                                                                     "hostname": {
2021-07-19T08:19:12.3732463Z [cluster2]                                                                         "type": "string"
2021-07-19T08:19:12.3732981Z [cluster2]                                                                     },
2021-07-19T08:19:12.3733491Z [cluster2]                                                                     "nat_enabled": {
2021-07-19T08:19:12.3734335Z [cluster2]                                                                         "type": "boolean"
2021-07-19T08:19:12.3734793Z [cluster2]                                                                     },
2021-07-19T08:19:12.3735265Z [cluster2]                                                                     "private_ip": {
2021-07-19T08:19:12.3735772Z [cluster2]                                                                         "type": "string"
2021-07-19T08:19:12.3736232Z [cluster2]                                                                     },
2021-07-19T08:19:12.3736692Z [cluster2]                                                                     "public_ip": {
2021-07-19T08:19:12.3737178Z [cluster2]                                                                         "type": "string"
2021-07-19T08:19:12.3737646Z [cluster2]                                                                     },
2021-07-19T08:19:12.3738107Z [cluster2]                                                                     "subnets": {
2021-07-19T08:19:12.3738573Z [cluster2]                                                                         "items": {
2021-07-19T08:19:12.3739066Z [cluster2]                                                                             "type": "string"
2021-07-19T08:19:12.3739527Z [cluster2]                                                                         },
2021-07-19T08:19:12.3739999Z [cluster2]                                                                         "type": "array"
2021-07-19T08:19:12.3740449Z [cluster2]                                                                     }
2021-07-19T08:19:12.3740877Z [cluster2]                                                                 },
2021-07-19T08:19:12.3741331Z [cluster2]                                                                 "required": [
2021-07-19T08:19:12.3741807Z [cluster2]                                                                     "backend",
2021-07-19T08:19:12.3742295Z [cluster2]                                                                     "cable_name",
2021-07-19T08:19:12.3742771Z [cluster2]                                                                     "cluster_id",
2021-07-19T08:19:12.3743261Z [cluster2]                                                                     "hostname",
2021-07-19T08:19:12.3743821Z [cluster2]                                                                     "nat_enabled",
2021-07-19T08:19:12.3744326Z [cluster2]                                                                     "private_ip",
2021-07-19T08:19:12.3744820Z [cluster2]                                                                     "public_ip",
2021-07-19T08:19:12.3745293Z [cluster2]                                                                     "subnets"
2021-07-19T08:19:12.3745874Z [cluster2]                                                                 ],
2021-07-19T08:19:12.3746327Z [cluster2]                                                                 "type": "object"
2021-07-19T08:19:12.3746790Z [cluster2]                                                             },
2021-07-19T08:19:12.3747261Z [cluster2]                                                             "latencyRTT": {
2021-07-19T08:19:12.3748121Z [cluster2]                                                                 "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-19T08:19:12.3748991Z [cluster2]                                                                 "properties": {
2021-07-19T08:19:12.3749483Z [cluster2]                                                                     "average": {
2021-07-19T08:19:12.3749981Z [cluster2]                                                                         "type": "string"
2021-07-19T08:19:12.3750440Z [cluster2]                                                                     },
2021-07-19T08:19:12.3750886Z [cluster2]                                                                     "last": {
2021-07-19T08:19:12.3751424Z [cluster2]                                                                         "type": "string"
2021-07-19T08:19:12.3751974Z [cluster2]                                                                     },
2021-07-19T08:19:12.3752414Z [cluster2]                                                                     "max": {
2021-07-19T08:19:12.3752890Z [cluster2]                                                                         "type": "string"
2021-07-19T08:19:12.3753355Z [cluster2]                                                                     },
2021-07-19T08:19:12.3753984Z [cluster2]                                                                     "min": {
2021-07-19T08:19:12.3754446Z [cluster2]                                                                         "type": "string"
2021-07-19T08:19:12.3754909Z [cluster2]                                                                     },
2021-07-19T08:19:12.3755352Z [cluster2]                                                                     "stdDev": {
2021-07-19T08:19:12.3755841Z [cluster2]                                                                         "type": "string"
2021-07-19T08:19:12.3756292Z [cluster2]                                                                     }
2021-07-19T08:19:12.3756725Z [cluster2]                                                                 },
2021-07-19T08:19:12.3757193Z [cluster2]                                                                 "type": "object"
2021-07-19T08:19:12.3757639Z [cluster2]                                                             },
2021-07-19T08:19:12.3758083Z [cluster2]                                                             "status": {
2021-07-19T08:19:12.3758544Z [cluster2]                                                                 "type": "string"
2021-07-19T08:19:12.3759004Z [cluster2]                                                             },
2021-07-19T08:19:12.3759484Z [cluster2]                                                             "statusMessage": {
2021-07-19T08:19:12.3760008Z [cluster2]                                                                 "type": "string"
2021-07-19T08:19:12.3760467Z [cluster2]                                                             },
2021-07-19T08:19:12.3760903Z [cluster2]                                                             "usingIP": {
2021-07-19T08:19:12.3761444Z [cluster2]                                                                 "type": "string"
2021-07-19T08:19:12.3761898Z [cluster2]                                                             },
2021-07-19T08:19:12.3762354Z [cluster2]                                                             "usingNAT": {
2021-07-19T08:19:12.3762845Z [cluster2]                                                                 "type": "boolean"
2021-07-19T08:19:12.3763510Z [cluster2]                                                             }
2021-07-19T08:19:12.3763991Z [cluster2]                                                         },
2021-07-19T08:19:12.3764494Z [cluster2]                                                         "required": [
2021-07-19T08:19:12.3807719Z [cluster2]                                                             "endpoint",
2021-07-19T08:19:12.3808275Z [cluster2]                                                             "status",
2021-07-19T08:19:12.3808992Z [cluster2]                                                             "statusMessage"
2021-07-19T08:19:12.3809560Z [cluster2]                                                         ],
2021-07-19T08:19:12.3810071Z [cluster2]                                                         "type": "object"
2021-07-19T08:19:12.3810772Z [cluster2]                                                     },
2021-07-19T08:19:12.3811307Z [cluster2]                                                     "type": "array"
2021-07-19T08:19:12.3811854Z [cluster2]                                                 },
2021-07-19T08:19:12.3812584Z [cluster2]                                                 "haStatus": {
2021-07-19T08:19:12.3813178Z [cluster2]                                                     "type": "string"
2021-07-19T08:19:12.3813725Z [cluster2]                                                 },
2021-07-19T08:19:12.3814292Z [cluster2]                                                 "localEndpoint": {
2021-07-19T08:19:12.3814941Z [cluster2]                                                     "properties": {
2021-07-19T08:19:12.3815531Z [cluster2]                                                         "backend": {
2021-07-19T08:19:12.3816124Z [cluster2]                                                             "type": "string"
2021-07-19T08:19:12.3816671Z [cluster2]                                                         },
2021-07-19T08:19:12.3817241Z [cluster2]                                                         "backend_config": {
2021-07-19T08:19:12.3817982Z [cluster2]                                                             "additionalProperties": {
2021-07-19T08:19:12.3818709Z [cluster2]                                                                 "type": "string"
2021-07-19T08:19:12.3819278Z [cluster2]                                                             },
2021-07-19T08:19:12.3819825Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.3820388Z [cluster2]                                                         },
2021-07-19T08:19:12.3820928Z [cluster2]                                                         "cable_name": {
2021-07-19T08:19:12.3821532Z [cluster2]                                                             "type": "string"
2021-07-19T08:19:12.3822090Z [cluster2]                                                         },
2021-07-19T08:19:12.3822622Z [cluster2]                                                         "cluster_id": {
2021-07-19T08:19:12.3823217Z [cluster2]                                                             "type": "string"
2021-07-19T08:19:12.3823767Z [cluster2]                                                         },
2021-07-19T08:19:12.3824525Z [cluster2]                                                         "healthCheckIP": {
2021-07-19T08:19:12.3825169Z [cluster2]                                                             "type": "string"
2021-07-19T08:19:12.3825866Z [cluster2]                                                         },
2021-07-19T08:19:12.3826426Z [cluster2]                                                         "hostname": {
2021-07-19T08:19:12.3827020Z [cluster2]                                                             "type": "string"
2021-07-19T08:19:12.3827567Z [cluster2]                                                         },
2021-07-19T08:19:12.3828131Z [cluster2]                                                         "nat_enabled": {
2021-07-19T08:19:12.3828750Z [cluster2]                                                             "type": "boolean"
2021-07-19T08:19:12.3829307Z [cluster2]                                                         },
2021-07-19T08:19:12.3829868Z [cluster2]                                                         "private_ip": {
2021-07-19T08:19:12.3830461Z [cluster2]                                                             "type": "string"
2021-07-19T08:19:12.3831028Z [cluster2]                                                         },
2021-07-19T08:19:12.3831570Z [cluster2]                                                         "public_ip": {
2021-07-19T08:19:12.3832172Z [cluster2]                                                             "type": "string"
2021-07-19T08:19:12.3832735Z [cluster2]                                                         },
2021-07-19T08:19:12.3833268Z [cluster2]                                                         "subnets": {
2021-07-19T08:19:12.3833842Z [cluster2]                                                             "items": {
2021-07-19T08:19:12.3834476Z [cluster2]                                                                 "type": "string"
2021-07-19T08:19:12.3835049Z [cluster2]                                                             },
2021-07-19T08:19:12.3835592Z [cluster2]                                                             "type": "array"
2021-07-19T08:19:12.3836150Z [cluster2]                                                         }
2021-07-19T08:19:12.3836667Z [cluster2]                                                     },
2021-07-19T08:19:12.3837203Z [cluster2]                                                     "required": [
2021-07-19T08:19:12.3837788Z [cluster2]                                                         "backend",
2021-07-19T08:19:12.3838351Z [cluster2]                                                         "cable_name",
2021-07-19T08:19:12.3838950Z [cluster2]                                                         "cluster_id",
2021-07-19T08:19:12.3839531Z [cluster2]                                                         "hostname",
2021-07-19T08:19:12.3840130Z [cluster2]                                                         "nat_enabled",
2021-07-19T08:19:12.3840738Z [cluster2]                                                         "private_ip",
2021-07-19T08:19:12.3841313Z [cluster2]                                                         "public_ip",
2021-07-19T08:19:12.3841899Z [cluster2]                                                         "subnets"
2021-07-19T08:19:12.3842436Z [cluster2]                                                     ],
2021-07-19T08:19:12.3842998Z [cluster2]                                                     "type": "object"
2021-07-19T08:19:12.3843533Z [cluster2]                                                 },
2021-07-19T08:19:12.3844118Z [cluster2]                                                 "statusFailure": {
2021-07-19T08:19:12.3844757Z [cluster2]                                                     "type": "string"
2021-07-19T08:19:12.3904372Z [cluster2]                                                 },
2021-07-19T08:19:12.3904860Z [cluster2]                                                 "version": {
2021-07-19T08:19:12.3905332Z [cluster2]                                                     "type": "string"
2021-07-19T08:19:12.3905783Z [cluster2]                                                 }
2021-07-19T08:19:12.3906180Z [cluster2]                                             },
2021-07-19T08:19:12.3906866Z [cluster2]                                             "required": [
2021-07-19T08:19:12.3907356Z [cluster2]                                                 "connections",
2021-07-19T08:19:12.3907848Z [cluster2]                                                 "haStatus",
2021-07-19T08:19:12.3908357Z [cluster2]                                                 "localEndpoint",
2021-07-19T08:19:12.3908880Z [cluster2]                                                 "statusFailure",
2021-07-19T08:19:12.3909382Z [cluster2]                                                 "version"
2021-07-19T08:19:12.3909808Z [cluster2]                                             ],
2021-07-19T08:19:12.3910251Z [cluster2]                                             "type": "object"
2021-07-19T08:19:12.3910849Z [cluster2]                                         },
2021-07-19T08:19:12.3911339Z [cluster2]                                         "type": "array"
2021-07-19T08:19:12.3911825Z [cluster2]                                     },
2021-07-19T08:19:12.3912496Z [cluster2]                                     "globalCIDR": {
2021-07-19T08:19:12.3913087Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.3913598Z [cluster2]                                     },
2021-07-19T08:19:12.3914305Z [cluster2]                                     "globalnetDaemonSetStatus": {
2021-07-19T08:19:12.3915062Z [cluster2]                                         "properties": {
2021-07-19T08:19:12.3915771Z [cluster2]                                             "lastResourceVersion": {
2021-07-19T08:19:12.3916542Z [cluster2]                                                 "type": "string"
2021-07-19T08:19:12.3917090Z [cluster2]                                             },
2021-07-19T08:19:12.3917819Z [cluster2]                                             "mismatchedContainerImages": {
2021-07-19T08:19:12.3918592Z [cluster2]                                                 "type": "boolean"
2021-07-19T08:19:12.3919153Z [cluster2]                                             },
2021-07-19T08:19:12.3919833Z [cluster2]                                             "nonReadyContainerStates": {
2021-07-19T08:19:12.3920552Z [cluster2]                                                 "items": {
2021-07-19T08:19:12.3921870Z [cluster2]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T08:19:12.3923202Z [cluster2]                                                     "properties": {
2021-07-19T08:19:12.3923804Z [cluster2]                                                         "running": {
2021-07-19T08:19:12.3924530Z [cluster2]                                                             "description": "Details about a running container",
2021-07-19T08:19:12.3925528Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.3926152Z [cluster2]                                                                 "startedAt": {
2021-07-19T08:19:12.3927765Z [cluster2]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-19T08:19:12.3928750Z [cluster2]                                                                     "format": "date-time",
2021-07-19T08:19:12.3929346Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3929999Z [cluster2]                                                                 }
2021-07-19T08:19:12.3930476Z [cluster2]                                                             },
2021-07-19T08:19:12.3931009Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.3931541Z [cluster2]                                                         },
2021-07-19T08:19:12.3932157Z [cluster2]                                                         "terminated": {
2021-07-19T08:19:12.3932900Z [cluster2]                                                             "description": "Details about a terminated container",
2021-07-19T08:19:12.3933623Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.3934279Z [cluster2]                                                                 "containerID": {
2021-07-19T08:19:12.3935241Z [cluster2]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T08:19:12.3935942Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3936407Z [cluster2]                                                                 },
2021-07-19T08:19:12.3936856Z [cluster2]                                                                 "exitCode": {
2021-07-19T08:19:12.3937536Z [cluster2]                                                                     "description": "Exit status from the last termination of the container",
2021-07-19T08:19:12.3938201Z [cluster2]                                                                     "format": "int32",
2021-07-19T08:19:12.3938715Z [cluster2]                                                                     "type": "integer"
2021-07-19T08:19:12.3939188Z [cluster2]                                                                 },
2021-07-19T08:19:12.3939647Z [cluster2]                                                                 "finishedAt": {
2021-07-19T08:19:12.3940378Z [cluster2]                                                                     "description": "Time at which the container last terminated",
2021-07-19T08:19:12.3941229Z [cluster2]                                                                     "format": "date-time",
2021-07-19T08:19:12.3941759Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3942223Z [cluster2]                                                                 },
2021-07-19T08:19:12.3942664Z [cluster2]                                                                 "message": {
2021-07-19T08:19:12.3943358Z [cluster2]                                                                     "description": "Message regarding the last termination of the container",
2021-07-19T08:19:12.3944051Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3944520Z [cluster2]                                                                 },
2021-07-19T08:19:12.3944974Z [cluster2]                                                                 "reason": {
2021-07-19T08:19:12.3945637Z [cluster2]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-19T08:19:12.3946326Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3946784Z [cluster2]                                                                 },
2021-07-19T08:19:12.3947231Z [cluster2]                                                                 "signal": {
2021-07-19T08:19:12.3947867Z [cluster2]                                                                     "description": "Signal from the last termination of the container",
2021-07-19T08:19:12.3948704Z [cluster2]                                                                     "format": "int32",
2021-07-19T08:19:12.3949287Z [cluster2]                                                                     "type": "integer"
2021-07-19T08:19:12.3949817Z [cluster2]                                                                 },
2021-07-19T08:19:12.3950354Z [cluster2]                                                                 "startedAt": {
2021-07-19T08:19:12.3951195Z [cluster2]                                                                     "description": "Time at which previous execution of the container started",
2021-07-19T08:19:12.3952242Z [cluster2]                                                                     "format": "date-time",
2021-07-19T08:19:12.3952844Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3953363Z [cluster2]                                                                 }
2021-07-19T08:19:12.3953844Z [cluster2]                                                             },
2021-07-19T08:19:12.3954355Z [cluster2]                                                             "required": [
2021-07-19T08:19:12.3954915Z [cluster2]                                                                 "exitCode"
2021-07-19T08:19:12.3955419Z [cluster2]                                                             ],
2021-07-19T08:19:12.3955951Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.3956473Z [cluster2]                                                         },
2021-07-19T08:19:12.3956967Z [cluster2]                                                         "waiting": {
2021-07-19T08:19:12.3957653Z [cluster2]                                                             "description": "Details about a waiting container",
2021-07-19T08:19:12.3958354Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.3958932Z [cluster2]                                                                 "message": {
2021-07-19T08:19:12.3959770Z [cluster2]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-19T08:19:12.3960535Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3961347Z [cluster2]                                                                 },
2021-07-19T08:19:12.3961849Z [cluster2]                                                                 "reason": {
2021-07-19T08:19:12.3962778Z [cluster2]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-19T08:19:12.3963691Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.3964201Z [cluster2]                                                                 }
2021-07-19T08:19:12.3964682Z [cluster2]                                                             },
2021-07-19T08:19:12.4027682Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.4028247Z [cluster2]                                                         }
2021-07-19T08:19:12.4028715Z [cluster2]                                                     },
2021-07-19T08:19:12.4029441Z [cluster2]                                                     "type": "object"
2021-07-19T08:19:12.4029982Z [cluster2]                                                 },
2021-07-19T08:19:12.4030620Z [cluster2]                                                 "type": "array"
2021-07-19T08:19:12.4031164Z [cluster2]                                             },
2021-07-19T08:19:12.4031676Z [cluster2]                                             "status": {
2021-07-19T08:19:12.4032553Z [cluster2]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T08:19:12.4033448Z [cluster2]                                                 "properties": {
2021-07-19T08:19:12.4034106Z [cluster2]                                                     "collisionCount": {
2021-07-19T08:19:12.4035711Z [cluster2]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T08:19:12.4037082Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4037702Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4038257Z [cluster2]                                                     },
2021-07-19T08:19:12.4038822Z [cluster2]                                                     "conditions": {
2021-07-19T08:19:12.4040354Z [cluster2]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T08:19:12.4041279Z [cluster2]                                                         "items": {
2021-07-19T08:19:12.4042299Z [cluster2]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T08:19:12.4043192Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.4043855Z [cluster2]                                                                 "lastTransitionTime": {
2021-07-19T08:19:12.4044750Z [cluster2]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-19T08:19:12.4057783Z [cluster2]                                                                     "format": "date-time",
2021-07-19T08:19:12.4058467Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4059419Z [cluster2]                                                                 },
2021-07-19T08:19:12.4059985Z [cluster2]                                                                 "message": {
2021-07-19T08:19:12.4060877Z [cluster2]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-19T08:19:12.4061781Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4062358Z [cluster2]                                                                 },
2021-07-19T08:19:12.4062895Z [cluster2]                                                                 "reason": {
2021-07-19T08:19:12.4064065Z [cluster2]                                                                     "description": "The reason for the condition's last transition.",
2021-07-19T08:19:12.4064808Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4065344Z [cluster2]                                                                 },
2021-07-19T08:19:12.4065855Z [cluster2]                                                                 "status": {
2021-07-19T08:19:12.4066599Z [cluster2]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T08:19:12.4067369Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4067883Z [cluster2]                                                                 },
2021-07-19T08:19:12.4068477Z [cluster2]                                                                 "type": {
2021-07-19T08:19:12.4069072Z [cluster2]                                                                     "description": "Type of DaemonSet condition.",
2021-07-19T08:19:12.4069672Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4070137Z [cluster2]                                                                 }
2021-07-19T08:19:12.4070549Z [cluster2]                                                             },
2021-07-19T08:19:12.4071011Z [cluster2]                                                             "required": [
2021-07-19T08:19:12.4071559Z [cluster2]                                                                 "status",
2021-07-19T08:19:12.4072031Z [cluster2]                                                                 "type"
2021-07-19T08:19:12.4072472Z [cluster2]                                                             ],
2021-07-19T08:19:12.4072923Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.4073387Z [cluster2]                                                         },
2021-07-19T08:19:12.4073829Z [cluster2]                                                         "type": "array"
2021-07-19T08:19:12.4074463Z [cluster2]                                                     },
2021-07-19T08:19:12.4075101Z [cluster2]                                                     "currentNumberScheduled": {
2021-07-19T08:19:12.4076507Z [cluster2]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.4077752Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4078319Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4078842Z [cluster2]                                                     },
2021-07-19T08:19:12.4079477Z [cluster2]                                                     "desiredNumberScheduled": {
2021-07-19T08:19:12.4080991Z [cluster2]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.4106802Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4107408Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4107940Z [cluster2]                                                     },
2021-07-19T08:19:12.4108494Z [cluster2]                                                     "numberAvailable": {
2021-07-19T08:19:12.4109888Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T08:19:12.4111117Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4111719Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4112287Z [cluster2]                                                     },
2021-07-19T08:19:12.4112914Z [cluster2]                                                     "numberMisscheduled": {
2021-07-19T08:19:12.4114349Z [cluster2]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.4115685Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4116287Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4116850Z [cluster2]                                                     },
2021-07-19T08:19:12.4117415Z [cluster2]                                                     "numberReady": {
2021-07-19T08:19:12.4118432Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T08:19:12.4119599Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4120203Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4120765Z [cluster2]                                                     },
2021-07-19T08:19:12.4121380Z [cluster2]                                                     "numberUnavailable": {
2021-07-19T08:19:12.4152002Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T08:19:12.4153311Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4153922Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4154642Z [cluster2]                                                     },
2021-07-19T08:19:12.4155281Z [cluster2]                                                     "observedGeneration": {
2021-07-19T08:19:12.4156576Z [cluster2]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T08:19:12.4157478Z [cluster2]                                                         "format": "int64",
2021-07-19T08:19:12.4158349Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4158879Z [cluster2]                                                     },
2021-07-19T08:19:12.4159817Z [cluster2]                                                     "updatedNumberScheduled": {
2021-07-19T08:19:12.4160731Z [cluster2]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T08:19:12.4175777Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4176401Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4176932Z [cluster2]                                                     }
2021-07-19T08:19:12.4177384Z [cluster2]                                                 },
2021-07-19T08:19:12.4177888Z [cluster2]                                                 "required": [
2021-07-19T08:19:12.4178568Z [cluster2]                                                     "currentNumberScheduled",
2021-07-19T08:19:12.4179494Z [cluster2]                                                     "desiredNumberScheduled",
2021-07-19T08:19:12.4181315Z [cluster2]                                                     "numberMisscheduled",
2021-07-19T08:19:12.4182045Z [cluster2]                                                     "numberReady"
2021-07-19T08:19:12.4182699Z [cluster2]                                                 ],
2021-07-19T08:19:12.4183377Z [cluster2]                                                 "type": "object"
2021-07-19T08:19:12.4183939Z [cluster2]                                             }
2021-07-19T08:19:12.4184418Z [cluster2]                                         },
2021-07-19T08:19:12.4184942Z [cluster2]                                         "required": [
2021-07-19T08:19:12.4185696Z [cluster2]                                             "mismatchedContainerImages"
2021-07-19T08:19:12.4186489Z [cluster2]                                         ],
2021-07-19T08:19:12.4186994Z [cluster2]                                         "type": "object"
2021-07-19T08:19:12.4187473Z [cluster2]                                     },
2021-07-19T08:19:12.4188052Z [cluster2]                                     "loadBalancerStatus": {
2021-07-19T08:19:12.4188671Z [cluster2]                                         "properties": {
2021-07-19T08:19:12.4189210Z [cluster2]                                             "status": {
2021-07-19T08:19:12.4202113Z [cluster2]                                                 "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-19T08:19:12.4203248Z [cluster2]                                                 "properties": {
2021-07-19T08:19:12.4203816Z [cluster2]                                                     "ingress": {
2021-07-19T08:19:12.4213076Z [cluster2]                                                         "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-19T08:19:12.4214202Z [cluster2]                                                         "items": {
2021-07-19T08:19:12.4229084Z [cluster2]                                                             "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-19T08:19:12.4230413Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.4231063Z [cluster2]                                                                 "hostname": {
2021-07-19T08:19:12.4232462Z [cluster2]                                                                     "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-19T08:19:12.4233633Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4234200Z [cluster2]                                                                 },
2021-07-19T08:19:12.4234743Z [cluster2]                                                                 "ip": {
2021-07-19T08:19:12.4236283Z [cluster2]                                                                     "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-19T08:19:12.4237330Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4237910Z [cluster2]                                                                 }
2021-07-19T08:19:12.4238429Z [cluster2]                                                             },
2021-07-19T08:19:12.4239003Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.4239570Z [cluster2]                                                         },
2021-07-19T08:19:12.4240112Z [cluster2]                                                         "type": "array"
2021-07-19T08:19:12.4240662Z [cluster2]                                                     }
2021-07-19T08:19:12.4241159Z [cluster2]                                                 },
2021-07-19T08:19:12.4241704Z [cluster2]                                                 "type": "object"
2021-07-19T08:19:12.4242231Z [cluster2]                                             }
2021-07-19T08:19:12.4242721Z [cluster2]                                         },
2021-07-19T08:19:12.4243249Z [cluster2]                                         "type": "object"
2021-07-19T08:19:12.4243793Z [cluster2]                                     },
2021-07-19T08:19:12.4244335Z [cluster2]                                     "natEnabled": {
2021-07-19T08:19:12.4245306Z [cluster2]                                         "type": "boolean"
2021-07-19T08:19:12.4245747Z [cluster2]                                     },
2021-07-19T08:19:12.4246193Z [cluster2]                                     "networkPlugin": {
2021-07-19T08:19:12.4246699Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.4247122Z [cluster2]                                     },
2021-07-19T08:19:12.4247709Z [cluster2]                                     "routeAgentDaemonSetStatus": {
2021-07-19T08:19:12.4248337Z [cluster2]                                         "properties": {
2021-07-19T08:19:12.4248913Z [cluster2]                                             "lastResourceVersion": {
2021-07-19T08:19:12.4249576Z [cluster2]                                                 "type": "string"
2021-07-19T08:19:12.4250010Z [cluster2]                                             },
2021-07-19T08:19:12.4250600Z [cluster2]                                             "mismatchedContainerImages": {
2021-07-19T08:19:12.4251225Z [cluster2]                                                 "type": "boolean"
2021-07-19T08:19:12.4251671Z [cluster2]                                             },
2021-07-19T08:19:12.4252234Z [cluster2]                                             "nonReadyContainerStates": {
2021-07-19T08:19:12.4252830Z [cluster2]                                                 "items": {
2021-07-19T08:19:12.4253892Z [cluster2]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T08:19:12.4255099Z [cluster2]                                                     "properties": {
2021-07-19T08:19:12.4255598Z [cluster2]                                                         "running": {
2021-07-19T08:19:12.4256197Z [cluster2]                                                             "description": "Details about a running container",
2021-07-19T08:19:12.4256821Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.4257335Z [cluster2]                                                                 "startedAt": {
2021-07-19T08:19:12.4258241Z [cluster2]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-19T08:19:12.4259176Z [cluster2]                                                                     "format": "date-time",
2021-07-19T08:19:12.4259696Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4260161Z [cluster2]                                                                 }
2021-07-19T08:19:12.4260585Z [cluster2]                                                             },
2021-07-19T08:19:12.4261029Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.4261487Z [cluster2]                                                         },
2021-07-19T08:19:12.4261943Z [cluster2]                                                         "terminated": {
2021-07-19T08:19:12.4262585Z [cluster2]                                                             "description": "Details about a terminated container",
2021-07-19T08:19:12.4263217Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.4263745Z [cluster2]                                                                 "containerID": {
2021-07-19T08:19:12.4264685Z [cluster2]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T08:19:12.4265372Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4265839Z [cluster2]                                                                 },
2021-07-19T08:19:12.4266293Z [cluster2]                                                                 "exitCode": {
2021-07-19T08:19:12.4266973Z [cluster2]                                                                     "description": "Exit status from the last termination of the container",
2021-07-19T08:19:12.4267652Z [cluster2]                                                                     "format": "int32",
2021-07-19T08:19:12.4268154Z [cluster2]                                                                     "type": "integer"
2021-07-19T08:19:12.4268633Z [cluster2]                                                                 },
2021-07-19T08:19:12.4269097Z [cluster2]                                                                 "finishedAt": {
2021-07-19T08:19:12.4269808Z [cluster2]                                                                     "description": "Time at which the container last terminated",
2021-07-19T08:19:12.4270667Z [cluster2]                                                                     "format": "date-time",
2021-07-19T08:19:12.4271186Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4271665Z [cluster2]                                                                 },
2021-07-19T08:19:12.4272110Z [cluster2]                                                                 "message": {
2021-07-19T08:19:12.4272811Z [cluster2]                                                                     "description": "Message regarding the last termination of the container",
2021-07-19T08:19:12.4273667Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4274215Z [cluster2]                                                                 },
2021-07-19T08:19:12.4274735Z [cluster2]                                                                 "reason": {
2021-07-19T08:19:12.4275494Z [cluster2]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-19T08:19:12.4276274Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4276956Z [cluster2]                                                                 },
2021-07-19T08:19:12.4277572Z [cluster2]                                                                 "signal": {
2021-07-19T08:19:12.4278387Z [cluster2]                                                                     "description": "Signal from the last termination of the container",
2021-07-19T08:19:12.4279195Z [cluster2]                                                                     "format": "int32",
2021-07-19T08:19:12.4279835Z [cluster2]                                                                     "type": "integer"
2021-07-19T08:19:12.4280401Z [cluster2]                                                                 },
2021-07-19T08:19:12.4281031Z [cluster2]                                                                 "startedAt": {
2021-07-19T08:19:12.4281897Z [cluster2]                                                                     "description": "Time at which previous execution of the container started",
2021-07-19T08:19:12.4283156Z [cluster2]                                                                     "format": "date-time",
2021-07-19T08:19:12.4283814Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4284369Z [cluster2]                                                                 }
2021-07-19T08:19:12.4284892Z [cluster2]                                                             },
2021-07-19T08:19:12.4286412Z [cluster2]                                                             "required": [
2021-07-19T08:19:12.4286996Z [cluster2]                                                                 "exitCode"
2021-07-19T08:19:12.4287525Z [cluster2]                                                             ],
2021-07-19T08:19:12.4288039Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.4288567Z [cluster2]                                                         },
2021-07-19T08:19:12.4289071Z [cluster2]                                                         "waiting": {
2021-07-19T08:19:12.4289762Z [cluster2]                                                             "description": "Details about a waiting container",
2021-07-19T08:19:12.4290481Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.4291047Z [cluster2]                                                                 "message": {
2021-07-19T08:19:12.4291939Z [cluster2]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-19T08:19:12.4292716Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4293251Z [cluster2]                                                                 },
2021-07-19T08:19:12.4293756Z [cluster2]                                                                 "reason": {
2021-07-19T08:19:12.4294539Z [cluster2]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-19T08:19:12.4295194Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4295733Z [cluster2]                                                                 }
2021-07-19T08:19:12.4296101Z [cluster2]                                                             },
2021-07-19T08:19:12.4296489Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.4296888Z [cluster2]                                                         }
2021-07-19T08:19:12.4297238Z [cluster2]                                                     },
2021-07-19T08:19:12.4297637Z [cluster2]                                                     "type": "object"
2021-07-19T08:19:12.4298027Z [cluster2]                                                 },
2021-07-19T08:19:12.4298394Z [cluster2]                                                 "type": "array"
2021-07-19T08:19:12.4298827Z [cluster2]                                             },
2021-07-19T08:19:12.4299181Z [cluster2]                                             "status": {
2021-07-19T08:19:12.4299794Z [cluster2]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T08:19:12.4300441Z [cluster2]                                                 "properties": {
2021-07-19T08:19:12.4300905Z [cluster2]                                                     "collisionCount": {
2021-07-19T08:19:12.4301899Z [cluster2]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T08:19:12.4303114Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4303619Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4304081Z [cluster2]                                                     },
2021-07-19T08:19:12.4304520Z [cluster2]                                                     "conditions": {
2021-07-19T08:19:12.4305623Z [cluster2]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T08:19:12.4306358Z [cluster2]                                                         "items": {
2021-07-19T08:19:12.4307127Z [cluster2]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T08:19:12.4307908Z [cluster2]                                                             "properties": {
2021-07-19T08:19:12.4308498Z [cluster2]                                                                 "lastTransitionTime": {
2021-07-19T08:19:12.4309280Z [cluster2]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-19T08:19:12.4310168Z [cluster2]                                                                     "format": "date-time",
2021-07-19T08:19:12.4310702Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4311213Z [cluster2]                                                                 },
2021-07-19T08:19:12.4311671Z [cluster2]                                                                 "message": {
2021-07-19T08:19:12.4312389Z [cluster2]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-19T08:19:12.4313099Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4313575Z [cluster2]                                                                 },
2021-07-19T08:19:12.4314128Z [cluster2]                                                                 "reason": {
2021-07-19T08:19:12.4314876Z [cluster2]                                                                     "description": "The reason for the condition's last transition.",
2021-07-19T08:19:12.4315443Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4315835Z [cluster2]                                                                 },
2021-07-19T08:19:12.4316225Z [cluster2]                                                                 "status": {
2021-07-19T08:19:12.4316972Z [cluster2]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T08:19:12.4317640Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4318163Z [cluster2]                                                                 },
2021-07-19T08:19:12.4318594Z [cluster2]                                                                 "type": {
2021-07-19T08:19:12.4319193Z [cluster2]                                                                     "description": "Type of DaemonSet condition.",
2021-07-19T08:19:12.4319798Z [cluster2]                                                                     "type": "string"
2021-07-19T08:19:12.4320259Z [cluster2]                                                                 }
2021-07-19T08:19:12.4320667Z [cluster2]                                                             },
2021-07-19T08:19:12.4321126Z [cluster2]                                                             "required": [
2021-07-19T08:19:12.4321606Z [cluster2]                                                                 "status",
2021-07-19T08:19:12.4322052Z [cluster2]                                                                 "type"
2021-07-19T08:19:12.4322496Z [cluster2]                                                             ],
2021-07-19T08:19:12.4322945Z [cluster2]                                                             "type": "object"
2021-07-19T08:19:12.4323402Z [cluster2]                                                         },
2021-07-19T08:19:12.4323842Z [cluster2]                                                         "type": "array"
2021-07-19T08:19:12.4324471Z [cluster2]                                                     },
2021-07-19T08:19:12.4325672Z [cluster2]                                                     "currentNumberScheduled": {
2021-07-19T08:19:12.4327281Z [cluster2]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.4328520Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4329091Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4329616Z [cluster2]                                                     },
2021-07-19T08:19:12.4330260Z [cluster2]                                                     "desiredNumberScheduled": {
2021-07-19T08:19:12.4331782Z [cluster2]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.4333098Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4333664Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4334197Z [cluster2]                                                     },
2021-07-19T08:19:12.4334973Z [cluster2]                                                     "numberAvailable": {
2021-07-19T08:19:12.4336244Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T08:19:12.4337464Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4338067Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4338637Z [cluster2]                                                     },
2021-07-19T08:19:12.4339279Z [cluster2]                                                     "numberMisscheduled": {
2021-07-19T08:19:12.4340696Z [cluster2]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.4342102Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4342704Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4350552Z [cluster2]                                                     },
2021-07-19T08:19:12.4351052Z [cluster2]                                                     "numberReady": {
2021-07-19T08:19:12.4351868Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T08:19:12.4352672Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4353161Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4353625Z [cluster2]                                                     },
2021-07-19T08:19:12.4354142Z [cluster2]                                                     "numberUnavailable": {
2021-07-19T08:19:12.4355164Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T08:19:12.4356002Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4356422Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4356817Z [cluster2]                                                     },
2021-07-19T08:19:12.4357256Z [cluster2]                                                     "observedGeneration": {
2021-07-19T08:19:12.4357936Z [cluster2]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T08:19:12.4358551Z [cluster2]                                                         "format": "int64",
2021-07-19T08:19:12.4358972Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4359375Z [cluster2]                                                     },
2021-07-19T08:19:12.4359971Z [cluster2]                                                     "updatedNumberScheduled": {
2021-07-19T08:19:12.4410397Z [cluster2]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T08:19:12.4411312Z [cluster2]                                                         "format": "int32",
2021-07-19T08:19:12.4411891Z [cluster2]                                                         "type": "integer"
2021-07-19T08:19:12.4412422Z [cluster2]                                                     }
2021-07-19T08:19:12.4412875Z [cluster2]                                                 },
2021-07-19T08:19:12.4413392Z [cluster2]                                                 "required": [
2021-07-19T08:19:12.4414063Z [cluster2]                                                     "currentNumberScheduled",
2021-07-19T08:19:12.4414889Z [cluster2]                                                     "desiredNumberScheduled",
2021-07-19T08:19:12.4415648Z [cluster2]                                                     "numberMisscheduled",
2021-07-19T08:19:12.4416299Z [cluster2]                                                     "numberReady"
2021-07-19T08:19:12.4416829Z [cluster2]                                                 ],
2021-07-19T08:19:12.4417428Z [cluster2]                                                 "type": "object"
2021-07-19T08:19:12.4417938Z [cluster2]                                             }
2021-07-19T08:19:12.4418374Z [cluster2]                                         },
2021-07-19T08:19:12.4418868Z [cluster2]                                         "required": [
2021-07-19T08:19:12.4419683Z [cluster2]                                             "mismatchedContainerImages"
2021-07-19T08:19:12.4420355Z [cluster2]                                         ],
2021-07-19T08:19:12.4420841Z [cluster2]                                         "type": "object"
2021-07-19T08:19:12.4421332Z [cluster2]                                     },
2021-07-19T08:19:12.4421849Z [cluster2]                                     "serviceCIDR": {
2021-07-19T08:19:12.4422384Z [cluster2]                                         "type": "string"
2021-07-19T08:19:12.4422873Z [cluster2]                                     }
2021-07-19T08:19:12.4423294Z [cluster2]                                 },
2021-07-19T08:19:12.4423769Z [cluster2]                                 "required": [
2021-07-19T08:19:12.4424284Z [cluster2]                                     "clusterID",
2021-07-19T08:19:12.4424822Z [cluster2]                                     "natEnabled"
2021-07-19T08:19:12.4425295Z [cluster2]                                 ],
2021-07-19T08:19:12.4425777Z [cluster2]                                 "type": "object"
2021-07-19T08:19:12.4426249Z [cluster2]                             }
2021-07-19T08:19:12.4426656Z [cluster2]                         },
2021-07-19T08:19:12.4427127Z [cluster2]                         "type": "object"
2021-07-19T08:19:12.4427570Z [cluster2]                     }
2021-07-19T08:19:12.4427981Z [cluster2]                 },
2021-07-19T08:19:12.4428421Z [cluster2]                 "served": true,
2021-07-19T08:19:12.4428925Z [cluster2]                 "storage": true,
2021-07-19T08:19:12.4429437Z [cluster2]                 "subresources": {
2021-07-19T08:19:12.4429939Z [cluster2]                     "status": {}
2021-07-19T08:19:12.4430352Z [cluster2]                 }
2021-07-19T08:19:12.4430782Z [cluster2]             }
2021-07-19T08:19:12.4431181Z [cluster2]         ]
2021-07-19T08:19:12.4431556Z [cluster2]     },
2021-07-19T08:19:12.4431974Z [cluster2]     "status": {
2021-07-19T08:19:12.4432453Z [cluster2]         "acceptedNames": {
2021-07-19T08:19:12.4433004Z [cluster2]             "kind": "Submariner",
2021-07-19T08:19:12.4433583Z [cluster2]             "listKind": "SubmarinerList",
2021-07-19T08:19:12.4434199Z [cluster2]             "plural": "submariners",
2021-07-19T08:19:12.4434757Z [cluster2]             "singular": "submariner"
2021-07-19T08:19:12.4435236Z [cluster2]         },
2021-07-19T08:19:12.4435731Z [cluster2]         "conditions": [
2021-07-19T08:19:12.4436393Z [cluster2]             {
2021-07-19T08:19:12.4438446Z [cluster2]                 "lastTransitionTime": "2021-07-19T08:17:51Z",
2021-07-19T08:19:12.4439387Z [cluster2]                 "message": "no conflicts found",
2021-07-19T08:19:12.4440046Z [cluster2]                 "reason": "NoConflicts",
2021-07-19T08:19:12.4440612Z [cluster2]                 "status": "True",
2021-07-19T08:19:12.4441214Z [cluster2]                 "type": "NamesAccepted"
2021-07-19T08:19:12.4441754Z [cluster2]             },
2021-07-19T08:19:12.4442184Z [cluster2]             {
2021-07-19T08:19:12.4443020Z [cluster2]                 "lastTransitionTime": "2021-07-19T08:17:51Z",
2021-07-19T08:19:12.4443816Z [cluster2]                 "message": "the initial names have been accepted",
2021-07-19T08:19:12.4444629Z [cluster2]                 "reason": "InitialNamesAccepted",
2021-07-19T08:19:12.4445868Z [cluster2]                 "status": "True",
2021-07-19T08:19:12.4446455Z [cluster2]                 "type": "Established"
2021-07-19T08:19:12.4446957Z [cluster2]             }
2021-07-19T08:19:12.4447382Z [cluster2]         ],
2021-07-19T08:19:12.4447884Z [cluster2]         "storedVersions": [
2021-07-19T08:19:12.4448440Z [cluster2]             "v1alpha1"
2021-07-19T08:19:12.4448887Z [cluster2]         ]
2021-07-19T08:19:12.4449305Z [cluster2]     }
2021-07-19T08:19:12.4449698Z [cluster2] }
2021-07-19T08:19:12.4450880Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io[0m
2021-07-19T08:19:12.4452699Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io[0m
2021-07-19T08:19:12.4454617Z [36m[submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster2.json[0m
2021-07-19T08:19:12.4456305Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced[0m
2021-07-19T08:19:12.4457585Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced[0m
2021-07-19T08:19:12.5559636Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/submarind": "Cluster",
2021-07-19T08:19:12.5560703Z [cluster1]             "listKind": "ClusterList",
2021-07-19T08:19:12.5561435Z [cluster1]             "plural": "clusters",
2021-07-19T08:19:12.5562131Z [cluster1]             "singular": "cluster"
2021-07-19T08:19:12.5562722Z [cluster1]         },
2021-07-19T08:19:12.5563458Z [cluster1]         "conditions": [
2021-07-19T08:19:12.5564050Z [cluster1]             {
2021-07-19T08:19:12.5567172Z [cluster1]                 "lastTransitionTime": "2021-07-19T08:17:48Z",
2021-07-19T08:19:12.5568232Z [cluster1]                 "message": "no conflicts found",
2021-07-19T08:19:12.5568922Z [cluster1]                 "reason": "NoConflicts",
2021-07-19T08:19:12.5569401Z [cluster1]                 "status": "True",
2021-07-19T08:19:12.5569880Z [cluster1]                 "type": "NamesAccepted"
2021-07-19T08:19:12.5570350Z [cluster1]             },
2021-07-19T08:19:12.5570710Z [cluster1]             {
2021-07-19T08:19:12.5571469Z [cluster1]                 "lastTransitionTime": "2021-07-19T08:17:48Z",
2021-07-19T08:19:12.5572120Z [cluster1]                 "message": "the initial names have been accepted",
2021-07-19T08:19:12.5572975Z [cluster1]                 "reason": "InitialNamesAccepted",
2021-07-19T08:19:12.5573609Z [cluster1]                 "status": "True",
2021-07-19T08:19:12.5574126Z [cluster1]                 "type": "Established"
2021-07-19T08:19:12.5574607Z [cluster1]             }
2021-07-19T08:19:12.5575000Z [cluster1]         ],
2021-07-19T08:19:12.5575487Z [cluster1]         "storedVersions": [
2021-07-19T08:19:12.5575961Z [cluster1]             "v1"
2021-07-19T08:19:12.5576442Z [cluster1]         ]
2021-07-19T08:19:12.5576784Z [cluster1]     }
2021-07-19T08:19:12.5577106Z [cluster1] }
2021-07-19T08:19:12.5578016Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io[0m
2021-07-19T08:19:12.5579860Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io[0m
2021-07-19T08:19:12.5581543Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster1.json[0m
2021-07-19T08:19:12.5583036Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced[0m
2021-07-19T08:19:12.5584227Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced[0m
2021-07-19T08:19:12.5585732Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster1.json[0m
2021-07-19T08:19:12.5587223Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io[0m
2021-07-19T08:19:12.5588570Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io[0m
2021-07-19T08:19:12.5590143Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster1.json[0m
2021-07-19T08:19:12.5591450Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster[0m
2021-07-19T08:19:12.5592503Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster[0m
2021-07-19T08:19:12.5593862Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster1.json[0m
2021-07-19T08:19:12.5595681Z [36m[submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster[0m
2021-07-19T08:19:12.5596936Z [36m[submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster[0m
2021-07-19T08:19:12.5598604Z [36m[submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster1.json[0m
2021-07-19T08:19:12.5599884Z [36m[submariner-operator]$ [cluster1] verify_subm_crd[0m
2021-07-19T08:19:12.5600693Z [36m[submariner-operator]$ [cluster1] verify_subm_crd[0m
2021-07-19T08:19:12.5601783Z [36m[submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner[0m
2021-07-19T08:19:12.5603101Z [36m[submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner[0m
2021-07-19T08:19:12.5604360Z [36m[submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io[0m
2021-07-19T08:19:12.5647230Z [36m[submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io[0m
2021-07-19T08:19:12.5648751Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io[0m
2021-07-19T08:19:12.5649581Z [cluster1] NAME                        CREATED AT
2021-07-19T08:19:12.5650358Z [cluster1] submariners.submariner.io   2021-07-19T08:17:39Z
2021-07-19T08:19:12.5651617Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/submariners.submariner.io.cluster1.json[0m
2021-07-19T08:19:12.5653016Z [36m[submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json[0m
2021-07-19T08:19:12.5654711Z [36m[submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json[0m
2021-07-19T08:19:12.5656603Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd submariners.submariner.io -o json[0m
2021-07-19T08:19:12.5658452Z [36m[submariner-operator]$ [cluster1] tee /tmp/submariners.submariner.io.cluster1.json[0m
2021-07-19T08:19:12.5659597Z [cluster1] {
2021-07-19T08:19:12.5660248Z [cluster1]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T08:19:12.5661128Z [cluster1]     "kind": "CustomResourceDefinition",
2021-07-19T08:19:12.5661809Z [cluster1]     "metadata": {
2021-07-19T08:19:12.5662347Z [cluster1]         "annotations": {
2021-07-19T08:19:12.5663351Z [cluster1]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T08:19:12.5664107Z [cluster1]         },
2021-07-19T08:19:12.5664961Z [cluster1]         "creationTimestamp": "2021-07-19T08:17:39Z",
2021-07-19T08:19:12.5665602Z [cluster1]         "generation": 1,
2021-07-19T08:19:12.5666316Z [cluster1]         "name": "submariners.submariner.io",
2021-07-19T08:19:12.5667274Z [cluster1]         "resourceVersion": "1621",
2021-07-19T08:19:12.5668472Z [cluster1]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/submariners.submariner.io",
2021-07-19T08:19:12.5670011Z [cluster1]         "uid": "939e54c4-828a-43d6-9df7-7b720cc964d8"
2021-07-19T08:19:12.5670758Z [cluster1]     },
2021-07-19T08:19:12.5671184Z [cluster1]     "spec": {
2021-07-19T08:19:12.5671690Z [cluster1]         "conversion": {
2021-07-19T08:19:12.5672216Z [cluster1]             "strategy": "None"
2021-07-19T08:19:12.5672710Z [cluster1]         },
2021-07-19T08:19:12.5673230Z [cluster1]         "group": "submariner.io",
2021-07-19T08:19:12.5673781Z [cluster1]         "names": {
2021-07-19T08:19:12.5674296Z [cluster1]             "kind": "Submariner",
2021-07-19T08:19:12.5675024Z [cluster1]             "listKind": "SubmarinerList",
2021-07-19T08:19:12.5675627Z [cluster1]             "plural": "submariners",
2021-07-19T08:19:12.5676209Z [cluster1]             "singular": "submariner"
2021-07-19T08:19:12.5676689Z [cluster1]         },
2021-07-19T08:19:12.5677153Z [cluster1]         "scope": "Namespaced",
2021-07-19T08:19:12.5677671Z [cluster1]         "versions": [
2021-07-19T08:19:12.5678091Z [cluster1]             {
2021-07-19T08:19:12.5678548Z [cluster1]                 "name": "v1alpha1",
2021-07-19T08:19:12.5679022Z [cluster1]                 "schema": {
2021-07-19T08:19:12.5679566Z [cluster1]                     "openAPIV3Schema": {
2021-07-19T08:19:12.5680324Z [cluster1]                         "description": "Submariner is the Schema for the submariners API",
2021-07-19T08:19:12.5681136Z [cluster1]                         "properties": {
2021-07-19T08:19:12.5681678Z [cluster1]                             "apiVersion": {
2021-07-19T08:19:12.5683890Z [cluster1]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T08:19:12.5702444Z [cluster1]                                 "type": "string"
2021-07-19T08:19:12.5702950Z [cluster1]                             },
2021-07-19T08:19:12.5703392Z [cluster1]                             "kind": {
2021-07-19T08:19:12.5706197Z [cluster1]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T08:19:12.5708037Z [cluster1]                                 "type": "string"
2021-07-19T08:19:12.5708526Z [cluster1]                             },
2021-07-19T08:19:12.5708993Z [cluster1]                             "metadata": {
2021-07-19T08:19:12.5709505Z [cluster1]                                 "type": "object"
2021-07-19T08:19:12.5709981Z [cluster1]                             },
2021-07-19T08:19:12.5710414Z [cluster1]                             "spec": {
2021-07-19T08:19:12.5726709Z [cluster1]                                 "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-19T08:19:12.5727515Z [cluster1]                                 "properties": {
2021-07-19T08:19:12.5728049Z [cluster1]                                     "broker": {
2021-07-19T08:19:12.5728573Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5729061Z [cluster1]                                     },
2021-07-19T08:19:12.5729644Z [cluster1]                                     "brokerK8sApiServer": {
2021-07-19T08:19:12.5730250Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5730738Z [cluster1]                                     },
2021-07-19T08:19:12.5731515Z [cluster1]                                     "brokerK8sApiServerToken": {
2021-07-19T08:19:12.5732199Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5732688Z [cluster1]                                     },
2021-07-19T08:19:12.5733175Z [cluster1]                                     "brokerK8sCA": {
2021-07-19T08:19:12.5733977Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5734534Z [cluster1]                                     },
2021-07-19T08:19:12.5735345Z [cluster1]                                     "brokerK8sRemoteNamespace": {
2021-07-19T08:19:12.5736027Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5736512Z [cluster1]                                     },
2021-07-19T08:19:12.5736999Z [cluster1]                                     "cableDriver": {
2021-07-19T08:19:12.5737547Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5738032Z [cluster1]                                     },
2021-07-19T08:19:12.5738542Z [cluster1]                                     "ceIPSecDebug": {
2021-07-19T08:19:12.5739236Z [cluster1]                                         "type": "boolean"
2021-07-19T08:19:12.5739750Z [cluster1]                                     },
2021-07-19T08:19:12.5740362Z [cluster1]                                     "ceIPSecForceUDPEncaps": {
2021-07-19T08:19:12.5741016Z [cluster1]                                         "type": "boolean"
2021-07-19T08:19:12.5741513Z [cluster1]                                     },
2021-07-19T08:19:12.5742127Z [cluster1]                                     "ceIPSecIKEPort": {
2021-07-19T08:19:12.5742723Z [cluster1]                                         "type": "integer"
2021-07-19T08:19:12.5743223Z [cluster1]                                     },
2021-07-19T08:19:12.5743752Z [cluster1]                                     "ceIPSecNATTPort": {
2021-07-19T08:19:12.5744355Z [cluster1]                                         "type": "integer"
2021-07-19T08:19:12.5744842Z [cluster1]                                     },
2021-07-19T08:19:12.5745430Z [cluster1]                                     "ceIPSecPSK": {
2021-07-19T08:19:12.5745975Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5746461Z [cluster1]                                     },
2021-07-19T08:19:12.5747192Z [cluster1]                                     "ceIPSecPreferredServer": {
2021-07-19T08:19:12.5747783Z [cluster1]                                         "type": "boolean"
2021-07-19T08:19:12.5748219Z [cluster1]                                     },
2021-07-19T08:19:12.5748648Z [cluster1]                                     "clusterCIDR": {
2021-07-19T08:19:12.5749306Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5749665Z [cluster1]                                     },
2021-07-19T08:19:12.5750044Z [cluster1]                                     "clusterID": {
2021-07-19T08:19:12.5750437Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5750808Z [cluster1]                                     },
2021-07-19T08:19:12.5751185Z [cluster1]                                     "colorCodes": {
2021-07-19T08:19:12.5751585Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5751956Z [cluster1]                                     },
2021-07-19T08:19:12.5752402Z [cluster1]                                     "connectionHealthCheck": {
2021-07-19T08:19:12.5752904Z [cluster1]                                         "properties": {
2021-07-19T08:19:12.5753308Z [cluster1]                                             "enabled": {
2021-07-19T08:19:12.5753721Z [cluster1]                                                 "type": "boolean"
2021-07-19T08:19:12.5754091Z [cluster1]                                             },
2021-07-19T08:19:12.5754708Z [cluster1]                                             "intervalSeconds": {
2021-07-19T08:19:12.5755447Z [cluster1]                                                 "description": "The interval at which health check pings are sent.",
2021-07-19T08:19:12.5756068Z [cluster1]                                                 "format": "int64",
2021-07-19T08:19:12.5756627Z [cluster1]                                                 "type": "integer"
2021-07-19T08:19:12.5757062Z [cluster1]                                             },
2021-07-19T08:19:12.5757843Z [cluster1]                                             "maxPacketLossCount": {
2021-07-19T08:19:12.5758873Z [cluster1]                                                 "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-19T08:19:12.5759883Z [cluster1]                                                 "format": "int64",
2021-07-19T08:19:12.5760481Z [cluster1]                                                 "type": "integer"
2021-07-19T08:19:12.5761019Z [cluster1]                                             }
2021-07-19T08:19:12.5761507Z [cluster1]                                         },
2021-07-19T08:19:12.5762023Z [cluster1]                                         "type": "object"
2021-07-19T08:19:12.5762550Z [cluster1]                                     },
2021-07-19T08:19:12.5763183Z [cluster1]                                     "coreDNSCustomConfig": {
2021-07-19T08:19:12.5763870Z [cluster1]                                         "properties": {
2021-07-19T08:19:12.5764503Z [cluster1]                                             "configMapName": {
2021-07-19T08:19:12.5765334Z [cluster1]                                                 "type": "string"
2021-07-19T08:19:12.5765873Z [cluster1]                                             },
2021-07-19T08:19:12.5766402Z [cluster1]                                             "namespace": {
2021-07-19T08:19:12.5767100Z [cluster1]                                                 "type": "string"
2021-07-19T08:19:12.5767646Z [cluster1]                                             }
2021-07-19T08:19:12.5768115Z [cluster1]                                         },
2021-07-19T08:19:12.5768645Z [cluster1]                                         "type": "object"
2021-07-19T08:19:12.5769192Z [cluster1]                                     },
2021-07-19T08:19:12.5769646Z [cluster1]                                     "customDomains": {
2021-07-19T08:19:12.5770108Z [cluster1]                                         "items": {
2021-07-19T08:19:12.5770563Z [cluster1]                                             "type": "string"
2021-07-19T08:19:12.5770983Z [cluster1]                                         },
2021-07-19T08:19:12.5771414Z [cluster1]                                         "type": "array",
2021-07-19T08:19:12.5772308Z [cluster1]                                         "x-kubernetes-list-type": "set"
2021-07-19T08:19:12.5772841Z [cluster1]                                     },
2021-07-19T08:19:12.5773257Z [cluster1]                                     "debug": {
2021-07-19T08:19:12.5773772Z [cluster1]                                         "type": "boolean"
2021-07-19T08:19:12.5774147Z [cluster1]                                     },
2021-07-19T08:19:12.5774511Z [cluster1]                                     "globalCIDR": {
2021-07-19T08:19:12.5774932Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5775306Z [cluster1]                                     },
2021-07-19T08:19:12.5775698Z [cluster1]                                     "imageOverrides": {
2021-07-19T08:19:12.5776229Z [cluster1]                                         "additionalProperties": {
2021-07-19T08:19:12.5776711Z [cluster1]                                             "type": "string"
2021-07-19T08:19:12.5777090Z [cluster1]                                         },
2021-07-19T08:19:12.5777457Z [cluster1]                                         "type": "object"
2021-07-19T08:19:12.5777905Z [cluster1]                                     },
2021-07-19T08:19:12.5778331Z [cluster1]                                     "loadBalancerEnabled": {
2021-07-19T08:19:12.5778814Z [cluster1]                                         "type": "boolean"
2021-07-19T08:19:12.5779193Z [cluster1]                                     },
2021-07-19T08:19:12.5779557Z [cluster1]                                     "namespace": {
2021-07-19T08:19:12.5779967Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5780425Z [cluster1]                                     },
2021-07-19T08:19:12.5780807Z [cluster1]                                     "natEnabled": {
2021-07-19T08:19:12.5781214Z [cluster1]                                         "type": "boolean"
2021-07-19T08:19:12.5781588Z [cluster1]                                     },
2021-07-19T08:19:12.5781955Z [cluster1]                                     "repository": {
2021-07-19T08:19:12.5782363Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5782743Z [cluster1]                                     },
2021-07-19T08:19:12.5783114Z [cluster1]                                     "serviceCIDR": {
2021-07-19T08:19:12.5783539Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5784111Z [cluster1]                                     },
2021-07-19T08:19:12.5784663Z [cluster1]                                     "serviceDiscoveryEnabled": {
2021-07-19T08:19:12.5785253Z [cluster1]                                         "type": "boolean"
2021-07-19T08:19:12.5785753Z [cluster1]                                     },
2021-07-19T08:19:12.5818283Z [cluster1]                                     "version": {
2021-07-19T08:19:12.5818720Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5819101Z [cluster1]                                     }
2021-07-19T08:19:12.5819424Z [cluster1]                                 },
2021-07-19T08:19:12.5819799Z [cluster1]                                 "required": [
2021-07-19T08:19:12.5820178Z [cluster1]                                     "broker",
2021-07-19T08:19:12.5820632Z [cluster1]                                     "brokerK8sApiServer",
2021-07-19T08:19:12.5821199Z [cluster1]                                     "brokerK8sApiServerToken",
2021-07-19T08:19:12.5821728Z [cluster1]                                     "brokerK8sCA",
2021-07-19T08:19:12.5822261Z [cluster1]                                     "brokerK8sRemoteNamespace",
2021-07-19T08:19:12.5822804Z [cluster1]                                     "ceIPSecDebug",
2021-07-19T08:19:12.5823249Z [cluster1]                                     "ceIPSecPSK",
2021-07-19T08:19:12.5823664Z [cluster1]                                     "clusterCIDR",
2021-07-19T08:19:12.5824078Z [cluster1]                                     "clusterID",
2021-07-19T08:19:12.5824450Z [cluster1]                                     "debug",
2021-07-19T08:19:12.5824849Z [cluster1]                                     "namespace",
2021-07-19T08:19:12.5825249Z [cluster1]                                     "natEnabled",
2021-07-19T08:19:12.5825675Z [cluster1]                                     "serviceCIDR"
2021-07-19T08:19:12.5826049Z [cluster1]                                 ],
2021-07-19T08:19:12.5826405Z [cluster1]                                 "type": "object"
2021-07-19T08:19:12.5826766Z [cluster1]                             },
2021-07-19T08:19:12.5827097Z [cluster1]                             "status": {
2021-07-19T08:19:12.5827687Z [cluster1]                                 "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-19T08:19:12.5828291Z [cluster1]                                 "properties": {
2021-07-19T08:19:12.5828718Z [cluster1]                                     "clusterCIDR": {
2021-07-19T08:19:12.5829125Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5829586Z [cluster1]                                     },
2021-07-19T08:19:12.5830109Z [cluster1]                                     "clusterID": {
2021-07-19T08:19:12.5830510Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5830883Z [cluster1]                                     },
2021-07-19T08:19:12.5831250Z [cluster1]                                     "colorCodes": {
2021-07-19T08:19:12.5831664Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.5832192Z [cluster1]                                     },
2021-07-19T08:19:12.5832663Z [cluster1]                                     "deploymentInfo": {
2021-07-19T08:19:12.5833171Z [cluster1]                                         "properties": {
2021-07-19T08:19:12.5833694Z [cluster1]                                             "cloudProvider": {
2021-07-19T08:19:12.5834212Z [cluster1]                                                 "type": "string"
2021-07-19T08:19:12.5834849Z [cluster1]                                             },
2021-07-19T08:19:12.5835396Z [cluster1]                                             "kubernetesType": {
2021-07-19T08:19:12.5835978Z [cluster1]                                                 "type": "string"
2021-07-19T08:19:12.5836479Z [cluster1]                                             },
2021-07-19T08:19:12.5837095Z [cluster1]                                             "kubernetesTypeVersion": {
2021-07-19T08:19:12.5837765Z [cluster1]                                                 "type": "string"
2021-07-19T08:19:12.5838270Z [cluster1]                                             },
2021-07-19T08:19:12.5838926Z [cluster1]                                             "kubernetesVersion": {
2021-07-19T08:19:12.5839580Z [cluster1]                                                 "type": "string"
2021-07-19T08:19:12.5840064Z [cluster1]                                             }
2021-07-19T08:19:12.5840510Z [cluster1]                                         },
2021-07-19T08:19:12.5840995Z [cluster1]                                         "type": "object"
2021-07-19T08:19:12.5841484Z [cluster1]                                     },
2021-07-19T08:19:12.5842089Z [cluster1]                                     "gatewayDaemonSetStatus": {
2021-07-19T08:19:12.5842784Z [cluster1]                                         "properties": {
2021-07-19T08:19:12.5843446Z [cluster1]                                             "lastResourceVersion": {
2021-07-19T08:19:12.5844069Z [cluster1]                                                 "type": "string"
2021-07-19T08:19:12.5844574Z [cluster1]                                             },
2021-07-19T08:19:12.5845462Z [cluster1]                                             "mismatchedContainerImages": {
2021-07-19T08:19:12.5846221Z [cluster1]                                                 "type": "boolean"
2021-07-19T08:19:12.5846653Z [cluster1]                                             },
2021-07-19T08:19:12.5847214Z [cluster1]                                             "nonReadyContainerStates": {
2021-07-19T08:19:12.5847799Z [cluster1]                                                 "items": {
2021-07-19T08:19:12.5848853Z [cluster1]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T08:19:12.5849962Z [cluster1]                                                     "properties": {
2021-07-19T08:19:12.5850448Z [cluster1]                                                         "running": {
2021-07-19T08:19:12.5851125Z [cluster1]                                                             "description": "Details about a running container",
2021-07-19T08:19:12.5851750Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.5852248Z [cluster1]                                                                 "startedAt": {
2021-07-19T08:19:12.5853373Z [cluster1]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-19T08:19:12.5854238Z [cluster1]                                                                     "format": "date-time",
2021-07-19T08:19:12.5854751Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5855215Z [cluster1]                                                                 }
2021-07-19T08:19:12.5855621Z [cluster1]                                                             },
2021-07-19T08:19:12.5856084Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.5856544Z [cluster1]                                                         },
2021-07-19T08:19:12.5856992Z [cluster1]                                                         "terminated": {
2021-07-19T08:19:12.5857627Z [cluster1]                                                             "description": "Details about a terminated container",
2021-07-19T08:19:12.5858564Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.5859363Z [cluster1]                                                                 "containerID": {
2021-07-19T08:19:12.5860537Z [cluster1]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T08:19:12.5861469Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5862141Z [cluster1]                                                                 },
2021-07-19T08:19:12.5885243Z [cluster1]                                                                 "exitCode": {
2021-07-19T08:19:12.5886076Z [cluster1]                                                                     "description": "Exit status from the last termination of the container",
2021-07-19T08:19:12.5886857Z [cluster1]                                                                     "format": "int32",
2021-07-19T08:19:12.5887429Z [cluster1]                                                                     "type": "integer"
2021-07-19T08:19:12.5887971Z [cluster1]                                                                 },
2021-07-19T08:19:12.5888493Z [cluster1]                                                                 "finishedAt": {
2021-07-19T08:19:12.5889255Z [cluster1]                                                                     "description": "Time at which the container last terminated",
2021-07-19T08:19:12.5890496Z [cluster1]                                                                     "format": "date-time",
2021-07-19T08:19:12.5891011Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5891470Z [cluster1]                                                                 },
2021-07-19T08:19:12.5891912Z [cluster1]                                                                 "message": {
2021-07-19T08:19:12.5892610Z [cluster1]                                                                     "description": "Message regarding the last termination of the container",
2021-07-19T08:19:12.5893302Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5893754Z [cluster1]                                                                 },
2021-07-19T08:19:12.5894206Z [cluster1]                                                                 "reason": {
2021-07-19T08:19:12.5894868Z [cluster1]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-19T08:19:12.5895547Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5896114Z [cluster1]                                                                 },
2021-07-19T08:19:12.5896551Z [cluster1]                                                                 "signal": {
2021-07-19T08:19:12.5897206Z [cluster1]                                                                     "description": "Signal from the last termination of the container",
2021-07-19T08:19:12.5897856Z [cluster1]                                                                     "format": "int32",
2021-07-19T08:19:12.5898371Z [cluster1]                                                                     "type": "integer"
2021-07-19T08:19:12.5898832Z [cluster1]                                                                 },
2021-07-19T08:19:12.5899299Z [cluster1]                                                                 "startedAt": {
2021-07-19T08:19:12.5899996Z [cluster1]                                                                     "description": "Time at which previous execution of the container started",
2021-07-19T08:19:12.5900899Z [cluster1]                                                                     "format": "date-time",
2021-07-19T08:19:12.5901433Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5902095Z [cluster1]                                                                 }
2021-07-19T08:19:12.5902575Z [cluster1]                                                             },
2021-07-19T08:19:12.5903098Z [cluster1]                                                             "required": [
2021-07-19T08:19:12.5903719Z [cluster1]                                                                 "exitCode"
2021-07-19T08:19:12.5904244Z [cluster1]                                                             ],
2021-07-19T08:19:12.5904758Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.5905282Z [cluster1]                                                         },
2021-07-19T08:19:12.5905776Z [cluster1]                                                         "waiting": {
2021-07-19T08:19:12.5906465Z [cluster1]                                                             "description": "Details about a waiting container",
2021-07-19T08:19:12.5963426Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.5964200Z [cluster1]                                                                 "message": {
2021-07-19T08:19:12.5965139Z [cluster1]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-19T08:19:12.5965984Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5966559Z [cluster1]                                                                 },
2021-07-19T08:19:12.5967116Z [cluster1]                                                                 "reason": {
2021-07-19T08:19:12.5967890Z [cluster1]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-19T08:19:12.5968679Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5969233Z [cluster1]                                                                 }
2021-07-19T08:19:12.5969752Z [cluster1]                                                             },
2021-07-19T08:19:12.5970293Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.5970859Z [cluster1]                                                         }
2021-07-19T08:19:12.5971362Z [cluster1]                                                     },
2021-07-19T08:19:12.5971896Z [cluster1]                                                     "type": "object"
2021-07-19T08:19:12.5972547Z [cluster1]                                                 },
2021-07-19T08:19:12.5973197Z [cluster1]                                                 "type": "array"
2021-07-19T08:19:12.5973699Z [cluster1]                                             },
2021-07-19T08:19:12.5974167Z [cluster1]                                             "status": {
2021-07-19T08:19:12.5974964Z [cluster1]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T08:19:12.5975884Z [cluster1]                                                 "properties": {
2021-07-19T08:19:12.5976398Z [cluster1]                                                     "collisionCount": {
2021-07-19T08:19:12.5977555Z [cluster1]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T08:19:12.5978668Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.5979153Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.5979612Z [cluster1]                                                     },
2021-07-19T08:19:12.5980047Z [cluster1]                                                     "conditions": {
2021-07-19T08:19:12.5981205Z [cluster1]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T08:19:12.5981950Z [cluster1]                                                         "items": {
2021-07-19T08:19:12.5982771Z [cluster1]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T08:19:12.5983562Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.5984129Z [cluster1]                                                                 "lastTransitionTime": {
2021-07-19T08:19:12.5985015Z [cluster1]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-19T08:19:12.5985948Z [cluster1]                                                                     "format": "date-time",
2021-07-19T08:19:12.5986459Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5986923Z [cluster1]                                                                 },
2021-07-19T08:19:12.5987368Z [cluster1]                                                                 "message": {
2021-07-19T08:19:12.5988084Z [cluster1]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-19T08:19:12.5988812Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5989252Z [cluster1]                                                                 },
2021-07-19T08:19:12.5989699Z [cluster1]                                                                 "reason": {
2021-07-19T08:19:12.5990539Z [cluster1]                                                                     "description": "The reason for the condition's last transition.",
2021-07-19T08:19:12.5991360Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5991891Z [cluster1]                                                                 },
2021-07-19T08:19:12.5992379Z [cluster1]                                                                 "status": {
2021-07-19T08:19:12.5993122Z [cluster1]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T08:19:12.5993939Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5994467Z [cluster1]                                                                 },
2021-07-19T08:19:12.5994963Z [cluster1]                                                                 "type": {
2021-07-19T08:19:12.5995642Z [cluster1]                                                                     "description": "Type of DaemonSet condition.",
2021-07-19T08:19:12.5996342Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.5996855Z [cluster1]                                                                 }
2021-07-19T08:19:12.5997336Z [cluster1]                                                             },
2021-07-19T08:19:12.5997842Z [cluster1]                                                             "required": [
2021-07-19T08:19:12.5998389Z [cluster1]                                                                 "status",
2021-07-19T08:19:12.5998901Z [cluster1]                                                                 "type"
2021-07-19T08:19:12.5999397Z [cluster1]                                                             ],
2021-07-19T08:19:12.5999918Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.6000423Z [cluster1]                                                         },
2021-07-19T08:19:12.6000931Z [cluster1]                                                         "type": "array"
2021-07-19T08:19:12.6001422Z [cluster1]                                                     },
2021-07-19T08:19:12.6002114Z [cluster1]                                                     "currentNumberScheduled": {
2021-07-19T08:19:12.6003510Z [cluster1]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.6004742Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6033721Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6034134Z [cluster1]                                                     },
2021-07-19T08:19:12.6034630Z [cluster1]                                                     "desiredNumberScheduled": {
2021-07-19T08:19:12.6035741Z [cluster1]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.6036733Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6037170Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6037571Z [cluster1]                                                     },
2021-07-19T08:19:12.6037985Z [cluster1]                                                     "numberAvailable": {
2021-07-19T08:19:12.6038874Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T08:19:12.6039750Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6040367Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6040819Z [cluster1]                                                     },
2021-07-19T08:19:12.6041322Z [cluster1]                                                     "numberMisscheduled": {
2021-07-19T08:19:12.6042850Z [cluster1]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.6044096Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6044651Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6045284Z [cluster1]                                                     },
2021-07-19T08:19:12.6045795Z [cluster1]                                                     "numberReady": {
2021-07-19T08:19:12.6053122Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T08:19:12.6054044Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6054617Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6055149Z [cluster1]                                                     },
2021-07-19T08:19:12.6055712Z [cluster1]                                                     "numberUnavailable": {
2021-07-19T08:19:12.6056898Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T08:19:12.6057978Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6058999Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6059561Z [cluster1]                                                     },
2021-07-19T08:19:12.6060185Z [cluster1]                                                     "observedGeneration": {
2021-07-19T08:19:12.6061156Z [cluster1]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T08:19:12.6062009Z [cluster1]                                                         "format": "int64",
2021-07-19T08:19:12.6062619Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6063177Z [cluster1]                                                     },
2021-07-19T08:19:12.6063848Z [cluster1]                                                     "updatedNumberScheduled": {
2021-07-19T08:19:12.6064824Z [cluster1]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T08:19:12.6065623Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6066229Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6066771Z [cluster1]                                                     }
2021-07-19T08:19:12.6067268Z [cluster1]                                                 },
2021-07-19T08:19:12.6067807Z [cluster1]                                                 "required": [
2021-07-19T08:19:12.6068518Z [cluster1]                                                     "currentNumberScheduled",
2021-07-19T08:19:12.6069394Z [cluster1]                                                     "desiredNumberScheduled",
2021-07-19T08:19:12.6070209Z [cluster1]                                                     "numberMisscheduled",
2021-07-19T08:19:12.6070907Z [cluster1]                                                     "numberReady"
2021-07-19T08:19:12.6071458Z [cluster1]                                                 ],
2021-07-19T08:19:12.6071999Z [cluster1]                                                 "type": "object"
2021-07-19T08:19:12.6072541Z [cluster1]                                             }
2021-07-19T08:19:12.6073007Z [cluster1]                                         },
2021-07-19T08:19:12.6073602Z [cluster1]                                         "required": [
2021-07-19T08:19:12.6074365Z [cluster1]                                             "mismatchedContainerImages"
2021-07-19T08:19:12.6075188Z [cluster1]                                         ],
2021-07-19T08:19:12.6075670Z [cluster1]                                         "type": "object"
2021-07-19T08:19:12.6076159Z [cluster1]                                     },
2021-07-19T08:19:12.6076626Z [cluster1]                                     "gateways": {
2021-07-19T08:19:12.6077152Z [cluster1]                                         "items": {
2021-07-19T08:19:12.6077763Z [cluster1]                                             "properties": {
2021-07-19T08:19:12.6078245Z [cluster1]                                                 "connections": {
2021-07-19T08:19:12.6078715Z [cluster1]                                                     "items": {
2021-07-19T08:19:12.6079178Z [cluster1]                                                         "properties": {
2021-07-19T08:19:12.6079679Z [cluster1]                                                             "endpoint": {
2021-07-19T08:19:12.6080169Z [cluster1]                                                                 "properties": {
2021-07-19T08:19:12.6080666Z [cluster1]                                                                     "backend": {
2021-07-19T08:19:12.6081166Z [cluster1]                                                                         "type": "string"
2021-07-19T08:19:12.6081613Z [cluster1]                                                                     },
2021-07-19T08:19:12.6082152Z [cluster1]                                                                     "backend_config": {
2021-07-19T08:19:12.6083036Z [cluster1]                                                                         "additionalProperties": {
2021-07-19T08:19:12.6083640Z [cluster1]                                                                             "type": "string"
2021-07-19T08:19:12.6084113Z [cluster1]                                                                         },
2021-07-19T08:19:12.6084577Z [cluster1]                                                                         "type": "object"
2021-07-19T08:19:12.6085204Z [cluster1]                                                                     },
2021-07-19T08:19:12.6085649Z [cluster1]                                                                     "cable_name": {
2021-07-19T08:19:12.6086146Z [cluster1]                                                                         "type": "string"
2021-07-19T08:19:12.6086626Z [cluster1]                                                                     },
2021-07-19T08:19:12.6087077Z [cluster1]                                                                     "cluster_id": {
2021-07-19T08:19:12.6087579Z [cluster1]                                                                         "type": "string"
2021-07-19T08:19:12.6088142Z [cluster1]                                                                     },
2021-07-19T08:19:12.6088643Z [cluster1]                                                                     "healthCheckIP": {
2021-07-19T08:19:12.6089171Z [cluster1]                                                                         "type": "string"
2021-07-19T08:19:12.6089636Z [cluster1]                                                                     },
2021-07-19T08:19:12.6090098Z [cluster1]                                                                     "hostname": {
2021-07-19T08:19:12.6090586Z [cluster1]                                                                         "type": "string"
2021-07-19T08:19:12.6091057Z [cluster1]                                                                     },
2021-07-19T08:19:12.6091510Z [cluster1]                                                                     "nat_enabled": {
2021-07-19T08:19:12.6092087Z [cluster1]                                                                         "type": "boolean"
2021-07-19T08:19:12.6092562Z [cluster1]                                                                     },
2021-07-19T08:19:12.6093013Z [cluster1]                                                                     "private_ip": {
2021-07-19T08:19:12.6093629Z [cluster1]                                                                         "type": "string"
2021-07-19T08:19:12.6094017Z [cluster1]                                                                     },
2021-07-19T08:19:12.6094413Z [cluster1]                                                                     "public_ip": {
2021-07-19T08:19:12.6094837Z [cluster1]                                                                         "type": "string"
2021-07-19T08:19:12.6095243Z [cluster1]                                                                     },
2021-07-19T08:19:12.6095639Z [cluster1]                                                                     "subnets": {
2021-07-19T08:19:12.6096038Z [cluster1]                                                                         "items": {
2021-07-19T08:19:12.6096464Z [cluster1]                                                                             "type": "string"
2021-07-19T08:19:12.6096862Z [cluster1]                                                                         },
2021-07-19T08:19:12.6097266Z [cluster1]                                                                         "type": "array"
2021-07-19T08:19:12.6097668Z [cluster1]                                                                     }
2021-07-19T08:19:12.6098071Z [cluster1]                                                                 },
2021-07-19T08:19:12.6099324Z [cluster1]                                                                 "required": [
2021-07-19T08:19:12.6099773Z [cluster1]                                                                     "backend",
2021-07-19T08:19:12.6100261Z [cluster1]                                                                     "cable_name",
2021-07-19T08:19:12.6100683Z [cluster1]                                                                     "cluster_id",
2021-07-19T08:19:12.6101110Z [cluster1]                                                                     "hostname",
2021-07-19T08:19:12.6101539Z [cluster1]                                                                     "nat_enabled",
2021-07-19T08:19:12.6101961Z [cluster1]                                                                     "private_ip",
2021-07-19T08:19:12.6102388Z [cluster1]                                                                     "public_ip",
2021-07-19T08:19:12.6102980Z [cluster1]                                                                     "subnets"
2021-07-19T08:19:12.6103436Z [cluster1]                                                                 ],
2021-07-19T08:19:12.6103882Z [cluster1]                                                                 "type": "object"
2021-07-19T08:19:12.6104342Z [cluster1]                                                             },
2021-07-19T08:19:12.6104809Z [cluster1]                                                             "latencyRTT": {
2021-07-19T08:19:12.6105659Z [cluster1]                                                                 "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-19T08:19:12.6106524Z [cluster1]                                                                 "properties": {
2021-07-19T08:19:12.6107011Z [cluster1]                                                                     "average": {
2021-07-19T08:19:12.6107745Z [cluster1]                                                                         "type": "string"
2021-07-19T08:19:12.6108278Z [cluster1]                                                                     },
2021-07-19T08:19:12.6108771Z [cluster1]                                                                     "last": {
2021-07-19T08:19:12.6109405Z [cluster1]                                                                         "type": "string"
2021-07-19T08:19:12.6109924Z [cluster1]                                                                     },
2021-07-19T08:19:12.6110425Z [cluster1]                                                                     "max": {
2021-07-19T08:19:12.6110953Z [cluster1]                                                                         "type": "string"
2021-07-19T08:19:12.6111495Z [cluster1]                                                                     },
2021-07-19T08:19:12.6112000Z [cluster1]                                                                     "min": {
2021-07-19T08:19:12.6112532Z [cluster1]                                                                         "type": "string"
2021-07-19T08:19:12.6113061Z [cluster1]                                                                     },
2021-07-19T08:19:12.6113560Z [cluster1]                                                                     "stdDev": {
2021-07-19T08:19:12.6114129Z [cluster1]                                                                         "type": "string"
2021-07-19T08:19:12.6114662Z [cluster1]                                                                     }
2021-07-19T08:19:12.6115131Z [cluster1]                                                                 },
2021-07-19T08:19:12.6115657Z [cluster1]                                                                 "type": "object"
2021-07-19T08:19:12.6116160Z [cluster1]                                                             },
2021-07-19T08:19:12.6116760Z [cluster1]                                                             "status": {
2021-07-19T08:19:12.6117296Z [cluster1]                                                                 "type": "string"
2021-07-19T08:19:12.6117822Z [cluster1]                                                             },
2021-07-19T08:19:12.6118375Z [cluster1]                                                             "statusMessage": {
2021-07-19T08:19:12.6118961Z [cluster1]                                                                 "type": "string"
2021-07-19T08:19:12.6119484Z [cluster1]                                                             },
2021-07-19T08:19:12.6119985Z [cluster1]                                                             "usingIP": {
2021-07-19T08:19:12.6120544Z [cluster1]                                                                 "type": "string"
2021-07-19T08:19:12.6121045Z [cluster1]                                                             },
2021-07-19T08:19:12.6121567Z [cluster1]                                                             "usingNAT": {
2021-07-19T08:19:12.6122134Z [cluster1]                                                                 "type": "boolean"
2021-07-19T08:19:12.6122645Z [cluster1]                                                             }
2021-07-19T08:19:12.6123117Z [cluster1]                                                         },
2021-07-19T08:19:12.6123617Z [cluster1]                                                         "required": [
2021-07-19T08:19:12.6124173Z [cluster1]                                                             "endpoint",
2021-07-19T08:19:12.6124702Z [cluster1]                                                             "status",
2021-07-19T08:19:12.6125380Z [cluster1]                                                             "statusMessage"
2021-07-19T08:19:12.6125934Z [cluster1]                                                         ],
2021-07-19T08:19:12.6126440Z [cluster1]                                                         "type": "object"
2021-07-19T08:19:12.6126960Z [cluster1]                                                     },
2021-07-19T08:19:12.6127450Z [cluster1]                                                     "type": "array"
2021-07-19T08:19:12.6127955Z [cluster1]                                                 },
2021-07-19T08:19:12.6128499Z [cluster1]                                                 "haStatus": {
2021-07-19T08:19:12.6129894Z [cluster1]                                                     "type": "string"
2021-07-19T08:19:12.6130479Z [cluster1]                                                 },
2021-07-19T08:19:12.6130936Z [cluster1]                                                 "localEndpoint": {
2021-07-19T08:19:12.6131462Z [cluster1]                                                     "properties": {
2021-07-19T08:19:12.6131938Z [cluster1]                                                         "backend": {
2021-07-19T08:19:12.6132420Z [cluster1]                                                             "type": "string"
2021-07-19T08:19:12.6132869Z [cluster1]                                                         },
2021-07-19T08:19:12.6133330Z [cluster1]                                                         "backend_config": {
2021-07-19T08:19:12.6134004Z [cluster1]                                                             "additionalProperties": {
2021-07-19T08:19:12.6134503Z [cluster1]                                                                 "type": "string"
2021-07-19T08:19:12.6134898Z [cluster1]                                                             },
2021-07-19T08:19:12.6135283Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.6135674Z [cluster1]                                                         },
2021-07-19T08:19:12.6136052Z [cluster1]                                                         "cable_name": {
2021-07-19T08:19:12.6136471Z [cluster1]                                                             "type": "string"
2021-07-19T08:19:12.6136933Z [cluster1]                                                         },
2021-07-19T08:19:12.6137852Z [cluster1]                                                         "cluster_id": {
2021-07-19T08:19:12.6138411Z [cluster1]                                                             "type": "string"
2021-07-19T08:19:12.6138798Z [cluster1]                                                         },
2021-07-19T08:19:12.6140205Z [cluster1]                                                         "healthCheckIP": {
2021-07-19T08:19:12.6140724Z [cluster1]                                                             "type": "string"
2021-07-19T08:19:12.6141181Z [cluster1]                                                         },
2021-07-19T08:19:12.6141801Z [cluster1]                                                         "hostname": {
2021-07-19T08:19:12.6142346Z [cluster1]                                                             "type": "string"
2021-07-19T08:19:12.6142870Z [cluster1]                                                         },
2021-07-19T08:19:12.6143371Z [cluster1]                                                         "nat_enabled": {
2021-07-19T08:19:12.6143939Z [cluster1]                                                             "type": "boolean"
2021-07-19T08:19:12.6144449Z [cluster1]                                                         },
2021-07-19T08:19:12.6144974Z [cluster1]                                                         "private_ip": {
2021-07-19T08:19:12.6145537Z [cluster1]                                                             "type": "string"
2021-07-19T08:19:12.6146032Z [cluster1]                                                         },
2021-07-19T08:19:12.6146534Z [cluster1]                                                         "public_ip": {
2021-07-19T08:19:12.6147066Z [cluster1]                                                             "type": "string"
2021-07-19T08:19:12.6147586Z [cluster1]                                                         },
2021-07-19T08:19:12.6148074Z [cluster1]                                                         "subnets": {
2021-07-19T08:19:12.6148605Z [cluster1]                                                             "items": {
2021-07-19T08:19:12.6149150Z [cluster1]                                                                 "type": "string"
2021-07-19T08:19:12.6149744Z [cluster1]                                                             },
2021-07-19T08:19:12.6150268Z [cluster1]                                                             "type": "array"
2021-07-19T08:19:12.6150762Z [cluster1]                                                         }
2021-07-19T08:19:12.6151234Z [cluster1]                                                     },
2021-07-19T08:19:12.6151726Z [cluster1]                                                     "required": [
2021-07-19T08:19:12.6152266Z [cluster1]                                                         "backend",
2021-07-19T08:19:12.6152809Z [cluster1]                                                         "cable_name",
2021-07-19T08:19:12.6153412Z [cluster1]                                                         "cluster_id",
2021-07-19T08:19:12.6153894Z [cluster1]                                                         "hostname",
2021-07-19T08:19:12.6154364Z [cluster1]                                                         "nat_enabled",
2021-07-19T08:19:12.6154854Z [cluster1]                                                         "private_ip",
2021-07-19T08:19:12.6155319Z [cluster1]                                                         "public_ip",
2021-07-19T08:19:12.6155792Z [cluster1]                                                         "subnets"
2021-07-19T08:19:12.6156231Z [cluster1]                                                     ],
2021-07-19T08:19:12.6156663Z [cluster1]                                                     "type": "object"
2021-07-19T08:19:12.6157154Z [cluster1]                                                 },
2021-07-19T08:19:12.6157612Z [cluster1]                                                 "statusFailure": {
2021-07-19T08:19:12.6158126Z [cluster1]                                                     "type": "string"
2021-07-19T08:19:12.6158551Z [cluster1]                                                 },
2021-07-19T08:19:12.6158987Z [cluster1]                                                 "version": {
2021-07-19T08:19:12.6159703Z [cluster1]                                                     "type": "string"
2021-07-19T08:19:12.6160489Z [cluster1]                                                 }
2021-07-19T08:19:12.6161227Z [cluster1]                                             },
2021-07-19T08:19:12.6162386Z [cluster1]                                             "required": [
2021-07-19T08:19:12.6162946Z [cluster1]                                                 "connections",
2021-07-19T08:19:12.6163487Z [cluster1]                                                 "haStatus",
2021-07-19T08:19:12.6164061Z [cluster1]                                                 "localEndpoint",
2021-07-19T08:19:12.6164688Z [cluster1]                                                 "statusFailure",
2021-07-19T08:19:12.6165351Z [cluster1]                                                 "version"
2021-07-19T08:19:12.6166038Z [cluster1]                                             ],
2021-07-19T08:19:12.6166570Z [cluster1]                                             "type": "object"
2021-07-19T08:19:12.6167106Z [cluster1]                                         },
2021-07-19T08:19:12.6167623Z [cluster1]                                         "type": "array"
2021-07-19T08:19:12.6168142Z [cluster1]                                     },
2021-07-19T08:19:12.6168664Z [cluster1]                                     "globalCIDR": {
2021-07-19T08:19:12.6169251Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.6169774Z [cluster1]                                     },
2021-07-19T08:19:12.6170469Z [cluster1]                                     "globalnetDaemonSetStatus": {
2021-07-19T08:19:12.6171239Z [cluster1]                                         "properties": {
2021-07-19T08:19:12.6171927Z [cluster1]                                             "lastResourceVersion": {
2021-07-19T08:19:12.6172612Z [cluster1]                                                 "type": "string"
2021-07-19T08:19:12.6173233Z [cluster1]                                             },
2021-07-19T08:19:12.6173967Z [cluster1]                                             "mismatchedContainerImages": {
2021-07-19T08:19:12.6174754Z [cluster1]                                                 "type": "boolean"
2021-07-19T08:19:12.6175288Z [cluster1]                                             },
2021-07-19T08:19:12.6175976Z [cluster1]                                             "nonReadyContainerStates": {
2021-07-19T08:19:12.6176678Z [cluster1]                                                 "items": {
2021-07-19T08:19:12.6178033Z [cluster1]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T08:19:12.6179275Z [cluster1]                                                     "properties": {
2021-07-19T08:19:12.6179837Z [cluster1]                                                         "running": {
2021-07-19T08:19:12.6180522Z [cluster1]                                                             "description": "Details about a running container",
2021-07-19T08:19:12.6181215Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.6181800Z [cluster1]                                                                 "startedAt": {
2021-07-19T08:19:12.6182947Z [cluster1]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-19T08:19:12.6184016Z [cluster1]                                                                     "format": "date-time",
2021-07-19T08:19:12.6184617Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6185127Z [cluster1]                                                                 }
2021-07-19T08:19:12.6185614Z [cluster1]                                                             },
2021-07-19T08:19:12.6186122Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.6186642Z [cluster1]                                                         },
2021-07-19T08:19:12.6187454Z [cluster1]                                                         "terminated": {
2021-07-19T08:19:12.6188363Z [cluster1]                                                             "description": "Details about a terminated container",
2021-07-19T08:19:12.6189399Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.6190006Z [cluster1]                                                                 "containerID": {
2021-07-19T08:19:12.6191443Z [cluster1]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T08:19:12.6192229Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6192764Z [cluster1]                                                                 },
2021-07-19T08:19:12.6193296Z [cluster1]                                                                 "exitCode": {
2021-07-19T08:19:12.6194056Z [cluster1]                                                                     "description": "Exit status from the last termination of the container",
2021-07-19T08:19:12.6194817Z [cluster1]                                                                     "format": "int32",
2021-07-19T08:19:12.6195387Z [cluster1]                                                                     "type": "integer"
2021-07-19T08:19:12.6195925Z [cluster1]                                                                 },
2021-07-19T08:19:12.6196468Z [cluster1]                                                                 "finishedAt": {
2021-07-19T08:19:12.6197984Z [cluster1]                                                                     "description": "Time at which the container last terminated",
2021-07-19T08:19:12.6199035Z [cluster1]                                                                     "format": "date-time",
2021-07-19T08:19:12.6199807Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6200378Z [cluster1]                                                                 },
2021-07-19T08:19:12.6200924Z [cluster1]                                                                 "message": {
2021-07-19T08:19:12.6201787Z [cluster1]                                                                     "description": "Message regarding the last termination of the container",
2021-07-19T08:19:12.6202755Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6203262Z [cluster1]                                                                 },
2021-07-19T08:19:12.6203972Z [cluster1]                                                                 "reason": {
2021-07-19T08:19:12.6204789Z [cluster1]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-19T08:19:12.6205741Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6206306Z [cluster1]                                                                 },
2021-07-19T08:19:12.6206836Z [cluster1]                                                                 "signal": {
2021-07-19T08:19:12.6207723Z [cluster1]                                                                     "description": "Signal from the last termination of the container",
2021-07-19T08:19:12.6208519Z [cluster1]                                                                     "format": "int32",
2021-07-19T08:19:12.6209148Z [cluster1]                                                                     "type": "integer"
2021-07-19T08:19:12.6209730Z [cluster1]                                                                 },
2021-07-19T08:19:12.6210285Z [cluster1]                                                                 "startedAt": {
2021-07-19T08:19:12.6211245Z [cluster1]                                                                     "description": "Time at which previous execution of the container started",
2021-07-19T08:19:12.6212283Z [cluster1]                                                                     "format": "date-time",
2021-07-19T08:19:12.6215455Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6216320Z [cluster1]                                                                 }
2021-07-19T08:19:12.6216752Z [cluster1]                                                             },
2021-07-19T08:19:12.6217214Z [cluster1]                                                             "required": [
2021-07-19T08:19:12.6217728Z [cluster1]                                                                 "exitCode"
2021-07-19T08:19:12.6218168Z [cluster1]                                                             ],
2021-07-19T08:19:12.6218624Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.6219059Z [cluster1]                                                         },
2021-07-19T08:19:12.6219675Z [cluster1]                                                         "waiting": {
2021-07-19T08:19:12.6220378Z [cluster1]                                                             "description": "Details about a waiting container",
2021-07-19T08:19:12.6221074Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.6221813Z [cluster1]                                                                 "message": {
2021-07-19T08:19:12.6222779Z [cluster1]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-19T08:19:12.6223619Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6224178Z [cluster1]                                                                 },
2021-07-19T08:19:12.6224726Z [cluster1]                                                                 "reason": {
2021-07-19T08:19:12.6225501Z [cluster1]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-19T08:19:12.6226433Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6227007Z [cluster1]                                                                 }
2021-07-19T08:19:12.6227512Z [cluster1]                                                             },
2021-07-19T08:19:12.6228078Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.6228635Z [cluster1]                                                         }
2021-07-19T08:19:12.6229126Z [cluster1]                                                     },
2021-07-19T08:19:12.6229676Z [cluster1]                                                     "type": "object"
2021-07-19T08:19:12.6230212Z [cluster1]                                                 },
2021-07-19T08:19:12.6230749Z [cluster1]                                                 "type": "array"
2021-07-19T08:19:12.6231344Z [cluster1]                                             },
2021-07-19T08:19:12.6232163Z [cluster1]                                             "status": {
2021-07-19T08:19:12.6233144Z [cluster1]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T08:19:12.6234220Z [cluster1]                                                 "properties": {
2021-07-19T08:19:12.6234759Z [cluster1]                                                     "collisionCount": {
2021-07-19T08:19:12.6235894Z [cluster1]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T08:19:12.6237120Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6237619Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6238067Z [cluster1]                                                     },
2021-07-19T08:19:12.6238512Z [cluster1]                                                     "conditions": {
2021-07-19T08:19:12.6239711Z [cluster1]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T08:19:12.6240354Z [cluster1]                                                         "items": {
2021-07-19T08:19:12.6240995Z [cluster1]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T08:19:12.6241676Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.6242175Z [cluster1]                                                                 "lastTransitionTime": {
2021-07-19T08:19:12.6242833Z [cluster1]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-19T08:19:12.6243930Z [cluster1]                                                                     "format": "date-time",
2021-07-19T08:19:12.6244440Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6245127Z [cluster1]                                                                 },
2021-07-19T08:19:12.6245590Z [cluster1]                                                                 "message": {
2021-07-19T08:19:12.6246298Z [cluster1]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-19T08:19:12.6247020Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6248876Z [cluster1]                                                                 },
2021-07-19T08:19:12.6249368Z [cluster1]                                                                 "reason": {
2021-07-19T08:19:12.6250308Z [cluster1]                                                                     "description": "The reason for the condition's last transition.",
2021-07-19T08:19:12.6250949Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6251609Z [cluster1]                                                                 },
2021-07-19T08:19:12.6252104Z [cluster1]                                                                 "status": {
2021-07-19T08:19:12.6252849Z [cluster1]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T08:19:12.6253606Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6254117Z [cluster1]                                                                 },
2021-07-19T08:19:12.6254737Z [cluster1]                                                                 "type": {
2021-07-19T08:19:12.6255405Z [cluster1]                                                                     "description": "Type of DaemonSet condition.",
2021-07-19T08:19:12.6256244Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6256762Z [cluster1]                                                                 }
2021-07-19T08:19:12.6257239Z [cluster1]                                                             },
2021-07-19T08:19:12.6257757Z [cluster1]                                                             "required": [
2021-07-19T08:19:12.6258284Z [cluster1]                                                                 "status",
2021-07-19T08:19:12.6258810Z [cluster1]                                                                 "type"
2021-07-19T08:19:12.6259292Z [cluster1]                                                             ],
2021-07-19T08:19:12.6259818Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.6260322Z [cluster1]                                                         },
2021-07-19T08:19:12.6260830Z [cluster1]                                                         "type": "array"
2021-07-19T08:19:12.6261333Z [cluster1]                                                     },
2021-07-19T08:19:12.6261963Z [cluster1]                                                     "currentNumberScheduled": {
2021-07-19T08:19:12.6263351Z [cluster1]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.6277553Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6278206Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6278778Z [cluster1]                                                     },
2021-07-19T08:19:12.6279464Z [cluster1]                                                     "desiredNumberScheduled": {
2021-07-19T08:19:12.6281185Z [cluster1]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.6282601Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6283226Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6283794Z [cluster1]                                                     },
2021-07-19T08:19:12.6284387Z [cluster1]                                                     "numberAvailable": {
2021-07-19T08:19:12.6285835Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T08:19:12.6287707Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6288684Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6289279Z [cluster1]                                                     },
2021-07-19T08:19:12.6290383Z [cluster1]                                                     "numberMisscheduled": {
2021-07-19T08:19:12.6291892Z [cluster1]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.6293233Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6293810Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6294490Z [cluster1]                                                     },
2021-07-19T08:19:12.6295024Z [cluster1]                                                     "numberReady": {
2021-07-19T08:19:12.6322411Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T08:19:12.6323475Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6324032Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6324558Z [cluster1]                                                     },
2021-07-19T08:19:12.6326040Z [cluster1]                                                     "numberUnavailable": {
2021-07-19T08:19:12.6327238Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T08:19:12.6328590Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6329183Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6329841Z [cluster1]                                                     },
2021-07-19T08:19:12.6330421Z [cluster1]                                                     "observedGeneration": {
2021-07-19T08:19:12.6331504Z [cluster1]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T08:19:12.6332366Z [cluster1]                                                         "format": "int64",
2021-07-19T08:19:12.6332973Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6333617Z [cluster1]                                                     },
2021-07-19T08:19:12.6334238Z [cluster1]                                                     "updatedNumberScheduled": {
2021-07-19T08:19:12.6335312Z [cluster1]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T08:19:12.6336066Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6336629Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6337143Z [cluster1]                                                     }
2021-07-19T08:19:12.6337589Z [cluster1]                                                 },
2021-07-19T08:19:12.6338087Z [cluster1]                                                 "required": [
2021-07-19T08:19:12.6338757Z [cluster1]                                                     "currentNumberScheduled",
2021-07-19T08:19:12.6339567Z [cluster1]                                                     "desiredNumberScheduled",
2021-07-19T08:19:12.6340354Z [cluster1]                                                     "numberMisscheduled",
2021-07-19T08:19:12.6341003Z [cluster1]                                                     "numberReady"
2021-07-19T08:19:12.6341526Z [cluster1]                                                 ],
2021-07-19T08:19:12.6342018Z [cluster1]                                                 "type": "object"
2021-07-19T08:19:12.6342521Z [cluster1]                                             }
2021-07-19T08:19:12.6342952Z [cluster1]                                         },
2021-07-19T08:19:12.6343439Z [cluster1]                                         "required": [
2021-07-19T08:19:12.6344458Z [cluster1]                                             "mismatchedContainerImages"
2021-07-19T08:19:12.6345121Z [cluster1]                                         ],
2021-07-19T08:19:12.6345600Z [cluster1]                                         "type": "object"
2021-07-19T08:19:12.6346085Z [cluster1]                                     },
2021-07-19T08:19:12.6346654Z [cluster1]                                     "loadBalancerStatus": {
2021-07-19T08:19:12.6347271Z [cluster1]                                         "properties": {
2021-07-19T08:19:12.6347801Z [cluster1]                                             "status": {
2021-07-19T08:19:12.6349046Z [cluster1]                                                 "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-19T08:19:12.6349914Z [cluster1]                                                 "properties": {
2021-07-19T08:19:12.6350453Z [cluster1]                                                     "ingress": {
2021-07-19T08:19:12.6351845Z [cluster1]                                                         "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-19T08:19:12.6352867Z [cluster1]                                                         "items": {
2021-07-19T08:19:12.6354126Z [cluster1]                                                             "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-19T08:19:12.6355142Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.6355752Z [cluster1]                                                                 "hostname": {
2021-07-19T08:19:12.6356665Z [cluster1]                                                                     "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-19T08:19:12.6357386Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6357771Z [cluster1]                                                                 },
2021-07-19T08:19:12.6358144Z [cluster1]                                                                 "ip": {
2021-07-19T08:19:12.6359133Z [cluster1]                                                                     "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-19T08:19:12.6359858Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6360254Z [cluster1]                                                                 }
2021-07-19T08:19:12.6360607Z [cluster1]                                                             },
2021-07-19T08:19:12.6361003Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.6361388Z [cluster1]                                                         },
2021-07-19T08:19:12.6361771Z [cluster1]                                                         "type": "array"
2021-07-19T08:19:12.6362329Z [cluster1]                                                     }
2021-07-19T08:19:12.6362728Z [cluster1]                                                 },
2021-07-19T08:19:12.6363168Z [cluster1]                                                 "type": "object"
2021-07-19T08:19:12.6363782Z [cluster1]                                             }
2021-07-19T08:19:12.6364229Z [cluster1]                                         },
2021-07-19T08:19:12.6365100Z [cluster1]                                         "type": "object"
2021-07-19T08:19:12.6365595Z [cluster1]                                     },
2021-07-19T08:19:12.6366090Z [cluster1]                                     "natEnabled": {
2021-07-19T08:19:12.6366710Z [cluster1]                                         "type": "boolean"
2021-07-19T08:19:12.6367203Z [cluster1]                                     },
2021-07-19T08:19:12.6367707Z [cluster1]                                     "networkPlugin": {
2021-07-19T08:19:12.6368276Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.6368742Z [cluster1]                                     },
2021-07-19T08:19:12.6369612Z [cluster1]                                     "routeAgentDaemonSetStatus": {
2021-07-19T08:19:12.6370379Z [cluster1]                                         "properties": {
2021-07-19T08:19:12.6371077Z [cluster1]                                             "lastResourceVersion": {
2021-07-19T08:19:12.6371757Z [cluster1]                                                 "type": "string"
2021-07-19T08:19:12.6376628Z [cluster1]                                             },
2021-07-19T08:19:12.6377475Z [cluster1]                                             "mismatchedContainerImages": {
2021-07-19T08:19:12.6381818Z [cluster1]                                                 "type": "boolean"
2021-07-19T08:19:12.6382382Z [cluster1]                                             },
2021-07-19T08:19:12.6383066Z [cluster1]                                             "nonReadyContainerStates": {
2021-07-19T08:19:12.6383856Z [cluster1]                                                 "items": {
2021-07-19T08:19:12.6385076Z [cluster1]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T08:19:12.6386336Z [cluster1]                                                     "properties": {
2021-07-19T08:19:12.6386948Z [cluster1]                                                         "running": {
2021-07-19T08:19:12.6387599Z [cluster1]                                                             "description": "Details about a running container",
2021-07-19T08:19:12.6388364Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.6388865Z [cluster1]                                                                 "startedAt": {
2021-07-19T08:19:12.6390124Z [cluster1]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-19T08:19:12.6391239Z [cluster1]                                                                     "format": "date-time",
2021-07-19T08:19:12.6391856Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6392897Z [cluster1]                                                                 }
2021-07-19T08:19:12.6393432Z [cluster1]                                                             },
2021-07-19T08:19:12.6393961Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.6394475Z [cluster1]                                                         },
2021-07-19T08:19:12.6395003Z [cluster1]                                                         "terminated": {
2021-07-19T08:19:12.6395776Z [cluster1]                                                             "description": "Details about a terminated container",
2021-07-19T08:19:12.6396515Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.6397117Z [cluster1]                                                                 "containerID": {
2021-07-19T08:19:12.6398235Z [cluster1]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T08:19:12.6399030Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6399545Z [cluster1]                                                                 },
2021-07-19T08:19:12.6400176Z [cluster1]                                                                 "exitCode": {
2021-07-19T08:19:12.6400947Z [cluster1]                                                                     "description": "Exit status from the last termination of the container",
2021-07-19T08:19:12.6401736Z [cluster1]                                                                     "format": "int32",
2021-07-19T08:19:12.6402255Z [cluster1]                                                                     "type": "integer"
2021-07-19T08:19:12.6402710Z [cluster1]                                                                 },
2021-07-19T08:19:12.6403180Z [cluster1]                                                                 "finishedAt": {
2021-07-19T08:19:12.6403832Z [cluster1]                                                                     "description": "Time at which the container last terminated",
2021-07-19T08:19:12.6404677Z [cluster1]                                                                     "format": "date-time",
2021-07-19T08:19:12.6405954Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6406547Z [cluster1]                                                                 },
2021-07-19T08:19:12.6407069Z [cluster1]                                                                 "message": {
2021-07-19T08:19:12.6407850Z [cluster1]                                                                     "description": "Message regarding the last termination of the container",
2021-07-19T08:19:12.6408644Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6409177Z [cluster1]                                                                 },
2021-07-19T08:19:12.6409674Z [cluster1]                                                                 "reason": {
2021-07-19T08:19:12.6410706Z [cluster1]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-19T08:19:12.6411552Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6412081Z [cluster1]                                                                 },
2021-07-19T08:19:12.6412591Z [cluster1]                                                                 "signal": {
2021-07-19T08:19:12.6413428Z [cluster1]                                                                     "description": "Signal from the last termination of the container",
2021-07-19T08:19:12.6414192Z [cluster1]                                                                     "format": "int32",
2021-07-19T08:19:12.6414761Z [cluster1]                                                                     "type": "integer"
2021-07-19T08:19:12.6415298Z [cluster1]                                                                 },
2021-07-19T08:19:12.6415835Z [cluster1]                                                                 "startedAt": {
2021-07-19T08:19:12.6416616Z [cluster1]                                                                     "description": "Time at which previous execution of the container started",
2021-07-19T08:19:12.6417712Z [cluster1]                                                                     "format": "date-time",
2021-07-19T08:19:12.6418297Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6418885Z [cluster1]                                                                 }
2021-07-19T08:19:12.6419313Z [cluster1]                                                             },
2021-07-19T08:19:12.6419753Z [cluster1]                                                             "required": [
2021-07-19T08:19:12.6420247Z [cluster1]                                                                 "exitCode"
2021-07-19T08:19:12.6420902Z [cluster1]                                                             ],
2021-07-19T08:19:12.6421502Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.6422008Z [cluster1]                                                         },
2021-07-19T08:19:12.6422514Z [cluster1]                                                         "waiting": {
2021-07-19T08:19:12.6423203Z [cluster1]                                                             "description": "Details about a waiting container",
2021-07-19T08:19:12.6423904Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.6424473Z [cluster1]                                                                 "message": {
2021-07-19T08:19:12.6425236Z [cluster1]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-19T08:19:12.6426016Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6426533Z [cluster1]                                                                 },
2021-07-19T08:19:12.6427040Z [cluster1]                                                                 "reason": {
2021-07-19T08:19:12.6427764Z [cluster1]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-19T08:19:12.6428489Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6429019Z [cluster1]                                                                 }
2021-07-19T08:19:12.6429482Z [cluster1]                                                             },
2021-07-19T08:19:12.6430002Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.6430517Z [cluster1]                                                         }
2021-07-19T08:19:12.6430977Z [cluster1]                                                     },
2021-07-19T08:19:12.6431584Z [cluster1]                                                     "type": "object"
2021-07-19T08:19:12.6432182Z [cluster1]                                                 },
2021-07-19T08:19:12.6432764Z [cluster1]                                                 "type": "array"
2021-07-19T08:19:12.6433183Z [cluster1]                                             },
2021-07-19T08:19:12.6433651Z [cluster1]                                             "status": {
2021-07-19T08:19:12.6434369Z [cluster1]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T08:19:12.6435087Z [cluster1]                                                 "properties": {
2021-07-19T08:19:12.6435616Z [cluster1]                                                     "collisionCount": {
2021-07-19T08:19:12.6436749Z [cluster1]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T08:19:12.6437853Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6438346Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6438792Z [cluster1]                                                     },
2021-07-19T08:19:12.6439249Z [cluster1]                                                     "conditions": {
2021-07-19T08:19:12.6440295Z [cluster1]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T08:19:12.6441036Z [cluster1]                                                         "items": {
2021-07-19T08:19:12.6441784Z [cluster1]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T08:19:12.6442637Z [cluster1]                                                             "properties": {
2021-07-19T08:19:12.6443399Z [cluster1]                                                                 "lastTransitionTime": {
2021-07-19T08:19:12.6444281Z [cluster1]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-19T08:19:12.6445305Z [cluster1]                                                                     "format": "date-time",
2021-07-19T08:19:12.6446016Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6446547Z [cluster1]                                                                 },
2021-07-19T08:19:12.6447062Z [cluster1]                                                                 "message": {
2021-07-19T08:19:12.6447872Z [cluster1]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-19T08:19:12.6448699Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6449213Z [cluster1]                                                                 },
2021-07-19T08:19:12.6450223Z [cluster1]                                                                 "reason": {
2021-07-19T08:19:12.6451258Z [cluster1]                                                                     "description": "The reason for the condition's last transition.",
2021-07-19T08:19:12.6451989Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6452512Z [cluster1]                                                                 },
2021-07-19T08:19:12.6453012Z [cluster1]                                                                 "status": {
2021-07-19T08:19:12.6453763Z [cluster1]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T08:19:12.6454590Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6455032Z [cluster1]                                                                 },
2021-07-19T08:19:12.6455561Z [cluster1]                                                                 "type": {
2021-07-19T08:19:12.6456143Z [cluster1]                                                                     "description": "Type of DaemonSet condition.",
2021-07-19T08:19:12.6456761Z [cluster1]                                                                     "type": "string"
2021-07-19T08:19:12.6457215Z [cluster1]                                                                 }
2021-07-19T08:19:12.6457638Z [cluster1]                                                             },
2021-07-19T08:19:12.6458097Z [cluster1]                                                             "required": [
2021-07-19T08:19:12.6458558Z [cluster1]                                                                 "status",
2021-07-19T08:19:12.6459017Z [cluster1]                                                                 "type"
2021-07-19T08:19:12.6459442Z [cluster1]                                                             ],
2021-07-19T08:19:12.6460705Z [cluster1]                                                             "type": "object"
2021-07-19T08:19:12.6461660Z [cluster1]                                                         },
2021-07-19T08:19:12.6473106Z [cluster1]                                                         "type": "array"
2021-07-19T08:19:12.6473696Z [cluster1]                                                     },
2021-07-19T08:19:12.6474382Z [cluster1]                                                     "currentNumberScheduled": {
2021-07-19T08:19:12.6476077Z [cluster1]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.6477540Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6478170Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6478737Z [cluster1]                                                     },
2021-07-19T08:19:12.6479411Z [cluster1]                                                     "desiredNumberScheduled": {
2021-07-19T08:19:12.6480981Z [cluster1]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.6482385Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6483006Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6483568Z [cluster1]                                                     },
2021-07-19T08:19:12.6484151Z [cluster1]                                                     "numberAvailable": {
2021-07-19T08:19:12.6485582Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T08:19:12.6486779Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6487393Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6487960Z [cluster1]                                                     },
2021-07-19T08:19:12.6488585Z [cluster1]                                                     "numberMisscheduled": {
2021-07-19T08:19:12.6490125Z [cluster1]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T08:19:12.6491594Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6492219Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6492782Z [cluster1]                                                     },
2021-07-19T08:19:12.6493339Z [cluster1]                                                     "numberReady": {
2021-07-19T08:19:12.6494451Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T08:19:12.6495420Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6496027Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6496587Z [cluster1]                                                     },
2021-07-19T08:19:12.6497197Z [cluster1]                                                     "numberUnavailable": {
2021-07-19T08:19:12.6498463Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T08:19:12.6499634Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6500247Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6500876Z [cluster1]                                                     },
2021-07-19T08:19:12.6501497Z [cluster1]                                                     "observedGeneration": {
2021-07-19T08:19:12.6502510Z [cluster1]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T08:19:12.6503309Z [cluster1]                                                         "format": "int64",
2021-07-19T08:19:12.6503876Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6504382Z [cluster1]                                                     },
2021-07-19T08:19:12.6505028Z [cluster1]                                                     "updatedNumberScheduled": {
2021-07-19T08:19:12.6505936Z [cluster1]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T08:19:12.6506681Z [cluster1]                                                         "format": "int32",
2021-07-19T08:19:12.6507249Z [cluster1]                                                         "type": "integer"
2021-07-19T08:19:12.6507758Z [cluster1]                                                     }
2021-07-19T08:19:12.6508219Z [cluster1]                                                 },
2021-07-19T08:19:12.6508708Z [cluster1]                                                 "required": [
2021-07-19T08:19:12.6509583Z [cluster1]                                                     "currentNumberScheduled",
2021-07-19T08:19:12.6510466Z [cluster1]                                                     "desiredNumberScheduled",
2021-07-19T08:19:12.6511280Z [cluster1]                                                     "numberMisscheduled",
2021-07-19T08:19:12.6511981Z [cluster1]                                                     "numberReady"
2021-07-19T08:19:12.6512531Z [cluster1]                                                 ],
2021-07-19T08:19:12.6513078Z [cluster1]                                                 "type": "object"
2021-07-19T08:19:12.6513603Z [cluster1]                                             }
2021-07-19T08:19:12.6514087Z [cluster1]                                         },
2021-07-19T08:19:12.6514610Z [cluster1]                                         "required": [
2021-07-19T08:19:12.6515405Z [cluster1]                                             "mismatchedContainerImages"
2021-07-19T08:19:12.6516119Z [cluster1]                                         ],
2021-07-19T08:19:12.6516631Z [cluster1]                                         "type": "object"
2021-07-19T08:19:12.6517422Z [cluster1]                                     },
2021-07-19T08:19:12.6517952Z [cluster1]                                     "serviceCIDR": {
2021-07-19T08:19:12.6518541Z [cluster1]                                         "type": "string"
2021-07-19T08:19:12.6519063Z [cluster1]                                     }
2021-07-19T08:19:12.6519520Z [cluster1]                                 },
2021-07-19T08:19:12.6520039Z [cluster1]                                 "required": [
2021-07-19T08:19:12.6520591Z [cluster1]                                     "clusterID",
2021-07-19T08:19:12.6521169Z [cluster1]                                     "natEnabled"
2021-07-19T08:19:12.6521674Z [cluster1]                                 ],
2021-07-19T08:19:12.6522192Z [cluster1]                                 "type": "object"
2021-07-19T08:19:12.6522687Z [cluster1]                             }
2021-07-19T08:19:12.6523140Z [cluster1]                         },
2021-07-19T08:19:12.6523628Z [cluster1]                         "type": "object"
2021-07-19T08:19:12.6524128Z [cluster1]                     }
2021-07-19T08:19:12.6524564Z [cluster1]                 },
2021-07-19T08:19:12.6525147Z [cluster1]                 "served": true,
2021-07-19T08:19:12.6525695Z [cluster1]                 "storage": true,
2021-07-19T08:19:12.6526245Z [cluster1]                 "subresources": {
2021-07-19T08:19:12.6526865Z [cluster1]                     "status": {}
2021-07-19T08:19:12.6527313Z [cluster1]                 }
2021-07-19T08:19:12.6527743Z [cluster1]             }
2021-07-19T08:19:12.6528154Z [cluster1]         ]
2021-07-19T08:19:12.6528571Z [cluster1]     },
2021-07-19T08:19:12.6528998Z [cluster1]     "status": {
2021-07-19T08:19:12.6529539Z [cluster1]         "acceptedNames": {
2021-07-19T08:19:12.6530128Z [cluster1]             "kind": "Submariner",
2021-07-19T08:19:12.6530771Z [cluster1]             "listKind": "SubmarinerList",
2021-07-19T08:19:12.6531433Z [cluster1]             "plural": "submariners",
2021-07-19T08:19:12.6534808Z [cluster1]             "singular": "submariner"
2021-07-19T08:19:12.6535351Z [cluster1]         },
2021-07-19T08:19:12.6535785Z [cluster1]         "conditions": [
2021-07-19T08:19:12.6536239Z [cluster1]             {
2021-07-19T08:19:12.6537627Z [cluster1]                 "lastTransitionTime": "2021-07-19T08:17:39Z",
2021-07-19T08:19:12.6538369Z [cluster1]                 "message": "no conflicts found",
2021-07-19T08:19:12.6538999Z [cluster1]                 "reason": "NoConflicts",
2021-07-19T08:19:12.6539671Z [cluster1]                 "status": "True",
2021-07-19T08:19:12.6540258Z [cluster1]                 "type": "NamesAccepted"
2021-07-19T08:19:12.6540764Z [cluster1]             },
2021-07-19T08:19:12.6541167Z [cluster1]             {
2021-07-19T08:19:12.6541907Z [cluster1]                 "lastTransitionTime": "2021-07-19T08:17:39Z",
2021-07-19T08:19:12.6542828Z [cluster1]                 "message": "the initial names have been accepted",
2021-07-19T08:19:12.6543644Z [cluster1]                 "reason": "InitialNamesAccepted",
2021-07-19T08:19:12.6544328Z [cluster1]                 "status": "True",
2021-07-19T08:19:12.6544890Z [cluster1]                 "type": "Established"
2021-07-19T08:19:12.6545404Z [cluster1]             }
2021-07-19T08:19:12.6545814Z [cluster1]         ],
2021-07-19T08:19:12.6546438Z [cluster1]         "storedVersions": [
2021-07-19T08:19:12.6546949Z [cluster1]             "v1alpha1"
2021-07-19T08:19:12.6547377Z [cluster1]         ]
2021-07-19T08:19:12.6547763Z [cluster1]     }
2021-07-19T08:19:12.6548131Z [cluster1] }
2021-07-19T08:19:12.6549198Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io[0m
2021-07-19T08:19:12.6550855Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io[0m
2021-07-19T08:19:12.6552624Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster1.json[0m
2021-07-19T08:19:12.6554171Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced[0m
2021-07-19T08:19:12.6555368Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced[0m
2021-07-19T08:19:15.6024612Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster2.json[0m
2021-07-19T08:19:15.6026041Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io[0m
2021-07-19T08:19:15.6027160Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io[0m
2021-07-19T08:19:15.6028538Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster2.json[0m
2021-07-19T08:19:15.6029903Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner[0m
2021-07-19T08:19:15.6031005Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner[0m
2021-07-19T08:19:15.6032427Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster2.json[0m
2021-07-19T08:19:15.6033706Z [36m[submariner-operator]$ [cluster2] verify_subm_operator[0m
2021-07-19T08:19:15.6034555Z [36m[submariner-operator]$ [cluster2] verify_subm_operator[0m
2021-07-19T08:19:15.6035533Z [36m[submariner-operator]$ [cluster2] kubectl get ns submariner-operator[0m
2021-07-19T08:19:15.6036584Z [36m[submariner-operator]$ [cluster2] kubectl get ns submariner-operator[0m
2021-07-19T08:19:15.6037959Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get ns submariner-operator[0m
2021-07-19T08:19:15.6038747Z [cluster2] NAME                  STATUS   AGE
2021-07-19T08:19:15.6039398Z [cluster2] submariner-operator   Active   82s
2021-07-19T08:19:15.6040393Z [36m[submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io[0m
2021-07-19T08:19:15.6041625Z [36m[submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io[0m
2021-07-19T08:19:15.6042939Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io[0m
2021-07-19T08:19:15.6043778Z [cluster2] NAME                        CREATED AT
2021-07-19T08:19:15.6044507Z [cluster2] submariners.submariner.io   2021-07-19T08:17:51Z
2021-07-19T08:19:15.6046421Z [36m[submariner-operator]$ [cluster2] kubectl api-resources[0m
2021-07-19T08:19:15.6047307Z [36m[submariner-operator]$ [cluster2] grep submariners[0m
2021-07-19T08:19:15.6048195Z [36m[submariner-operator]$ [cluster2] kubectl api-resources[0m
2021-07-19T08:19:15.6049211Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources[0m
2021-07-19T08:19:15.6050095Z [cluster2] submariners                                    submariner.io/v1alpha1            true         Submariner
2021-07-19T08:19:15.6051297Z [36m[submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6053017Z [36m[submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6054753Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get sa --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6055932Z [cluster2] NAME                  SECRETS   AGE
2021-07-19T08:19:15.6056685Z [cluster2] submariner-operator   1         83s
2021-07-19T08:19:15.6057954Z [36m[submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6059681Z [36m[submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6061452Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get roles --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6062653Z [cluster2] NAME                  AGE
2021-07-19T08:19:15.6063374Z [cluster2] submariner-operator   83s
2021-07-19T08:19:15.6064712Z [36m[submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6066554Z [36m[submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6068406Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get rolebindings --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6069487Z [cluster2] NAME                  AGE
2021-07-19T08:19:15.6070185Z [cluster2] submariner-operator   83s
2021-07-19T08:19:15.6071470Z [36m[submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6073199Z [36m[submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6075219Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get deployments --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6076680Z [cluster2] NAME                  READY   UP-TO-DATE   AVAILABLE   AGE
2021-07-19T08:19:15.6077630Z [cluster2] submariner-operator   1/1     1            1           78s
2021-07-19T08:19:15.6078602Z [36m[submariner-operator]$ [cluster2] verify_subm_op_pod[0m
2021-07-19T08:19:15.6079636Z [36m[submariner-operator]$ [cluster2] verify_subm_op_pod[0m
2021-07-19T08:19:15.6081378Z [36m[submariner-operator]$ [cluster2] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')[0m
2021-07-19T08:19:15.6199504Z [36m[submariner-operator]$ [cluster2] kers.submariner.io.cluster1.json[0m
2021-07-19T08:19:15.6201046Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io[0m
2021-07-19T08:19:15.6202415Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io[0m
2021-07-19T08:19:15.6204115Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster1.json[0m
2021-07-19T08:19:15.6206022Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner[0m
2021-07-19T08:19:15.6207366Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner[0m
2021-07-19T08:19:15.6209137Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster1.json[0m
2021-07-19T08:19:15.6210729Z [36m[submariner-operator]$ [cluster1] verify_subm_operator[0m
2021-07-19T08:19:15.6211767Z [36m[submariner-operator]$ [cluster1] verify_subm_operator[0m
2021-07-19T08:19:15.6212957Z [36m[submariner-operator]$ [cluster1] kubectl get ns submariner-operator[0m
2021-07-19T08:19:15.6214345Z [36m[submariner-operator]$ [cluster1] kubectl get ns submariner-operator[0m
2021-07-19T08:19:15.6215906Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get ns submariner-operator[0m
2021-07-19T08:19:15.6216847Z [cluster1] NAME                  STATUS   AGE
2021-07-19T08:19:15.6217668Z [cluster1] submariner-operator   Active   94s
2021-07-19T08:19:15.6219004Z [36m[submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io[0m
2021-07-19T08:19:15.6220350Z [36m[submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io[0m
2021-07-19T08:19:15.6221850Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io[0m
2021-07-19T08:19:15.6222792Z [cluster1] NAME                        CREATED AT
2021-07-19T08:19:15.6223645Z [cluster1] submariners.submariner.io   2021-07-19T08:17:39Z
2021-07-19T08:19:15.6224649Z [36m[submariner-operator]$ [cluster1] kubectl api-resources[0m
2021-07-19T08:19:15.6225689Z [36m[submariner-operator]$ [cluster1] kubectl api-resources[0m
2021-07-19T08:19:15.6227037Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources[0m
2021-07-19T08:19:15.6228246Z [36m[submariner-operator]$ [cluster1] grep submariners[0m
2021-07-19T08:19:15.6229004Z [cluster1] submariners                                    submariner.io/v1alpha1            true         Submariner
2021-07-19T08:19:15.6230176Z [36m[submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6231574Z [36m[submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6233094Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get sa --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6234014Z [cluster1] NAME                  SECRETS   AGE
2021-07-19T08:19:15.6234665Z [cluster1] submariner-operator   1         95s
2021-07-19T08:19:15.6235755Z [36m[submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6237174Z [36m[submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6238801Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get roles --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6239711Z [cluster1] NAME                  AGE
2021-07-19T08:19:15.6240329Z [cluster1] submariner-operator   95s
2021-07-19T08:19:15.6241485Z [36m[submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6243404Z [36m[submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6245388Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get rolebindings --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6246483Z [cluster1] NAME                  AGE
2021-07-19T08:19:15.6247197Z [cluster1] submariner-operator   95s
2021-07-19T08:19:15.6248481Z [36m[submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6250246Z [36m[submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6251848Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get deployments --namespace=submariner-operator submariner-operator[0m
2021-07-19T08:19:15.6253370Z [cluster1] NAME                  READY   UP-TO-DATE   AVAILABLE   AGE
2021-07-19T08:19:15.6254238Z [cluster1] submariner-operator   1/1     1            1           90s
2021-07-19T08:19:15.6255155Z [36m[submariner-operator]$ [cluster1] verify_subm_op_pod[0m
2021-07-19T08:19:15.6256104Z [36m[submariner-operator]$ [cluster1] verify_subm_op_pod[0m
2021-07-19T08:19:15.6257616Z [36m[submariner-operator]$ [cluster1] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')[0m
2021-07-19T08:19:16.4492164Z [36m[submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}[0m
2021-07-19T08:19:16.4499066Z [36m[submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}[0m
2021-07-19T08:19:16.4501349Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}[0m
2021-07-19T08:19:16.4504068Z [36m[submariner-operator]$ [cluster2] kubectl get pod submariner-operator-56f895dd55-n29fl --namespace=submariner-operator -o json[0m
2021-07-19T08:19:16.4506515Z [36m[submariner-operator]$ [cluster2] kubectl get pod submariner-operator-56f895dd55-n29fl --namespace=submariner-operator -o json[0m
2021-07-19T08:19:16.4509270Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-56f895dd55-n29fl --namespace=submariner-operator -o json[0m
2021-07-19T08:19:16.4510618Z [cluster2] {
2021-07-19T08:19:16.4511078Z [cluster2]     "apiVersion": "v1",
2021-07-19T08:19:16.4511550Z [cluster2]     "kind": "Pod",
2021-07-19T08:19:16.4512006Z [cluster2]     "metadata": {
2021-07-19T08:19:16.4512804Z [cluster2]         "creationTimestamp": "2021-07-19T08:17:57Z",
2021-07-19T08:19:16.4513889Z [cluster2]         "generateName": "submariner-operator-56f895dd55-",
2021-07-19T08:19:16.4514681Z [cluster2]         "labels": {
2021-07-19T08:19:16.4515403Z [cluster2]             "name": "submariner-operator",
2021-07-19T08:19:16.4516256Z [cluster2]             "pod-template-hash": "56f895dd55"
2021-07-19T08:19:16.4516773Z [cluster2]         },
2021-07-19T08:19:16.4517719Z [cluster2]         "name": "submariner-operator-56f895dd55-n29fl",
2021-07-19T08:19:16.4518812Z [cluster2]         "namespace": "submariner-operator",
2021-07-19T08:19:16.4519498Z [cluster2]         "ownerReferences": [
2021-07-19T08:19:16.4519978Z [cluster2]             {
2021-07-19T08:19:16.4520458Z [cluster2]                 "apiVersion": "apps/v1",
2021-07-19T08:19:16.4521090Z [cluster2]                 "blockOwnerDeletion": true,
2021-07-19T08:19:16.4521921Z [cluster2]                 "controller": true,
2021-07-19T08:19:16.4522509Z [cluster2]                 "kind": "ReplicaSet",
2021-07-19T08:19:16.4523514Z [cluster2]                 "name": "submariner-operator-56f895dd55",
2021-07-19T08:19:16.4525071Z [cluster2]                 "uid": "921435d4-824c-4f0e-b869-60c3724a0d53"
2021-07-19T08:19:16.4525733Z [cluster2]             }
2021-07-19T08:19:16.4526159Z [cluster2]         ],
2021-07-19T08:19:16.4526682Z [cluster2]         "resourceVersion": "1804",
2021-07-19T08:19:16.4528140Z [cluster2]         "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-operator-56f895dd55-n29fl",
2021-07-19T08:19:16.4529605Z [cluster2]         "uid": "6e4ccdaf-6945-4703-8098-607e365258a8"
2021-07-19T08:19:16.4530339Z [cluster2]     },
2021-07-19T08:19:16.4530742Z [cluster2]     "spec": {
2021-07-19T08:19:16.4531190Z [cluster2]         "containers": [
2021-07-19T08:19:16.4531635Z [cluster2]             {
2021-07-19T08:19:16.4532047Z [cluster2]                 "command": [
2021-07-19T08:19:16.4533215Z [cluster2]                     "submariner-operator",
2021-07-19T08:19:16.4534000Z [cluster2]                     "-alsologtostderr",
2021-07-19T08:19:16.4534656Z [cluster2]                     "-v=1"
2021-07-19T08:19:16.4535164Z [cluster2]                 ],
2021-07-19T08:19:16.4535589Z [cluster2]                 "env": [
2021-07-19T08:19:16.4535999Z [cluster2]                     {
2021-07-19T08:19:16.4536507Z [cluster2]                         "name": "WATCH_NAMESPACE",
2021-07-19T08:19:16.4537045Z [cluster2]                         "valueFrom": {
2021-07-19T08:19:16.4537556Z [cluster2]                             "fieldRef": {
2021-07-19T08:19:16.4538088Z [cluster2]                                 "apiVersion": "v1",
2021-07-19T08:19:16.4538741Z [cluster2]                                 "fieldPath": "metadata.namespace"
2021-07-19T08:19:16.4539337Z [cluster2]                             }
2021-07-19T08:19:16.4539745Z [cluster2]                         }
2021-07-19T08:19:16.4540157Z [cluster2]                     },
2021-07-19T08:19:16.4540718Z [cluster2]                     {
2021-07-19T08:19:16.4541222Z [cluster2]                         "name": "POD_NAME",
2021-07-19T08:19:16.4541765Z [cluster2]                         "valueFrom": {
2021-07-19T08:19:16.4542403Z [cluster2]                             "fieldRef": {
2021-07-19T08:19:16.4542983Z [cluster2]                                 "apiVersion": "v1",
2021-07-19T08:19:16.4543629Z [cluster2]                                 "fieldPath": "metadata.name"
2021-07-19T08:19:16.4544216Z [cluster2]                             }
2021-07-19T08:19:16.4544745Z [cluster2]                         }
2021-07-19T08:19:16.4545285Z [cluster2]                     },
2021-07-19T08:19:16.4545683Z [cluster2]                     {
2021-07-19T08:19:16.4546177Z [cluster2]                         "name": "OPERATOR_NAME",
2021-07-19T08:19:16.4547016Z [cluster2]                         "value": "submariner-operator"
2021-07-19T08:19:16.4547595Z [cluster2]                     }
2021-07-19T08:19:16.4547988Z [cluster2]                 ],
2021-07-19T08:19:16.4548802Z [cluster2]                 "image": "localhost:5000/submariner-operator:local",
2021-07-19T08:19:16.4549610Z [cluster2]                 "imagePullPolicy": "IfNotPresent",
2021-07-19T08:19:16.4550494Z [cluster2]                 "name": "submariner-operator",
2021-07-19T08:19:16.4551103Z [cluster2]                 "resources": {},
2021-07-19T08:19:16.4552004Z [cluster2]                 "terminationMessagePath": "/dev/termination-log",
2021-07-19T08:19:16.4552916Z [cluster2]                 "terminationMessagePolicy": "File",
2021-07-19T08:19:16.4553695Z [cluster2]                 "volumeMounts": [
2021-07-19T08:19:16.4554170Z [cluster2]                     {
2021-07-19T08:19:16.4554839Z [cluster2]                         "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-19T08:19:16.4556037Z [cluster2]                         "name": "submariner-operator-token-75f79",
2021-07-19T08:19:16.4556831Z [cluster2]                         "readOnly": true
2021-07-19T08:19:16.4557281Z [cluster2]                     }
2021-07-19T08:19:16.4557682Z [cluster2]                 ]
2021-07-19T08:19:16.4558070Z [cluster2]             }
2021-07-19T08:19:16.4558570Z [cluster2]         ],
2021-07-19T08:19:16.4559063Z [cluster2]         "dnsPolicy": "ClusterFirst",
2021-07-19T08:19:16.4559722Z [cluster2]         "enableServiceLinks": true,
2021-07-19T08:19:16.4560548Z [cluster2]         "nodeName": "cluster2-worker",
2021-07-19T08:19:16.4561122Z [cluster2]         "priority": 0,
2021-07-19T08:19:16.4561651Z [cluster2]         "restartPolicy": "Always",
2021-07-19T08:19:16.4562728Z [cluster2]         "schedulerName": "default-scheduler",
2021-07-19T08:19:16.4563472Z [cluster2]         "securityContext": {},
2021-07-19T08:19:16.4564396Z [cluster2]         "serviceAccount": "submariner-operator",
2021-07-19T08:19:16.4594780Z [cluster2]         "serviceAccountName": "submariner-operator",
2021-07-19T08:19:16.4595888Z [cluster2]         "terminationGracePeriodSeconds": 30,
2021-07-19T08:19:16.4596688Z [cluster2]         "tolerations": [
2021-07-19T08:19:16.4597165Z [cluster2]             {
2021-07-19T08:19:16.4597689Z [cluster2]                 "effect": "NoExecute",
2021-07-19T08:19:16.4598892Z [cluster2]                 "key": "node.kubernetes.io/not-ready",
2021-07-19T08:19:16.4599602Z [cluster2]                 "operator": "Exists",
2021-07-19T08:19:16.4600329Z [cluster2]                 "tolerationSeconds": 300
2021-07-19T08:19:16.4600837Z [cluster2]             },
2021-07-19T08:19:16.4601236Z [cluster2]             {
2021-07-19T08:19:16.4601706Z [cluster2]                 "effect": "NoExecute",
2021-07-19T08:19:16.4602395Z [cluster2]                 "key": "node.kubernetes.io/unreachable",
2021-07-19T08:19:16.4603052Z [cluster2]                 "operator": "Exists",
2021-07-19T08:19:16.4603649Z [cluster2]                 "tolerationSeconds": 300
2021-07-19T08:19:16.4604152Z [cluster2]             }
2021-07-19T08:19:16.4604542Z [cluster2]         ],
2021-07-19T08:19:16.4605065Z [cluster2]         "volumes": [
2021-07-19T08:19:16.4605493Z [cluster2]             {
2021-07-19T08:19:16.4606393Z [cluster2]                 "name": "submariner-operator-token-75f79",
2021-07-19T08:19:16.4607151Z [cluster2]                 "secret": {
2021-07-19T08:19:16.4607656Z [cluster2]                     "defaultMode": 420,
2021-07-19T08:19:16.4608651Z [cluster2]                     "secretName": "submariner-operator-token-75f79"
2021-07-19T08:19:16.4609417Z [cluster2]                 }
2021-07-19T08:19:16.4609804Z [cluster2]             }
2021-07-19T08:19:16.4610193Z [cluster2]         ]
2021-07-19T08:19:16.4610758Z [cluster2]     },
2021-07-19T08:19:16.4611175Z [cluster2]     "status": {
2021-07-19T08:19:16.4611630Z [cluster2]         "conditions": [
2021-07-19T08:19:16.4612103Z [cluster2]             {
2021-07-19T08:19:16.4612591Z [cluster2]                 "lastProbeTime": null,
2021-07-19T08:19:16.4613451Z [cluster2]                 "lastTransitionTime": "2021-07-19T08:17:57Z",
2021-07-19T08:19:16.4614061Z [cluster2]                 "status": "True",
2021-07-19T08:19:16.4614583Z [cluster2]                 "type": "Initialized"
2021-07-19T08:19:16.4615067Z [cluster2]             },
2021-07-19T08:19:16.4615460Z [cluster2]             {
2021-07-19T08:19:16.4615956Z [cluster2]                 "lastProbeTime": null,
2021-07-19T08:19:16.4616784Z [cluster2]                 "lastTransitionTime": "2021-07-19T08:18:12Z",
2021-07-19T08:19:16.4617394Z [cluster2]                 "status": "True",
2021-07-19T08:19:16.4617873Z [cluster2]                 "type": "Ready"
2021-07-19T08:19:16.4618312Z [cluster2]             },
2021-07-19T08:19:16.4618702Z [cluster2]             {
2021-07-19T08:19:16.4619201Z [cluster2]                 "lastProbeTime": null,
2021-07-19T08:19:16.4620239Z [cluster2]                 "lastTransitionTime": "2021-07-19T08:18:12Z",
2021-07-19T08:19:16.4620881Z [cluster2]                 "status": "True",
2021-07-19T08:19:16.4621496Z [cluster2]                 "type": "ContainersReady"
2021-07-19T08:19:16.4622036Z [cluster2]             },
2021-07-19T08:19:16.4622465Z [cluster2]             {
2021-07-19T08:19:16.4623123Z [cluster2]                 "lastProbeTime": null,
2021-07-19T08:19:16.4624174Z [cluster2]                 "lastTransitionTime": "2021-07-19T08:17:57Z",
2021-07-19T08:19:16.4624810Z [cluster2]                 "status": "True",
2021-07-19T08:19:16.4625399Z [cluster2]                 "type": "PodScheduled"
2021-07-19T08:19:16.4625916Z [cluster2]             }
2021-07-19T08:19:16.4626339Z [cluster2]         ],
2021-07-19T08:19:16.4626891Z [cluster2]         "containerStatuses": [
2021-07-19T08:19:16.4627429Z [cluster2]             {
2021-07-19T08:19:16.4629219Z [cluster2]                 "containerID": "containerd://b5ac16401ffaf2653eb49e8a9a9d912d6f8b4144427f14037f724cd8966072f9",
2021-07-19T08:19:16.4631440Z [cluster2]                 "image": "localhost:5000/submariner-operator:local",
2021-07-19T08:19:16.4633095Z [cluster2]                 "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-19T08:19:16.4634288Z [cluster2]                 "lastState": {
2021-07-19T08:19:16.4634898Z [cluster2]                     "terminated": {
2021-07-19T08:19:16.4636569Z [cluster2]                         "containerID": "containerd://248f03602c09dfcba0a12ee5c83293020517983e8aab7a1ba8a9ae4a86b5c5a0",
2021-07-19T08:19:16.4638206Z [cluster2]                         "exitCode": 1,
2021-07-19T08:19:16.4638945Z [cluster2]                         "finishedAt": "2021-07-19T08:18:09Z",
2021-07-19T08:19:16.4639495Z [cluster2]                         "reason": "Error",
2021-07-19T08:19:16.4640214Z [cluster2]                         "startedAt": "2021-07-19T08:17:59Z"
2021-07-19T08:19:16.4640688Z [cluster2]                     }
2021-07-19T08:19:16.4641092Z [cluster2]                 },
2021-07-19T08:19:16.4641800Z [cluster2]                 "name": "submariner-operator",
2021-07-19T08:19:16.4642410Z [cluster2]                 "ready": true,
2021-07-19T08:19:16.4642924Z [cluster2]                 "restartCount": 1,
2021-07-19T08:19:16.4643429Z [cluster2]                 "started": true,
2021-07-19T08:19:16.4643908Z [cluster2]                 "state": {
2021-07-19T08:19:16.5358147Z [cluster2]   ubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}[0m
2021-07-19T08:19:16.5360687Z [36m[submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}[0m
2021-07-19T08:19:16.5363303Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}[0m
2021-07-19T08:19:16.5365900Z [36m[submariner-operator]$ [cluster1] kubectl get pod submariner-operator-56f895dd55-s9lcp --namespace=submariner-operator -o json[0m
2021-07-19T08:19:16.5368030Z [36m[submariner-operator]$ [cluster1] kubectl get pod submariner-operator-56f895dd55-s9lcp --namespace=submariner-operator -o json[0m
2021-07-19T08:19:16.5370486Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-56f895dd55-s9lcp --namespace=submariner-operator -o json[0m
2021-07-19T08:19:16.5371888Z [cluster1] {
2021-07-19T08:19:16.5372341Z [cluster1]     "apiVersion": "v1",
2021-07-19T08:19:16.5373132Z [cluster1]     "kind": "Pod",
2021-07-19T08:19:16.5373730Z [cluster1]     "metadata": {
2021-07-19T08:19:16.5374550Z [cluster1]         "creationTimestamp": "2021-07-19T08:17:45Z",
2021-07-19T08:19:16.5375717Z [cluster1]         "generateName": "submariner-operator-56f895dd55-",
2021-07-19T08:19:16.5376548Z [cluster1]         "labels": {
2021-07-19T08:19:16.5377346Z [cluster1]             "name": "submariner-operator",
2021-07-19T08:19:16.5378388Z [cluster1]             "pod-template-hash": "56f895dd55"
2021-07-19T08:19:16.5378968Z [cluster1]         },
2021-07-19T08:19:16.5379962Z [cluster1]         "name": "submariner-operator-56f895dd55-s9lcp",
2021-07-19T08:19:16.5381149Z [cluster1]         "namespace": "submariner-operator",
2021-07-19T08:19:16.5381889Z [cluster1]         "ownerReferences": [
2021-07-19T08:19:16.5382551Z [cluster1]             {
2021-07-19T08:19:16.5383077Z [cluster1]                 "apiVersion": "apps/v1",
2021-07-19T08:19:16.5383758Z [cluster1]                 "blockOwnerDeletion": true,
2021-07-19T08:19:16.5384520Z [cluster1]                 "controller": true,
2021-07-19T08:19:16.5385104Z [cluster1]                 "kind": "ReplicaSet",
2021-07-19T08:19:16.5386152Z [cluster1]                 "name": "submariner-operator-56f895dd55",
2021-07-19T08:19:16.5387268Z [cluster1]                 "uid": "743aec66-5360-4ba3-a159-6959882e47c0"
2021-07-19T08:19:16.5387875Z [cluster1]             }
2021-07-19T08:19:16.5388295Z [cluster1]         ],
2021-07-19T08:19:16.5388822Z [cluster1]         "resourceVersion": "1790",
2021-07-19T08:19:16.5390263Z [cluster1]         "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-operator-56f895dd55-s9lcp",
2021-07-19T08:19:16.5391686Z [cluster1]         "uid": "b249292d-8629-409e-b1b7-028fd8207f3d"
2021-07-19T08:19:16.5392271Z [cluster1]     },
2021-07-19T08:19:16.5392693Z [cluster1]     "spec": {
2021-07-19T08:19:16.5393181Z [cluster1]         "containers": [
2021-07-19T08:19:16.5393655Z [cluster1]             {
2021-07-19T08:19:16.5394114Z [cluster1]                 "command": [
2021-07-19T08:19:16.5395014Z [cluster1]                     "submariner-operator",
2021-07-19T08:19:16.5395872Z [cluster1]                     "-alsologtostderr",
2021-07-19T08:19:16.5396575Z [cluster1]                     "-v=1"
2021-07-19T08:19:16.5397016Z [cluster1]                 ],
2021-07-19T08:19:16.5397471Z [cluster1]                 "env": [
2021-07-19T08:19:16.5397913Z [cluster1]                     {
2021-07-19T08:19:16.5398463Z [cluster1]                         "name": "WATCH_NAMESPACE",
2021-07-19T08:19:16.5399044Z [cluster1]                         "valueFrom": {
2021-07-19T08:19:16.5399598Z [cluster1]                             "fieldRef": {
2021-07-19T08:19:16.5400162Z [cluster1]                                 "apiVersion": "v1",
2021-07-19T08:19:16.5400888Z [cluster1]                                 "fieldPath": "metadata.namespace"
2021-07-19T08:19:16.5401520Z [cluster1]                             }
2021-07-19T08:19:16.5401968Z [cluster1]                         }
2021-07-19T08:19:16.5402410Z [cluster1]                     },
2021-07-19T08:19:16.5402838Z [cluster1]                     {
2021-07-19T08:19:16.5403345Z [cluster1]                         "name": "POD_NAME",
2021-07-19T08:19:16.5403989Z [cluster1]                         "valueFrom": {
2021-07-19T08:19:16.5404547Z [cluster1]                             "fieldRef": {
2021-07-19T08:19:16.5405396Z [cluster1]                                 "apiVersion": "v1",
2021-07-19T08:19:16.5406018Z [cluster1]                                 "fieldPath": "metadata.name"
2021-07-19T08:19:16.5406550Z [cluster1]                             }
2021-07-19T08:19:16.5406964Z [cluster1]                         }
2021-07-19T08:19:16.5407366Z [cluster1]                     },
2021-07-19T08:19:16.5407780Z [cluster1]                     {
2021-07-19T08:19:16.5408279Z [cluster1]                         "name": "OPERATOR_NAME",
2021-07-19T08:19:16.5409129Z [cluster1]                         "value": "submariner-operator"
2021-07-19T08:19:16.5409705Z [cluster1]                     }
2021-07-19T08:19:16.5410095Z [cluster1]                 ],
2021-07-19T08:19:16.5410920Z [cluster1]                 "image": "localhost:5000/submariner-operator:local",
2021-07-19T08:19:16.5411716Z [cluster1]                 "imagePullPolicy": "IfNotPresent",
2021-07-19T08:19:16.5412611Z [cluster1]                 "name": "submariner-operator",
2021-07-19T08:19:16.5413270Z [cluster1]                 "resources": {},
2021-07-19T08:19:16.5414070Z [cluster1]                 "terminationMessagePath": "/dev/termination-log",
2021-07-19T08:19:16.5415049Z [cluster1]                 "terminationMessagePolicy": "File",
2021-07-19T08:19:16.5415730Z [cluster1]                 "volumeMounts": [
2021-07-19T08:19:16.5416202Z [cluster1]                     {
2021-07-19T08:19:16.5416966Z [cluster1]                         "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-19T08:19:16.5418159Z [cluster1]                         "name": "submariner-operator-token-6c72j",
2021-07-19T08:19:16.5418946Z [cluster1]                         "readOnly": true
2021-07-19T08:19:16.5419413Z [cluster1]                     }
2021-07-19T08:19:16.5419801Z [cluster1]                 ]
2021-07-19T08:19:16.5420201Z [cluster1]             }
2021-07-19T08:19:16.5420590Z [cluster1]         ],
2021-07-19T08:19:16.5421090Z [cluster1]         "dnsPolicy": "ClusterFirst",
2021-07-19T08:19:16.5421756Z [cluster1]         "enableServiceLinks": true,
2021-07-19T08:19:16.5422578Z [cluster1]         "nodeName": "cluster1-worker",
2021-07-19T08:19:16.5423146Z [cluster1]         "priority": 0,
2021-07-19T08:19:16.5423672Z [cluster1]         "restartPolicy": "Always",
2021-07-19T08:19:16.5424520Z [cluster1]         "schedulerName": "default-scheduler",
2021-07-19T08:19:16.5425196Z [cluster1]         "securityContext": {},
2021-07-19T08:19:16.5426066Z [cluster1]         "serviceAccount": "submariner-operator",
2021-07-19T08:19:16.5427094Z [cluster1]         "serviceAccountName": "submariner-operator",
2021-07-19T08:19:16.5428034Z [cluster1]         "terminationGracePeriodSeconds": 30,
2021-07-19T08:19:16.5428768Z [cluster1]         "tolerations": [
2021-07-19T08:19:16.5429207Z [cluster1]             {
2021-07-19T08:19:16.5429696Z [cluster1]                 "effect": "NoExecute",
2021-07-19T08:19:16.5431401Z [cluster1]                 "key": "node.kubernetes.io/not-ready",
2021-07-19T08:19:16.5432256Z [cluster1]                 "operator": "Exists",
2021-07-19T08:19:16.5432832Z [cluster1]                 "tolerationSeconds": 300
2021-07-19T08:19:16.5433354Z [cluster1]             },
2021-07-19T08:19:16.5433743Z [cluster1]             {
2021-07-19T08:19:16.5434223Z [cluster1]                 "effect": "NoExecute",
2021-07-19T08:19:16.5434894Z [cluster1]                 "key": "node.kubernetes.io/unreachable",
2021-07-19T08:19:16.5435570Z [cluster1]                 "operator": "Exists",
2021-07-19T08:19:16.5436189Z [cluster1]                 "tolerationSeconds": 300
2021-07-19T08:19:16.5436699Z [cluster1]             }
2021-07-19T08:19:16.5437090Z [cluster1]         ],
2021-07-19T08:19:16.5437499Z [cluster1]         "volumes": [
2021-07-19T08:19:16.5437921Z [cluster1]             {
2021-07-19T08:19:16.5439050Z [cluster1]                 "name": "submariner-operator-token-6c72j",
2021-07-19T08:19:16.5439813Z [cluster1]                 "secret": {
2021-07-19T08:19:16.5440303Z [cluster1]                     "defaultMode": 420,
2021-07-19T08:19:16.5441333Z [cluster1]                     "secretName": "submariner-operator-token-6c72j"
2021-07-19T08:19:16.5442075Z [cluster1]                 }
2021-07-19T08:19:16.5442676Z [cluster1]             }
2021-07-19T08:19:16.5443102Z [cluster1]         ]
2021-07-19T08:19:16.5443501Z [cluster1]     },
2021-07-19T08:19:16.5443950Z [cluster1]     "status": {
2021-07-19T08:19:16.5444524Z [cluster1]         "conditions": [
2021-07-19T08:19:16.5445286Z [cluster1]             {
2021-07-19T08:19:16.5445772Z [cluster1]                 "lastProbeTime": null,
2021-07-19T08:19:16.5446632Z [cluster1]                 "lastTransitionTime": "2021-07-19T08:17:45Z",
2021-07-19T08:19:16.5447226Z [cluster1]                 "status": "True",
2021-07-19T08:19:16.5447760Z [cluster1]                 "type": "Initialized"
2021-07-19T08:19:16.5448220Z [cluster1]             },
2021-07-19T08:19:16.5448614Z [cluster1]             {
2021-07-19T08:19:16.5449104Z [cluster1]                 "lastProbeTime": null,
2021-07-19T08:19:16.5449941Z [cluster1]                 "lastTransitionTime": "2021-07-19T08:17:53Z",
2021-07-19T08:19:16.5450538Z [cluster1]                 "status": "True",
2021-07-19T08:19:16.5451017Z [cluster1]                 "type": "Ready"
2021-07-19T08:19:16.5451459Z [cluster1]             },
2021-07-19T08:19:16.5451841Z [cluster1]             {
2021-07-19T08:19:16.5452439Z [cluster1]                 "lastProbeTime": null,
2021-07-19T08:19:16.5453266Z [cluster1]                 "lastTransitionTime": "2021-07-19T08:17:53Z",
2021-07-19T08:19:16.5453953Z [cluster1]                 "status": "True",
2021-07-19T08:19:16.5454439Z [cluster1]                 "type": "ContainersReady"
2021-07-19T08:19:16.5454898Z [cluster1]             },
2021-07-19T08:19:16.5455236Z [cluster1]             {
2021-07-19T08:19:16.5455677Z [cluster1]                 "lastProbeTime": null,
2021-07-19T08:19:16.5456403Z [cluster1]                 "lastTransitionTime": "2021-07-19T08:17:45Z",
2021-07-19T08:19:16.5456921Z [cluster1]                 "status": "True",
2021-07-19T08:19:16.5457401Z [cluster1]                 "type": "PodScheduled"
2021-07-19T08:19:16.5457819Z [cluster1]             }
2021-07-19T08:19:16.5458163Z [cluster1]         ],
2021-07-19T08:19:16.5458596Z [cluster1]         "containerStatuses": [
2021-07-19T08:19:16.5459039Z [cluster1]             {
2021-07-19T08:19:16.5460394Z [cluster1]                 "containerID": "containerd://1349e47b0f579917a392f823f18d0414ce39efd0443eed59b6de39afb898f16b",
2021-07-19T08:19:16.5462100Z [cluster1]                 "image": "localhost:5000/submariner-operator:local",
2021-07-19T08:19:16.5463441Z [cluster1]                 "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-19T08:19:16.5464382Z [cluster1]                 "lastState": {},
2021-07-19T08:19:16.5465267Z [cluster1]                 "name": "submariner-operator",
2021-07-19T08:19:16.5465857Z [cluster1]                 "ready": true,
2021-07-19T08:19:16.5466454Z [cluster1]                 "restartCount": 1,
2021-07-19T08:19:16.5466900Z [cluster1]                 "started": true,
2021-07-19T08:19:16.5467311Z [cluster1]                 "state": {
2021-07-19T08:19:16.5467697Z [cluster1]                     "running": {
2021-07-19T08:19:16.5468310Z [cluster1]                         "startedAt": "2021-07-19T08:17:52Z"
2021-07-19T08:19:16.5468743Z [cluster1]                     }
2021-07-19T08:19:16.5469085Z [cluster1]                 }
2021-07-19T08:19:16.5469433Z [cluster1]             }
2021-07-19T08:19:16.5469761Z [cluster1]         ],
2021-07-19T08:19:16.5470140Z [cluster1]         "hostIP": "172.18.0.5",
2021-07-19T08:19:16.5470559Z [cluster1]         "phase": "Running",
2021-07-19T08:19:16.5470989Z [cluster1]         "podIP": "10.0.0.3",
2021-07-19T08:19:16.5471466Z [cluster1]         "podIPs": [
2021-07-19T08:19:16.5471846Z [cluster1]             {
2021-07-19T08:19:16.5472201Z [cluster1]                 "ip": "10.0.0.3"
2021-07-19T08:19:16.5472573Z [cluster1]             }
2021-07-19T08:19:16.5472903Z [cluster1]         ],
2021-07-19T08:19:17.2204176Z [cluste                  "running": {
2021-07-19T08:19:17.2206230Z [cluster2]                         "startedAt": "2021-07-19T08:18:11Z"
2021-07-19T08:19:17.2206837Z [cluster2]                     }
2021-07-19T08:19:17.2207391Z [cluster2]                 }
2021-07-19T08:19:17.2208690Z [cluster2]             }
2021-07-19T08:19:17.2209072Z [cluster2]         ],
2021-07-19T08:19:17.2209704Z [cluster2]         "hostIP": "172.18.0.7",
2021-07-19T08:19:17.2210131Z [cluster2]         "phase": "Running",
2021-07-19T08:19:17.2210559Z [cluster2]         "podIP": "10.0.0.2",
2021-07-19T08:19:17.2210950Z [cluster2]         "podIPs": [
2021-07-19T08:19:17.2211326Z [cluster2]             {
2021-07-19T08:19:17.2211931Z [cluster2]                 "ip": "10.0.0.2"
2021-07-19T08:19:17.2212456Z [cluster2]             }
2021-07-19T08:19:17.2213008Z [cluster2]         ],
2021-07-19T08:19:17.2213619Z [cluster2]         "qosClass": "BestEffort",
2021-07-19T08:19:17.2215397Z [cluster2]         "startTime": "2021-07-19T08:17:57Z"
2021-07-19T08:19:17.2215846Z [cluster2]     }
2021-07-19T08:19:17.2216228Z [cluster2] }
2021-07-19T08:19:17.2219344Z [36m[submariner-operator]$ [cluster2] kubectl get pod submariner-operator-56f895dd55-n29fl --namespace=submariner-operator -o jsonpath={.status.phase}[0m
2021-07-19T08:19:17.2221280Z [36m[submariner-operator]$ [cluster2] grep Running[0m
2021-07-19T08:19:17.2223999Z [36m[submariner-operator]$ [cluster2] kubectl get pod submariner-operator-56f895dd55-n29fl --namespace=submariner-operator -o jsonpath={.status.phase}[0m
2021-07-19T08:19:17.2226498Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-56f895dd55-n29fl --namespace=submariner-operator -o jsonpath={.status.phase}[0m
2021-07-19T08:19:17.2227530Z [cluster2] Running
2021-07-19T08:19:17.2228926Z [36m[submariner-operator]$ [cluster2] kubectl logs submariner-operator-56f895dd55-n29fl --namespace=submariner-operator[0m
2021-07-19T08:19:17.2231685Z [36m[submariner-operator]$ [cluster2] kubectl logs submariner-operator-56f895dd55-n29fl --namespace=submariner-operator[0m
2021-07-19T08:19:17.2234097Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 logs submariner-operator-56f895dd55-n29fl --namespace=submariner-operator[0m
2021-07-19T08:19:17.2235773Z [cluster2] I0719 08:18:12.186962       1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-19T08:19:17.2236461Z [cluster2] I0719 08:18:12.187095       1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-19T08:19:17.2237433Z [cluster2] I0719 08:18:12.187120       1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-19T08:19:17.2238685Z [cluster2] I0719 08:18:12.187162       1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-19T08:19:17.2239608Z [cluster2] I0719 08:18:12.187427       1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-19T08:19:17.2240678Z [cluster2] I0719 08:18:12.599874       1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."
2021-07-19T08:19:17.2241724Z [cluster2] I0719 08:18:12.599986       1 leader.go:123] leader "msg"="Continuing as the leader."
2021-07-19T08:19:17.2249220Z [cluster2] I0719 08:18:13.007182       1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen"  "addr"="0.0.0.0:8383"
2021-07-19T08:19:17.2250353Z [cluster2] I0719 08:18:13.012597       1 main.go:129] cmd "msg"="Registering Components."
2021-07-19T08:19:17.2251220Z [cluster2] I0719 08:18:13.012816       1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-19T08:19:17.2252412Z [cluster2] I0719 08:18:15.650355       1 main.go:182] cmd "msg"="Could not create ServiceMonitor object"  "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2253909Z [cluster2] I0719 08:18:15.650583       1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects"  "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2254874Z [cluster2] I0719 08:18:15.650752       1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-19T08:19:17.2255767Z [cluster2] I0719 08:18:15.651092       1 internal.go:406] controller-runtime/manager "msg"="starting metrics server"  "path"="/metrics"
2021-07-19T08:19:17.2274538Z [cluster2] I0719 08:18:15.651801       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-19T08:19:17.2284256Z [cluster2] I0719 08:18:15.652289       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-19T08:19:17.2291422Z [cluster2] I0719 08:18:15.652591       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-19T08:19:17.2296695Z [cluster2] I0719 08:18:15.652952       1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-19T08:19:17.2300983Z [cluster2] I0719 08:18:15.653194       1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-19T08:19:17.2305055Z [cluster2] I0719 08:18:15.754148       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-19T08:19:17.2309968Z [cluster2] I0719 08:18:15.754750       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-19T08:19:17.2314405Z [cluster2] I0719 08:18:15.754810       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-19T08:19:17.2317780Z [cluster2] I0719 08:18:15.778777       1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T08:19:17.2320160Z [cluster2] I0719 08:18:15.779071       1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-19T08:19:17.2322972Z [cluster2] I0719 08:18:15.779003       1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T08:19:17.2366580Z [cluster2] I0719 08:18:15.779245       1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-19T08:19:17.2370597Z [cluster2] I0719 08:18:15.855413       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-19T08:19:17.2374328Z [cluster2] I0719 08:18:15.856066       1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T08:19:17.2376311Z [cluster2] I0719 08:18:15.861203       1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-19T08:19:17.2378383Z [cluster2] I0719 08:18:15.861377       1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers"  "worker count"=1
2021-07-19T08:19:17.2380994Z [cluster2] I0719 08:18:15.956820       1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-19T08:19:17.2382912Z [cluster2] I0719 08:18:15.957032       1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers"  "worker count"=1
2021-07-19T08:19:17.2385681Z [cluster2] I0719 08:18:15.957203       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2388041Z [cluster2] I0719 08:18:15.957642       1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-19T08:19:17.2390314Z [cluster2] I0719 08:18:15.957851       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2392015Z [cluster2] I0719 08:18:16.085474       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-19T08:19:17.2393657Z [cluster2] I0719 08:18:16.085656       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.0.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.0.0.0/16"]
2021-07-19T08:19:17.2395156Z [cluster2] I0719 08:18:16.085743       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2396693Z [cluster2] I0719 08:18:16.085796       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2398048Z [cluster2] I0719 08:18:16.115914       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-19T08:19:17.2399825Z [cluster2] I0719 08:18:16.115951       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.0.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.0.0.0/16"]
2021-07-19T08:19:17.2401309Z [cluster2] I0719 08:18:16.115961       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2402722Z [cluster2] I0719 08:18:16.115971       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2405866Z [cluster2] I0719 08:18:16.233013       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2409775Z [cluster2] E0719 08:18:16.264099       1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T08:19:17.2413151Z [cluster2] I0719 08:18:16.270105       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2414842Z [cluster2] I0719 08:18:16.270185       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2416231Z [cluster2] I0719 08:18:16.270219       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2418778Z [cluster2] I0719 08:18:16.380956       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2422427Z [cluster2] I0719 08:18:16.472994       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2426839Z [cluster2] E0719 08:18:16.565857       1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: services \"submariner-gateway-metrics\" already exists" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T08:19:17.2430230Z [cluster2] I0719 08:18:16.576179       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2431993Z [cluster2] I0719 08:18:16.576367       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2433290Z [cluster2] I0719 08:18:16.576438       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2435694Z [cluster2] I0719 08:18:16.596423       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2438744Z [cluster2] I0719 08:18:16.600804       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2441900Z [cluster2] I0719 08:18:16.874954       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2444874Z [cluster2] I0719 08:18:16.893742       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2448148Z [cluster2] I0719 08:18:16.899767       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2451178Z [cluster2] I0719 08:18:16.964458       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2454288Z [cluster2] I0719 08:18:17.002207       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2457262Z [cluster2] I0719 08:18:17.020883       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2469383Z [cluster2] I0719 08:18:17.109215       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2472776Z [cluster2] I0719 08:18:17.208570       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2476086Z [cluster2] I0719 08:18:17.515568       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2514134Z [cluster2] I0719 08:18:17.623866       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2517140Z [cluster2] I0719 08:18:17.844731       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2520240Z [cluster2] I0719 08:18:17.865665       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2523301Z [cluster2] I0719 08:18:17.961813       1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-19T08:19:17.2527431Z [cluster2] E0719 08:18:18.080449       1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error reconciling the Service Discovery CR: servicediscoveries.submariner.io \"service-discovery\" already exists" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T08:19:17.2530649Z [cluster2] I0719 08:18:18.101286       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2532403Z [cluster2] I0719 08:18:18.101370       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2533725Z [cluster2] I0719 08:18:18.101383       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2536374Z [cluster2] I0719 08:18:18.130364       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.2541222Z [cluster2] E0719 08:18:18.325842       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T08:19:17.2545307Z [cluster2] I0719 08:18:18.370354       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2547784Z [cluster2] I0719 08:18:18.594718       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2549350Z [cluster2] I0719 08:18:18.594760       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2550656Z [cluster2] I0719 08:18:18.594769       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2553335Z [cluster2] I0719 08:18:19.044756       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.2556627Z [cluster2] I0719 08:18:19.045201       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2559708Z [cluster2] I0719 08:18:19.148645       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2563278Z [cluster2] I0719 08:18:19.241481       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2566975Z [cluster2] I0719 08:18:19.603618       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2570375Z [cluster2] I0719 08:18:19.648211       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2573738Z [cluster2] I0719 08:18:19.754254       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2577569Z [cluster2] I0719 08:18:19.982321       1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-19T08:19:17.2581026Z [cluster2] I0719 08:18:20.031724       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2589241Z [cluster2] E0719 08:18:20.088323       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: services \"submariner-lighthouse-agent-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T08:19:17.2593597Z [cluster2] I0719 08:18:20.098393       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2607163Z [cluster2] I0719 08:18:20.105561       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2610805Z [cluster2] I0719 08:18:20.177776       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.2614429Z [cluster2] I0719 08:18:20.226098       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2617679Z [cluster2] I0719 08:18:20.264446       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2620964Z [cluster2] I0719 08:18:20.282600       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.2624625Z [cluster2] I0719 08:18:20.406905       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2627900Z [cluster2] I0719 08:18:20.576733       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2631491Z [cluster2] I0719 08:18:20.588119       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2635115Z [cluster2] I0719 08:18:20.588381       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2638566Z [cluster2] I0719 08:18:20.592714       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2641722Z [cluster2] I0719 08:18:21.051851       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2644886Z [cluster2] I0719 08:18:21.052858       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2648998Z [cluster2] I0719 08:18:21.207823       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.2652720Z [cluster2] E0719 08:18:21.213954       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2655854Z [cluster2] I0719 08:18:21.214005       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2657540Z [cluster2] I0719 08:18:21.214040       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2658948Z [cluster2] I0719 08:18:21.214057       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2661532Z [cluster2] I0719 08:18:21.214504       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2665553Z [cluster2] I0719 08:18:21.341131       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2668975Z [cluster2] I0719 08:18:21.439128       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2672022Z [cluster2] I0719 08:18:21.624913       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2675257Z [cluster2] I0719 08:18:21.639374       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2678575Z [cluster2] I0719 08:18:21.752408       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2683285Z [cluster2] E0719 08:18:21.790755       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns-metrics: services \"submariner-lighthouse-coredns-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T08:19:17.2688090Z [cluster2] I0719 08:18:21.812264       1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2692231Z [cluster2] I0719 08:18:21.812301       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.207.216\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n"
2021-07-19T08:19:17.2695774Z [cluster2] I0719 08:18:21.812834       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2698092Z [cluster2] I0719 08:18:21.820250       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2699846Z [cluster2] I0719 08:18:21.820290       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2701263Z [cluster2] I0719 08:18:21.820299       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2703520Z [cluster2] I0719 08:18:21.843758       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2707311Z [cluster2] I0719 08:18:21.844079       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.2711591Z [cluster2] I0719 08:18:21.864072       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.2714193Z [cluster2] I0719 08:18:21.868480       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2717018Z [cluster2] I0719 08:18:21.908189       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2719786Z [cluster2] I0719 08:18:21.908758       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2722491Z [cluster2] I0719 08:18:21.980732       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2726431Z [cluster2] I0719 08:18:22.070911       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2729812Z [cluster2] I0719 08:18:22.086476       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2733116Z [cluster2] I0719 08:18:22.123353       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2736339Z [cluster2] I0719 08:18:22.179368       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2739505Z [cluster2] I0719 08:18:22.316880       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2742657Z [cluster2] I0719 08:18:22.317393       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2746051Z [cluster2] I0719 08:18:22.361417       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.2749474Z [cluster2] I0719 08:18:22.362031       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.2752796Z [cluster2] I0719 08:18:22.386751       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2756132Z [cluster2] I0719 08:18:22.443898       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2759782Z [cluster2] I0719 08:18:22.444301       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2763129Z [cluster2] I0719 08:18:22.452356       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2766613Z [cluster2] I0719 08:18:22.544749       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2769954Z [cluster2] I0719 08:18:22.570455       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2773429Z [cluster2] I0719 08:18:22.609545       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2776822Z [cluster2] E0719 08:18:22.737686       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2779655Z [cluster2] I0719 08:18:22.737737       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2781213Z [cluster2] I0719 08:18:22.737774       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2782521Z [cluster2] I0719 08:18:22.737791       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2784967Z [cluster2] I0719 08:18:22.856296       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2788141Z [cluster2] I0719 08:18:22.865688       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2791173Z [cluster2] I0719 08:18:22.962135       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2794219Z [cluster2] I0719 08:18:22.993436       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2797835Z [cluster2] I0719 08:18:23.200727       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2802352Z [cluster2] I0719 08:18:23.200789       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.207.216\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n"
2021-07-19T08:19:17.2806449Z [cluster2] I0719 08:18:23.201341       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2811839Z [cluster2] I0719 08:18:23.201393       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.207.216\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n"
2021-07-19T08:19:17.2816939Z [cluster2] I0719 08:18:23.465801       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2821930Z [cluster2] I0719 08:18:23.465854       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.207.216\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n"
2021-07-19T08:19:17.2826512Z [cluster2] I0719 08:18:23.470690       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2830566Z [cluster2] I0719 08:18:23.880069       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2833914Z [cluster2] I0719 08:18:23.940321       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2837185Z [cluster2] I0719 08:18:24.025708       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2840920Z [cluster2] I0719 08:18:24.598785       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2844223Z [cluster2] I0719 08:18:25.014338       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2847359Z [cluster2] I0719 08:18:34.925207       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2849058Z [cluster2] I0719 08:18:34.925260       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2850471Z [cluster2] I0719 08:18:34.925271       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2852965Z [cluster2] I0719 08:18:34.957004       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2856503Z [cluster2] I0719 08:18:34.967080       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2859896Z [cluster2] I0719 08:18:35.373059       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2863105Z [cluster2] I0719 08:18:35.379268       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2867729Z [cluster2] I0719 08:18:35.384767       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2871447Z [cluster2] I0719 08:18:35.408204       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2877088Z [cluster2] I0719 08:18:35.810198       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2880025Z [cluster2] I0719 08:18:35.826351       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2881915Z [cluster2] I0719 08:18:35.826395       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2883332Z [cluster2] I0719 08:18:35.826405       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2889074Z [cluster2] I0719 08:18:35.826897       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2890818Z [cluster2] I0719 08:18:35.826923       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2892235Z [cluster2] I0719 08:18:35.826933       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2894885Z [cluster2] I0719 08:18:35.847288       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2897861Z [cluster2] I0719 08:18:35.860704       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2900896Z [cluster2] I0719 08:18:35.883308       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2904308Z [cluster2] I0719 08:18:35.883672       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2907699Z [cluster2] I0719 08:18:36.286004       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2910847Z [cluster2] I0719 08:18:36.286522       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2914023Z [cluster2] I0719 08:18:36.298292       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2917308Z [cluster2] I0719 08:18:36.303941       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2921611Z [cluster2] I0719 08:18:36.321641       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2925305Z [cluster2] I0719 08:18:36.325105       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2929056Z [cluster2] I0719 08:18:36.337863       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2944722Z [cluster2] I0719 08:18:36.375200       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2948969Z [cluster2] I0719 08:18:36.741192       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2951692Z [cluster2] I0719 08:18:36.758053       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2953385Z [cluster2] I0719 08:18:36.758099       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2954877Z [cluster2] I0719 08:18:36.758110       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2957732Z [cluster2] I0719 08:18:36.773295       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2960699Z [cluster2] I0719 08:18:36.778337       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.2965700Z [cluster2] E0719 08:18:36.785765       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2969862Z [cluster2] I0719 08:18:36.785808       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2971546Z [cluster2] I0719 08:18:36.785838       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.2972956Z [cluster2] I0719 08:18:36.785849       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.2975517Z [cluster2] I0719 08:18:36.796741       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2979940Z [cluster2] I0719 08:18:36.873148       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.2983358Z [cluster2] I0719 08:18:36.880818       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2986391Z [cluster2] I0719 08:18:37.095620       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.2989750Z [cluster2] I0719 08:18:37.114922       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.2993759Z [cluster2] I0719 08:18:37.163464       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.2997376Z [cluster2] I0719 08:18:37.218997       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3000299Z [cluster2] I0719 08:18:37.282163       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3003519Z [cluster2] I0719 08:18:37.402800       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3007222Z [cluster2] I0719 08:18:37.403678       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3010489Z [cluster2] I0719 08:18:37.408615       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3014099Z [cluster2] I0719 08:18:37.411010       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3017880Z [cluster2] I0719 08:18:37.412311       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3021256Z [cluster2] I0719 08:18:37.499352       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3024668Z [cluster2] I0719 08:18:37.587850       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3029463Z [cluster2] I0719 08:18:37.649947       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.3033387Z [cluster2] I0719 08:18:37.693789       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3037272Z [cluster2] I0719 08:18:37.820210       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3040613Z [cluster2] I0719 08:18:37.902137       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3043909Z [cluster2] I0719 08:18:38.109393       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3047365Z [cluster2] I0719 08:18:38.127736       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3051691Z [cluster2] I0719 08:18:38.127782       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.207.216\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n"
2021-07-19T08:19:17.3056226Z [cluster2] I0719 08:18:38.158476       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3059319Z [cluster2] I0719 08:18:38.173210       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.3063017Z [cluster2] I0719 08:18:38.182978       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3066392Z [cluster2] I0719 08:18:38.585267       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3069754Z [cluster2] I0719 08:18:38.590118       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.3073369Z [cluster2] I0719 08:18:38.601723       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3076205Z [cluster2] I0719 08:18:38.931321       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3077774Z [cluster2] I0719 08:18:38.931383       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3079065Z [cluster2] I0719 08:18:38.931393       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3082479Z [cluster2] I0719 08:18:38.969696       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3088114Z [cluster2] I0719 08:18:38.990579       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3091603Z [cluster2] I0719 08:18:39.020342       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3094876Z [cluster2] I0719 08:18:39.026390       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3099337Z [cluster2] I0719 08:18:39.026483       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.207.216\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n"
2021-07-19T08:19:17.3105590Z [cluster2] I0719 08:18:39.393940       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3117739Z [cluster2] I0719 08:18:39.401896       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3121385Z [cluster2] I0719 08:18:39.406836       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3125336Z [cluster2] I0719 08:18:39.440574       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3129257Z [cluster2] I0719 08:18:39.847624       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3131947Z [cluster2] I0719 08:18:39.859468       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3133645Z [cluster2] I0719 08:18:39.859511       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3135058Z [cluster2] I0719 08:18:39.859532       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3137050Z [cluster2] I0719 08:18:39.860392       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3138738Z [cluster2] I0719 08:18:39.860425       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3140418Z [cluster2] I0719 08:18:39.860434       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3142738Z [cluster2] I0719 08:18:39.869982       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3145702Z [cluster2] I0719 08:18:39.871266       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3148745Z [cluster2] I0719 08:18:39.875584       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3152000Z [cluster2] I0719 08:18:39.877493       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3155257Z [cluster2] I0719 08:18:40.313720       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3158533Z [cluster2] I0719 08:18:40.314395       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3161709Z [cluster2] I0719 08:18:40.358700       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3165175Z [cluster2] I0719 08:18:40.362639       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3168816Z [cluster2] I0719 08:18:40.377351       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3172142Z [cluster2] I0719 08:18:40.393359       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3175370Z [cluster2] I0719 08:18:40.402039       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3178684Z [cluster2] I0719 08:18:40.406242       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3181960Z [cluster2] I0719 08:18:40.779285       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3185225Z [cluster2] I0719 08:18:40.785172       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3186998Z [cluster2] I0719 08:18:40.785212       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3188414Z [cluster2] I0719 08:18:40.785224       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3191486Z [cluster2] I0719 08:18:40.791094       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3194866Z [cluster2] I0719 08:18:40.799936       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3197873Z [cluster2] I0719 08:18:40.820669       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3201273Z [cluster2] I0719 08:18:41.202050       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3205031Z [cluster2] I0719 08:18:41.205632       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3208367Z [cluster2] I0719 08:18:41.208332       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3211680Z [cluster2] I0719 08:18:41.211246       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3214964Z [cluster2] I0719 08:18:41.612656       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3217934Z [cluster2] I0719 08:18:41.947730       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3220442Z [cluster2] I0719 08:18:41.965062       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3222131Z [cluster2] I0719 08:18:41.966890       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3223582Z [cluster2] I0719 08:18:41.967010       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3228666Z [cluster2] I0719 08:18:41.978225       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.3232132Z [cluster2] I0719 08:18:41.978939       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3235403Z [cluster2] I0719 08:18:41.991963       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3238914Z [cluster2] I0719 08:18:41.993016       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3242987Z [cluster2] I0719 08:18:42.394486       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3246208Z [cluster2] I0719 08:18:42.397421       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3250331Z [cluster2] I0719 08:18:42.397786       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3254949Z [cluster2] I0719 08:18:42.401097       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3258647Z [cluster2] I0719 08:18:42.401118       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.3262059Z [cluster2] I0719 08:18:42.403843       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3265469Z [cluster2] I0719 08:18:42.408693       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3268726Z [cluster2] I0719 08:18:42.805704       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3271208Z [cluster2] I0719 08:18:42.811052       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3272759Z [cluster2] I0719 08:18:42.811093       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3274405Z [cluster2] I0719 08:18:42.811103       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3276425Z [cluster2] I0719 08:18:42.811875       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3279235Z [cluster2] I0719 08:18:42.811905       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3281196Z [cluster2] I0719 08:18:42.811915       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3285134Z [cluster2] I0719 08:18:42.812307       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3290328Z [cluster2] I0719 08:18:42.816992       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3293526Z [cluster2] I0719 08:18:42.820421       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3296100Z [cluster2] I0719 08:18:42.820740       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3300965Z [cluster2] I0719 08:18:42.820821       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.207.216\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n\n"
2021-07-19T08:19:17.3305934Z [cluster2] I0719 08:18:42.821103       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3308607Z [cluster2] I0719 08:18:42.832944       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3312039Z [cluster2] I0719 08:18:43.222241       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3315229Z [cluster2] I0719 08:18:43.225602       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3318528Z [cluster2] I0719 08:18:43.227994       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3321974Z [cluster2] I0719 08:18:43.230409       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3326143Z [cluster2] I0719 08:18:43.238535       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3333359Z [cluster2] I0719 08:18:43.240625       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3336672Z [cluster2] I0719 08:18:43.243019       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3339986Z [cluster2] I0719 08:18:43.245549       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3343631Z [cluster2] I0719 08:18:43.631663       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3346685Z [cluster2] I0719 08:18:43.646554       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3349174Z [cluster2] I0719 08:18:44.236439       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3350735Z [cluster2] I0719 08:18:44.238162       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3352028Z [cluster2] I0719 08:18:44.238262       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3354340Z [cluster2] I0719 08:18:44.242552       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3357371Z [cluster2] I0719 08:18:44.245566       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3360988Z [cluster2] I0719 08:18:44.647578       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3366230Z [cluster2] I0719 08:18:44.650422       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3370939Z [cluster2] I0719 08:18:44.653339       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3376324Z [cluster2] I0719 08:18:44.658046       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3379985Z [cluster2] I0719 08:18:45.059676       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3382679Z [cluster2] I0719 08:18:45.066015       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3439951Z [cluster2] I0719 08:18:45.066051       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3441256Z [cluster2] I0719 08:18:45.066060       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3443151Z [cluster2] I0719 08:18:45.066721       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3444707Z [cluster2] I0719 08:18:45.069861       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3446338Z [cluster2] I0719 08:18:45.069883       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3448641Z [cluster2] I0719 08:18:45.072288       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3451202Z [cluster2] I0719 08:18:45.079018       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3453837Z [cluster2] I0719 08:18:45.081919       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3456526Z [cluster2] I0719 08:18:45.106292       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3459138Z [cluster2] I0719 08:18:45.483799       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3461721Z [cluster2] I0719 08:18:45.486925       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3464465Z [cluster2] I0719 08:18:45.489960       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3467226Z [cluster2] I0719 08:18:45.493479       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3470421Z [cluster2] I0719 08:18:45.507430       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3473392Z [cluster2] I0719 08:18:45.509962       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3476821Z [cluster2] I0719 08:18:45.512073       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3480454Z [cluster2] I0719 08:18:45.515376       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3483472Z [cluster2] I0719 08:18:45.895167       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3486598Z [cluster2] I0719 08:18:45.917041       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3489069Z [cluster2] I0719 08:18:49.250504       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3490625Z [cluster2] I0719 08:18:49.250571       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3491930Z [cluster2] I0719 08:18:49.250581       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3494259Z [cluster2] I0719 08:18:49.255359       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3497294Z [cluster2] I0719 08:18:49.266865       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3500378Z [cluster2] I0719 08:18:49.669124       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3503537Z [cluster2] I0719 08:18:49.673141       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3506796Z [cluster2] I0719 08:18:49.677146       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3525670Z [cluster2] I0719 08:18:49.692527       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3529261Z [cluster2] I0719 08:18:50.095154       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3532462Z [cluster2] I0719 08:18:50.108700       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3534188Z [cluster2] I0719 08:18:50.108866       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3535561Z [cluster2] I0719 08:18:50.108928       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3537517Z [cluster2] I0719 08:18:50.109411       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3539111Z [cluster2] I0719 08:18:50.109496       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3540727Z [cluster2] I0719 08:18:50.109529       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3543177Z [cluster2] I0719 08:18:50.123789       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3546187Z [cluster2] I0719 08:18:50.124895       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3549288Z [cluster2] I0719 08:18:50.134913       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3553801Z [cluster2] I0719 08:18:50.135867       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3557222Z [cluster2] I0719 08:18:50.536830       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3560434Z [cluster2] I0719 08:18:50.538073       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3563748Z [cluster2] I0719 08:18:50.542081       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3568334Z [cluster2] I0719 08:18:50.542523       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3585453Z [cluster2] I0719 08:18:50.545549       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3589010Z [cluster2] I0719 08:18:50.548316       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3613172Z [cluster2] I0719 08:18:50.552679       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3617675Z [cluster2] I0719 08:18:50.553872       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3621750Z [cluster2] I0719 08:18:50.956117       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3626001Z [cluster2] I0719 08:18:50.957855       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3629254Z [cluster2] I0719 08:18:54.282435       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3631385Z [cluster2] I0719 08:18:54.282827       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3633103Z [cluster2] I0719 08:18:54.282875       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3636225Z [cluster2] I0719 08:18:54.290834       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3639954Z [cluster2] I0719 08:18:54.306489       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3645306Z [cluster2] I0719 08:18:54.709059       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3649029Z [cluster2] I0719 08:18:54.716644       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3652665Z [cluster2] I0719 08:18:54.721994       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3656204Z [cluster2] I0719 08:18:54.731931       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3659469Z [cluster2] I0719 08:18:55.133460       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3661967Z [cluster2] I0719 08:18:55.162093       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3663541Z [cluster2] I0719 08:18:55.162141       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3665246Z [cluster2] I0719 08:18:55.162151       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3667314Z [cluster2] I0719 08:18:55.162589       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3668873Z [cluster2] I0719 08:18:55.162617       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3670284Z [cluster2] I0719 08:18:55.162627       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3672634Z [cluster2] I0719 08:18:55.186289       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3675923Z [cluster2] I0719 08:18:55.186675       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3679198Z [cluster2] I0719 08:18:55.193753       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3682756Z [cluster2] I0719 08:18:55.194013       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3686535Z [cluster2] I0719 08:18:55.595251       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3689738Z [cluster2] I0719 08:18:55.595257       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3692940Z [cluster2] I0719 08:18:55.599940       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3696310Z [cluster2] I0719 08:18:55.600290       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3699603Z [cluster2] I0719 08:18:55.603005       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3702864Z [cluster2] I0719 08:18:55.604153       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3706279Z [cluster2] I0719 08:18:55.606004       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3709467Z [cluster2] I0719 08:18:55.606939       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3712857Z [cluster2] I0719 08:18:56.008038       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3716309Z [cluster2] I0719 08:18:56.008288       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3719032Z [cluster2] I0719 08:18:59.345924       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3720725Z [cluster2] I0719 08:18:59.346243       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3722113Z [cluster2] I0719 08:18:59.346404       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3724631Z [cluster2] I0719 08:18:59.369023       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3728315Z [cluster2] I0719 08:18:59.372995       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3731786Z [cluster2] I0719 08:18:59.775127       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3735004Z [cluster2] I0719 08:18:59.787166       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3738224Z [cluster2] I0719 08:18:59.791727       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3741379Z [cluster2] I0719 08:18:59.795159       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3745643Z [cluster2] I0719 08:19:00.197662       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3748346Z [cluster2] I0719 08:19:00.203600       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3750595Z [cluster2] I0719 08:19:00.204747       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3752682Z [cluster2] I0719 08:19:00.204825       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3754074Z [cluster2] I0719 08:19:00.204851       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3756549Z [cluster2] I0719 08:19:00.205486       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3758272Z [cluster2] I0719 08:19:00.205534       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3761451Z [cluster2] I0719 08:19:00.401446       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3764668Z [cluster2] I0719 08:19:00.402018       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3767908Z [cluster2] I0719 08:19:00.409587       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3771398Z [cluster2] I0719 08:19:00.431236       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3774624Z [cluster2] I0719 08:19:00.811592       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3777850Z [cluster2] I0719 08:19:00.815217       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3781115Z [cluster2] I0719 08:19:00.820281       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3784417Z [cluster2] I0719 08:19:00.832607       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3788188Z [cluster2] I0719 08:19:00.835429       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3791893Z [cluster2] I0719 08:19:00.838043       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3794991Z [cluster2] I0719 08:19:00.868400       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3798311Z [cluster2] I0719 08:19:00.871944       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3801376Z [cluster2] I0719 08:19:01.237851       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3804429Z [cluster2] I0719 08:19:01.273585       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3807060Z [cluster2] I0719 08:19:04.374789       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3808825Z [cluster2] I0719 08:19:04.374844       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3810561Z [cluster2] I0719 08:19:04.374854       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3813375Z [cluster2] I0719 08:19:04.379042       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3816703Z [cluster2] I0719 08:19:04.381938       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3819991Z [cluster2] I0719 08:19:04.783720       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3823541Z [cluster2] I0719 08:19:04.788127       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3826825Z [cluster2] I0719 08:19:04.791155       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3830582Z [cluster2] I0719 08:19:04.795514       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3834175Z [cluster2] I0719 08:19:05.198146       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3836836Z [cluster2] I0719 08:19:05.207730       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3838395Z [cluster2] I0719 08:19:05.207795       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3839695Z [cluster2] I0719 08:19:05.207806       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3841522Z [cluster2] I0719 08:19:05.210670       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3843080Z [cluster2] I0719 08:19:05.210723       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3844465Z [cluster2] I0719 08:19:05.210735       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3846987Z [cluster2] I0719 08:19:05.216674       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3849960Z [cluster2] I0719 08:19:05.219438       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3853054Z [cluster2] I0719 08:19:05.227384       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3856113Z [cluster2] I0719 08:19:05.228544       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3859130Z [cluster2] I0719 08:19:05.635245       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3863438Z [cluster2] I0719 08:19:05.635765       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3867907Z [cluster2] I0719 08:19:05.642599       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3872817Z [cluster2] I0719 08:19:05.643951       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3878637Z [cluster2] I0719 08:19:05.646941       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3882007Z [cluster2] I0719 08:19:05.647329       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3886070Z [cluster2] I0719 08:19:05.651532       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3890043Z [cluster2] I0719 08:19:05.651804       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3893377Z [cluster2] I0719 08:19:06.053544       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3896707Z [cluster2] I0719 08:19:06.054458       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3899370Z [cluster2] I0719 08:19:09.398646       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3901225Z [cluster2] I0719 08:19:09.399105       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3902904Z [cluster2] I0719 08:19:09.399142       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3905392Z [cluster2] I0719 08:19:09.412528       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3908672Z [cluster2] I0719 08:19:09.419882       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3912448Z [cluster2] I0719 08:19:09.821507       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3915710Z [cluster2] I0719 08:19:09.825064       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3919033Z [cluster2] I0719 08:19:09.829599       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3922868Z [cluster2] I0719 08:19:09.840801       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3926549Z [cluster2] I0719 08:19:10.242604       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.3929259Z [cluster2] I0719 08:19:10.249497       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3976435Z [cluster2] I0719 08:19:10.249602       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3977888Z [cluster2] I0719 08:19:10.249620       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3980100Z [cluster2] I0719 08:19:10.252691       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.3981799Z [cluster2] I0719 08:19:10.252808       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.3983192Z [cluster2] I0719 08:19:10.252865       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.3985962Z [cluster2] I0719 08:19:10.258211       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3989182Z [cluster2] I0719 08:19:10.259742       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.3992447Z [cluster2] I0719 08:19:10.267967       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3995766Z [cluster2] I0719 08:19:10.277436       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.3999044Z [cluster2] I0719 08:19:10.669356       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.4002274Z [cluster2] I0719 08:19:10.672364       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.4027079Z [cluster2] I0719 08:19:10.674809       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.4030982Z [cluster2] I0719 08:19:10.677340       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.4034483Z [cluster2] I0719 08:19:10.683703       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.4037454Z [cluster2] I0719 08:19:10.691070       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.4040488Z [cluster2] I0719 08:19:10.693196       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.4043843Z [cluster2] I0719 08:19:10.697752       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.4047150Z [cluster2] I0719 08:19:11.078659       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.4050236Z [cluster2] I0719 08:19:11.099459       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.4053022Z [cluster2] I0719 08:19:14.460927       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.4054709Z [cluster2] I0719 08:19:14.460979       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.4056112Z [cluster2] I0719 08:19:14.460986       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.4058618Z [cluster2] I0719 08:19:14.470024       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.4061939Z [cluster2] I0719 08:19:14.474810       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.4064923Z [cluster2] I0719 08:19:14.876606       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.4067904Z [cluster2] I0719 08:19:14.880024       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.4070935Z [cluster2] I0719 08:19:14.883338       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.4074184Z [cluster2] I0719 08:19:14.887479       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.4082187Z [cluster2] I0719 08:19:15.289597       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.4084882Z [cluster2] I0719 08:19:15.296314       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.4086866Z [cluster2] I0719 08:19:15.296964       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.4088263Z [cluster2] I0719 08:19:15.296974       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.4090275Z [cluster2] I0719 08:19:15.299017       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.4091964Z [cluster2] I0719 08:19:15.299053       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.4093440Z [cluster2] I0719 08:19:15.299062       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.4095928Z [cluster2] I0719 08:19:15.309094       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.4098886Z [cluster2] I0719 08:19:15.311371       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.4101896Z [cluster2] I0719 08:19:15.313880       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.4104965Z [cluster2] I0719 08:19:15.327617       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.4107980Z [cluster2] I0719 08:19:15.715913       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.4110943Z [cluster2] I0719 08:19:15.719709       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5228129Z [cluster2] I0719 08:19:15.724515       1 helpers.go:85] controller_submariner "msg"="Updar1]         "qosClass": "BestEffort",
2021-07-19T08:19:17.5229726Z [cluster1]         "startTime": "2021-07-19T08:17:45Z"
2021-07-19T08:19:17.5230190Z [cluster1]     }
2021-07-19T08:19:17.5230578Z [cluster1] }
2021-07-19T08:19:17.5232083Z [36m[submariner-operator]$ [cluster1] kubectl get pod submariner-operator-56f895dd55-s9lcp --namespace=submariner-operator -o jsonpath={.status.phase}[0m
2021-07-19T08:19:17.5234122Z [36m[submariner-operator]$ [cluster1] grep Running[0m
2021-07-19T08:19:17.5235914Z [36m[submariner-operator]$ [cluster1] kubectl get pod submariner-operator-56f895dd55-s9lcp --namespace=submariner-operator -o jsonpath={.status.phase}[0m
2021-07-19T08:19:17.5241180Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-56f895dd55-s9lcp --namespace=submariner-operator -o jsonpath={.status.phase}[0m
2021-07-19T08:19:17.5243642Z [cluster1] Running
2021-07-19T08:19:17.5245594Z [36m[submariner-operator]$ [cluster1] kubectl logs submariner-operator-56f895dd55-s9lcp --namespace=submariner-operator[0m
2021-07-19T08:19:17.5251200Z [36m[submariner-operator]$ [cluster1] kubectl logs submariner-operator-56f895dd55-s9lcp --namespace=submariner-operator[0m
2021-07-19T08:19:17.5256667Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 logs submariner-operator-56f895dd55-s9lcp --namespace=submariner-operator[0m
2021-07-19T08:19:17.5259992Z [cluster1] I0719 08:17:52.965768       1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-19T08:19:17.5261447Z [cluster1] I0719 08:17:52.965881       1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-19T08:19:17.5262705Z [cluster1] I0719 08:17:52.965888       1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-19T08:19:17.5265937Z [cluster1] I0719 08:17:52.965894       1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-19T08:19:17.5267793Z [cluster1] I0719 08:17:52.966058       1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-19T08:19:17.5269095Z [cluster1] I0719 08:17:53.372686       1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."
2021-07-19T08:19:17.5271452Z [cluster1] I0719 08:17:53.372717       1 leader.go:123] leader "msg"="Continuing as the leader."
2021-07-19T08:19:17.5273587Z [cluster1] I0719 08:17:53.778985       1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen"  "addr"="0.0.0.0:8383"
2021-07-19T08:19:17.5275125Z [cluster1] I0719 08:17:53.779353       1 main.go:129] cmd "msg"="Registering Components."
2021-07-19T08:19:17.5275973Z [cluster1] I0719 08:17:53.779473       1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-19T08:19:17.5278556Z [cluster1] I0719 08:17:56.336792       1 main.go:182] cmd "msg"="Could not create ServiceMonitor object"  "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5280429Z [cluster1] I0719 08:17:56.336828       1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects"  "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5282653Z [cluster1] I0719 08:17:56.336918       1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-19T08:19:17.5285604Z [cluster1] I0719 08:17:56.337164       1 internal.go:406] controller-runtime/manager "msg"="starting metrics server"  "path"="/metrics"
2021-07-19T08:19:17.5292068Z [cluster1] I0719 08:17:56.337602       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-19T08:19:17.5299266Z [cluster1] I0719 08:17:56.337836       1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-19T08:19:17.5306291Z [cluster1] I0719 08:17:56.338127       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-19T08:19:17.5338561Z [cluster1] I0719 08:17:56.338334       1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-19T08:19:17.5345764Z [cluster1] I0719 08:17:56.338436       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-19T08:19:17.5352698Z [cluster1] I0719 08:17:56.438412       1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T08:19:17.5355794Z [cluster1] I0719 08:17:56.438450       1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-19T08:19:17.5358714Z [cluster1] I0719 08:17:56.438486       1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T08:19:17.5361363Z [cluster1] I0719 08:17:56.438503       1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-19T08:19:17.5365198Z [cluster1] I0719 08:17:56.439944       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-19T08:19:17.5382839Z [cluster1] I0719 08:17:56.439955       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-19T08:19:17.5387601Z [cluster1] I0719 08:17:56.440230       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-19T08:19:17.5390803Z [cluster1] I0719 08:17:56.540151       1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-19T08:19:17.5393265Z [cluster1] I0719 08:17:56.540586       1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers"  "worker count"=1
2021-07-19T08:19:17.5395503Z [cluster1] I0719 08:17:56.540399       1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T08:19:17.5402751Z [cluster1] I0719 08:17:56.540891       1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-19T08:19:17.5409575Z [cluster1] I0719 08:17:56.540676       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-19T08:19:17.5412357Z [cluster1] I0719 08:17:56.641808       1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-19T08:19:17.5414127Z [cluster1] I0719 08:17:56.641851       1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers"  "worker count"=1
2021-07-19T08:19:17.5416091Z [cluster1] I0719 08:17:57.386886       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5418381Z [cluster1] I0719 08:17:57.386928       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5419905Z [cluster1] I0719 08:17:57.422881       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-19T08:19:17.5421549Z [cluster1] I0719 08:17:57.422915       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.0.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.0.0.0/16"]
2021-07-19T08:19:17.5423314Z [cluster1] I0719 08:17:57.422928       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.5424625Z [cluster1] I0719 08:17:57.422937       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.5425911Z [cluster1] I0719 08:17:57.430618       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-19T08:19:17.5427592Z [cluster1] I0719 08:17:57.430649       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.0.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.0.0.0/16"]
2021-07-19T08:19:17.5428977Z [cluster1] I0719 08:17:57.430660       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.5430272Z [cluster1] I0719 08:17:57.430670       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.5432547Z [cluster1] I0719 08:17:57.432637       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5436571Z [cluster1] E0719 08:17:57.432714       1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: DaemonSet.apps \"submariner-gateway\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T08:19:17.5439607Z [cluster1] I0719 08:17:57.438682       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5441170Z [cluster1] I0719 08:17:57.438737       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.5442500Z [cluster1] I0719 08:17:57.438748       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.5445845Z [cluster1] E0719 08:17:57.439267       1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-19T08:19:17.5449139Z [cluster1] I0719 08:17:57.439312       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5450841Z [cluster1] I0719 08:17:57.439334       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.5452448Z [cluster1] I0719 08:17:57.439352       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.5455861Z [cluster1] I0719 08:17:57.445943       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5459615Z [cluster1] I0719 08:17:57.446269       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5462433Z [cluster1] I0719 08:17:57.552581       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5465678Z [cluster1] E0719 08:17:57.552665       1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: Service \"submariner-gateway-metrics\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T08:19:17.5468381Z [cluster1] I0719 08:17:57.562757       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5469746Z [cluster1] I0719 08:17:57.562954       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.5470887Z [cluster1] I0719 08:17:57.562968       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.5472897Z [cluster1] I0719 08:17:57.570473       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5475639Z [cluster1] I0719 08:17:57.588717       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5479404Z [cluster1] E0719 08:17:57.600861       1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: services \"submariner-gateway-metrics\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-19T08:19:17.5482040Z [cluster1] I0719 08:17:57.601028       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5483753Z [cluster1] I0719 08:17:57.601860       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.5485210Z [cluster1] I0719 08:17:57.601991       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.5487549Z [cluster1] I0719 08:17:57.618966       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5490577Z [cluster1] I0719 08:17:57.643504       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5497053Z [cluster1] I0719 08:17:57.991724       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5501623Z [cluster1] I0719 08:17:58.002302       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5504811Z [cluster1] I0719 08:17:58.007659       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5508169Z [cluster1] E0719 08:17:58.007728       1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-globalnet: DaemonSet.apps \"submariner-globalnet\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T08:19:17.5511856Z [cluster1] I0719 08:17:58.028595       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5513226Z [cluster1] I0719 08:17:58.028637       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.5514369Z [cluster1] I0719 08:17:58.028647       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.5516394Z [cluster1] I0719 08:17:58.058480       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5519926Z [cluster1] I0719 08:17:58.066762       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5522786Z [cluster1] I0719 08:17:58.162375       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5526567Z [cluster1] I0719 08:17:58.207961       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5529648Z [cluster1] I0719 08:17:58.388854       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5532678Z [cluster1] I0719 08:17:58.467754       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5536043Z [cluster1] E0719 08:17:58.467820       1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-globalnet-metrics: Service \"submariner-globalnet-metrics\" not found" "name"="submariner" "namespace"="submariner-operator"
2021-07-19T08:19:17.5538761Z [cluster1] I0719 08:17:58.468182       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5540142Z [cluster1] I0719 08:17:58.468221       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.5541578Z [cluster1] I0719 08:17:58.468230       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.5544173Z [cluster1] I0719 08:17:58.509179       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5547454Z [cluster1] I0719 08:17:58.544958       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5551522Z [cluster1] I0719 08:17:58.609558       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5554826Z [cluster1] I0719 08:17:58.612127       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5558651Z [cluster1] I0719 08:17:58.614634       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5562126Z [cluster1] I0719 08:17:58.620889       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5566500Z [cluster1] I0719 08:17:58.947043       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5570202Z [cluster1] I0719 08:17:58.951620       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5580065Z [cluster1] I0719 08:17:58.955228       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5584295Z [cluster1] I0719 08:17:58.961802       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5587631Z [cluster1] I0719 08:17:59.041206       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5597111Z [cluster1] I0719 08:17:59.059548       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5600058Z [cluster1] I0719 08:17:59.060670       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5610531Z [cluster1] I0719 08:17:59.088721       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.5614466Z [cluster1] I0719 08:17:59.108832       1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-19T08:19:17.5619860Z [cluster1] E0719 08:17:59.187705       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T08:19:17.5639320Z [cluster1] I0719 08:17:59.192990       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5642566Z [cluster1] I0719 08:17:59.363277       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5645420Z [cluster1] I0719 08:17:59.593805       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5647334Z [cluster1] I0719 08:17:59.593857       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.5648758Z [cluster1] I0719 08:17:59.593867       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.5651742Z [cluster1] E0719 08:17:59.608357       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5657508Z [cluster1] I0719 08:17:59.608411       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5659749Z [cluster1] I0719 08:17:59.608466       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.5661284Z [cluster1] I0719 08:17:59.608476       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.5664643Z [cluster1] I0719 08:17:59.799803       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5668734Z [cluster1] I0719 08:17:59.834549       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5672166Z [cluster1] I0719 08:17:59.835365       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5677487Z [cluster1] I0719 08:18:00.119408       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.5681800Z [cluster1] I0719 08:18:00.145834       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5687287Z [cluster1] I0719 08:18:00.217499       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5691749Z [cluster1] I0719 08:18:00.242604       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5697563Z [cluster1] I0719 08:18:00.250131       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5701959Z [cluster1] I0719 08:18:00.386331       1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-19T08:19:17.5713264Z [cluster1] E0719 08:18:00.386381       1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found"
2021-07-19T08:19:17.5718429Z [cluster1] E0719 08:18:00.386414       1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-19T08:19:17.5726607Z [cluster1] I0719 08:18:00.386446       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5742813Z [cluster1] I0719 08:18:00.416646       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.5747583Z [cluster1] I0719 08:18:00.494593       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5751442Z [cluster1] I0719 08:18:00.548601       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5754683Z [cluster1] I0719 08:18:00.634592       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5759178Z [cluster1] I0719 08:18:00.645465       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5763088Z [cluster1] I0719 08:18:00.653117       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5766362Z [cluster1] I0719 08:18:00.699053       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5769892Z [cluster1] I0719 08:18:00.730863       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.5780191Z [cluster1] I0719 08:18:00.745279       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5783389Z [cluster1] I0719 08:18:00.904337       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5787342Z [cluster1] I0719 08:18:00.908370       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.5790796Z [cluster1] I0719 08:18:00.947597       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5794598Z [cluster1] I0719 08:18:01.108939       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5809232Z [cluster1] E0719 08:18:01.109010       1 servicediscovery_controller.go:169] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS service" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found"
2021-07-19T08:19:17.5813911Z [cluster1] E0719 08:18:01.109065       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T08:19:17.5819053Z [cluster1] I0719 08:18:01.124877       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5821548Z [cluster1] I0719 08:18:01.125703       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5823996Z [cluster1] I0719 08:18:01.312368       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5826808Z [cluster1] I0719 08:18:01.455155       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.5830787Z [cluster1] I0719 08:18:01.542879       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5834119Z [cluster1] I0719 08:18:01.564475       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5838451Z [cluster1] I0719 08:18:01.564441       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.5842278Z [cluster1] I0719 08:18:01.823771       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5875984Z [cluster1] I0719 08:18:01.983619       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5880274Z [cluster1] I0719 08:18:01.995884       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.5884228Z [cluster1] I0719 08:18:02.000686       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5927700Z [cluster1] I0719 08:18:02.236059       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5931156Z [cluster1] I0719 08:18:02.271124       1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5935841Z [cluster1] I0719 08:18:02.271175       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.97.167\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n"
2021-07-19T08:19:17.5940098Z [cluster1] I0719 08:18:02.279308       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5942911Z [cluster1] I0719 08:18:02.282229       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.5946747Z [cluster1] I0719 08:18:02.286188       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.5950264Z [cluster1] I0719 08:18:02.402533       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5953507Z [cluster1] I0719 08:18:02.408911       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.5958265Z [cluster1] I0719 08:18:02.408949       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.97.167\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n"
2021-07-19T08:19:17.5965300Z [cluster1] I0719 08:18:02.690916       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.5969062Z [cluster1] I0719 08:18:02.698037       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.5973028Z [cluster1] I0719 08:18:02.703129       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6006029Z [cluster1] I0719 08:18:03.113033       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6009638Z [cluster1] I0719 08:18:03.125809       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6013809Z [cluster1] I0719 08:18:03.125855       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.97.167\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n"
2021-07-19T08:19:17.6017440Z [cluster1] I0719 08:18:15.759651       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6019121Z [cluster1] I0719 08:18:15.774942       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6020448Z [cluster1] I0719 08:18:15.774972       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6022897Z [cluster1] I0719 08:18:15.848040       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6025944Z [cluster1] I0719 08:18:15.932931       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6029167Z [cluster1] I0719 08:18:16.351833       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6032492Z [cluster1] I0719 08:18:16.379851       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6035778Z [cluster1] I0719 08:18:16.391804       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6062232Z [cluster1] I0719 08:18:16.409961       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6065557Z [cluster1] I0719 08:18:16.811702       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6068256Z [cluster1] I0719 08:18:16.868130       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6069839Z [cluster1] I0719 08:18:16.868204       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6071151Z [cluster1] I0719 08:18:16.868225       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6073140Z [cluster1] I0719 08:18:16.888223       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6074713Z [cluster1] I0719 08:18:16.888300       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6100327Z [cluster1] I0719 08:18:16.888310       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6103055Z [cluster1] I0719 08:18:16.904192       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6106071Z [cluster1] I0719 08:18:16.928538       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6109117Z [cluster1] I0719 08:18:16.946878       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6112176Z [cluster1] I0719 08:18:16.993257       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6115192Z [cluster1] I0719 08:18:17.394395       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6118648Z [cluster1] I0719 08:18:17.414771       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6156419Z [cluster1] I0719 08:18:17.606286       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6160281Z [cluster1] I0719 08:18:17.606714       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6163702Z [cluster1] I0719 08:18:17.665132       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6167622Z [cluster1] I0719 08:18:17.665536       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6170891Z [cluster1] I0719 08:18:17.766921       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6174193Z [cluster1] I0719 08:18:17.785279       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6177547Z [cluster1] I0719 08:18:18.167754       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6180395Z [cluster1] I0719 08:18:18.219245       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6183967Z [cluster1] I0719 08:18:18.238542       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.6187666Z [cluster1] I0719 08:18:18.288560       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6191066Z [cluster1] E0719 08:18:18.558065       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6193900Z [cluster1] I0719 08:18:18.558131       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6195474Z [cluster1] I0719 08:18:18.558171       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6206975Z [cluster1] I0719 08:18:18.558181       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6209203Z [cluster1] I0719 08:18:18.588303       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6210911Z [cluster1] I0719 08:18:18.588378       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6212215Z [cluster1] I0719 08:18:18.588397       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6214896Z [cluster1] I0719 08:18:18.879140       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6218204Z [cluster1] I0719 08:18:18.972040       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6233363Z [cluster1] I0719 08:18:18.982545       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6236684Z [cluster1] I0719 08:18:19.048325       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6240587Z [cluster1] I0719 08:18:19.048772       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6243787Z [cluster1] I0719 08:18:19.348823       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6248021Z [cluster1] I0719 08:18:19.378957       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.6251677Z [cluster1] I0719 08:18:19.395007       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6265146Z [cluster1] I0719 08:18:19.487490       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6269204Z [cluster1] I0719 08:18:19.495536       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6272422Z [cluster1] I0719 08:18:19.524368       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6275644Z [cluster1] I0719 08:18:19.535529       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6278956Z [cluster1] I0719 08:18:19.631354       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6290557Z [cluster1] I0719 08:18:19.632817       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6312058Z [cluster1] I0719 08:18:19.718992       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6315200Z [cluster1] I0719 08:18:19.722706       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6318471Z [cluster1] I0719 08:18:19.844966       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6321271Z [cluster1] I0719 08:18:19.875279       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6325679Z [cluster1] I0719 08:18:19.875345       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.97.167\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n"
2021-07-19T08:19:17.6329235Z [cluster1] I0719 08:18:19.971308       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6332323Z [cluster1] I0719 08:18:20.000902       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.6335870Z [cluster1] I0719 08:18:20.023850       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6350509Z [cluster1] I0719 08:18:20.176240       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6353870Z [cluster1] I0719 08:18:20.178769       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6383239Z [cluster1] I0719 08:18:20.425187       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6387105Z [cluster1] I0719 08:18:20.545700       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.6391043Z [cluster1] I0719 08:18:20.573701       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6394761Z [cluster1] I0719 08:18:20.975748       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6397984Z [cluster1] I0719 08:18:21.192790       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6402456Z [cluster1] I0719 08:18:21.192846       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.97.167\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n"
2021-07-19T08:19:17.6406217Z [cluster1] I0719 08:18:21.228981       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6407790Z [cluster1] I0719 08:18:21.229035       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6409084Z [cluster1] I0719 08:18:21.229045       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6411417Z [cluster1] I0719 08:18:21.243355       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6414476Z [cluster1] I0719 08:18:21.310653       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6417498Z [cluster1] I0719 08:18:21.712627       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6420550Z [cluster1] I0719 08:18:21.716218       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6428445Z [cluster1] I0719 08:18:21.722675       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6431185Z [cluster1] I0719 08:18:21.780006       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6433845Z [cluster1] I0719 08:18:22.184606       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6436013Z [cluster1] I0719 08:18:22.192718       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6437372Z [cluster1] I0719 08:18:22.192755       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6438507Z [cluster1] I0719 08:18:22.192763       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6445427Z [cluster1] I0719 08:18:22.193490       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6447169Z [cluster1] I0719 08:18:22.193519       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6448480Z [cluster1] I0719 08:18:22.193529       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6450843Z [cluster1] I0719 08:18:22.213899       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6454248Z [cluster1] I0719 08:18:22.214288       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6457356Z [cluster1] I0719 08:18:22.222695       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6460080Z [cluster1] I0719 08:18:22.222965       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6463714Z [cluster1] I0719 08:18:22.631856       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6467586Z [cluster1] I0719 08:18:22.632359       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6470951Z [cluster1] I0719 08:18:22.656132       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6475375Z [cluster1] I0719 08:18:22.657115       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6479992Z [cluster1] I0719 08:18:22.677371       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6484641Z [cluster1] I0719 08:18:22.677660       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6488003Z [cluster1] I0719 08:18:22.696677       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6491134Z [cluster1] I0719 08:18:22.729517       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6495304Z [cluster1] I0719 08:18:23.099260       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6498320Z [cluster1] I0719 08:18:23.131099       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6500792Z [cluster1] I0719 08:18:24.722523       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6502330Z [cluster1] I0719 08:18:24.722574       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6505069Z [cluster1] I0719 08:18:24.722601       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6507414Z [cluster1] I0719 08:18:24.729792       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6510505Z [cluster1] I0719 08:18:24.732655       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6514475Z [cluster1] I0719 08:18:25.134861       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6524297Z [cluster1] I0719 08:18:25.138415       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6527731Z [cluster1] I0719 08:18:25.142270       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6532387Z [cluster1] I0719 08:18:25.148877       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6536261Z [cluster1] I0719 08:18:25.550410       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6538859Z [cluster1] I0719 08:18:25.556321       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6540462Z [cluster1] I0719 08:18:25.556363       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6541875Z [cluster1] I0719 08:18:25.556374       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6543795Z [cluster1] I0719 08:18:25.559102       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6545291Z [cluster1] I0719 08:18:25.559136       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6546424Z [cluster1] I0719 08:18:25.559147       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6548454Z [cluster1] I0719 08:18:25.565979       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6551408Z [cluster1] I0719 08:18:25.566508       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6554719Z [cluster1] I0719 08:18:25.581454       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6558105Z [cluster1] I0719 08:18:25.581666       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6561128Z [cluster1] I0719 08:18:25.991864       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6564783Z [cluster1] I0719 08:18:26.002799       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6568792Z [cluster1] I0719 08:18:26.010756       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6572251Z [cluster1] I0719 08:18:26.016746       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6575509Z [cluster1] I0719 08:18:26.034128       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6578761Z [cluster1] I0719 08:18:26.034555       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6582044Z [cluster1] I0719 08:18:26.057258       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6586625Z [cluster1] I0719 08:18:26.057500       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6589670Z [cluster1] I0719 08:18:26.458951       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6592722Z [cluster1] I0719 08:18:26.458980       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6595172Z [cluster1] I0719 08:18:28.758590       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6601537Z [cluster1] I0719 08:18:28.779893       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6603106Z [cluster1] I0719 08:18:28.779949       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6606138Z [cluster1] I0719 08:18:28.841695       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6609432Z [cluster1] I0719 08:18:28.853002       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6613395Z [cluster1] I0719 08:18:29.260035       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6616934Z [cluster1] I0719 08:18:29.264048       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6621707Z [cluster1] I0719 08:18:29.267361       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6626180Z [cluster1] I0719 08:18:29.276426       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6630623Z [cluster1] I0719 08:18:29.679238       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6633698Z [cluster1] I0719 08:18:29.689462       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6636489Z [cluster1] I0719 08:18:29.690069       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6638110Z [cluster1] I0719 08:18:29.690254       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6640485Z [cluster1] I0719 08:18:29.703664       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6642822Z [cluster1] I0719 08:18:29.705441       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6644546Z [cluster1] I0719 08:18:29.705560       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6647823Z [cluster1] I0719 08:18:29.738010       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6652111Z [cluster1] I0719 08:18:29.738619       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6656200Z [cluster1] I0719 08:18:29.762794       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6661437Z [cluster1] I0719 08:18:29.763158       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6665514Z [cluster1] I0719 08:18:30.172927       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6668792Z [cluster1] I0719 08:18:30.269992       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6673641Z [cluster1] I0719 08:18:30.273379       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6677399Z [cluster1] I0719 08:18:30.277479       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6680089Z [cluster1] I0719 08:18:30.291324       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6686097Z [cluster1] I0719 08:18:30.291510       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6691014Z [cluster1] I0719 08:18:30.314664       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6694842Z [cluster1] I0719 08:18:30.325775       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6700702Z [cluster1] I0719 08:18:30.697392       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6707751Z [cluster1] I0719 08:18:30.727689       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6711815Z [cluster1] I0719 08:18:30.819990       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6718713Z [cluster1] I0719 08:18:30.831433       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.6723899Z [cluster1] I0719 08:18:30.843381       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6739274Z [cluster1] I0719 08:18:31.247742       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6743581Z [cluster1] I0719 08:18:31.260624       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T08:19:17.6746759Z [cluster1] I0719 08:18:31.293780       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6750361Z [cluster1] I0719 08:18:31.695483       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6753542Z [cluster1] I0719 08:18:31.697517       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6759303Z [cluster1] I0719 08:18:31.697578       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.97.167\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n\n"
2021-07-19T08:19:17.6763886Z [cluster1] I0719 08:18:41.333373       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6768268Z [cluster1] I0719 08:18:41.334032       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6771634Z [cluster1] I0719 08:18:41.334216       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6775168Z [cluster1] I0719 08:18:41.342538       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6780257Z [cluster1] I0719 08:18:41.346050       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6783960Z [cluster1] I0719 08:18:41.747994       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6787213Z [cluster1] I0719 08:18:41.751900       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6790586Z [cluster1] I0719 08:18:41.759226       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6793831Z [cluster1] I0719 08:18:41.764803       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6806431Z [cluster1] I0719 08:18:42.166691       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6809207Z [cluster1] I0719 08:18:42.174459       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6810953Z [cluster1] I0719 08:18:42.174629       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6812256Z [cluster1] I0719 08:18:42.174698       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6814610Z [cluster1] I0719 08:18:42.191913       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6817126Z [cluster1] I0719 08:18:42.193149       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6818664Z [cluster1] I0719 08:18:42.197375       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6819969Z [cluster1] I0719 08:18:42.197521       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6822336Z [cluster1] I0719 08:18:42.202979       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6825466Z [cluster1] I0719 08:18:42.244904       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6828519Z [cluster1] I0719 08:18:42.258801       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6831524Z [cluster1] I0719 08:18:42.605101       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6834493Z [cluster1] I0719 08:18:42.608016       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6837526Z [cluster1] I0719 08:18:42.610622       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6840575Z [cluster1] I0719 08:18:42.613647       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6843643Z [cluster1] I0719 08:18:42.661061       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6847133Z [cluster1] I0719 08:18:42.664019       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6850665Z [cluster1] I0719 08:18:42.667164       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6853980Z [cluster1] I0719 08:18:42.670208       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6857262Z [cluster1] I0719 08:18:43.015073       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6860402Z [cluster1] I0719 08:18:43.077237       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6862874Z [cluster1] I0719 08:18:46.351443       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6864436Z [cluster1] I0719 08:18:46.351498       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6865722Z [cluster1] I0719 08:18:46.351509       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6869359Z [cluster1] I0719 08:18:46.355879       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6872650Z [cluster1] I0719 08:18:46.360024       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6875869Z [cluster1] I0719 08:18:46.766742       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6879544Z [cluster1] I0719 08:18:46.772872       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6883718Z [cluster1] I0719 08:18:46.776437       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6889348Z [cluster1] I0719 08:18:46.779994       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6893251Z [cluster1] I0719 08:18:47.181713       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6897366Z [cluster1] I0719 08:18:47.191777       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6899075Z [cluster1] I0719 08:18:47.191944       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6900960Z [cluster1] I0719 08:18:47.192036       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6902524Z [cluster1] I0719 08:18:47.192106       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6903815Z [cluster1] I0719 08:18:47.192189       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6905686Z [cluster1] I0719 08:18:47.192322       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6908237Z [cluster1] I0719 08:18:47.198207       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6911259Z [cluster1] I0719 08:18:47.204604       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6914391Z [cluster1] I0719 08:18:47.220111       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6917420Z [cluster1] I0719 08:18:47.226492       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6920446Z [cluster1] I0719 08:18:47.606290       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6924291Z [cluster1] I0719 08:18:47.609253       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6928146Z [cluster1] I0719 08:18:47.612407       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6931463Z [cluster1] I0719 08:18:47.615791       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6934493Z [cluster1] I0719 08:18:47.629361       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6937492Z [cluster1] I0719 08:18:47.632212       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6940626Z [cluster1] I0719 08:18:47.634883       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6944883Z [cluster1] I0719 08:18:47.637729       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6947530Z [cluster1] I0719 08:18:48.017696       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6950077Z [cluster1] I0719 08:18:48.039223       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6952608Z [cluster1] I0719 08:18:51.371793       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6953976Z [cluster1] I0719 08:18:51.372013       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6955118Z [cluster1] I0719 08:18:51.372103       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6958028Z [cluster1] I0719 08:18:51.384080       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6960668Z [cluster1] I0719 08:18:51.387360       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6963886Z [cluster1] I0719 08:18:51.789117       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6966666Z [cluster1] I0719 08:18:51.793236       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6970955Z [cluster1] I0719 08:18:51.800472       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6974678Z [cluster1] I0719 08:18:51.804675       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.6979268Z [cluster1] I0719 08:18:52.206703       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.6982285Z [cluster1] I0719 08:18:52.212851       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6984207Z [cluster1] I0719 08:18:52.213505       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6985689Z [cluster1] I0719 08:18:52.213591       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6988518Z [cluster1] I0719 08:18:52.215136       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.6990337Z [cluster1] I0719 08:18:52.215185       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.6991634Z [cluster1] I0719 08:18:52.215197       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.6994942Z [cluster1] I0719 08:18:52.219535       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.6998232Z [cluster1] I0719 08:18:52.223647       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7001637Z [cluster1] I0719 08:18:52.239120       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7005365Z [cluster1] I0719 08:18:52.249519       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7009265Z [cluster1] I0719 08:18:52.628450       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7012348Z [cluster1] I0719 08:18:52.632274       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7015649Z [cluster1] I0719 08:18:52.636421       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7019485Z [cluster1] I0719 08:18:52.645371       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7023269Z [cluster1] I0719 08:18:52.659285       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7026665Z [cluster1] I0719 08:18:52.664311       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7029837Z [cluster1] I0719 08:18:52.671274       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7032537Z [cluster1] I0719 08:18:52.674502       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7035685Z [cluster1] I0719 08:18:53.047184       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7039223Z [cluster1] I0719 08:18:53.075772       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7041923Z [cluster1] I0719 08:18:56.394085       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7044194Z [cluster1] I0719 08:18:56.394164       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7045753Z [cluster1] I0719 08:18:56.394175       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7048254Z [cluster1] I0719 08:18:56.405118       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7051188Z [cluster1] I0719 08:18:56.416642       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7054452Z [cluster1] I0719 08:18:56.818308       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7057716Z [cluster1] I0719 08:18:56.829980       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7061524Z [cluster1] I0719 08:18:56.833409       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7065123Z [cluster1] I0719 08:18:56.836815       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7083721Z [cluster1] I0719 08:18:57.243545       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7087049Z [cluster1] I0719 08:18:57.265601       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7088907Z [cluster1] I0719 08:18:57.265671       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7090216Z [cluster1] I0719 08:18:57.265681       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7092150Z [cluster1] I0719 08:18:57.272342       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7094461Z [cluster1] I0719 08:18:57.272388       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7096145Z [cluster1] I0719 08:18:57.272413       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7098716Z [cluster1] I0719 08:18:57.288829       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7101957Z [cluster1] I0719 08:18:57.291352       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7104965Z [cluster1] I0719 08:18:57.304763       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7108497Z [cluster1] I0719 08:18:57.304784       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7111565Z [cluster1] I0719 08:18:57.706965       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7114756Z [cluster1] I0719 08:18:57.707446       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7118445Z [cluster1] I0719 08:18:57.712720       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7121811Z [cluster1] I0719 08:18:57.715610       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7127394Z [cluster1] I0719 08:18:57.716401       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7130478Z [cluster1] I0719 08:18:57.724085       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7135210Z [cluster1] I0719 08:18:57.725269       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7139114Z [cluster1] I0719 08:18:57.739157       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7142463Z [cluster1] I0719 08:18:58.126096       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7145635Z [cluster1] I0719 08:18:58.140216       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7149349Z [cluster1] I0719 08:19:01.424857       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7151044Z [cluster1] I0719 08:19:01.425098       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7152449Z [cluster1] I0719 08:19:01.425398       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7155106Z [cluster1] I0719 08:19:01.434251       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7158552Z [cluster1] I0719 08:19:01.439206       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7161572Z [cluster1] I0719 08:19:01.847079       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7165781Z [cluster1] I0719 08:19:01.853661       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7169062Z [cluster1] I0719 08:19:01.858013       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7172382Z [cluster1] I0719 08:19:01.863586       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7175639Z [cluster1] I0719 08:19:02.265031       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7178314Z [cluster1] I0719 08:19:02.272311       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7180107Z [cluster1] I0719 08:19:02.272385       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7181502Z [cluster1] I0719 08:19:02.272403       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7183506Z [cluster1] I0719 08:19:02.272921       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7185426Z [cluster1] I0719 08:19:02.272999       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7187396Z [cluster1] I0719 08:19:02.273043       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7191566Z [cluster1] I0719 08:19:02.278142       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7194829Z [cluster1] I0719 08:19:02.279028       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7198077Z [cluster1] I0719 08:19:02.282249       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7201590Z [cluster1] I0719 08:19:02.282504       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7204593Z [cluster1] I0719 08:19:02.683741       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7207691Z [cluster1] I0719 08:19:02.684860       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7210671Z [cluster1] I0719 08:19:02.688681       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7213706Z [cluster1] I0719 08:19:02.689067       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7218277Z [cluster1] I0719 08:19:02.692585       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7222382Z [cluster1] I0719 08:19:02.693091       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7236263Z [cluster1] I0719 08:19:02.696646       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7241028Z [cluster1] I0719 08:19:02.696774       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7244181Z [cluster1] I0719 08:19:03.099127       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7248398Z [cluster1] I0719 08:19:03.099406       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7251579Z [cluster1] I0719 08:19:06.477941       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7253153Z [cluster1] I0719 08:19:06.478685       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7259728Z [cluster1] I0719 08:19:06.478930       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7262451Z [cluster1] I0719 08:19:06.492785       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7265480Z [cluster1] I0719 08:19:06.512883       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7268503Z [cluster1] I0719 08:19:06.917033       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7271491Z [cluster1] I0719 08:19:06.920447       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7274832Z [cluster1] I0719 08:19:06.934914       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7278124Z [cluster1] I0719 08:19:06.946254       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7281412Z [cluster1] I0719 08:19:07.347954       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7285439Z [cluster1] I0719 08:19:07.375215       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7287269Z [cluster1] I0719 08:19:07.375277       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7288685Z [cluster1] I0719 08:19:07.375288       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7290750Z [cluster1] I0719 08:19:07.375804       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7292960Z [cluster1] I0719 08:19:07.375835       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7294706Z [cluster1] I0719 08:19:07.375844       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7307990Z [cluster1] I0719 08:19:07.389693       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7311243Z [cluster1] I0719 08:19:07.393564       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7316084Z [cluster1] I0719 08:19:07.407496       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7319657Z [cluster1] I0719 08:19:07.425670       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7322882Z [cluster1] I0719 08:19:07.812936       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7326283Z [cluster1] I0719 08:19:07.825063       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7329317Z [cluster1] I0719 08:19:07.827628       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7333089Z [cluster1] I0719 08:19:07.830507       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7336613Z [cluster1] I0719 08:19:07.836091       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7339978Z [cluster1] I0719 08:19:07.842013       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7343414Z [cluster1] I0719 08:19:07.845559       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7347389Z [cluster1] I0719 08:19:07.860884       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7350730Z [cluster1] I0719 08:19:08.238104       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7354152Z [cluster1] I0719 08:19:08.262791       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7356842Z [cluster1] I0719 08:19:11.516241       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7358522Z [cluster1] I0719 08:19:11.517678       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7359934Z [cluster1] I0719 08:19:11.517852       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7363505Z [cluster1] I0719 08:19:11.525294       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7366993Z [cluster1] I0719 08:19:11.529572       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7370294Z [cluster1] I0719 08:19:11.931175       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7376636Z [cluster1] I0719 08:19:11.935068       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7380689Z [cluster1] I0719 08:19:11.937699       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7384010Z [cluster1] I0719 08:19:11.941363       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7387289Z [cluster1] I0719 08:19:12.345941       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7390673Z [cluster1] I0719 08:19:12.354325       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7392565Z [cluster1] I0719 08:19:12.354383       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7393992Z [cluster1] I0719 08:19:12.354395       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7396044Z [cluster1] I0719 08:19:12.362741       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7397716Z [cluster1] I0719 08:19:12.362918       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7399121Z [cluster1] I0719 08:19:12.363003       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7401640Z [cluster1] I0719 08:19:12.364051       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7404828Z [cluster1] I0719 08:19:12.371183       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7410456Z [cluster1] I0719 08:19:12.378330       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7414915Z [cluster1] I0719 08:19:12.379187       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7417905Z [cluster1] I0719 08:19:12.779805       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7421897Z [cluster1] I0719 08:19:12.782146       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7424947Z [cluster1] I0719 08:19:12.784728       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7427993Z [cluster1] I0719 08:19:12.787973       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7430985Z [cluster1] I0719 08:19:12.790729       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7434018Z [cluster1] I0719 08:19:12.795835       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7437946Z [cluster1] I0719 08:19:12.797745       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7441158Z [cluster1] I0719 08:19:12.815724       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7444227Z [cluster1] I0719 08:19:13.199518       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7447644Z [cluster1] I0719 08:19:13.217747       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7450112Z [cluster1] I0719 08:19:16.549080       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:17.7451653Z [cluster1] I0719 08:19:16.549137       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:17.7452965Z [cluster1] I0719 08:19:16.549160       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:17.7455379Z [cluster1] I0719 08:19:16.554205       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7458412Z [cluster1] I0719 08:19:16.564701       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:17.7461416Z [cluster1] I0719 08:19:16.966406       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:17.7464275Z [cluster1] I0719 08:19:16.974282       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7466915Z [cluster1] I0719 08:19:16.984946       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:17.7469587Z [cluster1] I0719 08:19:16.992388       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:18.3469260Z [cluster1] I0719 08:19:17.394106       1 metrics.go:55] controller_sted existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:18.3471912Z [cluster2] I0719 08:19:15.729531       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:18.3475631Z [cluster2] I0719 08:19:15.735317       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:18.3478869Z [cluster2] I0719 08:19:15.757969       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:18.3481718Z [cluster2] I0719 08:19:15.760870       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:18.3485811Z [cluster2] I0719 08:19:15.766283       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:18.3489135Z [cluster2] I0719 08:19:16.137411       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:18.3492436Z [cluster2] I0719 08:19:16.169026       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:18.3494632Z [36m[submariner-operator]$ [cluster2] verify_subm_cr[0m
2021-07-19T08:19:18.3495640Z [36m[submariner-operator]$ [cluster2] verify_subm_cr[0m
2021-07-19T08:19:18.3497442Z [36m[submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator[0m
2021-07-19T08:19:18.3498868Z [36m[submariner-operator]$ [cluster2] grep submariner[0m
2021-07-19T08:19:18.3500193Z [36m[submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator[0m
2021-07-19T08:19:18.3501871Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner --namespace=submariner-operator[0m
2021-07-19T08:19:18.3502911Z [cluster2] submariner   74s
2021-07-19T08:19:18.3503981Z [36m[submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json[0m
2021-07-19T08:19:18.3505565Z [36m[submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-19T08:19:18.3507506Z [36m[submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-19T08:19:18.3509421Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-19T08:19:18.3511065Z [36m[submariner-operator]$ [cluster2] tee /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:18.3511856Z [cluster2] {
2021-07-19T08:19:18.3512527Z [cluster2]     "apiVersion": "submariner.io/v1alpha1",
2021-07-19T08:19:18.3513137Z [cluster2]     "kind": "Submariner",
2021-07-19T08:19:18.3513644Z [cluster2]     "metadata": {
2021-07-19T08:19:18.3514390Z [cluster2]         "creationTimestamp": "2021-07-19T08:18:03Z",
2021-07-19T08:19:18.3514995Z [cluster2]         "generation": 1,
2021-07-19T08:19:18.3515515Z [cluster2]         "name": "submariner",
2021-07-19T08:19:18.3516626Z [cluster2]         "namespace": "submariner-operator",
2021-07-19T08:19:18.3517343Z [cluster2]         "resourceVersion": "2223",
2021-07-19T08:19:18.3518564Z [cluster2]         "selfLink": "/apis/submariner.io/v1alpha1/namespaces/submariner-operator/submariners/submariner",
2021-07-19T08:19:18.3519784Z [cluster2]         "uid": "d5601a4c-7db1-4071-bb5b-86051d9e4027"
2021-07-19T08:19:18.3520347Z [cluster2]     },
2021-07-19T08:19:18.3520920Z [cluster2]     "spec": {
2021-07-19T08:19:18.3521403Z [cluster2]         "broker": "k8s",
2021-07-19T08:19:18.3522090Z [cluster2]         "brokerK8sApiServer": "172.18.0.6:6443",
2021-07-19T08:19:18.3672145Z [cluster2]         "brokerK8sApiServerToken": "***",
2021-07-19T08:19:18.4289722Z [cluster2]         "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEE0TVRFeE1Gb1hEVE14TURjeE56QTRNVEV4TUZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHdICnF5a0h5TFhlRmFUZmNoNlNRb25iL0FqTUNOZ21tVUZvS0duc1JwdWlEem03Q1ZtcDdtUlJQUkQ4SEN2dThUOTcKcHFTVjFRYmNaTWFuMXFhZGhRQlhxWFVnRGlqQXhBN0ZzMlZzcjZZNEU2b2NiTWZOMXZPVDNrMkRZUFE0MVhHcQpucmVYSjdpQzVYT0VKK0ZlUTNKL0RZK3JmUk4vUmh1Um9icHV2eWFqQnB5QzEyWWpvb2ZpWEVURGhDTjNUcWxlCnMvNGJPSE00dTBGWEhESERvZkE2SmRaVnFYYkZpcytLZUJBL2VobkJ6Y2t1ekpYcTlFOVhtZVRFUFNlMG00N3kKT1RMVTFabHFobStIdDl4dWViWEpiWFozamF4dHgvRGoxeVRnQk8xZUpINzFWRW5VdTRObjhNQUxuZU8rbklaeApFV0Z4NHdEalIvN081WEdxdnYwQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFET3ExSFZHbHJxdGNjYy9ZbUc1ZnVJWGdkb2MKK3huOGhKRjJiOUNiQU5rR2syVmJ5dmNRUzgwNU9wcHJmN2JnSEF2UmI5cjJXVmZPYzBBdHI4L3d3d2FOaEZYawpRMkhJcVo0SlhoZEg4S2pFbTFEekM3ODYvRDBUUEZOcGJ1MCtuQk00Z0JwTk1Ed3QzUlludldiZUQ0OFdGS1hDCk1DUi82Vk8rRk5nRk9kaTVVbVBqQlA4Z1ljTDZudHNTa0poY04rUE9WTm9sVklaVHIxWitmcnphRE9ya1VNZEcKNDI3SWppem0zU3NtUWJaZ0pjcW1aVTZPbEx3M05UcXQwNEl3bmRUaFJ4cU1WWC9BYVhXZlRtSVducDZYZmVCWApKbEZJWDg0UFFoTE9Sd3ZObEQrazMrWUsralM5cDlPT1c3TFpnUEUvdUhKbU8rUmZONUwzRE1hTEJ3QT0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=",
2021-07-19T08:19:18.4824581Z [cluster2]         "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-19T08:19:18.4825503Z [cluster2]         "cableDriver": "libreswan",
2021-07-19T08:19:18.4826120Z [cluster2]         "ceIPSecDebug": false,
2021-07-19T08:19:18.4826696Z [cluster2]         "ceIPSecIKEPort": 500,
2021-07-19T08:19:18.4827322Z [cluster2]         "ceIPSecNATTPort": 4500,
2021-07-19T08:19:18.4828310Z [cluster2]         "ceIPSecPSK": "sZFmVdfOnB40qkFDBi+EKA8Sv/Rw5SH3O/wsoAds+gvpgX54HYhmQ5Xbu/I5QYTn",
2021-07-19T08:19:18.4829254Z [cluster2]         "clusterCIDR": "",
2021-07-19T08:19:18.4829788Z [cluster2]         "clusterID": "cluster2",
2021-07-19T08:19:18.4830339Z [cluster2]         "colorCodes": "blue",
2021-07-19T08:19:18.4830977Z [cluster2]         "connectionHealthCheck": {
2021-07-19T08:19:18.4831585Z [cluster2]             "enabled": true,
2021-07-19T08:19:18.4832138Z [cluster2]             "intervalSeconds": 1,
2021-07-19T08:19:18.4832975Z [cluster2]             "maxPacketLossCount": 5
2021-07-19T08:19:18.4833541Z [cluster2]         },
2021-07-19T08:19:18.4834002Z [cluster2]         "debug": false,
2021-07-19T08:19:18.4834546Z [cluster2]         "globalCIDR": "242.254.2.0/24",
2021-07-19T08:19:18.4835434Z [cluster2]         "namespace": "submariner-operator",
2021-07-19T08:19:18.4836544Z [cluster2]         "natEnabled": false,
2021-07-19T08:19:18.4837161Z [cluster2]         "repository": "localhost:5000",
2021-07-19T08:19:18.4837773Z [cluster2]         "serviceCIDR": "",
2021-07-19T08:19:18.4838500Z [cluster2]         "serviceDiscoveryEnabled": true,
2021-07-19T08:19:18.4839737Z [cluster2]         "version": "local"
2021-07-19T08:19:18.4840219Z [cluster2]     },
2021-07-19T08:19:18.4840646Z [cluster2]     "status": {
2021-07-19T08:19:18.4841665Z [cluster2]         "clusterCIDR": "10.0.0.0/16",
2021-07-19T08:19:18.4842404Z [cluster2]         "clusterID": "cluster2",
2021-07-19T08:19:18.4843014Z [cluster2]         "colorCodes": "blue",
2021-07-19T08:19:18.4843622Z [cluster2]         "deploymentInfo": {},
2021-07-19T08:19:18.4844329Z [cluster2]         "gatewayDaemonSetStatus": {
2021-07-19T08:19:18.4845834Z [cluster2]             "lastResourceVersion": "2022",
2021-07-19T08:19:18.4846815Z [cluster2]             "mismatchedContainerImages": false,
2021-07-19T08:19:18.4847720Z [cluster2]             "nonReadyContainerStates": [],
2021-07-19T08:19:18.4848616Z [cluster2]             "status": {
2021-07-19T08:19:18.4849300Z [cluster2]                 "currentNumberScheduled": 1,
2021-07-19T08:19:18.4850113Z [cluster2]                 "desiredNumberScheduled": 1,
2021-07-19T08:19:18.4850853Z [cluster2]                 "numberAvailable": 1,
2021-07-19T08:19:18.4851522Z [cluster2]                 "numberMisscheduled": 0,
2021-07-19T08:19:18.4852178Z [cluster2]                 "numberReady": 1,
2021-07-19T08:19:18.4852922Z [cluster2]                 "observedGeneration": 1,
2021-07-19T08:19:18.4858190Z [cluster2]                 "updatedNumberScheduled": 1
2021-07-19T08:19:18.4859014Z [cluster2]             }
2021-07-19T08:19:18.4859394Z [cluster2]         },
2021-07-19T08:19:18.4859826Z [cluster2]         "gateways": [
2021-07-19T08:19:18.4860240Z [cluster2]             {
2021-07-19T08:19:18.4860701Z [cluster2]                 "connections": [
2021-07-19T08:19:18.4861158Z [cluster2]                     {
2021-07-19T08:19:18.4861642Z [cluster2]                         "endpoint": {
2021-07-19T08:19:18.4862174Z [cluster2]                             "backend": "libreswan",
2021-07-19T08:19:18.4862919Z [cluster2]                             "backend_config": {
2021-07-19T08:19:18.4864090Z [cluster2]                                 "natt-discovery-port": "4490",
2021-07-19T08:19:18.4865313Z [cluster2]                                 "preferred-server": "false"
2021-07-19T08:19:18.4865928Z [cluster2]                             },
2021-07-19T08:19:18.4867072Z [cluster2]                             "cable_name": "submariner-cable-cluster1-172-18-0-5",
2021-07-19T08:19:18.4868156Z [cluster2]                             "cluster_id": "cluster1",
2021-07-19T08:19:18.4869000Z [cluster2]                             "healthCheckIP": "242.254.1.254",
2021-07-19T08:19:18.4869892Z [cluster2]                             "hostname": "cluster1-worker",
2021-07-19T08:19:18.4870526Z [cluster2]                             "nat_enabled": false,
2021-07-19T08:19:18.4871072Z [cluster2]                             "private_ip": "172.18.0.5",
2021-07-19T08:19:18.4871606Z [cluster2]                             "public_ip": "20.97.61.213",
2021-07-19T08:19:18.4872098Z [cluster2]                             "subnets": [
2021-07-19T08:19:18.4872582Z [cluster2]                                 "242.254.1.0/24"
2021-07-19T08:19:18.4873011Z [cluster2]                             ]
2021-07-19T08:19:18.4873438Z [cluster2]                         },
2021-07-19T08:19:18.4873901Z [cluster2]                         "latencyRTT": {
2021-07-19T08:19:18.4874634Z [cluster2]                             "average": "190.771µs",
2021-07-19T08:19:18.4875299Z [cluster2]                             "last": "167.313µs",
2021-07-19T08:19:18.4876275Z [cluster2]                             "max": "300.423µs",
2021-07-19T08:19:18.4876968Z [cluster2]                             "min": "135.61µs",
2021-07-19T08:19:18.4877605Z [cluster2]                             "stdDev": "43.237µs"
2021-07-19T08:19:18.4878080Z [cluster2]                         },
2021-07-19T08:19:18.4878560Z [cluster2]                         "status": "connected",
2021-07-19T08:19:18.4879142Z [cluster2]                         "statusMessage": "",
2021-07-19T08:19:18.4879670Z [cluster2]                         "usingIP": "172.18.0.5"
2021-07-19T08:19:18.4880124Z [cluster2]                     }
2021-07-19T08:19:18.4880516Z [cluster2]                 ],
2021-07-19T08:19:18.4880989Z [cluster2]                 "haStatus": "active",
2021-07-19T08:19:18.4881541Z [cluster2]                 "localEndpoint": {
2021-07-19T08:19:18.4882102Z [cluster2]                     "backend": "libreswan",
2021-07-19T08:19:18.4882649Z [cluster2]                     "backend_config": {
2021-07-19T08:19:18.4883417Z [cluster2]                         "natt-discovery-port": "4490",
2021-07-19T08:19:18.4884263Z [cluster2]                         "preferred-server": "false"
2021-07-19T08:19:18.4884808Z [cluster2]                     },
2021-07-19T08:19:18.4901072Z [cluster2]                     "cable_name": "submariner-cable-cluster2-172-18-0-7",
2021-07-19T08:19:18.4901994Z [cluster2]                     "cluster_id": "cluster2",
2021-07-19T08:19:18.4902998Z [cluster2]                     "hostname": "cluster2-worker",
2021-07-19T08:19:18.4903665Z [cluster2]                     "nat_enabled": false,
2021-07-19T08:19:18.4904239Z [cluster2]                     "private_ip": "172.18.0.7",
2021-07-19T08:19:18.4904798Z [cluster2]                     "public_ip": "20.97.61.213",
2021-07-19T08:19:18.4905311Z [cluster2]                     "subnets": [
2021-07-19T08:19:18.4905814Z [cluster2]                         "242.254.2.0/24"
2021-07-19T08:19:18.4906253Z [cluster2]                     ]
2021-07-19T08:19:18.4906693Z [cluster2]                 },
2021-07-19T08:19:18.4907206Z [cluster2]                 "statusFailure": "",
2021-07-19T08:19:18.4908007Z [cluster2]                 "version": "devel-1441a80"
2021-07-19T08:19:18.4908531Z [cluster2]             }
2021-07-19T08:19:18.4908944Z [cluster2]         ],
2021-07-19T08:19:18.4909440Z [cluster2]         "globalCIDR": "242.254.2.0/24",
2021-07-19T08:19:18.4910157Z [cluster2]         "globalnetDaemonSetStatus": {
2021-07-19T08:19:18.4910970Z [cluster2]             "lastResourceVersion": "1978",
2021-07-19T08:19:18.4912184Z [cluster2]             "mismatchedContainerImages": false,
2021-07-19T08:19:18.4913429Z [cluster2]             "nonReadyContainerStates": [],
2021-07-19T08:19:18.4914086Z [cluster2]             "status": {
2021-07-19T08:19:18.4914849Z [cluster2]                 "currentNumberScheduled": 1,
2021-07-19T08:19:18.4915788Z [cluster2]                 "desiredNumberScheduled": 1,
2021-07-19T08:19:18.4918544Z [cluster2]                 "numberAvailable": 1,
2021-07-19T08:19:18.4919235Z [cluster2]                 "numberMisscheduled": 0,
2021-07-19T08:19:18.4919861Z [cluster2]                 "numberReady": 1,
2021-07-19T08:19:18.4920508Z [cluster2]                 "observedGeneration": 1,
2021-07-19T08:19:18.4921278Z [cluster2]                 "updatedNumberScheduled": 1
2021-07-19T08:19:18.4921929Z [cluster2]             }
2021-07-19T08:19:18.4922342Z [cluster2]         },
2021-07-19T08:19:18.4922903Z [cluster2]         "loadBalancerStatus": {},
2021-07-19T08:19:18.4923533Z [cluster2]         "natEnabled": false,
2021-07-19T08:19:18.4924577Z [cluster2]         "networkPlugin": "weave-net",
2021-07-19T08:19:18.4925479Z [cluster2]         "routeAgentDaemonSetStatus": {
2021-07-19T08:19:18.4926241Z [cluster2]             "lastResourceVersion": "2059",
2021-07-19T08:19:18.4927031Z [cluster2]             "mismatchedContainerImages": false,
2021-07-19T08:19:18.4927850Z [cluster2]             "nonReadyContainerStates": [],
2021-07-19T08:19:18.4928465Z [cluster2]             "status": {
2021-07-19T08:19:18.4929058Z [cluster2]                 "currentNumberScheduled": 3,
2021-07-19T08:19:18.4929824Z [cluster2]                 "desiredNumberScheduled": 3,
2021-07-19T08:19:18.5497667Z [cluster2ubmariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T08:19:18.5500209Z [cluster1] I0719 08:19:17.412318       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:18.5501781Z [cluster1] I0719 08:19:17.412425       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:18.5503100Z [cluster1] I0719 08:19:17.412485       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:18.5504940Z [cluster1] I0719 08:19:17.413590       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T08:19:18.5506717Z [cluster1] I0719 08:19:17.413637       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T08:19:18.5508036Z [cluster1] I0719 08:19:17.413648       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T08:19:18.5510414Z [cluster1] I0719 08:19:17.418371       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:18.5513411Z [cluster1] I0719 08:19:17.419325       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T08:19:18.5517468Z [cluster1] I0719 08:19:17.421729       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:18.5521025Z [cluster1] I0719 08:19:17.428873       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T08:19:18.5523249Z [36m[submariner-operator]$ [cluster1] verify_subm_cr[0m
2021-07-19T08:19:18.5524251Z [36m[submariner-operator]$ [cluster1] verify_subm_cr[0m
2021-07-19T08:19:18.5526070Z [36m[submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator[0m
2021-07-19T08:19:18.5527346Z [36m[submariner-operator]$ [cluster1] grep submariner[0m
2021-07-19T08:19:18.5528667Z [36m[submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator[0m
2021-07-19T08:19:18.5530334Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner --namespace=submariner-operator[0m
2021-07-19T08:19:18.5531370Z [cluster1] submariner   81s
2021-07-19T08:19:18.5532457Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json[0m
2021-07-19T08:19:18.5534021Z [36m[submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-19T08:19:18.5535539Z [36m[submariner-operator]$ [cluster1] tee /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:18.5553992Z [36m[submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-19T08:19:18.5555878Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-19T08:19:18.5557808Z [cluster1] {
2021-07-19T08:19:18.5558435Z [cluster1]     "apiVersion": "submariner.io/v1alpha1",
2021-07-19T08:19:18.5559109Z [cluster1]     "kind": "Submariner",
2021-07-19T08:19:18.5559624Z [cluster1]     "metadata": {
2021-07-19T08:19:18.5560499Z [cluster1]         "creationTimestamp": "2021-07-19T08:17:57Z",
2021-07-19T08:19:18.5561125Z [cluster1]         "generation": 1,
2021-07-19T08:19:18.5561680Z [cluster1]         "name": "submariner",
2021-07-19T08:19:18.5562532Z [cluster1]         "namespace": "submariner-operator",
2021-07-19T08:19:18.5563275Z [cluster1]         "resourceVersion": "2350",
2021-07-19T08:19:18.5564542Z [cluster1]         "selfLink": "/apis/submariner.io/v1alpha1/namespaces/submariner-operator/submariners/submariner",
2021-07-19T08:19:18.5566681Z [cluster1]         "uid": "ecdca792-3f86-4619-87d3-60356e7860e2"
2021-07-19T08:19:18.5567330Z [cluster1]     },
2021-07-19T08:19:18.5567757Z [cluster1]     "spec": {
2021-07-19T08:19:18.5568240Z [cluster1]         "broker": "k8s",
2021-07-19T08:19:18.5569127Z [cluster1]         "brokerK8sApiServer": "172.18.0.6:6443",
2021-07-19T08:19:18.5792221Z [cluster1]         "brokerK8sApiServerToken": "***",
2021-07-19T08:19:18.6317633Z [cluster1]         "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEE0TVRFeE1Gb1hEVE14TURjeE56QTRNVEV4TUZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHdICnF5a0h5TFhlRmFUZmNoNlNRb25iL0FqTUNOZ21tVUZvS0duc1JwdWlEem03Q1ZtcDdtUlJQUkQ4SEN2dThUOTcKcHFTVjFRYmNaTWFuMXFhZGhRQlhxWFVnRGlqQXhBN0ZzMlZzcjZZNEU2b2NiTWZOMXZPVDNrMkRZUFE0MVhHcQpucmVYSjdpQzVYT0VKK0ZlUTNKL0RZK3JmUk4vUmh1Um9icHV2eWFqQnB5QzEyWWpvb2ZpWEVURGhDTjNUcWxlCnMvNGJPSE00dTBGWEhESERvZkE2SmRaVnFYYkZpcytLZUJBL2VobkJ6Y2t1ekpYcTlFOVhtZVRFUFNlMG00N3kKT1RMVTFabHFobStIdDl4dWViWEpiWFozamF4dHgvRGoxeVRnQk8xZUpINzFWRW5VdTRObjhNQUxuZU8rbklaeApFV0Z4NHdEalIvN081WEdxdnYwQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFET3ExSFZHbHJxdGNjYy9ZbUc1ZnVJWGdkb2MKK3huOGhKRjJiOUNiQU5rR2syVmJ5dmNRUzgwNU9wcHJmN2JnSEF2UmI5cjJXVmZPYzBBdHI4L3d3d2FOaEZYawpRMkhJcVo0SlhoZEg4S2pFbTFEekM3ODYvRDBUUEZOcGJ1MCtuQk00Z0JwTk1Ed3QzUlludldiZUQ0OFdGS1hDCk1DUi82Vk8rRk5nRk9kaTVVbVBqQlA4Z1ljTDZudHNTa0poY04rUE9WTm9sVklaVHIxWitmcnphRE9ya1VNZEcKNDI3SWppem0zU3NtUWJaZ0pjcW1aVTZPbEx3M05UcXQwNEl3bmRUaFJ4cU1WWC9BYVhXZlRtSVducDZYZmVCWApKbEZJWDg0UFFoTE9Sd3ZObEQrazMrWUsralM5cDlPT1c3TFpnUEUvdUhKbU8rUmZONUwzRE1hTEJ3QT0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=",
2021-07-19T08:19:18.6848825Z [cluster1]         "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-19T08:19:18.6850168Z [cluster1]         "cableDriver": "libreswan",
2021-07-19T08:19:18.6850829Z [cluster1]         "ceIPSecDebug": false,
2021-07-19T08:19:18.6851579Z [cluster1]         "ceIPSecIKEPort": 500,
2021-07-19T08:19:18.6852274Z [cluster1]         "ceIPSecNATTPort": 4500,
2021-07-19T08:19:18.6855452Z [cluster1]         "ceIPSecPSK": "sZFmVdfOnB40qkFDBi+EKA8Sv/Rw5SH3O/wsoAds+gvpgX54HYhmQ5Xbu/I5QYTn",
2021-07-19T08:19:18.6856945Z [cluster1]         "clusterCIDR": "",
2021-07-19T08:19:18.6857380Z [cluster1]         "clusterID": "cluster1",
2021-07-19T08:19:18.6862231Z [cluster1]         "colorCodes": "blue",
2021-07-19T08:19:18.6862721Z [cluster1]         "connectionHealthCheck": {
2021-07-19T08:19:18.6863192Z [cluster1]             "enabled": true,
2021-07-19T08:19:18.6863601Z [cluster1]             "intervalSeconds": 1,
2021-07-19T08:19:18.6864084Z [cluster1]             "maxPacketLossCount": 5
2021-07-19T08:19:18.6864484Z [cluster1]         },
2021-07-19T08:19:18.6864824Z [cluster1]         "debug": false,
2021-07-19T08:19:18.6865209Z [cluster1]         "globalCIDR": "242.254.1.0/24",
2021-07-19T08:19:18.6866076Z [cluster1]         "namespace": "submariner-operator",
2021-07-19T08:19:18.6867881Z [cluster1]         "natEnabled": false,
2021-07-19T08:19:18.6868390Z [cluster1]         "repository": "localhost:5000",
2021-07-19T08:19:18.6868821Z [cluster1]         "serviceCIDR": "",
2021-07-19T08:19:18.6869335Z [cluster1]         "serviceDiscoveryEnabled": true,
2021-07-19T08:19:18.6869830Z [cluster1]         "version": "local"
2021-07-19T08:19:18.6870153Z [cluster1]     },
2021-07-19T08:19:18.6870467Z [cluster1]     "status": {
2021-07-19T08:19:18.6870843Z [cluster1]         "clusterCIDR": "10.0.0.0/16",
2021-07-19T08:19:18.6871250Z [cluster1]         "clusterID": "cluster1",
2021-07-19T08:19:18.6871665Z [cluster1]         "colorCodes": "blue",
2021-07-19T08:19:18.6872071Z [cluster1]         "deploymentInfo": {},
2021-07-19T08:19:18.6872578Z [cluster1]         "gatewayDaemonSetStatus": {
2021-07-19T08:19:18.6873115Z [cluster1]             "lastResourceVersion": "1983",
2021-07-19T08:19:18.6873713Z [cluster1]             "mismatchedContainerImages": false,
2021-07-19T08:19:18.6874333Z [cluster1]             "nonReadyContainerStates": [],
2021-07-19T08:19:18.6874801Z [cluster1]             "status": {
2021-07-19T08:19:18.6875257Z [cluster1]                 "currentNumberScheduled": 1,
2021-07-19T08:19:18.6876225Z [cluster1]                 "desiredNumberScheduled": 1,
2021-07-19T08:19:18.6876832Z [cluster1]                 "numberAvailable": 1,
2021-07-19T08:19:18.6877367Z [cluster1]                 "numberMisscheduled": 0,
2021-07-19T08:19:18.6877890Z [cluster1]                 "numberReady": 1,
2021-07-19T08:19:18.6878405Z [cluster1]                 "observedGeneration": 1,
2021-07-19T08:19:18.6879031Z [cluster1]                 "updatedNumberScheduled": 1
2021-07-19T08:19:18.6879524Z [cluster1]             }
2021-07-19T08:19:18.6879869Z [cluster1]         },
2021-07-19T08:19:18.6880240Z [cluster1]         "gateways": [
2021-07-19T08:19:18.6880620Z [cluster1]             {
2021-07-19T08:19:18.6881009Z [cluster1]                 "connections": [
2021-07-19T08:19:18.6881629Z [cluster1]                     {
2021-07-19T08:19:18.6882091Z [cluster1]                         "endpoint": {
2021-07-19T08:19:18.6882630Z [cluster1]                             "backend": "libreswan",
2021-07-19T08:19:18.6883192Z [cluster1]                             "backend_config": {
2021-07-19T08:19:18.6884134Z [cluster1]                                 "natt-discovery-port": "4490",
2021-07-19T08:19:18.6885189Z [cluster1]                                 "preferred-server": "false"
2021-07-19T08:19:18.6885745Z [cluster1]                             },
2021-07-19T08:19:18.6886788Z [cluster1]                             "cable_name": "submariner-cable-cluster2-172-18-0-7",
2021-07-19T08:19:18.6887752Z [cluster1]                             "cluster_id": "cluster2",
2021-07-19T08:19:18.6888463Z [cluster1]                             "hostname": "cluster2-worker",
2021-07-19T08:19:18.6889130Z [cluster1]                             "nat_enabled": false,
2021-07-19T08:19:18.6889596Z [cluster1]                             "private_ip": "172.18.0.7",
2021-07-19T08:19:18.6890064Z [cluster1]                             "public_ip": "20.97.61.213",
2021-07-19T08:19:18.6890714Z [cluster1]                             "subnets": [
2021-07-19T08:19:18.6891197Z [cluster1]                                 "242.254.2.0/24"
2021-07-19T08:19:18.6891616Z [cluster1]                             ]
2021-07-19T08:19:18.6892043Z [cluster1]                         },
2021-07-19T08:19:18.6892507Z [cluster1]                         "latencyRTT": {
2021-07-19T08:19:18.6893252Z [cluster1]                             "average": "222.714µs",
2021-07-19T08:19:18.6893929Z [cluster1]                             "last": "136.81µs",
2021-07-19T08:19:18.6894551Z [cluster1]                             "max": "796.862µs",
2021-07-19T08:19:18.6895197Z [cluster1]                             "min": "125.41µs",
2021-07-19T08:19:18.6895835Z [cluster1]                             "stdDev": "133.351µs"
2021-07-19T08:19:18.6896295Z [cluster1]                         },
2021-07-19T08:19:18.6896780Z [cluster1]                         "status": "connected",
2021-07-19T08:19:18.6897346Z [cluster1]                         "statusMessage": "",
2021-07-19T08:19:18.6897887Z [cluster1]                         "usingIP": "172.18.0.7"
2021-07-19T08:19:18.6898344Z [cluster1]                     }
2021-07-19T08:19:18.6898749Z [cluster1]                 ],
2021-07-19T08:19:18.6899211Z [cluster1]                 "haStatus": "active",
2021-07-19T08:19:18.6899759Z [cluster1]                 "localEndpoint": {
2021-07-19T08:19:18.6900308Z [cluster1]                     "backend": "libreswan",
2021-07-19T08:19:18.6900854Z [cluster1]                     "backend_config": {
2021-07-19T08:19:18.6902804Z [cluster1]                         "natt-discovery-port": "4490",
2021-07-19T08:19:18.6903905Z [cluster1]                         "preferred-server": "false"
2021-07-19T08:19:18.6904312Z [cluster1]                     },
2021-07-19T08:19:18.6905473Z [cluster1]                     "cable_name": "submariner-cable-cluster1-172-18-0-5",
2021-07-19T08:19:18.6906585Z [cluster1]                     "cluster_id": "cluster1",
2021-07-19T08:19:18.6907585Z [cluster1]                     "hostname": "cluster1-worker",
2021-07-19T08:19:18.6912940Z [cluster1]                     "nat_enabled": false,
2021-07-19T08:19:18.6913690Z [cluster1]                     "private_ip": "172.18.0.5",
2021-07-19T08:19:18.6914501Z [cluster1]                     "public_ip": "20.97.61.213",
2021-07-19T08:19:18.6915219Z [cluster1]                     "subnets": [
2021-07-19T08:19:18.6915964Z [cluster1]                         "242.254.1.0/24"
2021-07-19T08:19:18.6916621Z [cluster1]                     ]
2021-07-19T08:19:18.6917468Z [cluster1]                 },
2021-07-19T08:19:18.6917961Z [cluster1]                 "statusFailure": "",
2021-07-19T08:19:18.6920475Z [cluster1]                 "version": "devel-1441a80"
2021-07-19T08:19:18.6921224Z [cluster1]             }
2021-07-19T08:19:18.6921963Z [cluster1]         ],
2021-07-19T08:19:18.6922664Z [cluster1]         "globalCIDR": "242.254.1.0/24",
2021-07-19T08:19:18.6923696Z [cluster1]         "globalnetDaemonSetStatus": {
2021-07-19T08:19:18.6924821Z [cluster1]             "lastResourceVersion": "2075",
2021-07-19T08:19:18.6926768Z [cluster1]             "mismatchedContainerImages": false,
2021-07-19T08:19:18.6928207Z [cluster1]             "nonReadyContainerStates": [],
2021-07-19T08:19:18.6928943Z [cluster1]             "status": {
2021-07-19T08:19:18.6929480Z [cluster1]                 "currentNumberScheduled": 1,
2021-07-19T08:19:18.6930136Z [cluster1]                 "desiredNumberScheduled": 1,
2021-07-19T08:19:18.6930740Z [cluster1]                 "numberAvailable": 1,
2021-07-19T08:19:18.6931294Z [cluster1]                 "numberMisscheduled": 0,
2021-07-19T08:19:18.6931965Z [cluster1]                 "numberReady": 1,
2021-07-19T08:19:18.6932490Z [cluster1]                 "observedGeneration": 1,
2021-07-19T08:19:18.6933106Z [cluster1]                 "updatedNumberScheduled": 1
2021-07-19T08:19:18.6933610Z [cluster1]             }
2021-07-19T08:19:18.6933938Z [cluster1]         },
2021-07-19T08:19:18.6936627Z [cluster1]         "loadBalancerStatus": {},
2021-07-19T08:19:18.6937310Z [cluster1]         "natEnabled": false,
2021-07-19T08:19:18.6938129Z [cluster1]         "networkPlugin": "weave-net",
2021-07-19T08:19:18.6938790Z [cluster1]         "routeAgentDaemonSetStatus": {
2021-07-19T08:19:18.6939446Z [cluster1]             "lastResourceVersion": "2054",
2021-07-19T08:19:18.6940308Z [cluster1]             "mismatchedContainerImages": false,
2021-07-19T08:19:18.6941134Z [cluster1]             "nonReadyContainerStates": [],
2021-07-19T08:19:18.7823467Z [c]                 "numberAvailable": 3,
2021-07-19T08:19:18.7824091Z [cluster2]                 "numberMisscheduled": 0,
2021-07-19T08:19:18.7824881Z [cluster2]                 "numberReady": 3,
2021-07-19T08:19:18.7825483Z [cluster2]                 "observedGeneration": 1,
2021-07-19T08:19:18.7826193Z [cluster2]                 "updatedNumberScheduled": 3
2021-07-19T08:19:18.7826772Z [cluster2]             }
2021-07-19T08:19:18.7827150Z [cluster2]         },
2021-07-19T08:19:18.7827626Z [cluster2]         "serviceCIDR": "100.0.0.0/16"
2021-07-19T08:19:18.7828081Z [cluster2]     }
2021-07-19T08:19:18.7828461Z [cluster2] }
2021-07-19T08:19:18.7829856Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator[0m
2021-07-19T08:19:18.7831374Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator[0m
2021-07-19T08:19:18.7832918Z [36m[submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:18.7834348Z [36m[submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1[0m
2021-07-19T08:19:18.7836053Z [36m[submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1[0m
2021-07-19T08:19:18.7837511Z [36m[submariner-operator]$ [cluster2] jq -r -M .apiVersion /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:18.7838869Z [36m[submariner-operator]$ [cluster2] validate_equals .kind Submariner[0m
2021-07-19T08:19:18.7840278Z [36m[submariner-operator]$ [cluster2] validate_equals .kind Submariner[0m
2021-07-19T08:19:18.7841626Z [36m[submariner-operator]$ [cluster2] jq -r -M .kind /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:18.7843010Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name submariner[0m
2021-07-19T08:19:18.7844571Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name submariner[0m
2021-07-19T08:19:18.7846166Z [36m[submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:18.7847728Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443[0m
2021-07-19T08:19:18.7849129Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443[0m
2021-07-19T08:19:18.7850655Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:18.8112970Z [36m[submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-19T08:19:18.8279074Z [36m[submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-19T08:19:18.8756494Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.clusteluster1]             "status": {
2021-07-19T08:19:18.8760972Z [cluster1]                 "currentNumberScheduled": 3,
2021-07-19T08:19:18.8761817Z [cluster1]                 "desiredNumberScheduled": 3,
2021-07-19T08:19:18.8762555Z [cluster1]                 "numberAvailable": 3,
2021-07-19T08:19:18.8763244Z [cluster1]                 "numberMisscheduled": 0,
2021-07-19T08:19:18.8764150Z [cluster1]                 "numberReady": 3,
2021-07-19T08:19:18.8764797Z [cluster1]                 "observedGeneration": 1,
2021-07-19T08:19:18.8765927Z [cluster1]                 "updatedNumberScheduled": 3
2021-07-19T08:19:18.8766563Z [cluster1]             }
2021-07-19T08:19:18.8766979Z [cluster1]         },
2021-07-19T08:19:18.8767492Z [cluster1]         "serviceCIDR": "100.0.0.0/16"
2021-07-19T08:19:18.8768002Z [cluster1]     }
2021-07-19T08:19:18.8768396Z [cluster1] }
2021-07-19T08:19:18.8769762Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator[0m
2021-07-19T08:19:18.8771254Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator[0m
2021-07-19T08:19:18.8772797Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:18.8774474Z [36m[submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1[0m
2021-07-19T08:19:18.8776053Z [36m[submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1[0m
2021-07-19T08:19:18.8777529Z [36m[submariner-operator]$ [cluster1] jq -r -M .apiVersion /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:18.8778868Z [36m[submariner-operator]$ [cluster1] validate_equals .kind Submariner[0m
2021-07-19T08:19:18.8780065Z [36m[submariner-operator]$ [cluster1] validate_equals .kind Submariner[0m
2021-07-19T08:19:18.8781379Z [36m[submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:18.8782800Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name submariner[0m
2021-07-19T08:19:18.8784122Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name submariner[0m
2021-07-19T08:19:18.8785585Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:18.8787182Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443[0m
2021-07-19T08:19:18.8788395Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443[0m
2021-07-19T08:19:18.8789744Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:18.8980442Z [36m[submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-19T08:19:19.0012221Z [36m[submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-19T08:19:19.0519561Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEE0TVRFeE1Gb1hEVE14TURjeE56QTRNVEV4TUZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHdICnF5a0h5TFhlRmFUZmNoNlNRb25iL0FqTUNOZ21tVUZvS0duc1JwdWlEem03Q1ZtcDdtUlJQUkQ4SEN2dThUOTcKcHFTVjFRYmNaTWFuMXFhZGhRQlhxWFVnRGlqQXhBN0ZzMlZzcjZZNEU2b2NiTWZOMXZPVDNrMkRZUFE0MVhHcQpucmVYSjdpQzVYT0VKK0ZlUTNKL0RZK3JmUk4vUmh1Um9icHV2eWFqQnB5QzEyWWpvb2ZpWEVURGhDTjNUcWxlCnMvNGJPSE00dTBGWEhESERvZkE2SmRaVnFYYkZpcytLZUJBL2VobkJ6Y2t1ekpYcTlFOVhtZVRFUFNlMG00N3kKT1RMVTFabHFobStIdDl4dWViWEpiWFozamF4dHgvRGoxeVRnQk8xZUpINzFWRW5VdTRObjhNQUxuZU8rbklaeApFV0Z4NHdEalIvN081WEdxdnYwQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFET3ExSFZHbHJxdGNjYy9ZbUc1ZnVJWGdkb2MKK3huOGhKRjJiOUNiQU5rR2syVmJ5dmNRUzgwNU9wcHJmN2JnSEF2UmI5cjJXVmZPYzBBdHI4L3d3d2FOaEZYawpRMkhJcVo0SlhoZEg4S2pFbTFEekM3ODYvRDBUUEZOcGJ1MCtuQk00Z0JwTk1Ed3QzUlludldiZUQ0OFdGS1hDCk1DUi82Vk8rRk5nRk9kaTVVbVBqQlA4Z1ljTDZudHNTa0poY04rUE9WTm9sVklaVHIxWitmcnphRE9ya1VNZEcKNDI3SWppem0zU3NtUWJaZ0pjcW1aVTZPbEx3M05UcXQwNEl3bmRUaFJ4cU1WWC9BYVhXZlRtSVducDZYZmVCWApKbEZJWDg0UFFoTE9Sd3ZObEQrazMrWUsralM5cDlPT1c3TFpnUEUvdUhKbU8rUmZONUwzRE1hTEJ3QT0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-19T08:19:19.1567399Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEE0TVRFeE1Gb1hEVE14TURjeE56QTRNVEV4TUZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHdICnF5a0h5TFhlRmFUZmNoNlNRb25iL0FqTUNOZ21tVUZvS0duc1JwdWlEem03Q1ZtcDdtUlJQUkQ4SEN2dThUOTcKcHFTVjFRYmNaTWFuMXFhZGhRQlhxWFVnRGlqQXhBN0ZzMlZzcjZZNEU2b2NiTWZOMXZPVDNrMkRZUFE0MVhHcQpucmVYSjdpQzVYT0VKK0ZlUTNKL0RZK3JmUk4vUmh1Um9icHV2eWFqQnB5QzEyWWpvb2ZpWEVURGhDTjNUcWxlCnMvNGJPSE00dTBGWEhESERvZkE2SmRaVnFYYkZpcytLZUJBL2VobkJ6Y2t1ekpYcTlFOVhtZVRFUFNlMG00N3kKT1RMVTFabHFobStIdDl4dWViWEpiWFozamF4dHgvRGoxeVRnQk8xZUpINzFWRW5VdTRObjhNQUxuZU8rbklaeApFV0Z4NHdEalIvN081WEdxdnYwQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFET3ExSFZHbHJxdGNjYy9ZbUc1ZnVJWGdkb2MKK3huOGhKRjJiOUNiQU5rR2syVmJ5dmNRUzgwNU9wcHJmN2JnSEF2UmI5cjJXVmZPYzBBdHI4L3d3d2FOaEZYawpRMkhJcVo0SlhoZEg4S2pFbTFEekM3ODYvRDBUUEZOcGJ1MCtuQk00Z0JwTk1Ed3QzUlludldiZUQ0OFdGS1hDCk1DUi82Vk8rRk5nRk9kaTVVbVBqQlA4Z1ljTDZudHNTa0poY04rUE9WTm9sVklaVHIxWitmcnphRE9ya1VNZEcKNDI3SWppem0zU3NtUWJaZ0pjcW1aVTZPbEx3M05UcXQwNEl3bmRUaFJ4cU1WWC9BYVhXZlRtSVducDZYZmVCWApKbEZJWDg0UFFoTE9Sd3ZObEQrazMrWUsralM5cDlPT1c3TFpnUEUvdUhKbU8rUmZONUwzRE1hTEJ3QT0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-19T08:19:19.2181281Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:19.2183603Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker[0m
2021-07-19T08:19:19.2185599Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker[0m
2021-07-19T08:19:19.2187615Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:19.2189297Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false[0m
2021-07-19T08:19:19.2191291Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false[0m
2021-07-19T08:19:19.2192937Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:19.2194488Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500[0m
2021-07-19T08:19:19.2196395Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500[0m
2021-07-19T08:19:19.2198135Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:19.2199792Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500[0m
2021-07-19T08:19:19.2201220Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500[0m
2021-07-19T08:19:19.2227364Z [36m[submariner-operator]$ [cluster2] jq -ip8et3VsijwCqfFSbp8gkrWRsBEab1OMBCaKay9a8q7V_cBHg[0m
2021-07-19T08:19:19.2229828Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:19.2779027Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEE0TVRFeE1Gb1hEVE14TURjeE56QTRNVEV4TUZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHdICnF5a0h5TFhlRmFUZmNoNlNRb25iL0FqTUNOZ21tVUZvS0duc1JwdWlEem03Q1ZtcDdtUlJQUkQ4SEN2dThUOTcKcHFTVjFRYmNaTWFuMXFhZGhRQlhxWFVnRGlqQXhBN0ZzMlZzcjZZNEU2b2NiTWZOMXZPVDNrMkRZUFE0MVhHcQpucmVYSjdpQzVYT0VKK0ZlUTNKL0RZK3JmUk4vUmh1Um9icHV2eWFqQnB5QzEyWWpvb2ZpWEVURGhDTjNUcWxlCnMvNGJPSE00dTBGWEhESERvZkE2SmRaVnFYYkZpcytLZUJBL2VobkJ6Y2t1ekpYcTlFOVhtZVRFUFNlMG00N3kKT1RMVTFabHFobStIdDl4dWViWEpiWFozamF4dHgvRGoxeVRnQk8xZUpINzFWRW5VdTRObjhNQUxuZU8rbklaeApFV0Z4NHdEalIvN081WEdxdnYwQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFET3ExSFZHbHJxdGNjYy9ZbUc1ZnVJWGdkb2MKK3huOGhKRjJiOUNiQU5rR2syVmJ5dmNRUzgwNU9wcHJmN2JnSEF2UmI5cjJXVmZPYzBBdHI4L3d3d2FOaEZYawpRMkhJcVo0SlhoZEg4S2pFbTFEekM3ODYvRDBUUEZOcGJ1MCtuQk00Z0JwTk1Ed3QzUlludldiZUQ0OFdGS1hDCk1DUi82Vk8rRk5nRk9kaTVVbVBqQlA4Z1ljTDZudHNTa0poY04rUE9WTm9sVklaVHIxWitmcnphRE9ya1VNZEcKNDI3SWppem0zU3NtUWJaZ0pjcW1aVTZPbEx3M05UcXQwNEl3bmRUaFJ4cU1WWC9BYVhXZlRtSVducDZYZmVCWApKbEZJWDg0UFFoTE9Sd3ZObEQrazMrWUsralM5cDlPT1c3TFpnUEUvdUhKbU8rUmZONUwzRE1hTEJ3QT0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-19T08:19:19.3730707Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEE0TVRFeE1Gb1hEVE14TURjeE56QTRNVEV4TUZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHdICnF5a0h5TFhlRmFUZmNoNlNRb25iL0FqTUNOZ21tVUZvS0duc1JwdWlEem03Q1ZtcDdtUlJQUkQ4SEN2dThUOTcKcHFTVjFRYmNaTWFuMXFhZGhRQlhxWFVnRGlqQXhBN0ZzMlZzcjZZNEU2b2NiTWZOMXZPVDNrMkRZUFE0MVhHcQpucmVYSjdpQzVYT0VKK0ZlUTNKL0RZK3JmUk4vUmh1Um9icHV2eWFqQnB5QzEyWWpvb2ZpWEVURGhDTjNUcWxlCnMvNGJPSE00dTBGWEhESERvZkE2SmRaVnFYYkZpcytLZUJBL2VobkJ6Y2t1ekpYcTlFOVhtZVRFUFNlMG00N3kKT1RMVTFabHFobStIdDl4dWViWEpiWFozamF4dHgvRGoxeVRnQk8xZUpINzFWRW5VdTRObjhNQUxuZU8rbklaeApFV0Z4NHdEalIvN081WEdxdnYwQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFET3ExSFZHbHJxdGNjYy9ZbUc1ZnVJWGdkb2MKK3huOGhKRjJiOUNiQU5rR2syVmJ5dmNRUzgwNU9wcHJmN2JnSEF2UmI5cjJXVmZPYzBBdHI4L3d3d2FOaEZYawpRMkhJcVo0SlhoZEg4S2pFbTFEekM3ODYvRDBUUEZOcGJ1MCtuQk00Z0JwTk1Ed3QzUlludldiZUQ0OFdGS1hDCk1DUi82Vk8rRk5nRk9kaTVVbVBqQlA4Z1ljTDZudHNTa0poY04rUE9WTm9sVklaVHIxWitmcnphRE9ya1VNZEcKNDI3SWppem0zU3NtUWJaZ0pjcW1aVTZPbEx3M05UcXQwNEl3bmRUaFJ4cU1WWC9BYVhXZlRtSVducDZYZmVCWApKbEZJWDg0UFFoTE9Sd3ZObEQrazMrWUsralM5cDlPT1c3TFpnUEUvdUhKbU8rUmZONUwzRE1hTEJ3QT0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-19T08:19:19.4280364Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:19.4282348Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker[0m
2021-07-19T08:19:19.4284471Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker[0m
2021-07-19T08:19:19.4286964Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:19.4288804Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false[0m
2021-07-19T08:19:19.4290139Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false[0m
2021-07-19T08:19:19.4291639Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:19.4293105Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500[0m
2021-07-19T08:19:19.4294470Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500[0m
2021-07-19T08:19:19.4296017Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2288614Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:20.2290263Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000[0m
2021-07-19T08:19:20.2291521Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000[0m
2021-07-19T08:19:20.2292910Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.repository /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:20.2294290Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.version local[0m
2021-07-19T08:19:20.2295434Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.version local[0m
2021-07-19T08:19:20.2296975Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.version /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:20.2298228Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.broker k8s[0m
2021-07-19T08:19:20.2299589Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.broker k8s[0m
2021-07-19T08:19:20.2300949Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.broker /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:20.2302504Z [36m[submariner-operator]$ [cluster2] jq -r .spec.clusterID /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:20.2303531Z [cluster2] Generated cluster id: cluster2
2021-07-19T08:19:20.2304601Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue[0m
2021-07-19T08:19:20.2306158Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue[0m
2021-07-19T08:19:20.2307605Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.colorCodes /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:20.2309773Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.debug false[0m
2021-07-19T08:19:20.2310984Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.debug false[0m
2021-07-19T08:19:20.2312490Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.debug /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:20.2314015Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator[0m
2021-07-19T08:19:20.2315534Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator[0m
2021-07-19T08:19:20.2317091Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.namespace /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:20.2318517Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false[0m
2021-07-19T08:19:20.2319810Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false[0m
2021-07-19T08:19:20.2321260Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.natEnabled /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:20.2322647Z [36m[submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries[0m
2021-07-19T08:19:20.2323789Z [36m[submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries[0m
2021-07-19T08:19:20.2325134Z [36m[submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_[0m
2021-07-19T08:19:20.2326330Z [36m[submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_[0m
2021-07-19T08:19:20.2327670Z [36m[submariner-operator]$ [cluster2] iteration=1[0m
2021-07-19T08:19:20.2328591Z [36m[submariner-operator]$ [cluster2] wait 8660[0m
2021-07-19T08:19:20.2329499Z [36m[submariner-operator]$ [cluster2] verify_subm_cr_status_[0m
2021-07-19T08:19:20.2330476Z [36m[submariner-operator]$ [cluster2] verify_subm_cr_status_[0m
2021-07-19T08:19:20.2331431Z [36m[submariner-operator]$ [cluster2] verify_subm_cr_status[0m
2021-07-19T08:19:20.2332395Z [36m[submariner-operator]$ [cluster2] verify_subm_cr_status[0m
2021-07-19T08:19:20.2333544Z [36m[submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json[0m
2021-07-19T08:19:20.2334428Z [cluster2] [36m[0m
2021-07-19T08:19:20.2334944Z [cluster2] [36m[0m
2021-07-19T08:19:20.2336164Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-19T08:19:20.2337673Z [36m[submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.0.0.0/16[0m
2021-07-19T08:19:20.2338915Z [36m[submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.0.0.0/16[0m
2021-07-19T08:19:20.2340327Z [36m[submariner-operator]$ [cluster2] jq -r -M .status.serviceCIDR /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:20.2341725Z [36m[submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.0.0.0/16[0m
2021-07-19T08:19:20.2342951Z [36m[submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.0.0.0/16[0m
2021-07-19T08:19:20.2344350Z [36m[submariner-operator]$ [cluster2] jq -r -M .status.clusterCIDR /tmp/submariner.cluster2.json[0m
2021-07-19T08:19:20.2345629Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-19T08:19:20.2346505Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-19T08:19:20.2347480Z [36m[submariner-operator]$ [cluster2] verify_subm_gateway_deployment[0m
2021-07-19T08:19:20.2348813Z [36m[submariner-operator]$ [cluster2] verify_subm_gateway_deployment[0m
2021-07-19T08:19:20.2350213Z [36m[submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway[0m
2021-07-19T08:19:20.2351795Z [36m[submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway[0m
2021-07-19T08:19:20.2353227Z [36m[submariner-operator]$ [cluster2] daemonset_app=submariner-gateway[0m
2021-07-19T08:19:20.2484335Z [36mceIPSecNATTPort 4500[0m
2021-07-19T08:19:20.2486071Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500[0m
2021-07-19T08:19:20.2487703Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2489392Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000[0m
2021-07-19T08:19:20.2490654Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000[0m
2021-07-19T08:19:20.2492013Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.repository /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2493337Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.version local[0m
2021-07-19T08:19:20.2494461Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.version local[0m
2021-07-19T08:19:20.2495763Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.version /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2497029Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.broker k8s[0m
2021-07-19T08:19:20.2498122Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.broker k8s[0m
2021-07-19T08:19:20.2499395Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.broker /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2500824Z [36m[submariner-operator]$ [cluster1] jq -r .spec.clusterID /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2501770Z [cluster1] Generated cluster id: cluster1
2021-07-19T08:19:20.2502751Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue[0m
2021-07-19T08:19:20.2504126Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue[0m
2021-07-19T08:19:20.2505498Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.colorCodes /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2506784Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.debug false[0m
2021-07-19T08:19:20.2507899Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.debug false[0m
2021-07-19T08:19:20.2509152Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.debug /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2510972Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator[0m
2021-07-19T08:19:20.2512481Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator[0m
2021-07-19T08:19:20.2514052Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.namespace /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2515488Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false[0m
2021-07-19T08:19:20.2516769Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false[0m
2021-07-19T08:19:20.2518320Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.natEnabled /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2519693Z [36m[submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries[0m
2021-07-19T08:19:20.2520858Z [36m[submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries[0m
2021-07-19T08:19:20.2522029Z [36m[submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_[0m
2021-07-19T08:19:20.2523304Z [36m[submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_[0m
2021-07-19T08:19:20.2524474Z [36m[submariner-operator]$ [cluster1] iteration=1[0m
2021-07-19T08:19:20.2525756Z [36m[submariner-operator]$ [cluster1] wait 8685[0m
2021-07-19T08:19:20.2526762Z [36m[submariner-operator]$ [cluster1] verify_subm_cr_status_[0m
2021-07-19T08:19:20.2527798Z [36m[submariner-operator]$ [cluster1] verify_subm_cr_status_[0m
2021-07-19T08:19:20.2528854Z [36m[submariner-operator]$ [cluster1] verify_subm_cr_status[0m
2021-07-19T08:19:20.2529887Z [36m[submariner-operator]$ [cluster1] verify_subm_cr_status[0m
2021-07-19T08:19:20.2531183Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2532182Z [cluster1] [36m[0m
2021-07-19T08:19:20.2532689Z [cluster1] [36m[0m
2021-07-19T08:19:20.2533922Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-19T08:19:20.2535433Z [36m[submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.0.0.0/16[0m
2021-07-19T08:19:20.2537814Z [36m[submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.0.0.0/16[0m
2021-07-19T08:19:20.2539219Z [36m[submariner-operator]$ [cluster1] jq -r -M .status.serviceCIDR /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2540631Z [36m[submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.0.0.0/16[0m
2021-07-19T08:19:20.2541877Z [36m[submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.0.0.0/16[0m
2021-07-19T08:19:20.2543256Z [36m[submariner-operator]$ [cluster1] jq -r -M .status.clusterCIDR /tmp/submariner.cluster1.json[0m
2021-07-19T08:19:20.2544444Z [36m[submariner-operator]$ [cluster1] return 0[0m
2021-07-19T08:19:20.2545301Z [36m[submariner-operator]$ [cluster1] return 0[0m
2021-07-19T08:19:20.2546294Z [36m[submariner-operator]$ [cluster1] verify_subm_gateway_deployment[0m
2021-07-19T08:19:20.2547381Z [36m[submariner-operator]$ [cluster1] verify_subm_gateway_deployment[0m
2021-07-19T08:19:20.2548673Z [36m[submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway[0m
2021-07-19T08:19:22.6613462Z [36m[submariner-operator[submariner-operator]$ [cluster2] daemonset_name=submariner-gateway[0m
2021-07-19T08:19:22.6619351Z [36m[submariner-operator]$ [cluster2] with_retries 60 daemonset_created[0m
2021-07-19T08:19:22.6620793Z [36m[submariner-operator]$ [cluster2] with_retries 60 daemonset_created[0m
2021-07-19T08:19:22.6621882Z [36m[submariner-operator]$ [cluster2] iteration=1[0m
2021-07-19T08:19:22.6622922Z [36m[submariner-operator]$ [cluster2] daemonset_created[0m
2021-07-19T08:19:22.6623895Z [36m[submariner-operator]$ [cluster2] wait 8734[0m
2021-07-19T08:19:22.6625065Z [36m[submariner-operator]$ [cluster2] daemonset_created[0m
2021-07-19T08:19:22.6625842Z [cluster2] [36m[0m
2021-07-19T08:19:22.6626608Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-19T08:19:22.6627707Z [36m[submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed[0m
2021-07-19T08:19:22.6628917Z [36m[submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed[0m
2021-07-19T08:19:22.6629998Z [36m[submariner-operator]$ [cluster2] iteration=1[0m
2021-07-19T08:19:22.6631021Z [36m[submariner-operator]$ [cluster2] daemonset_deployed[0m
2021-07-19T08:19:22.6632100Z [36m[submariner-operator]$ [cluster2] daemonset_deployed[0m
2021-07-19T08:19:22.6633083Z [36m[submariner-operator]$ [cluster2] wait 8790[0m
2021-07-19T08:19:22.6634665Z [36m[submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}[0m
2021-07-19T08:19:22.6636807Z [36m[submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}[0m
2021-07-19T08:19:22.6639082Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}[0m
2021-07-19T08:19:22.6641382Z [36m[submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}[0m
2021-07-19T08:19:22.6643041Z [36m[submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}[0m
2021-07-19T08:19:22.6645205Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}[0m
2021-07-19T08:19:22.6646661Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-19T08:19:22.6647665Z [36m[submariner-operator]$ [cluster2] verify_subm_gateway_pod[0m
2021-07-19T08:19:22.6648875Z [36m[submariner-operator]$ [cluster2] verify_subm_gateway_pod[0m
2021-07-19T08:19:22.6650623Z [36m[submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator[0m
2021-07-19T08:19:22.6652823Z [36m[submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator[0m
2021-07-19T08:19:22.6655043Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator[0m
2021-07-19T08:19:22.6656686Z [cluster2] pod/submariner-gateway-tc4jv condition met
2021-07-19T08:19:22.6658377Z [36m[submariner-operator]$ [cluster2] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')[0m
2021-07-19T08:19:22.6660522Z [36m[submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-19T08:19:22.6662758Z [36m[submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-19T08:19:22.6664911Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-19T08:19:22.6666645Z [36m[submariner-operator]$ [cluster2] json_file=/tmp/submariner-gateway-tc4jv.cluster2.json[0m
2021-07-19T08:19:22.6668303Z [36m[submariner-operator]$ [cluster2] kubectl get pod submariner-gateway-tc4jv --namespace=submariner-operator -o json[0m
2021-07-19T08:19:22.6669980Z [36m[submariner-operator]$ [cluster2] kubectl get pod submariner-gateway-tc4jv --namespace=submariner-operator -o json[0m
2021-07-19T08:19:22.6671637Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-gateway-tc4jv --namespace=submariner-operator -o json[0m
2021-07-19T08:19:22.6673238Z [36m[submariner-operator]$ [cluster2] tee /tmp/submariner-gateway-tc4jv.cluster2.json[0m
2021-07-19T08:19:22.6674317Z [cluster2] {
2021-07-19T08:19:22.6674749Z [cluster2]     "apiVersion": "v1",
2021-07-19T08:19:22.6675242Z [cluster2]     "kind": "Pod",
2021-07-19T08:19:22.6675684Z [cluster2]     "metadata": {
2021-07-19T08:19:22.6676545Z [cluster2]         "creationTimestamp": "2021-07-19T08:18:16Z",
2021-07-19T08:19:22.6677320Z [cluster2]         "generateName": "submariner-gateway-",
2021-07-19T08:19:22.6677869Z [cluster2]         "labels": {
2021-07-19T08:19:22.6678682Z [cluster2]             "app": "submariner-gateway",
2021-07-19T08:19:22.6679611Z [cluster2]             "controller-revision-hash": "788c7ccd59",
2021-07-19T08:19:22.6680661Z [cluster2]             "gateway.submariner.io/node": "cluster2-worker",
2021-07-19T08:19:22.6681739Z [cluster2]             "gateway.submariner.io/status": "active",
2021-07-19T08:19:22.6682745Z [cluster2]             "pod-template-generation": "1"
2021-07-19T08:19:22.6683361Z [cluster2]         },
2021-07-19T08:19:22.6684182Z [cluster2]         "name": "submariner-gateway-tc4jv",
2021-07-19T08:19:22.6742427Z [cluster2]         "namespace": "submariner-operator",
2021-07-19T08:19:22.6743574Z [cluster2]         "ownerReferences": [
2021-07-19T08:19:22.6744097Z [cluster2]             {
2021-07-19T08:19:22.6744701Z [cluster2]                 "apiVersion": "apps/v1",
2021-07-19T08:19:22.6745513Z [cluster2]                 "blockOwnerDeletion": true,
2021-07-19T08:19:22.6746130Z [cluster2]                 "controller": true,
2021-07-19T08:19:22.6746668Z [cluster2]                 "kind": "DaemonSet",
2021-07-19T08:19:22.6747511Z [cluster2]                 "name": "submariner-gateway",
2021-07-19T08:19:22.6748453Z [cluster2]                 "uid": "0c10ee79-2cb9-406c-9c48-1352efe6e3ac"
2021-07-19T08:19:22.6749038Z [cluster2]             }
2021-07-19T08:19:22.6749466Z [cluster2]         ],
2021-07-19T08:19:22.6749950Z [cluster2]         "resourceVersion": "2035",
2021-07-19T08:19:22.6751126Z [cluster2]         "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-gateway-tc4jv",
2021-07-19T08:19:22.6752559Z [cluster2]         "uid": "fd71e14c-1d3a-46ac-9b33-a1468a70a27c"
2021-07-19T08:19:22.6753332Z [cluster2]     },
2021-07-19T08:19:22.6753743Z [cluster2]     "spec": {
2021-07-19T08:19:22.6754176Z [cluster2]         "affinity": {
2021-07-19T08:19:22.6754679Z [cluster2]             "nodeAffinity": {
2021-07-19T08:19:22.6755771Z [cluster2]                 "requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-19T08:19:22.6756916Z [cluster2]                     "nodeSelectorTerms": [
2021-07-19T08:19:22.6757441Z [cluster2]                         {
2021-07-19T08:19:22.6758090Z [cluster2]                             "matchFields": [
2021-07-19T08:19:22.6758599Z [cluster2]                                 {
2021-07-19T08:19:22.6759162Z [cluster2]                                     "key": "metadata.name",
2021-07-19T08:19:22.6759905Z [cluster2]                                     "operator": "In",
2021-07-19T08:19:22.6760449Z [cluster2]                                     "values": [
2021-07-19T08:19:22.6761250Z [cluster2]                                         "cluster2-worker"
2021-07-19T08:19:22.6761815Z [cluster2]                                     ]
2021-07-19T08:19:22.6762282Z [cluster2]                                 }
2021-07-19T08:19:22.6762724Z [cluster2]                             ]
2021-07-19T08:19:22.6763177Z [cluster2]                         }
2021-07-19T08:19:22.6763608Z [cluster2]                     ]
2021-07-19T08:19:22.6764041Z [cluster2]                 }
2021-07-19T08:19:22.6764581Z [cluster2]             },
2021-07-19T08:19:22.6765238Z [cluster2]             "podAntiAffinity": {
2021-07-19T08:19:22.6766458Z [cluster2]                 "requiredDuringSchedulingIgnoredDuringExecution": [
2021-07-19T08:19:22.6767551Z [cluster2]                     {
2021-07-19T08:19:22.6768085Z [cluster2]                         "labelSelector": {
2021-07-19T08:19:22.6768687Z [cluster2]                             "matchLabels": {
2021-07-19T08:19:22.6769634Z [cluster2]                                 "app": "submariner-gateway"
2021-07-19T08:19:22.6770248Z [cluster2]                             }
2021-07-19T08:19:22.6770618Z [cluster2]                         },
2021-07-19T08:19:22.6771131Z [cluster2]                         "topologyKey": "kubernetes.io/hostname"
2021-07-19T08:19:22.6771647Z [cluster2]                     }
2021-07-19T08:19:22.6771987Z [cluster2]                 ]
2021-07-19T08:19:22.6772338Z [cluster2]             }
2021-07-19T08:19:22.6772682Z [cluster2]         },
2021-07-19T08:19:22.6773058Z [cluster2]         "containers": [
2021-07-19T08:19:22.6773448Z [cluster2]             {
2021-07-19T08:19:22.6773896Z [cluster2]                 "command": [
2021-07-19T08:19:22.6774285Z [cluster2]                     "submariner.sh"
2021-07-19T08:19:22.6774635Z [cluster2]                 ],
2021-07-19T08:19:22.6774955Z [cluster2]                 "env": [
2021-07-19T08:19:22.6775262Z [cluster2]                     {
2021-07-19T08:19:22.6775856Z [cluster2]                         "name": "SUBMARINER_NAMESPACE",
2021-07-19T08:19:22.6776598Z [cluster2]                         "value": "submariner-operator"
2021-07-19T08:19:22.6777241Z [cluster2]                     },
2021-07-19T08:19:22.6777606Z [cluster2]                     {
2021-07-19T08:19:22.6778071Z [cluster2]                         "name": "SUBMARINER_CLUSTERCIDR",
2021-07-19T08:19:22.6778798Z [cluster2]                         "value": "10.0.0.0/16"
2021-07-19T08:19:22.6779232Z [cluster2]                     },
2021-07-19T08:19:22.6779638Z [cluster2]                     {
2021-07-19T08:19:22.6780173Z [cluster2]                         "name": "SUBMARINER_SERVICECIDR",
2021-07-19T08:19:22.6780753Z [cluster2]                         "value": "100.0.0.0/16"
2021-07-19T08:19:22.6781180Z [cluster2]                     },
2021-07-19T08:19:22.6781587Z [cluster2]                     {
2021-07-19T08:19:22.6782109Z [cluster2]                         "name": "SUBMARINER_GLOBALCIDR",
2021-07-19T08:19:22.6782679Z [cluster2]                         "value": "242.254.2.0/24"
2021-07-19T08:19:22.6783128Z [cluster2]                     },
2021-07-19T08:19:22.6783521Z [cluster2]                     {
2021-07-19T08:19:22.6784223Z [cluster2]                         "name": "SUBMARINER_CLUSTERID",
2021-07-19T08:19:22.6784841Z [cluster2]                         "value": "cluster2"
2021-07-19T08:19:22.6785350Z [cluster2]                     },
2021-07-19T08:19:22.6785914Z [cluster2]                     {
2021-07-19T08:19:22.6786494Z [cluster2]                         "name": "SUBMARINER_COLORCODES",
2021-07-19T08:19:22.6787096Z [cluster2]                         "value": "blue"
2021-07-19T08:19:22.6787580Z [cluster2]                     },
2021-07-19T08:19:22.6788012Z [cluster2]                     {
2021-07-19T08:19:22.6788559Z [cluster2]                         "name": "SUBMARINER_DEBUG",
2021-07-19T08:19:22.6789145Z [cluster2]                         "value": "false"
2021-07-19T08:19:22.6789624Z [cluster2]                     },
2021-07-19T08:19:22.6790170Z [cluster2]                     {
2021-07-19T08:19:22.6790920Z [cluster2]                         "name": "SUBMARINER_NATENABLED",
2021-07-19T08:19:22.6791525Z [cluster2]                         "value": "false"
2021-07-19T08:19:22.6792098Z [cluster2]                     },
2021-07-19T08:19:22.6792489Z [cluster2]                     {
2021-07-19T08:19:22.6792997Z [cluster2]                         "name": "SUBMARINER_BROKER",
2021-07-19T08:19:22.6793537Z [cluster2]                         "value": "k8s"
2021-07-19T08:19:22.6794054Z [cluster2]                     },
2021-07-19T08:19:22.6794468Z [cluster2]                     {
2021-07-19T08:19:22.6794995Z [cluster2]                         "name": "SUBMARINER_CABLEDRIVER",
2021-07-19T08:19:22.6795676Z [cluster2]                         "value": "libreswan"
2021-07-19T08:19:22.6796300Z [cluster2]                     },
2021-07-19T08:19:22.6796710Z [cluster2]                     {
2021-07-19T08:19:22.6797214Z [cluster2]                         "name": "BROKER_K8S_APISERVER",
2021-07-19T08:19:22.6797770Z [cluster2]                         "value": "172.18.0.6:6443"
2021-07-19T08:19:22.6798205Z [cluster2]                     },
2021-07-19T08:19:22.6798613Z [cluster2]                     {
2021-07-19T08:19:22.6799165Z [cluster2]                         "name": "BROKER_K8S_APISERVERTOKEN",
2021-07-19T08:19:22.6930004Z [cluster2]                         "value": "***"
2021-07-19T08:19:22.6930563Z [cluster2]                     },
2021-07-19T08:19:22.6931013Z [cluster2]                     {
2021-07-19T08:19:22.6931629Z [cluster2]                         "name": "BROKER_K8S_REMOTENAMESPACE",
2021-07-19T08:19:22.6956033Z [cluster2]                         "value": "submariner-k8s-broker"
2021-07-19T08:19:22.6956780Z [cluster2]                     },
2021-07-19T08:19:22.6957231Z [cluster2]                     {
2021-07-19T08:19:22.6957737Z [cluster2]                         "name": "BROKER_K8S_CA",
2021-07-19T08:19:22.7533024Z [cluster2]                         "value": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEE0TVRFeE1Gb1hEVE14TURjeE56QTRNVEV4TUZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHdICnF5a0h5TFhlRmFUZmNoNlNRb25iL0FqTUNOZ21tVUZvS0duc1JwdWlEem03Q1ZtcDdtUlJQUkQ4SEN2dThUOTcKcHFTVjFRYmNaTWFuMXFhZGhRQlhxWFVnRGlqQXhBN0ZzMlZzcjZZNEU2b2NiTWZOMXZPVDNrMkRZUFE0MVhHcQpucmVYSjdpQzVYT0VKK0ZlUTNKL0RZK3JmUk4vUmh1Um9icHV2eWFqQnB5QzEyWWpvb2ZpWEVURGhDTjNUcWxlCnMvNGJPSE00dTBGWEhESERvZkE2SmRaVnFYYkZpcytLZUJBL2VobkJ6Y2t1ekpYcTlFOVhtZVRFUFNlMG00N3kKT1RMVTFabHFobStIdDl4dWViWEpiWFozamF4dHgvRGoxeVRnQk8xZUpINzFWRW5VdTRObjhNQUxuZU8rbklaeApFV0Z4NHdEalIvN081WEdxdnYwQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFET3ExSFZHbHJxdGNjYy9ZbUc1ZnVJWGdkb2MKK3huOGhKRjJiOUNiQU5rR2syVmJ5dmNRUzgwNU9wcHJmN2JnSEF2UmI5cjJXVmZPYzBBdHI4L3d3d2FOaEZYawpRMkhJcVo0SlhoZEg4S2pFbTFEekM3ODYvRDBUUEZOcGJ1MCtuQk00Z0JwTk1Ed3QzUlludldiZUQ0OFdGS1hDCk1DUi82Vk8rRk5nRk9kaTVVbVBqQlA4Z1ljTDZudHNTa0poY04rUE9WTm9sVklaVHIxWitmcnphRE9ya1VNZEcKNDI3SWppem0zU3NtUWJaZ0pjcW1aVTZPbEx3M05UcXQwNEl3bmRUaFJ4cU1WWC9BYVhXZlRtSVducDZYZmVCWApKbEZJWDg0UFFoTE9Sd3ZObEQrazMrWUsralM5cDlPT1c3TFpnUEUvdUhKbU8rUmZONUwzRE1hTEJ3QT0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo="
2021-07-19T08:19:22.8035703Z [cluster2]                     },
2021-07-19T08:19:22.8036194Z [cluster2]                     {
2021-07-19T08:19:22.8036766Z [cluster2]                         "name": "CE_IPSEC_PSK",
2021-07-19T08:19:22.8037768Z [cluster2]                         "value": "sZFmVdfOnB40qkFDBi+EKA8Sv/Rw5SH3O/wsoAds+gvpgX54HYhmQ5Xbu/I5QYTn"
2021-07-19T08:19:22.8045297Z [cluster2]                     },
2021-07-19T08:19:22.8045814Z [cluster2]                     {
2021-07-19T08:19:22.8046358Z [cluster2]                         "name": "CE_IPSEC_DEBUG",
2021-07-19T08:19:22.8046939Z [cluster2]                         "value": "false"
2021-07-19T08:19:22.8047423Z [cluster2]                     },
2021-07-19T08:19:22.8047894Z [cluster2]                     {
2021-07-19T08:19:22.8048532Z [cluster2]                         "name": "SUBMARINER_HEALTHCHECKENABLED",
2021-07-19T08:19:22.8049228Z [cluster2]                         "value": "true"
2021-07-19T08:19:22.8049731Z [cluster2]                     },
2021-07-19T08:19:22.8050168Z [cluster2]                     {
2021-07-19T08:19:22.8050820Z [cluster2]                         "name": "SUBMARINER_HEALTHCHECKINTERVAL",
2021-07-19T08:19:22.8051750Z [cluster2]                         "value": "1"
2021-07-19T08:19:22.8052226Z [cluster2]                     },
2021-07-19T08:19:22.8052650Z [cluster2]                     {
2021-07-19T08:19:22.8053454Z [cluster2]                         "name": "SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT",
2021-07-19T08:19:22.8054268Z [cluster2]                         "value": "5"
2021-07-19T08:19:22.8054740Z [cluster2]                     },
2021-07-19T08:19:22.8055169Z [cluster2]                     {
2021-07-19T08:19:22.8055670Z [cluster2]                         "name": "NODE_NAME",
2021-07-19T08:19:22.8056214Z [cluster2]                         "valueFrom": {
2021-07-19T08:19:22.8056763Z [cluster2]                             "fieldRef": {
2021-07-19T08:19:22.8057327Z [cluster2]                                 "apiVersion": "v1",
2021-07-19T08:19:22.8057992Z [cluster2]                                 "fieldPath": "spec.nodeName"
2021-07-19T08:19:22.8058581Z [cluster2]                             }
2021-07-19T08:19:22.8059019Z [cluster2]                         }
2021-07-19T08:19:22.8059463Z [cluster2]                     },
2021-07-19T08:19:22.8059886Z [cluster2]                     {
2021-07-19T08:19:22.8060390Z [cluster2]                         "name": "POD_NAME",
2021-07-19T08:19:22.8061028Z [cluster2]                         "valueFrom": {
2021-07-19T08:19:22.8061535Z [cluster2]                             "fieldRef": {
2021-07-19T08:19:22.8062050Z [cluster2]                                 "apiVersion": "v1",
2021-07-19T08:19:22.8062665Z [cluster2]                                 "fieldPath": "metadata.name"
2021-07-19T08:19:22.8063306Z [cluster2]                             }
2021-07-19T08:19:22.8063712Z [cluster2]                         }
2021-07-19T08:19:22.8064123Z [cluster2]                     },
2021-07-19T08:19:22.8064509Z [cluster2]                     {
2021-07-19T08:19:22.8065015Z [cluster2]                         "name": "CE_IPSEC_IKEPORT",
2021-07-19T08:19:22.8065535Z [cluster2]                         "value": "500"
2021-07-19T08:19:22.8065977Z [cluster2]                     },
2021-07-19T08:19:22.8066368Z [cluster2]                     {
2021-07-19T08:19:22.8066866Z [cluster2]                         "name": "CE_IPSEC_NATTPORT",
2021-07-19T08:19:22.8067381Z [cluster2]                         "value": "4500"
2021-07-19T08:19:22.8067818Z [cluster2]                     },
2021-07-19T08:19:22.8070177Z [cluster2]                     {
2021-07-19T08:19:22.8072321Z [cluster2]                         "name": "CE_IPSEC_PREFERREDSERVER",
2021-07-19T08:19:22.8073301Z [cluster2]                         "value": "false"
2021-07-19T08:19:22.8073811Z [cluster2]                     },
2021-07-19T08:19:22.8074432Z [cluster2]                     {
2021-07-19T08:19:22.8075138Z [cluster2]                         "name": "CE_IPSEC_FORCEENCAPS",
2021-07-19T08:19:22.8077309Z [cluster2]                         "value": "false"
2021-07-19T08:19:22.8078001Z [cluster2]                     }
2021-07-19T08:19:22.8078640Z [cluster2]                 ],
2021-07-19T08:19:22.8080346Z [cluster2]                 "image": "localhost:5000/submariner-gateway:local",
2021-07-19T08:19:22.8081118Z [cluster2]                 "imagePullPolicy": "Always",
2021-07-19T08:19:22.8081992Z [cluster2]                 "name": "submariner-gateway",
2021-07-19T08:19:22.8082552Z [cluster2]                 "ports": [
2021-07-19T08:19:22.8082986Z [cluster2]                     {
2021-07-19T08:19:22.8083475Z [cluster2]                         "containerPort": 4500,
2021-07-19T08:19:22.8084020Z [cluster2]                         "hostPort": 4500,
2021-07-19T08:19:22.8084732Z [cluster2]                         "name": "cable-encaps",
2021-07-19T08:19:22.8085525Z [cluster2]                         "protocol": "UDP"
2021-07-19T08:19:22.8085979Z [cluster2]                     },
2021-07-19T08:19:22.8086397Z [cluster2]                     {
2021-07-19T08:19:22.8086897Z [cluster2]                         "containerPort": 4490,
2021-07-19T08:19:22.8087604Z [cluster2]                         "hostPort": 4490,
2021-07-19T08:19:22.8088364Z [cluster2]                         "name": "natt-discovery",
2021-07-19T08:19:22.8088928Z [cluster2]                         "protocol": "UDP"
2021-07-19T08:19:22.8089396Z [cluster2]                     }
2021-07-19T08:19:22.8089782Z [cluster2]                 ],
2021-07-19T08:19:22.8090243Z [cluster2]                 "resources": {},
2021-07-19T08:19:22.8090778Z [cluster2]                 "securityContext": {
2021-07-19T08:19:22.8091511Z [cluster2]                     "allowPrivilegeEscalation": true,
2021-07-19T08:19:22.8092202Z [cluster2]                     "capabilities": {
2021-07-19T08:19:22.8092693Z [cluster2]                         "add": [
2021-07-19T08:19:22.8093158Z [cluster2]                             "net_admin"
2021-07-19T08:19:22.8093595Z [cluster2]                         ],
2021-07-19T08:19:22.8094030Z [cluster2]                         "drop": [
2021-07-19T08:19:22.8094464Z [cluster2]                             "all"
2021-07-19T08:19:22.8094899Z [cluster2]                         ]
2021-07-19T08:19:22.8095298Z [cluster2]                     },
2021-07-19T08:19:22.8095783Z [cluster2]                     "privileged": true,
2021-07-19T08:19:22.8096456Z [cluster2]                     "readOnlyRootFilesystem": false,
2021-07-19T08:19:22.8097145Z [cluster2]                     "runAsNonRoot": false
2021-07-19T08:19:22.8097625Z [cluster2]                 },
2021-07-19T08:19:22.8098510Z [cluster2]                 "terminationMessagePath": "/dev/termination-log",
2021-07-19T08:19:22.8099534Z [cluster2]                 "terminationMessagePolicy": "File",
2021-07-19T08:19:22.8100215Z [cluster2]                 "volumeMounts": [
2021-07-19T08:19:22.8100690Z [cluster2]                     {
2021-07-19T08:19:22.8101192Z [cluster2]                         "mountPath": "/etc/ipsec.d",
2021-07-19T08:19:22.8101749Z [cluster2]                         "name": "ipsecd"
2021-07-19T08:19:22.8102196Z [cluster2]                     },
2021-07-19T08:19:22.8102786Z [cluster2]                     {
2021-07-19T08:19:22.8103338Z [cluster2]                         "mountPath": "/var/lib/ipsec/nss",
2021-07-19T08:19:22.8103970Z [cluster2]                         "name": "ipsecnss"
2021-07-19T08:19:22.8104470Z [cluster2]                     },
2021-07-19T08:19:22.8104892Z [cluster2]                     {
2021-07-19T08:19:22.8105624Z [cluster2]                         "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-19T08:19:22.8106871Z [cluster2]                         "name": "submariner-gateway-token-cz5rk",
2021-07-19T08:19:22.8107707Z [cluster2]                         "readOnly": true
2021-07-19T08:19:22.8108192Z [cluster2]                     }
2021-07-19T08:19:22.8108630Z [cluster2]                 ]
2021-07-19T08:19:22.8109041Z [cluster2]             }
2021-07-19T08:19:22.8109461Z [cluster2]         ],
2021-07-19T08:19:22.8109994Z [cluster2]         "dnsPolicy": "ClusterFirst",
2021-07-19T08:19:22.8110707Z [cluster2]         "enableServiceLinks": true,
2021-07-19T08:19:22.8111445Z [cluster2]         "hostNetwork": true,
2021-07-19T08:19:22.8112248Z [cluster2]         "nodeName": "cluster2-worker",
2021-07-19T08:19:22.8112892Z [cluster2]         "nodeSelector": {
2021-07-19T08:19:22.8113518Z [cluster2]             "submariner.io/gateway": "true"
2021-07-19T08:19:22.8114072Z [cluster2]         },
2021-07-19T08:19:22.8114520Z [cluster2]         "priority": 0,
2021-07-19T08:19:22.8115098Z [cluster2]         "restartPolicy": "Always",
2021-07-19T08:19:22.8115992Z [cluster2]         "schedulerName": "default-scheduler",
2021-07-19T08:19:22.8116738Z [cluster2]         "securityContext": {},
2021-07-19T08:19:22.8117652Z [cluster2]         "serviceAccount": "submariner-gateway",
2021-07-19T08:19:22.8118748Z [cluster2]         "serviceAccountName": "submariner-gateway",
2021-07-19T08:19:22.8119758Z [cluster2]         "terminationGracePeriodSeconds": 1,
2021-07-19T08:19:22.8120532Z [cluster2]         "tolerations": [
2021-07-19T08:19:22.8121100Z [cluster2]             {
2021-07-19T08:19:22.8121600Z [cluster2]                 "operator": "Exists"
2021-07-19T08:19:22.8122103Z [cluster2]             },
2021-07-19T08:19:22.8122516Z [cluster2]             {
2021-07-19T08:19:22.8123034Z [cluster2]                 "effect": "NoExecute",
2021-07-19T08:19:22.8124006Z [cluster2]                 "key": "node.kubernetes.io/not-ready",
2021-07-19T08:19:22.8124664Z [cluster2]                 "operator": "Exists"
2021-07-19T08:19:22.8125955Z [cluster2]             },
2021-07-19T08:19:22.8126359Z [cluster2]             {
2021-07-19T08:19:22.8126840Z [cluster2]                 "effect": "NoExecute",
2021-07-19T08:19:22.8127704Z [cluster2]                 "key": "node.kubernetes.io/unreachable",
2021-07-19T08:19:22.8128425Z [cluster2]                 "operator": "Exists"
2021-07-19T08:19:22.8128910Z [cluster2]             },
2021-07-19T08:19:22.8129339Z [cluster2]             {
2021-07-19T08:19:22.8129853Z [cluster2]                 "effect": "NoSchedule",
2021-07-19T08:19:22.8130834Z [cluster2]                 "key": "node.kubernetes.io/disk-pressure",
2021-07-19T08:19:22.8131571Z [cluster2]                 "operator": "Exists"
2021-07-19T08:19:22.8132072Z [cluster2]             },
2021-07-19T08:19:22.8132485Z [cluster2]             {
2021-07-19T08:19:22.8133012Z [cluster2]                 "effect": "NoSchedule",
2021-07-19T08:19:22.8133973Z [cluster2]                 "key": "node.kubernetes.io/memory-pressure",
2021-07-19T08:19:22.8134715Z [cluster2]                 "operator": "Exists"
2021-07-19T08:19:22.8135343Z [cluster2]             },
2021-07-19T08:19:22.8135755Z [cluster2]             {
2021-07-19T08:19:22.8136286Z [cluster2]                 "effect": "NoSchedule",
2021-07-19T08:19:22.8138089Z [cluster2]                 "key": "node.kubernetes.io/pid-pressure",
2021-07-19T08:19:22.8139048Z [cluster2]                 "operator": "Exists"
2021-07-19T08:19:22.8139548Z [cluster2]             },
2021-07-19T08:19:22.8139972Z [cluster2]             {
2021-07-19T08:19:22.8140500Z [cluster2]                 "effect": "NoSchedule",
2021-07-19T08:19:22.8141259Z [cluster2]                 "key": "node.kubernetes.io/unschedulable",
2021-07-19T08:19:22.8141996Z [cluster2]                 "operator": "Exists"
2021-07-19T08:19:22.8142484Z [cluster2]             },
2021-07-19T08:19:22.8142906Z [cluster2]             {
2021-07-19T08:19:22.8143424Z [cluster2]                 "effect": "NoSchedule",
2021-07-19T08:19:22.8144529Z [cluster2]                 "key": "node.kubernetes.io/network-unavailable",
2021-07-19T08:19:22.8145315Z [cluster2]                 "operator": "Exists"
2021-07-19T08:19:22.8145820Z [cluster2]             }
2021-07-19T08:19:22.8146223Z [cluster2]         ],
2021-07-19T08:19:22.8146677Z [cluster2]         "volumes": [
2021-07-19T08:19:22.8147118Z [cluster2]             {
2021-07-19T08:19:22.8147597Z [cluster2]                 "emptyDir": {},
2021-07-19T08:19:22.8148122Z [cluster2]                 "name": "ipsecd"
2021-07-19T08:19:22.8148604Z [cluster2]             },
2021-07-19T08:19:22.8149029Z [cluster2]             {
2021-07-19T08:19:22.8149495Z [cluster2]                 "emptyDir": {},
2021-07-19T08:19:22.8150083Z [cluster2]                 "name": "ipsecnss"
2021-07-19T08:19:22.8150560Z [cluster2]             },
2021-07-19T08:19:22.8150993Z [cluster2]             {
2021-07-19T08:19:22.8151925Z [cluster2]                 "name": "submariner-gateway-token-cz5rk",
2021-07-19T08:19:22.8152715Z [cluster2]                 "secret": {
2021-07-19T08:19:22.8153240Z [cluster2]                     "defaultMode": 420,
2021-07-19T08:19:22.8154306Z [cluster2]                     "secretName": "submariner-gateway-token-cz5rk"
2021-07-19T08:19:22.8155099Z [cluster2]                 }
2021-07-19T08:19:22.8155523Z [cluster2]             }
2021-07-19T08:19:22.8155940Z [cluster2]         ]
2021-07-19T08:19:22.8156338Z [cluster2]     },
2021-07-19T08:19:22.8156778Z [cluster2]     "status": {
2021-07-19T08:19:22.8157263Z [cluster2]         "conditions": [
2021-07-19T08:19:22.8157876Z [cluster2]             {
2021-07-19T08:19:22.8158404Z [cluster2]                 "lastProbeTime": null,
2021-07-19T08:19:22.8159318Z [cluster2]                 "lastTransitionTime": "2021-07-19T08:18:16Z",
2021-07-19T08:19:22.8159958Z [cluster2]                 "status": "True",
2021-07-19T08:19:22.8160529Z [cluster2]                 "type": "Initialized"
2021-07-19T08:19:22.8161104Z [cluster2]             },
2021-07-19T08:19:22.8161498Z [cluster2]             {
2021-07-19T08:19:22.8161978Z [cluster2]                 "lastProbeTime": null,
2021-07-19T08:19:22.8162817Z [cluster2]                 "lastTransitionTime": "2021-07-19T08:18:38Z",
2021-07-19T08:19:22.8163421Z [cluster2]                 "status": "True",
2021-07-19T08:19:22.8289692Z [cluster2]  ]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway[0m
2021-07-19T08:19:22.8291097Z [36m[submariner-operator]$ [cluster1] daemonset_app=submariner-gateway[0m
2021-07-19T08:19:22.8292422Z [36m[submariner-operator]$ [cluster1] daemonset_name=submariner-gateway[0m
2021-07-19T08:19:22.8293659Z [36m[submariner-operator]$ [cluster1] with_retries 60 daemonset_created[0m
2021-07-19T08:19:22.8294839Z [36m[submariner-operator]$ [cluster1] with_retries 60 daemonset_created[0m
2021-07-19T08:19:22.8295910Z [36m[submariner-operator]$ [cluster1] iteration=1[0m
2021-07-19T08:19:22.8296950Z [36m[submariner-operator]$ [cluster1] wait 8749[0m
2021-07-19T08:19:22.8298055Z [36m[submariner-operator]$ [cluster1] daemonset_created[0m
2021-07-19T08:19:22.8299023Z [36m[submariner-operator]$ [cluster1] daemonset_created[0m
2021-07-19T08:19:22.8299940Z [cluster1] [36m[0m
2021-07-19T08:19:22.8300639Z [36m[submariner-operator]$ [cluster1] return 0[0m
2021-07-19T08:19:22.8301739Z [36m[submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed[0m
2021-07-19T08:19:22.8303171Z [36m[submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed[0m
2021-07-19T08:19:22.8304261Z [36m[submariner-operator]$ [cluster1] iteration=1[0m
2021-07-19T08:19:22.8305214Z [36m[submariner-operator]$ [cluster1] wait 8776[0m
2021-07-19T08:19:22.8306292Z [36m[submariner-operator]$ [cluster1] daemonset_deployed[0m
2021-07-19T08:19:22.8307405Z [36m[submariner-operator]$ [cluster1] daemonset_deployed[0m
2021-07-19T08:19:22.8309035Z [36m[submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}[0m
2021-07-19T08:19:22.8311176Z [36m[submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}[0m
2021-07-19T08:19:22.8313433Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}[0m
2021-07-19T08:19:22.8315584Z [36m[submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}[0m
2021-07-19T08:19:22.8317267Z [36m[submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}[0m
2021-07-19T08:19:22.8319055Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}[0m
2021-07-19T08:19:22.8320396Z [36m[submariner-operator]$ [cluster1] return 0[0m
2021-07-19T08:19:22.8321346Z [36m[submariner-operator]$ [cluster1] verify_subm_gateway_pod[0m
2021-07-19T08:19:22.8322330Z [36m[submariner-operator]$ [cluster1] verify_subm_gateway_pod[0m
2021-07-19T08:19:22.8324025Z [36m[submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator[0m
2021-07-19T08:19:22.8326042Z [36m[submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator[0m
2021-07-19T08:19:22.8328210Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator[0m
2021-07-19T08:19:22.8329769Z [cluster1] pod/submariner-gateway-jkqtk condition met
2021-07-19T08:19:22.8331307Z [36m[submariner-operator]$ [cluster1] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')[0m
2021-07-19T08:19:22.8355241Z [36m[submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-19T08:19:22.8357776Z [36m[submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-19T08:19:22.8360250Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-19T08:19:22.8362397Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/submariner-gateway-jkqtk.cluster1.json[0m
2021-07-19T08:19:22.8364338Z [36m[submariner-operator]$ [cluster1] kubectl get pod submariner-gateway-jkqtk --namespace=submariner-operator -o json[0m
2021-07-19T08:19:22.8386228Z [36m[submariner-operator]$ [cluster1] tee /tmp/submariner-gateway-jkqtk.cluster1.json[0m
2021-07-19T08:19:22.8388034Z [36m[submariner-operator]$ [cluster1] kubectl get pod submariner-gateway-jkqtk --namespace=submariner-operator -o json[0m
2021-07-19T08:19:22.8390183Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-gateway-jkqtk --namespace=submariner-operator -o json[0m
2021-07-19T08:19:22.8391552Z [cluster1] {
2021-07-19T08:19:22.8392022Z [cluster1]     "apiVersion": "v1",
2021-07-19T08:19:22.8392541Z [cluster1]     "kind": "Pod",
2021-07-19T08:19:22.8393020Z [cluster1]     "metadata": {
2021-07-19T08:19:22.8393860Z [cluster1]         "creationTimestamp": "2021-07-19T08:17:57Z",
2021-07-19T08:19:22.8394938Z [cluster1]         "generateName": "submariner-gateway-",
2021-07-19T08:19:22.8395569Z [cluster1]         "labels": {
2021-07-19T08:19:22.8396269Z [cluster1]             "app": "submariner-gateway",
2021-07-19T08:19:22.8397200Z [cluster1]             "controller-revision-hash": "788fd47c9b",
2021-07-19T08:19:22.8398252Z [cluster1]             "gateway.submariner.io/node": "cluster1-worker",
2021-07-19T08:19:22.8399100Z [cluster1]             "gateway.submariner.io/status": "active",
2021-07-19T08:19:22.8400048Z [cluster1]             "pod-template-generation": "1"
2021-07-19T08:19:22.8400618Z [cluster1]         },
2021-07-19T08:19:22.8401375Z [cluster1]         "name": "submariner-gateway-jkqtk",
2021-07-19T08:19:22.8402303Z [cluster1]         "namespace": "submariner-operator",
2021-07-19T08:19:22.8403186Z [cluster1]         "ownerReferences": [
2021-07-19T08:19:22.8403703Z [cluster1]             {
2021-07-19T08:19:22.8404222Z [cluster1]                 "apiVersion": "apps/v1",
2021-07-19T08:19:22.8405973Z [cluster1]                 "blockOwnerDeletion": true,
2021-07-19T08:19:22.8406828Z [cluster1]                 "controller": true,
2021-07-19T08:19:22.8407420Z [cluster1]                 "kind": "DaemonSet",
2021-07-19T08:19:22.8408359Z [cluster1]                 "name": "submariner-gateway",
2021-07-19T08:19:22.8409329Z [cluster1]                 "uid": "f07482e6-7e12-449e-b975-f870b41077a6"
2021-07-19T08:19:22.8410097Z [cluster1]             }
2021-07-19T08:19:22.8410496Z [cluster1]         ],
2021-07-19T08:19:22.8410984Z [cluster1]         "resourceVersion": "2010",
2021-07-19T08:19:22.8412174Z [cluster1]         "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-gateway-jkqtk",
2021-07-19T08:19:22.8413797Z [cluster1]         "uid": "b13e4947-ce1d-476a-9b30-e1ba41e0c09c"
2021-07-19T08:19:22.8414382Z [cluster1]     },
2021-07-19T08:19:22.8414793Z [cluster1]     "spec": {
2021-07-19T08:19:22.8415226Z [cluster1]         "affinity": {
2021-07-19T08:19:22.8415725Z [cluster1]             "nodeAffinity": {
2021-07-19T08:19:22.8416939Z [cluster1]                 "requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-19T08:19:22.8418089Z [cluster1]                     "nodeSelectorTerms": [
2021-07-19T08:19:22.8418612Z [cluster1]                         {
2021-07-19T08:19:22.8419104Z [cluster1]                             "matchFields": [
2021-07-19T08:19:22.8419581Z [cluster1]                                 {
2021-07-19T08:19:22.8420105Z [cluster1]                                     "key": "metadata.name",
2021-07-19T08:19:22.8420678Z [cluster1]                                     "operator": "In",
2021-07-19T08:19:22.8421185Z [cluster1]                                     "values": [
2021-07-19T08:19:22.8421936Z [cluster1]                                         "cluster1-worker"
2021-07-19T08:19:22.8422452Z [cluster1]                                     ]
2021-07-19T08:19:22.8422887Z [cluster1]                                 }
2021-07-19T08:19:22.8423296Z [cluster1]                             ]
2021-07-19T08:19:22.8423712Z [cluster1]                         }
2021-07-19T08:19:22.8424113Z [cluster1]                     ]
2021-07-19T08:19:22.8424516Z [cluster1]                 }
2021-07-19T08:19:22.8424992Z [cluster1]             },
2021-07-19T08:19:22.8425428Z [cluster1]             "podAntiAffinity": {
2021-07-19T08:19:22.8426407Z [cluster1]                 "requiredDuringSchedulingIgnoredDuringExecution": [
2021-07-19T08:19:22.8427287Z [cluster1]                     {
2021-07-19T08:19:22.8427724Z [cluster1]                         "labelSelector": {
2021-07-19T08:19:22.8428321Z [cluster1]                             "matchLabels": {
2021-07-19T08:19:22.8429039Z [cluster1]                                 "app": "submariner-gateway"
2021-07-19T08:19:22.8429518Z [cluster1]                             }
2021-07-19T08:19:22.8429885Z [cluster1]                         },
2021-07-19T08:19:22.8430399Z [cluster1]                         "topologyKey": "kubernetes.io/hostname"
2021-07-19T08:19:22.8430914Z [cluster1]                     }
2021-07-19T08:19:22.8433464Z [cluster1]                 ]
2021-07-19T08:19:22.8433868Z [cluster1]             }
2021-07-19T08:19:22.8434260Z [cluster1]         },
2021-07-19T08:19:22.8434690Z [cluster1]         "containers": [
2021-07-19T08:19:22.8435131Z [cluster1]             {
2021-07-19T08:19:22.8435548Z [cluster1]                 "command": [
2021-07-19T08:19:22.8436059Z [cluster1]                     "submariner.sh"
2021-07-19T08:19:22.8436520Z [cluster1]                 ],
2021-07-19T08:19:22.8436944Z [cluster1]                 "env": [
2021-07-19T08:19:22.8437354Z [cluster1]                     {
2021-07-19T08:19:22.8437885Z [cluster1]                         "name": "SUBMARINER_NAMESPACE",
2021-07-19T08:19:22.8438866Z [cluster1]                         "value": "submariner-operator"
2021-07-19T08:19:22.8439439Z [cluster1]                     },
2021-07-19T08:19:22.8439853Z [cluster1]                     {
2021-07-19T08:19:22.8440378Z [cluster1]                         "name": "SUBMARINER_CLUSTERCIDR",
2021-07-19T08:19:22.8440968Z [cluster1]                         "value": "10.0.0.0/16"
2021-07-19T08:19:22.8441400Z [cluster1]                     },
2021-07-19T08:19:22.8441808Z [cluster1]                     {
2021-07-19T08:19:22.8442343Z [cluster1]                         "name": "SUBMARINER_SERVICECIDR",
2021-07-19T08:19:22.8442926Z [cluster1]                         "value": "100.0.0.0/16"
2021-07-19T08:19:22.8443357Z [cluster1]                     },
2021-07-19T08:19:22.8443760Z [cluster1]                     {
2021-07-19T08:19:22.8454189Z [cluster1]                         "name": "SUBMARINER_GLOBALCIDR",
2021-07-19T08:19:22.8454856Z [cluster1]                         "value": "242.254.1.0/24"
2021-07-19T08:19:22.8455348Z [cluster1]                     },
2021-07-19T08:19:22.8455778Z [cluster1]                     {
2021-07-19T08:19:22.8456346Z [cluster1]                         "name": "SUBMARINER_CLUSTERID",
2021-07-19T08:19:22.8456966Z [cluster1]                         "value": "cluster1"
2021-07-19T08:19:22.8457648Z [cluster1]                     },
2021-07-19T08:19:22.8458086Z [cluster1]                     {
2021-07-19T08:19:22.8458663Z [cluster1]                         "name": "SUBMARINER_COLORCODES",
2021-07-19T08:19:22.8459268Z [cluster1]                         "value": "blue"
2021-07-19T08:19:22.8459857Z [cluster1]                     },
2021-07-19T08:19:22.8460267Z [cluster1]                     {
2021-07-19T08:19:22.8460917Z [cluster1]                         "name": "SUBMARINER_DEBUG",
2021-07-19T08:19:22.8461447Z [cluster1]                         "value": "false"
2021-07-19T08:19:22.8461936Z [cluster1]                     },
2021-07-19T08:19:22.8462329Z [cluster1]                     {
2021-07-19T08:19:22.8462864Z [cluster1]                         "name": "SUBMARINER_NATENABLED",
2021-07-19T08:19:22.8463431Z [cluster1]                         "value": "false"
2021-07-19T08:19:22.8463889Z [cluster1]                     },
2021-07-19T0