dfarrell07/logs.txt

## logs.txt
2021-07-20T02:17:26.2031265Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-20T02:17:26.2031320Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-20T02:17:34.8101412Z Current runner version: '2.278.0'
2021-07-20T02:17:34.8129614Z ##[group]Operating System
2021-07-20T02:17:34.8130584Z Ubuntu
2021-07-20T02:17:34.8131105Z 20.04.2
2021-07-20T02:17:34.8131555Z LTS
2021-07-20T02:17:34.8132130Z ##[endgroup]
2021-07-20T02:17:34.8132746Z ##[group]Virtual Environment
2021-07-20T02:17:34.8133489Z Environment: ubuntu-20.04
2021-07-20T02:17:34.8134075Z Version: 20210712.0
2021-07-20T02:17:34.8135226Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210712.0/images/linux/Ubuntu2004-README.md
2021-07-20T02:17:34.8136720Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210712.0
2021-07-20T02:17:34.8137737Z ##[endgroup]
2021-07-20T02:17:34.8139986Z ##[group]GITHUB_TOKEN Permissions
2021-07-20T02:17:34.8141338Z Actions: write
2021-07-20T02:17:34.8141881Z Checks: write
2021-07-20T02:17:34.8142731Z Contents: write
2021-07-20T02:17:34.8143313Z Deployments: write
2021-07-20T02:17:34.8144035Z Discussions: write
2021-07-20T02:17:34.8144662Z Issues: write
2021-07-20T02:17:34.8145258Z Metadata: read
2021-07-20T02:17:34.8145822Z Packages: write
2021-07-20T02:17:34.8146456Z PullRequests: write
2021-07-20T02:17:34.8147129Z RepositoryProjects: write
2021-07-20T02:17:34.8147888Z SecurityEvents: write
2021-07-20T02:17:34.8148476Z Statuses: write
2021-07-20T02:17:34.8149198Z ##[endgroup]
2021-07-20T02:17:34.8152480Z Prepare workflow directory
2021-07-20T02:17:34.8828304Z Prepare all required actions
2021-07-20T02:17:34.8840238Z Getting action download info
2021-07-20T02:17:35.3300281Z Download action repository 'actions/checkout@v2'
2021-07-20T02:17:37.4187860Z Download action repository 'submariner-io/shipyard@devel'
2021-07-20T02:17:37.7963992Z ##[group]Run actions/checkout@v2
2021-07-20T02:17:37.7964708Z with:
2021-07-20T02:17:37.7965415Z   repository: submariner-io/submariner-operator
2021-07-20T02:17:37.7966653Z   token: ***
2021-07-20T02:17:37.7967171Z   ssh-strict: true
2021-07-20T02:17:37.7967782Z   persist-credentials: true
2021-07-20T02:17:37.7968399Z   clean: true
2021-07-20T02:17:37.7968894Z   fetch-depth: 1
2021-07-20T02:17:37.7969395Z   lfs: false
2021-07-20T02:17:37.7969982Z   submodules: false
2021-07-20T02:17:37.7970469Z ##[endgroup]
2021-07-20T02:17:38.0360166Z Syncing repository: submariner-io/submariner-operator
2021-07-20T02:17:38.0374969Z ##[group]Getting Git version info
2021-07-20T02:17:38.0376448Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-20T02:17:38.0416186Z [command]/usr/bin/git version
2021-07-20T02:17:38.0558075Z git version 2.32.0
2021-07-20T02:17:38.0579462Z ##[endgroup]
2021-07-20T02:17:38.0586887Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-20T02:17:38.0590703Z ##[group]Initializing the repository
2021-07-20T02:17:38.0595473Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-20T02:17:38.0680234Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-20T02:17:38.5056003Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-20T02:17:38.5110377Z hint: of your new repositories, which will suppress this warning, call:
2021-07-20T02:17:38.5116511Z hint:
2021-07-20T02:17:38.5117975Z hint: 	git config --global init.defaultBranch <name>
2021-07-20T02:17:38.5118764Z hint:
2021-07-20T02:17:38.5119768Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-20T02:17:38.5121041Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-20T02:17:38.5121907Z hint:
2021-07-20T02:17:38.5122696Z hint: 	git branch -m <name>
2021-07-20T02:17:38.5124067Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-20T02:17:38.5125822Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-20T02:17:38.5126971Z ##[endgroup]
2021-07-20T02:17:38.5127792Z ##[group]Disabling automatic garbage collection
2021-07-20T02:17:38.5129150Z [command]/usr/bin/git config --local gc.auto 0
2021-07-20T02:17:38.5129897Z ##[endgroup]
2021-07-20T02:17:38.5131933Z ##[group]Setting up auth
2021-07-20T02:17:38.5133096Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-20T02:17:38.5134898Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-20T02:17:38.5136720Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-20T02:17:38.5138948Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-20T02:17:38.5141115Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-20T02:17:38.5142220Z ##[endgroup]
2021-07-20T02:17:38.5144697Z ##[group]Fetching the repository
2021-07-20T02:17:38.5146545Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +0105e4d08ef7236073547f1383566fc76c548f6d:refs/remotes/origin/devel
2021-07-20T02:17:38.5148044Z remote: Enumerating objects: 486, done.
2021-07-20T02:17:38.5148864Z remote: Counting objects:   0% (1/486)
2021-07-20T02:17:38.5149614Z remote: Counting objects:   1% (5/486)
2021-07-20T02:17:38.5150379Z remote: Counting objects:   2% (10/486)
2021-07-20T02:17:38.5151143Z remote: Counting objects:   3% (15/486)
2021-07-20T02:17:38.5152104Z remote: Counting objects:   4% (20/486)
2021-07-20T02:17:38.5152895Z remote: Counting objects:   5% (25/486)
2021-07-20T02:17:38.5153650Z remote: Counting objects:   6% (30/486)
2021-07-20T02:17:38.5154421Z remote: Counting objects:   7% (35/486)
2021-07-20T02:17:38.5155594Z remote: Counting objects:   8% (39/486)
2021-07-20T02:17:38.5156347Z remote: Counting objects:   9% (44/486)
2021-07-20T02:17:38.5157118Z remote: Counting objects:  10% (49/486)
2021-07-20T02:17:38.5157880Z remote: Counting objects:  11% (54/486)
2021-07-20T02:17:38.5158632Z remote: Counting objects:  12% (59/486)
2021-07-20T02:17:38.5159402Z remote: Counting objects:  13% (64/486)
2021-07-20T02:17:38.5160238Z remote: Counting objects:  14% (69/486)
2021-07-20T02:17:38.5161007Z remote: Counting objects:  15% (73/486)
2021-07-20T02:17:38.5161770Z remote: Counting objects:  16% (78/486)
2021-07-20T02:17:38.5162531Z remote: Counting objects:  17% (83/486)
2021-07-20T02:17:38.5163296Z remote: Counting objects:  18% (88/486)
2021-07-20T02:17:38.5164075Z remote: Counting objects:  19% (93/486)
2021-07-20T02:17:38.5164861Z remote: Counting objects:  20% (98/486)
2021-07-20T02:17:38.5165635Z remote: Counting objects:  21% (103/486)
2021-07-20T02:17:38.5166404Z remote: Counting objects:  22% (107/486)
2021-07-20T02:17:38.5167172Z remote: Counting objects:  23% (112/486)
2021-07-20T02:17:38.5167950Z remote: Counting objects:  24% (117/486)
2021-07-20T02:17:38.5168725Z remote: Counting objects:  25% (122/486)
2021-07-20T02:17:38.5169492Z remote: Counting objects:  26% (127/486)
2021-07-20T02:17:38.5170240Z remote: Counting objects:  27% (132/486)
2021-07-20T02:17:38.5171009Z remote: Counting objects:  28% (137/486)
2021-07-20T02:17:38.5171777Z remote: Counting objects:  29% (141/486)
2021-07-20T02:17:38.5172538Z remote: Counting objects:  30% (146/486)
2021-07-20T02:17:38.5173302Z remote: Counting objects:  31% (151/486)
2021-07-20T02:17:38.5174047Z remote: Counting objects:  32% (156/486)
2021-07-20T02:17:38.5174815Z remote: Counting objects:  33% (161/486)
2021-07-20T02:17:38.5175587Z remote: Counting objects:  34% (166/486)
2021-07-20T02:17:38.5176501Z remote: Counting objects:  35% (171/486)
2021-07-20T02:17:38.5177269Z remote: Counting objects:  36% (175/486)
2021-07-20T02:17:38.5178044Z remote: Counting objects:  37% (180/486)
2021-07-20T02:17:38.5178801Z remote: Counting objects:  38% (185/486)
2021-07-20T02:17:38.5179502Z remote: Counting objects:  39% (190/486)
2021-07-20T02:17:38.5180136Z remote: Counting objects:  40% (195/486)
2021-07-20T02:17:38.5180784Z remote: Counting objects:  41% (200/486)
2021-07-20T02:17:38.5181416Z remote: Counting objects:  42% (205/486)
2021-07-20T02:17:38.5182072Z remote: Counting objects:  43% (209/486)
2021-07-20T02:17:38.5182874Z remote: Counting objects:  44% (214/486)
2021-07-20T02:17:38.5183667Z remote: Counting objects:  45% (219/486)
2021-07-20T02:17:38.5184433Z remote: Counting objects:  46% (224/486)
2021-07-20T02:17:38.5185186Z remote: Counting objects:  47% (229/486)
2021-07-20T02:17:38.5185978Z remote: Counting objects:  48% (234/486)
2021-07-20T02:17:38.5186739Z remote: Counting objects:  49% (239/486)
2021-07-20T02:17:38.5187488Z remote: Counting objects:  50% (243/486)
2021-07-20T02:17:38.5188253Z remote: Counting objects:  51% (248/486)
2021-07-20T02:17:38.5188998Z remote: Counting objects:  52% (253/486)
2021-07-20T02:17:38.5189766Z remote: Counting objects:  53% (258/486)
2021-07-20T02:17:38.5190531Z remote: Counting objects:  54% (263/486)
2021-07-20T02:17:38.5191284Z remote: Counting objects:  55% (268/486)
2021-07-20T02:17:38.5192153Z remote: Counting objects:  56% (273/486)
2021-07-20T02:17:38.5192927Z remote: Counting objects:  57% (278/486)
2021-07-20T02:17:38.5193777Z remote: Counting objects:  58% (282/486)
2021-07-20T02:17:38.5194489Z remote: Counting objects:  59% (287/486)
2021-07-20T02:17:38.5195187Z remote: Counting objects:  60% (292/486)
2021-07-20T02:17:38.5195906Z remote: Counting objects:  61% (297/486)
2021-07-20T02:17:38.5196610Z remote: Counting objects:  62% (302/486)
2021-07-20T02:17:38.5197331Z remote: Counting objects:  63% (307/486)
2021-07-20T02:17:38.5198044Z remote: Counting objects:  64% (312/486)
2021-07-20T02:17:38.5198739Z remote: Counting objects:  65% (316/486)
2021-07-20T02:17:38.5199450Z remote: Counting objects:  66% (321/486)
2021-07-20T02:17:38.5200159Z remote: Counting objects:  67% (326/486)
2021-07-20T02:17:38.5200861Z remote: Counting objects:  68% (331/486)
2021-07-20T02:17:38.5201577Z remote: Counting objects:  69% (336/486)
2021-07-20T02:17:38.5202281Z remote: Counting objects:  70% (341/486)
2021-07-20T02:17:38.5202995Z remote: Counting objects:  71% (346/486)
2021-07-20T02:17:38.5203847Z remote: Counting objects:  72% (350/486)
2021-07-20T02:17:38.5204559Z remote: Counting objects:  73% (355/486)
2021-07-20T02:17:38.5205278Z remote: Counting objects:  74% (360/486)
2021-07-20T02:17:38.5205995Z remote: Counting objects:  75% (365/486)
2021-07-20T02:17:38.5206693Z remote: Counting objects:  76% (370/486)
2021-07-20T02:17:38.5207412Z remote: Counting objects:  77% (375/486)
2021-07-20T02:17:38.5208127Z remote: Counting objects:  78% (380/486)
2021-07-20T02:17:38.5208825Z remote: Counting objects:  79% (384/486)
2021-07-20T02:17:38.5209532Z remote: Counting objects:  80% (389/486)
2021-07-20T02:17:38.5210231Z remote: Counting objects:  81% (394/486)
2021-07-20T02:17:38.5210947Z remote: Counting objects:  82% (399/486)
2021-07-20T02:17:38.5211660Z remote: Counting objects:  83% (404/486)
2021-07-20T02:17:38.5212357Z remote: Counting objects:  84% (409/486)
2021-07-20T02:17:38.5213066Z remote: Counting objects:  85% (414/486)
2021-07-20T02:17:38.5213757Z remote: Counting objects:  86% (418/486)
2021-07-20T02:17:38.5214600Z remote: Counting objects:  87% (423/486)
2021-07-20T02:17:38.5215511Z remote: Counting objects:  88% (428/486)
2021-07-20T02:17:38.5216261Z remote: Counting objects:  89% (433/486)
2021-07-20T02:17:38.5217027Z remote: Counting objects:  90% (438/486)
2021-07-20T02:17:38.5217779Z remote: Counting objects:  91% (443/486)
2021-07-20T02:17:38.5218553Z remote: Counting objects:  92% (448/486)
2021-07-20T02:17:38.5219317Z remote: Counting objects:  93% (452/486)
2021-07-20T02:17:38.5220062Z remote: Counting objects:  94% (457/486)
2021-07-20T02:17:38.5220830Z remote: Counting objects:  95% (462/486)
2021-07-20T02:17:38.5221612Z remote: Counting objects:  96% (467/486)
2021-07-20T02:17:38.5222525Z remote: Counting objects:  97% (472/486)
2021-07-20T02:17:38.5223312Z remote: Counting objects:  98% (477/486)
2021-07-20T02:17:38.5224067Z remote: Counting objects:  99% (482/486)
2021-07-20T02:17:38.5224835Z remote: Counting objects: 100% (486/486)
2021-07-20T02:17:38.5225637Z remote: Counting objects: 100% (486/486), done.
2021-07-20T02:17:38.5226519Z remote: Compressing objects:   0% (1/353)
2021-07-20T02:17:38.5227336Z remote: Compressing objects:   1% (4/353)
2021-07-20T02:17:38.5228139Z remote: Compressing objects:   2% (8/353)
2021-07-20T02:17:38.5228957Z remote: Compressing objects:   3% (11/353)
2021-07-20T02:17:38.5229775Z remote: Compressing objects:   4% (15/353)
2021-07-20T02:17:38.5230588Z remote: Compressing objects:   5% (18/353)
2021-07-20T02:17:38.5231408Z remote: Compressing objects:   6% (22/353)
2021-07-20T02:17:38.5232312Z remote: Compressing objects:   7% (25/353)
2021-07-20T02:17:38.5233151Z remote: Compressing objects:   8% (29/353)
2021-07-20T02:17:38.5233977Z remote: Compressing objects:   9% (32/353)
2021-07-20T02:17:38.5234807Z remote: Compressing objects:  10% (36/353)
2021-07-20T02:17:38.5236172Z remote: Compressing objects:  11% (39/353)
2021-07-20T02:17:38.5314240Z remote: Compressing objects:  12% (43/353)
2021-07-20T02:17:38.5315133Z remote: Compressing objects:  13% (46/353)
2021-07-20T02:17:38.5315923Z remote: Compressing objects:  14% (50/353)
2021-07-20T02:17:38.5316691Z remote: Compressing objects:  15% (53/353)
2021-07-20T02:17:38.5317454Z remote: Compressing objects:  16% (57/353)
2021-07-20T02:17:38.5318223Z remote: Compressing objects:  17% (61/353)
2021-07-20T02:17:38.5319168Z remote: Compressing objects:  18% (64/353)
2021-07-20T02:17:38.5319984Z remote: Compressing objects:  19% (68/353)
2021-07-20T02:17:38.5320922Z remote: Compressing objects:  20% (71/353)
2021-07-20T02:17:38.5321734Z remote: Compressing objects:  21% (75/353)
2021-07-20T02:17:38.5322490Z remote: Compressing objects:  22% (78/353)
2021-07-20T02:17:38.5323233Z remote: Compressing objects:  23% (82/353)
2021-07-20T02:17:38.5324099Z remote: Compressing objects:  24% (85/353)
2021-07-20T02:17:38.5324856Z remote: Compressing objects:  25% (89/353)
2021-07-20T02:17:38.5325609Z remote: Compressing objects:  26% (92/353)
2021-07-20T02:17:38.5326360Z remote: Compressing objects:  27% (96/353)
2021-07-20T02:17:38.5327096Z remote: Compressing objects:  28% (99/353)
2021-07-20T02:17:38.5327856Z remote: Compressing objects:  29% (103/353)
2021-07-20T02:17:38.5328594Z remote: Compressing objects:  30% (106/353)
2021-07-20T02:17:38.5329347Z remote: Compressing objects:  31% (110/353)
2021-07-20T02:17:38.5330112Z remote: Compressing objects:  32% (113/353)
2021-07-20T02:17:38.5330853Z remote: Compressing objects:  33% (117/353)
2021-07-20T02:17:38.5331617Z remote: Compressing objects:  34% (121/353)
2021-07-20T02:17:38.5332366Z remote: Compressing objects:  35% (124/353)
2021-07-20T02:17:38.5333105Z remote: Compressing objects:  36% (128/353)
2021-07-20T02:17:38.5334071Z remote: Compressing objects:  37% (131/353)
2021-07-20T02:17:38.5334816Z remote: Compressing objects:  38% (135/353)
2021-07-20T02:17:38.5335786Z remote: Compressing objects:  39% (138/353)
2021-07-20T02:17:38.5336597Z remote: Compressing objects:  40% (142/353)
2021-07-20T02:17:38.5337393Z remote: Compressing objects:  41% (145/353)
2021-07-20T02:17:38.5338207Z remote: Compressing objects:  42% (149/353)
2021-07-20T02:17:38.5339005Z remote: Compressing objects:  43% (152/353)
2021-07-20T02:17:38.5339817Z remote: Compressing objects:  44% (156/353)
2021-07-20T02:17:38.5340638Z remote: Compressing objects:  45% (159/353)
2021-07-20T02:17:38.5341437Z remote: Compressing objects:  46% (163/353)
2021-07-20T02:17:38.5342247Z remote: Compressing objects:  47% (166/353)
2021-07-20T02:17:38.5343681Z remote: Compressing objects:  48% (170/353)
2021-07-20T02:17:38.5344513Z remote: Compressing objects:  49% (173/353)
2021-07-20T02:17:38.5345329Z remote: Compressing objects:  50% (177/353)
2021-07-20T02:17:38.5346125Z remote: Compressing objects:  51% (181/353)
2021-07-20T02:17:38.5346932Z remote: Compressing objects:  52% (184/353)
2021-07-20T02:17:38.5347837Z remote: Compressing objects:  53% (188/353)
2021-07-20T02:17:38.5348581Z remote: Compressing objects:  54% (191/353)
2021-07-20T02:17:38.5349328Z remote: Compressing objects:  55% (195/353)
2021-07-20T02:17:38.5350065Z remote: Compressing objects:  56% (198/353)
2021-07-20T02:17:38.5350880Z remote: Compressing objects:  57% (202/353)
2021-07-20T02:17:38.5352088Z remote: Compressing objects:  58% (205/353)
2021-07-20T02:17:38.5352920Z remote: Compressing objects:  59% (209/353)
2021-07-20T02:17:38.5353740Z remote: Compressing objects:  60% (212/353)
2021-07-20T02:17:38.5354554Z remote: Compressing objects:  61% (216/353)
2021-07-20T02:17:38.5355366Z remote: Compressing objects:  62% (219/353)
2021-07-20T02:17:38.5356186Z remote: Compressing objects:  63% (223/353)
2021-07-20T02:17:38.5356994Z remote: Compressing objects:  64% (226/353)
2021-07-20T02:17:38.5357814Z remote: Compressing objects:  65% (230/353)
2021-07-20T02:17:38.5358634Z remote: Compressing objects:  66% (233/353)
2021-07-20T02:17:38.5359436Z remote: Compressing objects:  67% (237/353)
2021-07-20T02:17:38.5360260Z remote: Compressing objects:  68% (241/353)
2021-07-20T02:17:38.5361060Z remote: Compressing objects:  69% (244/353)
2021-07-20T02:17:38.5361877Z remote: Compressing objects:  70% (248/353)
2021-07-20T02:17:38.5362690Z remote: Compressing objects:  71% (251/353)
2021-07-20T02:17:38.5363490Z remote: Compressing objects:  72% (255/353)
2021-07-20T02:17:38.5364307Z remote: Compressing objects:  73% (258/353)
2021-07-20T02:17:38.5365138Z remote: Compressing objects:  74% (262/353)
2021-07-20T02:17:38.5365963Z remote: Compressing objects:  75% (265/353)
2021-07-20T02:17:38.5366775Z remote: Compressing objects:  76% (269/353)
2021-07-20T02:17:38.5367573Z remote: Compressing objects:  77% (272/353)
2021-07-20T02:17:38.5368388Z remote: Compressing objects:  78% (276/353)
2021-07-20T02:17:38.5369218Z remote: Compressing objects:  79% (279/353)
2021-07-20T02:17:38.5370017Z remote: Compressing objects:  80% (283/353)
2021-07-20T02:17:38.5370834Z remote: Compressing objects:  81% (286/353)
2021-07-20T02:17:38.5371635Z remote: Compressing objects:  82% (290/353)
2021-07-20T02:17:38.5372535Z remote: Compressing objects:  83% (293/353)
2021-07-20T02:17:38.5373356Z remote: Compressing objects:  84% (297/353)
2021-07-20T02:17:38.5374155Z remote: Compressing objects:  85% (301/353)
2021-07-20T02:17:38.5374967Z remote: Compressing objects:  86% (304/353)
2021-07-20T02:17:38.5375887Z remote: Compressing objects:  87% (308/353)
2021-07-20T02:17:38.5376705Z remote: Compressing objects:  88% (311/353)
2021-07-20T02:17:38.5377518Z remote: Compressing objects:  89% (315/353)
2021-07-20T02:17:38.5378316Z remote: Compressing objects:  90% (318/353)
2021-07-20T02:17:38.5379130Z remote: Compressing objects:  91% (322/353)
2021-07-20T02:17:38.5379944Z remote: Compressing objects:  92% (325/353)
2021-07-20T02:17:38.5380743Z remote: Compressing objects:  93% (329/353)
2021-07-20T02:17:38.5381551Z remote: Compressing objects:  94% (332/353)
2021-07-20T02:17:38.5382354Z remote: Compressing objects:  95% (336/353)
2021-07-20T02:17:38.5383326Z remote: Compressing objects:  96% (339/353)
2021-07-20T02:17:38.5384138Z remote: Compressing objects:  97% (343/353)
2021-07-20T02:17:38.5384971Z remote: Compressing objects:  98% (346/353)
2021-07-20T02:17:38.5385773Z remote: Compressing objects:  99% (350/353)
2021-07-20T02:17:38.5386594Z remote: Compressing objects: 100% (353/353)
2021-07-20T02:17:38.5387434Z remote: Compressing objects: 100% (353/353), done.
2021-07-20T02:17:38.5388215Z Receiving objects:   0% (1/486)
2021-07-20T02:17:38.5388927Z Receiving objects:   1% (5/486)
2021-07-20T02:17:38.5389619Z Receiving objects:   2% (10/486)
2021-07-20T02:17:38.5390444Z Receiving objects:   3% (15/486)
2021-07-20T02:17:38.5391107Z Receiving objects:   4% (20/486)
2021-07-20T02:17:38.5391760Z Receiving objects:   5% (25/486)
2021-07-20T02:17:38.5392420Z Receiving objects:   6% (30/486)
2021-07-20T02:17:38.5393065Z Receiving objects:   7% (35/486)
2021-07-20T02:17:38.5393817Z Receiving objects:   8% (39/486)
2021-07-20T02:17:38.5394500Z Receiving objects:   9% (44/486)
2021-07-20T02:17:38.5395149Z Receiving objects:  10% (49/486)
2021-07-20T02:17:38.5395810Z Receiving objects:  11% (54/486)
2021-07-20T02:17:38.5396649Z Receiving objects:  12% (59/486)
2021-07-20T02:17:38.5397355Z Receiving objects:  13% (64/486)
2021-07-20T02:17:38.5398079Z Receiving objects:  14% (69/486)
2021-07-20T02:17:38.5398779Z Receiving objects:  15% (73/486)
2021-07-20T02:17:38.5399485Z Receiving objects:  16% (78/486)
2021-07-20T02:17:38.5400176Z Receiving objects:  17% (83/486)
2021-07-20T02:17:38.5400885Z Receiving objects:  18% (88/486)
2021-07-20T02:17:38.5401600Z Receiving objects:  19% (93/486)
2021-07-20T02:17:38.5402303Z Receiving objects:  20% (98/486)
2021-07-20T02:17:38.5403016Z Receiving objects:  21% (103/486)
2021-07-20T02:17:38.5403715Z Receiving objects:  22% (107/486)
2021-07-20T02:17:38.5404424Z Receiving objects:  23% (112/486)
2021-07-20T02:17:38.5405264Z Receiving objects:  24% (117/486)
2021-07-20T02:17:38.5405966Z Receiving objects:  25% (122/486)
2021-07-20T02:17:38.5406679Z Receiving objects:  26% (127/486)
2021-07-20T02:17:38.5407376Z Receiving objects:  27% (132/486)
2021-07-20T02:17:38.5408095Z Receiving objects:  28% (137/486)
2021-07-20T02:17:38.5408809Z Receiving objects:  29% (141/486)
2021-07-20T02:17:38.5409517Z Receiving objects:  30% (146/486)
2021-07-20T02:17:38.5410224Z Receiving objects:  31% (151/486)
2021-07-20T02:17:38.5410918Z Receiving objects:  32% (156/486)
2021-07-20T02:17:38.5411626Z Receiving objects:  33% (161/486)
2021-07-20T02:17:38.5412337Z Receiving objects:  34% (166/486)
2021-07-20T02:17:38.5413031Z Receiving objects:  35% (171/486)
2021-07-20T02:17:38.5413738Z Receiving objects:  36% (175/486)
2021-07-20T02:17:38.5414430Z Receiving objects:  37% (180/486)
2021-07-20T02:17:38.5415134Z Receiving objects:  38% (185/486)
2021-07-20T02:17:38.5415850Z Receiving objects:  39% (190/486)
2021-07-20T02:17:38.5416544Z Receiving objects:  40% (195/486)
2021-07-20T02:17:38.5417264Z Receiving objects:  41% (200/486)
2021-07-20T02:17:38.5417959Z Receiving objects:  42% (205/486)
2021-07-20T02:17:38.5418664Z Receiving objects:  43% (209/486)
2021-07-20T02:17:38.5419383Z Receiving objects:  44% (214/486)
2021-07-20T02:17:38.5420080Z Receiving objects:  45% (219/486)
2021-07-20T02:17:38.5420897Z Receiving objects:  46% (224/486)
2021-07-20T02:17:38.5421592Z Receiving objects:  47% (229/486)
2021-07-20T02:17:38.5422307Z Receiving objects:  48% (234/486)
2021-07-20T02:17:38.5423196Z Receiving objects:  49% (239/486)
2021-07-20T02:17:38.5423899Z Receiving objects:  50% (243/486)
2021-07-20T02:17:38.5424609Z Receiving objects:  51% (248/486)
2021-07-20T02:17:38.5425302Z Receiving objects:  52% (253/486)
2021-07-20T02:17:38.5426101Z Receiving objects:  53% (258/486)
2021-07-20T02:17:38.5426762Z Receiving objects:  54% (263/486)
2021-07-20T02:17:38.5427404Z Receiving objects:  55% (268/486)
2021-07-20T02:17:38.5428054Z Receiving objects:  56% (273/486)
2021-07-20T02:17:38.5428706Z Receiving objects:  57% (278/486)
2021-07-20T02:17:38.5429362Z Receiving objects:  58% (282/486)
2021-07-20T02:17:38.5430023Z Receiving objects:  59% (287/486)
2021-07-20T02:17:38.5430668Z Receiving objects:  60% (292/486)
2021-07-20T02:17:38.5431325Z Receiving objects:  61% (297/486)
2021-07-20T02:17:38.5431966Z Receiving objects:  62% (302/486)
2021-07-20T02:17:38.5432636Z Receiving objects:  63% (307/486)
2021-07-20T02:17:38.5433297Z Receiving objects:  64% (312/486)
2021-07-20T02:17:38.5433938Z Receiving objects:  65% (316/486)
2021-07-20T02:17:38.5434594Z Receiving objects:  66% (321/486)
2021-07-20T02:17:38.5435238Z Receiving objects:  67% (326/486)
2021-07-20T02:17:38.5435901Z Receiving objects:  68% (331/486)
2021-07-20T02:17:38.5436554Z Receiving objects:  69% (336/486)
2021-07-20T02:17:38.5437195Z Receiving objects:  70% (341/486)
2021-07-20T02:17:38.5437851Z Receiving objects:  71% (346/486)
2021-07-20T02:17:38.5438491Z Receiving objects:  72% (350/486)
2021-07-20T02:17:38.5439249Z Receiving objects:  73% (355/486)
2021-07-20T02:17:38.5439934Z Receiving objects:  74% (360/486)
2021-07-20T02:17:38.5440582Z Receiving objects:  75% (365/486)
2021-07-20T02:17:38.5441244Z Receiving objects:  76% (370/486)
2021-07-20T02:17:38.5441927Z Receiving objects:  77% (375/486)
2021-07-20T02:17:38.5442594Z Receiving objects:  78% (380/486)
2021-07-20T02:17:38.5443339Z Receiving objects:  79% (384/486)
2021-07-20T02:17:38.5444216Z Receiving objects:  80% (389/486)
2021-07-20T02:17:38.5444929Z Receiving objects:  81% (394/486)
2021-07-20T02:17:38.5445628Z Receiving objects:  82% (399/486)
2021-07-20T02:17:38.5446346Z Receiving objects:  83% (404/486)
2021-07-20T02:17:38.5447052Z Receiving objects:  84% (409/486)
2021-07-20T02:17:38.5447747Z Receiving objects:  85% (414/486)
2021-07-20T02:17:38.5448463Z Receiving objects:  86% (418/486)
2021-07-20T02:17:38.5449159Z Receiving objects:  87% (423/486)
2021-07-20T02:17:38.5449878Z Receiving objects:  88% (428/486)
2021-07-20T02:17:38.5450593Z Receiving objects:  89% (433/486)
2021-07-20T02:17:38.5451291Z Receiving objects:  90% (438/486)
2021-07-20T02:17:38.5451998Z Receiving objects:  91% (443/486)
2021-07-20T02:17:38.5452689Z Receiving objects:  92% (448/486)
2021-07-20T02:17:38.5453412Z Receiving objects:  93% (452/486)
2021-07-20T02:17:38.5454120Z Receiving objects:  94% (457/486)
2021-07-20T02:17:38.5454823Z Receiving objects:  95% (462/486)
2021-07-20T02:17:38.5455539Z Receiving objects:  96% (467/486)
2021-07-20T02:17:38.5456973Z remote: Total 486 (delta 154), reused 305 (delta 87), pack-reused 0
2021-07-20T02:17:38.5457850Z Receiving objects:  97% (472/486)
2021-07-20T02:17:38.5458567Z Receiving objects:  98% (477/486)
2021-07-20T02:17:38.5459258Z Receiving objects:  99% (482/486)
2021-07-20T02:17:38.5459972Z Receiving objects: 100% (486/486)
2021-07-20T02:17:38.5460763Z Receiving objects: 100% (486/486), 349.02 KiB | 7.27 MiB/s, done.
2021-07-20T02:17:38.5461523Z Resolving deltas:   0% (0/154)
2021-07-20T02:17:38.5462220Z Resolving deltas:   1% (2/154)
2021-07-20T02:17:38.5463046Z Resolving deltas:   2% (4/154)
2021-07-20T02:17:38.5463750Z Resolving deltas:   3% (5/154)
2021-07-20T02:17:38.5464555Z Resolving deltas:   4% (7/154)
2021-07-20T02:17:38.5465222Z Resolving deltas:   5% (8/154)
2021-07-20T02:17:38.5465869Z Resolving deltas:   6% (10/154)
2021-07-20T02:17:38.5466494Z Resolving deltas:   7% (11/154)
2021-07-20T02:17:38.5467314Z Resolving deltas:   8% (13/154)
2021-07-20T02:17:38.5467965Z Resolving deltas:   9% (14/154)
2021-07-20T02:17:38.5468599Z Resolving deltas:  10% (16/154)
2021-07-20T02:17:38.5469246Z Resolving deltas:  11% (17/154)
2021-07-20T02:17:38.5469875Z Resolving deltas:  12% (19/154)
2021-07-20T02:17:38.5470518Z Resolving deltas:  13% (21/154)
2021-07-20T02:17:38.5471154Z Resolving deltas:  14% (22/154)
2021-07-20T02:17:38.5471803Z Resolving deltas:  15% (24/154)
2021-07-20T02:17:38.5472440Z Resolving deltas:  16% (25/154)
2021-07-20T02:17:38.5473070Z Resolving deltas:  17% (27/154)
2021-07-20T02:17:38.5473858Z Resolving deltas:  18% (28/154)
2021-07-20T02:17:38.5474634Z Resolving deltas:  19% (30/154)
2021-07-20T02:17:38.5475536Z Resolving deltas:  20% (31/154)
2021-07-20T02:17:38.5476190Z Resolving deltas:  21% (33/154)
2021-07-20T02:17:38.5476822Z Resolving deltas:  22% (34/154)
2021-07-20T02:17:38.5477467Z Resolving deltas:  23% (36/154)
2021-07-20T02:17:38.5478107Z Resolving deltas:  24% (37/154)
2021-07-20T02:17:38.5478762Z Resolving deltas:  25% (39/154)
2021-07-20T02:17:38.5479406Z Resolving deltas:  26% (41/154)
2021-07-20T02:17:38.5480036Z Resolving deltas:  27% (42/154)
2021-07-20T02:17:38.5480683Z Resolving deltas:  28% (44/154)
2021-07-20T02:17:38.5481314Z Resolving deltas:  29% (45/154)
2021-07-20T02:17:38.5481964Z Resolving deltas:  30% (47/154)
2021-07-20T02:17:38.5482607Z Resolving deltas:  31% (48/154)
2021-07-20T02:17:38.5483240Z Resolving deltas:  32% (50/154)
2021-07-20T02:17:38.5483890Z Resolving deltas:  33% (51/154)
2021-07-20T02:17:38.5484530Z Resolving deltas:  34% (53/154)
2021-07-20T02:17:38.5485268Z Resolving deltas:  35% (54/154)
2021-07-20T02:17:38.5485931Z Resolving deltas:  36% (56/154)
2021-07-20T02:17:38.5486562Z Resolving deltas:  37% (57/154)
2021-07-20T02:17:38.5487208Z Resolving deltas:  38% (59/154)
2021-07-20T02:17:38.5487848Z Resolving deltas:  39% (61/154)
2021-07-20T02:17:38.5488491Z Resolving deltas:  40% (62/154)
2021-07-20T02:17:38.5489153Z Resolving deltas:  41% (64/154)
2021-07-20T02:17:38.5489780Z Resolving deltas:  42% (65/154)
2021-07-20T02:17:38.5490424Z Resolving deltas:  43% (67/154)
2021-07-20T02:17:38.5491329Z Resolving deltas:  44% (68/154)
2021-07-20T02:17:38.5492017Z Resolving deltas:  45% (70/154)
2021-07-20T02:17:38.5492707Z Resolving deltas:  46% (71/154)
2021-07-20T02:17:38.5493385Z Resolving deltas:  47% (73/154)
2021-07-20T02:17:38.5494076Z Resolving deltas:  48% (74/154)
2021-07-20T02:17:38.5494769Z Resolving deltas:  49% (76/154)
2021-07-20T02:17:38.5495467Z Resolving deltas:  50% (77/154)
2021-07-20T02:17:38.5496163Z Resolving deltas:  51% (79/154)
2021-07-20T02:17:38.5496847Z Resolving deltas:  52% (81/154)
2021-07-20T02:17:38.5497545Z Resolving deltas:  53% (82/154)
2021-07-20T02:17:38.5498237Z Resolving deltas:  54% (84/154)
2021-07-20T02:17:38.5498931Z Resolving deltas:  55% (85/154)
2021-07-20T02:17:38.5499631Z Resolving deltas:  56% (87/154)
2021-07-20T02:17:38.5500309Z Resolving deltas:  57% (88/154)
2021-07-20T02:17:38.5501014Z Resolving deltas:  58% (90/154)
2021-07-20T02:17:38.5501713Z Resolving deltas:  59% (91/154)
2021-07-20T02:17:38.5502516Z Resolving deltas:  60% (93/154)
2021-07-20T02:17:38.5503222Z Resolving deltas:  61% (94/154)
2021-07-20T02:17:38.5503900Z Resolving deltas:  62% (96/154)
2021-07-20T02:17:38.5504597Z Resolving deltas:  63% (98/154)
2021-07-20T02:17:38.5505289Z Resolving deltas:  64% (99/154)
2021-07-20T02:17:38.5505989Z Resolving deltas:  65% (101/154)
2021-07-20T02:17:38.5506693Z Resolving deltas:  66% (102/154)
2021-07-20T02:17:38.5507376Z Resolving deltas:  67% (104/154)
2021-07-20T02:17:38.5508075Z Resolving deltas:  68% (105/154)
2021-07-20T02:17:38.5508769Z Resolving deltas:  69% (107/154)
2021-07-20T02:17:38.5509473Z Resolving deltas:  70% (108/154)
2021-07-20T02:17:38.5510179Z Resolving deltas:  71% (110/154)
2021-07-20T02:17:38.5510869Z Resolving deltas:  72% (111/154)
2021-07-20T02:17:38.5511578Z Resolving deltas:  73% (113/154)
2021-07-20T02:17:38.5512269Z Resolving deltas:  74% (114/154)
2021-07-20T02:17:38.5513101Z Resolving deltas:  75% (116/154)
2021-07-20T02:17:38.5513804Z Resolving deltas:  76% (118/154)
2021-07-20T02:17:38.5514494Z Resolving deltas:  77% (119/154)
2021-07-20T02:17:38.5515208Z Resolving deltas:  78% (121/154)
2021-07-20T02:17:38.5515896Z Resolving deltas:  79% (122/154)
2021-07-20T02:17:38.5516608Z Resolving deltas:  80% (124/154)
2021-07-20T02:17:38.5517318Z Resolving deltas:  81% (125/154)
2021-07-20T02:17:38.5517996Z Resolving deltas:  82% (127/154)
2021-07-20T02:17:38.5518702Z Resolving deltas:  83% (128/154)
2021-07-20T02:17:38.5519384Z Resolving deltas:  84% (130/154)
2021-07-20T02:17:38.5520084Z Resolving deltas:  85% (131/154)
2021-07-20T02:17:38.5520784Z Resolving deltas:  86% (133/154)
2021-07-20T02:17:38.5521458Z Resolving deltas:  87% (134/154)
2021-07-20T02:17:38.5522163Z Resolving deltas:  88% (136/154)
2021-07-20T02:17:38.5522845Z Resolving deltas:  89% (138/154)
2021-07-20T02:17:38.5523547Z Resolving deltas:  90% (139/154)
2021-07-20T02:17:38.5524250Z Resolving deltas:  91% (141/154)
2021-07-20T02:17:38.5524935Z Resolving deltas:  92% (142/154)
2021-07-20T02:17:38.5525639Z Resolving deltas:  93% (144/154)
2021-07-20T02:17:38.5526321Z Resolving deltas:  94% (145/154)
2021-07-20T02:17:38.5527016Z Resolving deltas:  95% (147/154)
2021-07-20T02:17:38.5527711Z Resolving deltas:  96% (148/154)
2021-07-20T02:17:38.5528388Z Resolving deltas:  97% (150/154)
2021-07-20T02:17:38.5529091Z Resolving deltas:  98% (151/154)
2021-07-20T02:17:38.5529775Z Resolving deltas:  99% (153/154)
2021-07-20T02:17:38.5530467Z Resolving deltas: 100% (154/154)
2021-07-20T02:17:38.5531197Z Resolving deltas: 100% (154/154), done.
2021-07-20T02:17:38.5532711Z From https://github.com/submariner-io/submariner-operator
2021-07-20T02:17:38.5534148Z  * [new ref]         0105e4d08ef7236073547f1383566fc76c548f6d -> origin/devel
2021-07-20T02:17:38.5535129Z ##[endgroup]
2021-07-20T02:17:38.5535896Z ##[group]Determining the checkout info
2021-07-20T02:17:38.5536633Z ##[endgroup]
2021-07-20T02:17:38.5537324Z ##[group]Checking out the ref
2021-07-20T02:17:38.5538511Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-20T02:17:38.5539649Z Switched to a new branch 'devel'
2021-07-20T02:17:38.5540714Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-20T02:17:38.5541545Z ##[endgroup]
2021-07-20T02:17:38.5542542Z [command]/usr/bin/git log -1 --format='%H'
2021-07-20T02:17:38.5543601Z '0105e4d08ef7236073547f1383566fc76c548f6d'
2021-07-20T02:17:38.5765015Z ##[group]Run submariner-io/shipyard/gh-actions/e2e@devel
2021-07-20T02:17:38.5765711Z with:
2021-07-20T02:17:38.5766187Z   k8s_version: 1.17
2021-07-20T02:17:38.5766743Z   using: libreswan  lighthouse
2021-07-20T02:17:38.5767376Z   working-directory: .
2021-07-20T02:17:38.5767921Z   target: e2e
2021-07-20T02:17:38.5768390Z   focus: \[.*\]
2021-07-20T02:17:38.5768963Z   skip: \[external-dataplane\]
2021-07-20T02:17:38.5769583Z   testdir: test/e2e
2021-07-20T02:17:38.5770109Z ##[endgroup]
2021-07-20T02:17:39.4178687Z ##[group]Reclaiming free space
2021-07-20T02:17:39.7986156Z Filesystem      Size  Used Avail Use% Mounted on
2021-07-20T02:17:39.8008628Z /dev/root        84G   42G   43G  50% /
2021-07-20T02:17:39.8010802Z devtmpfs        3.4G     0  3.4G   0% /dev
2021-07-20T02:17:39.8064212Z tmpfs           3.4G   12K  3.4G   1% /dev/shm
2021-07-20T02:17:39.8065463Z tmpfs           696M  1.1M  695M   1% /run
2021-07-20T02:17:39.8066714Z tmpfs           5.0M     0  5.0M   0% /run/lock
2021-07-20T02:17:39.8067840Z tmpfs           3.4G     0  3.4G   0% /sys/fs/cgroup
2021-07-20T02:17:39.8068878Z /dev/loop0       56M   56M     0 100% /snap/core18/2066
2021-07-20T02:17:39.8070012Z /dev/loop1       56M   56M     0 100% /snap/core18/2074
2021-07-20T02:17:39.8071106Z /dev/loop2       33M   33M     0 100% /snap/snapd/12398
2021-07-20T02:17:39.8072352Z /dev/loop3       33M   33M     0 100% /snap/snapd/12159
2021-07-20T02:17:39.8073258Z /dev/loop4       68M   68M     0 100% /snap/lxd/20326
2021-07-20T02:17:39.8074564Z /dev/sdb15      105M  7.9M   97M   8% /boot/efi
2021-07-20T02:17:39.8075456Z /dev/sda1        14G  4.1G  9.0G  32% /mnt
2021-07-20T02:17:39.8076571Z ##[endgroup]
2021-07-20T02:17:39.8246522Z ##[group]Disable swap
2021-07-20T02:17:39.8520591Z ##[endgroup]
2021-07-20T02:17:39.8664020Z ##[group]Report available RAM
2021-07-20T02:17:39.8862527Z               total        used        free      shared  buff/cache   available
2021-07-20T02:17:39.8864787Z Mem:          6.8Gi       501Mi       5.2Gi       7.0Mi       1.1Gi       6.0Gi
2021-07-20T02:17:39.8865478Z Swap:            0B          0B          0B
2021-07-20T02:17:39.8866196Z ##[endgroup]
2021-07-20T02:17:39.9222285Z Downloading Makefile.dapper
2021-07-20T02:17:39.9639466Z Downloading dapper
2021-07-20T02:17:40.1648605Z .dapper.tmp version v0.5.6
2021-07-20T02:17:40.1682622Z Downloading Dockerfile.dapper
2021-07-20T02:17:40.2057713Z docker network create -d bridge kind
2021-07-20T02:17:40.5399018Z e3f2cced513ef8ad94816926246a17fdb2a78e35fc8a2d9ac8f67b4d7cdd5787
2021-07-20T02:17:40.5421110Z ./.dapper -m bind  make --debug=b e2e
2021-07-20T02:17:40.7947504Z Sending build context to Docker daemon  7.517MB
2021-07-20T02:17:40.7948865Z
2021-07-20T02:17:40.8058906Z Step 1/8 : ARG BASE_BRANCH
2021-07-20T02:17:40.8061697Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-20T02:17:41.1665654Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-20T02:17:41.1737224Z b1495d80d526: Pulling fs layer
2021-07-20T02:17:41.1738111Z 436e487a3a14: Pulling fs layer
2021-07-20T02:17:41.1738688Z ca0647cd69c4: Pulling fs layer
2021-07-20T02:17:41.1739271Z 169bd7d49280: Pulling fs layer
2021-07-20T02:17:41.1739826Z 355db6a505b3: Pulling fs layer
2021-07-20T02:17:41.1740516Z 80e9cdf47183: Pulling fs layer
2021-07-20T02:17:41.1741163Z 5dc5d4a7886e: Pulling fs layer
2021-07-20T02:17:41.1741696Z bcc150802595: Pulling fs layer
2021-07-20T02:17:41.1742172Z 355db6a505b3: Waiting
2021-07-20T02:17:41.1742814Z 80e9cdf47183: Waiting
2021-07-20T02:17:41.1743373Z 5dc5d4a7886e: Waiting
2021-07-20T02:17:41.1743840Z bcc150802595: Waiting
2021-07-20T02:17:41.1744277Z 169bd7d49280: Waiting
2021-07-20T02:17:42.6527129Z b1495d80d526: Verifying Checksum
2021-07-20T02:17:42.6527756Z b1495d80d526: Download complete
2021-07-20T02:17:42.7540146Z 169bd7d49280: Verifying Checksum
2021-07-20T02:17:42.7545597Z 169bd7d49280: Download complete
2021-07-20T02:17:42.8626913Z 355db6a505b3: Verifying Checksum
2021-07-20T02:17:42.8629202Z 355db6a505b3: Download complete
2021-07-20T02:17:42.9876393Z 80e9cdf47183: Verifying Checksum
2021-07-20T02:17:42.9878284Z 80e9cdf47183: Download complete
2021-07-20T02:17:43.0836555Z ca0647cd69c4: Verifying Checksum
2021-07-20T02:17:43.0840646Z ca0647cd69c4: Download complete
2021-07-20T02:17:43.1239116Z 5dc5d4a7886e: Verifying Checksum
2021-07-20T02:17:43.1239781Z 5dc5d4a7886e: Download complete
2021-07-20T02:17:43.2155932Z bcc150802595: Verifying Checksum
2021-07-20T02:17:43.2156950Z bcc150802595: Download complete
2021-07-20T02:17:45.5772054Z b1495d80d526: Pull complete
2021-07-20T02:17:48.2797638Z 436e487a3a14: Download complete
2021-07-20T02:17:58.4423907Z 436e487a3a14: Pull complete
2021-07-20T02:17:59.9337917Z ca0647cd69c4: Pull complete
2021-07-20T02:18:00.0066984Z 169bd7d49280: Pull complete
2021-07-20T02:18:00.0780375Z 355db6a505b3: Pull complete
2021-07-20T02:18:00.2826782Z 80e9cdf47183: Pull complete
2021-07-20T02:18:00.3521404Z 5dc5d4a7886e: Pull complete
2021-07-20T02:18:00.4643449Z bcc150802595: Pull complete
2021-07-20T02:18:00.4655532Z Digest: sha256:afbc987524ae61c7701040f8e92be374f0dadcfe1b08cba635eb8d9e1fafdd61
2021-07-20T02:18:00.4677015Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-20T02:18:00.4695851Z  ---> 8e970b865a56
2021-07-20T02:18:00.4696370Z Step 3/8 : ARG PROJECT
2021-07-20T02:18:00.4953276Z  ---> Running in a61a28eb67dd
2021-07-20T02:18:01.4736659Z Removing intermediate container a61a28eb67dd
2021-07-20T02:18:01.4737918Z  ---> 4774ba4ae873
2021-07-20T02:18:01.4739851Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR"     DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-20T02:18:01.4945415Z  ---> Running in 3e8ffe237e5a
2021-07-20T02:18:02.4764412Z Removing intermediate container 3e8ffe237e5a
2021-07-20T02:18:02.4765836Z  ---> d9317a50fa21
2021-07-20T02:18:02.4767335Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-20T02:18:02.4948126Z  ---> Running in 3c637163d07b
2021-07-20T02:18:03.4484869Z Removing intermediate container 3c637163d07b
2021-07-20T02:18:03.4486060Z  ---> 2cf38a3464c5
2021-07-20T02:18:03.4486569Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-20T02:18:03.4710977Z  ---> Running in d56ab385e69a
2021-07-20T02:18:04.4387475Z Removing intermediate container d56ab385e69a
2021-07-20T02:18:04.4389779Z  ---> 94022613e005
2021-07-20T02:18:04.4390385Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-20T02:18:04.4674839Z  ---> Running in 6dfbb3696208
2021-07-20T02:18:05.4505485Z Removing intermediate container 6dfbb3696208
2021-07-20T02:18:05.4521534Z  ---> c0ef98498eb1
2021-07-20T02:18:05.4522709Z Step 8/8 : CMD ["sh"]
2021-07-20T02:18:05.4711836Z  ---> Running in 9116f19fcbc3
2021-07-20T02:18:06.4556492Z Removing intermediate container 9116f19fcbc3
2021-07-20T02:18:06.4557954Z  ---> 1e93d5f067c4
2021-07-20T02:18:06.4662707Z Successfully built 1e93d5f067c4
2021-07-20T02:18:06.4692545Z Successfully tagged submariner-operator:devel
2021-07-20T02:18:06.9725954Z [36m[submariner-operator]$ trap chown -R 1001:121 . exit[0m
2021-07-20T02:18:06.9737374Z [36m[submariner-operator]$ mkdir -p bin dist output[0m
2021-07-20T02:18:06.9742137Z [36m[submariner-operator]$ make --debug=b e2e[0m
2021-07-20T02:18:06.9761078Z GNU Make 4.3
2021-07-20T02:18:06.9761975Z Built for x86_64-redhat-linux-gnu
2021-07-20T02:18:06.9763374Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-20T02:18:06.9764303Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-20T02:18:06.9765231Z This is free software: you are free to change and redistribute it.
2021-07-20T02:18:06.9766023Z There is NO WARRANTY, to the extent permitted by law.
2021-07-20T02:18:06.9771669Z Reading makefiles...
2021-07-20T02:18:07.1041686Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-20T02:18:07.1042815Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-20T02:18:07.3477778Z Updating makefiles....
2021-07-20T02:18:07.3485596Z Updating goal targets....
2021-07-20T02:18:07.3486738Z  File 'e2e' does not exist.
2021-07-20T02:18:07.3487433Z      File 'clusters' does not exist.
2021-07-20T02:18:07.3488158Z     Must remake target 'clusters'.
2021-07-20T02:18:07.3489642Z /opt/shipyard/scripts/clusters.sh --k8s_version="1.17" --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-20T02:18:07.3518850Z Downloading shflags 1.0.3
2021-07-20T02:18:07.3608192Z   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
2021-07-20T02:18:07.3616216Z                                  Dload  Upload   Total   Spent    Left  Speed
2021-07-20T02:18:07.3616656Z
2021-07-20T02:18:07.3912220Z   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
2021-07-20T02:18:07.3913174Z 100 31091  100 31091    0     0   920k      0 --:--:-- --:--:-- --:--:--  948k
2021-07-20T02:18:07.4593961Z Running with: k8s_version=1.17.17, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-20T02:18:07.4615491Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/utils[0m
2021-07-20T02:18:07.4624693Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:18:07.4636228Z [36m[submariner-operator]$ script_name=utils[0m
2021-07-20T02:18:07.4649253Z [36m[submariner-operator]$ exec_name=clusters.sh[0m
2021-07-20T02:18:07.4670060Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings[0m
2021-07-20T02:18:07.4680923Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:18:07.4693590Z [36m[submariner-operator]$ script_name=cluster_settings[0m
2021-07-20T02:18:07.4706333Z [36m[submariner-operator]$ exec_name=clusters.sh[0m
2021-07-20T02:18:07.4725192Z [36m[submariner-operator]$ broker=cluster1[0m
2021-07-20T02:18:07.4738074Z [36m[submariner-operator]$ declare -gA cluster_nodes[0m
2021-07-20T02:18:07.4752153Z [36m[submariner-operator]$ cluster_nodes[cluster1]=control-plane worker[0m
2021-07-20T02:18:07.4766818Z [36m[submariner-operator]$ cluster_nodes[cluster2]=control-plane worker[0m
2021-07-20T02:18:07.4779834Z [36m[submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker[0m
2021-07-20T02:18:07.4792650Z [36m[submariner-operator]$ declare -gA cluster_subm[0m
2021-07-20T02:18:07.4805913Z [36m[submariner-operator]$ cluster_subm[cluster1]=true[0m
2021-07-20T02:18:07.4818634Z [36m[submariner-operator]$ cluster_subm[cluster2]=true[0m
2021-07-20T02:18:07.4832085Z [36m[submariner-operator]$ cluster_subm[cluster3]=true[0m
2021-07-20T02:18:07.4844951Z [36m[submariner-operator]$ declare -gA cluster_cni[0m
2021-07-20T02:18:07.4858448Z [36m[submariner-operator]$ cluster_cni[cluster2]=weave[0m
2021-07-20T02:18:07.4870802Z [36m[submariner-operator]$ cluster_cni[cluster3]=weave[0m
2021-07-20T02:18:07.4883109Z [36m[submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings[0m
2021-07-20T02:18:07.4893866Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:18:07.4905803Z [36m[submariner-operator]$ script_name=cluster_settings[0m
2021-07-20T02:18:07.4915728Z [36m[submariner-operator]$ exec_name=clusters.sh[0m
2021-07-20T02:18:07.4938315Z [36m[submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker[0m
2021-07-20T02:18:07.4951754Z [36m[submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker[0m
2021-07-20T02:18:07.4983776Z [36m[submariner-operator]$ cat <<EOM
2021-07-20T02:18:07.4985232Z Cluster settings::
2021-07-20T02:18:07.4985934Z   broker - ${broker@Q}
2021-07-20T02:18:07.4986575Z   clusters - ${clusters[*]@Q}
2021-07-20T02:18:07.4987304Z   cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-20T02:18:07.4988420Z   nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-20T02:18:07.4989380Z   install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-20T02:18:07.4990117Z EOM[0m
2021-07-20T02:18:07.5003593Z [36m[submariner-operator]$ typeset -p cluster_cni[0m
2021-07-20T02:18:07.5017049Z [36m[submariner-operator]$ cut -f 2- -d=[0m
2021-07-20T02:18:07.5049237Z [36m[submariner-operator]$ typeset -p cluster_nodes[0m
2021-07-20T02:18:07.5064057Z [36m[submariner-operator]$ cut -f 2- -d=[0m
2021-07-20T02:18:07.5094017Z [36m[submariner-operator]$ typeset -p cluster_subm[0m
2021-07-20T02:18:07.5108614Z [36m[submariner-operator]$ cut -f 2- -d=[0m
2021-07-20T02:18:07.5129383Z Cluster settings::
2021-07-20T02:18:07.5130171Z   broker - 'cluster1'
2021-07-20T02:18:07.5130845Z   clusters - 'cluster1' 'cluster2'
2021-07-20T02:18:07.5131635Z   cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-20T02:18:07.5133027Z   nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-20T02:18:07.5134382Z   install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-20T02:18:07.5148602Z [36m[submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs[0m
2021-07-20T02:18:07.5169949Z [36m[submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs[0m
2021-07-20T02:18:07.5195072Z [36m[submariner-operator]$ run_local_registry[0m
2021-07-20T02:18:07.5207916Z [36m[submariner-operator]$ run_local_registry[0m
2021-07-20T02:18:07.5220410Z [36m[submariner-operator]$ registry_running[0m
2021-07-20T02:18:07.5233318Z [36m[submariner-operator]$ registry_running[0m
2021-07-20T02:18:07.5245877Z [36m[submariner-operator]$ docker ps --filter name=^/?kind-registry$[0m
2021-07-20T02:18:07.5260699Z [36m[submariner-operator]$ grep kind-registry[0m
2021-07-20T02:18:07.8199071Z [36m[submariner-operator]$ return 0[0m
2021-07-20T02:18:07.8209463Z Deploying local registry kind-registry to serve images centrally.
2021-07-20T02:18:07.8228142Z [36m[submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry[0m
2021-07-20T02:18:07.8246610Z [36m[submariner-operator]$ selinuxenabled[0m
2021-07-20T02:18:07.8263543Z [36m[submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2[0m
2021-07-20T02:18:08.1037486Z Unable to find image 'registry:2' locally
2021-07-20T02:18:08.3301028Z 2: Pulling from library/registry
2021-07-20T02:18:08.3948466Z ddad3d7c1e96: Already exists
2021-07-20T02:18:08.3974090Z 6eda6749503f: Pulling fs layer
2021-07-20T02:18:08.3974647Z 363ab70c2143: Pulling fs layer
2021-07-20T02:18:08.3975161Z 5b94580856e6: Pulling fs layer
2021-07-20T02:18:08.3975637Z 12008541203a: Pulling fs layer
2021-07-20T02:18:08.3976081Z 12008541203a: Waiting
2021-07-20T02:18:08.4883943Z 5b94580856e6: Verifying Checksum
2021-07-20T02:18:08.4884698Z 5b94580856e6: Download complete
2021-07-20T02:18:08.5119967Z 6eda6749503f: Verifying Checksum
2021-07-20T02:18:08.5120598Z 6eda6749503f: Download complete
2021-07-20T02:18:08.5599603Z 363ab70c2143: Verifying Checksum
2021-07-20T02:18:08.5600212Z 363ab70c2143: Download complete
2021-07-20T02:18:08.5940645Z 12008541203a: Verifying Checksum
2021-07-20T02:18:08.5941256Z 12008541203a: Download complete
2021-07-20T02:18:08.6607556Z 6eda6749503f: Pull complete
2021-07-20T02:18:09.0280420Z 363ab70c2143: Pull complete
2021-07-20T02:18:09.0961553Z 5b94580856e6: Pull complete
2021-07-20T02:18:09.1641785Z 12008541203a: Pull complete
2021-07-20T02:18:09.1686900Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-20T02:18:09.1711756Z Status: Downloaded newer image for registry:2
2021-07-20T02:18:09.1859606Z 33ddb037cda02d528c21030176b54b25f0ce3a72665684aa9104a052aeb81a75
2021-07-20T02:18:09.4989244Z [36m[submariner-operator]$ docker network connect kind kind-registry[0m
2021-07-20T02:18:09.9096191Z [36m[submariner-operator]$ declare_cidrs[0m
2021-07-20T02:18:09.9119150Z [36m[submariner-operator]$ declare_cidrs[0m
2021-07-20T02:18:09.9120239Z [36m[submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs[0m
2021-07-20T02:18:09.9139608Z [36m[submariner-operator]$ i=1[0m
2021-07-20T02:18:09.9140671Z [36m[submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1[0m
2021-07-20T02:18:09.9160529Z [36m[submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1[0m
2021-07-20T02:18:09.9161770Z [36m[submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16[0m
2021-07-20T02:18:09.9180292Z [36m[submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16[0m
2021-07-20T02:18:09.9181394Z [36m[submariner-operator]$ [cluster1] i=$(("$i"+1))[0m
2021-07-20T02:18:09.9193492Z [36m[submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2[0m
2021-07-20T02:18:09.9194603Z [36m[submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2[0m
2021-07-20T02:18:09.9202647Z [36m[submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16[0m
2021-07-20T02:18:09.9212530Z [36m[submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16[0m
2021-07-20T02:18:09.9225542Z [36m[submariner-operator]$ [cluster2] i=$(("$i"+1))[0m
2021-07-20T02:18:09.9241751Z [36m[submariner-operator]$ [cluster2] wait 233[0m
2021-07-20T02:18:09.9247363Z [36m[submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster[0m
2021-07-20T02:18:09.9264185Z [36m[submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster[0m
2021-07-20T02:18:09.9275210Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster[0m
2021-07-20T02:18:09.9281633Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster[0m
2021-07-20T02:18:09.9294158Z [36m[submariner-operator]$ [cluster2] declare -A pids[0m
2021-07-20T02:18:09.9308701Z [36m[submariner-operator]$ [cluster2] eval echo cluster1 cluster2[0m
2021-07-20T02:18:09.9328344Z [36m[submariner-operator]$ [cluster1] pids[cluster1]=242[0m
2021-07-20T02:18:09.9329337Z [36m[submariner-operator]$ [cluster1] set -o pipefail[0m
2021-07-20T02:18:09.9339377Z [36m[submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster[0m
2021-07-20T02:18:09.9351179Z [36m[submariner-operator]$ [cluster2] pids[cluster2]=246[0m
2021-07-20T02:18:09.9362532Z [36m[submariner-operator]$ [cluster2] set -o pipefail[0m
2021-07-20T02:18:09.9371554Z [36m[submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /[0m
2021-07-20T02:18:09.9381853Z [36m[submariner-operator]$ [cluster2] wait 246[0m
2021-07-20T02:18:09.9396429Z [36m[submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster[0m
2021-07-20T02:18:09.9416024Z [36m[submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /[0m
2021-07-20T02:20:06.0858878Z [36m[submariner-operator]$ [cluster1] with_retries[0m
2021-07-20T02:20:06.0860325Z [36m[submariner-operator]$ [cluster1] iteration=1[0m
2021-07-20T02:20:06.0861316Z [36m[submariner-operator]$ [cluster1] wait 262[0m
2021-07-20T02:20:06.0862693Z [36m[submariner-operator]$ [cluster1] create_kind_cluster[0m
2021-07-20T02:20:06.0863784Z [36m[submariner-operator]$ [cluster1] create_kind_cluster[0m
2021-07-20T02:20:06.0865608Z [36m[submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-20T02:20:06.0867836Z [36m[submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-20T02:20:06.0869551Z [36m[submariner-operator]$ [cluster1] kind get clusters[0m
2021-07-20T02:20:06.0873403Z [36m[submariner-operator]$ [cluster1] grep -q ^cluster1$[0m
2021-07-20T02:20:06.0874415Z [cluster1] No kind clusters found.
2021-07-20T02:20:06.0875481Z [cluster1] Creating KIND cluster...
2021-07-20T02:20:06.0876709Z [36m[submariner-operator]$ [cluster1] generate_cluster_yaml[0m
2021-07-20T02:20:06.0878133Z [36m[submariner-operator]$ [cluster1] generate_cluster_yaml[0m
2021-07-20T02:20:06.0879443Z [36m[submariner-operator]$ [cluster1] disable_cni=true[0m
2021-07-20T02:20:06.0880657Z [36m[submariner-operator]$ [cluster1] nodes=
2021-07-20T02:20:06.0881755Z [cluster1] - role: control-plane[0m
2021-07-20T02:20:06.0882839Z [36m[submariner-operator]$ [cluster1] nodes=
2021-07-20T02:20:06.0884776Z [cluster1] - role: control-plane
2021-07-20T02:20:06.0885553Z [cluster1] - role: worker[0m
2021-07-20T02:20:06.0886384Z [36m[submariner-operator]$ [cluster1] nodes=
2021-07-20T02:20:06.0887316Z [cluster1] - role: control-plane
2021-07-20T02:20:06.0888002Z [cluster1] - role: worker
2021-07-20T02:20:06.0888659Z [cluster1] - role: worker[0m
2021-07-20T02:20:06.0889449Z [cluster1] [36m[0m
2021-07-20T02:20:06.0890022Z [cluster1] [36m[0m
2021-07-20T02:20:06.0890873Z [36m[submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""[0m
2021-07-20T02:20:06.0892265Z [36m[submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml[0m
2021-07-20T02:20:06.0893845Z [36m[submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.17.17[0m
2021-07-20T02:20:06.0894959Z [36m[submariner-operator]$ [cluster1] kind version[0m
2021-07-20T02:20:06.0895834Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-20T02:20:06.0897046Z [36m[submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml[0m
2021-07-20T02:20:06.0898471Z [cluster1] ---
2021-07-20T02:20:06.0898949Z [cluster1] kind: Cluster
2021-07-20T02:20:06.0899734Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-20T02:20:06.0900375Z [cluster1] networking:
2021-07-20T02:20:06.0900986Z [cluster1]   disableDefaultCNI: true
2021-07-20T02:20:06.0901624Z [cluster1]   podSubnet: 10.1.0.0/16
2021-07-20T02:20:06.0902194Z [cluster1]   serviceSubnet: 100.1.0.0/16
2021-07-20T02:20:06.0903236Z [cluster1] containerdConfigPatches:
2021-07-20T02:20:06.0904040Z [cluster1]   - |-
2021-07-20T02:20:06.0904917Z [cluster1]     [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-20T02:20:06.0906238Z [cluster1]       endpoint = ["http://kind-registry:5000"]
2021-07-20T02:20:06.0907078Z [cluster1] kubeadmConfigPatches:
2021-07-20T02:20:06.0907813Z [cluster1]   - |
2021-07-20T02:20:06.0908515Z [cluster1]     apiVersion: kubeadm.k8s.io/v1beta2
2021-07-20T02:20:06.0909289Z [cluster1]     kind: ClusterConfiguration
2021-07-20T02:20:06.0909907Z [cluster1]     metadata:
2021-07-20T02:20:06.0910420Z [cluster1]       name: config
2021-07-20T02:20:06.0910935Z [cluster1]     networking:
2021-07-20T02:20:06.0911493Z [cluster1]       podSubnet: 10.1.0.0/16
2021-07-20T02:20:06.0912069Z [cluster1]       serviceSubnet: 100.1.0.0/16
2021-07-20T02:20:06.0912724Z [cluster1]       dnsDomain: cluster1.local
2021-07-20T02:20:06.0913281Z [cluster1] nodes:
2021-07-20T02:20:06.0914044Z [cluster1] - role: control-plane
2021-07-20T02:20:06.0914762Z [cluster1] - role: worker
2021-07-20T02:20:06.0915396Z [cluster1] - role: worker
2021-07-20T02:20:06.0916923Z [36m[submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.17.17 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml[0m
2021-07-20T02:20:06.0918197Z [cluster1] Creating cluster "cluster1" ...
2021-07-20T02:20:06.0920282Z [cluster1]  • Ensuring node image (kindest/node:v1.17.17) 🖼  ...
2021-07-20T02:20:06.0921533Z [cluster1]  ✓ Ensuring node image (kindest/node:v1.17.17) 🖼
2021-07-20T02:20:06.0922420Z [cluster1]  • Preparing nodes 📦 📦 📦   ...
2021-07-20T02:20:06.0923195Z [cluster1]  ✓ Preparing nodes 📦 📦 📦
2021-07-20T02:20:06.0923968Z [cluster1]  • Writing configuration 📜  ...
2021-07-20T02:20:06.0924784Z [cluster1]  ✓ Writing configuration 📜
2021-07-20T02:20:06.0925618Z [cluster1]  • Starting control-plane 🕹️  ...
2021-07-20T02:20:06.0926632Z [cluster1]  ✓ Starting control-plane 🕹️
2021-07-20T02:20:06.0927493Z [cluster1]  • Installing StorageClass 💾  ...
2021-07-20T02:20:06.0928351Z [cluster1]  ✓ Installing StorageClass 💾
2021-07-20T02:20:06.0938738Z [cluster1]  • Joining worker nodes 🚜  ...
2021-07-20T02:20:06.0939656Z [cluster1]  ✓ Joining worker nodes 🚜
2021-07-20T02:20:06.0940496Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-20T02:20:06.0941207Z [cluster1] You can now use your cluster with:
2021-07-20T02:20:06.0941742Z [cluster1]
2021-07-20T02:20:06.0942847Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-20T02:20:06.0943497Z [cluster1]
2021-07-20T02:20:06.0944579Z [cluster1] Not sure what to do next? 😅  Check out https://kind.sigs.k8s.io/docs/user/quick-start/
2021-07-20T02:20:06.0945837Z [36m[submariner-operator]$ [cluster1] kind_fixup_config[0m
2021-07-20T02:20:06.0947654Z [36m[submariner-operator]$ [cluster1] kind_fixup_config[0m
2021-07-20T02:20:06.0949335Z [36m[submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane[0m
2021-07-20T02:20:06.0950826Z [36m[submariner-operator]$ [cluster1] head -n 1[0m
2021-07-20T02:20:18.1897078Z [36m[36m[submariner-operator]$ [cluster2] with_retries[0m
2021-07-20T02:20:18.1898100Z [36m[submariner-operator]$ [cluster2] iteration=1[0m
2021-07-20T02:20:18.1899022Z [36m[submariner-operator]$ [cluster2] wait 266[0m
2021-07-20T02:20:18.1899951Z [36m[submariner-operator]$ [cluster2] create_kind_cluster[0m
2021-07-20T02:20:18.1901211Z [36m[submariner-operator]$ [cluster2] create_kind_cluster[0m
2021-07-20T02:20:18.1903016Z [36m[submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-20T02:20:18.1905069Z [36m[submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-20T02:20:18.1906710Z [36m[submariner-operator]$ [cluster2] kind get clusters[0m
2021-07-20T02:20:18.1907756Z [36m[submariner-operator]$ [cluster2] grep -q ^cluster2$[0m
2021-07-20T02:20:18.1908501Z [cluster2] No kind clusters found.
2021-07-20T02:20:18.1909095Z [cluster2] Creating KIND cluster...
2021-07-20T02:20:18.1910049Z [36m[submariner-operator]$ [cluster2] generate_cluster_yaml[0m
2021-07-20T02:20:18.1911139Z [36m[submariner-operator]$ [cluster2] generate_cluster_yaml[0m
2021-07-20T02:20:18.1912208Z [36m[submariner-operator]$ [cluster2] disable_cni=true[0m
2021-07-20T02:20:18.1913194Z [36m[submariner-operator]$ [cluster2] nodes=
2021-07-20T02:20:18.1914037Z [cluster2] - role: control-plane[0m
2021-07-20T02:20:18.1914902Z [36m[submariner-operator]$ [cluster2] nodes=
2021-07-20T02:20:18.1915727Z [cluster2] - role: control-plane
2021-07-20T02:20:18.1916434Z [cluster2] - role: worker[0m
2021-07-20T02:20:18.1917229Z [36m[submariner-operator]$ [cluster2] nodes=
2021-07-20T02:20:18.1918168Z [cluster2] - role: control-plane
2021-07-20T02:20:18.1918802Z [cluster2] - role: worker
2021-07-20T02:20:18.1919406Z [cluster2] - role: worker[0m
2021-07-20T02:20:18.1919956Z [cluster2] [36m[0m
2021-07-20T02:20:18.1920482Z [cluster2] [36m[0m
2021-07-20T02:20:18.1921244Z [36m[submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""[0m
2021-07-20T02:20:18.1922526Z [36m[submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml[0m
2021-07-20T02:20:18.1923880Z [36m[submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.17.17[0m
2021-07-20T02:20:18.1924894Z [36m[submariner-operator]$ [cluster2] kind version[0m
2021-07-20T02:20:18.1925571Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-20T02:20:18.1926896Z [36m[submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml[0m
2021-07-20T02:20:18.1927918Z [cluster2] ---
2021-07-20T02:20:18.1928372Z [cluster2] kind: Cluster
2021-07-20T02:20:18.1929158Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-20T02:20:18.1929778Z [cluster2] networking:
2021-07-20T02:20:18.1930524Z [cluster2]   disableDefaultCNI: true
2021-07-20T02:20:18.1931164Z [cluster2]   podSubnet: 10.2.0.0/16
2021-07-20T02:20:18.1931726Z [cluster2]   serviceSubnet: 100.2.0.0/16
2021-07-20T02:20:18.1932454Z [cluster2] containerdConfigPatches:
2021-07-20T02:20:18.1933221Z [cluster2]   - |-
2021-07-20T02:20:18.1934090Z [cluster2]     [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-20T02:20:18.1935356Z [cluster2]       endpoint = ["http://kind-registry:5000"]
2021-07-20T02:20:18.1936187Z [cluster2] kubeadmConfigPatches:
2021-07-20T02:20:18.1936891Z [cluster2]   - |
2021-07-20T02:20:18.1937493Z [cluster2]     apiVersion: kubeadm.k8s.io/v1beta2
2021-07-20T02:20:18.1938240Z [cluster2]     kind: ClusterConfiguration
2021-07-20T02:20:18.1938941Z [cluster2]     metadata:
2021-07-20T02:20:18.1939411Z [cluster2]       name: config
2021-07-20T02:20:18.1939877Z [cluster2]     networking:
2021-07-20T02:20:18.1940385Z [cluster2]       podSubnet: 10.2.0.0/16
2021-07-20T02:20:18.1940924Z [cluster2]       serviceSubnet: 100.2.0.0/16
2021-07-20T02:20:18.1941527Z [cluster2]       dnsDomain: cluster2.local
2021-07-20T02:20:18.1942040Z [cluster2] nodes:
2021-07-20T02:20:18.1945543Z [cluster2] - role: control-plane
2021-07-20T02:20:18.1946192Z [cluster2] - role: worker
2021-07-20T02:20:18.1946793Z [cluster2] - role: worker
2021-07-20T02:20:18.1948173Z [36m[submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.17.17 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml[0m
2021-07-20T02:20:18.1949461Z [cluster2] Creating cluster "cluster2" ...
2021-07-20T02:20:18.1950423Z [cluster2]  • Ensuring node image (kindest/node:v1.17.17) 🖼  ...
2021-07-20T02:20:18.1951335Z [cluster2]  ✓ Ensuring node image (kindest/node:v1.17.17) 🖼
2021-07-20T02:20:18.1952212Z [cluster2]  • Preparing nodes 📦 📦 📦   ...
2021-07-20T02:20:18.1953214Z [cluster2]  ✓ Preparing nodes 📦 📦 📦
2021-07-20T02:20:18.1953972Z [cluster2]  • Writing configuration 📜  ...
2021-07-20T02:20:18.1954737Z [cluster2]  ✓ Writing configuration 📜
2021-07-20T02:20:18.1955519Z [cluster2]  • Starting control-plane 🕹️  ...
2021-07-20T02:20:18.1956278Z [cluster2]  ✓ Starting control-plane 🕹️
2021-07-20T02:20:18.1957061Z [cluster2]  • Installing StorageClass 💾  ...
2021-07-20T02:20:18.1957820Z [cluster2]  ✓ Installing StorageClass 💾
2021-07-20T02:20:18.1958565Z [cluster2]  • Joining worker nodes 🚜  ...
2021-07-20T02:20:18.1959259Z [cluster2]  ✓ Joining worker nodes 🚜
2021-07-20T02:20:18.1960048Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-20T02:20:18.1960707Z [cluster2] You can now use your cluster with:
2021-07-20T02:20:18.1961181Z [cluster2]
2021-07-20T02:20:18.1962071Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-20T02:20:18.1962652Z [cluster2]
2021-07-20T02:20:18.1963257Z [cluster2] Thanks for using kind! 😊
2021-07-20T02:20:18.1964075Z [36m[submariner-operator]$ [cluster2] kind_fixup_config[0m
2021-07-20T02:20:18.1965283Z [36m[submariner-operator]$ [cluster2] kind_fixup_config[0m
2021-07-20T02:20:18.1966911Z [36m[submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane[0m
2021-07-20T02:20:18.1968418Z [36m[submariner-operator]$ [cluster2] head -n 1[0m
2021-07-20T02:20:42.2266017Z [36m[submariner-operator]$ [cluster2] sed -i -- s/server: .*/serve[submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.4:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-20T02:20:42.2269366Z [36m[submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-20T02:20:42.2271966Z [36m[submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-20T02:20:42.2274991Z [36m[submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-20T02:20:42.2278037Z [36m[submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-20T02:20:42.2280709Z [36m[submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1[0m
2021-07-20T02:20:42.2282568Z [36m[submariner-operator]$ [cluster1] wait 1467[0m
2021-07-20T02:20:42.2284828Z [36m[submariner-operator]$ [cluster1] deploy_cluster_capabilities[0m
2021-07-20T02:20:42.2286781Z [36m[submariner-operator]$ [cluster1] deploy_cluster_capabilities[0m
2021-07-20T02:20:42.2288071Z [36m[submariner-operator]$ [cluster1] deploy_cni[0m
2021-07-20T02:20:42.2289202Z [36m[submariner-operator]$ [cluster1] deploy_cni[0m
2021-07-20T02:20:42.2290394Z [36m[submariner-operator]$ [cluster1] eval deploy_weave_cni[0m
2021-07-20T02:20:42.2291608Z [36m[submariner-operator]$ [cluster1] deploy_weave_cni[0m
2021-07-20T02:20:42.2293053Z [36m[submariner-operator]$ [cluster1] deploy_weave_cni[0m
2021-07-20T02:20:42.2293930Z [cluster1] Applying weave network...
2021-07-20T02:20:42.2295536Z [36m[submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.1.0.0/16[0m
2021-07-20T02:20:42.2298053Z [36m[submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.1.0.0/16[0m
2021-07-20T02:20:42.2301047Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.1.0.0/16[0m
2021-07-20T02:20:42.2303279Z [cluster1] serviceaccount/weave-net created
2021-07-20T02:20:42.2304491Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-20T02:20:42.2306145Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-20T02:20:42.2307652Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-20T02:20:42.2308992Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-20T02:20:42.2310154Z [cluster1] daemonset.apps/weave-net created
2021-07-20T02:20:42.2310989Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-20T02:20:42.2312233Z [36m[submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m[0m
2021-07-20T02:20:42.2313944Z [36m[submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m[0m
2021-07-20T02:20:42.2316923Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m[0m
2021-07-20T02:20:42.2318987Z [cluster1] pod/weave-net-5qkps condition met
2021-07-20T02:20:42.2320242Z [cluster1] pod/weave-net-64vqr condition met
2021-07-20T02:20:42.2321152Z [cluster1] pod/weave-net-tx69r condition met
2021-07-20T02:20:42.2322080Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-20T02:20:42.2323476Z [36m[submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m[0m
2021-07-20T02:20:42.2324976Z [36m[submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m[0m
2021-07-20T02:20:42.2326624Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m[0m
2021-07-20T02:20:42.2327959Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-20T02:20:42.2329095Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-20T02:20:42.2330222Z [cluster1] deployment "coredns" successfully rolled out
2021-07-20T02:20:42.2331212Z [36m[submariner-operator]$ [cluster1] return 0[0m
2021-07-20T02:20:48.5198836Z r: https:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-20T02:20:48.5201423Z [36m[submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-20T02:20:48.5204053Z [36m[submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-20T02:20:48.5206658Z [36m[submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-20T02:20:48.5209404Z [36m[submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-20T02:20:48.5212800Z [36m[submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2[0m
2021-07-20T02:20:48.5214305Z [36m[submariner-operator]$ [cluster2] wait 1605[0m
2021-07-20T02:20:48.5215399Z [36m[submariner-operator]$ [cluster2] deploy_cluster_capabilities[0m
2021-07-20T02:20:48.5216581Z [36m[submariner-operator]$ [cluster2] deploy_cluster_capabilities[0m
2021-07-20T02:20:48.5217895Z [36m[submariner-operator]$ [cluster2] deploy_cni[0m
2021-07-20T02:20:48.5218862Z [36m[submariner-operator]$ [cluster2] deploy_cni[0m
2021-07-20T02:20:48.5220144Z [36m[submariner-operator]$ [cluster2] eval deploy_weave_cni[0m
2021-07-20T02:20:48.5221208Z [36m[submariner-operator]$ [cluster2] deploy_weave_cni[0m
2021-07-20T02:20:48.5222235Z [36m[submariner-operator]$ [cluster2] deploy_weave_cni[0m
2021-07-20T02:20:48.5224168Z [cluster2] Applying weave network...
2021-07-20T02:20:48.5225792Z [36m[submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.2.0.0/16[0m
2021-07-20T02:20:48.5227798Z [36m[submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.2.0.0/16[0m
2021-07-20T02:20:48.5229900Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.2.0.0/16[0m
2021-07-20T02:20:48.5231572Z [cluster2] serviceaccount/weave-net created
2021-07-20T02:20:48.5232868Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-20T02:20:48.5234634Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-20T02:20:48.5236262Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-20T02:20:48.5237707Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-20T02:20:48.5238965Z [cluster2] daemonset.apps/weave-net created
2021-07-20T02:20:48.5239873Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-20T02:20:48.5241210Z [36m[submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m[0m
2021-07-20T02:20:48.5242873Z [36m[submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m[0m
2021-07-20T02:20:48.5244684Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m[0m
2021-07-20T02:20:48.5246046Z [cluster2] pod/weave-net-c6c9d condition met
2021-07-20T02:20:48.5246939Z [cluster2] pod/weave-net-n6q44 condition met
2021-07-20T02:20:48.5247841Z [cluster2] pod/weave-net-rlm26 condition met
2021-07-20T02:20:48.5248767Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-20T02:20:48.5250217Z [36m[submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m[0m
2021-07-20T02:20:48.5251751Z [36m[submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m[0m
2021-07-20T02:20:48.5253381Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m[0m
2021-07-20T02:20:48.5254722Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-20T02:20:48.5256008Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-20T02:20:48.5256998Z [cluster2] deployment "coredns" successfully rolled out
2021-07-20T02:20:48.5257999Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-20T02:20:48.5282708Z [36m[submariner-operator]$ [cluster2] wait 242[0m
2021-07-20T02:20:48.5307964Z [36m[submariner-operator]$ [cluster2] print_clusters_message[0m
2021-07-20T02:20:48.5322742Z [36m[submariner-operator]$ [cluster2] print_clusters_message[0m
2021-07-20T02:20:48.5339485Z [36m[submariner-operator]$ [cluster2] cat <<EOM
2021-07-20T02:20:48.5340426Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-20T02:20:48.5340988Z
2021-07-20T02:20:48.5341998Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-20T02:20:48.5342945Z
2021-07-20T02:20:48.5343728Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-20T02:20:48.5344420Z
2021-07-20T02:20:48.5345149Z To clean everthing up, just run: make clean-clusters
2021-07-20T02:20:48.5345827Z EOM[0m
2021-07-20T02:20:48.5361116Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-20T02:20:48.5362608Z
2021-07-20T02:20:48.5363837Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-20T02:20:48.5364507Z
2021-07-20T02:20:48.5365304Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-20T02:20:48.5365811Z
2021-07-20T02:20:48.5366530Z To clean everthing up, just run: make clean-clusters
2021-07-20T02:20:48.5374571Z     Successfully remade target file 'clusters'.
2021-07-20T02:20:48.5376436Z      File 'preload-images' does not exist.
2021-07-20T02:20:48.5377657Z        File 'images' does not exist.
2021-07-20T02:20:48.5390554Z          File 'package/.image.submariner-operator' does not exist.
2021-07-20T02:20:48.5527498Z find: 'bin/submariner-operator': No such file or directory
2021-07-20T02:20:48.8919341Z              File 'bin/submariner-operator' does not exist.
2021-07-20T02:20:48.8920345Z                File 'vendor/modules.txt' does not exist.
2021-07-20T02:20:48.8921190Z               Must remake target 'vendor/modules.txt'.
2021-07-20T02:20:48.8921753Z go mod download
2021-07-20T02:21:41.6984354Z go mod vendor
2021-07-20T02:21:43.7016131Z go mod tidy
2021-07-20T02:21:44.3150344Z               Successfully remade target file 'vendor/modules.txt'.
2021-07-20T02:21:44.3151548Z                File 'generate-embeddedyamls' does not exist.
2021-07-20T02:21:44.3152457Z                  File 'generate' does not exist.
2021-07-20T02:21:44.3153695Z                    File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-20T02:21:44.3155133Z                   Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-20T02:21:44.3156409Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-20T02:21:44.3190353Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-20T02:22:05.4778142Z                   Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-20T02:22:05.4788761Z                 Must remake target 'generate'.
2021-07-20T02:22:05.4790916Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-20T02:22:17.5541805Z                 Successfully remade target file 'generate'.
2021-07-20T02:22:17.5544434Z                  File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-20T02:22:17.5550518Z                    File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-20T02:22:17.5560351Z                   Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-20T02:22:17.5562829Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-20T02:22:19.9040806Z                   Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-20T02:22:19.9044946Z                    File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-20T02:22:19.9047344Z                   Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-20T02:22:19.9049789Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-20T02:22:21.2493088Z                   Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-20T02:22:21.2595176Z                 Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-20T02:22:21.2596137Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-20T02:22:21.9681593Z Generating yamls.go
2021-07-20T02:22:21.9689003Z deploy/crds/submariner.io_brokers.yaml
2021-07-20T02:22:21.9693379Z deploy/crds/submariner.io_submariners.yaml
2021-07-20T02:22:21.9724394Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-20T02:22:21.9729885Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-20T02:22:21.9734034Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-20T02:22:21.9738273Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-20T02:22:21.9744230Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-20T02:22:21.9755159Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-20T02:22:21.9770363Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-20T02:22:21.9778917Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-20T02:22:21.9797242Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-20T02:22:21.9811845Z config/broker/broker-admin/service_account.yaml
2021-07-20T02:22:21.9829263Z config/broker/broker-admin/role.yaml
2021-07-20T02:22:21.9840583Z config/broker/broker-admin/role_binding.yaml
2021-07-20T02:22:21.9848975Z config/broker/broker-client/service_account.yaml
2021-07-20T02:22:21.9860026Z config/broker/broker-client/role.yaml
2021-07-20T02:22:21.9865134Z config/broker/broker-client/role_binding.yaml
2021-07-20T02:22:21.9870121Z config/rbac/submariner-operator/service_account.yaml
2021-07-20T02:22:21.9874452Z config/rbac/submariner-operator/role.yaml
2021-07-20T02:22:21.9879129Z config/rbac/submariner-operator/role_binding.yaml
2021-07-20T02:22:21.9883838Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-20T02:22:21.9889934Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-20T02:22:21.9893911Z config/rbac/submariner-gateway/service_account.yaml
2021-07-20T02:22:21.9896335Z config/rbac/submariner-gateway/role.yaml
2021-07-20T02:22:21.9897516Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-20T02:22:21.9902783Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-20T02:22:21.9907718Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-20T02:22:21.9911958Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-20T02:22:21.9916920Z config/rbac/submariner-route-agent/role.yaml
2021-07-20T02:22:21.9920621Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-20T02:22:21.9923856Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-20T02:22:21.9926375Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-20T02:22:21.9928891Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-20T02:22:21.9931522Z config/rbac/submariner-globalnet/role.yaml
2021-07-20T02:22:21.9936363Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-20T02:22:21.9939933Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-20T02:22:21.9946606Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-20T02:22:21.9950255Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-20T02:22:21.9956773Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-20T02:22:21.9961801Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-20T02:22:21.9966228Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-20T02:22:21.9969478Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-20T02:22:21.9971654Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-20T02:22:21.9976648Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-20T02:22:21.9978117Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-20T02:22:21.9983773Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-20T02:22:21.9987847Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-20T02:22:21.9990864Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-20T02:22:22.0023538Z                 Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-20T02:22:22.0024739Z               Must remake target 'generate-embeddedyamls'.
2021-07-20T02:22:22.0025926Z               Successfully remade target file 'generate-embeddedyamls'.
2021-07-20T02:22:22.0026929Z             Must remake target 'bin/submariner-operator'.
2021-07-20T02:22:22.0027605Z /opt/shipyard/scripts/compile.sh \
2021-07-20T02:22:22.0028755Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d" \
2021-07-20T02:22:22.0029843Z bin/submariner-operator main.go
2021-07-20T02:22:22.0653962Z [36m[submariner-operator]$ mkdir -p bin[0m
2021-07-20T02:22:22.0675341Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d')
2021-07-20T02:22:22.0686026Z [36m[submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d[0m
2021-07-20T02:22:22.0697946Z [36m[submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -o bin/submariner-operator main.go[0m
2021-07-20T02:23:55.4275220Z [36m[submariner-operator]$ upx bin/submariner-operator[0m
2021-07-20T02:24:01.0396469Z                        Ultimate Packer for eXecutables
2021-07-20T02:24:01.0398293Z                           Copyright (C) 1996 - 2020
2021-07-20T02:24:01.0399171Z UPX 3.96        Markus Oberhumer, Laszlo Molnar & John Reiser   Jan 23rd 2020
2021-07-20T02:24:01.0403861Z
2021-07-20T02:24:01.0404252Z         File size         Ratio      Format      Name
2021-07-20T02:24:01.0405003Z    --------------------   ------   -----------   -----------
2021-07-20T02:24:01.0405736Z   34459648 ->   9933112   28.83%   linux/amd64   submariner-operator
2021-07-20T02:24:01.0406287Z
2021-07-20T02:24:01.0406625Z Packed 1 file.
2021-07-20T02:24:01.0407466Z             Successfully remade target file 'bin/submariner-operator'.
2021-07-20T02:24:01.0409097Z            Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-20T02:24:01.0410731Z           Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-20T02:24:01.0412208Z           Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-20T02:24:01.0413522Z            File 'FORCE_IMAGE' does not exist.
2021-07-20T02:24:01.0414284Z           Must remake target 'FORCE_IMAGE'.
2021-07-20T02:24:01.0415094Z           Successfully remade target file 'FORCE_IMAGE'.
2021-07-20T02:24:01.0416151Z         Must remake target 'package/.image.submariner-operator'.
2021-07-20T02:24:01.0418006Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator
2021-07-20T02:24:01.0826229Z flags:WARN flag short name (h) already defined
2021-07-20T02:24:01.1376411Z [36m[submariner-operator]$ set -e[0m
2021-07-20T02:24:01.1389237Z [36m[submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel[0m
2021-07-20T02:24:01.1400282Z [36m[submariner-operator]$ cache_flag=[0m
2021-07-20T02:24:01.1411239Z [36m[submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel[0m
2021-07-20T02:24:01.1425933Z [36m[submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel[0m
2021-07-20T02:24:01.4223786Z [36m[submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel[0m
2021-07-20T02:24:02.0187874Z devel: Pulling from submariner/submariner-operator
2021-07-20T02:24:02.0198629Z 9aabc6bb514c: Pulling fs layer
2021-07-20T02:24:02.2558454Z 9aabc6bb514c: Verifying Checksum
2021-07-20T02:24:02.2559210Z 9aabc6bb514c: Download complete
2021-07-20T02:24:02.4639290Z 9aabc6bb514c: Pull complete
2021-07-20T02:24:02.4682393Z Digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b
2021-07-20T02:24:02.4703718Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-20T02:24:02.4711597Z quay.io/submariner/submariner-operator:devel
2021-07-20T02:24:02.4755725Z [36m[submariner-operator]$ grep FROM package/Dockerfile.submariner-operator[0m
2021-07-20T02:24:02.4766512Z [36m[submariner-operator]$ cut -f2 -d [0m
2021-07-20T02:24:02.4776928Z [36m[submariner-operator]$ grep -v scratch[0m
2021-07-20T02:24:02.4798074Z [36m[submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel[0m
2021-07-20T02:24:02.4811079Z [36m[0m
2021-07-20T02:24:03.3334315Z [36m[submariner-operator]$ docker buildx use buildx_builder[0m
2021-07-20T02:24:04.1620308Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-20T02:24:04.1672985Z [36m[submariner-operator]$ docker buildx create --name buildx_builder --use[0m
2021-07-20T02:24:05.0129899Z buildx_builder
2021-07-20T02:24:05.0186657Z [36m[submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .[0m
2021-07-20T02:24:05.8516894Z #1 [internal] booting buildkit
2021-07-20T02:24:05.8517951Z #1 sha256:f59323889a889062156e6ff9bf38780fb8501ce7776427d59f0b539499b97e30
2021-07-20T02:24:06.0026162Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-20T02:24:09.7549340Z #1 pulling image moby/buildkit:buildx-stable-1 3.8s done
2021-07-20T02:24:09.7550645Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-20T02:24:10.1724783Z #1 creating container buildx_buildkit_buildx_builder0 0.5s done
2021-07-20T02:24:10.3217407Z #1 DONE 4.3s
2021-07-20T02:24:10.4432280Z
2021-07-20T02:24:10.4435347Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-20T02:24:10.4436924Z #2 sha256:af41b4fb9c3e44fbec6353fbcceea177089b64c0532cf143a2bd4f036b1c3970
2021-07-20T02:24:10.4438717Z #2 transferring dockerfile: 230B done
2021-07-20T02:24:10.4439344Z #2 DONE 0.0s
2021-07-20T02:24:10.4439592Z
2021-07-20T02:24:10.4440047Z #3 [internal] load .dockerignore
2021-07-20T02:24:10.4441138Z #3 sha256:c801bc1135e33df7b3ad6df612f53e506e4778ff16e03cb2d0608ad972185c72
2021-07-20T02:24:10.5936031Z #3 transferring context: 2B done
2021-07-20T02:24:10.5937602Z #3 DONE 0.0s
2021-07-20T02:24:10.5937840Z
2021-07-20T02:24:10.5938310Z #4 [internal] load build context
2021-07-20T02:24:10.5939422Z #4 sha256:7b1a43483ddc7c2cbbef16bb9a5f18e84a906e8b3aa2e26daeded69f9550916b
2021-07-20T02:24:10.5940437Z #4 DONE 0.0s
2021-07-20T02:24:10.5940678Z
2021-07-20T02:24:10.5941914Z #6 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-20T02:24:10.5943871Z #6 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-20T02:24:10.8942529Z #6 DONE 0.3s
2021-07-20T02:24:10.8942888Z
2021-07-20T02:24:10.8943340Z #4 [internal] load build context
2021-07-20T02:24:10.8944716Z #4 sha256:7b1a43483ddc7c2cbbef16bb9a5f18e84a906e8b3aa2e26daeded69f9550916b
2021-07-20T02:24:11.1918653Z #4 transferring context: 9.94MB 0.2s done
2021-07-20T02:24:11.1919227Z #4 DONE 0.3s
2021-07-20T02:24:11.1919519Z
2021-07-20T02:24:11.1920914Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-20T02:24:11.1923336Z #5 sha256:76769370b87c14157612d45ec4f285c50e256ca2d6cf4394aef243bcdc3c79fb
2021-07-20T02:24:11.1924105Z #5 CACHED
2021-07-20T02:24:11.1924348Z
2021-07-20T02:24:11.1924748Z #7 exporting to oci image format
2021-07-20T02:24:11.1925868Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-20T02:24:11.1926835Z #7 exporting layers done
2021-07-20T02:24:11.1927970Z #7 exporting manifest sha256:de9bbdc497e579259a39507af2f25bbb63c3b0a7ac43576fa382f07e1dd99e1f done
2021-07-20T02:24:11.1931018Z #7 exporting config sha256:2d7e862e7c9a7cf6d0fff86d715882397631fcc6b1ba617b2d8a8d78322e83b7 done
2021-07-20T02:24:11.3416816Z #7 ...
2021-07-20T02:24:11.3421973Z
2021-07-20T02:24:11.3423395Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-20T02:24:11.3424443Z #5 sha256:76769370b87c14157612d45ec4f285c50e256ca2d6cf4394aef243bcdc3c79fb
2021-07-20T02:24:11.3425850Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 9.62MB / 9.62MB 0.1s done
2021-07-20T02:24:11.3426871Z #5 CACHED
2021-07-20T02:24:11.3427117Z
2021-07-20T02:24:11.3427516Z #7 exporting to oci image format
2021-07-20T02:24:11.3428518Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-20T02:24:11.3429464Z #7 sending tarball
2021-07-20T02:24:11.4791540Z #7 sending tarball 0.3s done
2021-07-20T02:24:11.4792045Z #7 DONE 0.4s
2021-07-20T02:24:11.4792373Z
2021-07-20T02:24:11.4792781Z #9 exporting cache
2021-07-20T02:24:11.4794006Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-20T02:24:11.4795023Z #9 preparing build cache for export done
2021-07-20T02:24:11.4795495Z #9 DONE 0.0s
2021-07-20T02:24:11.4795718Z
2021-07-20T02:24:11.4796092Z #8 importing to docker
2021-07-20T02:24:11.4797223Z #8 sha256:af1c7adc83892e70c3d992533fc86c8496db5a3a66225e2262947991301fd772
2021-07-20T02:24:11.4798159Z #8 DONE 0.0s
2021-07-20T02:24:11.4903844Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel[0m
2021-07-20T02:24:11.7657202Z         Successfully remade target file 'package/.image.submariner-operator'.
2021-07-20T02:24:11.7658398Z          File 'build' does not exist.
2021-07-20T02:24:11.7659122Z            File 'bin/subctl' does not exist.
2021-07-20T02:24:11.7660153Z              File 'bin/subctl-devel-0105e4d-linux-amd64' does not exist.
2021-07-20T02:24:11.7885492Z             Must remake target 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-20T02:24:11.7886501Z mkdir -p bin
2021-07-20T02:24:11.7910781Z target=bin/subctl-devel-0105e4d-linux-amd64; \
2021-07-20T02:24:11.7912058Z target=${target%.exe}; \
2021-07-20T02:24:11.7913112Z components=($(echo ${target//-/ })); \
2021-07-20T02:24:11.7914035Z GOOS=${components[-2]}; \
2021-07-20T02:24:11.7914889Z GOARCH=${components[-1]}; \
2021-07-20T02:24:11.7915631Z export GOARCH GOOS; \
2021-07-20T02:24:11.7916538Z /opt/shipyard/scripts/compile.sh \
2021-07-20T02:24:11.7918347Z 	--ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \
2021-07-20T02:24:11.7920448Z 		   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-20T02:24:11.7922462Z 	--noupx bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-20T02:24:11.8456866Z [36m[submariner-operator]$ mkdir -p bin[0m
2021-07-20T02:24:11.8473954Z Building 'bin/subctl-devel-0105e4d-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \t\t   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-20T02:24:11.8490072Z [36m[submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d 		   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel[0m
2021-07-20T02:24:11.8507350Z [36m[submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d 		   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go[0m
2021-07-20T02:24:47.1211580Z             Successfully remade target file 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-20T02:24:47.1213475Z           Must remake target 'bin/subctl'.
2021-07-20T02:24:47.1214708Z ln -sf subctl-devel-0105e4d-linux-amd64 bin/subctl
2021-07-20T02:24:47.1242481Z           Successfully remade target file 'bin/subctl'.
2021-07-20T02:24:47.1243645Z         Must remake target 'build'.
2021-07-20T02:24:47.1244615Z         Successfully remade target file 'build'.
2021-07-20T02:24:47.1245546Z       Must remake target 'images'.
2021-07-20T02:24:47.1246501Z       Successfully remade target file 'images'.
2021-07-20T02:24:47.1247515Z     Must remake target 'preload-images'.
2021-07-20T02:24:47.1248333Z set -e;\
2021-07-20T02:24:47.1249039Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-20T02:24:47.1249838Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-20T02:24:47.1251461Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns; do\
2021-07-20T02:24:47.1252910Z 	import_image quay.io/submariner/${image};\
2021-07-20T02:24:47.1253792Z done
2021-07-20T02:24:47.1284910Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-operator[0m
2021-07-20T02:24:47.1295067Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-operator[0m
2021-07-20T02:24:47.1308353Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local[0m
2021-07-20T02:24:47.4258986Z [36m[submariner-operator]$ docker push localhost:5000/submariner-operator:local[0m
2021-07-20T02:24:47.6879339Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-20T02:24:47.7240192Z f9269f9cee12: Preparing
2021-07-20T02:24:48.3456413Z f9269f9cee12: Pushed
2021-07-20T02:24:48.3638949Z local: digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b size: 528
2021-07-20T02:24:48.3675989Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-gateway[0m
2021-07-20T02:24:48.3695018Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-gateway[0m
2021-07-20T02:24:48.3709871Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local[0m
2021-07-20T02:24:48.6451357Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-20T02:24:48.6475642Z [36m[submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel[0m
2021-07-20T02:24:49.1964419Z devel: Pulling from submariner/submariner-gateway
2021-07-20T02:24:49.1965250Z 8c741e919b67: Pulling fs layer
2021-07-20T02:24:49.1965766Z 13495efbbac4: Pulling fs layer
2021-07-20T02:24:49.1966540Z 6df6df193f2d: Pulling fs layer
2021-07-20T02:24:49.1967200Z 3afbe9ee7387: Pulling fs layer
2021-07-20T02:24:49.1971438Z 3afbe9ee7387: Waiting
2021-07-20T02:24:49.2920380Z 13495efbbac4: Verifying Checksum
2021-07-20T02:24:49.2921011Z 13495efbbac4: Download complete
2021-07-20T02:24:49.4610130Z 6df6df193f2d: Verifying Checksum
2021-07-20T02:24:49.4610774Z 6df6df193f2d: Download complete
2021-07-20T02:24:49.4922835Z 3afbe9ee7387: Verifying Checksum
2021-07-20T02:24:49.4923552Z 3afbe9ee7387: Download complete
2021-07-20T02:24:49.8797615Z 8c741e919b67: Verifying Checksum
2021-07-20T02:24:49.8798485Z 8c741e919b67: Download complete
2021-07-20T02:24:52.4613254Z 8c741e919b67: Pull complete
2021-07-20T02:24:53.8787084Z 13495efbbac4: Pull complete
2021-07-20T02:24:54.9700858Z 6df6df193f2d: Pull complete
2021-07-20T02:24:55.1512022Z 3afbe9ee7387: Pull complete
2021-07-20T02:24:55.1628238Z Digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895
2021-07-20T02:24:55.1645627Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-20T02:24:55.1681235Z quay.io/submariner/submariner-gateway:devel
2021-07-20T02:24:55.1705511Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev[0m
2021-07-20T02:24:55.4526517Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local[0m
2021-07-20T02:24:55.7273697Z [36m[submariner-operator]$ docker push localhost:5000/submariner-gateway:local[0m
2021-07-20T02:24:55.9909455Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-20T02:24:55.9985466Z 71972a942ed4: Preparing
2021-07-20T02:24:55.9986265Z 3c7f2d60eacb: Preparing
2021-07-20T02:24:55.9989697Z 00c5f6897675: Preparing
2021-07-20T02:24:56.0240785Z b3b62c837788: Preparing
2021-07-20T02:24:56.7293533Z 00c5f6897675: Pushed
2021-07-20T02:24:57.2470776Z 71972a942ed4: Pushed
2021-07-20T02:25:00.3922317Z 3c7f2d60eacb: Pushed
2021-07-20T02:25:07.6199784Z b3b62c837788: Pushed
2021-07-20T02:25:07.6388054Z local: digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895 size: 1159
2021-07-20T02:25:07.6424632Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-route-agent[0m
2021-07-20T02:25:07.6436977Z [36m[submariner-operator]$ import_image quay.io/submariner/submariner-route-agent[0m
2021-07-20T02:25:07.6443372Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local[0m
2021-07-20T02:25:07.9091330Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-20T02:25:07.9118163Z [36m[submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel[0m
2021-07-20T02:25:08.4969462Z devel: Pulling from submariner/submariner-route-agent
2021-07-20T02:25:08.4974369Z 8c741e919b67: Already exists
2021-07-20T02:25:08.4989062Z 13495efbbac4: Already exists
2021-07-20T02:25:08.5011632Z 70cc6422093d: Pulling fs layer
2021-07-20T02:25:08.5012203Z 7ba74d821748: Pulling fs layer
2021-07-20T02:25:08.5012793Z 62b0802bcf90: Pulling fs layer
2021-07-20T02:25:08.5014835Z 3e9c83283ee4: Pulling fs layer
2021-07-20T02:25:08.5015301Z 3e9c83283ee4: Waiting
2021-07-20T02:25:08.5880519Z 62b0802bcf90: Verifying Checksum
2021-07-20T02:25:08.5881242Z 62b0802bcf90: Download complete
2021-07-20T02:25:08.6551209Z 3e9c83283ee4: Verifying Checksum
2021-07-20T02:25:08.6552133Z 3e9c83283ee4: Download complete
2021-07-20T02:25:08.6699843Z 7ba74d821748: Verifying Checksum
2021-07-20T02:25:08.6701422Z 7ba74d821748: Download complete
2021-07-20T02:25:08.9267276Z 70cc6422093d: Download complete
2021-07-20T02:25:10.2683654Z 70cc6422093d: Pull complete
2021-07-20T02:25:10.4514633Z 7ba74d821748: Pull complete
2021-07-20T02:25:10.5276062Z 62b0802bcf90: Pull complete
2021-07-20T02:25:10.6177023Z 3e9c83283ee4: Pull complete
2021-07-20T02:25:10.6217597Z Digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c
2021-07-20T02:25:10.6241266Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-20T02:25:10.6260926Z quay.io/submariner/submariner-route-agent:devel
2021-07-20T02:25:10.6273176Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev[0m
2021-07-20T02:25:10.9015431Z [36m[submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local[0m
2021-07-20T02:25:11.1672497Z [36m[submariner-operator]$ docker push localhost:5000/submariner-route-agent:local[0m
2021-07-20T02:25:11.4425128Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-20T02:25:11.4466196Z 1d810a4c0610: Preparing
2021-07-20T02:25:11.4472651Z 7a86b74623fc: Preparing
2021-07-20T02:25:11.4474254Z 26de773c4486: Preparing
2021-07-20T02:25:11.4476035Z 6931e591f8e2: Preparing
2021-07-20T02:25:11.4477612Z 00c5f6897675: Preparing
2021-07-20T02:25:11.4479216Z b3b62c837788: Preparing
2021-07-20T02:25:11.4480783Z b3b62c837788: Waiting
2021-07-20T02:25:11.4787035Z 00c5f6897675: Mounted from submariner-gateway
2021-07-20T02:25:12.0740800Z 7a86b74623fc: Pushed
2021-07-20T02:25:12.0742122Z b3b62c837788: Mounted from submariner-gateway
2021-07-20T02:25:12.0817456Z 1d810a4c0610: Pushed
2021-07-20T02:25:12.0854722Z 26de773c4486: Pushed
2021-07-20T02:25:15.9087825Z 6931e591f8e2: Pushed
2021-07-20T02:25:15.9260676Z local: digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c size: 1575
2021-07-20T02:25:15.9296857Z [36m[submariner-operator]$ import_image quay.io/submariner/lighthouse-agent[0m
2021-07-20T02:25:15.9309456Z [36m[submariner-operator]$ import_image quay.io/submariner/lighthouse-agent[0m
2021-07-20T02:25:15.9316552Z [36m[submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local[0m
2021-07-20T02:25:16.1873212Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-20T02:25:16.1893922Z [36m[submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel[0m
2021-07-20T02:25:16.6997239Z devel: Pulling from submariner/lighthouse-agent
2021-07-20T02:25:16.6997992Z ecd69139dc76: Pulling fs layer
2021-07-20T02:25:16.6998495Z 8261c1767de3: Pulling fs layer
2021-07-20T02:25:16.8118050Z ecd69139dc76: Verifying Checksum
2021-07-20T02:25:16.8118702Z ecd69139dc76: Download complete
2021-07-20T02:25:16.8973852Z 8261c1767de3: Verifying Checksum
2021-07-20T02:25:16.8986493Z 8261c1767de3: Download complete
2021-07-20T02:25:16.9030845Z ecd69139dc76: Pull complete
2021-07-20T02:25:17.0478190Z 8261c1767de3: Pull complete
2021-07-20T02:25:17.0526836Z Digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f
2021-07-20T02:25:17.0546950Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-20T02:25:17.0564948Z quay.io/submariner/lighthouse-agent:devel
2021-07-20T02:25:17.0578934Z [36m[submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev[0m
2021-07-20T02:25:17.3189873Z [36m[submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local[0m
2021-07-20T02:25:17.5972363Z [36m[submariner-operator]$ docker push localhost:5000/lighthouse-agent:local[0m
2021-07-20T02:25:17.8711697Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-20T02:25:17.8775712Z 83c79e393e11: Preparing
2021-07-20T02:25:17.8776310Z 0026d2f62bbf: Preparing
2021-07-20T02:25:17.9349518Z 0026d2f62bbf: Pushed
2021-07-20T02:25:18.4409289Z 83c79e393e11: Pushed
2021-07-20T02:25:18.4601667Z local: digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f size: 735
2021-07-20T02:25:18.4640418Z [36m[submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns[0m
2021-07-20T02:25:18.4654328Z [36m[submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns[0m
2021-07-20T02:25:18.4671958Z [36m[submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local[0m
2021-07-20T02:25:18.7378079Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-20T02:25:18.7401082Z [36m[submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel[0m
2021-07-20T02:25:19.2651050Z devel: Pulling from submariner/lighthouse-coredns
2021-07-20T02:25:19.2651891Z 088e56360f76: Pulling fs layer
2021-07-20T02:25:19.2652431Z 18aed70882d2: Pulling fs layer
2021-07-20T02:25:19.3592338Z 088e56360f76: Verifying Checksum
2021-07-20T02:25:19.3593065Z 088e56360f76: Download complete
2021-07-20T02:25:19.4681321Z 088e56360f76: Pull complete
2021-07-20T02:25:19.5639062Z 18aed70882d2: Verifying Checksum
2021-07-20T02:25:19.5639788Z 18aed70882d2: Download complete
2021-07-20T02:25:19.8129896Z 18aed70882d2: Pull complete
2021-07-20T02:25:19.8167467Z Digest: sha256:92280c8723eb4400aeadedcb1885052b0d8344fc4c3efeee4cc91d10c5d29dd6
2021-07-20T02:25:19.8188232Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-20T02:25:19.8216312Z quay.io/submariner/lighthouse-coredns:devel
2021-07-20T02:25:19.8228387Z [36m[submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev[0m
2021-07-20T02:25:20.1074573Z [36m[submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local[0m
2021-07-20T02:25:20.3923241Z [36m[submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local[0m
2021-07-20T02:25:20.6645605Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-20T02:25:20.6728852Z 7fca351e51be: Preparing
2021-07-20T02:25:20.6783878Z 4fa0ece06e25: Preparing
2021-07-20T02:25:20.7494026Z 4fa0ece06e25: Pushed
2021-07-20T02:25:21.4166878Z 7fca351e51be: Pushed
2021-07-20T02:25:21.4363655Z local: digest: sha256:92280c8723eb4400aeadedcb1885052b0d8344fc4c3efeee4cc91d10c5d29dd6 size: 739
2021-07-20T02:25:21.4402569Z     Successfully remade target file 'preload-images'.
2021-07-20T02:25:21.4403628Z    Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-20T02:25:21.4404618Z    Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-20T02:25:21.4405562Z    Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-20T02:25:21.4406308Z   Must remake target 'deploy'.
2021-07-20T02:25:21.4408286Z /opt/shipyard/scripts/deploy.sh --cable_driver libreswan --service_discovery --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --deploytool_broker_args '--service-discovery'
2021-07-20T02:25:21.5387804Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='--service-discovery', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=true
2021-07-20T02:25:21.5409314Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/utils[0m
2021-07-20T02:25:21.5430629Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:25:21.5440961Z [36m[submariner-operator]$ script_name=utils[0m
2021-07-20T02:25:21.5453855Z [36m[submariner-operator]$ exec_name=deploy.sh[0m
2021-07-20T02:25:21.5473791Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs[0m
2021-07-20T02:25:21.5487865Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:25:21.5499733Z [36m[submariner-operator]$ script_name=deploy_funcs[0m
2021-07-20T02:25:21.5514324Z [36m[submariner-operator]$ exec_name=deploy.sh[0m
2021-07-20T02:25:21.5532786Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings[0m
2021-07-20T02:25:21.5550282Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:25:21.5560886Z [36m[submariner-operator]$ script_name=cluster_settings[0m
2021-07-20T02:25:21.5574194Z [36m[submariner-operator]$ exec_name=deploy.sh[0m
2021-07-20T02:25:21.5595157Z [36m[submariner-operator]$ broker=cluster1[0m
2021-07-20T02:25:21.5606319Z [36m[submariner-operator]$ declare -gA cluster_nodes[0m
2021-07-20T02:25:21.5618855Z [36m[submariner-operator]$ cluster_nodes[cluster1]=control-plane worker[0m
2021-07-20T02:25:21.5633310Z [36m[submariner-operator]$ cluster_nodes[cluster2]=control-plane worker[0m
2021-07-20T02:25:21.5643429Z [36m[submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker[0m
2021-07-20T02:25:21.5655414Z [36m[submariner-operator]$ declare -gA cluster_subm[0m
2021-07-20T02:25:21.5669271Z [36m[submariner-operator]$ cluster_subm[cluster1]=true[0m
2021-07-20T02:25:21.5681753Z [36m[submariner-operator]$ cluster_subm[cluster2]=true[0m
2021-07-20T02:25:21.5693851Z [36m[submariner-operator]$ cluster_subm[cluster3]=true[0m
2021-07-20T02:25:21.5706151Z [36m[submariner-operator]$ declare -gA cluster_cni[0m
2021-07-20T02:25:21.5717665Z [36m[submariner-operator]$ cluster_cni[cluster2]=weave[0m
2021-07-20T02:25:21.5730114Z [36m[submariner-operator]$ cluster_cni[cluster3]=weave[0m
2021-07-20T02:25:21.5743811Z [36m[submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings[0m
2021-07-20T02:25:21.5756781Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:25:21.5771157Z [36m[submariner-operator]$ script_name=cluster_settings[0m
2021-07-20T02:25:21.5785238Z [36m[submariner-operator]$ exec_name=deploy.sh[0m
2021-07-20T02:25:21.5807516Z [36m[submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker[0m
2021-07-20T02:25:21.5821439Z [36m[submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker[0m
2021-07-20T02:25:21.5856184Z [36m[submariner-operator]$ declare_cidrs[0m
2021-07-20T02:25:21.5870517Z [36m[submariner-operator]$ declare_cidrs[0m
2021-07-20T02:25:21.5880761Z [36m[submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs[0m
2021-07-20T02:25:21.5894181Z [36m[submariner-operator]$ i=1[0m
2021-07-20T02:25:21.5909176Z [36m[submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1[0m
2021-07-20T02:25:21.5923048Z [36m[submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1[0m
2021-07-20T02:25:21.5939280Z [36m[submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16[0m
2021-07-20T02:25:21.5978202Z [36m[submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16[0m
2021-07-20T02:25:21.6029847Z [36m[submariner-operator]$ [cluster1] i=$(("$i"+1))[0m
2021-07-20T02:25:21.6048310Z [36m[submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2[0m
2021-07-20T02:25:21.6074812Z [36m[submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2[0m
2021-07-20T02:25:21.6094502Z [36m[submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16[0m
2021-07-20T02:25:21.6110713Z [36m[submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16[0m
2021-07-20T02:25:21.6126678Z [36m[submariner-operator]$ [cluster2] i=$(("$i"+1))[0m
2021-07-20T02:25:21.6141946Z [36m[submariner-operator]$ [cluster2] declare_kubeconfig[0m
2021-07-20T02:25:21.6158001Z [36m[submariner-operator]$ [cluster2] declare_kubeconfig[0m
2021-07-20T02:25:21.6173913Z [36m[submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg[0m
2021-07-20T02:25:21.6190629Z [36m[submariner-operator]$ [cluster2] export KUBECONFIG[0m
2021-07-20T02:25:21.6203841Z [36m[submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)[0m
2021-07-20T02:25:21.6223346Z [36m[submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:[0m
2021-07-20T02:25:21.6263044Z [36m[submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash[0m
2021-07-20T02:25:21.7449246Z Installing subctl version devel
2021-07-20T02:25:21.7449939Z   OS detected:           linux
2021-07-20T02:25:21.7450499Z   Architecture detected: amd64
2021-07-20T02:25:21.7452729Z   Download URL:          https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-20T02:25:21.7453763Z
2021-07-20T02:25:21.7454339Z Downloading...
2021-07-20T02:25:22.7944815Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-20T02:25:22.8163033Z This provides subctl version: devel
2021-07-20T02:25:22.8183570Z
2021-07-20T02:25:22.8185232Z please update your path (and consider adding it to ~/.profile):
2021-07-20T02:25:22.8185771Z     export PATH=$PATH:/go/bin
2021-07-20T02:25:22.8186127Z
2021-07-20T02:25:22.8295126Z [36m[submariner-operator]$ [cluster2] load_deploytool operator[0m
2021-07-20T02:25:22.8308499Z [36m[submariner-operator]$ [cluster2] load_deploytool operator[0m
2021-07-20T02:25:22.8314328Z Will deploy submariner using operator
2021-07-20T02:25:22.8326592Z [36m[submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator[0m
2021-07-20T02:25:22.8339191Z [36m[submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:25:22.8351666Z [36m[submariner-operator]$ [cluster2] script_name=deploy_operator[0m
2021-07-20T02:25:22.8372819Z [36m[submariner-operator]$ [cluster2] exec_name=deploy.sh[0m
2021-07-20T02:25:22.8393842Z [36m[submariner-operator]$ [cluster2] deploytool_prereqs[0m
2021-07-20T02:25:22.8428072Z [36m[submariner-operator]$ [cluster2] deploytool_prereqs[0m
2021-07-20T02:25:22.8439904Z [36m[0m
2021-07-20T02:25:22.8452666Z [36m[submariner-operator]$ [cluster2] subctl version[0m
2021-07-20T02:25:22.8661767Z subctl version: devel-0105e4d
2021-07-20T02:25:22.8690222Z [36m[submariner-operator]$ [cluster2] run_if_defined pre_deploy[0m
2021-07-20T02:25:22.8702719Z [36m[submariner-operator]$ [cluster2] run_if_defined pre_deploy[0m
2021-07-20T02:25:22.8715241Z [36m[submariner-operator]$ [cluster2] type -t pre_deploy[0m
2021-07-20T02:25:22.8733061Z [36m[submariner-operator]$ [cluster2] grep -q function[0m
2021-07-20T02:25:22.8767170Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-20T02:25:22.8781090Z [36m[submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster[0m
2021-07-20T02:25:22.8796877Z [36m[submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster[0m
2021-07-20T02:25:22.8812554Z [36m[submariner-operator]$ [cluster2] declare -a subm_clusters[0m
2021-07-20T02:25:22.8858440Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster[0m
2021-07-20T02:25:22.8874435Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster[0m
2021-07-20T02:25:22.8889824Z [36m[submariner-operator]$ [cluster2] declare -A pids[0m
2021-07-20T02:25:22.8911544Z [36m[submariner-operator]$ [cluster2] eval echo cluster1 cluster2[0m
2021-07-20T02:25:22.8932076Z [36m[submariner-operator]$ [cluster1] set -o pipefail[0m
2021-07-20T02:25:22.8933173Z [36m[submariner-operator]$ [cluster1] pids[cluster1]=7216[0m
2021-07-20T02:25:22.8949814Z [36m[submariner-operator]$ [cluster2] pids[cluster2]=7219[0m
2021-07-20T02:25:22.8957723Z [36m[submariner-operator]$ [cluster1] prepare_cluster[0m
2021-07-20T02:25:22.8964944Z [36m[submariner-operator]$ [cluster2] set -o pipefail[0m
2021-07-20T02:25:22.8975145Z [36m[submariner-operator]$ [cluster2] wait 7219[0m
2021-07-20T02:25:22.8979770Z [36m[submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /[0m
2021-07-20T02:25:22.8995247Z [36m[submariner-operator]$ [cluster2] prepare_cluster[0m
2021-07-20T02:25:22.9036688Z [36m[submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /[0m
2021-07-20T02:25:23.2872313Z [36m[submariner-operator]$ [cluster1] prepare_cluster[0m
2021-07-20T02:25:23.2873495Z [36m[submariner-operator]$ [cluster1] add_subm_gateway_label[0m
2021-07-20T02:25:23.2874790Z [36m[submariner-operator]$ [cluster1] add_subm_gateway_label[0m
2021-07-20T02:25:23.2876220Z [36m[submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite[0m
2021-07-20T02:25:23.2877917Z [36m[submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite[0m
2021-07-20T02:25:23.2879739Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite[0m
2021-07-20T02:25:23.2881121Z [cluster1] node/cluster1-worker labeled
2021-07-20T02:25:23.3383542Z [36m[submariner-operator]$ [cluster2] prepare_cluster[0m
2021-07-20T02:25:23.3384695Z [36m[submariner-operator]$ [cluster2] add_subm_gateway_label[0m
2021-07-20T02:25:23.3385794Z [36m[submariner-operator]$ [cluster2] add_subm_gateway_label[0m
2021-07-20T02:25:23.3387199Z [36m[submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite[0m
2021-07-20T02:25:23.3388966Z [36m[submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite[0m
2021-07-20T02:25:23.3390670Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite[0m
2021-07-20T02:25:23.3391909Z [cluster2] node/cluster2-worker labeled
2021-07-20T02:25:23.3402104Z [36m[submariner-operator]$ [cluster2] wait 7216[0m
2021-07-20T02:25:23.3415370Z [36m[submariner-operator]$ [cluster2] with_context cluster1 setup_broker[0m
2021-07-20T02:25:23.3429803Z [36m[submariner-operator]$ [cluster2] with_context cluster1 setup_broker[0m
2021-07-20T02:25:23.3446094Z [36m[submariner-operator]$ [cluster1] setup_broker[0m
2021-07-20T02:25:23.3459632Z [36m[submariner-operator]$ [cluster1] setup_broker[0m
2021-07-20T02:25:23.3477979Z [36m[submariner-operator]$ [cluster1] sd=--components service-discovery,connectivity[0m
2021-07-20T02:25:23.3483675Z Installing broker...
2021-07-20T02:25:23.3495552Z [36m[submariner-operator]$ [cluster1] subctlrepver=[0m
2021-07-20T02:25:23.3510916Z [36m[submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local[0m
2021-07-20T02:25:23.3532550Z [36m[submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output[0m
2021-07-20T02:25:23.3544839Z [36m[output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local --components service-discovery,connectivity --service-discovery[0m
2021-07-20T02:25:23.3745064Z Flag --service-discovery has been deprecated, please use --components instead
2021-07-20T02:25:23.3776312Z  • Setting up broker RBAC  ...
2021-07-20T02:25:23.4734607Z  ✓ Setting up broker RBAC
2021-07-20T02:25:23.4735505Z  • Deploying the Submariner operator  ...
2021-07-20T02:25:34.7152665Z  ✓ Deploying the Submariner operator
2021-07-20T02:25:34.7154408Z  ✓ Created operator CRDs
2021-07-20T02:25:34.7155507Z  ✓ Created operator namespace: submariner-operator
2021-07-20T02:25:34.7156623Z  ✓ Created operator service account and role
2021-07-20T02:25:34.7157686Z  ✓ Created lighthouse service account and role
2021-07-20T02:25:34.7158603Z  ✓ Created Lighthouse service accounts and roles
2021-07-20T02:25:34.7159472Z  ✓ Deployed the operator successfully
2021-07-20T02:25:34.7160273Z  • Deploying the broker  ...
2021-07-20T02:25:34.7753530Z  ✓ Deploying the broker
2021-07-20T02:25:34.7754469Z  ✓ The broker has been deployed
2021-07-20T02:25:34.7755335Z  • Creating broker-info.subm file  ...
2021-07-20T02:25:34.7872247Z  ✓ Creating broker-info.subm file
2021-07-20T02:25:34.7873228Z  ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-20T02:25:34.7925055Z [36m[submariner-operator]$ [cluster2] install_subm_all_clusters[0m
2021-07-20T02:25:34.7938801Z [36m[submariner-operator]$ [cluster2] install_subm_all_clusters[0m
2021-07-20T02:25:34.7952910Z [36m[submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm[0m
2021-07-20T02:25:34.7967944Z [36m[submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm[0m
2021-07-20T02:25:34.7978434Z [36m[submariner-operator]$ [cluster2] declare -a subm_clusters[0m
2021-07-20T02:25:34.8011710Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm[0m
2021-07-20T02:25:34.8024433Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm[0m
2021-07-20T02:25:34.8099389Z [36m[submariner-operator]$ [cluster2] declare -A pids[0m
2021-07-20T02:25:34.8121101Z [36m[submariner-operator]$ [cluster2] eval echo cluster1 cluster2[0m
2021-07-20T02:25:34.8151900Z [36m[submariner-operator]$ [cluster1] pids[cluster1]=7281[0m
2021-07-20T02:25:34.8154881Z [36m[submariner-operator]$ [cluster1] set -o pipefail[0m
2021-07-20T02:25:34.8166627Z [36m[submariner-operator]$ [cluster1] subctl_install_subm[0m
2021-07-20T02:25:34.8179696Z [36m[submariner-operator]$ [cluster2] pids[cluster2]=7285[0m
2021-07-20T02:25:34.8201754Z [36m[submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /[0m
2021-07-20T02:25:34.8210979Z [36m[submariner-operator]$ [cluster2] set -o pipefail[0m
2021-07-20T02:25:34.8224649Z [36m[submariner-operator]$ [cluster2] wait 7285[0m
2021-07-20T02:25:34.8229729Z [36m[submariner-operator]$ [cluster2] subctl_install_subm[0m
2021-07-20T02:25:34.8262294Z [36m[submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /[0m
2021-07-20T02:25:41.4099971Z [36m[submariner-operator]$ [cluster1] subctl_install_subm[0m
2021-07-20T02:25:41.4101727Z [36m[submariner-operator]$ [cluster1] subctlrepver=[0m
2021-07-20T02:25:41.4105434Z [36m[submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local[0m
2021-07-20T02:25:41.4106687Z [36m[submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false[0m
2021-07-20T02:25:41.4109213Z [36m[submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr  --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm[0m
2021-07-20T02:25:41.4111851Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.4:6443
2021-07-20T02:25:41.4112835Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-20T02:25:41.4113492Z [cluster1]   - cluster1-worker
2021-07-20T02:25:41.4114173Z [cluster1]  • Discovering network details  ...
2021-07-20T02:25:41.4115085Z [cluster1]         Network plugin:  weave-net
2021-07-20T02:25:41.4115661Z [cluster1]         Service CIDRs:   [100.1.0.0/16]
2021-07-20T02:25:41.4116181Z [cluster1]         Cluster CIDRs:   [10.1.0.0/16]
2021-07-20T02:25:41.4117176Z [cluster1]  ✓ Discovering network details
2021-07-20T02:25:41.4118046Z [cluster1]  • Discovering multi cluster details  ...
2021-07-20T02:25:41.4118973Z [cluster1]  • Validating Globalnet configurations  ...
2021-07-20T02:25:41.4119929Z [cluster1]  ✓ Validating Globalnet configurations
2021-07-20T02:25:41.4120825Z [cluster1]  ✓ Discovering multi cluster details
2021-07-20T02:25:41.4121725Z [cluster1]  • Deploying the Submariner operator  ...
2021-07-20T02:25:41.4122607Z [cluster1]  ✓ Deploying the Submariner operator
2021-07-20T02:25:41.4123709Z [cluster1]  ✓ Created Lighthouse service accounts and roles
2021-07-20T02:25:41.4124571Z [cluster1]  • Creating SA for cluster  ...
2021-07-20T02:25:41.4125328Z [cluster1]  ✓ Creating SA for cluster
2021-07-20T02:25:41.4126080Z [cluster1]  • Deploying Submariner  ...
2021-07-20T02:25:41.4126857Z [cluster1]  ✓ Deploying Submariner
2021-07-20T02:25:41.4127638Z [cluster1]  ✓ Submariner is up and running
2021-07-20T02:25:48.2308103Z [36m[submariner-operator]$ [cluster2] subctl_install_subm[0m
2021-07-20T02:25:48.2309673Z [36m[submariner-operator]$ [cluster2] subctlrepver=[0m
2021-07-20T02:25:48.2311026Z [36m[submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local[0m
2021-07-20T02:25:48.2312285Z [36m[submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false[0m
2021-07-20T02:25:48.2315407Z [36m[submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr  --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm[0m
2021-07-20T02:25:48.2318707Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.4:6443
2021-07-20T02:25:48.2319810Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-20T02:25:48.2320584Z [cluster2]   - cluster2-worker
2021-07-20T02:25:48.2321353Z [cluster2]  • Discovering network details  ...
2021-07-20T02:25:48.2322129Z [cluster2]         Network plugin:  weave-net
2021-07-20T02:25:48.2322706Z [cluster2]         Service CIDRs:   [100.2.0.0/16]
2021-07-20T02:25:48.2323230Z [cluster2]         Cluster CIDRs:   [10.2.0.0/16]
2021-07-20T02:25:48.2323954Z [cluster2]  ✓ Discovering network details
2021-07-20T02:25:48.2324748Z [cluster2]  • Discovering multi cluster details  ...
2021-07-20T02:25:48.2325762Z [cluster2]  • Validating Globalnet configurations  ...
2021-07-20T02:25:48.2326631Z [cluster2]  ✓ Validating Globalnet configurations
2021-07-20T02:25:48.2327470Z [cluster2]  ✓ Discovering multi cluster details
2021-07-20T02:25:48.2328284Z [cluster2]  • Deploying the Submariner operator  ...
2021-07-20T02:25:48.2329127Z [cluster2]  ✓ Deploying the Submariner operator
2021-07-20T02:25:48.2329887Z [cluster2]  ✓ Created operator CRDs
2021-07-20T02:25:48.2330796Z [cluster2]  ✓ Created operator namespace: submariner-operator
2021-07-20T02:25:48.2331761Z [cluster2]  ✓ Created operator service account and role
2021-07-20T02:25:48.2332627Z [cluster2]  ✓ Created lighthouse service account and role
2021-07-20T02:25:48.2333529Z [cluster2]  ✓ Created Lighthouse service accounts and roles
2021-07-20T02:25:48.2334564Z [cluster2]  ✓ Deployed the operator successfully
2021-07-20T02:25:48.2335403Z [cluster2]  • Creating SA for cluster  ...
2021-07-20T02:25:48.2336146Z [cluster2]  ✓ Creating SA for cluster
2021-07-20T02:25:48.2336936Z [cluster2]  • Deploying Submariner  ...
2021-07-20T02:25:48.2337692Z [cluster2]  ✓ Deploying Submariner
2021-07-20T02:25:48.2338477Z [cluster2]  ✓ Submariner is up and running
2021-07-20T02:25:48.2364220Z [36m[submariner-operator]$ [cluster2] wait 7281[0m
2021-07-20T02:25:48.2389717Z [36m[submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status[0m
2021-07-20T02:25:48.2414737Z [36m[submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status[0m
2021-07-20T02:25:48.2474146Z [36m[submariner-operator]$ [cluster2] with_retries 30 verify_gw_status[0m
2021-07-20T02:25:48.2590996Z [36m[submariner-operator]$ [cluster2] with_retries[0m
2021-07-20T02:25:48.2672426Z [36m[submariner-operator]$ [cluster2] iteration=1[0m
2021-07-20T02:25:48.2705036Z [36m[submariner-operator]$ [cluster2] wait 7324[0m
2021-07-20T02:25:48.2709222Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:25:48.2720091Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:25:48.2755304Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-20T02:25:48.2768615Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:25:48.2823114Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-20T02:25:48.7112830Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:25:48.7131291Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-20T02:25:48.8774191Z  • Showing Connections  ...
2021-07-20T02:25:48.8862042Z  ✗ Showing Connections
2021-07-20T02:25:48.8868074Z  ✗ There are no gateways detected
2021-07-20T02:25:49.1013482Z  • Showing Connections  ...
2021-07-20T02:25:49.1209844Z panic: runtime error: invalid memory address or nil pointer dereference
2021-07-20T02:25:49.1218175Z [signal SIGSEGV: segmentation violation code=0x1 addr=0x60 pc=0x1a02ca9]
2021-07-20T02:25:49.1222167Z
2021-07-20T02:25:49.1228220Z goroutine 1 [running]:
2021-07-20T02:25:49.1235748Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show.getConnectionsStatus(0xc00045a370, 0xc0000c0000)
2021-07-20T02:25:49.1243821Z 	github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show/connections.go:65 +0x89
2021-07-20T02:25:49.1272254Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show.showConnections(0xc00045a370, 0xc000470fc0)
2021-07-20T02:25:49.1273871Z 	github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show/connections.go:132 +0x3f
2021-07-20T02:25:49.1275509Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd.ExecuteMultiCluster(0x1fe2f30)
2021-07-20T02:25:49.1276908Z 	github.com/submariner-io/submariner-operator/pkg/subctl/cmd/execute.go:103 +0x1a7
2021-07-20T02:25:49.1278277Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show.init.1.func1(0xc000222580, 0x30541c8, 0x0, 0x0)
2021-07-20T02:25:49.1279669Z 	github.com/submariner-io/submariner-operator/pkg/subctl/cmd/show/connections.go:49 +0x2d
2021-07-20T02:25:49.1280862Z github.com/spf13/cobra.(*Command).execute(0xc000222580, 0x30541c8, 0x0, 0x0, 0xc000222580, 0x30541c8)
2021-07-20T02:25:49.1281610Z 	github.com/spf13/cobra@v1.2.0/command.go:863 +0x2c2
2021-07-20T02:25:49.1282328Z github.com/spf13/cobra.(*Command).ExecuteC(0x2ff79a0, 0x30256c0, 0x0, 0xc000062778)
2021-07-20T02:25:49.1283050Z 	github.com/spf13/cobra@v1.2.0/command.go:977 +0x375
2021-07-20T02:25:49.1283682Z github.com/spf13/cobra.(*Command).Execute(...)
2021-07-20T02:25:49.1284288Z 	github.com/spf13/cobra@v1.2.0/command.go:905
2021-07-20T02:25:49.1285299Z github.com/submariner-io/submariner-operator/pkg/subctl/cmd.Execute(...)
2021-07-20T02:25:49.1286478Z 	github.com/submariner-io/submariner-operator/pkg/subctl/cmd/root.go:58
2021-07-20T02:25:49.1287171Z main.main()
2021-07-20T02:25:49.1287853Z 	command-line-arguments/main.go:31 +0x32
2021-07-20T02:25:49.1298711Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-20T02:25:49.1308928Z [36m[submariner-operator]$ [cluster2] sleep 6[0m
2021-07-20T02:25:55.1343261Z [36m[submariner-operator]$ [cluster2] return 1[0m
2021-07-20T02:25:55.1388667Z [36m[submariner-operator]$ [cluster2] wait 7351[0m
2021-07-20T02:25:55.1411729Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:25:55.1428385Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:25:55.1448069Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-20T02:25:55.1485090Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:25:55.1509454Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-20T02:25:56.9562070Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:25:56.9578056Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-20T02:25:57.0897263Z  • Showing Connections  ...
2021-07-20T02:25:57.1005401Z  ✗ Showing Connections
2021-07-20T02:25:57.1006103Z  ✗ There are no gateways detected
2021-07-20T02:25:57.1252798Z  • Showing Connections  ...
2021-07-20T02:25:57.1281907Z  ✗ Showing Connections
2021-07-20T02:25:57.1282653Z  ✗ There are no gateways detected
2021-07-20T02:25:57.1309053Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-20T02:25:57.1323107Z [36m[submariner-operator]$ [cluster2] sleep 6[0m
2021-07-20T02:26:03.1350982Z [36m[submariner-operator]$ [cluster2] return 1[0m
2021-07-20T02:26:03.1442193Z [36m[submariner-operator]$ [cluster2] wait 7377[0m
2021-07-20T02:26:03.1461560Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:26:03.1477222Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:26:03.1516987Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-20T02:26:03.1553242Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:26:03.1664253Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-20T02:26:04.0586024Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:26:04.0628560Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-20T02:26:04.2460828Z  • Showing Connections  ...
2021-07-20T02:26:04.2567421Z  ✗ Showing Connections
2021-07-20T02:26:04.2568072Z  ✗ No connections found
2021-07-20T02:26:04.3194713Z  • Showing Connections  ...
2021-07-20T02:26:05.2346058Z  ✗ Showing Connections
2021-07-20T02:26:05.2346882Z  ✗ There are no gateways detected
2021-07-20T02:26:05.2375473Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-20T02:26:05.2391640Z [36m[submariner-operator]$ [cluster2] sleep 6[0m
2021-07-20T02:26:11.2420324Z [36m[submariner-operator]$ [cluster2] return 1[0m
2021-07-20T02:26:11.2462620Z [36m[submariner-operator]$ [cluster2] wait 7405[0m
2021-07-20T02:26:11.2497829Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:26:11.2511822Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:26:11.2527040Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-20T02:26:11.2543664Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:26:11.2560897Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-20T02:26:11.4289975Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:26:11.4313789Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-20T02:26:11.5851560Z  • Showing Connections  ...
2021-07-20T02:26:11.5897291Z  ✗ Showing Connections
2021-07-20T02:26:11.5912498Z  ✗ No connections found
2021-07-20T02:26:11.6045535Z  • Showing Connections  ...
2021-07-20T02:26:11.6103128Z  ✗ Showing Connections
2021-07-20T02:26:11.6106872Z  ✗ There are no gateways detected
2021-07-20T02:26:11.6145401Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-20T02:26:11.6165821Z [36m[submariner-operator]$ [cluster2] sleep 6[0m
2021-07-20T02:26:17.6197361Z [36m[submariner-operator]$ [cluster2] return 1[0m
2021-07-20T02:26:17.6230512Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:26:17.6236931Z [36m[submariner-operator]$ [cluster2] wait 7431[0m
2021-07-20T02:26:17.6240165Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:26:17.6249872Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-20T02:26:17.6261748Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:26:17.6277685Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-20T02:26:17.7885946Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:26:17.7919702Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-20T02:26:17.9150935Z  • Showing Connections  ...
2021-07-20T02:26:17.9252429Z  ✗ Showing Connections
2021-07-20T02:26:17.9253197Z  ✗ No connections found
2021-07-20T02:26:17.9696485Z  • Showing Connections  ...
2021-07-20T02:26:17.9825180Z  ✗ Showing Connections
2021-07-20T02:26:17.9825951Z  ✗ There are no gateways detected
2021-07-20T02:26:17.9850297Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-20T02:26:17.9864510Z [36m[submariner-operator]$ [cluster2] sleep 6[0m
2021-07-20T02:26:23.9900769Z [36m[submariner-operator]$ [cluster2] return 1[0m
2021-07-20T02:26:23.9950790Z [36m[submariner-operator]$ [cluster2] wait 7458[0m
2021-07-20T02:26:23.9951664Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:26:23.9964187Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:26:23.9978471Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-20T02:26:23.9989650Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:26:24.0006114Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-20T02:26:24.0666337Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:26:24.0690542Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-20T02:26:24.1138614Z  • Showing Connections  ...
2021-07-20T02:26:24.1164177Z  ✗ Showing Connections
2021-07-20T02:26:24.1164859Z  ✗ No connections found
2021-07-20T02:26:24.1196451Z  • Showing Connections  ...
2021-07-20T02:26:24.1221535Z  ✗ Showing Connections
2021-07-20T02:26:24.1222228Z  ✗ No connections found
2021-07-20T02:26:24.1252243Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-20T02:26:24.1266109Z [36m[submariner-operator]$ [cluster2] sleep 6[0m
2021-07-20T02:26:30.1291994Z [36m[submariner-operator]$ [cluster2] return 1[0m
2021-07-20T02:26:30.1328454Z [36m[submariner-operator]$ [cluster2] wait 7484[0m
2021-07-20T02:26:30.1334236Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:26:30.1348427Z [36m[submariner-operator]$ [cluster2] verify_gw_status[0m
2021-07-20T02:26:30.1362011Z [36m[submariner-operator]$ [cluster2] sleep_duration=6[0m
2021-07-20T02:26:30.1377614Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:26:30.1391929Z [36m[submariner-operator]$ [cluster2] grep the server could not find the requested resource[0m
2021-07-20T02:26:30.2225025Z [36m[submariner-operator]$ [cluster2] subctl show connections[0m
2021-07-20T02:26:30.2243533Z [36m[submariner-operator]$ [cluster2] grep connected[0m
2021-07-20T02:26:30.2689570Z  • Showing Connections  ...
2021-07-20T02:26:30.2717196Z  ✓ Showing Connections
2021-07-20T02:26:30.2853139Z  • Showing Connections  ...
2021-07-20T02:26:30.2877787Z  ✓ Showing Connections
2021-07-20T02:26:30.2903293Z cluster2-worker  cluster2  172.18.0.7  no   libreswan     100.2.0.0/16, 10.2.0.0/16  connected  213.28µs
2021-07-20T02:26:30.2904646Z cluster1-worker  cluster1  172.18.0.6  no   libreswan     100.1.0.0/16, 10.1.0.0/16  connected  174.386µs
2021-07-20T02:26:30.2922700Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-20T02:26:30.2937104Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-20T02:26:30.2954017Z [36m[submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1[0m
2021-07-20T02:26:30.2965413Z [36m[submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1[0m
2021-07-20T02:26:30.2983123Z [36m[submariner-operator]$ [cluster2] connectivity_tests cluster1[0m
2021-07-20T02:26:30.2995536Z [36m[submariner-operator]$ [cluster2] connectivity_tests[0m
2021-07-20T02:26:30.3009978Z [36m[submariner-operator]$ [cluster2] target_cluster=cluster1[0m
2021-07-20T02:26:30.3024395Z [36m[submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest[0m
2021-07-20T02:26:30.3041573Z [36m[submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest[0m
2021-07-20T02:26:30.3055885Z [36m[submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local[0m
2021-07-20T02:26:30.6386242Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-20T02:26:30.6445535Z [36m[submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel[0m
2021-07-20T02:26:31.2940563Z devel: Pulling from submariner/nettest
2021-07-20T02:26:31.2945236Z 5843afab3874: Already exists
2021-07-20T02:26:31.2964334Z 07557957ddf1: Pulling fs layer
2021-07-20T02:26:31.2964945Z 3e381c3e8fb7: Pulling fs layer
2021-07-20T02:26:31.2965531Z 9eef9f7a1e2d: Pulling fs layer
2021-07-20T02:26:31.4455706Z 07557957ddf1: Download complete
2021-07-20T02:26:31.4626529Z 9eef9f7a1e2d: Verifying Checksum
2021-07-20T02:26:31.4629073Z 9eef9f7a1e2d: Download complete
2021-07-20T02:26:31.6271277Z 3e381c3e8fb7: Verifying Checksum
2021-07-20T02:26:31.6271887Z 3e381c3e8fb7: Download complete
2021-07-20T02:26:31.6295852Z 07557957ddf1: Pull complete
2021-07-20T02:26:32.1292902Z 3e381c3e8fb7: Pull complete
2021-07-20T02:26:32.2436466Z 9eef9f7a1e2d: Pull complete
2021-07-20T02:26:32.2495898Z Digest: sha256:97257f0ca58fda5e76ba72feed36f899d870c0811b0ada92a9abfeea2027ee88
2021-07-20T02:26:32.2512689Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-20T02:26:32.2563710Z quay.io/submariner/nettest:devel
2021-07-20T02:26:32.2635818Z [36m[submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev[0m
2021-07-20T02:26:32.6331744Z [36m[submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local[0m
2021-07-20T02:26:32.9854263Z [36m[submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local[0m
2021-07-20T02:26:33.3374240Z The push refers to repository [localhost:5000/nettest]
2021-07-20T02:26:33.4713749Z 84184d8131fb: Preparing
2021-07-20T02:26:33.4714787Z c277b396665a: Preparing
2021-07-20T02:26:33.4715837Z 135742dfad9e: Preparing
2021-07-20T02:26:33.4716465Z 72e830a4dff5: Preparing
2021-07-20T02:26:34.0511851Z 135742dfad9e: Pushed
2021-07-20T02:26:34.0624848Z 84184d8131fb: Pushed
2021-07-20T02:26:34.0696201Z 72e830a4dff5: Pushed
2021-07-20T02:26:34.6669444Z c277b396665a: Pushed
2021-07-20T02:26:34.6860044Z local: digest: sha256:97257f0ca58fda5e76ba72feed36f899d870c0811b0ada92a9abfeea2027ee88 size: 1155
2021-07-20T02:26:34.6936765Z [36m[submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-20T02:26:34.6947495Z [36m[submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-20T02:26:34.6964371Z [36m[submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")[0m
2021-07-20T02:26:34.6983701Z [36m[submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml[0m
2021-07-20T02:26:34.7010936Z [36m[submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-20T02:26:34.7025399Z [36m[submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-20T02:26:34.7040303Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-20T02:26:35.2303125Z deployment.apps/netshoot created
2021-07-20T02:26:35.2360333Z Waiting for netshoot pods to be ready.
2021-07-20T02:26:35.2379242Z [36m[submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m[0m
2021-07-20T02:26:35.2392171Z [36m[submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m[0m
2021-07-20T02:26:35.2405416Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m[0m
2021-07-20T02:26:35.6284207Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-20T02:26:36.6207691Z deployment "netshoot" successfully rolled out
2021-07-20T02:26:36.6263452Z [36m[submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-20T02:26:36.6275628Z [36m[submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-20T02:26:36.6287181Z [36m[submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-20T02:26:36.6298622Z [36m[submariner-operator]$ [cluster1] deploy_resource[0m
2021-07-20T02:26:36.6313359Z [36m[submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")[0m
2021-07-20T02:26:36.6330816Z [36m[submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml[0m
2021-07-20T02:26:36.6347720Z [36m[submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-20T02:26:36.6359152Z [36m[submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-20T02:26:36.6374470Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-20T02:26:37.2956096Z deployment.apps/nginx-demo created
2021-07-20T02:26:37.3072328Z service/nginx-demo created
2021-07-20T02:26:37.3633080Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-20T02:26:37.3693981Z Waiting for nginx-demo pods to be ready.
2021-07-20T02:26:37.3714866Z [36m[submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m[0m
2021-07-20T02:26:37.3741886Z [36m[submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m[0m
2021-07-20T02:26:37.3768308Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m[0m
2021-07-20T02:26:37.8909829Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-20T02:26:43.5977624Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-20T02:26:43.6384789Z deployment "nginx-demo" successfully rolled out
2021-07-20T02:26:43.6456611Z [36m[submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')[0m
2021-07-20T02:26:43.6489141Z [36m[submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot[0m
2021-07-20T02:26:43.6511639Z [36m[submariner-operator]$ [cluster2] awk FNR == 2 {print $1}[0m
2021-07-20T02:26:43.6544882Z [36m[submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot[0m
2021-07-20T02:26:43.6591129Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot[0m
2021-07-20T02:26:44.0593105Z [36m[submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)[0m
2021-07-20T02:26:44.0610857Z [36m[submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo[0m
2021-07-20T02:26:44.0624418Z [36m[submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo[0m
2021-07-20T02:26:44.0638359Z [36m[submariner-operator]$ [cluster1] get_svc_ip nginx-demo[0m
2021-07-20T02:26:44.0650748Z [36m[submariner-operator]$ [cluster1] get_svc_ip[0m
2021-07-20T02:26:44.0665431Z [36m[submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')[0m
2021-07-20T02:26:44.0686573Z [36m[submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo[0m
2021-07-20T02:26:44.0701302Z [36m[submariner-operator]$ [cluster1] awk FNR == 2 {print $3}[0m
2021-07-20T02:26:44.0711363Z [36m[submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo[0m
2021-07-20T02:26:44.0745232Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo[0m
2021-07-20T02:26:44.3939369Z [36m[submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-789f6cf54f-4bc2r 100.1.27.210[0m
2021-07-20T02:26:44.3958337Z [36m[submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-789f6cf54f-4bc2r 100.1.27.210[0m
2021-07-20T02:26:44.3986349Z [36m[submariner-operator]$ [cluster2] iteration=1[0m
2021-07-20T02:26:44.4034964Z [36m[submariner-operator]$ [cluster2] test_connection netshoot-789f6cf54f-4bc2r 100.1.27.210[0m
2021-07-20T02:26:44.4053202Z [36m[submariner-operator]$ [cluster2] wait 7638[0m
2021-07-20T02:26:44.4059583Z [36m[submariner-operator]$ [cluster2] test_connection[0m
2021-07-20T02:26:44.4068949Z Attempting connectivity between clusters - netshoot-789f6cf54f-4bc2r --> 100.1.27.210
2021-07-20T02:26:44.4083413Z [36m[submariner-operator]$ [cluster2] wait_time=30[0m
2021-07-20T02:26:44.4099303Z [36m[submariner-operator]$ [cluster2] start_time=$(date +%s)[0m
2021-07-20T02:26:44.4121257Z [36m[submariner-operator]$ [cluster2] date +%s[0m
2021-07-20T02:26:44.4183595Z [36m[submariner-operator]$ [cluster2] kubectl exec netshoot-789f6cf54f-4bc2r -- curl --output /dev/null -m 30 --silent --head --fail 100.1.27.210[0m
2021-07-20T02:26:44.4196613Z [36m[submariner-operator]$ [cluster2] kubectl exec netshoot-789f6cf54f-4bc2r -- curl --output /dev/null -m 30 --silent --head --fail 100.1.27.210[0m
2021-07-20T02:26:44.4211867Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-789f6cf54f-4bc2r -- curl --output /dev/null -m 30 --silent --head --fail 100.1.27.210[0m
2021-07-20T02:26:44.8222955Z Connection test was successful!
2021-07-20T02:26:44.8244555Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-20T02:26:44.8256515Z [36m[submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-20T02:26:44.8272446Z [36m[submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-20T02:26:44.8285558Z [36m[submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-20T02:26:44.8298727Z [36m[submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-20T02:26:44.8314707Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml[0m
2021-07-20T02:26:45.1345046Z deployment.apps "netshoot" deleted
2021-07-20T02:26:45.1402983Z [36m[submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-20T02:26:45.1417850Z [36m[submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-20T02:26:45.1432688Z [36m[submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-20T02:26:45.1446955Z [36m[submariner-operator]$ [cluster1] remove_resource[0m
2021-07-20T02:26:45.1459807Z [36m[submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-20T02:26:45.1473675Z [36m[submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-20T02:26:45.1488335Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml[0m
2021-07-20T02:26:45.4338909Z deployment.apps "nginx-demo" deleted
2021-07-20T02:26:45.4859306Z service "nginx-demo" deleted
2021-07-20T02:26:45.5260976Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-20T02:26:45.5474332Z [36m[submariner-operator]$ [cluster2] run_if_defined post_deploy[0m
2021-07-20T02:26:45.5514069Z [36m[submariner-operator]$ [cluster2] run_if_defined post_deploy[0m
2021-07-20T02:26:45.5564552Z [36m[submariner-operator]$ [cluster2] type -t post_deploy[0m
2021-07-20T02:26:45.5585522Z [36m[submariner-operator]$ [cluster2] grep -q function[0m
2021-07-20T02:26:45.5616456Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-20T02:26:45.5642680Z   Successfully remade target file 'deploy'.
2021-07-20T02:26:45.5643408Z Must remake target 'e2e'.
2021-07-20T02:26:45.5644196Z scripts/kind-e2e/e2e.sh
2021-07-20T02:26:45.5874098Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/utils[0m
2021-07-20T02:26:45.5937159Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:26:45.5949626Z [36m[submariner-operator]$ script_name=utils[0m
2021-07-20T02:26:45.5961231Z [36m[submariner-operator]$ exec_name=e2e.sh[0m
2021-07-20T02:26:45.5996666Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs[0m
2021-07-20T02:26:45.6056813Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:26:45.6080499Z [36m[submariner-operator]$ script_name=deploy_funcs[0m
2021-07-20T02:26:45.6136591Z [36m[submariner-operator]$ exec_name=e2e.sh[0m
2021-07-20T02:26:45.6204519Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_operator[0m
2021-07-20T02:26:45.6225227Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:26:45.6236370Z [36m[submariner-operator]$ script_name=deploy_operator[0m
2021-07-20T02:26:45.6248262Z [36m[submariner-operator]$ exec_name=e2e.sh[0m
2021-07-20T02:26:45.6316482Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings[0m
2021-07-20T02:26:45.6356542Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:26:45.6367487Z [36m[submariner-operator]$ script_name=cluster_settings[0m
2021-07-20T02:26:45.6380652Z [36m[submariner-operator]$ exec_name=e2e.sh[0m
2021-07-20T02:26:45.6412845Z [36m[submariner-operator]$ broker=cluster1[0m
2021-07-20T02:26:45.6430328Z [36m[submariner-operator]$ declare -gA cluster_nodes[0m
2021-07-20T02:26:45.6444950Z [36m[submariner-operator]$ cluster_nodes[cluster1]=control-plane worker[0m
2021-07-20T02:26:45.6554343Z [36m[submariner-operator]$ cluster_nodes[cluster2]=control-plane worker[0m
2021-07-20T02:26:45.6564830Z [36m[submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker[0m
2021-07-20T02:26:45.6604183Z [36m[submariner-operator]$ declare -gA cluster_subm[0m
2021-07-20T02:26:45.6657327Z [36m[submariner-operator]$ cluster_subm[cluster1]=true[0m
2021-07-20T02:26:45.6668337Z [36m[submariner-operator]$ cluster_subm[cluster2]=true[0m
2021-07-20T02:26:45.6679430Z [36m[submariner-operator]$ cluster_subm[cluster3]=true[0m
2021-07-20T02:26:45.6705379Z [36m[submariner-operator]$ declare -gA cluster_cni[0m
2021-07-20T02:26:45.6727941Z [36m[submariner-operator]$ cluster_cni[cluster2]=weave[0m
2021-07-20T02:26:45.6740093Z [36m[submariner-operator]$ cluster_cni[cluster3]=weave[0m
2021-07-20T02:26:45.6766874Z [36m[submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings[0m
2021-07-20T02:26:45.6841311Z [36m[submariner-operator]$ . /opt/shipyard/scripts/lib/source_only[0m
2021-07-20T02:26:45.6852588Z [36m[submariner-operator]$ script_name=cluster_settings[0m
2021-07-20T02:26:45.6873586Z [36m[submariner-operator]$ exec_name=e2e.sh[0m
2021-07-20T02:26:45.6912839Z [36m[submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker[0m
2021-07-20T02:26:45.6926322Z [36m[submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker[0m
2021-07-20T02:26:45.6968187Z [36m[submariner-operator]$ lighthouse=true[0m
2021-07-20T02:26:45.6977359Z [36m[submariner-operator]$ timeout=2m[0m
2021-07-20T02:26:45.6994072Z [36m[submariner-operator]$ declare_kubeconfig[0m
2021-07-20T02:26:45.7004124Z [36m[submariner-operator]$ declare_kubeconfig[0m
2021-07-20T02:26:45.7022977Z [36m[submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg[0m
2021-07-20T02:26:45.7056199Z [36m[submariner-operator]$ export KUBECONFIG[0m
2021-07-20T02:26:45.7070688Z [36m[submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)[0m
2021-07-20T02:26:45.7092917Z [36m[submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:[0m
2021-07-20T02:26:45.7148715Z [36m[submariner-operator]$ . /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/lib_operator_verify_subm.sh[0m
2021-07-20T02:26:45.7187805Z [36m[submariner-operator]$ create_subm_vars[0m
2021-07-20T02:26:45.7205134Z [36m[submariner-operator]$ create_subm_vars[0m
2021-07-20T02:26:45.7216786Z [36m[submariner-operator]$ deployment_name=submariner[0m
2021-07-20T02:26:45.7239078Z [36m[submariner-operator]$ operator_deployment_name=submariner-operator[0m
2021-07-20T02:26:45.7252256Z [36m[submariner-operator]$ gateway_deployment_name=submariner-gateway[0m
2021-07-20T02:26:45.7259705Z [36m[submariner-operator]$ routeagent_deployment_name=submariner-routeagent[0m
2021-07-20T02:26:45.7274195Z [36m[submariner-operator]$ broker_deployment_name=submariner-k8s-broker[0m
2021-07-20T02:26:45.7287802Z [36m[submariner-operator]$ globalnet_deployment_name=submariner-globalnet[0m
2021-07-20T02:26:45.7321475Z [36m[submariner-operator]$ declare_cidrs[0m
2021-07-20T02:26:45.7337159Z [36m[submariner-operator]$ declare_cidrs[0m
2021-07-20T02:26:45.7369135Z [36m[submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs[0m
2021-07-20T02:26:45.7379383Z [36m[submariner-operator]$ i=1[0m
2021-07-20T02:26:45.7391327Z [36m[submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1[0m
2021-07-20T02:26:45.7402092Z [36m[submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1[0m
2021-07-20T02:26:45.7435514Z [36m[submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16[0m
2021-07-20T02:26:45.7504545Z [36m[submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16[0m
2021-07-20T02:26:45.7529104Z [36m[submariner-operator]$ [cluster1] i=$(("$i"+1))[0m
2021-07-20T02:26:45.7543893Z [36m[submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2[0m
2021-07-20T02:26:45.7571038Z [36m[submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2[0m
2021-07-20T02:26:45.7591085Z [36m[submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16[0m
2021-07-20T02:26:45.7601658Z [36m[submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16[0m
2021-07-20T02:26:45.7615415Z [36m[submariner-operator]$ [cluster2] i=$(("$i"+1))[0m
2021-07-20T02:26:45.7640407Z [36m[submariner-operator]$ [cluster2] natEnabled=false[0m
2021-07-20T02:26:45.7664085Z [36m[submariner-operator]$ [cluster2] subm_gateway_image_repo=localhost:5000[0m
2021-07-20T02:26:45.7676737Z [36m[submariner-operator]$ [cluster2] subm_gateway_image_tag=local[0m
2021-07-20T02:26:45.7690762Z [36m[submariner-operator]$ [cluster2] subm_gateway_size=3[0m
2021-07-20T02:26:45.7706316Z [36m[submariner-operator]$ [cluster2] subm_colorcodes=blue[0m
2021-07-20T02:26:45.7717980Z [36m[submariner-operator]$ [cluster2] subm_debug=false[0m
2021-07-20T02:26:45.7729852Z [36m[submariner-operator]$ [cluster2] subm_broker=k8s[0m
2021-07-20T02:26:45.7741522Z [36m[submariner-operator]$ [cluster2] ce_ipsec_debug=false[0m
2021-07-20T02:26:45.7756208Z [36m[submariner-operator]$ [cluster2] ce_ipsec_ikeport=500[0m
2021-07-20T02:26:45.7768417Z [36m[submariner-operator]$ [cluster2] ce_ipsec_nattport=4500[0m
2021-07-20T02:26:45.7777982Z [36m[submariner-operator]$ [cluster2] subm_ns=submariner-operator[0m
2021-07-20T02:26:45.7789033Z [36m[submariner-operator]$ [cluster2] SUBMARINER_BROKER_NS=submariner-k8s-broker[0m
2021-07-20T02:26:45.7809261Z [36m[submariner-operator]$ [cluster2] with_context cluster1 broker_vars[0m
2021-07-20T02:26:45.7837956Z [36m[submariner-operator]$ [cluster2] with_context cluster1 broker_vars[0m
2021-07-20T02:26:45.7884379Z [36m[submariner-operator]$ [cluster1] broker_vars[0m
2021-07-20T02:26:45.7898459Z [36m[submariner-operator]$ [cluster1] broker_vars[0m
2021-07-20T02:26:45.7931263Z [36m[submariner-operator]$ [cluster1] SUBMARINER_BROKER_URL=$(kubectl -n default get endpoints kubernetes -o jsonpath="{.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}")[0m
2021-07-20T02:26:45.7949511Z [36m[submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}[0m
2021-07-20T02:26:45.7986146Z [36m[submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}[0m
2021-07-20T02:26:45.8001525Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}[0m
2021-07-20T02:26:46.1834254Z [36m[submariner-operator]$ [cluster1] SUBMARINER_BROKER_CA=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data['ca\.crt']}")[0m
2021-07-20T02:26:46.1859382Z [36m[submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}[0m
2021-07-20T02:26:46.1874710Z [36m[submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}[0m
2021-07-20T02:26:46.1887405Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}[0m
2021-07-20T02:26:46.5116359Z [36m[submariner-operator]$ [cluster1] SUBMARINER_BROKER_TOKEN=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data.token}"|base64 --decode)[0m
2021-07-20T02:26:46.5139915Z [36m[submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}[0m
2021-07-20T02:26:46.5157943Z [36m[submariner-operator]$ [cluster1] base64 --decode[0m
2021-07-20T02:26:46.5164621Z [36m[submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}[0m
2021-07-20T02:26:46.5178868Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}[0m
2021-07-20T02:26:46.8805796Z [36m[submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets[0m
2021-07-20T02:26:46.8817711Z [36m[submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets[0m
2021-07-20T02:26:46.8834019Z [36m[submariner-operator]$ [cluster1] verify_subm_broker_secrets[0m
2021-07-20T02:26:46.8847626Z [36m[submariner-operator]$ [cluster1] verify_subm_broker_secrets[0m
2021-07-20T02:26:46.9412656Z [36m[submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-20T02:26:47.0382983Z [36m[submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-20T02:26:47.0893225Z [36m[submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker[0m
2021-07-20T02:26:47.0894390Z [36m[submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker[0m
2021-07-20T02:26:47.0896337Z [36m[submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker[0m
2021-07-20T02:26:47.0897372Z [36m[submariner-operator]$ [cluster1] grep -q submariner-[0m
2021-07-20T02:26:47.0899067Z [36m[submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker[0m
2021-07-20T02:26:47.0900360Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret -n submariner-k8s-broker[0m
2021-07-20T02:26:47.2147339Z [36m[submariner-operator]$ [cluster1] return[0m
2021-07-20T02:26:47.2158655Z [36m[submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker[0m
2021-07-20T02:26:47.2171713Z [36m[submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker[0m
2021-07-20T02:26:47.2188050Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker[0m
2021-07-20T02:26:47.4867496Z NAME                                       TYPE                                  DATA   AGE
2021-07-20T02:26:47.4869294Z cluster-cluster1-token-k7w2t               kubernetes.io/service-account-token   3      66s
2021-07-20T02:26:47.4870924Z cluster-cluster2-token-6lgjh               kubernetes.io/service-account-token   3      61s
2021-07-20T02:26:47.4872481Z default-token-97drz                        kubernetes.io/service-account-token   3      84s
2021-07-20T02:26:47.4874048Z submariner-k8s-broker-admin-token-j5xvc    kubernetes.io/service-account-token   3      84s
2021-07-20T02:26:47.4875916Z submariner-k8s-broker-client-token-gqdsg   kubernetes.io/service-account-token   3      84s
2021-07-20T02:26:47.5020725Z [36m[submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}[0m
2021-07-20T02:26:47.5032835Z [36m[submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}[0m
2021-07-20T02:26:47.5045783Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}[0m
2021-07-20T02:26:47.8176432Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/submariner-k8s-broker-client-token-gqdsg.cluster1.json[0m
2021-07-20T02:26:47.8192005Z [36m[submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-gqdsg -n submariner-k8s-broker -o json[0m
2021-07-20T02:26:47.8208336Z [36m[submariner-operator]$ [cluster1] tee /tmp/submariner-k8s-broker-client-token-gqdsg.cluster1.json[0m
2021-07-20T02:26:47.8227153Z [36m[submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-gqdsg -n submariner-k8s-broker -o json[0m
2021-07-20T02:26:47.8240438Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret submariner-k8s-broker-client-token-gqdsg -n submariner-k8s-broker -o json[0m
2021-07-20T02:26:48.1073045Z {
2021-07-20T02:26:48.1073646Z     "apiVersion": "v1",
2021-07-20T02:26:48.1074081Z     "data": {
2021-07-20T02:26:48.1620581Z         "ca.crt": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=",
2021-07-20T02:26:48.2153833Z         "namespace": "c3VibWFyaW5lci1rOHMtYnJva2Vy",
2021-07-20T02:26:48.2659850Z         "token": "ZXlKaGJHY2lPaUpTVXpJMU5pSXNJbXRwWkNJNklsSnVRa0UxWmpkd05pMUdkREk1TmpKSllYQnZOa00wU0VKRWVYQlZiamxTWkhacmRUQm9SR05TUmtVaWZRLmV5SnBjM01pT2lKcmRXSmxjbTVsZEdWekwzTmxjblpwWTJWaFkyTnZkVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXVZVzFsYzNCaFkyVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJaUxDSnJkV0psY201bGRHVnpMbWx2TDNObGNuWnBZMlZoWTJOdmRXNTBMM05sWTNKbGRDNXVZVzFsSWpvaWMzVmliV0Z5YVc1bGNpMXJPSE10WW5KdmEyVnlMV05zYVdWdWRDMTBiMnRsYmkxbmNXUnpaeUlzSW10MVltVnlibVYwWlhNdWFXOHZjMlZ5ZG1salpXRmpZMjkxYm5RdmMyVnlkbWxqWlMxaFkyTnZkVzUwTG01aGJXVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXpaWEoyYVdObExXRmpZMjkxYm5RdWRXbGtJam9pWVdJd1lXVmxOREl0WXpKbFpTMDBNalUzTFdJek5tWXRPREZtT1RJeE4yTm1OR0ZsSWl3aWMzVmlJam9pYzNsemRHVnRPbk5sY25acFkyVmhZMk52ZFc1ME9uTjFZbTFoY21sdVpYSXRhemh6TFdKeWIydGxjanB6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSW4wLkQyWmpSUTZ0all4ZTNDSkdPSnNKT09fSk5RSzVUTUlsZmllWkVYU052VGxOUHJ5dEtyeHlNZWhTY3BHWENjbDh1QkVJLUw2OWZxYm5zMkExWkxHdUMtajc2dExXUmp4czFrTEN2aFpiZ0ZwUFptYnM0djVqVTB4OFdQOGVvTHNzaEhoUks1bGdPZzVZME5EMEFldUZCb1M3am8tOXZnelllUDEydUdVanQ2Q05BeUdpNHd0WF9fUG1COGxFWVVwX3VJMnBkalgzRUJCUGxmY0hhMHo5c0lSajAwcE90SGVPRGRzaXQ4TmhtLW8zZk9yWkRRVFItRncydDExX0VrTjhXU0tOTlpkbmdMZm45cHNRRUEwMGdGb3hUTkJxTGplUFVDelh0UEpDWWY2RXRkWDYyZkh4RkVYV293X0I3RXRaX3hHT3VVMzBQMHJSTVV4OVFsZUY2dw=="
2021-07-20T02:26:48.3286938Z     },
2021-07-20T02:26:48.3288409Z [36m[submariner-operator]$ [cluster1] validate_equals .kind Secret[0m
2021-07-20T02:26:48.3289920Z [36m[submariner-operator]$ [cluster1] validate_equals .kind Secret[0m
2021-07-20T02:26:48.3291778Z [36m[submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner-k8s-broker-client-token-gqdsg.cluster1.json[0m
2021-07-20T02:26:48.3293799Z [36m[submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token[0m
2021-07-20T02:26:48.3295327Z [36m[submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token[0m
2021-07-20T02:26:48.3297342Z [36m[submariner-operator]$ [cluster1] jq -r -M .type /tmp/submariner-k8s-broker-client-token-gqdsg.cluster1.json[0m
2021-07-20T02:26:48.3299320Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-gqdsg[0m
2021-07-20T02:26:48.3301115Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-gqdsg[0m
2021-07-20T02:26:48.3303290Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner-k8s-broker-client-token-gqdsg.cluster1.json[0m
2021-07-20T02:26:48.3305151Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker[0m
2021-07-20T02:26:48.3306520Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker[0m
2021-07-20T02:26:48.3308393Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner-k8s-broker-client-token-gqdsg.cluster1.json[0m
2021-07-20T02:26:48.3311135Z [36m[submariner-operator]$ [cluster1] jq -r -M .data["ca.crt"] /tmp/submariner-k8s-broker-client-token-gqdsg.cluster1.json[0m
2021-07-20T02:26:48.3312621Z     "kind": "Secret",
2021-07-20T02:26:48.3313413Z     "metadata": {
2021-07-20T02:26:48.3314224Z         "annotations": {
2021-07-20T02:26:48.3315567Z             "kubernetes.io/service-account.name": "submariner-k8s-broker-client",
2021-07-20T02:26:48.3317127Z             "kubernetes.io/service-account.uid": "ab0aee42-c2ee-4257-b36f-81f9217cf4ae"
2021-07-20T02:26:48.3317982Z         },
2021-07-20T02:26:48.3318667Z         "creationTimestamp": "2021-07-20T02:25:23Z",
2021-07-20T02:26:48.3319841Z         "name": "submariner-k8s-broker-client-token-gqdsg",
2021-07-20T02:26:48.3321072Z         "namespace": "submariner-k8s-broker",
2021-07-20T02:26:48.3321741Z         "resourceVersion": "1598",
2021-07-20T02:26:48.3323240Z         "selfLink": "/api/v1/namespaces/submariner-k8s-broker/secrets/submariner-k8s-broker-client-token-gqdsg",
2021-07-20T02:26:48.3324744Z         "uid": "74a6545e-337c-4b3c-9308-98b990bfe28d"
2021-07-20T02:26:48.3325274Z     },
2021-07-20T02:26:48.3326035Z     "type": "kubernetes.io/service-account-token"
2021-07-20T02:26:48.3326746Z }
2021-07-20T02:26:48.3327509Z [36m[submariner-operator]$ [cluster1] one_ca_crt_ok=true[0m
2021-07-20T02:26:48.3339053Z [36m[submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed[0m
2021-07-20T02:26:48.3349930Z [36m[submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed[0m
2021-07-20T02:26:48.3360905Z [36m[submariner-operator]$ [cluster2] declare -a subm_clusters[0m
2021-07-20T02:26:48.3395367Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 verify_subm_deployed[0m
2021-07-20T02:26:48.3408126Z [36m[submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 verify_subm_deployed[0m
2021-07-20T02:26:48.3423513Z [36m[submariner-operator]$ [cluster2] declare -A pids[0m
2021-07-20T02:26:48.3443481Z [36m[submariner-operator]$ [cluster2] eval echo cluster1 cluster2[0m
2021-07-20T02:26:48.3468070Z [36m[submariner-operator]$ [cluster1] set -o pipefail[0m
2021-07-20T02:26:48.3476326Z [36m[submariner-operator]$ [cluster1] pids[cluster1]=7885[0m
2021-07-20T02:26:48.3492520Z [36m[submariner-operator]$ [cluster1] verify_subm_deployed[0m
2021-07-20T02:26:48.3497743Z [36m[submariner-operator]$ [cluster2] pids[cluster2]=7889[0m
2021-07-20T02:26:48.3513883Z [36m[submariner-operator]$ [cluster2] wait 7889[0m
2021-07-20T02:26:48.3516957Z [36m[submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /[0m
2021-07-20T02:26:48.3530491Z [36m[submariner-operator]$ [cluster2] set -o pipefail[0m
2021-07-20T02:26:48.3552020Z [36m[submariner-operator]$ [cluster2] verify_subm_deployed[0m
2021-07-20T02:26:48.3574351Z [36m[submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /[0m
2021-07-20T02:26:49.1480760Z [36m[submariner-operator]$ [cluster2] verify_subm_deployed[0m
2021-07-20T02:26:49.1481856Z [36m[submariner-operator]$ [cluster2] verify_endpoints_crd[0m
2021-07-20T02:26:49.1482903Z [36m[submariner-operator]$ [cluster2] verify_endpoints_crd[0m
2021-07-20T02:26:49.1484122Z [36m[submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint[0m
2021-07-20T02:26:49.1485547Z [36m[submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint[0m
2021-07-20T02:26:49.1486920Z [36m[submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io[0m
2021-07-20T02:26:49.1488277Z [36m[submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io[0m
2021-07-20T02:26:49.1489749Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds endpoints.submariner.io[0m
2021-07-20T02:26:49.1490719Z [cluster2] NAME                      CREATED AT
2021-07-20T02:26:49.1491571Z [cluster2] endpoints.submariner.io   2021-07-20T02:25:48Z
2021-07-20T02:26:49.1492949Z [36m[submariner-operator]$ [cluster2] json_file=/tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-20T02:26:49.1494718Z [36m[submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json[0m
2021-07-20T02:26:49.1496258Z [36m[submariner-operator]$ [cluster2] tee /tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-20T02:26:49.1497873Z [36m[submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json[0m
2021-07-20T02:26:49.1499622Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd endpoints.submariner.io -o json[0m
2021-07-20T02:26:49.1500588Z [cluster2] {
2021-07-20T02:26:49.1501242Z [cluster2]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-20T02:26:49.1502129Z [cluster2]     "kind": "CustomResourceDefinition",
2021-07-20T02:26:49.1503095Z [cluster2]     "metadata": {
2021-07-20T02:26:49.1503617Z [cluster2]         "annotations": {
2021-07-20T02:26:49.1504671Z [cluster2]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-20T02:26:49.1505434Z [cluster2]         },
2021-07-20T02:26:49.1506337Z [cluster2]         "creationTimestamp": "2021-07-20T02:25:48Z",
2021-07-20T02:26:49.1506997Z [cluster2]         "generation": 1,
2021-07-20T02:26:49.1507697Z [cluster2]         "name": "endpoints.submariner.io",
2021-07-20T02:26:49.1508466Z [cluster2]         "resourceVersion": "1716",
2021-07-20T02:26:49.1509650Z [cluster2]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/endpoints.submariner.io",
2021-07-20T02:26:49.1511180Z [cluster2]         "uid": "49a7adb2-d997-4779-a4eb-2accffddd9f1"
2021-07-20T02:26:49.1511843Z [cluster2]     },
2021-07-20T02:26:49.1512290Z [cluster2]     "spec": {
2021-07-20T02:26:49.1512898Z [cluster2]         "conversion": {
2021-07-20T02:26:49.1513411Z [cluster2]             "strategy": "None"
2021-07-20T02:26:49.1513854Z [cluster2]         },
2021-07-20T02:26:49.1514354Z [cluster2]         "group": "submariner.io",
2021-07-20T02:26:49.1514866Z [cluster2]         "names": {
2021-07-20T02:26:49.1515332Z [cluster2]             "kind": "Endpoint",
2021-07-20T02:26:49.1515908Z [cluster2]             "listKind": "EndpointList",
2021-07-20T02:26:49.1516489Z [cluster2]             "plural": "endpoints",
2021-07-20T02:26:49.1517055Z [cluster2]             "singular": "endpoint"
2021-07-20T02:26:49.1517515Z [cluster2]         },
2021-07-20T02:26:49.1517993Z [cluster2]         "scope": "Namespaced",
2021-07-20T02:26:49.1518498Z [cluster2]         "versions": [
2021-07-20T02:26:49.1519033Z [cluster2]             {
2021-07-20T02:26:49.1519534Z [cluster2]                 "name": "v1",
2021-07-20T02:26:49.1519949Z [cluster2]                 "schema": {
2021-07-20T02:26:49.1520434Z [cluster2]                     "openAPIV3Schema": {
2021-07-20T02:26:49.1520934Z [cluster2]                         "properties": {
2021-07-20T02:26:49.1521416Z [cluster2]                             "apiVersion": {
2021-07-20T02:26:49.1523395Z [cluster2]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-20T02:26:49.1525169Z [cluster2]                                 "type": "string"
2021-07-20T02:26:49.1525660Z [cluster2]                             },
2021-07-20T02:26:49.1526315Z [cluster2]                             "kind": {
2021-07-20T02:26:49.1528661Z [cluster2]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-20T02:26:49.1530573Z [cluster2]                                 "type": "string"
2021-07-20T02:26:49.1531076Z [cluster2]                             },
2021-07-20T02:26:49.1531589Z [cluster2]                             "metadata": {
2021-07-20T02:26:49.1532272Z [cluster2]                                 "type": "object"
2021-07-20T02:26:49.1532785Z [cluster2]                             },
2021-07-20T02:26:49.1533256Z [cluster2]                             "spec": {
2021-07-20T02:26:49.1533811Z [cluster2]                                 "properties": {
2021-07-20T02:26:49.1534384Z [cluster2]                                     "backend": {
2021-07-20T02:26:49.1534938Z [cluster2]                                         "type": "string"
2021-07-20T02:26:49.1535474Z [cluster2]                                     },
2021-07-20T02:26:49.1623262Z [cluster2]                                     "backend_config": {
2021-07-20T02:26:49.1623963Z [cluster2]                                         "additionalProperties": {
2021-07-20T02:26:49.1624643Z [cluster2]                                             "type": "string"
2021-07-20T02:26:49.1625141Z [cluster2]                                         },
2021-07-20T02:26:49.1625663Z [cluster2]                                         "type": "object"
2021-07-20T02:26:49.1626145Z [cluster2]                                     },
2021-07-20T02:26:49.1626630Z [cluster2]                                     "cable_name": {
2021-07-20T02:26:49.1627473Z [cluster2]                                         "type": "string"
2021-07-20T02:26:49.1628007Z [cluster2]                                     },
2021-07-20T02:26:49.1628537Z [cluster2]                                     "cluster_id": {
2021-07-20T02:26:49.1629106Z [cluster2]                                         "type": "string"
2021-07-20T02:26:49.1629637Z [cluster2]                                     },
2021-07-20T02:26:49.1630198Z [cluster2]                                     "healthCheckIP": {
2021-07-20T02:26:49.1630824Z [cluster2]                                         "type": "string"
2021-07-20T02:26:49.1631342Z [cluster2]                                     },
2021-07-20T02:26:49.1631868Z [cluster2]                                     "hostname": {
2021-07-20T02:26:49.1632436Z [cluster2]                                         "type": "string"
2021-07-20T02:26:49.1632965Z [cluster2]                                     },
2021-07-20T02:26:49.1633489Z [cluster2]                                     "nat_enabled": {
2021-07-20T02:26:49.1634068Z [cluster2]                                         "type": "boolean"
2021-07-20T02:26:49.1634607Z [cluster2]                                     },
2021-07-20T02:26:49.1635307Z [cluster2]                                     "private_ip": {
2021-07-20T02:26:49.1635899Z [cluster2]                                         "type": "string"
2021-07-20T02:26:49.1636413Z [cluster2]                                     },
2021-07-20T02:26:49.1636934Z [cluster2]                                     "public_ip": {
2021-07-20T02:26:49.1637509Z [cluster2]                                         "type": "string"
2021-07-20T02:26:49.1638029Z [cluster2]                                     },
2021-07-20T02:26:49.1638556Z [cluster2]                                     "subnets": {
2021-07-20T02:26:49.1639084Z [cluster2]                                         "items": {
2021-07-20T02:26:49.1639649Z [cluster2]                                             "type": "string"
2021-07-20T02:26:49.1640179Z [cluster2]                                         },
2021-07-20T02:26:49.1640712Z [cluster2]                                         "type": "array"
2021-07-20T02:26:49.1641227Z [cluster2]                                     }
2021-07-20T02:26:49.1641703Z [cluster2]                                 },
2021-07-20T02:26:49.1642222Z [cluster2]                                 "required": [
2021-07-20T02:26:49.1642762Z [cluster2]                                     "backend",
2021-07-20T02:26:49.1643316Z [cluster2]                                     "cable_name",
2021-07-20T02:26:49.1643858Z [cluster2]                                     "cluster_id",
2021-07-20T02:26:49.1644422Z [cluster2]                                     "hostname",
2021-07-20T02:26:49.1645063Z [cluster2]                                     "nat_enabled",
2021-07-20T02:26:49.1645634Z [cluster2]                                     "private_ip",
2021-07-20T02:26:49.1646280Z [cluster2]                                     "public_ip",
2021-07-20T02:26:49.1646796Z [cluster2]                                     "subnets"
2021-07-20T02:26:49.1647265Z [cluster2]                                 ],
2021-07-20T02:26:49.1647741Z [cluster2]                                 "type": "object"
2021-07-20T02:26:49.1648215Z [cluster2]                             }
2021-07-20T02:26:49.1648628Z [cluster2]                         },
2021-07-20T02:26:49.1649099Z [cluster2]                         "required": [
2021-07-20T02:26:49.1649571Z [cluster2]                             "spec"
2021-07-20T02:26:49.1650204Z [cluster2]                         ],
2021-07-20T02:26:49.1650706Z [cluster2]                         "type": "object"
2021-07-20T02:26:49.1651206Z [cluster2]                     }
2021-07-20T02:26:49.1651637Z [cluster2]                 },
2021-07-20T02:26:49.1652134Z [cluster2]                 "served": true,
2021-07-20T02:26:49.1652679Z [cluster2]                 "storage": true
2021-07-20T02:26:49.1653146Z [cluster2]             }
2021-07-20T02:26:49.1653571Z [cluster2]         ]
2021-07-20T02:26:49.1653976Z [cluster2]     },
2021-07-20T02:26:49.1654422Z [cluster2]     "status": {
2021-07-20T02:26:49.1654955Z [cluster2]         "acceptedNames": {
2021-07-20T02:26:49.1655544Z [cluster2]             "kind": "Endpoint",
2021-07-20T02:26:49.1656150Z [cluster2]             "listKind": "EndpointList",
2021-07-20T02:26:49.1656789Z [cluster2]             "plural": "endpoints",
2021-07-20T02:26:49.1657384Z [cluster2]             "singular": "endpoint"
2021-07-20T02:26:49.1657901Z [cluster2]         },
2021-07-20T02:26:49.1658368Z [cluster2]         "conditions": [
2021-07-20T02:26:49.1658847Z [cluster2]             {
2021-07-20T02:26:49.1660062Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:25:48Z",
2021-07-20T02:26:49.1660791Z [cluster2]                 "message": "no conflicts found",
2021-07-20T02:26:49.1661446Z [cluster2]                 "reason": "NoConflicts",
2021-07-20T02:26:49.1662017Z [cluster2]                 "status": "True",
2021-07-20T02:26:49.1662845Z [cluster2]                 "type": "NamesAccepted"
2021-07-20T02:26:49.1663386Z [cluster2]             },
2021-07-20T02:26:49.1663820Z [cluster2]             {
2021-07-20T02:26:49.1664751Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:25:49Z",
2021-07-20T02:26:49.1665570Z [cluster2]                 "message": "the initial names have been accepted",
2021-07-20T02:26:49.1666401Z [cluster2]                 "reason": "InitialNamesAccepted",
2021-07-20T02:26:49.1667098Z [cluster2]                 "status": "True",
2021-07-20T02:26:49.2004870Z [cluster2]        [36m[submariner-operator]$ [cluster1] verify_subm_deployed[0m
2021-07-20T02:26:49.2005979Z [36m[submariner-operator]$ [cluster1] verify_endpoints_crd[0m
2021-07-20T02:26:49.2010816Z [36m[submariner-operator]$ [cluster1] verify_endpoints_crd[0m
2021-07-20T02:26:49.2012145Z [36m[submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint[0m
2021-07-20T02:26:49.2013687Z [36m[submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint[0m
2021-07-20T02:26:49.2015312Z [36m[submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io[0m
2021-07-20T02:26:49.2016863Z [36m[submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io[0m
2021-07-20T02:26:49.2018465Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds endpoints.submariner.io[0m
2021-07-20T02:26:49.2019486Z [cluster1] NAME                      CREATED AT
2021-07-20T02:26:49.2020393Z [cluster1] endpoints.submariner.io   2021-07-20T02:25:33Z
2021-07-20T02:26:49.2021890Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-20T02:26:49.2024149Z [36m[submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json[0m
2021-07-20T02:26:49.2025647Z [36m[submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json[0m
2021-07-20T02:26:49.2027303Z [36m[submariner-operator]$ [cluster1] tee /tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-20T02:26:49.2029127Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd endpoints.submariner.io -o json[0m
2021-07-20T02:26:49.2030110Z [cluster1] {
2021-07-20T02:26:49.2030752Z [cluster1]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-20T02:26:49.2031651Z [cluster1]     "kind": "CustomResourceDefinition",
2021-07-20T02:26:49.2032347Z [cluster1]     "metadata": {
2021-07-20T02:26:49.2032877Z [cluster1]         "annotations": {
2021-07-20T02:26:49.2033888Z [cluster1]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-20T02:26:49.2034660Z [cluster1]         },
2021-07-20T02:26:49.2035416Z [cluster1]         "creationTimestamp": "2021-07-20T02:25:33Z",
2021-07-20T02:26:49.2036070Z [cluster1]         "generation": 1,
2021-07-20T02:26:49.2036761Z [cluster1]         "name": "endpoints.submariner.io",
2021-07-20T02:26:49.2037520Z [cluster1]         "resourceVersion": "1725",
2021-07-20T02:26:49.2038717Z [cluster1]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/endpoints.submariner.io",
2021-07-20T02:26:49.2040184Z [cluster1]         "uid": "c503f60a-db4d-4072-8890-388dda4a427d"
2021-07-20T02:26:49.2040818Z [cluster1]     },
2021-07-20T02:26:49.2041247Z [cluster1]     "spec": {
2021-07-20T02:26:49.2041751Z [cluster1]         "conversion": {
2021-07-20T02:26:49.2042283Z [cluster1]             "strategy": "None"
2021-07-20T02:26:49.2042770Z [cluster1]         },
2021-07-20T02:26:49.2043289Z [cluster1]         "group": "submariner.io",
2021-07-20T02:26:49.2043847Z [cluster1]         "names": {
2021-07-20T02:26:49.2044348Z [cluster1]             "kind": "Endpoint",
2021-07-20T02:26:49.2044965Z [cluster1]             "listKind": "EndpointList",
2021-07-20T02:26:49.2045681Z [cluster1]             "plural": "endpoints",
2021-07-20T02:26:49.2046231Z [cluster1]             "singular": "endpoint"
2021-07-20T02:26:49.2046911Z [cluster1]         },
2021-07-20T02:26:49.2047411Z [cluster1]         "scope": "Namespaced",
2021-07-20T02:26:49.2047963Z [cluster1]         "versions": [
2021-07-20T02:26:49.2048419Z [cluster1]             {
2021-07-20T02:26:49.2048877Z [cluster1]                 "name": "v1",
2021-07-20T02:26:49.2049476Z [cluster1]                 "schema": {
2021-07-20T02:26:49.2050077Z [cluster1]                     "openAPIV3Schema": {
2021-07-20T02:26:49.2050699Z [cluster1]                         "properties": {
2021-07-20T02:26:49.2051294Z [cluster1]                             "apiVersion": {
2021-07-20T02:26:49.2053717Z [cluster1]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-20T02:26:49.2055512Z [cluster1]                                 "type": "string"
2021-07-20T02:26:49.2055998Z [cluster1]                             },
2021-07-20T02:26:49.2056556Z [cluster1]                             "kind": {
2021-07-20T02:26:49.2058736Z [cluster1]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-20T02:26:49.2060514Z [cluster1]                                 "type": "string"
2021-07-20T02:26:49.2061000Z [cluster1]                             },
2021-07-20T02:26:49.2061463Z [cluster1]                             "metadata": {
2021-07-20T02:26:49.2062076Z [cluster1]                                 "type": "object"
2021-07-20T02:26:49.2063001Z [cluster1]                             },
2021-07-20T02:26:49.2063462Z [cluster1]                             "spec": {
2021-07-20T02:26:49.2063971Z [cluster1]                                 "properties": {
2021-07-20T02:26:49.2064511Z [cluster1]                                     "backend": {
2021-07-20T02:26:49.2065035Z [cluster1]                                         "type": "string"
2021-07-20T02:26:49.2065539Z [cluster1]                                     },
2021-07-20T02:26:49.2066153Z [cluster1]                                     "backend_config": {
2021-07-20T02:26:49.2066824Z [cluster1]                                         "additionalProperties": {
2021-07-20T02:26:49.2067477Z [cluster1]                                             "type": "string"
2021-07-20T02:26:49.2067979Z [cluster1]                                         },
2021-07-20T02:26:49.2068661Z [cluster1]                                         "type": "object"
2021-07-20T02:26:49.2069278Z [cluster1]                                     },
2021-07-20T02:26:49.2069751Z [cluster1]                                     "cable_name": {
2021-07-20T02:26:49.2070284Z [cluster1]                                         "type": "string"
2021-07-20T02:26:49.2070769Z [cluster1]                                     },
2021-07-20T02:26:49.2071260Z [cluster1]                                     "cluster_id": {
2021-07-20T02:26:49.2071798Z [cluster1]                                         "type": "string"
2021-07-20T02:26:49.2072277Z [cluster1]                                     },
2021-07-20T02:26:49.2072808Z [cluster1]                                     "healthCheckIP": {
2021-07-20T02:26:49.2073364Z [cluster1]                                         "type": "string"
2021-07-20T02:26:49.2073852Z [cluster1]                                     },
2021-07-20T02:26:49.2074492Z [cluster1]                                     "hostname": {
2021-07-20T02:26:49.2075069Z [cluster1]                                         "type": "string"
2021-07-20T02:26:49.2075582Z [cluster1]                                     },
2021-07-20T02:26:49.2076104Z [cluster1]                                     "nat_enabled": {
2021-07-20T02:26:49.2076692Z [cluster1]                                         "type": "boolean"
2021-07-20T02:26:49.2077217Z [cluster1]                                     },
2021-07-20T02:26:49.2077826Z [cluster1]                                     "private_ip": {
2021-07-20T02:26:49.2078402Z [cluster1]                                         "type": "string"
2021-07-20T02:26:49.2078932Z [cluster1]                                     },
2021-07-20T02:26:49.2079440Z [cluster1]                                     "public_ip": {
2021-07-20T02:26:49.2080114Z [cluster1]                                         "type": "string"
2021-07-20T02:26:49.2080591Z [cluster1]                                     },
2021-07-20T02:26:49.2081080Z [cluster1]                                     "subnets": {
2021-07-20T02:26:49.2081586Z [cluster1]                                         "items": {
2021-07-20T02:26:49.2082094Z [cluster1]                                             "type": "string"
2021-07-20T02:26:49.2082600Z [cluster1]                                         },
2021-07-20T02:26:49.2083079Z [cluster1]                                         "type": "array"
2021-07-20T02:26:49.2083564Z [cluster1]                                     }
2021-07-20T02:26:49.2083993Z [cluster1]                                 },
2021-07-20T02:26:49.2084468Z [cluster1]                                 "required": [
2021-07-20T02:26:49.2084966Z [cluster1]                                     "backend",
2021-07-20T02:26:49.2085481Z [cluster1]                                     "cable_name",
2021-07-20T02:26:49.2120856Z [cluster1]                                     "cluster_id",
2021-07-20T02:26:49.2121403Z [cluster1]                                     "hostname",
2021-07-20T02:26:49.2122144Z [cluster1]                                     "nat_enabled",
2021-07-20T02:26:49.2122712Z [cluster1]                                     "private_ip",
2021-07-20T02:26:49.2123246Z [cluster1]                                     "public_ip",
2021-07-20T02:26:49.2123751Z [cluster1]                                     "subnets"
2021-07-20T02:26:49.2124227Z [cluster1]                                 ],
2021-07-20T02:26:49.2124712Z [cluster1]                                 "type": "object"
2021-07-20T02:26:49.2125199Z [cluster1]                             }
2021-07-20T02:26:49.2125624Z [cluster1]                         },
2021-07-20T02:26:49.2126082Z [cluster1]                         "required": [
2021-07-20T02:26:49.2126568Z [cluster1]                             "spec"
2021-07-20T02:26:49.2126992Z [cluster1]                         ],
2021-07-20T02:26:49.2127466Z [cluster1]                         "type": "object"
2021-07-20T02:26:49.2127917Z [cluster1]                     }
2021-07-20T02:26:49.2128335Z [cluster1]                 },
2021-07-20T02:26:49.2129111Z [cluster1]                 "served": true,
2021-07-20T02:26:49.2129621Z [cluster1]                 "storage": true
2021-07-20T02:26:49.2130058Z [cluster1]             }
2021-07-20T02:26:49.2130457Z [cluster1]         ]
2021-07-20T02:26:49.2130852Z [cluster1]     },
2021-07-20T02:26:49.2131253Z [cluster1]     "status": {
2021-07-20T02:26:49.2131761Z [cluster1]         "acceptedNames": {
2021-07-20T02:26:49.2132295Z [cluster1]             "kind": "Endpoint",
2021-07-20T02:26:49.2132874Z [cluster1]             "listKind": "EndpointList",
2021-07-20T02:26:49.2133456Z [cluster1]             "plural": "endpoints",
2021-07-20T02:26:49.2134195Z [cluster1]             "singular": "endpoint"
2021-07-20T02:26:49.2134695Z [cluster1]         },
2021-07-20T02:26:49.2135172Z [cluster1]         "conditions": [
2021-07-20T02:26:49.2135640Z [cluster1]             {
2021-07-20T02:26:49.2136717Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:33Z",
2021-07-20T02:26:49.2137466Z [cluster1]                 "message": "no conflicts found",
2021-07-20T02:26:49.2138104Z [cluster1]                 "reason": "NoConflicts",
2021-07-20T02:26:49.2138695Z [cluster1]                 "status": "True",
2021-07-20T02:26:49.2139291Z [cluster1]                 "type": "NamesAccepted"
2021-07-20T02:26:49.2139845Z [cluster1]             },
2021-07-20T02:26:49.2140262Z [cluster1]             {
2021-07-20T02:26:49.2141189Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:33Z",
2021-07-20T02:26:49.2141993Z [cluster1]                 "message": "the initial names have been accepted",
2021-07-20T02:26:49.2143411Z [cluster1]                 "reason": "InitialNamesAccepted",
2021-07-20T02:26:49.2144096Z [cluster1]                 "status": "True",
2021-07-20T02:26:50.2359993Z [cluster1]                 "type": "Established"
2021-07-20T02:26:50.2361176Z [cluster2]             }
2021-07-20T02:26:50.2361822Z [cluster2]         ],
2021-07-20T02:26:50.2362759Z [cluster2]         "storedVersions": [
2021-07-20T02:26:50.2363518Z [cluster2]             "v1"
2021-07-20T02:26:50.2364150Z [cluster2]         ]
2021-07-20T02:26:50.2364786Z [cluster2]     }
2021-07-20T02:26:50.2365394Z [cluster2] }
2021-07-20T02:26:50.2367242Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io[0m
2021-07-20T02:26:50.2369188Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io[0m
2021-07-20T02:26:50.2375947Z [36m[submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-20T02:26:50.2377732Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced[0m
2021-07-20T02:26:50.2378963Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced[0m
2021-07-20T02:26:50.2380503Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-20T02:26:50.2382290Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io[0m
2021-07-20T02:26:50.2383779Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io[0m
2021-07-20T02:26:50.2385426Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-20T02:26:50.2386988Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint[0m
2021-07-20T02:26:50.2388233Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint[0m
2021-07-20T02:26:50.2389959Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-20T02:26:50.2391675Z [36m[submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint[0m
2021-07-20T02:26:50.2392991Z [36m[submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint[0m
2021-07-20T02:26:50.2394621Z [36m[submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster2.json[0m
2021-07-20T02:26:50.2395983Z [36m[submariner-operator]$ [cluster2] verify_clusters_crd[0m
2021-07-20T02:26:50.2396846Z [36m[submariner-operator]$ [cluster2] verify_clusters_crd[0m
2021-07-20T02:26:50.2397875Z [36m[submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster[0m
2021-07-20T02:26:50.2399073Z [36m[submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster[0m
2021-07-20T02:26:50.2400229Z [36m[submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io[0m
2021-07-20T02:26:50.2401375Z [36m[submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io[0m
2021-07-20T02:26:50.2402636Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds clusters.submariner.io[0m
2021-07-20T02:26:50.2403444Z [cluster2] NAME                     CREATED AT
2021-07-20T02:26:50.2404159Z [cluster2] clusters.submariner.io   2021-07-20T02:25:48Z
2021-07-20T02:26:50.2405702Z [36m[submariner-operator]$ [cluster2] json_file=/tmp/clusters.submariner.io.cluster2.json[0m
2021-07-20T02:26:50.2407248Z [36m[submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json[0m
2021-07-20T02:26:50.2408747Z [36m[submariner-operator]$ [cluster2] tee /tmp/clusters.submariner.io.cluster2.json[0m
2021-07-20T02:26:50.2410297Z [36m[submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json[0m
2021-07-20T02:26:50.2411933Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd clusters.submariner.io -o json[0m
2021-07-20T02:26:50.2412816Z [cluster2] {
2021-07-20T02:26:50.2413424Z [cluster2]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-20T02:26:50.2414238Z [cluster2]     "kind": "CustomResourceDefinition",
2021-07-20T02:26:50.2414904Z [cluster2]     "metadata": {
2021-07-20T02:26:50.2415381Z [cluster2]         "annotations": {
2021-07-20T02:26:50.2416357Z [cluster2]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-20T02:26:50.2417066Z [cluster2]         },
2021-07-20T02:26:50.2417787Z [cluster2]         "creationTimestamp": "2021-07-20T02:25:48Z",
2021-07-20T02:26:50.2418391Z [cluster2]         "generation": 1,
2021-07-20T02:26:50.2419017Z [cluster2]         "name": "clusters.submariner.io",
2021-07-20T02:26:50.2419710Z [cluster2]         "resourceVersion": "1712",
2021-07-20T02:26:50.2421005Z [cluster2]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.submariner.io",
2021-07-20T02:26:50.2422548Z [cluster2]         "uid": "32639db8-9d23-4656-a741-73d882911da0"
2021-07-20T02:26:50.2452352Z [cluster2]     },
2021-07-20T02:26:50.2453155Z [cluster2]     "spec": {
2021-07-20T02:26:50.2453559Z [cluster2]         "conversion": {
2021-07-20T02:26:50.2454008Z [cluster2]             "strategy": "None"
2021-07-20T02:26:50.2454417Z [cluster2]         },
2021-07-20T02:26:50.2454840Z [cluster2]         "group": "submariner.io",
2021-07-20T02:26:50.2455500Z [cluster2]         "names": {
2021-07-20T02:26:50.2455902Z [cluster2]             "kind": "Cluster",
2021-07-20T02:26:50.2456393Z [cluster2]             "listKind": "ClusterList",
2021-07-20T02:26:50.2456885Z [cluster2]             "plural": "clusters",
2021-07-20T02:26:50.2457364Z [cluster2]             "singular": "cluster"
2021-07-20T02:26:50.2457763Z [cluster2]         },
2021-07-20T02:26:50.2458390Z [cluster2]         "scope": "Namespaced",
2021-07-20T02:26:50.2459081Z [cluster2]         "versions": [
2021-07-20T02:26:50.2459558Z [cluster2]             {
2021-07-20T02:26:50.2460005Z [cluster2]                 "name": "v1",
2021-07-20T02:26:50.2460505Z [cluster2]                 "schema": {
2021-07-20T02:26:50.2461093Z [cluster2]                     "openAPIV3Schema": {
2021-07-20T02:26:50.2461709Z [cluster2]                         "properties": {
2021-07-20T02:26:50.2462295Z [cluster2]                             "apiVersion": {
2021-07-20T02:26:50.2465133Z [cluster2]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-20T02:26:50.2467105Z [cluster2]                                 "type": "string"
2021-07-20T02:26:50.2467627Z [cluster2]                             },
2021-07-20T02:26:50.2468105Z [cluster2]                             "kind": {
2021-07-20T02:26:50.2470461Z [cluster2]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-20T02:26:50.2472361Z [cluster2]                                 "type": "string"
2021-07-20T02:26:50.2472838Z [cluster2]                             },
2021-07-20T02:26:50.2473307Z [cluster2]                             "metadata": {
2021-07-20T02:26:50.2473818Z [cluster2]                                 "type": "object"
2021-07-20T02:26:50.2474293Z [cluster2]                             },
2021-07-20T02:26:50.2474730Z [cluster2]                             "spec": {
2021-07-20T02:26:50.2475248Z [cluster2]                                 "properties": {
2021-07-20T02:26:50.2475900Z [cluster2]                                     "cluster_cidr": {
2021-07-20T02:26:50.2476462Z [cluster2]                                         "items": {
2021-07-20T02:26:50.2476924Z [cluster2]                                             "type": "string"
2021-07-20T02:26:50.2477349Z [cluster2]                                         },
2021-07-20T02:26:50.2477785Z [cluster2]                                         "type": "array"
2021-07-20T02:26:50.2478200Z [cluster2]                                     },
2021-07-20T02:26:50.2478636Z [cluster2]                                     "cluster_id": {
2021-07-20T02:26:50.2479109Z [cluster2]                                         "type": "string"
2021-07-20T02:26:50.2479532Z [cluster2]                                     },
2021-07-20T02:26:50.2479963Z [cluster2]                                     "color_codes": {
2021-07-20T02:26:50.2480599Z [cluster2]                                         "items": {
2021-07-20T02:26:50.2481124Z [cluster2]                                             "type": "string"
2021-07-20T02:26:50.2481609Z [cluster2]                                         },
2021-07-20T02:26:50.2482092Z [cluster2]                                         "type": "array"
2021-07-20T02:26:50.2482750Z [cluster2]                                     },
2021-07-20T02:26:50.2483267Z [cluster2]                                     "global_cidr": {
2021-07-20T02:26:50.2483812Z [cluster2]                                         "items": {
2021-07-20T02:26:50.2484431Z [cluster2]                                             "type": "string"
2021-07-20T02:26:50.2484967Z [cluster2]                                         },
2021-07-20T02:26:50.2485482Z [cluster2]                                         "type": "array"
2021-07-20T02:26:50.2486008Z [cluster2]                                     },
2021-07-20T02:26:50.2486529Z [cluster2]                                     "service_cidr": {
2021-07-20T02:26:50.2487088Z [cluster2]                                         "items": {
2021-07-20T02:26:50.2487637Z [cluster2]                                             "type": "string"
2021-07-20T02:26:50.2488180Z [cluster2]                                         },
2021-07-20T02:26:50.2488710Z [cluster2]                                         "type": "array"
2021-07-20T02:26:50.2489223Z [cluster2]                                     }
2021-07-20T02:26:50.2489699Z [cluster2]                                 },
2021-07-20T02:26:50.2490202Z [cluster2]                                 "required": [
2021-07-20T02:26:50.2490783Z [cluster2]                                     "cluster_cidr",
2021-07-20T02:26:50.2491336Z [cluster2]                                     "cluster_id",
2021-07-20T02:26:50.2491899Z [cluster2]                                     "color_codes",
2021-07-20T02:26:50.2492441Z [cluster2]                                     "global_cidr",
2021-07-20T02:26:50.2493010Z [cluster2]                                     "service_cidr"
2021-07-20T02:26:50.2493532Z [cluster2]                                 ],
2021-07-20T02:26:50.2494044Z [cluster2]                                 "type": "object"
2021-07-20T02:26:50.2494560Z [cluster2]                             }
2021-07-20T02:26:50.2495003Z [cluster2]                         },
2021-07-20T02:26:50.2495506Z [cluster2]                         "required": [
2021-07-20T02:26:50.2496010Z [cluster2]                             "spec"
2021-07-20T02:26:50.2496479Z [cluster2]                         ],
2021-07-20T02:26:50.2496979Z [cluster2]                         "type": "object"
2021-07-20T02:26:50.2497749Z [cluster2]                     }
2021-07-20T02:26:50.2498286Z [cluster2]                 },
2021-07-20T02:26:50.2498934Z [cluster2]                 "served": true,
2021-07-20T02:26:50.2499476Z [cluster2]                 "storage": true
2021-07-20T02:26:50.2499942Z [cluster2]             }
2021-07-20T02:26:50.2500367Z [cluster2]         ]
2021-07-20T02:26:50.2500771Z [cluster2]     },
2021-07-20T02:26:50.2501272Z [cluster2]     "status": {
2021-07-20T02:26:50.2501805Z [cluster2]         "acceptedNames": {
2021-07-20T02:26:50.3625369Z [cluster2]             "kin         "type": "Established"
2021-07-20T02:26:50.3626030Z [cluster1]             }
2021-07-20T02:26:50.3626442Z [cluster1]         ],
2021-07-20T02:26:50.3626922Z [cluster1]         "storedVersions": [
2021-07-20T02:26:50.3627533Z [cluster1]             "v1"
2021-07-20T02:26:50.3627938Z [cluster1]         ]
2021-07-20T02:26:50.3628453Z [cluster1]     }
2021-07-20T02:26:50.3629184Z [cluster1] }
2021-07-20T02:26:50.3630798Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io[0m
2021-07-20T02:26:50.3632771Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io[0m
2021-07-20T02:26:50.3634666Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-20T02:26:50.3636369Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced[0m
2021-07-20T02:26:50.3637689Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced[0m
2021-07-20T02:26:50.3639353Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-20T02:26:50.3641028Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io[0m
2021-07-20T02:26:50.3642359Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io[0m
2021-07-20T02:26:50.3644267Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-20T02:26:50.3645926Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint[0m
2021-07-20T02:26:50.3647282Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint[0m
2021-07-20T02:26:50.3649016Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-20T02:26:50.3650876Z [36m[submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint[0m
2021-07-20T02:26:50.3652493Z [36m[submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint[0m
2021-07-20T02:26:50.3654476Z [36m[submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster1.json[0m
2021-07-20T02:26:50.3656174Z [36m[submariner-operator]$ [cluster1] verify_clusters_crd[0m
2021-07-20T02:26:50.3657373Z [36m[submariner-operator]$ [cluster1] verify_clusters_crd[0m
2021-07-20T02:26:50.3658652Z [36m[submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster[0m
2021-07-20T02:26:50.3660127Z [36m[submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster[0m
2021-07-20T02:26:50.3661554Z [36m[submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io[0m
2021-07-20T02:26:50.3663348Z [36m[submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io[0m
2021-07-20T02:26:50.3665024Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds clusters.submariner.io[0m
2021-07-20T02:26:50.3666045Z [cluster1] NAME                     CREATED AT
2021-07-20T02:26:50.3666931Z [cluster1] clusters.submariner.io   2021-07-20T02:25:33Z
2021-07-20T02:26:50.3668471Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/clusters.submariner.io.cluster1.json[0m
2021-07-20T02:26:50.3670100Z [36m[submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json[0m
2021-07-20T02:26:50.3671612Z [36m[submariner-operator]$ [cluster1] tee /tmp/clusters.submariner.io.cluster1.json[0m
2021-07-20T02:26:50.3673131Z [36m[submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json[0m
2021-07-20T02:26:50.3674851Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd clusters.submariner.io -o json[0m
2021-07-20T02:26:50.3675808Z [cluster1] {
2021-07-20T02:26:50.3676602Z [cluster1]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-20T02:26:50.3677491Z [cluster1]     "kind": "CustomResourceDefinition",
2021-07-20T02:26:50.3678203Z [cluster1]     "metadata": {
2021-07-20T02:26:50.3678722Z [cluster1]         "annotations": {
2021-07-20T02:26:50.3679772Z [cluster1]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-20T02:26:50.3680614Z [cluster1]         },
2021-07-20T02:26:50.3681396Z [cluster1]         "creationTimestamp": "2021-07-20T02:25:33Z",
2021-07-20T02:26:50.3682032Z [cluster1]         "generation": 1,
2021-07-20T02:26:50.3682725Z [cluster1]         "name": "clusters.submariner.io",
2021-07-20T02:26:50.3683458Z [cluster1]         "resourceVersion": "1721",
2021-07-20T02:26:50.3684643Z [cluster1]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.submariner.io",
2021-07-20T02:26:50.3686119Z [cluster1]         "uid": "2340b0ab-5065-45d8-a82d-65cea4f00e09"
2021-07-20T02:26:50.3686678Z [cluster1]     },
2021-07-20T02:26:50.3687091Z [cluster1]     "spec": {
2021-07-20T02:26:50.3687548Z [cluster1]         "conversion": {
2021-07-20T02:26:50.3688057Z [cluster1]             "strategy": "None"
2021-07-20T02:26:50.3688491Z [cluster1]         },
2021-07-20T02:26:50.3688985Z [cluster1]         "group": "submariner.io",
2021-07-20T02:26:50.3689483Z [cluster1]         "names": {
2021-07-20T02:26:50.3689953Z [cluster1]             "kind": "Cluster",
2021-07-20T02:26:50.3690491Z [cluster1]             "listKind": "ClusterList",
2021-07-20T02:26:50.3691059Z [cluster1]             "plural": "clusters",
2021-07-20T02:26:50.3691806Z [cluster1]             "singular": "cluster"
2021-07-20T02:26:50.3692260Z [cluster1]         },
2021-07-20T02:26:50.3692738Z [cluster1]         "scope": "Namespaced",
2021-07-20T02:26:50.3693244Z [cluster1]         "versions": [
2021-07-20T02:26:50.3693683Z [cluster1]             {
2021-07-20T02:26:50.3694095Z [cluster1]                 "name": "v1",
2021-07-20T02:26:50.3694555Z [cluster1]                 "schema": {
2021-07-20T02:26:50.3695192Z [cluster1]                     "openAPIV3Schema": {
2021-07-20T02:26:50.3695768Z [cluster1]                         "properties": {
2021-07-20T02:26:50.3696318Z [cluster1]                             "apiVersion": {
2021-07-20T02:26:50.3698680Z [cluster1]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-20T02:26:50.3700485Z [cluster1]                                 "type": "string"
2021-07-20T02:26:50.3701167Z [cluster1]                             },
2021-07-20T02:26:50.3701636Z [cluster1]                             "kind": {
2021-07-20T02:26:50.3708822Z [cluster1]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-20T02:26:50.3710785Z [cluster1]                                 "type": "string"
2021-07-20T02:26:50.3711411Z [cluster1]                             },
2021-07-20T02:26:50.3711897Z [cluster1]                             "metadata": {
2021-07-20T02:26:50.3712410Z [cluster1]                                 "type": "object"
2021-07-20T02:26:50.3712901Z [cluster1]                             },
2021-07-20T02:26:50.3713356Z [cluster1]                             "spec": {
2021-07-20T02:26:50.3713863Z [cluster1]                                 "properties": {
2021-07-20T02:26:50.3714412Z [cluster1]                                     "cluster_cidr": {
2021-07-20T02:26:50.3714919Z [cluster1]                                         "items": {
2021-07-20T02:26:50.3715594Z [cluster1]                                             "type": "string"
2021-07-20T02:26:50.3716091Z [cluster1]                                         },
2021-07-20T02:26:50.3716589Z [cluster1]                                         "type": "array"
2021-07-20T02:26:50.3717157Z [cluster1]                                     },
2021-07-20T02:26:50.3717585Z [cluster1]                                     "cluster_id": {
2021-07-20T02:26:50.3718051Z [cluster1]                                         "type": "string"
2021-07-20T02:26:50.3718478Z [cluster1]                                     },
2021-07-20T02:26:50.3718912Z [cluster1]                                     "color_codes": {
2021-07-20T02:26:50.3719353Z [cluster1]                                         "items": {
2021-07-20T02:26:50.3720028Z [cluster1]                                             "type": "string"
2021-07-20T02:26:50.3720512Z [cluster1]                                         },
2021-07-20T02:26:50.3721004Z [cluster1]                                         "type": "array"
2021-07-20T02:26:50.3721492Z [cluster1]                                     },
2021-07-20T02:26:50.3721960Z [cluster1]                                     "global_cidr": {
2021-07-20T02:26:50.3725886Z [cluster1]                                         "items": {
2021-07-20T02:26:50.3726413Z [cluster1]                                             "type": "string"
2021-07-20T02:26:50.3726921Z [cluster1]                                         },
2021-07-20T02:26:50.3727403Z [cluster1]                                         "type": "array"
2021-07-20T02:26:50.3728045Z [cluster1]                                     },
2021-07-20T02:26:50.3728642Z [cluster1]                                     "service_cidr": {
2021-07-20T02:26:50.3729165Z [cluster1]                                         "items": {
2021-07-20T02:26:50.3729890Z [cluster1]                                             "type": "string"
2021-07-20T02:26:50.3730423Z [cluster1]                                         },
2021-07-20T02:26:50.3730962Z [cluster1]                                         "type": "array"
2021-07-20T02:26:50.3731484Z [cluster1]                                     }
2021-07-20T02:26:50.3762480Z [cluster1]                                 },
2021-07-20T02:26:50.3762929Z [cluster1]                                 "required": [
2021-07-20T02:26:50.3763403Z [cluster1]                                     "cluster_cidr",
2021-07-20T02:26:50.3763855Z [cluster1]                                     "cluster_id",
2021-07-20T02:26:50.3764318Z [cluster1]                                     "color_codes",
2021-07-20T02:26:50.3764789Z [cluster1]                                     "global_cidr",
2021-07-20T02:26:50.3765240Z [cluster1]                                     "service_cidr"
2021-07-20T02:26:50.3765668Z [cluster1]                                 ],
2021-07-20T02:26:50.3766086Z [cluster1]                                 "type": "object"
2021-07-20T02:26:50.3766504Z [cluster1]                             }
2021-07-20T02:26:50.3766869Z [cluster1]                         },
2021-07-20T02:26:50.3767278Z [cluster1]                         "required": [
2021-07-20T02:26:50.3767687Z [cluster1]                             "spec"
2021-07-20T02:26:50.3768071Z [cluster1]                         ],
2021-07-20T02:26:50.3768470Z [cluster1]                         "type": "object"
2021-07-20T02:26:50.3768949Z [cluster1]                     }
2021-07-20T02:26:50.3769312Z [cluster1]                 },
2021-07-20T02:26:50.3769702Z [cluster1]                 "served": true,
2021-07-20T02:26:50.3770151Z [cluster1]                 "storage": true
2021-07-20T02:26:50.3770532Z [cluster1]             }
2021-07-20T02:26:50.3770882Z [cluster1]         ]
2021-07-20T02:26:50.3771212Z [cluster1]     },
2021-07-20T02:26:50.3771577Z [cluster1]     "status": {
2021-07-20T02:26:50.3772011Z [cluster1]         "acceptedNames": {
2021-07-20T02:26:51.2545404Z [cluster1]             "kind": "Cluster",
2021-07-20T02:26:51.2546414Z [cluster2]             "listKind": "ClusterList",
2021-07-20T02:26:51.2547288Z [cluster2]             "plural": "clusters",
2021-07-20T02:26:51.2547968Z [cluster2]             "singular": "cluster"
2021-07-20T02:26:51.2548756Z [cluster2]         },
2021-07-20T02:26:51.2549399Z [cluster2]         "conditions": [
2021-07-20T02:26:51.2550050Z [cluster2]             {
2021-07-20T02:26:51.2551425Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:25:48Z",
2021-07-20T02:26:51.2552335Z [cluster2]                 "message": "no conflicts found",
2021-07-20T02:26:51.2553139Z [cluster2]                 "reason": "NoConflicts",
2021-07-20T02:26:51.2553880Z [cluster2]                 "status": "True",
2021-07-20T02:26:51.2554626Z [cluster2]                 "type": "NamesAccepted"
2021-07-20T02:26:51.2555332Z [cluster2]             },
2021-07-20T02:26:51.2555927Z [cluster2]             {
2021-07-20T02:26:51.2556888Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:25:48Z",
2021-07-20T02:26:51.2557855Z [cluster2]                 "message": "the initial names have been accepted",
2021-07-20T02:26:51.2558820Z [cluster2]                 "reason": "InitialNamesAccepted",
2021-07-20T02:26:51.2559660Z [cluster2]                 "status": "True",
2021-07-20T02:26:51.2560380Z [cluster2]                 "type": "Established"
2021-07-20T02:26:51.2561054Z [cluster2]             }
2021-07-20T02:26:51.2561640Z [cluster2]         ],
2021-07-20T02:26:51.2562469Z [cluster2]         "storedVersions": [
2021-07-20T02:26:51.2563308Z [cluster2]             "v1"
2021-07-20T02:26:51.2564240Z [cluster2]         ]
2021-07-20T02:26:51.2564854Z [cluster2]     }
2021-07-20T02:26:51.2565471Z [cluster2] }
2021-07-20T02:26:51.2566850Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io[0m
2021-07-20T02:26:51.2568712Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io[0m
2021-07-20T02:26:51.2573405Z [36m[submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster2.json[0m
2021-07-20T02:26:51.2575180Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced[0m
2021-07-20T02:26:51.2576413Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced[0m
2021-07-20T02:26:51.2577943Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster2.json[0m
2021-07-20T02:26:51.2579460Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io[0m
2021-07-20T02:26:51.2580745Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io[0m
2021-07-20T02:26:51.2582085Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster2.json[0m
2021-07-20T02:26:51.2583588Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster[0m
2021-07-20T02:26:51.2584665Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster[0m
2021-07-20T02:26:51.2586356Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster2.json[0m
2021-07-20T02:26:51.2588047Z [36m[submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster[0m
2021-07-20T02:26:51.2589530Z [36m[submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster[0m
2021-07-20T02:26:51.2591613Z [36m[submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster2.json[0m
2021-07-20T02:26:51.2593233Z [36m[submariner-operator]$ [cluster2] verify_subm_crd[0m
2021-07-20T02:26:51.2594261Z [36m[submariner-operator]$ [cluster2] verify_subm_crd[0m
2021-07-20T02:26:51.2595629Z [36m[submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner[0m
2021-07-20T02:26:51.2597334Z [36m[submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner[0m
2021-07-20T02:26:51.2598922Z [36m[submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io[0m
2021-07-20T02:26:51.2600581Z [36m[submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io[0m
2021-07-20T02:26:51.2602313Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io[0m
2021-07-20T02:26:51.2603155Z [cluster2] NAME                        CREATED AT
2021-07-20T02:26:51.2603908Z [cluster2] submariners.submariner.io   2021-07-20T02:25:35Z
2021-07-20T02:26:51.2605181Z [36m[submariner-operator]$ [cluster2] json_file=/tmp/submariners.submariner.io.cluster2.json[0m
2021-07-20T02:26:51.2606603Z [36m[submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json[0m
2021-07-20T02:26:51.2608020Z [36m[submariner-operator]$ [cluster2] tee /tmp/submariners.submariner.io.cluster2.json[0m
2021-07-20T02:26:51.2609422Z [36m[submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json[0m
2021-07-20T02:26:51.2610791Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd submariners.submariner.io -o json[0m
2021-07-20T02:26:51.2611584Z [cluster2] {
2021-07-20T02:26:51.2612112Z [cluster2]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-20T02:26:51.2612839Z [cluster2]     "kind": "CustomResourceDefinition",
2021-07-20T02:26:51.2613405Z [cluster2]     "metadata": {
2021-07-20T02:26:51.2614004Z [cluster2]         "annotations": {
2021-07-20T02:26:51.2614945Z [cluster2]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-20T02:26:51.2615752Z [cluster2]         },
2021-07-20T02:26:51.2616450Z [cluster2]         "creationTimestamp": "2021-07-20T02:25:35Z",
2021-07-20T02:26:51.2616985Z [cluster2]         "generation": 1,
2021-07-20T02:26:51.2709248Z [cluster2]         "name": "submariners.submariner.io",
2021-07-20T02:26:51.2710087Z [cluster2]         "resourceVersion": "1589",
2021-07-20T02:26:51.2711326Z [cluster2]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/submariners.submariner.io",
2021-07-20T02:26:51.2713339Z [cluster2]         "uid": "ac214c4e-eed6-4fea-9a99-558ef53cc7e9"
2021-07-20T02:26:51.2714066Z [cluster2]     },
2021-07-20T02:26:51.2714512Z [cluster2]     "spec": {
2021-07-20T02:26:51.2715004Z [cluster2]         "conversion": {
2021-07-20T02:26:51.2715558Z [cluster2]             "strategy": "None"
2021-07-20T02:26:51.2716035Z [cluster2]         },
2021-07-20T02:26:51.2716663Z [cluster2]         "group": "submariner.io",
2021-07-20T02:26:51.2717165Z [cluster2]         "names": {
2021-07-20T02:26:51.2717656Z [cluster2]             "kind": "Submariner",
2021-07-20T02:26:51.2718248Z [cluster2]             "listKind": "SubmarinerList",
2021-07-20T02:26:51.2718870Z [cluster2]             "plural": "submariners",
2021-07-20T02:26:51.2719435Z [cluster2]             "singular": "submariner"
2021-07-20T02:26:51.2719917Z [cluster2]         },
2021-07-20T02:26:51.2720398Z [cluster2]         "scope": "Namespaced",
2021-07-20T02:26:51.2720903Z [cluster2]         "versions": [
2021-07-20T02:26:51.2721539Z [cluster2]             {
2021-07-20T02:26:51.2722033Z [cluster2]                 "name": "v1alpha1",
2021-07-20T02:26:51.2722561Z [cluster2]                 "schema": {
2021-07-20T02:26:51.2723138Z [cluster2]                     "openAPIV3Schema": {
2021-07-20T02:26:51.2723978Z [cluster2]                         "description": "Submariner is the Schema for the submariners API",
2021-07-20T02:26:51.2724758Z [cluster2]                         "properties": {
2021-07-20T02:26:51.2725347Z [cluster2]                             "apiVersion": {
2021-07-20T02:26:51.2727815Z [cluster2]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-20T02:26:51.2729740Z [cluster2]                                 "type": "string"
2021-07-20T02:26:51.2730430Z [cluster2]                             },
2021-07-20T02:26:51.2730913Z [cluster2]                             "kind": {
2021-07-20T02:26:51.2733289Z [cluster2]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-20T02:26:51.2735311Z [cluster2]                                 "type": "string"
2021-07-20T02:26:51.2735779Z [cluster2]                             },
2021-07-20T02:26:51.2736255Z [cluster2]                             "metadata": {
2021-07-20T02:26:51.2736777Z [cluster2]                                 "type": "object"
2021-07-20T02:26:51.2737244Z [cluster2]                             },
2021-07-20T02:26:51.2737695Z [cluster2]                             "spec": {
2021-07-20T02:26:51.2738448Z [cluster2]                                 "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-20T02:26:51.2739255Z [cluster2]                                 "properties": {
2021-07-20T02:26:51.2739771Z [cluster2]                                     "broker": {
2021-07-20T02:26:51.2740296Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2740787Z [cluster2]                                     },
2021-07-20T02:26:51.2741522Z [cluster2]                                     "brokerK8sApiServer": {
2021-07-20T02:26:51.2742266Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2743128Z [cluster2]                                     },
2021-07-20T02:26:51.2743788Z [cluster2]                                     "brokerK8sApiServerToken": {
2021-07-20T02:26:51.2744467Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2744958Z [cluster2]                                     },
2021-07-20T02:26:51.2745586Z [cluster2]                                     "brokerK8sCA": {
2021-07-20T02:26:51.2746061Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2746493Z [cluster2]                                     },
2021-07-20T02:26:51.2747053Z [cluster2]                                     "brokerK8sRemoteNamespace": {
2021-07-20T02:26:51.2747671Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2748086Z [cluster2]                                     },
2021-07-20T02:26:51.2748539Z [cluster2]                                     "cableDriver": {
2021-07-20T02:26:51.2749018Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2749541Z [cluster2]                                     },
2021-07-20T02:26:51.2750002Z [cluster2]                                     "ceIPSecDebug": {
2021-07-20T02:26:51.2750501Z [cluster2]                                         "type": "boolean"
2021-07-20T02:26:51.2750944Z [cluster2]                                     },
2021-07-20T02:26:51.2751479Z [cluster2]                                     "ceIPSecForceUDPEncaps": {
2021-07-20T02:26:51.2752079Z [cluster2]                                         "type": "boolean"
2021-07-20T02:26:51.2752505Z [cluster2]                                     },
2021-07-20T02:26:51.2752976Z [cluster2]                                     "ceIPSecIKEPort": {
2021-07-20T02:26:51.2753489Z [cluster2]                                         "type": "integer"
2021-07-20T02:26:51.2753933Z [cluster2]                                     },
2021-07-20T02:26:51.2754415Z [cluster2]                                     "ceIPSecNATTPort": {
2021-07-20T02:26:51.2755134Z [cluster2]                                         "type": "integer"
2021-07-20T02:26:51.2755630Z [cluster2]                                     },
2021-07-20T02:26:51.2756119Z [cluster2]                                     "ceIPSecPSK": {
2021-07-20T02:26:51.2756750Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2757235Z [cluster2]                                     },
2021-07-20T02:26:51.2757873Z [cluster2]                                     "ceIPSecPreferredServer": {
2021-07-20T02:26:51.2758560Z [cluster2]                                         "type": "boolean"
2021-07-20T02:26:51.2759058Z [cluster2]                                     },
2021-07-20T02:26:51.2759561Z [cluster2]                                     "clusterCIDR": {
2021-07-20T02:26:51.2760321Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2760847Z [cluster2]                                     },
2021-07-20T02:26:51.2761359Z [cluster2]                                     "clusterID": {
2021-07-20T02:26:51.2761977Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2762489Z [cluster2]                                     },
2021-07-20T02:26:51.2763026Z [cluster2]                                     "colorCodes": {
2021-07-20T02:26:51.2763618Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2764134Z [cluster2]                                     },
2021-07-20T02:26:51.2764796Z [cluster2]                                     "connectionHealthCheck": {
2021-07-20T02:26:51.2765508Z [cluster2]                                         "properties": {
2021-07-20T02:26:51.2766103Z [cluster2]                                             "enabled": {
2021-07-20T02:26:51.2766679Z [cluster2]                                                 "type": "boolean"
2021-07-20T02:26:51.2767485Z [cluster2]                                             },
2021-07-20T02:26:51.2768029Z [cluster2]                                             "intervalSeconds": {
2021-07-20T02:26:51.2768823Z [cluster2]                                                 "description": "The interval at which health check pings are sent.",
2021-07-20T02:26:51.2769566Z [cluster2]                                                 "format": "int64",
2021-07-20T02:26:51.2770119Z [cluster2]                                                 "type": "integer"
2021-07-20T02:26:51.2770634Z [cluster2]                                             },
2021-07-20T02:26:51.2771210Z [cluster2]                                             "maxPacketLossCount": {
2021-07-20T02:26:51.2772216Z [cluster2]                                                 "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-20T02:26:51.2773002Z [cluster2]                                                 "format": "int64",
2021-07-20T02:26:51.2773485Z [cluster2]                                                 "type": "integer"
2021-07-20T02:26:51.2773936Z [cluster2]                                             }
2021-07-20T02:26:51.2774506Z [cluster2]                                         },
2021-07-20T02:26:51.2775004Z [cluster2]                                         "type": "object"
2021-07-20T02:26:51.2775483Z [cluster2]                                     },
2021-07-20T02:26:51.2776077Z [cluster2]                                     "coreDNSCustomConfig": {
2021-07-20T02:26:51.2776733Z [cluster2]                                         "properties": {
2021-07-20T02:26:51.2777314Z [cluster2]                                             "configMapName": {
2021-07-20T02:26:51.2777902Z [cluster2]                                                 "type": "string"
2021-07-20T02:26:51.2778393Z [cluster2]                                             },
2021-07-20T02:26:51.2778908Z [cluster2]                                             "namespace": {
2021-07-20T02:26:51.2779445Z [cluster2]                                                 "type": "string"
2021-07-20T02:26:51.2779944Z [cluster2]                                             }
2021-07-20T02:26:51.2780397Z [cluster2]                                         },
2021-07-20T02:26:51.2780882Z [cluster2]                                         "type": "object"
2021-07-20T02:26:51.2781423Z [cluster2]                                     },
2021-07-20T02:26:51.2781935Z [cluster2]                                     "customDomains": {
2021-07-20T02:26:51.2782591Z [cluster2]                                         "items": {
2021-07-20T02:26:51.2783101Z [cluster2]                                             "type": "string"
2021-07-20T02:26:51.2783603Z [cluster2]                                         },
2021-07-20T02:26:51.2784087Z [cluster2]                                         "type": "array",
2021-07-20T02:26:51.2785141Z [cluster2]                                         "x-kubernetes-list-type": "set"
2021-07-20T02:26:51.2785774Z [cluster2]                                     },
2021-07-20T02:26:51.2786227Z [cluster2]                                     "debug": {
2021-07-20T02:26:51.2786898Z [cluster2]                                         "type": "boolean"
2021-07-20T02:26:51.2787265Z [cluster2]                                     },
2021-07-20T02:26:51.2787652Z [cluster2]                                     "globalCIDR": {
2021-07-20T02:26:51.2788058Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2788433Z [cluster2]                                     },
2021-07-20T02:26:51.2788825Z [cluster2]                                     "imageOverrides": {
2021-07-20T02:26:51.2789355Z [cluster2]                                         "additionalProperties": {
2021-07-20T02:26:51.2789857Z [cluster2]                                             "type": "string"
2021-07-20T02:26:51.2790291Z [cluster2]                                         },
2021-07-20T02:26:51.2790670Z [cluster2]                                         "type": "object"
2021-07-20T02:26:51.2791029Z [cluster2]                                     },
2021-07-20T02:26:51.2791478Z [cluster2]                                     "loadBalancerEnabled": {
2021-07-20T02:26:51.2791956Z [cluster2]                                         "type": "boolean"
2021-07-20T02:26:51.2792337Z [cluster2]                                     },
2021-07-20T02:26:51.2792871Z [cluster2]                                     "namespace": {
2021-07-20T02:26:51.2793355Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2794145Z [cluster2]                                     },
2021-07-20T02:26:51.2794665Z [cluster2]                                     "natEnabled": {
2021-07-20T02:26:51.2795259Z [cluster2]                                         "type": "boolean"
2021-07-20T02:26:51.2795790Z [cluster2]                                     },
2021-07-20T02:26:51.2796325Z [cluster2]                                     "repository": {
2021-07-20T02:26:51.2796938Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2797467Z [cluster2]                                     },
2021-07-20T02:26:51.2798015Z [cluster2]                                     "serviceCIDR": {
2021-07-20T02:26:51.2798604Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2799127Z [cluster2]                                     },
2021-07-20T02:26:51.2799804Z [cluster2]                                     "serviceDiscoveryEnabled": {
2021-07-20T02:26:51.2800554Z [cluster2]                                         "type": "boolean"
2021-07-20T02:26:51.2801076Z [cluster2]                                     },
2021-07-20T02:26:51.2801594Z [cluster2]                                     "version": {
2021-07-20T02:26:51.2802149Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2802681Z [cluster2]                                     }
2021-07-20T02:26:51.2803159Z [cluster2]                                 },
2021-07-20T02:26:51.2803660Z [cluster2]                                 "required": [
2021-07-20T02:26:51.2804209Z [cluster2]                                     "broker",
2021-07-20T02:26:51.2804847Z [cluster2]                                     "brokerK8sApiServer",
2021-07-20T02:26:51.2805735Z [cluster2]                                     "brokerK8sApiServerToken",
2021-07-20T02:26:51.2806481Z [cluster2]                                     "brokerK8sCA",
2021-07-20T02:26:51.2807247Z [cluster2]                                     "brokerK8sRemoteNamespace",
2021-07-20T02:26:51.2808021Z [cluster2]                                     "ceIPSecDebug",
2021-07-20T02:26:51.2808643Z [cluster2]                                     "ceIPSecPSK",
2021-07-20T02:26:51.2809250Z [cluster2]                                     "clusterCIDR",
2021-07-20T02:26:51.2809830Z [cluster2]                                     "clusterID",
2021-07-20T02:26:51.2810381Z [cluster2]                                     "debug",
2021-07-20T02:26:51.2810923Z [cluster2]                                     "namespace",
2021-07-20T02:26:51.2811509Z [cluster2]                                     "natEnabled",
2021-07-20T02:26:51.2812102Z [cluster2]                                     "serviceCIDR"
2021-07-20T02:26:51.2812641Z [cluster2]                                 ],
2021-07-20T02:26:51.2813442Z [cluster2]                                 "type": "object"
2021-07-20T02:26:51.2813860Z [cluster2]                             },
2021-07-20T02:26:51.2814349Z [cluster2]                             "status": {
2021-07-20T02:26:51.2814937Z [cluster2]                                 "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-20T02:26:51.2815564Z [cluster2]                                 "properties": {
2021-07-20T02:26:51.2816028Z [cluster2]                                     "clusterCIDR": {
2021-07-20T02:26:51.2816449Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2816807Z [cluster2]                                     },
2021-07-20T02:26:51.2817183Z [cluster2]                                     "clusterID": {
2021-07-20T02:26:51.2817597Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2817959Z [cluster2]                                     },
2021-07-20T02:26:51.2818339Z [cluster2]                                     "colorCodes": {
2021-07-20T02:26:51.2818740Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.2819111Z [cluster2]                                     },
2021-07-20T02:26:51.2819506Z [cluster2]                                     "deploymentInfo": {
2021-07-20T02:26:51.2819958Z [cluster2]                                         "properties": {
2021-07-20T02:26:51.2820394Z [cluster2]                                             "cloudProvider": {
2021-07-20T02:26:51.2820842Z [cluster2]                                                 "type": "string"
2021-07-20T02:26:51.2821226Z [cluster2]                                             },
2021-07-20T02:26:51.2821627Z [cluster2]                                             "kubernetesType": {
2021-07-20T02:26:51.2822078Z [cluster2]                                                 "type": "string"
2021-07-20T02:26:51.2867179Z [cluster2]                                             },
2021-07-20T02:26:51.2867848Z [cluster2]                                             "kubernetesTypeVersion": {
2021-07-20T02:26:51.2868436Z [cluster2]                                                 "type": "string"
2021-07-20T02:26:51.2868889Z [cluster2]                                             },
2021-07-20T02:26:51.2869404Z [cluster2]                                             "kubernetesVersion": {
2021-07-20T02:26:51.2869946Z [cluster2]                                                 "type": "string"
2021-07-20T02:26:51.2870399Z [cluster2]                                             }
2021-07-20T02:26:51.2870782Z [cluster2]                                         },
2021-07-20T02:26:51.2871221Z [cluster2]                                         "type": "object"
2021-07-20T02:26:51.2871643Z [cluster2]                                     },
2021-07-20T02:26:51.2872200Z [cluster2]                                     "gatewayDaemonSetStatus": {
2021-07-20T02:26:51.2872942Z [cluster2]                                         "properties": {
2021-07-20T02:26:51.2873622Z [cluster2]                                             "lastResourceVersion": {
2021-07-20T02:26:51.2874198Z [cluster2]                                                 "type": "string"
2021-07-20T02:26:51.2874630Z [cluster2]                                             },
2021-07-20T02:26:51.2875226Z [cluster2]                                             "mismatchedContainerImages": {
2021-07-20T02:26:51.2875866Z [cluster2]                                                 "type": "boolean"
2021-07-20T02:26:51.2876321Z [cluster2]                                             },
2021-07-20T02:26:51.2876882Z [cluster2]                                             "nonReadyContainerStates": {
2021-07-20T02:26:51.2877486Z [cluster2]                                                 "items": {
2021-07-20T02:26:51.2878579Z [cluster2]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-20T02:26:51.2879685Z [cluster2]                                                     "properties": {
2021-07-20T02:26:51.2880281Z [cluster2]                                                         "running": {
2021-07-20T02:26:51.2880817Z [cluster2]                                                             "description": "Details about a running container",
2021-07-20T02:26:51.2881422Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.2881869Z [cluster2]                                                                 "startedAt": {
2021-07-20T02:26:51.2882793Z [cluster2]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-20T02:26:51.2883550Z [cluster2]                                                                     "format": "date-time",
2021-07-20T02:26:51.2884022Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2884419Z [cluster2]                                                                 }
2021-07-20T02:26:51.2884792Z [cluster2]                                                             },
2021-07-20T02:26:51.2885187Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.2885592Z [cluster2]                                                         },
2021-07-20T02:26:51.2886000Z [cluster2]                                                         "terminated": {
2021-07-20T02:26:51.2886554Z [cluster2]                                                             "description": "Details about a terminated container",
2021-07-20T02:26:51.2887120Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.2887573Z [cluster2]                                                                 "containerID": {
2021-07-20T02:26:51.2888411Z [cluster2]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-20T02:26:51.2889028Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2889426Z [cluster2]                                                                 },
2021-07-20T02:26:51.2889838Z [cluster2]                                                                 "exitCode": {
2021-07-20T02:26:51.2890419Z [cluster2]                                                                     "description": "Exit status from the last termination of the container",
2021-07-20T02:26:51.2891010Z [cluster2]                                                                     "format": "int32",
2021-07-20T02:26:51.2891511Z [cluster2]                                                                     "type": "integer"
2021-07-20T02:26:51.2891915Z [cluster2]                                                                 },
2021-07-20T02:26:51.2892330Z [cluster2]                                                                 "finishedAt": {
2021-07-20T02:26:51.2892895Z [cluster2]                                                                     "description": "Time at which the container last terminated",
2021-07-20T02:26:51.2893645Z [cluster2]                                                                     "format": "date-time",
2021-07-20T02:26:51.2894112Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2894716Z [cluster2]                                                                 },
2021-07-20T02:26:51.2895174Z [cluster2]                                                                 "message": {
2021-07-20T02:26:51.2896172Z [cluster2]                                                                     "description": "Message regarding the last termination of the container",
2021-07-20T02:26:51.2897083Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2897656Z [cluster2]                                                                 },
2021-07-20T02:26:51.2898195Z [cluster2]                                                                 "reason": {
2021-07-20T02:26:51.2899041Z [cluster2]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-20T02:26:51.2900097Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2900670Z [cluster2]                                                                 },
2021-07-20T02:26:51.2901206Z [cluster2]                                                                 "signal": {
2021-07-20T02:26:51.2902021Z [cluster2]                                                                     "description": "Signal from the last termination of the container",
2021-07-20T02:26:51.2941730Z [cluster2]                                                                     "format": "int32",
2021-07-20T02:26:51.2942254Z [cluster2]                                                                     "type": "integer"
2021-07-20T02:26:51.2942826Z [cluster2]                                                                 },
2021-07-20T02:26:51.2943287Z [cluster2]                                                                 "startedAt": {
2021-07-20T02:26:51.2944026Z [cluster2]                                                                     "description": "Time at which previous execution of the container started",
2021-07-20T02:26:51.2945075Z [cluster2]                                                                     "format": "date-time",
2021-07-20T02:26:51.2945600Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2946077Z [cluster2]                                                                 }
2021-07-20T02:26:51.2946491Z [cluster2]                                                             },
2021-07-20T02:26:51.2946958Z [cluster2]                                                             "required": [
2021-07-20T02:26:51.2947463Z [cluster2]                                                                 "exitCode"
2021-07-20T02:26:51.2947910Z [cluster2]                                                             ],
2021-07-20T02:26:51.2948465Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.2948848Z [cluster2]                                                         },
2021-07-20T02:26:51.2949451Z [cluster2]                                                         "waiting": {
2021-07-20T02:26:51.2950298Z [cluster2]                                                             "description": "Details about a waiting container",
2021-07-20T02:26:51.2951170Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.2951754Z [cluster2]                                                                 "message": {
2021-07-20T02:26:51.2952531Z [cluster2]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-20T02:26:51.2953323Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2953848Z [cluster2]                                                                 },
2021-07-20T02:26:51.2954364Z [cluster2]                                                                 "reason": {
2021-07-20T02:26:51.2955106Z [cluster2]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-20T02:26:51.2955849Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2956385Z [cluster2]                                                                 }
2021-07-20T02:26:51.2956857Z [cluster2]                                                             },
2021-07-20T02:26:51.2957551Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.2958108Z [cluster2]                                                         }
2021-07-20T02:26:51.2958616Z [cluster2]                                                     },
2021-07-20T02:26:51.2959265Z [cluster2]                                                     "type": "object"
2021-07-20T02:26:51.2959803Z [cluster2]                                                 },
2021-07-20T02:26:51.2960345Z [cluster2]                                                 "type": "array"
2021-07-20T02:26:51.2960866Z [cluster2]                                             },
2021-07-20T02:26:51.2961391Z [cluster2]                                             "status": {
2021-07-20T02:26:51.2962266Z [cluster2]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-20T02:26:51.2963184Z [cluster2]                                                 "properties": {
2021-07-20T02:26:51.2963846Z [cluster2]                                                     "collisionCount": {
2021-07-20T02:26:51.2966248Z [cluster2]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-20T02:26:51.2967692Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.2968321Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.2968883Z [cluster2]                                                     },
2021-07-20T02:26:51.2969451Z [cluster2]                                                     "conditions": {
2021-07-20T02:26:51.2970858Z [cluster2]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-20T02:26:51.2971727Z [cluster2]                                                         "items": {
2021-07-20T02:26:51.2972632Z [cluster2]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-20T02:26:51.2973432Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.2974022Z [cluster2]                                                                 "lastTransitionTime": {
2021-07-20T02:26:51.2974807Z [cluster2]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-20T02:26:51.2975819Z [cluster2]                                                                     "format": "date-time",
2021-07-20T02:26:51.2976365Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2976817Z [cluster2]                                                                 },
2021-07-20T02:26:51.2977275Z [cluster2]                                                                 "message": {
2021-07-20T02:26:51.2977994Z [cluster2]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-20T02:26:51.2978741Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2979209Z [cluster2]                                                                 },
2021-07-20T02:26:51.2979650Z [cluster2]                                                                 "reason": {
2021-07-20T02:26:51.2980537Z [cluster2]                                                                     "description": "The reason for the condition's last transition.",
2021-07-20T02:26:51.2981187Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2981651Z [cluster2]                                                                 },
2021-07-20T02:26:51.2982090Z [cluster2]                                                                 "status": {
2021-07-20T02:26:51.2983028Z [cluster2]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-20T02:26:51.2983709Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2984161Z [cluster2]                                                                 },
2021-07-20T02:26:51.2984611Z [cluster2]                                                                 "type": {
2021-07-20T02:26:51.2985202Z [cluster2]                                                                     "description": "Type of DaemonSet condition.",
2021-07-20T02:26:51.2985818Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.2986290Z [cluster2]                                                                 }
2021-07-20T02:26:51.2986701Z [cluster2]                                                             },
2021-07-20T02:26:51.2987170Z [cluster2]                                                             "required": [
2021-07-20T02:26:51.2987639Z [cluster2]                                                                 "status",
2021-07-20T02:26:51.2988107Z [cluster2]                                                                 "type"
2021-07-20T02:26:51.2988533Z [cluster2]                                                             ],
2021-07-20T02:26:51.2988999Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.2989461Z [cluster2]                                                         },
2021-07-20T02:26:51.2989900Z [cluster2]                                                         "type": "array"
2021-07-20T02:26:51.2990471Z [cluster2]                                                     },
2021-07-20T02:26:51.2990956Z [cluster2]                                                     "currentNumberScheduled": {
2021-07-20T02:26:51.2992029Z [cluster2]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.2992996Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.2993426Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.2993883Z [cluster2]                                                     },
2021-07-20T02:26:51.2994368Z [cluster2]                                                     "desiredNumberScheduled": {
2021-07-20T02:26:51.2995497Z [cluster2]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.2996995Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.2997781Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.2998335Z [cluster2]                                                     },
2021-07-20T02:26:51.2998944Z [cluster2]                                                     "numberAvailable": {
2021-07-20T02:26:51.3000238Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-20T02:26:51.3001481Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3002097Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3002651Z [cluster2]                                                     },
2021-07-20T02:26:51.3003366Z [cluster2]                                                     "numberMisscheduled": {
2021-07-20T02:26:51.3004810Z [cluster2]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.3006173Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3006795Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3007350Z [cluster2]                                                     },
2021-07-20T02:26:51.3007923Z [cluster2]                                                     "numberReady": {
2021-07-20T02:26:51.3009025Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-20T02:26:51.3009969Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3010452Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3010911Z [cluster2]                                                     },
2021-07-20T02:26:51.3011424Z [cluster2]                                                     "numberUnavailable": {
2021-07-20T02:26:51.3012465Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-20T02:26:51.3013455Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3013945Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3014402Z [cluster2]                                                     },
2021-07-20T02:26:51.3014933Z [cluster2]                                                     "observedGeneration": {
2021-07-20T02:26:51.3015721Z [cluster2]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-20T02:26:51.3016441Z [cluster2]                                                         "format": "int64",
2021-07-20T02:26:51.3016974Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3017437Z [cluster2]                                                     },
2021-07-20T02:26:51.3017998Z [cluster2]                                                     "updatedNumberScheduled": {
2021-07-20T02:26:51.3018807Z [cluster2]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-20T02:26:51.3019486Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3019974Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3020436Z [cluster2]                                                     }
2021-07-20T02:26:51.3020829Z [cluster2]                                                 },
2021-07-20T02:26:51.3021271Z [cluster2]                                                 "required": [
2021-07-20T02:26:51.3021889Z [cluster2]                                                     "currentNumberScheduled",
2021-07-20T02:26:51.3022686Z [cluster2]                                                     "desiredNumberScheduled",
2021-07-20T02:26:51.3023366Z [cluster2]                                                     "numberMisscheduled",
2021-07-20T02:26:51.3023937Z [cluster2]                                                     "numberReady"
2021-07-20T02:26:51.3024400Z [cluster2]                                                 ],
2021-07-20T02:26:51.3024899Z [cluster2]                                                 "type": "object"
2021-07-20T02:26:51.3025348Z [cluster2]                                             }
2021-07-20T02:26:51.3025748Z [cluster2]                                         },
2021-07-20T02:26:51.3026165Z [cluster2]                                         "required": [
2021-07-20T02:26:51.3026798Z [cluster2]                                             "mismatchedContainerImages"
2021-07-20T02:26:51.3027381Z [cluster2]                                         ],
2021-07-20T02:26:51.3027821Z [cluster2]                                         "type": "object"
2021-07-20T02:26:51.3028242Z [cluster2]                                     },
2021-07-20T02:26:51.3028669Z [cluster2]                                     "gateways": {
2021-07-20T02:26:51.3029179Z [cluster2]                                         "items": {
2021-07-20T02:26:51.3029586Z [cluster2]                                             "properties": {
2021-07-20T02:26:51.3030027Z [cluster2]                                                 "connections": {
2021-07-20T02:26:51.3030435Z [cluster2]                                                     "items": {
2021-07-20T02:26:51.3030860Z [cluster2]                                                         "properties": {
2021-07-20T02:26:51.3031290Z [cluster2]                                                             "endpoint": {
2021-07-20T02:26:51.3031916Z [cluster2]                                                                 "properties": {
2021-07-20T02:26:51.3032413Z [cluster2]                                                                     "backend": {
2021-07-20T02:26:51.3032920Z [cluster2]                                                                         "type": "string"
2021-07-20T02:26:51.3033398Z [cluster2]                                                                     },
2021-07-20T02:26:51.3033867Z [cluster2]                                                                     "backend_config": {
2021-07-20T02:26:51.3034496Z [cluster2]                                                                         "additionalProperties": {
2021-07-20T02:26:51.3035093Z [cluster2]                                                                             "type": "string"
2021-07-20T02:26:51.3035570Z [cluster2]                                                                         },
2021-07-20T02:26:51.3036053Z [cluster2]                                                                         "type": "object"
2021-07-20T02:26:51.3036556Z [cluster2]                                                                     },
2021-07-20T02:26:51.3037021Z [cluster2]                                                                     "cable_name": {
2021-07-20T02:26:51.3037518Z [cluster2]                                                                         "type": "string"
2021-07-20T02:26:51.3037991Z [cluster2]                                                                     },
2021-07-20T02:26:51.3038439Z [cluster2]                                                                     "cluster_id": {
2021-07-20T02:26:51.3038946Z [cluster2]                                                                         "type": "string"
2021-07-20T02:26:51.3039419Z [cluster2]                                                                     },
2021-07-20T02:26:51.3039906Z [cluster2]                                                                     "healthCheckIP": {
2021-07-20T02:26:51.3040448Z [cluster2]                                                                         "type": "string"
2021-07-20T02:26:51.3040911Z [cluster2]                                                                     },
2021-07-20T02:26:51.3041374Z [cluster2]                                                                     "hostname": {
2021-07-20T02:26:51.3041868Z [cluster2]                                                                         "type": "string"
2021-07-20T02:26:51.3042335Z [cluster2]                                                                     },
2021-07-20T02:26:51.3042846Z [cluster2]                                                                     "nat_enabled": {
2021-07-20T02:26:51.3043420Z [cluster2]                                                                         "type": "boolean"
2021-07-20T02:26:51.3043833Z [cluster2]                                                                     },
2021-07-20T02:26:51.3044423Z [cluster2]                                                                     "private_ip": {
2021-07-20T02:26:51.3044935Z [cluster2]                                                                         "type": "string"
2021-07-20T02:26:51.3045405Z [cluster2]                                                                     },
2021-07-20T02:26:51.3045849Z [cluster2]                                                                     "public_ip": {
2021-07-20T02:26:51.3046353Z [cluster2]                                                                         "type": "string"
2021-07-20T02:26:51.3046809Z [cluster2]                                                                     },
2021-07-20T02:26:51.3047270Z [cluster2]                                                                     "subnets": {
2021-07-20T02:26:51.3047733Z [cluster2]                                                                         "items": {
2021-07-20T02:26:51.3048222Z [cluster2]                                                                             "type": "string"
2021-07-20T02:26:51.3048701Z [cluster2]                                                                         },
2021-07-20T02:26:51.3049162Z [cluster2]                                                                         "type": "array"
2021-07-20T02:26:51.3049823Z [cluster2]                                                                     }
2021-07-20T02:26:51.3050296Z [cluster2]                                                                 },
2021-07-20T02:26:51.3050833Z [cluster2]                                                                 "required": [
2021-07-20T02:26:51.3051398Z [cluster2]                                                                     "backend",
2021-07-20T02:26:51.3051945Z [cluster2]                                                                     "cable_name",
2021-07-20T02:26:51.3052506Z [cluster2]                                                                     "cluster_id",
2021-07-20T02:26:51.3053053Z [cluster2]                                                                     "hostname",
2021-07-20T02:26:51.3053674Z [cluster2]                                                                     "nat_enabled",
2021-07-20T02:26:51.3054244Z [cluster2]                                                                     "private_ip",
2021-07-20T02:26:51.3054813Z [cluster2]                                                                     "public_ip",
2021-07-20T02:26:51.3055361Z [cluster2]                                                                     "subnets"
2021-07-20T02:26:51.3055892Z [cluster2]                                                                 ],
2021-07-20T02:26:51.3056478Z [cluster2]                                                                 "type": "object"
2021-07-20T02:26:51.3056940Z [cluster2]                                                             },
2021-07-20T02:26:51.3057407Z [cluster2]                                                             "latencyRTT": {
2021-07-20T02:26:51.3058285Z [cluster2]                                                                 "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-20T02:26:51.3142020Z [cluster2]                                                                 "properties": {
2021-07-20T02:26:51.3142807Z [cluster2]                                                                     "average": {
2021-07-20T02:26:51.3143318Z [cluster2]                                                                         "type": "string"
2021-07-20T02:26:51.3143955Z [cluster2]                                                                     },
2021-07-20T02:26:51.3144406Z [cluster2]                                                                     "last": {
2021-07-20T02:26:51.3144899Z [cluster2]                                                                         "type": "string"
2021-07-20T02:26:51.3145359Z [cluster2]                                                                     },
2021-07-20T02:26:51.3145805Z [cluster2]                                                                     "max": {
2021-07-20T02:26:51.3146279Z [cluster2]                                                                         "type": "string"
2021-07-20T02:26:51.3146754Z [cluster2]                                                                     },
2021-07-20T02:26:51.3147341Z [cluster2]                                                                     "min": {
2021-07-20T02:26:51.3147812Z [cluster2]                                                                         "type": "string"
2021-07-20T02:26:51.3148287Z [cluster2]                                                                     },
2021-07-20T02:26:51.3148730Z [cluster2]                                                                     "stdDev": {
2021-07-20T02:26:51.3149227Z [cluster2]                                                                         "type": "string"
2021-07-20T02:26:51.3149882Z [cluster2]                                                                     }
2021-07-20T02:26:51.3150370Z [cluster2]                                                                 },
2021-07-20T02:26:51.3150903Z [cluster2]                                                                 "type": "object"
2021-07-20T02:26:51.3151419Z [cluster2]                                                             },
2021-07-20T02:26:51.3151932Z [cluster2]                                                             "status": {
2021-07-20T02:26:51.3152585Z [cluster2]                                                                 "type": "string"
2021-07-20T02:26:51.3153121Z [cluster2]                                                             },
2021-07-20T02:26:51.3153673Z [cluster2]                                                             "statusMessage": {
2021-07-20T02:26:51.3154285Z [cluster2]                                                                 "type": "string"
2021-07-20T02:26:51.3154807Z [cluster2]                                                             },
2021-07-20T02:26:51.3155387Z [cluster2]                                                             "usingIP": {
2021-07-20T02:26:51.3155957Z [cluster2]                                                                 "type": "string"
2021-07-20T02:26:51.3156471Z [cluster2]                                                             },
2021-07-20T02:26:51.3156994Z [cluster2]                                                             "usingNAT": {
2021-07-20T02:26:51.3157570Z [cluster2]                                                                 "type": "boolean"
2021-07-20T02:26:51.3158094Z [cluster2]                                                             }
2021-07-20T02:26:51.3158576Z [cluster2]                                                         },
2021-07-20T02:26:51.3159082Z [cluster2]                                                         "required": [
2021-07-20T02:26:51.3159647Z [cluster2]                                                             "endpoint",
2021-07-20T02:26:51.3160188Z [cluster2]                                                             "status",
2021-07-20T02:26:51.3160777Z [cluster2]                                                             "statusMessage"
2021-07-20T02:26:51.3161339Z [cluster2]                                                         ],
2021-07-20T02:26:51.3161845Z [cluster2]                                                         "type": "object"
2021-07-20T02:26:51.3162367Z [cluster2]                                                     },
2021-07-20T02:26:51.3162914Z [cluster2]                                                     "type": "array"
2021-07-20T02:26:51.3163419Z [cluster2]                                                 },
2021-07-20T02:26:51.3163907Z [cluster2]                                                 "haStatus": {
2021-07-20T02:26:51.3164461Z [cluster2]                                                     "type": "string"
2021-07-20T02:26:51.3164959Z [cluster2]                                                 },
2021-07-20T02:26:51.3165511Z [cluster2]                                                 "localEndpoint": {
2021-07-20T02:26:51.3166114Z [cluster2]                                                     "properties": {
2021-07-20T02:26:51.3166659Z [cluster2]                                                         "backend": {
2021-07-20T02:26:51.3167279Z [cluster2]                                                             "type": "string"
2021-07-20T02:26:51.3167725Z [cluster2]                                                         },
2021-07-20T02:26:51.3168200Z [cluster2]                                                         "backend_config": {
2021-07-20T02:26:51.3168792Z [cluster2]                                                             "additionalProperties": {
2021-07-20T02:26:51.3169394Z [cluster2]                                                                 "type": "string"
2021-07-20T02:26:51.3169852Z [cluster2]                                                             },
2021-07-20T02:26:51.3170300Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.3170756Z [cluster2]                                                         },
2021-07-20T02:26:51.3171197Z [cluster2]                                                         "cable_name": {
2021-07-20T02:26:51.3171688Z [cluster2]                                                             "type": "string"
2021-07-20T02:26:51.3172144Z [cluster2]                                                         },
2021-07-20T02:26:51.3172587Z [cluster2]                                                         "cluster_id": {
2021-07-20T02:26:51.3173079Z [cluster2]                                                             "type": "string"
2021-07-20T02:26:51.3173519Z [cluster2]                                                         },
2021-07-20T02:26:51.3174005Z [cluster2]                                                         "healthCheckIP": {
2021-07-20T02:26:51.3174571Z [cluster2]                                                             "type": "string"
2021-07-20T02:26:51.3175035Z [cluster2]                                                         },
2021-07-20T02:26:51.3175485Z [cluster2]                                                         "hostname": {
2021-07-20T02:26:51.3175957Z [cluster2]                                                             "type": "string"
2021-07-20T02:26:51.3176412Z [cluster2]                                                         },
2021-07-20T02:26:51.3176857Z [cluster2]                                                         "nat_enabled": {
2021-07-20T02:26:51.3177363Z [cluster2]                                                             "type": "boolean"
2021-07-20T02:26:51.3177810Z [cluster2]                                                         },
2021-07-20T02:26:51.3178264Z [cluster2]                                                         "private_ip": {
2021-07-20T02:26:51.3178934Z [cluster2]                                                             "type": "string"
2021-07-20T02:26:51.3179440Z [cluster2]                                                         },
2021-07-20T02:26:51.3179950Z [cluster2]                                                         "public_ip": {
2021-07-20T02:26:51.3180564Z [cluster2]                                                             "type": "string"
2021-07-20T02:26:51.3181019Z [cluster2]                                                         },
2021-07-20T02:26:51.3181451Z [cluster2]                                                         "subnets": {
2021-07-20T02:26:51.3181957Z [cluster2]                                                             "items": {
2021-07-20T02:26:51.3182530Z [cluster2]                                                                 "type": "string"
2021-07-20T02:26:51.3182980Z [cluster2]                                                             },
2021-07-20T02:26:51.3183438Z [cluster2]                                                             "type": "array"
2021-07-20T02:26:51.3183885Z [cluster2]                                                         }
2021-07-20T02:26:51.3184508Z [cluster2]                                                     },
2021-07-20T02:26:51.3185011Z [cluster2]                                                     "required": [
2021-07-20T02:26:51.3185555Z [cluster2]                                                         "backend",
2021-07-20T02:26:51.3186100Z [cluster2]                                                         "cable_name",
2021-07-20T02:26:51.3186633Z [cluster2]                                                         "cluster_id",
2021-07-20T02:26:51.3187187Z [cluster2]                                                         "hostname",
2021-07-20T02:26:51.3187734Z [cluster2]                                                         "nat_enabled",
2021-07-20T02:26:51.3188295Z [cluster2]                                                         "private_ip",
2021-07-20T02:26:51.3188828Z [cluster2]                                                         "public_ip",
2021-07-20T02:26:51.3189375Z [cluster2]                                                         "subnets"
2021-07-20T02:26:51.3189880Z [cluster2]                                                     ],
2021-07-20T02:26:51.3190383Z [cluster2]                                                     "type": "object"
2021-07-20T02:26:51.3190895Z [cluster2]                                                 },
2021-07-20T02:26:51.3191422Z [cluster2]                                                 "statusFailure": {
2021-07-20T02:26:51.3192018Z [cluster2]                                                     "type": "string"
2021-07-20T02:26:51.3192513Z [cluster2]                                                 },
2021-07-20T02:26:51.3193005Z [cluster2]                                                 "version": {
2021-07-20T02:26:51.3193531Z [cluster2]                                                     "type": "string"
2021-07-20T02:26:51.3194041Z [cluster2]                                                 }
2021-07-20T02:26:51.3194559Z [cluster2]                                             },
2021-07-20T02:26:51.3195046Z [cluster2]                                             "required": [
2021-07-20T02:26:51.3195605Z [cluster2]                                                 "connections",
2021-07-20T02:26:51.3196146Z [cluster2]                                                 "haStatus",
2021-07-20T02:26:51.3196748Z [cluster2]                                                 "localEndpoint",
2021-07-20T02:26:51.3197355Z [cluster2]                                                 "statusFailure",
2021-07-20T02:26:51.3197930Z [cluster2]                                                 "version"
2021-07-20T02:26:51.3198421Z [cluster2]                                             ],
2021-07-20T02:26:51.3198909Z [cluster2]                                             "type": "object"
2021-07-20T02:26:51.3199614Z [cluster2]                                         },
2021-07-20T02:26:51.3200130Z [cluster2]                                         "type": "array"
2021-07-20T02:26:51.3200649Z [cluster2]                                     },
2021-07-20T02:26:51.3201176Z [cluster2]                                     "globalCIDR": {
2021-07-20T02:26:51.3201764Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.3202278Z [cluster2]                                     },
2021-07-20T02:26:51.3202990Z [cluster2]                                     "globalnetDaemonSetStatus": {
2021-07-20T02:26:51.3203773Z [cluster2]                                         "properties": {
2021-07-20T02:26:51.3204531Z [cluster2]                                             "lastResourceVersion": {
2021-07-20T02:26:51.3205226Z [cluster2]                                                 "type": "string"
2021-07-20T02:26:51.3205810Z [cluster2]                                             },
2021-07-20T02:26:51.3206632Z [cluster2]                                             "mismatchedContainerImages": {
2021-07-20T02:26:51.3207463Z [cluster2]                                                 "type": "boolean"
2021-07-20T02:26:51.3208191Z [cluster2]                                             },
2021-07-20T02:26:51.3208979Z [cluster2]                                             "nonReadyContainerStates": {
2021-07-20T02:26:51.3209740Z [cluster2]                                                 "items": {
2021-07-20T02:26:51.3211157Z [cluster2]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-20T02:26:51.3212310Z [cluster2]                                                     "properties": {
2021-07-20T02:26:51.3212898Z [cluster2]                                                         "running": {
2021-07-20T02:26:51.3213557Z [cluster2]                                                             "description": "Details about a running container",
2021-07-20T02:26:51.3346721Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.3347368Z [cluster2]                                                                 "startedAt": {
2021-07-20T02:26:51.3348699Z [cluster2]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-20T02:26:51.3349845Z [cluster2]                                                                     "format": "date-time",
2021-07-20T02:26:51.3350532Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3350989Z [cluster2]                                                                 }
2021-07-20T02:26:51.3351398Z [cluster2]                                                             },
2021-07-20T02:26:51.3351849Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.3352542Z [cluster2]                                                         },
2021-07-20T02:26:51.3352936Z [cluster2]                                                         "terminated": {
2021-07-20T02:26:51.3353486Z [cluster2]                                                             "description": "Details about a terminated container",
2021-07-20T02:26:51.3354035Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.3354499Z [cluster2]                                                                 "containerID": {
2021-07-20T02:26:51.3355325Z [cluster2]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-20T02:26:51.3355945Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3356352Z [cluster2]                                                                 },
2021-07-20T02:26:51.3356754Z [cluster2]                                                                 "exitCode": {
2021-07-20T02:26:51.3357353Z [cluster2]                                                                     "description": "Exit status from the last termination of the container",
2021-07-20T02:26:51.3357937Z [cluster2]                                                                     "format": "int32",
2021-07-20T02:26:51.3358386Z [cluster2]                                                                     "type": "integer"
2021-07-20T02:26:51.3358849Z [cluster2]                                                                 },
2021-07-20T02:26:51.3359266Z [cluster2]                                                                 "finishedAt": {
2021-07-20T02:26:51.3359851Z [cluster2]                                                                     "description": "Time at which the container last terminated",
2021-07-20T02:26:51.3360595Z [cluster2]                                                                     "format": "date-time",
2021-07-20T02:26:51.3361286Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3361744Z [cluster2]                                                                 },
2021-07-20T02:26:51.3362205Z [cluster2]                                                                 "message": {
2021-07-20T02:26:51.3362912Z [cluster2]                                                                     "description": "Message regarding the last termination of the container",
2021-07-20T02:26:51.3363613Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3364081Z [cluster2]                                                                 },
2021-07-20T02:26:51.3364517Z [cluster2]                                                                 "reason": {
2021-07-20T02:26:51.3365199Z [cluster2]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-20T02:26:51.3365896Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3366525Z [cluster2]                                                                 },
2021-07-20T02:26:51.3367041Z [cluster2]                                                                 "signal": {
2021-07-20T02:26:51.3367785Z [cluster2]                                                                     "description": "Signal from the last termination of the container",
2021-07-20T02:26:51.3368741Z [cluster2]                                                                     "format": "int32",
2021-07-20T02:26:51.3369363Z [cluster2]                                                                     "type": "integer"
2021-07-20T02:26:51.3369954Z [cluster2]                                                                 },
2021-07-20T02:26:51.3370586Z [cluster2]                                                                 "startedAt": {
2021-07-20T02:26:51.3371455Z [cluster2]                                                                     "description": "Time at which previous execution of the container started",
2021-07-20T02:26:51.3372590Z [cluster2]                                                                     "format": "date-time",
2021-07-20T02:26:51.3373329Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3373864Z [cluster2]                                                                 }
2021-07-20T02:26:51.3374356Z [cluster2]                                                             },
2021-07-20T02:26:51.3374865Z [cluster2]                                                             "required": [
2021-07-20T02:26:51.3375433Z [cluster2]                                                                 "exitCode"
2021-07-20T02:26:51.3375947Z [cluster2]                                                             ],
2021-07-20T02:26:51.3376487Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.3376998Z [cluster2]                                                         },
2021-07-20T02:26:51.3377508Z [cluster2]                                                         "waiting": {
2021-07-20T02:26:51.3378396Z [cluster2]                                                             "description": "Details about a waiting container",
2021-07-20T02:26:51.3379168Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.3379856Z [cluster2]                                                                 "message": {
2021-07-20T02:26:51.3380695Z [cluster2]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-20T02:26:51.3381552Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3382133Z [cluster2]                                                                 },
2021-07-20T02:26:51.3382830Z [cluster2]                                                                 "reason": {
2021-07-20T02:26:51.3383631Z [cluster2]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-20T02:26:51.3384424Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3385004Z [cluster2]                                                                 }
2021-07-20T02:26:51.3385512Z [cluster2]                                                             },
2021-07-20T02:26:51.3423209Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.3423792Z [cluster2]                                                         }
2021-07-20T02:26:51.3424393Z [cluster2]                                                     },
2021-07-20T02:26:51.3424930Z [cluster2]                                                     "type": "object"
2021-07-20T02:26:51.3425601Z [cluster2]                                                 },
2021-07-20T02:26:51.3426146Z [cluster2]                                                 "type": "array"
2021-07-20T02:26:51.3426675Z [cluster2]                                             },
2021-07-20T02:26:51.3427200Z [cluster2]                                             "status": {
2021-07-20T02:26:51.3428084Z [cluster2]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-20T02:26:51.3429000Z [cluster2]                                                 "properties": {
2021-07-20T02:26:51.3429657Z [cluster2]                                                     "collisionCount": {
2021-07-20T02:26:51.3431242Z [cluster2]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-20T02:26:51.3432651Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3433268Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3433824Z [cluster2]                                                     },
2021-07-20T02:26:51.3434394Z [cluster2]                                                     "conditions": {
2021-07-20T02:26:51.3435798Z [cluster2]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-20T02:26:51.3436729Z [cluster2]                                                         "items": {
2021-07-20T02:26:51.3437753Z [cluster2]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-20T02:26:51.3438668Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.3439340Z [cluster2]                                                                 "lastTransitionTime": {
2021-07-20T02:26:51.3440239Z [cluster2]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-20T02:26:51.3441173Z [cluster2]                                                                     "format": "date-time",
2021-07-20T02:26:51.3441784Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3442241Z [cluster2]                                                                 },
2021-07-20T02:26:51.3442702Z [cluster2]                                                                 "message": {
2021-07-20T02:26:51.3443430Z [cluster2]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-20T02:26:51.3444167Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3444625Z [cluster2]                                                                 },
2021-07-20T02:26:51.3445083Z [cluster2]                                                                 "reason": {
2021-07-20T02:26:51.3445965Z [cluster2]                                                                     "description": "The reason for the condition's last transition.",
2021-07-20T02:26:51.3446623Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3447091Z [cluster2]                                                                 },
2021-07-20T02:26:51.3447528Z [cluster2]                                                                 "status": {
2021-07-20T02:26:51.3448199Z [cluster2]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-20T02:26:51.3448881Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3449339Z [cluster2]                                                                 },
2021-07-20T02:26:51.3449785Z [cluster2]                                                                 "type": {
2021-07-20T02:26:51.3450379Z [cluster2]                                                                     "description": "Type of DaemonSet condition.",
2021-07-20T02:26:51.3451005Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3451475Z [cluster2]                                                                 }
2021-07-20T02:26:51.3451883Z [cluster2]                                                             },
2021-07-20T02:26:51.3452420Z [cluster2]                                                             "required": [
2021-07-20T02:26:51.3452888Z [cluster2]                                                                 "status",
2021-07-20T02:26:51.3453355Z [cluster2]                                                                 "type"
2021-07-20T02:26:51.3453788Z [cluster2]                                                             ],
2021-07-20T02:26:51.3454251Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.3454716Z [cluster2]                                                         },
2021-07-20T02:26:51.3455309Z [cluster2]                                                         "type": "array"
2021-07-20T02:26:51.3455745Z [cluster2]                                                     },
2021-07-20T02:26:51.3456321Z [cluster2]                                                     "currentNumberScheduled": {
2021-07-20T02:26:51.3457568Z [cluster2]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.3458671Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3459171Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3459617Z [cluster2]                                                     },
2021-07-20T02:26:51.3460241Z [cluster2]                                                     "desiredNumberScheduled": {
2021-07-20T02:26:51.3461533Z [cluster2]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.3462861Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3463366Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3463811Z [cluster2]                                                     },
2021-07-20T02:26:51.3464315Z [cluster2]                                                     "numberAvailable": {
2021-07-20T02:26:51.3465572Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-20T02:26:51.3466718Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3467293Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3467809Z [cluster2]                                                     },
2021-07-20T02:26:51.3468417Z [cluster2]                                                     "numberMisscheduled": {
2021-07-20T02:26:51.3469773Z [cluster2]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.3471022Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3471595Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3472108Z [cluster2]                                                     },
2021-07-20T02:26:51.3472648Z [cluster2]                                                     "numberReady": {
2021-07-20T02:26:51.3473810Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-20T02:26:51.3474872Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3475497Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3476049Z [cluster2]                                                     },
2021-07-20T02:26:51.3476681Z [cluster2]                                                     "numberUnavailable": {
2021-07-20T02:26:51.3477974Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-20T02:26:51.3479178Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3479790Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3480337Z [cluster2]                                                     },
2021-07-20T02:26:51.3480991Z [cluster2]                                                     "observedGeneration": {
2021-07-20T02:26:51.3481972Z [cluster2]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-20T02:26:51.3482849Z [cluster2]                                                         "format": "int64",
2021-07-20T02:26:51.3483469Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3484088Z [cluster2]                                                     },
2021-07-20T02:26:51.3484795Z [cluster2]                                                     "updatedNumberScheduled": {
2021-07-20T02:26:51.3485776Z [cluster2]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-20T02:26:51.3486719Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3487291Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3487797Z [cluster2]                                                     }
2021-07-20T02:26:51.3488261Z [cluster2]                                                 },
2021-07-20T02:26:51.3488753Z [cluster2]                                                 "required": [
2021-07-20T02:26:51.3489445Z [cluster2]                                                     "currentNumberScheduled",
2021-07-20T02:26:51.3490276Z [cluster2]                                                     "desiredNumberScheduled",
2021-07-20T02:26:51.3491047Z [cluster2]                                                     "numberMisscheduled",
2021-07-20T02:26:51.3491709Z [cluster2]                                                     "numberReady"
2021-07-20T02:26:51.3492223Z [cluster2]                                                 ],
2021-07-20T02:26:51.3492741Z [cluster2]                                                 "type": "object"
2021-07-20T02:26:51.3493289Z [cluster2]                                             }
2021-07-20T02:26:51.3493686Z [cluster2]                                         },
2021-07-20T02:26:51.3494106Z [cluster2]                                         "required": [
2021-07-20T02:26:51.3494734Z [cluster2]                                             "mismatchedContainerImages"
2021-07-20T02:26:51.3495323Z [cluster2]                                         ],
2021-07-20T02:26:51.3495748Z [cluster2]                                         "type": "object"
2021-07-20T02:26:51.3496182Z [cluster2]                                     },
2021-07-20T02:26:51.3496674Z [cluster2]                                     "loadBalancerStatus": {
2021-07-20T02:26:51.3497263Z [cluster2]                                         "properties": {
2021-07-20T02:26:51.3497723Z [cluster2]                                             "status": {
2021-07-20T02:26:51.3498836Z [cluster2]                                                 "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-20T02:26:51.3499622Z [cluster2]                                                 "properties": {
2021-07-20T02:26:51.3500109Z [cluster2]                                                     "ingress": {
2021-07-20T02:26:51.3501343Z [cluster2]                                                         "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-20T02:26:51.3503800Z [cluster2]                                                         "items": {
2021-07-20T02:26:51.3505483Z [cluster2]                                                             "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-20T02:26:51.3506777Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.3507390Z [cluster2]                                                                 "hostname": {
2021-07-20T02:26:51.3508747Z [cluster2]                                                                     "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-20T02:26:51.3509786Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3510478Z [cluster2]                                                                 },
2021-07-20T02:26:51.3511020Z [cluster2]                                                                 "ip": {
2021-07-20T02:26:51.3512382Z [cluster2]                                                                     "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-20T02:26:51.3513463Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3514023Z [cluster2]                                                                 }
2021-07-20T02:26:51.3514637Z [cluster2]                                                             },
2021-07-20T02:26:51.3515222Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.3515669Z [cluster2]                                                         },
2021-07-20T02:26:51.3516122Z [cluster2]                                                         "type": "array"
2021-07-20T02:26:51.3516561Z [cluster2]                                                     }
2021-07-20T02:26:51.3516970Z [cluster2]                                                 },
2021-07-20T02:26:51.3517400Z [cluster2]                                                 "type": "object"
2021-07-20T02:26:51.3517847Z [cluster2]                                             }
2021-07-20T02:26:51.3518248Z [cluster2]                                         },
2021-07-20T02:26:51.3518668Z [cluster2]                                         "type": "object"
2021-07-20T02:26:51.3519104Z [cluster2]                                     },
2021-07-20T02:26:51.3519530Z [cluster2]                                     "natEnabled": {
2021-07-20T02:26:51.3520018Z [cluster2]                                         "type": "boolean"
2021-07-20T02:26:51.3520441Z [cluster2]                                     },
2021-07-20T02:26:51.3520901Z [cluster2]                                     "networkPlugin": {
2021-07-20T02:26:51.3521398Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.3521827Z [cluster2]                                     },
2021-07-20T02:26:51.3522415Z [cluster2]                                     "routeAgentDaemonSetStatus": {
2021-07-20T02:26:51.3523050Z [cluster2]                                         "properties": {
2021-07-20T02:26:51.3523688Z [cluster2]                                             "lastResourceVersion": {
2021-07-20T02:26:51.3524251Z [cluster2]                                                 "type": "string"
2021-07-20T02:26:51.3524691Z [cluster2]                                             },
2021-07-20T02:26:51.3525273Z [cluster2]                                             "mismatchedContainerImages": {
2021-07-20T02:26:51.3525919Z [cluster2]                                                 "type": "boolean"
2021-07-20T02:26:51.3526363Z [cluster2]                                             },
2021-07-20T02:26:51.3526925Z [cluster2]                                             "nonReadyContainerStates": {
2021-07-20T02:26:51.3527737Z [cluster2]                                                 "items": {
2021-07-20T02:26:51.3528972Z [cluster2]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-20T02:26:51.3530265Z [cluster2]                                                     "properties": {
2021-07-20T02:26:51.3530812Z [cluster2]                                                         "running": {
2021-07-20T02:26:51.3531511Z [cluster2]                                                             "description": "Details about a running container",
2021-07-20T02:26:51.3532235Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.3532810Z [cluster2]                                                                 "startedAt": {
2021-07-20T02:26:51.3533893Z [cluster2]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-20T02:26:51.3534857Z [cluster2]                                                                     "format": "date-time",
2021-07-20T02:26:51.3535462Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3536004Z [cluster2]                                                                 }
2021-07-20T02:26:51.3536479Z [cluster2]                                                             },
2021-07-20T02:26:51.3537012Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.3537524Z [cluster2]                                                         },
2021-07-20T02:26:51.3538048Z [cluster2]                                                         "terminated": {
2021-07-20T02:26:51.3538781Z [cluster2]                                                             "description": "Details about a terminated container",
2021-07-20T02:26:51.3539520Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.3540128Z [cluster2]                                                                 "containerID": {
2021-07-20T02:26:51.3541201Z [cluster2]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-20T02:26:51.3542015Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3542664Z [cluster2]                                                                 },
2021-07-20T02:26:51.3543203Z [cluster2]                                                                 "exitCode": {
2021-07-20T02:26:51.3544252Z [cluster2]                                                                     "description": "Exit status from the last termination of the container",
2021-07-20T02:26:51.3545209Z [cluster2]                                                                     "format": "int32",
2021-07-20T02:26:51.3545803Z [cluster2]                                                                     "type": "integer"
2021-07-20T02:26:51.3546334Z [cluster2]                                                                 },
2021-07-20T02:26:51.3546971Z [cluster2]                                                                 "finishedAt": {
2021-07-20T02:26:51.3547739Z [cluster2]                                                                     "description": "Time at which the container last terminated",
2021-07-20T02:26:51.3548988Z [cluster2]                                                                     "format": "date-time",
2021-07-20T02:26:51.3549759Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3550293Z [cluster2]                                                                 },
2021-07-20T02:26:51.3550815Z [cluster2]                                                                 "message": {
2021-07-20T02:26:51.3551618Z [cluster2]                                                                     "description": "Message regarding the last termination of the container",
2021-07-20T02:26:51.3552424Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3552961Z [cluster2]                                                                 },
2021-07-20T02:26:51.3553462Z [cluster2]                                                                 "reason": {
2021-07-20T02:26:51.3554238Z [cluster2]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-20T02:26:51.3555130Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3555675Z [cluster2]                                                                 },
2021-07-20T02:26:51.3556122Z [cluster2]                                                                 "signal": {
2021-07-20T02:26:51.3556768Z [cluster2]                                                                     "description": "Signal from the last termination of the container",
2021-07-20T02:26:51.3557444Z [cluster2]                                                                     "format": "int32",
2021-07-20T02:26:51.3557947Z [cluster2]                                                                     "type": "integer"
2021-07-20T02:26:51.3558423Z [cluster2]                                                                 },
2021-07-20T02:26:51.3558893Z [cluster2]                                                                 "startedAt": {
2021-07-20T02:26:51.3559593Z [cluster2]                                                                     "description": "Time at which previous execution of the container started",
2021-07-20T02:26:51.3560544Z [cluster2]                                                                     "format": "date-time",
2021-07-20T02:26:51.3561063Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3561730Z [cluster2]                                                                 }
2021-07-20T02:26:51.3562217Z [cluster2]                                                             },
2021-07-20T02:26:51.3562725Z [cluster2]                                                             "required": [
2021-07-20T02:26:51.3563292Z [cluster2]                                                                 "exitCode"
2021-07-20T02:26:51.3563804Z [cluster2]                                                             ],
2021-07-20T02:26:51.3564334Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.3564848Z [cluster2]                                                         },
2021-07-20T02:26:51.3565356Z [cluster2]                                                         "waiting": {
2021-07-20T02:26:51.3566052Z [cluster2]                                                             "description": "Details about a waiting container",
2021-07-20T02:26:51.3566764Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.3567393Z [cluster2]                                                                 "message": {
2021-07-20T02:26:51.3568173Z [cluster2]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-20T02:26:51.3568964Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3569483Z [cluster2]                                                                 },
2021-07-20T02:26:51.3569997Z [cluster2]                                                                 "reason": {
2021-07-20T02:26:51.3570907Z [cluster2]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-20T02:26:51.3571696Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3572273Z [cluster2]                                                                 }
2021-07-20T02:26:51.3572876Z [cluster2]                                                             },
2021-07-20T02:26:51.3573722Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.3574411Z [cluster2]                                                         }
2021-07-20T02:26:51.3575222Z [cluster2]                                                     },
2021-07-20T02:26:51.3575940Z [cluster2]                                                     "type": "object"
2021-07-20T02:26:51.3576717Z [cluster2]                                                 },
2021-07-20T02:26:51.3577408Z [cluster2]                                                 "type": "array"
2021-07-20T02:26:51.3578082Z [cluster2]                                             },
2021-07-20T02:26:51.3578622Z [cluster2]                                             "status": {
2021-07-20T02:26:51.3579802Z [cluster2]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-20T02:26:51.3580723Z [cluster2]                                                 "properties": {
2021-07-20T02:26:51.3581378Z [cluster2]                                                     "collisionCount": {
2021-07-20T02:26:51.3583027Z [cluster2]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-20T02:26:51.3584450Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3585067Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3585617Z [cluster2]                                                     },
2021-07-20T02:26:51.3586182Z [cluster2]                                                     "conditions": {
2021-07-20T02:26:51.3587497Z [cluster2]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-20T02:26:51.3588428Z [cluster2]                                                         "items": {
2021-07-20T02:26:51.3589371Z [cluster2]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-20T02:26:51.3590367Z [cluster2]                                                             "properties": {
2021-07-20T02:26:51.3591095Z [cluster2]                                                                 "lastTransitionTime": {
2021-07-20T02:26:51.3592060Z [cluster2]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-20T02:26:51.3593205Z [cluster2]                                                                     "format": "date-time",
2021-07-20T02:26:51.3593940Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3594521Z [cluster2]                                                                 },
2021-07-20T02:26:51.3595086Z [cluster2]                                                                 "message": {
2021-07-20T02:26:51.3595978Z [cluster2]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-20T02:26:51.3597023Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3597546Z [cluster2]                                                                 },
2021-07-20T02:26:51.3598067Z [cluster2]                                                                 "reason": {
2021-07-20T02:26:51.3599151Z [cluster2]                                                                     "description": "The reason for the condition's last transition.",
2021-07-20T02:26:51.3599810Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3600276Z [cluster2]                                                                 },
2021-07-20T02:26:51.3600711Z [cluster2]                                                                 "status": {
2021-07-20T02:26:51.3601373Z [cluster2]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-20T02:26:51.3602117Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3602568Z [cluster2]                                                                 },
2021-07-20T02:26:51.3603010Z [cluster2]                                                                 "type": {
2021-07-20T02:26:51.3604050Z [cluster2]                                                                     "description": "Type of DaemonSet condition.",
2021-07-20T02:26:51.3605182Z [cluster2]                                                                     "type": "string"
2021-07-20T02:26:51.3605745Z [cluster2]                                                                 }
2021-07-20T02:26:51.3606264Z [cluster2]                                                             },
2021-07-20T02:26:51.3606834Z [cluster2]                                                             "required": [
2021-07-20T02:26:51.3607409Z [cluster2]                                                                 "status",
2021-07-20T02:26:51.3607986Z [cluster2]                                                                 "type"
2021-07-20T02:26:51.3608512Z [cluster2]                                                             ],
2021-07-20T02:26:51.3619695Z [cluster2]                                                             "type": "object"
2021-07-20T02:26:51.3620466Z [cluster2]                                                         },
2021-07-20T02:26:51.3621008Z [cluster2]                                                         "type": "array"
2021-07-20T02:26:51.3621526Z [cluster2]                                                     },
2021-07-20T02:26:51.3622173Z [cluster2]                                                     "currentNumberScheduled": {
2021-07-20T02:26:51.3623730Z [cluster2]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.3625001Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3625793Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3626368Z [cluster2]                                                     },
2021-07-20T02:26:51.3627218Z [cluster2]                                                     "desiredNumberScheduled": {
2021-07-20T02:26:51.3628862Z [cluster2]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.3630190Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3630778Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3631309Z [cluster2]                                                     },
2021-07-20T02:26:51.3631871Z [cluster2]                                                     "numberAvailable": {
2021-07-20T02:26:51.3633087Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-20T02:26:51.3634226Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3634802Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3635337Z [cluster2]                                                     },
2021-07-20T02:26:51.3635921Z [cluster2]                                                     "numberMisscheduled": {
2021-07-20T02:26:51.3637274Z [cluster2]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.3638615Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3639198Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3639725Z [cluster2]                                                     },
2021-07-20T02:26:51.3640441Z [cluster2]                                                     "numberReady": {
2021-07-20T02:26:51.3641164Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-20T02:26:51.3641858Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3642302Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3642709Z [cluster2]                                                     },
2021-07-20T02:26:51.3643144Z [cluster2]                                                     "numberUnavailable": {
2021-07-20T02:26:51.3644059Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-20T02:26:51.3644904Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3645339Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3645739Z [cluster2]                                                     },
2021-07-20T02:26:51.3646184Z [cluster2]                                                     "observedGeneration": {
2021-07-20T02:26:51.3646881Z [cluster2]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-20T02:26:51.3647493Z [cluster2]                                                         "format": "int64",
2021-07-20T02:26:51.3647928Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3648313Z [cluster2]                                                     },
2021-07-20T02:26:51.3648849Z [cluster2]                                                     "updatedNumberScheduled": {
2021-07-20T02:26:51.3649618Z [cluster2]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-20T02:26:51.3650211Z [cluster2]                                                         "format": "int32",
2021-07-20T02:26:51.3650631Z [cluster2]                                                         "type": "integer"
2021-07-20T02:26:51.3651039Z [cluster2]                                                     }
2021-07-20T02:26:51.3651381Z [cluster2]                                                 },
2021-07-20T02:26:51.3651765Z [cluster2]                                                 "required": [
2021-07-20T02:26:51.3652279Z [cluster2]                                                     "currentNumberScheduled",
2021-07-20T02:26:51.3652914Z [cluster2]                                                     "desiredNumberScheduled",
2021-07-20T02:26:51.3653507Z [cluster2]                                                     "numberMisscheduled",
2021-07-20T02:26:51.3653996Z [cluster2]                                                     "numberReady"
2021-07-20T02:26:51.3654404Z [cluster2]                                                 ],
2021-07-20T02:26:51.3654781Z [cluster2]                                                 "type": "object"
2021-07-20T02:26:51.3655166Z [cluster2]                                             }
2021-07-20T02:26:51.3655539Z [cluster2]                                         },
2021-07-20T02:26:51.3655915Z [cluster2]                                         "required": [
2021-07-20T02:26:51.3656445Z [cluster2]                                             "mismatchedContainerImages"
2021-07-20T02:26:51.3656961Z [cluster2]                                         ],
2021-07-20T02:26:51.3657346Z [cluster2]                                         "type": "object"
2021-07-20T02:26:51.3657712Z [cluster2]                                     },
2021-07-20T02:26:51.3658106Z [cluster2]                                     "serviceCIDR": {
2021-07-20T02:26:51.3658516Z [cluster2]                                         "type": "string"
2021-07-20T02:26:51.3658890Z [cluster2]                                     }
2021-07-20T02:26:51.3659211Z [cluster2]                                 },
2021-07-20T02:26:51.3659581Z [cluster2]                                 "required": [
2021-07-20T02:26:51.3659972Z [cluster2]                                     "clusterID",
2021-07-20T02:26:51.3660393Z [cluster2]                                     "natEnabled"
2021-07-20T02:26:51.3660769Z [cluster2]                                 ],
2021-07-20T02:26:51.3661128Z [cluster2]                                 "type": "object"
2021-07-20T02:26:51.3661699Z [cluster2]                             }
2021-07-20T02:26:51.3662061Z [cluster2]                         },
2021-07-20T02:26:51.3662672Z [cluster2]                         "type": "object"
2021-07-20T02:26:51.3663075Z [cluster2]                     }
2021-07-20T02:26:51.3663439Z [cluster2]                 },
2021-07-20T02:26:51.3663829Z [cluster2]                 "served": true,
2021-07-20T02:26:51.3664275Z [cluster2]                 "storage": true,
2021-07-20T02:26:51.3664727Z [cluster2]                 "subresources": {
2021-07-20T02:26:51.3665171Z [cluster2]                     "status": {}
2021-07-20T02:26:51.3665770Z [cluster2]                 }
2021-07-20T02:26:51.3666163Z [cluster2]             }
2021-07-20T02:26:51.3666566Z [cluster2]         ]
2021-07-20T02:26:51.3666943Z [cluster2]     },
2021-07-20T02:26:51.3667363Z [cluster2]     "status": {
2021-07-20T02:26:51.3667854Z [cluster2]         "acceptedNames": {
2021-07-20T02:26:51.3668415Z [cluster2]             "kind": "Submariner",
2021-07-20T02:26:51.3669030Z [cluster2]             "listKind": "SubmarinerList",
2021-07-20T02:26:51.3669844Z [cluster2]             "plural": "submariners",
2021-07-20T02:26:51.3670539Z [cluster2]             "singular": "submariner"
2021-07-20T02:26:51.3671068Z [cluster2]         },
2021-07-20T02:26:51.3671554Z [cluster2]         "conditions": [
2021-07-20T02:26:51.3672021Z [cluster2]             {
2021-07-20T02:26:51.3673018Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:25:35Z",
2021-07-20T02:26:51.3673738Z [cluster2]                 "message": "no conflicts found",
2021-07-20T02:26:51.3674385Z [cluster2]                 "reason": "NoConflicts",
2021-07-20T02:26:51.3674954Z [cluster2]                 "status": "True",
2021-07-20T02:26:51.3675571Z [cluster2]                 "type": "NamesAccepted"
2021-07-20T02:26:51.3676106Z [cluster2]             },
2021-07-20T02:26:51.3676537Z [cluster2]             {
2021-07-20T02:26:51.3677331Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:25:35Z",
2021-07-20T02:26:51.3678144Z [cluster2]                 "message": "the initial names have been accepted",
2021-07-20T02:26:51.3679078Z [cluster2]                 "reason": "InitialNamesAccepted",
2021-07-20T02:26:51.3679709Z [cluster2]                 "status": "True",
2021-07-20T02:26:51.3680251Z [cluster2]                 "type": "Established"
2021-07-20T02:26:51.3680727Z [cluster2]             }
2021-07-20T02:26:51.3681124Z [cluster2]         ],
2021-07-20T02:26:51.3681599Z [cluster2]         "storedVersions": [
2021-07-20T02:26:51.3682124Z [cluster2]             "v1alpha1"
2021-07-20T02:26:51.3682542Z [cluster2]         ]
2021-07-20T02:26:51.3682924Z [cluster2]     }
2021-07-20T02:26:51.3683369Z [cluster2] }
2021-07-20T02:26:51.3684480Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io[0m
2021-07-20T02:26:51.3686056Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io[0m
2021-07-20T02:26:51.3687828Z [36m[submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster2.json[0m
2021-07-20T02:26:51.3689534Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced[0m
2021-07-20T02:26:51.3690576Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced[0m
2021-07-20T02:26:51.5191874Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/submarind": "Cluster",
2021-07-20T02:26:51.5192773Z [cluster1]             "listKind": "ClusterList",
2021-07-20T02:26:51.5193402Z [cluster1]             "plural": "clusters",
2021-07-20T02:26:51.5193978Z [cluster1]             "singular": "cluster"
2021-07-20T02:26:51.5194425Z [cluster1]         },
2021-07-20T02:26:51.5194916Z [cluster1]         "conditions": [
2021-07-20T02:26:51.5195414Z [cluster1]             {
2021-07-20T02:26:51.5196322Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:33Z",
2021-07-20T02:26:51.5196938Z [cluster1]                 "message": "no conflicts found",
2021-07-20T02:26:51.5197397Z [cluster1]                 "reason": "NoConflicts",
2021-07-20T02:26:51.5197904Z [cluster1]                 "status": "True",
2021-07-20T02:26:51.5198654Z [cluster1]                 "type": "NamesAccepted"
2021-07-20T02:26:51.5199189Z [cluster1]             },
2021-07-20T02:26:51.5199571Z [cluster1]             {
2021-07-20T02:26:51.5200375Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:33Z",
2021-07-20T02:26:51.5201149Z [cluster1]                 "message": "the initial names have been accepted",
2021-07-20T02:26:51.5201932Z [cluster1]                 "reason": "InitialNamesAccepted",
2021-07-20T02:26:51.5202606Z [cluster1]                 "status": "True",
2021-07-20T02:26:51.5203173Z [cluster1]                 "type": "Established"
2021-07-20T02:26:51.5203610Z [cluster1]             }
2021-07-20T02:26:51.5204049Z [cluster1]         ],
2021-07-20T02:26:51.5204579Z [cluster1]         "storedVersions": [
2021-07-20T02:26:51.5205009Z [cluster1]             "v1"
2021-07-20T02:26:51.5205470Z [cluster1]         ]
2021-07-20T02:26:51.5205813Z [cluster1]     }
2021-07-20T02:26:51.5206241Z [cluster1] }
2021-07-20T02:26:51.5207556Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io[0m
2021-07-20T02:26:51.5214737Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io[0m
2021-07-20T02:26:51.5216161Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster1.json[0m
2021-07-20T02:26:51.5217325Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced[0m
2021-07-20T02:26:51.5218250Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced[0m
2021-07-20T02:26:51.5219686Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster1.json[0m
2021-07-20T02:26:51.5221464Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io[0m
2021-07-20T02:26:51.5222917Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io[0m
2021-07-20T02:26:51.5225187Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster1.json[0m
2021-07-20T02:26:51.5304070Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster[0m
2021-07-20T02:26:51.5305443Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster[0m
2021-07-20T02:26:51.5307178Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster1.json[0m
2021-07-20T02:26:51.5309006Z [36m[submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster[0m
2021-07-20T02:26:51.5311024Z [36m[submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster[0m
2021-07-20T02:26:51.5313009Z [36m[submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster1.json[0m
2021-07-20T02:26:51.5314770Z [36m[submariner-operator]$ [cluster1] verify_subm_crd[0m
2021-07-20T02:26:51.5315834Z [36m[submariner-operator]$ [cluster1] verify_subm_crd[0m
2021-07-20T02:26:51.5317118Z [36m[submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner[0m
2021-07-20T02:26:51.5318673Z [36m[submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner[0m
2021-07-20T02:26:51.5320147Z [36m[submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io[0m
2021-07-20T02:26:51.5321529Z [36m[submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io[0m
2021-07-20T02:26:51.5323334Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io[0m
2021-07-20T02:26:51.5324388Z [cluster1] NAME                        CREATED AT
2021-07-20T02:26:51.5325333Z [cluster1] submariners.submariner.io   2021-07-20T02:25:23Z
2021-07-20T02:26:51.5327025Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/submariners.submariner.io.cluster1.json[0m
2021-07-20T02:26:51.5328794Z [36m[submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json[0m
2021-07-20T02:26:51.5330564Z [36m[submariner-operator]$ [cluster1] tee /tmp/submariners.submariner.io.cluster1.json[0m
2021-07-20T02:26:51.5332297Z [36m[submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json[0m
2021-07-20T02:26:51.5334209Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd submariners.submariner.io -o json[0m
2021-07-20T02:26:51.5335220Z [cluster1] {
2021-07-20T02:26:51.5335755Z [cluster1]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-20T02:26:51.5336488Z [cluster1]     "kind": "CustomResourceDefinition",
2021-07-20T02:26:51.5337050Z [cluster1]     "metadata": {
2021-07-20T02:26:51.5337484Z [cluster1]         "annotations": {
2021-07-20T02:26:51.5338306Z [cluster1]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-20T02:26:51.5338936Z [cluster1]         },
2021-07-20T02:26:51.5339562Z [cluster1]         "creationTimestamp": "2021-07-20T02:25:23Z",
2021-07-20T02:26:51.5340096Z [cluster1]         "generation": 1,
2021-07-20T02:26:51.5340769Z [cluster1]         "name": "submariners.submariner.io",
2021-07-20T02:26:51.5341649Z [cluster1]         "resourceVersion": "1606",
2021-07-20T02:26:51.5369280Z [cluster1]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/submariners.submariner.io",
2021-07-20T02:26:51.5370616Z [cluster1]         "uid": "34dbe6b7-2da8-4245-81e1-c234405943ba"
2021-07-20T02:26:51.5371077Z [cluster1]     },
2021-07-20T02:26:51.5371382Z [cluster1]     "spec": {
2021-07-20T02:26:51.5371758Z [cluster1]         "conversion": {
2021-07-20T02:26:51.5372139Z [cluster1]             "strategy": "None"
2021-07-20T02:26:51.5372489Z [cluster1]         },
2021-07-20T02:26:51.5372857Z [cluster1]         "group": "submariner.io",
2021-07-20T02:26:51.5373252Z [cluster1]         "names": {
2021-07-20T02:26:51.5373616Z [cluster1]             "kind": "Submariner",
2021-07-20T02:26:51.5374076Z [cluster1]             "listKind": "SubmarinerList",
2021-07-20T02:26:51.5374543Z [cluster1]             "plural": "submariners",
2021-07-20T02:26:51.5374992Z [cluster1]             "singular": "submariner"
2021-07-20T02:26:51.5375364Z [cluster1]         },
2021-07-20T02:26:51.5375718Z [cluster1]         "scope": "Namespaced",
2021-07-20T02:26:51.5376117Z [cluster1]         "versions": [
2021-07-20T02:26:51.5376439Z [cluster1]             {
2021-07-20T02:26:51.5376793Z [cluster1]                 "name": "v1alpha1",
2021-07-20T02:26:51.5377155Z [cluster1]                 "schema": {
2021-07-20T02:26:51.5377578Z [cluster1]                     "openAPIV3Schema": {
2021-07-20T02:26:51.5378300Z [cluster1]                         "description": "Submariner is the Schema for the submariners API",
2021-07-20T02:26:51.5379052Z [cluster1]                         "properties": {
2021-07-20T02:26:51.5379535Z [cluster1]                             "apiVersion": {
2021-07-20T02:26:51.5381525Z [cluster1]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-20T02:26:51.5383353Z [cluster1]                                 "type": "string"
2021-07-20T02:26:51.5383769Z [cluster1]                             },
2021-07-20T02:26:51.5384173Z [cluster1]                             "kind": {
2021-07-20T02:26:51.5386081Z [cluster1]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-20T02:26:51.5388019Z [cluster1]                                 "type": "string"
2021-07-20T02:26:51.5388512Z [cluster1]                             },
2021-07-20T02:26:51.5388994Z [cluster1]                             "metadata": {
2021-07-20T02:26:51.5389507Z [cluster1]                                 "type": "object"
2021-07-20T02:26:51.5390094Z [cluster1]                             },
2021-07-20T02:26:51.5390475Z [cluster1]                             "spec": {
2021-07-20T02:26:51.5391152Z [cluster1]                                 "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-20T02:26:51.5391846Z [cluster1]                                 "properties": {
2021-07-20T02:26:51.5392321Z [cluster1]                                     "broker": {
2021-07-20T02:26:51.5392781Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5393203Z [cluster1]                                     },
2021-07-20T02:26:51.5393724Z [cluster1]                                     "brokerK8sApiServer": {
2021-07-20T02:26:51.5394263Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5394789Z [cluster1]                                     },
2021-07-20T02:26:51.5395342Z [cluster1]                                     "brokerK8sApiServerToken": {
2021-07-20T02:26:51.5395951Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5396383Z [cluster1]                                     },
2021-07-20T02:26:51.5396813Z [cluster1]                                     "brokerK8sCA": {
2021-07-20T02:26:51.5455256Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5455911Z [cluster1]                                     },
2021-07-20T02:26:51.5456579Z [cluster1]                                     "brokerK8sRemoteNamespace": {
2021-07-20T02:26:51.5457325Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5458017Z [cluster1]                                     },
2021-07-20T02:26:51.5458552Z [cluster1]                                     "cableDriver": {
2021-07-20T02:26:51.5459163Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5459695Z [cluster1]                                     },
2021-07-20T02:26:51.5460250Z [cluster1]                                     "ceIPSecDebug": {
2021-07-20T02:26:51.5460875Z [cluster1]                                         "type": "boolean"
2021-07-20T02:26:51.5461446Z [cluster1]                                     },
2021-07-20T02:26:51.5462239Z [cluster1]                                     "ceIPSecForceUDPEncaps": {
2021-07-20T02:26:51.5463210Z [cluster1]                                         "type": "boolean"
2021-07-20T02:26:51.5463750Z [cluster1]                                     },
2021-07-20T02:26:51.5464321Z [cluster1]                                     "ceIPSecIKEPort": {
2021-07-20T02:26:51.5465430Z [cluster1]                                         "type": "integer"
2021-07-20T02:26:51.5465967Z [cluster1]                                     },
2021-07-20T02:26:51.5466544Z [cluster1]                                     "ceIPSecNATTPort": {
2021-07-20T02:26:51.5467203Z [cluster1]                                         "type": "integer"
2021-07-20T02:26:51.5467729Z [cluster1]                                     },
2021-07-20T02:26:51.5468281Z [cluster1]                                     "ceIPSecPSK": {
2021-07-20T02:26:51.5468863Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5469396Z [cluster1]                                     },
2021-07-20T02:26:51.5470088Z [cluster1]                                     "ceIPSecPreferredServer": {
2021-07-20T02:26:51.5470940Z [cluster1]                                         "type": "boolean"
2021-07-20T02:26:51.5471480Z [cluster1]                                     },
2021-07-20T02:26:51.5472013Z [cluster1]                                     "clusterCIDR": {
2021-07-20T02:26:51.5472613Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5473129Z [cluster1]                                     },
2021-07-20T02:26:51.5473664Z [cluster1]                                     "clusterID": {
2021-07-20T02:26:51.5474253Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5474764Z [cluster1]                                     },
2021-07-20T02:26:51.5475307Z [cluster1]                                     "colorCodes": {
2021-07-20T02:26:51.5475884Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5476410Z [cluster1]                                     },
2021-07-20T02:26:51.5477063Z [cluster1]                                     "connectionHealthCheck": {
2021-07-20T02:26:51.5477802Z [cluster1]                                         "properties": {
2021-07-20T02:26:51.5478387Z [cluster1]                                             "enabled": {
2021-07-20T02:26:51.5478980Z [cluster1]                                                 "type": "boolean"
2021-07-20T02:26:51.5479535Z [cluster1]                                             },
2021-07-20T02:26:51.5480292Z [cluster1]                                             "intervalSeconds": {
2021-07-20T02:26:51.5481099Z [cluster1]                                                 "description": "The interval at which health check pings are sent.",
2021-07-20T02:26:51.5481826Z [cluster1]                                                 "format": "int64",
2021-07-20T02:26:51.5482390Z [cluster1]                                                 "type": "integer"
2021-07-20T02:26:51.5482965Z [cluster1]                                             },
2021-07-20T02:26:51.5483488Z [cluster1]                                             "maxPacketLossCount": {
2021-07-20T02:26:51.5484350Z [cluster1]                                                 "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-20T02:26:51.5485115Z [cluster1]                                                 "format": "int64",
2021-07-20T02:26:51.5485614Z [cluster1]                                                 "type": "integer"
2021-07-20T02:26:51.5486055Z [cluster1]                                             }
2021-07-20T02:26:51.5486453Z [cluster1]                                         },
2021-07-20T02:26:51.5486893Z [cluster1]                                         "type": "object"
2021-07-20T02:26:51.5487311Z [cluster1]                                     },
2021-07-20T02:26:51.5488044Z [cluster1]                                     "coreDNSCustomConfig": {
2021-07-20T02:26:51.5488759Z [cluster1]                                         "properties": {
2021-07-20T02:26:51.5489353Z [cluster1]                                             "configMapName": {
2021-07-20T02:26:51.5489930Z [cluster1]                                                 "type": "string"
2021-07-20T02:26:51.5490430Z [cluster1]                                             },
2021-07-20T02:26:51.5490924Z [cluster1]                                             "namespace": {
2021-07-20T02:26:51.5491485Z [cluster1]                                                 "type": "string"
2021-07-20T02:26:51.5491994Z [cluster1]                                             }
2021-07-20T02:26:51.5492430Z [cluster1]                                         },
2021-07-20T02:26:51.5492931Z [cluster1]                                         "type": "object"
2021-07-20T02:26:51.5493410Z [cluster1]                                     },
2021-07-20T02:26:51.5493936Z [cluster1]                                     "customDomains": {
2021-07-20T02:26:51.5494478Z [cluster1]                                         "items": {
2021-07-20T02:26:51.5494996Z [cluster1]                                             "type": "string"
2021-07-20T02:26:51.5495490Z [cluster1]                                         },
2021-07-20T02:26:51.5495970Z [cluster1]                                         "type": "array",
2021-07-20T02:26:51.5497003Z [cluster1]                                         "x-kubernetes-list-type": "set"
2021-07-20T02:26:51.5497628Z [cluster1]                                     },
2021-07-20T02:26:51.5498094Z [cluster1]                                     "debug": {
2021-07-20T02:26:51.5498610Z [cluster1]                                         "type": "boolean"
2021-07-20T02:26:51.5499312Z [cluster1]                                     },
2021-07-20T02:26:51.5499837Z [cluster1]                                     "globalCIDR": {
2021-07-20T02:26:51.5500694Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5501232Z [cluster1]                                     },
2021-07-20T02:26:51.5501793Z [cluster1]                                     "imageOverrides": {
2021-07-20T02:26:51.5532487Z [cluster1]                                         "additionalProperties": {
2021-07-20T02:26:51.5533266Z [cluster1]                                             "type": "string"
2021-07-20T02:26:51.5533822Z [cluster1]                                         },
2021-07-20T02:26:51.5534516Z [cluster1]                                         "type": "object"
2021-07-20T02:26:51.5535057Z [cluster1]                                     },
2021-07-20T02:26:51.5535681Z [cluster1]                                     "loadBalancerEnabled": {
2021-07-20T02:26:51.5536384Z [cluster1]                                         "type": "boolean"
2021-07-20T02:26:51.5537017Z [cluster1]                                     },
2021-07-20T02:26:51.5537591Z [cluster1]                                     "namespace": {
2021-07-20T02:26:51.5538137Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5538625Z [cluster1]                                     },
2021-07-20T02:26:51.5539127Z [cluster1]                                     "natEnabled": {
2021-07-20T02:26:51.5539674Z [cluster1]                                         "type": "boolean"
2021-07-20T02:26:51.5540175Z [cluster1]                                     },
2021-07-20T02:26:51.5540675Z [cluster1]                                     "repository": {
2021-07-20T02:26:51.5541218Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5541716Z [cluster1]                                     },
2021-07-20T02:26:51.5542210Z [cluster1]                                     "serviceCIDR": {
2021-07-20T02:26:51.5542963Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5543467Z [cluster1]                                     },
2021-07-20T02:26:51.5544114Z [cluster1]                                     "serviceDiscoveryEnabled": {
2021-07-20T02:26:51.5544894Z [cluster1]                                         "type": "boolean"
2021-07-20T02:26:51.5545401Z [cluster1]                                     },
2021-07-20T02:26:51.5545883Z [cluster1]                                     "version": {
2021-07-20T02:26:51.5546396Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5546892Z [cluster1]                                     }
2021-07-20T02:26:51.5547321Z [cluster1]                                 },
2021-07-20T02:26:51.5547807Z [cluster1]                                 "required": [
2021-07-20T02:26:51.5548306Z [cluster1]                                     "broker",
2021-07-20T02:26:51.5548916Z [cluster1]                                     "brokerK8sApiServer",
2021-07-20T02:26:51.5549674Z [cluster1]                                     "brokerK8sApiServerToken",
2021-07-20T02:26:51.5550372Z [cluster1]                                     "brokerK8sCA",
2021-07-20T02:26:51.5551087Z [cluster1]                                     "brokerK8sRemoteNamespace",
2021-07-20T02:26:51.5551992Z [cluster1]                                     "ceIPSecDebug",
2021-07-20T02:26:51.5552710Z [cluster1]                                     "ceIPSecPSK",
2021-07-20T02:26:51.5553259Z [cluster1]                                     "clusterCIDR",
2021-07-20T02:26:51.5553807Z [cluster1]                                     "clusterID",
2021-07-20T02:26:51.5554308Z [cluster1]                                     "debug",
2021-07-20T02:26:51.5554826Z [cluster1]                                     "namespace",
2021-07-20T02:26:51.5555363Z [cluster1]                                     "natEnabled",
2021-07-20T02:26:51.5555928Z [cluster1]                                     "serviceCIDR"
2021-07-20T02:26:51.5556425Z [cluster1]                                 ],
2021-07-20T02:26:51.5556897Z [cluster1]                                 "type": "object"
2021-07-20T02:26:51.5557375Z [cluster1]                             },
2021-07-20T02:26:51.5557822Z [cluster1]                             "status": {
2021-07-20T02:26:51.5558616Z [cluster1]                                 "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-20T02:26:51.5559437Z [cluster1]                                 "properties": {
2021-07-20T02:26:51.5560000Z [cluster1]                                     "clusterCIDR": {
2021-07-20T02:26:51.5560555Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5561095Z [cluster1]                                     },
2021-07-20T02:26:51.5561598Z [cluster1]                                     "clusterID": {
2021-07-20T02:26:51.5562123Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5562613Z [cluster1]                                     },
2021-07-20T02:26:51.5563107Z [cluster1]                                     "colorCodes": {
2021-07-20T02:26:51.5563655Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.5564137Z [cluster1]                                     },
2021-07-20T02:26:51.5564676Z [cluster1]                                     "deploymentInfo": {
2021-07-20T02:26:51.5565275Z [cluster1]                                         "properties": {
2021-07-20T02:26:51.5565855Z [cluster1]                                             "cloudProvider": {
2021-07-20T02:26:51.5566449Z [cluster1]                                                 "type": "string"
2021-07-20T02:26:51.5566946Z [cluster1]                                             },
2021-07-20T02:26:51.5567503Z [cluster1]                                             "kubernetesType": {
2021-07-20T02:26:51.5568091Z [cluster1]                                                 "type": "string"
2021-07-20T02:26:51.5568598Z [cluster1]                                             },
2021-07-20T02:26:51.5569213Z [cluster1]                                             "kubernetesTypeVersion": {
2021-07-20T02:26:51.5569951Z [cluster1]                                                 "type": "string"
2021-07-20T02:26:51.5570454Z [cluster1]                                             },
2021-07-20T02:26:51.5571016Z [cluster1]                                             "kubernetesVersion": {
2021-07-20T02:26:51.5571642Z [cluster1]                                                 "type": "string"
2021-07-20T02:26:51.5572125Z [cluster1]                                             }
2021-07-20T02:26:51.5572584Z [cluster1]                                         },
2021-07-20T02:26:51.5573069Z [cluster1]                                         "type": "object"
2021-07-20T02:26:51.5573565Z [cluster1]                                     },
2021-07-20T02:26:51.5574194Z [cluster1]                                     "gatewayDaemonSetStatus": {
2021-07-20T02:26:51.5574879Z [cluster1]                                         "properties": {
2021-07-20T02:26:51.5575544Z [cluster1]                                             "lastResourceVersion": {
2021-07-20T02:26:51.5576187Z [cluster1]                                                 "type": "string"
2021-07-20T02:26:51.5576697Z [cluster1]                                             },
2021-07-20T02:26:51.5577358Z [cluster1]                                             "mismatchedContainerImages": {
2021-07-20T02:26:51.5578105Z [cluster1]                                                 "type": "boolean"
2021-07-20T02:26:51.5578616Z [cluster1]                                             },
2021-07-20T02:26:51.5579259Z [cluster1]                                             "nonReadyContainerStates": {
2021-07-20T02:26:51.5579943Z [cluster1]                                                 "items": {
2021-07-20T02:26:51.5581172Z [cluster1]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-20T02:26:51.5662725Z [cluster1]                                                     "properties": {
2021-07-20T02:26:51.5663310Z [cluster1]                                                         "running": {
2021-07-20T02:26:51.5663923Z [cluster1]                                                             "description": "Details about a running container",
2021-07-20T02:26:51.5664567Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.5665409Z [cluster1]                                                                 "startedAt": {
2021-07-20T02:26:51.5666599Z [cluster1]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-20T02:26:51.5667594Z [cluster1]                                                                     "format": "date-time",
2021-07-20T02:26:51.5668198Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5668752Z [cluster1]                                                                 }
2021-07-20T02:26:51.5669230Z [cluster1]                                                             },
2021-07-20T02:26:51.5669771Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.5670301Z [cluster1]                                                         },
2021-07-20T02:26:51.5670824Z [cluster1]                                                         "terminated": {
2021-07-20T02:26:51.5671609Z [cluster1]                                                             "description": "Details about a terminated container",
2021-07-20T02:26:51.5672506Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.5673118Z [cluster1]                                                                 "containerID": {
2021-07-20T02:26:51.5674217Z [cluster1]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-20T02:26:51.5675106Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5675728Z [cluster1]                                                                 },
2021-07-20T02:26:51.5676187Z [cluster1]                                                                 "exitCode": {
2021-07-20T02:26:51.5676887Z [cluster1]                                                                     "description": "Exit status from the last termination of the container",
2021-07-20T02:26:51.5677576Z [cluster1]                                                                     "format": "int32",
2021-07-20T02:26:51.5678084Z [cluster1]                                                                     "type": "integer"
2021-07-20T02:26:51.5678562Z [cluster1]                                                                 },
2021-07-20T02:26:51.5679038Z [cluster1]                                                                 "finishedAt": {
2021-07-20T02:26:51.5679700Z [cluster1]                                                                     "description": "Time at which the container last terminated",
2021-07-20T02:26:51.5680801Z [cluster1]                                                                     "format": "date-time",
2021-07-20T02:26:51.5681394Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5681933Z [cluster1]                                                                 },
2021-07-20T02:26:51.5682446Z [cluster1]                                                                 "message": {
2021-07-20T02:26:51.5683254Z [cluster1]                                                                     "description": "Message regarding the last termination of the container",
2021-07-20T02:26:51.5684065Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5684586Z [cluster1]                                                                 },
2021-07-20T02:26:51.5685098Z [cluster1]                                                                 "reason": {
2021-07-20T02:26:51.5685863Z [cluster1]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-20T02:26:51.5686714Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5687255Z [cluster1]                                                                 },
2021-07-20T02:26:51.5687752Z [cluster1]                                                                 "signal": {
2021-07-20T02:26:51.5688508Z [cluster1]                                                                     "description": "Signal from the last termination of the container",
2021-07-20T02:26:51.5689260Z [cluster1]                                                                     "format": "int32",
2021-07-20T02:26:51.5689854Z [cluster1]                                                                     "type": "integer"
2021-07-20T02:26:51.5690391Z [cluster1]                                                                 },
2021-07-20T02:26:51.5690913Z [cluster1]                                                                 "startedAt": {
2021-07-20T02:26:51.5691734Z [cluster1]                                                                     "description": "Time at which previous execution of the container started",
2021-07-20T02:26:51.5692771Z [cluster1]                                                                     "format": "date-time",
2021-07-20T02:26:51.5693381Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5693901Z [cluster1]                                                                 }
2021-07-20T02:26:51.5694389Z [cluster1]                                                             },
2021-07-20T02:26:51.5694973Z [cluster1]                                                             "required": [
2021-07-20T02:26:51.5695533Z [cluster1]                                                                 "exitCode"
2021-07-20T02:26:51.5696060Z [cluster1]                                                             ],
2021-07-20T02:26:51.5696570Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.5697097Z [cluster1]                                                         },
2021-07-20T02:26:51.5697594Z [cluster1]                                                         "waiting": {
2021-07-20T02:26:51.5698289Z [cluster1]                                                             "description": "Details about a waiting container",
2021-07-20T02:26:51.5699013Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.5699581Z [cluster1]                                                                 "message": {
2021-07-20T02:26:51.5700373Z [cluster1]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-20T02:26:51.5701148Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5701685Z [cluster1]                                                                 },
2021-07-20T02:26:51.5702204Z [cluster1]                                                                 "reason": {
2021-07-20T02:26:51.5703089Z [cluster1]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-20T02:26:51.5703942Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5704616Z [cluster1]                                                                 }
2021-07-20T02:26:51.5705104Z [cluster1]                                                             },
2021-07-20T02:26:51.5705647Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.5706160Z [cluster1]                                                         }
2021-07-20T02:26:51.5706634Z [cluster1]                                                     },
2021-07-20T02:26:51.5707143Z [cluster1]                                                     "type": "object"
2021-07-20T02:26:51.5707728Z [cluster1]                                                 },
2021-07-20T02:26:51.5708224Z [cluster1]                                                 "type": "array"
2021-07-20T02:26:51.5708728Z [cluster1]                                             },
2021-07-20T02:26:51.5709197Z [cluster1]                                             "status": {
2021-07-20T02:26:51.5710015Z [cluster1]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-20T02:26:51.5710874Z [cluster1]                                                 "properties": {
2021-07-20T02:26:51.5711473Z [cluster1]                                                     "collisionCount": {
2021-07-20T02:26:51.5712833Z [cluster1]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-20T02:26:51.5714144Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.5714710Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.5715249Z [cluster1]                                                     },
2021-07-20T02:26:51.5715756Z [cluster1]                                                     "conditions": {
2021-07-20T02:26:51.5758216Z [cluster1]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-20T02:26:51.5759361Z [cluster1]                                                         "items": {
2021-07-20T02:26:51.5760252Z [cluster1]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-20T02:26:51.5761191Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.5761850Z [cluster1]                                                                 "lastTransitionTime": {
2021-07-20T02:26:51.5762956Z [cluster1]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-20T02:26:51.5764381Z [cluster1]                                                                     "format": "date-time",
2021-07-20T02:26:51.5765034Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5765617Z [cluster1]                                                                 },
2021-07-20T02:26:51.5766175Z [cluster1]                                                                 "message": {
2021-07-20T02:26:51.5767088Z [cluster1]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-20T02:26:51.5768008Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5768571Z [cluster1]                                                                 },
2021-07-20T02:26:51.5769128Z [cluster1]                                                                 "reason": {
2021-07-20T02:26:51.5770286Z [cluster1]                                                                     "description": "The reason for the condition's last transition.",
2021-07-20T02:26:51.5771123Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5771706Z [cluster1]                                                                 },
2021-07-20T02:26:51.5772249Z [cluster1]                                                                 "status": {
2021-07-20T02:26:51.5773065Z [cluster1]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-20T02:26:51.5773998Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5774588Z [cluster1]                                                                 },
2021-07-20T02:26:51.5775128Z [cluster1]                                                                 "type": {
2021-07-20T02:26:51.5775881Z [cluster1]                                                                     "description": "Type of DaemonSet condition.",
2021-07-20T02:26:51.5776659Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.5777219Z [cluster1]                                                                 }
2021-07-20T02:26:51.5777743Z [cluster1]                                                             },
2021-07-20T02:26:51.5778297Z [cluster1]                                                             "required": [
2021-07-20T02:26:51.5779010Z [cluster1]                                                                 "status",
2021-07-20T02:26:51.5779541Z [cluster1]                                                                 "type"
2021-07-20T02:26:51.5780033Z [cluster1]                                                             ],
2021-07-20T02:26:51.5780564Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.5781077Z [cluster1]                                                         },
2021-07-20T02:26:51.5781594Z [cluster1]                                                         "type": "array"
2021-07-20T02:26:51.5782151Z [cluster1]                                                     },
2021-07-20T02:26:51.5783331Z [cluster1]                                                     "currentNumberScheduled": {
2021-07-20T02:26:51.5784773Z [cluster1]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.5786044Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.5786632Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.5787168Z [cluster1]                                                     },
2021-07-20T02:26:51.5787812Z [cluster1]                                                     "desiredNumberScheduled": {
2021-07-20T02:26:51.5789310Z [cluster1]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.5790659Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.5791229Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.5791819Z [cluster1]                                                     },
2021-07-20T02:26:51.5792425Z [cluster1]                                                     "numberAvailable": {
2021-07-20T02:26:51.5793878Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-20T02:26:51.5837199Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.5837836Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.5838421Z [cluster1]                                                     },
2021-07-20T02:26:51.5839061Z [cluster1]                                                     "numberMisscheduled": {
2021-07-20T02:26:51.5840701Z [cluster1]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.5842085Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.5842776Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.5843339Z [cluster1]                                                     },
2021-07-20T02:26:51.5843872Z [cluster1]                                                     "numberReady": {
2021-07-20T02:26:51.5844830Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-20T02:26:51.5845846Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.5846337Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.5846978Z [cluster1]                                                     },
2021-07-20T02:26:51.5847552Z [cluster1]                                                     "numberUnavailable": {
2021-07-20T02:26:51.5848758Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-20T02:26:51.5849973Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.5850535Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.5851064Z [cluster1]                                                     },
2021-07-20T02:26:51.5851651Z [cluster1]                                                     "observedGeneration": {
2021-07-20T02:26:51.5852579Z [cluster1]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-20T02:26:51.5853390Z [cluster1]                                                         "format": "int64",
2021-07-20T02:26:51.5853970Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.5854501Z [cluster1]                                                     },
2021-07-20T02:26:51.5855146Z [cluster1]                                                     "updatedNumberScheduled": {
2021-07-20T02:26:51.5856076Z [cluster1]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-20T02:26:51.5856835Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.5857508Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.5858044Z [cluster1]                                                     }
2021-07-20T02:26:51.5858497Z [cluster1]                                                 },
2021-07-20T02:26:51.5859006Z [cluster1]                                                 "required": [
2021-07-20T02:26:51.5859685Z [cluster1]                                                     "currentNumberScheduled",
2021-07-20T02:26:51.5860516Z [cluster1]                                                     "desiredNumberScheduled",
2021-07-20T02:26:51.5861293Z [cluster1]                                                     "numberMisscheduled",
2021-07-20T02:26:51.5861955Z [cluster1]                                                     "numberReady"
2021-07-20T02:26:51.5862571Z [cluster1]                                                 ],
2021-07-20T02:26:51.5863072Z [cluster1]                                                 "type": "object"
2021-07-20T02:26:51.5863587Z [cluster1]                                             }
2021-07-20T02:26:51.5864090Z [cluster1]                                         },
2021-07-20T02:26:51.5864597Z [cluster1]                                         "required": [
2021-07-20T02:26:51.5865304Z [cluster1]                                             "mismatchedContainerImages"
2021-07-20T02:26:51.5865984Z [cluster1]                                         ],
2021-07-20T02:26:51.5866473Z [cluster1]                                         "type": "object"
2021-07-20T02:26:51.5866969Z [cluster1]                                     },
2021-07-20T02:26:51.5867459Z [cluster1]                                     "gateways": {
2021-07-20T02:26:51.5867958Z [cluster1]                                         "items": {
2021-07-20T02:26:51.5868500Z [cluster1]                                             "properties": {
2021-07-20T02:26:51.5869067Z [cluster1]                                                 "connections": {
2021-07-20T02:26:51.5869610Z [cluster1]                                                     "items": {
2021-07-20T02:26:51.5870148Z [cluster1]                                                         "properties": {
2021-07-20T02:26:51.5870728Z [cluster1]                                                             "endpoint": {
2021-07-20T02:26:51.5871312Z [cluster1]                                                                 "properties": {
2021-07-20T02:26:51.5871880Z [cluster1]                                                                     "backend": {
2021-07-20T02:26:51.5872456Z [cluster1]                                                                         "type": "string"
2021-07-20T02:26:51.5873052Z [cluster1]                                                                     },
2021-07-20T02:26:51.5873604Z [cluster1]                                                                     "backend_config": {
2021-07-20T02:26:51.5874300Z [cluster1]                                                                         "additionalProperties": {
2021-07-20T02:26:51.5875013Z [cluster1]                                                                             "type": "string"
2021-07-20T02:26:51.5875561Z [cluster1]                                                                         },
2021-07-20T02:26:51.5876095Z [cluster1]                                                                         "type": "object"
2021-07-20T02:26:51.5876632Z [cluster1]                                                                     },
2021-07-20T02:26:51.5877149Z [cluster1]                                                                     "cable_name": {
2021-07-20T02:26:51.5877736Z [cluster1]                                                                         "type": "string"
2021-07-20T02:26:51.5878277Z [cluster1]                                                                     },
2021-07-20T02:26:51.5878796Z [cluster1]                                                                     "cluster_id": {
2021-07-20T02:26:51.5879378Z [cluster1]                                                                         "type": "string"
2021-07-20T02:26:51.5880088Z [cluster1]                                                                     },
2021-07-20T02:26:51.5880673Z [cluster1]                                                                     "healthCheckIP": {
2021-07-20T02:26:51.5881287Z [cluster1]                                                                         "type": "string"
2021-07-20T02:26:51.5881827Z [cluster1]                                                                     },
2021-07-20T02:26:51.5882371Z [cluster1]                                                                     "hostname": {
2021-07-20T02:26:51.5920055Z [cluster1]                                                                         "type": "string"
2021-07-20T02:26:51.5920664Z [cluster1]                                                                     },
2021-07-20T02:26:51.5921235Z [cluster1]                                                                     "nat_enabled": {
2021-07-20T02:26:51.5922036Z [cluster1]                                                                         "type": "boolean"
2021-07-20T02:26:51.5922639Z [cluster1]                                                                     },
2021-07-20T02:26:51.5923212Z [cluster1]                                                                     "private_ip": {
2021-07-20T02:26:51.5923848Z [cluster1]                                                                         "type": "string"
2021-07-20T02:26:51.5924423Z [cluster1]                                                                     },
2021-07-20T02:26:51.5925003Z [cluster1]                                                                     "public_ip": {
2021-07-20T02:26:51.5925732Z [cluster1]                                                                         "type": "string"
2021-07-20T02:26:51.5926324Z [cluster1]                                                                     },
2021-07-20T02:26:51.5926901Z [cluster1]                                                                     "subnets": {
2021-07-20T02:26:51.5927474Z [cluster1]                                                                         "items": {
2021-07-20T02:26:51.5928087Z [cluster1]                                                                             "type": "string"
2021-07-20T02:26:51.5928661Z [cluster1]                                                                         },
2021-07-20T02:26:51.5929239Z [cluster1]                                                                         "type": "array"
2021-07-20T02:26:51.5929973Z [cluster1]                                                                     }
2021-07-20T02:26:51.5930510Z [cluster1]                                                                 },
2021-07-20T02:26:51.5931086Z [cluster1]                                                                 "required": [
2021-07-20T02:26:51.5931676Z [cluster1]                                                                     "backend",
2021-07-20T02:26:51.5932283Z [cluster1]                                                                     "cable_name",
2021-07-20T02:26:51.5932888Z [cluster1]                                                                     "cluster_id",
2021-07-20T02:26:51.5933499Z [cluster1]                                                                     "hostname",
2021-07-20T02:26:51.5934119Z [cluster1]                                                                     "nat_enabled",
2021-07-20T02:26:51.5934725Z [cluster1]                                                                     "private_ip",
2021-07-20T02:26:51.5935348Z [cluster1]                                                                     "public_ip",
2021-07-20T02:26:51.5935940Z [cluster1]                                                                     "subnets"
2021-07-20T02:26:51.5936501Z [cluster1]                                                                 ],
2021-07-20T02:26:51.5937065Z [cluster1]                                                                 "type": "object"
2021-07-20T02:26:51.5937634Z [cluster1]                                                             },
2021-07-20T02:26:51.5938214Z [cluster1]                                                             "latencyRTT": {
2021-07-20T02:26:51.5939308Z [cluster1]                                                                 "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-20T02:26:51.5940402Z [cluster1]                                                                 "properties": {
2021-07-20T02:26:51.5941019Z [cluster1]                                                                     "average": {
2021-07-20T02:26:51.5941639Z [cluster1]                                                                         "type": "string"
2021-07-20T02:26:51.5942218Z [cluster1]                                                                     },
2021-07-20T02:26:51.5942942Z [cluster1]                                                                     "last": {
2021-07-20T02:26:51.5943581Z [cluster1]                                                                         "type": "string"
2021-07-20T02:26:51.5944150Z [cluster1]                                                                     },
2021-07-20T02:26:51.5944798Z [cluster1]                                                                     "max": {
2021-07-20T02:26:51.5945652Z [cluster1]                                                                         "type": "string"
2021-07-20T02:26:51.5946201Z [cluster1]                                                                     },
2021-07-20T02:26:51.5946888Z [cluster1]                                                                     "min": {
2021-07-20T02:26:51.5947571Z [cluster1]                                                                         "type": "string"
2021-07-20T02:26:51.5948299Z [cluster1]                                                                     },
2021-07-20T02:26:51.5948853Z [cluster1]                                                                     "stdDev": {
2021-07-20T02:26:51.5949472Z [cluster1]                                                                         "type": "string"
2021-07-20T02:26:51.5950057Z [cluster1]                                                                     }
2021-07-20T02:26:51.5950571Z [cluster1]                                                                 },
2021-07-20T02:26:51.5951143Z [cluster1]                                                                 "type": "object"
2021-07-20T02:26:51.5951763Z [cluster1]                                                             },
2021-07-20T02:26:51.5952310Z [cluster1]                                                             "status": {
2021-07-20T02:26:51.5952892Z [cluster1]                                                                 "type": "string"
2021-07-20T02:26:51.5953459Z [cluster1]                                                             },
2021-07-20T02:26:51.5954063Z [cluster1]                                                             "statusMessage": {
2021-07-20T02:26:51.5954709Z [cluster1]                                                                 "type": "string"
2021-07-20T02:26:51.5955362Z [cluster1]                                                             },
2021-07-20T02:26:51.5955870Z [cluster1]                                                             "usingIP": {
2021-07-20T02:26:51.5956433Z [cluster1]                                                                 "type": "string"
2021-07-20T02:26:51.5956950Z [cluster1]                                                             },
2021-07-20T02:26:51.5957476Z [cluster1]                                                             "usingNAT": {
2021-07-20T02:26:51.5958054Z [cluster1]                                                                 "type": "boolean"
2021-07-20T02:26:51.5958577Z [cluster1]                                                             }
2021-07-20T02:26:51.5959059Z [cluster1]                                                         },
2021-07-20T02:26:51.5959567Z [cluster1]                                                         "required": [
2021-07-20T02:26:51.5960132Z [cluster1]                                                             "endpoint",
2021-07-20T02:26:51.5960668Z [cluster1]                                                             "status",
2021-07-20T02:26:51.5961252Z [cluster1]                                                             "statusMessage"
2021-07-20T02:26:51.5961817Z [cluster1]                                                         ],
2021-07-20T02:26:51.5962328Z [cluster1]                                                         "type": "object"
2021-07-20T02:26:51.5962846Z [cluster1]                                                     },
2021-07-20T02:26:51.5963344Z [cluster1]                                                     "type": "array"
2021-07-20T02:26:51.5963847Z [cluster1]                                                 },
2021-07-20T02:26:51.5964451Z [cluster1]                                                 "haStatus": {
2021-07-20T02:26:51.5965013Z [cluster1]                                                     "type": "string"
2021-07-20T02:26:51.5965532Z [cluster1]                                                 },
2021-07-20T02:26:51.5966063Z [cluster1]                                                 "localEndpoint": {
2021-07-20T02:26:51.5966671Z [cluster1]                                                     "properties": {
2021-07-20T02:26:51.5967232Z [cluster1]                                                         "backend": {
2021-07-20T02:26:51.5967793Z [cluster1]                                                             "type": "string"
2021-07-20T02:26:51.5968303Z [cluster1]                                                         },
2021-07-20T02:26:51.5968840Z [cluster1]                                                         "backend_config": {
2021-07-20T02:26:51.5969539Z [cluster1]                                                             "additionalProperties": {
2021-07-20T02:26:51.5970206Z [cluster1]                                                                 "type": "string"
2021-07-20T02:26:51.5970733Z [cluster1]                                                             },
2021-07-20T02:26:51.5971250Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.5971772Z [cluster1]                                                         },
2021-07-20T02:26:51.5972323Z [cluster1]                                                         "cable_name": {
2021-07-20T02:26:51.5972881Z [cluster1]                                                             "type": "string"
2021-07-20T02:26:51.5973398Z [cluster1]                                                         },
2021-07-20T02:26:51.5973898Z [cluster1]                                                         "cluster_id": {
2021-07-20T02:26:51.5974456Z [cluster1]                                                             "type": "string"
2021-07-20T02:26:51.5974963Z [cluster1]                                                         },
2021-07-20T02:26:51.5975787Z [cluster1]                                                         "healthCheckIP": {
2021-07-20T02:26:51.5976377Z [cluster1]                                                             "type": "string"
2021-07-20T02:26:51.5976898Z [cluster1]                                                         },
2021-07-20T02:26:51.5977412Z [cluster1]                                                         "hostname": {
2021-07-20T02:26:51.5977959Z [cluster1]                                                             "type": "string"
2021-07-20T02:26:51.5978480Z [cluster1]                                                         },
2021-07-20T02:26:51.5978985Z [cluster1]                                                         "nat_enabled": {
2021-07-20T02:26:51.5979555Z [cluster1]                                                             "type": "boolean"
2021-07-20T02:26:51.5980072Z [cluster1]                                                         },
2021-07-20T02:26:51.5980591Z [cluster1]                                                         "private_ip": {
2021-07-20T02:26:51.5981156Z [cluster1]                                                             "type": "string"
2021-07-20T02:26:51.5981662Z [cluster1]                                                         },
2021-07-20T02:26:51.5982168Z [cluster1]                                                         "public_ip": {
2021-07-20T02:26:51.5983439Z [cluster1]                                                             "type": "string"
2021-07-20T02:26:51.5984237Z [cluster1]                                                         },
2021-07-20T02:26:51.5985531Z [cluster1]                                                         "subnets": {
2021-07-20T02:26:51.5986075Z [cluster1]                                                             "items": {
2021-07-20T02:26:51.5986734Z [cluster1]                                                                 "type": "string"
2021-07-20T02:26:51.5987254Z [cluster1]                                                             },
2021-07-20T02:26:51.5987784Z [cluster1]                                                             "type": "array"
2021-07-20T02:26:51.5988475Z [cluster1]                                                         }
2021-07-20T02:26:51.5988984Z [cluster1]                                                     },
2021-07-20T02:26:51.5989526Z [cluster1]                                                     "required": [
2021-07-20T02:26:51.5990122Z [cluster1]                                                         "backend",
2021-07-20T02:26:51.5990710Z [cluster1]                                                         "cable_name",
2021-07-20T02:26:51.5991399Z [cluster1]                                                         "cluster_id",
2021-07-20T02:26:51.5991948Z [cluster1]                                                         "hostname",
2021-07-20T02:26:51.5992495Z [cluster1]                                                         "nat_enabled",
2021-07-20T02:26:51.5993274Z [cluster1]                                                         "private_ip",
2021-07-20T02:26:51.5993998Z [cluster1]                                                         "public_ip",
2021-07-20T02:26:51.5994624Z [cluster1]                                                         "subnets"
2021-07-20T02:26:51.5995129Z [cluster1]                                                     ],
2021-07-20T02:26:51.5995714Z [cluster1]                                                     "type": "object"
2021-07-20T02:26:51.5996228Z [cluster1]                                                 },
2021-07-20T02:26:51.5996755Z [cluster1]                                                 "statusFailure": {
2021-07-20T02:26:51.5997342Z [cluster1]                                                     "type": "string"
2021-07-20T02:26:51.5997833Z [cluster1]                                                 },
2021-07-20T02:26:51.5998331Z [cluster1]                                                 "version": {
2021-07-20T02:26:51.5998882Z [cluster1]                                                     "type": "string"
2021-07-20T02:26:51.5999381Z [cluster1]                                                 }
2021-07-20T02:26:51.5999842Z [cluster1]                                             },
2021-07-20T02:26:51.6000331Z [cluster1]                                             "required": [
2021-07-20T02:26:51.6000902Z [cluster1]                                                 "connections",
2021-07-20T02:26:51.6001444Z [cluster1]                                                 "haStatus",
2021-07-20T02:26:51.6002021Z [cluster1]                                                 "localEndpoint",
2021-07-20T02:26:51.6002627Z [cluster1]                                                 "statusFailure",
2021-07-20T02:26:51.6003200Z [cluster1]                                                 "version"
2021-07-20T02:26:51.6003694Z [cluster1]                                             ],
2021-07-20T02:26:51.6004188Z [cluster1]                                             "type": "object"
2021-07-20T02:26:51.6004687Z [cluster1]                                         },
2021-07-20T02:26:51.6005166Z [cluster1]                                         "type": "array"
2021-07-20T02:26:51.6005651Z [cluster1]                                     },
2021-07-20T02:26:51.6006142Z [cluster1]                                     "globalCIDR": {
2021-07-20T02:26:51.6006791Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.6007221Z [cluster1]                                     },
2021-07-20T02:26:51.6007789Z [cluster1]                                     "globalnetDaemonSetStatus": {
2021-07-20T02:26:51.6008422Z [cluster1]                                         "properties": {
2021-07-20T02:26:51.6008984Z [cluster1]                                             "lastResourceVersion": {
2021-07-20T02:26:51.6009596Z [cluster1]                                                 "type": "string"
2021-07-20T02:26:51.6010035Z [cluster1]                                             },
2021-07-20T02:26:51.6010631Z [cluster1]                                             "mismatchedContainerImages": {
2021-07-20T02:26:51.6011262Z [cluster1]                                                 "type": "boolean"
2021-07-20T02:26:51.6011713Z [cluster1]                                             },
2021-07-20T02:26:51.6012287Z [cluster1]                                             "nonReadyContainerStates": {
2021-07-20T02:26:51.6012870Z [cluster1]                                                 "items": {
2021-07-20T02:26:51.6013958Z [cluster1]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-20T02:26:51.6015404Z [cluster1]                                                     "properties": {
2021-07-20T02:26:51.6015909Z [cluster1]                                                         "running": {
2021-07-20T02:26:51.6016523Z [cluster1]                                                             "description": "Details about a running container",
2021-07-20T02:26:51.6017150Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.6017666Z [cluster1]                                                                 "startedAt": {
2021-07-20T02:26:51.6018796Z [cluster1]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-20T02:26:51.6019665Z [cluster1]                                                                     "format": "date-time",
2021-07-20T02:26:51.6020206Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6020668Z [cluster1]                                                                 }
2021-07-20T02:26:51.6021096Z [cluster1]                                                             },
2021-07-20T02:26:51.6021843Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.6022324Z [cluster1]                                                         },
2021-07-20T02:26:51.6025347Z [cluster1]                                                         "terminated": {
2021-07-20T02:26:51.6026154Z [cluster1]                                                             "description": "Details about a terminated container",
2021-07-20T02:26:51.6026943Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.6028263Z [cluster1]                                                                 "containerID": {
2021-07-20T02:26:51.6030002Z [cluster1]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-20T02:26:51.6030848Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6031440Z [cluster1]                                                                 },
2021-07-20T02:26:51.6032284Z [cluster1]                                                                 "exitCode": {
2021-07-20T02:26:51.6033433Z [cluster1]                                                                     "description": "Exit status from the last termination of the container",
2021-07-20T02:26:51.6034575Z [cluster1]                                                                     "format": "int32",
2021-07-20T02:26:51.6035370Z [cluster1]                                                                     "type": "integer"
2021-07-20T02:26:51.6036109Z [cluster1]                                                                 },
2021-07-20T02:26:51.6037000Z [cluster1]                                                                 "finishedAt": {
2021-07-20T02:26:51.6037997Z [cluster1]                                                                     "description": "Time at which the container last terminated",
2021-07-20T02:26:51.6039427Z [cluster1]                                                                     "format": "date-time",
2021-07-20T02:26:51.6040226Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6040963Z [cluster1]                                                                 },
2021-07-20T02:26:51.6041673Z [cluster1]                                                                 "message": {
2021-07-20T02:26:51.6042943Z [cluster1]                                                                     "description": "Message regarding the last termination of the container",
2021-07-20T02:26:51.6044461Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6044930Z [cluster1]                                                                 },
2021-07-20T02:26:51.6045518Z [cluster1]                                                                 "reason": {
2021-07-20T02:26:51.6049451Z [cluster1]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-20T02:26:51.6050485Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6051311Z [cluster1]                                                                 },
2021-07-20T02:26:51.6051942Z [cluster1]                                                                 "signal": {
2021-07-20T02:26:51.6053173Z [cluster1]                                                                     "description": "Signal from the last termination of the container",
2021-07-20T02:26:51.6054041Z [cluster1]                                                                     "format": "int32",
2021-07-20T02:26:51.6054853Z [cluster1]                                                                     "type": "integer"
2021-07-20T02:26:51.6055526Z [cluster1]                                                                 },
2021-07-20T02:26:51.6056183Z [cluster1]                                                                 "startedAt": {
2021-07-20T02:26:51.6057108Z [cluster1]                                                                     "description": "Time at which previous execution of the container started",
2021-07-20T02:26:51.6058294Z [cluster1]                                                                     "format": "date-time",
2021-07-20T02:26:51.6058982Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6059565Z [cluster1]                                                                 }
2021-07-20T02:26:51.6060333Z [cluster1]                                                             },
2021-07-20T02:26:51.6061018Z [cluster1]                                                             "required": [
2021-07-20T02:26:51.6061714Z [cluster1]                                                                 "exitCode"
2021-07-20T02:26:51.6062491Z [cluster1]                                                             ],
2021-07-20T02:26:51.6063168Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.6063830Z [cluster1]                                                         },
2021-07-20T02:26:51.6064359Z [cluster1]                                                         "waiting": {
2021-07-20T02:26:51.6065208Z [cluster1]                                                             "description": "Details about a waiting container",
2021-07-20T02:26:51.6066211Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.6066794Z [cluster1]                                                                 "message": {
2021-07-20T02:26:51.6067987Z [cluster1]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-20T02:26:51.6068934Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6069625Z [cluster1]                                                                 },
2021-07-20T02:26:51.6070288Z [cluster1]                                                                 "reason": {
2021-07-20T02:26:51.6071156Z [cluster1]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-20T02:26:51.6072055Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6072728Z [cluster1]                                                                 }
2021-07-20T02:26:51.6073363Z [cluster1]                                                             },
2021-07-20T02:26:51.6074029Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.6074556Z [cluster1]                                                         }
2021-07-20T02:26:51.6075477Z [cluster1]                                                     },
2021-07-20T02:26:51.6076036Z [cluster1]                                                     "type": "object"
2021-07-20T02:26:51.6076738Z [cluster1]                                                 },
2021-07-20T02:26:51.6077515Z [cluster1]                                                 "type": "array"
2021-07-20T02:26:51.6078223Z [cluster1]                                             },
2021-07-20T02:26:51.6078881Z [cluster1]                                             "status": {
2021-07-20T02:26:51.6079915Z [cluster1]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-20T02:26:51.6081143Z [cluster1]                                                 "properties": {
2021-07-20T02:26:51.6081951Z [cluster1]                                                     "collisionCount": {
2021-07-20T02:26:51.6083693Z [cluster1]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-20T02:26:51.6085369Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6086141Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6086954Z [cluster1]                                                     },
2021-07-20T02:26:51.6087607Z [cluster1]                                                     "conditions": {
2021-07-20T02:26:51.6089334Z [cluster1]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-20T02:26:51.6090416Z [cluster1]                                                         "items": {
2021-07-20T02:26:51.6091879Z [cluster1]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-20T02:26:51.6092890Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.6093927Z [cluster1]                                                                 "lastTransitionTime": {
2021-07-20T02:26:51.6094907Z [cluster1]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-20T02:26:51.6096087Z [cluster1]                                                                     "format": "date-time",
2021-07-20T02:26:51.6096851Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6097614Z [cluster1]                                                                 },
2021-07-20T02:26:51.6098386Z [cluster1]                                                                 "message": {
2021-07-20T02:26:51.6099657Z [cluster1]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-20T02:26:51.6100497Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6101171Z [cluster1]                                                                 },
2021-07-20T02:26:51.6102034Z [cluster1]                                                                 "reason": {
2021-07-20T02:26:51.6103478Z [cluster1]                                                                     "description": "The reason for the condition's last transition.",
2021-07-20T02:26:51.6104791Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6105518Z [cluster1]                                                                 },
2021-07-20T02:26:51.6106224Z [cluster1]                                                                 "status": {
2021-07-20T02:26:51.6107037Z [cluster1]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-20T02:26:51.6108094Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6108637Z [cluster1]                                                                 },
2021-07-20T02:26:51.6109130Z [cluster1]                                                                 "type": {
2021-07-20T02:26:51.6109824Z [cluster1]                                                                     "description": "Type of DaemonSet condition.",
2021-07-20T02:26:51.6110527Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6111061Z [cluster1]                                                                 }
2021-07-20T02:26:51.6111546Z [cluster1]                                                             },
2021-07-20T02:26:51.6112142Z [cluster1]                                                             "required": [
2021-07-20T02:26:51.6112790Z [cluster1]                                                                 "status",
2021-07-20T02:26:51.6113245Z [cluster1]                                                                 "type"
2021-07-20T02:26:51.6113691Z [cluster1]                                                             ],
2021-07-20T02:26:51.6114348Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.6114887Z [cluster1]                                                         },
2021-07-20T02:26:51.6115469Z [cluster1]                                                         "type": "array"
2021-07-20T02:26:51.6115971Z [cluster1]                                                     },
2021-07-20T02:26:51.6116626Z [cluster1]                                                     "currentNumberScheduled": {
2021-07-20T02:26:51.6118906Z [cluster1]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.6120213Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6120966Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6121525Z [cluster1]                                                     },
2021-07-20T02:26:51.6122238Z [cluster1]                                                     "desiredNumberScheduled": {
2021-07-20T02:26:51.6124505Z [cluster1]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.6126321Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6126949Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6127964Z [cluster1]                                                     },
2021-07-20T02:26:51.6129259Z [cluster1]                                                     "numberAvailable": {
2021-07-20T02:26:51.6130561Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-20T02:26:51.6132572Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6133209Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6133765Z [cluster1]                                                     },
2021-07-20T02:26:51.6134420Z [cluster1]                                                     "numberMisscheduled": {
2021-07-20T02:26:51.6135874Z [cluster1]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.6137750Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6138377Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6138931Z [cluster1]                                                     },
2021-07-20T02:26:51.6139520Z [cluster1]                                                     "numberReady": {
2021-07-20T02:26:51.6140538Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-20T02:26:51.6141538Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6142163Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6142835Z [cluster1]                                                     },
2021-07-20T02:26:51.6143497Z [cluster1]                                                     "numberUnavailable": {
2021-07-20T02:26:51.6144997Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-20T02:26:51.6146680Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6147256Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6147774Z [cluster1]                                                     },
2021-07-20T02:26:51.6148382Z [cluster1]                                                     "observedGeneration": {
2021-07-20T02:26:51.6149280Z [cluster1]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-20T02:26:51.6150112Z [cluster1]                                                         "format": "int64",
2021-07-20T02:26:51.6150677Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6151203Z [cluster1]                                                     },
2021-07-20T02:26:51.6151942Z [cluster1]                                                     "updatedNumberScheduled": {
2021-07-20T02:26:51.6152858Z [cluster1]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-20T02:26:51.6153634Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6154191Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6155140Z [cluster1]                                                     }
2021-07-20T02:26:51.6155605Z [cluster1]                                                 },
2021-07-20T02:26:51.6156118Z [cluster1]                                                 "required": [
2021-07-20T02:26:51.6156811Z [cluster1]                                                     "currentNumberScheduled",
2021-07-20T02:26:51.6157635Z [cluster1]                                                     "desiredNumberScheduled",
2021-07-20T02:26:51.6158427Z [cluster1]                                                     "numberMisscheduled",
2021-07-20T02:26:51.6159076Z [cluster1]                                                     "numberReady"
2021-07-20T02:26:51.6159608Z [cluster1]                                                 ],
2021-07-20T02:26:51.6160107Z [cluster1]                                                 "type": "object"
2021-07-20T02:26:51.6160613Z [cluster1]                                             }
2021-07-20T02:26:51.6161063Z [cluster1]                                         },
2021-07-20T02:26:51.6161621Z [cluster1]                                         "required": [
2021-07-20T02:26:51.6162338Z [cluster1]                                             "mismatchedContainerImages"
2021-07-20T02:26:51.6163003Z [cluster1]                                         ],
2021-07-20T02:26:51.6163506Z [cluster1]                                         "type": "object"
2021-07-20T02:26:51.6163984Z [cluster1]                                     },
2021-07-20T02:26:51.6164582Z [cluster1]                                     "loadBalancerStatus": {
2021-07-20T02:26:51.6165211Z [cluster1]                                         "properties": {
2021-07-20T02:26:51.6165749Z [cluster1]                                             "status": {
2021-07-20T02:26:51.6166968Z [cluster1]                                                 "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-20T02:26:51.6167863Z [cluster1]                                                 "properties": {
2021-07-20T02:26:51.6168416Z [cluster1]                                                     "ingress": {
2021-07-20T02:26:51.6170306Z [cluster1]                                                         "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-20T02:26:51.6171247Z [cluster1]                                                         "items": {
2021-07-20T02:26:51.6172778Z [cluster1]                                                             "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-20T02:26:51.6173978Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.6174550Z [cluster1]                                                                 "hostname": {
2021-07-20T02:26:51.6175809Z [cluster1]                                                                     "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-20T02:26:51.6176781Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6177299Z [cluster1]                                                                 },
2021-07-20T02:26:51.6177885Z [cluster1]                                                                 "ip": {
2021-07-20T02:26:51.6179155Z [cluster1]                                                                     "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-20T02:26:51.6180147Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6180675Z [cluster1]                                                                 }
2021-07-20T02:26:51.6181152Z [cluster1]                                                             },
2021-07-20T02:26:51.6181685Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.6183207Z [cluster1]                                                         },
2021-07-20T02:26:51.6183736Z [cluster1]                                                         "type": "array"
2021-07-20T02:26:51.6184249Z [cluster1]                                                     }
2021-07-20T02:26:51.6184707Z [cluster1]                                                 },
2021-07-20T02:26:51.6185218Z [cluster1]                                                 "type": "object"
2021-07-20T02:26:51.6185709Z [cluster1]                                             }
2021-07-20T02:26:51.6186163Z [cluster1]                                         },
2021-07-20T02:26:51.6186650Z [cluster1]                                         "type": "object"
2021-07-20T02:26:51.6187143Z [cluster1]                                     },
2021-07-20T02:26:51.6187735Z [cluster1]                                     "natEnabled": {
2021-07-20T02:26:51.6188291Z [cluster1]                                         "type": "boolean"
2021-07-20T02:26:51.6188788Z [cluster1]                                     },
2021-07-20T02:26:51.6189301Z [cluster1]                                     "networkPlugin": {
2021-07-20T02:26:51.6189875Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.6190356Z [cluster1]                                     },
2021-07-20T02:26:51.6191027Z [cluster1]                                     "routeAgentDaemonSetStatus": {
2021-07-20T02:26:51.6191754Z [cluster1]                                         "properties": {
2021-07-20T02:26:51.6192408Z [cluster1]                                             "lastResourceVersion": {
2021-07-20T02:26:51.6193055Z [cluster1]                                                 "type": "string"
2021-07-20T02:26:51.6193553Z [cluster1]                                             },
2021-07-20T02:26:51.6194233Z [cluster1]                                             "mismatchedContainerImages": {
2021-07-20T02:26:51.6194956Z [cluster1]                                                 "type": "boolean"
2021-07-20T02:26:51.6195464Z [cluster1]                                             },
2021-07-20T02:26:51.6196342Z [cluster1]                                             "nonReadyContainerStates": {
2021-07-20T02:26:51.6197197Z [cluster1]                                                 "items": {
2021-07-20T02:26:51.6198663Z [cluster1]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-20T02:26:51.6200039Z [cluster1]                                                     "properties": {
2021-07-20T02:26:51.6200641Z [cluster1]                                                         "running": {
2021-07-20T02:26:51.6201387Z [cluster1]                                                             "description": "Details about a running container",
2021-07-20T02:26:51.6202170Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.6202805Z [cluster1]                                                                 "startedAt": {
2021-07-20T02:26:51.6204132Z [cluster1]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-20T02:26:51.6205134Z [cluster1]                                                                     "format": "date-time",
2021-07-20T02:26:51.6205728Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6206259Z [cluster1]                                                                 }
2021-07-20T02:26:51.6206728Z [cluster1]                                                             },
2021-07-20T02:26:51.6207258Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.6207777Z [cluster1]                                                         },
2021-07-20T02:26:51.6208298Z [cluster1]                                                         "terminated": {
2021-07-20T02:26:51.6209037Z [cluster1]                                                             "description": "Details about a terminated container",
2021-07-20T02:26:51.6209869Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.6210401Z [cluster1]                                                                 "containerID": {
2021-07-20T02:26:51.6211350Z [cluster1]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-20T02:26:51.6212212Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6212809Z [cluster1]                                                                 },
2021-07-20T02:26:51.6213335Z [cluster1]                                                                 "exitCode": {
2021-07-20T02:26:51.6214125Z [cluster1]                                                                     "description": "Exit status from the last termination of the container",
2021-07-20T02:26:51.6214895Z [cluster1]                                                                     "format": "int32",
2021-07-20T02:26:51.6215487Z [cluster1]                                                                     "type": "integer"
2021-07-20T02:26:51.6216028Z [cluster1]                                                                 },
2021-07-20T02:26:51.6216557Z [cluster1]                                                                 "finishedAt": {
2021-07-20T02:26:51.6217320Z [cluster1]                                                                     "description": "Time at which the container last terminated",
2021-07-20T02:26:51.6218297Z [cluster1]                                                                     "format": "date-time",
2021-07-20T02:26:51.6219587Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6220295Z [cluster1]                                                                 },
2021-07-20T02:26:51.6220813Z [cluster1]                                                                 "message": {
2021-07-20T02:26:51.6221791Z [cluster1]                                                                     "description": "Message regarding the last termination of the container",
2021-07-20T02:26:51.6222778Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6223356Z [cluster1]                                                                 },
2021-07-20T02:26:51.6224651Z [cluster1]                                                                 "reason": {
2021-07-20T02:26:51.6225502Z [cluster1]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-20T02:26:51.6226450Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6226967Z [cluster1]                                                                 },
2021-07-20T02:26:51.6227589Z [cluster1]                                                                 "signal": {
2021-07-20T02:26:51.6229016Z [cluster1]                                                                     "description": "Signal from the last termination of the container",
2021-07-20T02:26:51.6229789Z [cluster1]                                                                     "format": "int32",
2021-07-20T02:26:51.6230386Z [cluster1]                                                                     "type": "integer"
2021-07-20T02:26:51.6230921Z [cluster1]                                                                 },
2021-07-20T02:26:51.6231650Z [cluster1]                                                                 "startedAt": {
2021-07-20T02:26:51.6232521Z [cluster1]                                                                     "description": "Time at which previous execution of the container started",
2021-07-20T02:26:51.6233748Z [cluster1]                                                                     "format": "date-time",
2021-07-20T02:26:51.6234408Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6234995Z [cluster1]                                                                 }
2021-07-20T02:26:51.6235511Z [cluster1]                                                             },
2021-07-20T02:26:51.6236059Z [cluster1]                                                             "required": [
2021-07-20T02:26:51.6236779Z [cluster1]                                                                 "exitCode"
2021-07-20T02:26:51.6237329Z [cluster1]                                                             ],
2021-07-20T02:26:51.6237893Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.6238450Z [cluster1]                                                         },
2021-07-20T02:26:51.6238987Z [cluster1]                                                         "waiting": {
2021-07-20T02:26:51.6239746Z [cluster1]                                                             "description": "Details about a waiting container",
2021-07-20T02:26:51.6240513Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.6241137Z [cluster1]                                                                 "message": {
2021-07-20T02:26:51.6241982Z [cluster1]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-20T02:26:51.6242823Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6243432Z [cluster1]                                                                 },
2021-07-20T02:26:51.6243972Z [cluster1]                                                                 "reason": {
2021-07-20T02:26:51.6244764Z [cluster1]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-20T02:26:51.6245573Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6246127Z [cluster1]                                                                 }
2021-07-20T02:26:51.6246723Z [cluster1]                                                             },
2021-07-20T02:26:51.6247239Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.6247769Z [cluster1]                                                         }
2021-07-20T02:26:51.6248228Z [cluster1]                                                     },
2021-07-20T02:26:51.6248739Z [cluster1]                                                     "type": "object"
2021-07-20T02:26:51.6249254Z [cluster1]                                                 },
2021-07-20T02:26:51.6249746Z [cluster1]                                                 "type": "array"
2021-07-20T02:26:51.6250306Z [cluster1]                                             },
2021-07-20T02:26:51.6250782Z [cluster1]                                             "status": {
2021-07-20T02:26:51.6252385Z [cluster1]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-20T02:26:51.6253240Z [cluster1]                                                 "properties": {
2021-07-20T02:26:51.6253853Z [cluster1]                                                     "collisionCount": {
2021-07-20T02:26:51.6276896Z [cluster1]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-20T02:26:51.6278127Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6278655Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6279127Z [cluster1]                                                     },
2021-07-20T02:26:51.6279571Z [cluster1]                                                     "conditions": {
2021-07-20T02:26:51.6280719Z [cluster1]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-20T02:26:51.6281473Z [cluster1]                                                         "items": {
2021-07-20T02:26:51.6282411Z [cluster1]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-20T02:26:51.6283420Z [cluster1]                                                             "properties": {
2021-07-20T02:26:51.6284081Z [cluster1]                                                                 "lastTransitionTime": {
2021-07-20T02:26:51.6284996Z [cluster1]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-20T02:26:51.6286061Z [cluster1]                                                                     "format": "date-time",
2021-07-20T02:26:51.6286748Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6287401Z [cluster1]                                                                 },
2021-07-20T02:26:51.6287918Z [cluster1]                                                                 "message": {
2021-07-20T02:26:51.6288759Z [cluster1]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-20T02:26:51.6289589Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6290130Z [cluster1]                                                                 },
2021-07-20T02:26:51.6290639Z [cluster1]                                                                 "reason": {
2021-07-20T02:26:51.6291631Z [cluster1]                                                                     "description": "The reason for the condition's last transition.",
2021-07-20T02:26:51.6292397Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6292917Z [cluster1]                                                                 },
2021-07-20T02:26:51.6293688Z [cluster1]                                                                 "status": {
2021-07-20T02:26:51.6294499Z [cluster1]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-20T02:26:51.6295339Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6295998Z [cluster1]                                                                 },
2021-07-20T02:26:51.6296540Z [cluster1]                                                                 "type": {
2021-07-20T02:26:51.6297286Z [cluster1]                                                                     "description": "Type of DaemonSet condition.",
2021-07-20T02:26:51.6298042Z [cluster1]                                                                     "type": "string"
2021-07-20T02:26:51.6298617Z [cluster1]                                                                 }
2021-07-20T02:26:51.6299128Z [cluster1]                                                             },
2021-07-20T02:26:51.6299691Z [cluster1]                                                             "required": [
2021-07-20T02:26:51.6300279Z [cluster1]                                                                 "status",
2021-07-20T02:26:51.6300832Z [cluster1]                                                                 "type"
2021-07-20T02:26:51.6301384Z [cluster1]                                                             ],
2021-07-20T02:26:51.6301944Z [cluster1]                                                             "type": "object"
2021-07-20T02:26:51.6302657Z [cluster1]                                                         },
2021-07-20T02:26:51.6303864Z [cluster1]                                                         "type": "array"
2021-07-20T02:26:51.6304388Z [cluster1]                                                     },
2021-07-20T02:26:51.6305143Z [cluster1]                                                     "currentNumberScheduled": {
2021-07-20T02:26:51.6306744Z [cluster1]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.6308137Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6308764Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6309317Z [cluster1]                                                     },
2021-07-20T02:26:51.6310021Z [cluster1]                                                     "desiredNumberScheduled": {
2021-07-20T02:26:51.6311615Z [cluster1]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.6313077Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6313698Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6314257Z [cluster1]                                                     },
2021-07-20T02:26:51.6314976Z [cluster1]                                                     "numberAvailable": {
2021-07-20T02:26:51.6316173Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-20T02:26:51.6317329Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6317899Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6318416Z [cluster1]                                                     },
2021-07-20T02:26:51.6319020Z [cluster1]                                                     "numberMisscheduled": {
2021-07-20T02:26:51.6320412Z [cluster1]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-20T02:26:51.6321682Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6322250Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6322781Z [cluster1]                                                     },
2021-07-20T02:26:51.6323320Z [cluster1]                                                     "numberReady": {
2021-07-20T02:26:51.6324266Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-20T02:26:51.6325199Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6325763Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6326295Z [cluster1]                                                     },
2021-07-20T02:26:51.6326886Z [cluster1]                                                     "numberUnavailable": {
2021-07-20T02:26:51.6328079Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-20T02:26:51.6329210Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6329819Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6330348Z [cluster1]                                                     },
2021-07-20T02:26:51.6330948Z [cluster1]                                                     "observedGeneration": {
2021-07-20T02:26:51.6331855Z [cluster1]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-20T02:26:51.6332680Z [cluster1]                                                         "format": "int64",
2021-07-20T02:26:51.6333244Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6333768Z [cluster1]                                                     },
2021-07-20T02:26:51.6334414Z [cluster1]                                                     "updatedNumberScheduled": {
2021-07-20T02:26:51.6335462Z [cluster1]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-20T02:26:51.6336240Z [cluster1]                                                         "format": "int32",
2021-07-20T02:26:51.6337016Z [cluster1]                                                         "type": "integer"
2021-07-20T02:26:51.6337568Z [cluster1]                                                     }
2021-07-20T02:26:51.6338075Z [cluster1]                                                 },
2021-07-20T02:26:51.6338609Z [cluster1]                                                 "required": [
2021-07-20T02:26:51.6339355Z [cluster1]                                                     "currentNumberScheduled",
2021-07-20T02:26:51.6340240Z [cluster1]                                                     "desiredNumberScheduled",
2021-07-20T02:26:51.6341080Z [cluster1]                                                     "numberMisscheduled",
2021-07-20T02:26:51.6341778Z [cluster1]                                                     "numberReady"
2021-07-20T02:26:51.6342866Z [cluster1]                                                 ],
2021-07-20T02:26:51.6343448Z [cluster1]                                                 "type": "object"
2021-07-20T02:26:51.6343999Z [cluster1]                                             }
2021-07-20T02:26:51.6344487Z [cluster1]                                         },
2021-07-20T02:26:51.6345002Z [cluster1]                                         "required": [
2021-07-20T02:26:51.6345895Z [cluster1]                                             "mismatchedContainerImages"
2021-07-20T02:26:51.6346616Z [cluster1]                                         ],
2021-07-20T02:26:51.6355440Z [cluster1]                                         "type": "object"
2021-07-20T02:26:51.6355949Z [cluster1]                                     },
2021-07-20T02:26:51.6356470Z [cluster1]                                     "serviceCIDR": {
2021-07-20T02:26:51.6357038Z [cluster1]                                         "type": "string"
2021-07-20T02:26:51.6357538Z [cluster1]                                     }
2021-07-20T02:26:51.6357980Z [cluster1]                                 },
2021-07-20T02:26:51.6358446Z [cluster1]                                 "required": [
2021-07-20T02:26:51.6365552Z [cluster1]                                     "clusterID",
2021-07-20T02:26:51.6366284Z [cluster1]                                     "natEnabled"
2021-07-20T02:26:51.6366941Z [cluster1]                                 ],
2021-07-20T02:26:51.6367424Z [cluster1]                                 "type": "object"
2021-07-20T02:26:51.6367900Z [cluster1]                             }
2021-07-20T02:26:51.6368480Z [cluster1]                         },
2021-07-20T02:26:51.6369207Z [cluster1]                         "type": "object"
2021-07-20T02:26:51.6369736Z [cluster1]                     }
2021-07-20T02:26:51.6370090Z [cluster1]                 },
2021-07-20T02:26:51.6370606Z [cluster1]                 "served": true,
2021-07-20T02:26:51.6371182Z [cluster1]                 "storage": true,
2021-07-20T02:26:51.6371779Z [cluster1]                 "subresources": {
2021-07-20T02:26:51.6372318Z [cluster1]                     "status": {}
2021-07-20T02:26:51.6372716Z [cluster1]                 }
2021-07-20T02:26:51.6373058Z [cluster1]             }
2021-07-20T02:26:51.6373406Z [cluster1]         ]
2021-07-20T02:26:51.6373736Z [cluster1]     },
2021-07-20T02:26:51.6374099Z [cluster1]     "status": {
2021-07-20T02:26:51.6374544Z [cluster1]         "acceptedNames": {
2021-07-20T02:26:51.6375019Z [cluster1]             "kind": "Submariner",
2021-07-20T02:26:51.6375545Z [cluster1]             "listKind": "SubmarinerList",
2021-07-20T02:26:51.6376079Z [cluster1]             "plural": "submariners",
2021-07-20T02:26:51.6376592Z [cluster1]             "singular": "submariner"
2021-07-20T02:26:51.6377007Z [cluster1]         },
2021-07-20T02:26:51.6383526Z [cluster1]         "conditions": [
2021-07-20T02:26:51.6383995Z [cluster1]             {
2021-07-20T02:26:51.6384912Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:23Z",
2021-07-20T02:26:51.6385900Z [cluster1]                 "message": "no conflicts found",
2021-07-20T02:26:51.6386510Z [cluster1]                 "reason": "NoConflicts",
2021-07-20T02:26:51.6387058Z [cluster1]                 "status": "True",
2021-07-20T02:26:51.6387802Z [cluster1]                 "type": "NamesAccepted"
2021-07-20T02:26:51.6390124Z [cluster1]             },
2021-07-20T02:26:51.6397302Z [cluster1]             {
2021-07-20T02:26:51.6398312Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:23Z",
2021-07-20T02:26:51.6399874Z [cluster1]                 "message": "the initial names have been accepted",
2021-07-20T02:26:51.6400726Z [cluster1]                 "reason": "InitialNamesAccepted",
2021-07-20T02:26:51.6401409Z [cluster1]                 "status": "True",
2021-07-20T02:26:51.6401994Z [cluster1]                 "type": "Established"
2021-07-20T02:26:51.6402512Z [cluster1]             }
2021-07-20T02:26:51.6402942Z [cluster1]         ],
2021-07-20T02:26:51.6403470Z [cluster1]         "storedVersions": [
2021-07-20T02:26:51.6404020Z [cluster1]             "v1alpha1"
2021-07-20T02:26:51.6404482Z [cluster1]         ]
2021-07-20T02:26:51.6404885Z [cluster1]     }
2021-07-20T02:26:51.6405296Z [cluster1] }
2021-07-20T02:26:51.6406515Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io[0m
2021-07-20T02:26:51.6408374Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io[0m
2021-07-20T02:26:51.6410322Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster1.json[0m
2021-07-20T02:26:51.6412053Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced[0m
2021-07-20T02:26:51.6413359Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced[0m
2021-07-20T02:26:54.0820072Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster2.json[0m
2021-07-20T02:26:54.0821878Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io[0m
2021-07-20T02:26:54.0823478Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io[0m
2021-07-20T02:26:54.0825217Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster2.json[0m
2021-07-20T02:26:54.0827081Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner[0m
2021-07-20T02:26:54.0828466Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner[0m
2021-07-20T02:26:54.0830253Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster2.json[0m
2021-07-20T02:26:54.0831860Z [36m[submariner-operator]$ [cluster2] verify_subm_operator[0m
2021-07-20T02:26:54.0832952Z [36m[submariner-operator]$ [cluster2] verify_subm_operator[0m
2021-07-20T02:26:54.0834474Z [36m[submariner-operator]$ [cluster2] kubectl get ns submariner-operator[0m
2021-07-20T02:26:54.0835851Z [36m[submariner-operator]$ [cluster2] kubectl get ns submariner-operator[0m
2021-07-20T02:26:54.0837582Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get ns submariner-operator[0m
2021-07-20T02:26:54.0838551Z [cluster2] NAME                  STATUS   AGE
2021-07-20T02:26:54.0839383Z [cluster2] submariner-operator   Active   76s
2021-07-20T02:26:54.0840611Z [36m[submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io[0m
2021-07-20T02:26:54.0851503Z [36m[submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io[0m
2021-07-20T02:26:54.0853334Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io[0m
2021-07-20T02:26:54.0854332Z [cluster2] NAME                        CREATED AT
2021-07-20T02:26:54.0855205Z [cluster2] submariners.submariner.io   2021-07-20T02:25:35Z
2021-07-20T02:26:54.0856263Z [36m[submariner-operator]$ [cluster2] kubectl api-resources[0m
2021-07-20T02:26:54.0857324Z [36m[submariner-operator]$ [cluster2] kubectl api-resources[0m
2021-07-20T02:26:54.0858500Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources[0m
2021-07-20T02:26:54.0859641Z [36m[submariner-operator]$ [cluster2] grep submariners[0m
2021-07-20T02:26:54.0860524Z [cluster2] submariners                                    submariner.io/v1alpha1            true         Submariner
2021-07-20T02:26:54.0861918Z [36m[submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.0863848Z [36m[submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.0865617Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get sa --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.0866716Z [cluster2] NAME                  SECRETS   AGE
2021-07-20T02:26:54.0867465Z [cluster2] submariner-operator   1         78s
2021-07-20T02:26:54.0868750Z [36m[submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.0870421Z [36m[submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.0872398Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get roles --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.0873481Z [cluster2] NAME                  AGE
2021-07-20T02:26:54.0874193Z [cluster2] submariner-operator   78s
2021-07-20T02:26:54.0875535Z [36m[submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.0877300Z [36m[submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.0879197Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get rolebindings --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.0880307Z [cluster2] NAME                  AGE
2021-07-20T02:26:54.0880995Z [cluster2] submariner-operator   78s
2021-07-20T02:26:54.0882319Z [36m[submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.0884061Z [36m[submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.0885939Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get deployments --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.0887332Z [cluster2] NAME                  READY   UP-TO-DATE   AVAILABLE   AGE
2021-07-20T02:26:54.0888208Z [cluster2] submariner-operator   1/1     1            1           73s
2021-07-20T02:26:54.0889136Z [36m[submariner-operator]$ [cluster2] verify_subm_op_pod[0m
2021-07-20T02:26:54.0890189Z [36m[submariner-operator]$ [cluster2] verify_subm_op_pod[0m
2021-07-20T02:26:54.0891752Z [36m[submariner-operator]$ [cluster2] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')[0m
2021-07-20T02:26:54.2897036Z [36m[submariner-operator]$ [cluster2] kers.submariner.io.cluster1.json[0m
2021-07-20T02:26:54.2898714Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io[0m
2021-07-20T02:26:54.2899978Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io[0m
2021-07-20T02:26:54.2901676Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster1.json[0m
2021-07-20T02:26:54.2903380Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner[0m
2021-07-20T02:26:54.2904667Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner[0m
2021-07-20T02:26:54.2906333Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster1.json[0m
2021-07-20T02:26:54.2907826Z [36m[submariner-operator]$ [cluster1] verify_subm_operator[0m
2021-07-20T02:26:54.2908838Z [36m[submariner-operator]$ [cluster1] verify_subm_operator[0m
2021-07-20T02:26:54.2909948Z [36m[submariner-operator]$ [cluster1] kubectl get ns submariner-operator[0m
2021-07-20T02:26:54.2911281Z [36m[submariner-operator]$ [cluster1] kubectl get ns submariner-operator[0m
2021-07-20T02:26:54.2912660Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get ns submariner-operator[0m
2021-07-20T02:26:54.2913449Z [cluster1] NAME                  STATUS   AGE
2021-07-20T02:26:54.2914111Z [cluster1] submariner-operator   Active   89s
2021-07-20T02:26:54.2915119Z [36m[submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io[0m
2021-07-20T02:26:54.2916341Z [36m[submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io[0m
2021-07-20T02:26:54.2917670Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io[0m
2021-07-20T02:26:54.2918599Z [cluster1] NAME                        CREATED AT
2021-07-20T02:26:54.2919346Z [cluster1] submariners.submariner.io   2021-07-20T02:25:23Z
2021-07-20T02:26:54.2920258Z [36m[submariner-operator]$ [cluster1] kubectl api-resources[0m
2021-07-20T02:26:54.2921379Z [36m[submariner-operator]$ [cluster1] kubectl api-resources[0m
2021-07-20T02:26:54.2922446Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources[0m
2021-07-20T02:26:54.2923738Z [36m[submariner-operator]$ [cluster1] grep submariners[0m
2021-07-20T02:26:54.2924615Z [cluster1] submariners                                    submariner.io/v1alpha1            true         Submariner
2021-07-20T02:26:54.2926135Z [36m[submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.2927772Z [36m[submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.2929550Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get sa --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.2930630Z [cluster1] NAME                  SECRETS   AGE
2021-07-20T02:26:54.2931472Z [cluster1] submariner-operator   1         90s
2021-07-20T02:26:54.2932763Z [36m[submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.2934477Z [36m[submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.2936046Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get roles --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.2936962Z [cluster1] NAME                  AGE
2021-07-20T02:26:54.2937685Z [cluster1] submariner-operator   90s
2021-07-20T02:26:54.2938848Z [36m[submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.2940380Z [36m[submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.2943252Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get rolebindings --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.2944383Z [cluster1] NAME                  AGE
2021-07-20T02:26:54.2945132Z [cluster1] submariner-operator   89s
2021-07-20T02:26:54.2946442Z [36m[submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.2948202Z [36m[submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.2950088Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get deployments --namespace=submariner-operator submariner-operator[0m
2021-07-20T02:26:54.2951485Z [cluster1] NAME                  READY   UP-TO-DATE   AVAILABLE   AGE
2021-07-20T02:26:54.2952815Z [cluster1] submariner-operator   1/1     1            1           85s
2021-07-20T02:26:54.2953734Z [36m[submariner-operator]$ [cluster1] verify_subm_op_pod[0m
2021-07-20T02:26:54.2954708Z [36m[submariner-operator]$ [cluster1] verify_subm_op_pod[0m
2021-07-20T02:26:54.2956274Z [36m[submariner-operator]$ [cluster1] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')[0m
2021-07-20T02:26:54.8526904Z [36m[submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:26:54.8528821Z [36m[submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:26:54.8530816Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:26:54.8532770Z [36m[submariner-operator]$ [cluster2] kubectl get pod submariner-operator-56f895dd55-lh9t2 --namespace=submariner-operator -o json[0m
2021-07-20T02:26:54.8534837Z [36m[submariner-operator]$ [cluster2] kubectl get pod submariner-operator-56f895dd55-lh9t2 --namespace=submariner-operator -o json[0m
2021-07-20T02:26:54.8536850Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-56f895dd55-lh9t2 --namespace=submariner-operator -o json[0m
2021-07-20T02:26:54.8537963Z [cluster2] {
2021-07-20T02:26:54.8538369Z [cluster2]     "apiVersion": "v1",
2021-07-20T02:26:54.8538786Z [cluster2]     "kind": "Pod",
2021-07-20T02:26:54.8539195Z [cluster2]     "metadata": {
2021-07-20T02:26:54.8539852Z [cluster2]         "creationTimestamp": "2021-07-20T02:25:41Z",
2021-07-20T02:26:54.8540812Z [cluster2]         "generateName": "submariner-operator-56f895dd55-",
2021-07-20T02:26:54.8541692Z [cluster2]         "labels": {
2021-07-20T02:26:54.8542606Z [cluster2]             "name": "submariner-operator",
2021-07-20T02:26:54.8543678Z [cluster2]             "pod-template-hash": "56f895dd55"
2021-07-20T02:26:54.8544264Z [cluster2]         },
2021-07-20T02:26:54.8545275Z [cluster2]         "name": "submariner-operator-56f895dd55-lh9t2",
2021-07-20T02:26:54.8546495Z [cluster2]         "namespace": "submariner-operator",
2021-07-20T02:26:54.8547251Z [cluster2]         "ownerReferences": [
2021-07-20T02:26:54.8547780Z [cluster2]             {
2021-07-20T02:26:54.8548308Z [cluster2]                 "apiVersion": "apps/v1",
2021-07-20T02:26:54.8548998Z [cluster2]                 "blockOwnerDeletion": true,
2021-07-20T02:26:54.8549678Z [cluster2]                 "controller": true,
2021-07-20T02:26:54.8550262Z [cluster2]                 "kind": "ReplicaSet",
2021-07-20T02:26:54.8551417Z [cluster2]                 "name": "submariner-operator-56f895dd55",
2021-07-20T02:26:54.8552580Z [cluster2]                 "uid": "2370f7e5-2e98-461c-b7ec-64ddcf73f6f3"
2021-07-20T02:26:54.8553225Z [cluster2]             }
2021-07-20T02:26:54.8553656Z [cluster2]         ],
2021-07-20T02:26:54.8554186Z [cluster2]         "resourceVersion": "1761",
2021-07-20T02:26:54.8555726Z [cluster2]         "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-operator-56f895dd55-lh9t2",
2021-07-20T02:26:54.8557116Z [cluster2]         "uid": "e83b6042-3e7a-4e10-b768-9227da5af420"
2021-07-20T02:26:54.8557697Z [cluster2]     },
2021-07-20T02:26:54.8558093Z [cluster2]     "spec": {
2021-07-20T02:26:54.8558559Z [cluster2]         "containers": [
2021-07-20T02:26:54.8559060Z [cluster2]             {
2021-07-20T02:26:54.8559442Z [cluster2]                 "command": [
2021-07-20T02:26:54.8560078Z [cluster2]                     "submariner-operator",
2021-07-20T02:26:54.8560784Z [cluster2]                     "-alsologtostderr",
2021-07-20T02:26:54.8561363Z [cluster2]                     "-v=1"
2021-07-20T02:26:54.8561720Z [cluster2]                 ],
2021-07-20T02:26:54.8562093Z [cluster2]                 "env": [
2021-07-20T02:26:54.8562453Z [cluster2]                     {
2021-07-20T02:26:54.8562908Z [cluster2]                         "name": "WATCH_NAMESPACE",
2021-07-20T02:26:54.8563382Z [cluster2]                         "valueFrom": {
2021-07-20T02:26:54.8563955Z [cluster2]                             "fieldRef": {
2021-07-20T02:26:54.8564421Z [cluster2]                                 "apiVersion": "v1",
2021-07-20T02:26:54.8565019Z [cluster2]                                 "fieldPath": "metadata.namespace"
2021-07-20T02:26:54.8565761Z [cluster2]                             }
2021-07-20T02:26:54.8566187Z [cluster2]                         }
2021-07-20T02:26:54.8566606Z [cluster2]                     },
2021-07-20T02:26:54.8567003Z [cluster2]                     {
2021-07-20T02:26:54.8567481Z [cluster2]                         "name": "POD_NAME",
2021-07-20T02:26:54.8568060Z [cluster2]                         "valueFrom": {
2021-07-20T02:26:54.8568586Z [cluster2]                             "fieldRef": {
2021-07-20T02:26:54.8569113Z [cluster2]                                 "apiVersion": "v1",
2021-07-20T02:26:54.8569744Z [cluster2]                                 "fieldPath": "metadata.name"
2021-07-20T02:26:54.8570284Z [cluster2]                             }
2021-07-20T02:26:54.8570795Z [cluster2]                         }
2021-07-20T02:26:54.8571212Z [cluster2]                     },
2021-07-20T02:26:54.8571626Z [cluster2]                     {
2021-07-20T02:26:54.8572126Z [cluster2]                         "name": "OPERATOR_NAME",
2021-07-20T02:26:54.8572978Z [cluster2]                         "value": "submariner-operator"
2021-07-20T02:26:54.8573562Z [cluster2]                     }
2021-07-20T02:26:54.8573961Z [cluster2]                 ],
2021-07-20T02:26:54.8612632Z [cluster2]                 "image": "localhost:5000/submariner-operator:local",
2021-07-20T02:26:54.8613377Z [cluster2]                 "imagePullPolicy": "IfNotPresent",
2021-07-20T02:26:54.8614193Z [cluster2]                 "name": "submariner-operator",
2021-07-20T02:26:54.8614733Z [cluster2]                 "resources": {},
2021-07-20T02:26:54.8615661Z [cluster2]                 "terminationMessagePath": "/dev/termination-log",
2021-07-20T02:26:54.8616509Z [cluster2]                 "terminationMessagePolicy": "File",
2021-07-20T02:26:54.8617122Z [cluster2]                 "volumeMounts": [
2021-07-20T02:26:54.8617550Z [cluster2]                     {
2021-07-20T02:26:54.8618254Z [cluster2]                         "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-20T02:26:54.8619304Z [cluster2]                         "name": "submariner-operator-token-c6j8j",
2021-07-20T02:26:54.8620016Z [cluster2]                         "readOnly": true
2021-07-20T02:26:54.8620557Z [cluster2]                     }
2021-07-20T02:26:54.8620921Z [cluster2]                 ]
2021-07-20T02:26:54.8621265Z [cluster2]             }
2021-07-20T02:26:54.8621617Z [cluster2]         ],
2021-07-20T02:26:54.8622057Z [cluster2]         "dnsPolicy": "ClusterFirst",
2021-07-20T02:26:54.8622738Z [cluster2]         "enableServiceLinks": true,
2021-07-20T02:26:54.8623491Z [cluster2]         "nodeName": "cluster2-worker2",
2021-07-20T02:26:54.8624010Z [cluster2]         "priority": 0,
2021-07-20T02:26:54.8624498Z [cluster2]         "restartPolicy": "Always",
2021-07-20T02:26:54.8625243Z [cluster2]         "schedulerName": "default-scheduler",
2021-07-20T02:26:54.8625857Z [cluster2]         "securityContext": {},
2021-07-20T02:26:54.8626617Z [cluster2]         "serviceAccount": "submariner-operator",
2021-07-20T02:26:54.8627547Z [cluster2]         "serviceAccountName": "submariner-operator",
2021-07-20T02:26:54.8628599Z [cluster2]         "terminationGracePeriodSeconds": 30,
2021-07-20T02:26:54.8629357Z [cluster2]         "tolerations": [
2021-07-20T02:26:54.8629808Z [cluster2]             {
2021-07-20T02:26:54.8630294Z [cluster2]                 "effect": "NoExecute",
2021-07-20T02:26:54.8631117Z [cluster2]                 "key": "node.kubernetes.io/not-ready",
2021-07-20T02:26:54.8631779Z [cluster2]                 "operator": "Exists",
2021-07-20T02:26:54.8632376Z [cluster2]                 "tolerationSeconds": 300
2021-07-20T02:26:54.8632893Z [cluster2]             },
2021-07-20T02:26:54.8633298Z [cluster2]             {
2021-07-20T02:26:54.8633771Z [cluster2]                 "effect": "NoExecute",
2021-07-20T02:26:54.8634462Z [cluster2]                 "key": "node.kubernetes.io/unreachable",
2021-07-20T02:26:54.8635131Z [cluster2]                 "operator": "Exists",
2021-07-20T02:26:54.8635730Z [cluster2]                 "tolerationSeconds": 300
2021-07-20T02:26:54.8636238Z [cluster2]             }
2021-07-20T02:26:54.8636634Z [cluster2]         ],
2021-07-20T02:26:54.8637047Z [cluster2]         "volumes": [
2021-07-20T02:26:54.8637480Z [cluster2]             {
2021-07-20T02:26:54.8638381Z [cluster2]                 "name": "submariner-operator-token-c6j8j",
2021-07-20T02:26:54.8639338Z [cluster2]                 "secret": {
2021-07-20T02:26:54.8639889Z [cluster2]                     "defaultMode": 420,
2021-07-20T02:26:54.8640977Z [cluster2]                     "secretName": "submariner-operator-token-c6j8j"
2021-07-20T02:26:54.8641809Z [cluster2]                 }
2021-07-20T02:26:54.8642335Z [cluster2]             }
2021-07-20T02:26:54.8642769Z [cluster2]         ]
2021-07-20T02:26:54.8643176Z [cluster2]     },
2021-07-20T02:26:54.8643628Z [cluster2]     "status": {
2021-07-20T02:26:54.8644122Z [cluster2]         "conditions": [
2021-07-20T02:26:54.8644604Z [cluster2]             {
2021-07-20T02:26:54.8645134Z [cluster2]                 "lastProbeTime": null,
2021-07-20T02:26:54.8646064Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:25:41Z",
2021-07-20T02:26:54.8646736Z [cluster2]                 "status": "True",
2021-07-20T02:26:54.8647308Z [cluster2]                 "type": "Initialized"
2021-07-20T02:26:54.8647832Z [cluster2]             },
2021-07-20T02:26:54.8648249Z [cluster2]             {
2021-07-20T02:26:54.8648793Z [cluster2]                 "lastProbeTime": null,
2021-07-20T02:26:54.8649685Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:25:57Z",
2021-07-20T02:26:54.8650344Z [cluster2]                 "status": "True",
2021-07-20T02:26:54.8650873Z [cluster2]                 "type": "Ready"
2021-07-20T02:26:54.8651355Z [cluster2]             },
2021-07-20T02:26:54.8651784Z [cluster2]             {
2021-07-20T02:26:54.8652309Z [cluster2]                 "lastProbeTime": null,
2021-07-20T02:26:54.8653220Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:25:57Z",
2021-07-20T02:26:54.8653864Z [cluster2]                 "status": "True",
2021-07-20T02:26:54.8654481Z [cluster2]                 "type": "ContainersReady"
2021-07-20T02:26:54.8655032Z [cluster2]             },
2021-07-20T02:26:54.8655553Z [cluster2]             {
2021-07-20T02:26:54.8656167Z [cluster2]                 "lastProbeTime": null,
2021-07-20T02:26:54.8657017Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:25:41Z",
2021-07-20T02:26:54.8657621Z [cluster2]                 "status": "True",
2021-07-20T02:26:54.8658171Z [cluster2]                 "type": "PodScheduled"
2021-07-20T02:26:54.8658670Z [cluster2]             }
2021-07-20T02:26:54.8659054Z [cluster2]         ],
2021-07-20T02:26:54.8659574Z [cluster2]         "containerStatuses": [
2021-07-20T02:26:54.8660077Z [cluster2]             {
2021-07-20T02:26:54.8661862Z [cluster2]                 "containerID": "containerd://b2ca4cb8f343e08050b30f7d26d838f9f1de75be26ecb424e07fb7c7f2da940d",
2021-07-20T02:26:54.8670592Z [cluster2]                 "image": "localhost:5000/submariner-operator:local",
2021-07-20T02:26:54.8672191Z [cluster2]                 "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-20T02:26:54.8673320Z [cluster2]                 "lastState": {},
2021-07-20T02:26:54.8674109Z [cluster2]                 "name": "submariner-operator",
2021-07-20T02:26:54.8674919Z [cluster2]                 "ready": true,
2021-07-20T02:26:54.8675749Z [cluster2]                 "restartCount": 1,
2021-07-20T02:26:54.8676220Z [cluster2]                 "started": true,
2021-07-20T02:26:54.8676800Z [cluster2]                 "state": {
2021-07-20T02:26:54.8677278Z [cluster2]                     "running": {
2021-07-20T02:26:54.8677994Z [cluster2]                         "startedAt": "2021-07-20T02:25:57Z"
2021-07-20T02:26:54.8678492Z [cluster2]                     }
2021-07-20T02:26:54.8678890Z [cluster2]                 }
2021-07-20T02:26:54.8679294Z [cluster2]             }
2021-07-20T02:26:54.8679676Z [cluster2]         ],
2021-07-20T02:26:54.8680116Z [cluster2]         "hostIP": "172.18.0.8",
2021-07-20T02:26:54.8680619Z [cluster2]         "phase": "Running",
2021-07-20T02:26:54.8681104Z [cluster2]         "podIP": "10.2.128.2",
2021-07-20T02:26:54.8681572Z [cluster2]         "podIPs": [
2021-07-20T02:26:54.8681988Z [cluster2]             {
2021-07-20T02:26:54.8682415Z [cluster2]                 "ip": "10.2.128.2"
2021-07-20T02:26:54.8682823Z [cluster2]             }
2021-07-20T02:26:54.8683218Z [cluster2]         ],
2021-07-20T02:26:55.0927592Z [cubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:26:55.0929937Z [36m[submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:26:55.0932357Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:26:55.0934868Z [36m[submariner-operator]$ [cluster1] kubectl get pod submariner-operator-56f895dd55-8jpwf --namespace=submariner-operator -o json[0m
2021-07-20T02:26:55.0937277Z [36m[submariner-operator]$ [cluster1] kubectl get pod submariner-operator-56f895dd55-8jpwf --namespace=submariner-operator -o json[0m
2021-07-20T02:26:55.0939580Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-56f895dd55-8jpwf --namespace=submariner-operator -o json[0m
2021-07-20T02:26:55.0940848Z [cluster1] {
2021-07-20T02:26:55.0941295Z [cluster1]     "apiVersion": "v1",
2021-07-20T02:26:55.0941789Z [cluster1]     "kind": "Pod",
2021-07-20T02:26:55.0942239Z [cluster1]     "metadata": {
2021-07-20T02:26:55.0943188Z [cluster1]         "creationTimestamp": "2021-07-20T02:25:29Z",
2021-07-20T02:26:55.0944275Z [cluster1]         "generateName": "submariner-operator-56f895dd55-",
2021-07-20T02:26:55.0945072Z [cluster1]         "labels": {
2021-07-20T02:26:55.0945801Z [cluster1]             "name": "submariner-operator",
2021-07-20T02:26:55.0946673Z [cluster1]             "pod-template-hash": "56f895dd55"
2021-07-20T02:26:55.0947342Z [cluster1]         },
2021-07-20T02:26:55.0948287Z [cluster1]         "name": "submariner-operator-56f895dd55-8jpwf",
2021-07-20T02:26:55.0949417Z [cluster1]         "namespace": "submariner-operator",
2021-07-20T02:26:55.0950099Z [cluster1]         "ownerReferences": [
2021-07-20T02:26:55.0950604Z [cluster1]             {
2021-07-20T02:26:55.0951077Z [cluster1]                 "apiVersion": "apps/v1",
2021-07-20T02:26:55.0951729Z [cluster1]                 "blockOwnerDeletion": true,
2021-07-20T02:26:55.0952349Z [cluster1]                 "controller": true,
2021-07-20T02:26:55.0952908Z [cluster1]                 "kind": "ReplicaSet",
2021-07-20T02:26:55.0953855Z [cluster1]                 "name": "submariner-operator-56f895dd55",
2021-07-20T02:26:55.0954919Z [cluster1]                 "uid": "13616bf3-80cb-415b-a416-16b6f18a58b0"
2021-07-20T02:26:55.0955490Z [cluster1]             }
2021-07-20T02:26:55.0955873Z [cluster1]         ],
2021-07-20T02:26:55.0956381Z [cluster1]         "resourceVersion": "1778",
2021-07-20T02:26:55.0957726Z [cluster1]         "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-operator-56f895dd55-8jpwf",
2021-07-20T02:26:55.0959135Z [cluster1]         "uid": "86b591c5-f5ec-4596-9f90-bbc5d49d9968"
2021-07-20T02:26:55.0959706Z [cluster1]     },
2021-07-20T02:26:55.0960117Z [cluster1]     "spec": {
2021-07-20T02:26:55.0960573Z [cluster1]         "containers": [
2021-07-20T02:26:55.0961030Z [cluster1]             {
2021-07-20T02:26:55.0961451Z [cluster1]                 "command": [
2021-07-20T02:26:55.0962193Z [cluster1]                     "submariner-operator",
2021-07-20T02:26:55.0962996Z [cluster1]                     "-alsologtostderr",
2021-07-20T02:26:55.0963649Z [cluster1]                     "-v=1"
2021-07-20T02:26:55.0964070Z [cluster1]                 ],
2021-07-20T02:26:55.0964483Z [cluster1]                 "env": [
2021-07-20T02:26:55.0964914Z [cluster1]                     {
2021-07-20T02:26:55.0965415Z [cluster1]                         "name": "WATCH_NAMESPACE",
2021-07-20T02:26:55.0965976Z [cluster1]                         "valueFrom": {
2021-07-20T02:26:55.0966480Z [cluster1]                             "fieldRef": {
2021-07-20T02:26:55.0967021Z [cluster1]                                 "apiVersion": "v1",
2021-07-20T02:26:55.0967698Z [cluster1]                                 "fieldPath": "metadata.namespace"
2021-07-20T02:26:55.0968293Z [cluster1]                             }
2021-07-20T02:26:55.0968846Z [cluster1]                         }
2021-07-20T02:26:55.0969256Z [cluster1]                     },
2021-07-20T02:26:55.0969674Z [cluster1]                     {
2021-07-20T02:26:55.0970132Z [cluster1]                         "name": "POD_NAME",
2021-07-20T02:26:55.0970654Z [cluster1]                         "valueFrom": {
2021-07-20T02:26:55.0971160Z [cluster1]                             "fieldRef": {
2021-07-20T02:26:55.0971900Z [cluster1]                                 "apiVersion": "v1",
2021-07-20T02:26:55.0972571Z [cluster1]                                 "fieldPath": "metadata.name"
2021-07-20T02:26:55.0973172Z [cluster1]                             }
2021-07-20T02:26:55.0973625Z [cluster1]                         }
2021-07-20T02:26:55.0974060Z [cluster1]                     },
2021-07-20T02:26:55.0974506Z [cluster1]                     {
2021-07-20T02:26:55.0975032Z [cluster1]                         "name": "OPERATOR_NAME",
2021-07-20T02:26:55.0975952Z [cluster1]                         "value": "submariner-operator"
2021-07-20T02:26:55.0976565Z [cluster1]                     }
2021-07-20T02:26:55.0977004Z [cluster1]                 ],
2021-07-20T02:26:55.0977877Z [cluster1]                 "image": "localhost:5000/submariner-operator:local",
2021-07-20T02:26:55.0978775Z [cluster1]                 "imagePullPolicy": "IfNotPresent",
2021-07-20T02:26:55.0979743Z [cluster1]                 "name": "submariner-operator",
2021-07-20T02:26:55.0980395Z [cluster1]                 "resources": {},
2021-07-20T02:26:55.0981487Z [cluster1]                 "terminationMessagePath": "/dev/termination-log",
2021-07-20T02:26:55.0982613Z [cluster1]                 "terminationMessagePolicy": "File",
2021-07-20T02:26:55.0983382Z [cluster1]                 "volumeMounts": [
2021-07-20T02:26:55.0983888Z [cluster1]                     {
2021-07-20T02:26:55.0984630Z [cluster1]                         "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-20T02:26:55.0985913Z [cluster1]                         "name": "submariner-operator-token-qgm6w",
2021-07-20T02:26:55.0986787Z [cluster1]                         "readOnly": true
2021-07-20T02:26:55.0987296Z [cluster1]                     }
2021-07-20T02:26:55.0987721Z [cluster1]                 ]
2021-07-20T02:26:55.0988153Z [cluster1]             }
2021-07-20T02:26:55.0988564Z [cluster1]         ],
2021-07-20T02:26:55.0989120Z [cluster1]         "dnsPolicy": "ClusterFirst",
2021-07-20T02:26:55.0989833Z [cluster1]         "enableServiceLinks": true,
2021-07-20T02:26:55.0990744Z [cluster1]         "nodeName": "cluster1-worker",
2021-07-20T02:26:55.0991476Z [cluster1]         "priority": 0,
2021-07-20T02:26:55.0992069Z [cluster1]         "restartPolicy": "Always",
2021-07-20T02:26:55.0992996Z [cluster1]         "schedulerName": "default-scheduler",
2021-07-20T02:26:55.0993890Z [cluster1]         "securityContext": {},
2021-07-20T02:26:55.0994771Z [cluster1]         "serviceAccount": "submariner-operator",
2021-07-20T02:26:55.0995843Z [cluster1]         "serviceAccountName": "submariner-operator",
2021-07-20T02:26:55.0996805Z [cluster1]         "terminationGracePeriodSeconds": 30,
2021-07-20T02:26:55.0997549Z [cluster1]         "tolerations": [
2021-07-20T02:26:55.0998008Z [cluster1]             {
2021-07-20T02:26:55.0998484Z [cluster1]                 "effect": "NoExecute",
2021-07-20T02:26:55.0999326Z [cluster1]                 "key": "node.kubernetes.io/not-ready",
2021-07-20T02:26:55.0999978Z [cluster1]                 "operator": "Exists",
2021-07-20T02:26:55.1000583Z [cluster1]                 "tolerationSeconds": 300
2021-07-20T02:26:55.1001100Z [cluster1]             },
2021-07-20T02:26:55.1052465Z [cluster1]             {
2021-07-20T02:26:55.1053085Z [cluster1]                 "effect": "NoExecute",
2021-07-20T02:26:55.1053695Z [cluster1]                 "key": "node.kubernetes.io/unreachable",
2021-07-20T02:26:55.1054300Z [cluster1]                 "operator": "Exists",
2021-07-20T02:26:55.1054998Z [cluster1]                 "tolerationSeconds": 300
2021-07-20T02:26:55.1055474Z [cluster1]             }
2021-07-20T02:26:55.1056019Z [cluster1]         ],
2021-07-20T02:26:55.1056447Z [cluster1]         "volumes": [
2021-07-20T02:26:55.1056865Z [cluster1]             {
2021-07-20T02:26:55.1058122Z [cluster1]                 "name": "submariner-operator-token-qgm6w",
2021-07-20T02:26:55.1058884Z [cluster1]                 "secret": {
2021-07-20T02:26:55.1059395Z [cluster1]                     "defaultMode": 420,
2021-07-20T02:26:55.1060445Z [cluster1]                     "secretName": "submariner-operator-token-qgm6w"
2021-07-20T02:26:55.1061205Z [cluster1]                 }
2021-07-20T02:26:55.1061613Z [cluster1]             }
2021-07-20T02:26:55.1061991Z [cluster1]         ]
2021-07-20T02:26:55.1062502Z [cluster1]     },
2021-07-20T02:26:55.1062904Z [cluster1]     "status": {
2021-07-20T02:26:55.1063377Z [cluster1]         "conditions": [
2021-07-20T02:26:55.1063809Z [cluster1]             {
2021-07-20T02:26:55.1064326Z [cluster1]                 "lastProbeTime": null,
2021-07-20T02:26:55.1065182Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:29Z",
2021-07-20T02:26:55.1065808Z [cluster1]                 "status": "True",
2021-07-20T02:26:55.1066336Z [cluster1]                 "type": "Initialized"
2021-07-20T02:26:55.1066823Z [cluster1]             },
2021-07-20T02:26:55.1067227Z [cluster1]             {
2021-07-20T02:26:55.1067717Z [cluster1]                 "lastProbeTime": null,
2021-07-20T02:26:55.1068572Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:38Z",
2021-07-20T02:26:55.1069278Z [cluster1]                 "status": "True",
2021-07-20T02:26:55.1069780Z [cluster1]                 "type": "Ready"
2021-07-20T02:26:55.1070214Z [cluster1]             },
2021-07-20T02:26:55.1070617Z [cluster1]             {
2021-07-20T02:26:55.1071110Z [cluster1]                 "lastProbeTime": null,
2021-07-20T02:26:55.1071972Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:38Z",
2021-07-20T02:26:55.1072643Z [cluster1]                 "status": "True",
2021-07-20T02:26:55.1073227Z [cluster1]                 "type": "ContainersReady"
2021-07-20T02:26:55.1073758Z [cluster1]             },
2021-07-20T02:26:55.1074148Z [cluster1]             {
2021-07-20T02:26:55.1074652Z [cluster1]                 "lastProbeTime": null,
2021-07-20T02:26:55.1075485Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:29Z",
2021-07-20T02:26:55.1076097Z [cluster1]                 "status": "True",
2021-07-20T02:26:55.1076648Z [cluster1]                 "type": "PodScheduled"
2021-07-20T02:26:55.1077322Z [cluster1]             }
2021-07-20T02:26:55.1077736Z [cluster1]         ],
2021-07-20T02:26:55.1078291Z [cluster1]         "containerStatuses": [
2021-07-20T02:26:55.1078924Z [cluster1]             {
2021-07-20T02:26:55.1080792Z [cluster1]                 "containerID": "containerd://1e6767ae96e1b7f90c37c1f9ea45d7b553482ccb4c6b52a400ad905b7d649527",
2021-07-20T02:26:55.1083114Z [cluster1]                 "image": "localhost:5000/submariner-operator:local",
2021-07-20T02:26:55.1084798Z [cluster1]                 "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-20T02:26:55.1086005Z [cluster1]                 "lastState": {
2021-07-20T02:26:55.1086553Z [cluster1]                     "terminated": {
2021-07-20T02:26:55.1088522Z [cluster1]                         "containerID": "containerd://06052778efd99e2ddad4a29d6ee9ea93d47c57bd2cb424a0ff895395d1fd2bb5",
2021-07-20T02:26:55.1090620Z [cluster1]                         "exitCode": 1,
2021-07-20T02:26:55.1091371Z [cluster1]                         "finishedAt": "2021-07-20T02:25:36Z",
2021-07-20T02:26:55.1092008Z [cluster1]                         "reason": "Error",
2021-07-20T02:26:55.1092731Z [cluster1]                         "startedAt": "2021-07-20T02:25:31Z"
2021-07-20T02:26:55.1093251Z [cluster1]                     }
2021-07-20T02:26:55.1093650Z [cluster1]                 },
2021-07-20T02:26:55.1094538Z [cluster1]                 "name": "submariner-operator",
2021-07-20T02:26:55.1095067Z [cluster1]                 "ready": true,
2021-07-20T02:26:55.1095531Z [cluster1]                 "restartCount": 1,
2021-07-20T02:26:55.1095986Z [cluster1]                 "started": true,
2021-07-20T02:26:55.1096414Z [cluster1]                 "state": {
2021-07-20T02:26:55.7124123Z [cluster1]   luster2]         "qosClass": "BestEffort",
2021-07-20T02:26:55.7125512Z [cluster2]         "startTime": "2021-07-20T02:25:41Z"
2021-07-20T02:26:55.7126314Z [cluster2]     }
2021-07-20T02:26:55.7126806Z [cluster2] }
2021-07-20T02:26:55.7129537Z [36m[submariner-operator]$ [cluster2] kubectl get pod submariner-operator-56f895dd55-lh9t2 --namespace=submariner-operator -o jsonpath={.status.phase}[0m
2021-07-20T02:26:55.7131334Z [36m[submariner-operator]$ [cluster2] grep Running[0m
2021-07-20T02:26:55.7134262Z [36m[submariner-operator]$ [cluster2] kubectl get pod submariner-operator-56f895dd55-lh9t2 --namespace=submariner-operator -o jsonpath={.status.phase}[0m
2021-07-20T02:26:55.7136788Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-56f895dd55-lh9t2 --namespace=submariner-operator -o jsonpath={.status.phase}[0m
2021-07-20T02:26:55.7138184Z [cluster2] Running
2021-07-20T02:26:55.7146429Z [36m[submariner-operator]$ [cluster2] kubectl logs submariner-operator-56f895dd55-lh9t2 --namespace=submariner-operator[0m
2021-07-20T02:26:55.7184336Z [36m[submariner-operator]$ [cluster2] kubectl logs submariner-operator-56f895dd55-lh9t2 --namespace=submariner-operator[0m
2021-07-20T02:26:55.7187336Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 logs submariner-operator-56f895dd55-lh9t2 --namespace=submariner-operator[0m
2021-07-20T02:26:55.7188551Z [cluster2] I0720 02:25:57.689286       1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-20T02:26:55.7189165Z [cluster2] I0720 02:25:57.689339       1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-20T02:26:55.7190007Z [cluster2] I0720 02:25:57.689347       1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-20T02:26:55.7190953Z [cluster2] I0720 02:25:57.689355       1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-20T02:26:55.7191730Z [cluster2] I0720 02:25:57.690137       1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-20T02:26:55.7192526Z [cluster2] I0720 02:25:58.097239       1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."
2021-07-20T02:26:55.7193342Z [cluster2] I0720 02:25:58.097337       1 leader.go:123] leader "msg"="Continuing as the leader."
2021-07-20T02:26:55.7194564Z [cluster2] I0720 02:25:58.506318       1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen"  "addr"="0.0.0.0:8383"
2021-07-20T02:26:55.7195453Z [cluster2] I0720 02:25:58.507518       1 main.go:129] cmd "msg"="Registering Components."
2021-07-20T02:26:55.7196162Z [cluster2] I0720 02:25:58.507756       1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-20T02:26:55.7197067Z [cluster2] I0720 02:26:01.225264       1 main.go:182] cmd "msg"="Could not create ServiceMonitor object"  "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7198935Z [cluster2] I0720 02:26:01.225297       1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects"  "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7200142Z [cluster2] I0720 02:26:01.225344       1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-20T02:26:55.7201319Z [cluster2] I0720 02:26:01.225662       1 internal.go:406] controller-runtime/manager "msg"="starting metrics server"  "path"="/metrics"
2021-07-20T02:26:55.7206735Z [cluster2] I0720 02:26:01.226255       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-20T02:26:55.7214139Z [cluster2] I0720 02:26:01.226532       1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-20T02:26:55.7221684Z [cluster2] I0720 02:26:01.226660       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-20T02:26:55.7229046Z [cluster2] I0720 02:26:01.226799       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-20T02:26:55.7232777Z [cluster2] I0720 02:26:01.227006       1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-20T02:26:55.7236752Z [cluster2] I0720 02:26:01.328805       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-20T02:26:55.7241241Z [cluster2] I0720 02:26:01.329101       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-20T02:26:55.7244450Z [cluster2] I0720 02:26:01.340943       1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-20T02:26:55.7246862Z [cluster2] I0720 02:26:01.341045       1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-20T02:26:55.7249934Z [cluster2] I0720 02:26:01.342489       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-20T02:26:55.7252545Z [cluster2] I0720 02:26:01.342723       1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-20T02:26:55.7254533Z [cluster2] I0720 02:26:01.342885       1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers"  "worker count"=1
2021-07-20T02:26:55.7256567Z [cluster2] I0720 02:26:01.342663       1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:55.7258635Z [cluster2] I0720 02:26:01.343138       1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-20T02:26:55.7261958Z [cluster2] I0720 02:26:01.429850       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-20T02:26:55.7292706Z [cluster2] I0720 02:26:01.433848       1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-20T02:26:55.7294681Z [cluster2] I0720 02:26:01.530564       1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-20T02:26:55.7296521Z [cluster2] I0720 02:26:01.530609       1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers"  "worker count"=1
2021-07-20T02:26:55.7298558Z [cluster2] I0720 02:26:01.530714       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7300753Z [cluster2] I0720 02:26:01.535187       1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-20T02:26:55.7303036Z [cluster2] I0720 02:26:01.535254       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7304760Z [cluster2] I0720 02:26:01.577008       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-20T02:26:55.7306569Z [cluster2] I0720 02:26:01.577131       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-20T02:26:55.7307994Z [cluster2] I0720 02:26:01.577228       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7309350Z [cluster2] I0720 02:26:01.577284       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.7311845Z [cluster2] I0720 02:26:01.591520       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7313828Z [cluster2] I0720 02:26:01.613231       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-20T02:26:55.7315722Z [cluster2] I0720 02:26:01.613279       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-20T02:26:55.7317323Z [cluster2] I0720 02:26:01.613308       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7318755Z [cluster2] I0720 02:26:01.613401       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.7321352Z [cluster2] I0720 02:26:01.623970       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7324779Z [cluster2] I0720 02:26:01.681647       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7328295Z [cluster2] I0720 02:26:01.751346       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7331758Z [cluster2] I0720 02:26:02.095193       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7335178Z [cluster2] I0720 02:26:02.103750       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7339296Z [cluster2] E0720 02:26:02.103964       1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-routeagent: DaemonSet.apps \"submariner-routeagent\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-20T02:26:55.7376389Z [cluster2] I0720 02:26:02.109637       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7377900Z [cluster2] I0720 02:26:02.110074       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7379094Z [cluster2] I0720 02:26:02.110284       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.7381355Z [cluster2] I0720 02:26:02.135194       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7384669Z [cluster2] I0720 02:26:02.162546       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7388029Z [cluster2] I0720 02:26:02.162954       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7391633Z [cluster2] I0720 02:26:02.196822       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7394773Z [cluster2] I0720 02:26:02.251179       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7397655Z [cluster2] I0720 02:26:02.251834       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7401062Z [cluster2] I0720 02:26:02.281779       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.7404478Z [cluster2] I0720 02:26:02.283104       1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-20T02:26:55.7408546Z [cluster2] E0720 02:26:02.432287       1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-20T02:26:55.7412258Z [cluster2] I0720 02:26:02.432371       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7415196Z [cluster2] I0720 02:26:02.576314       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7417500Z [cluster2] I0720 02:26:02.625679       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7418898Z [cluster2] I0720 02:26:02.625791       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7420394Z [cluster2] I0720 02:26:02.625816       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.7445134Z [cluster2] I0720 02:26:02.723702       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7448175Z [cluster2] I0720 02:26:02.724074       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7451146Z [cluster2] I0720 02:26:02.747395       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.7454590Z [cluster2] I0720 02:26:02.747890       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7458618Z [cluster2] E0720 02:26:02.748078       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: Service \"submariner-lighthouse-agent-metrics\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-20T02:26:55.7462039Z [cluster2] I0720 02:26:02.753890       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7465820Z [cluster2] E0720 02:26:02.830077       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7468963Z [cluster2] I0720 02:26:02.839133       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7470698Z [cluster2] I0720 02:26:02.849755       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7472249Z [cluster2] I0720 02:26:02.849990       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.7474840Z [cluster2] I0720 02:26:02.936606       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7478312Z [cluster2] I0720 02:26:02.937001       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7481458Z [cluster2] I0720 02:26:03.000189       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7486031Z [cluster2] E0720 02:26:03.014144       1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: services \"submariner-lighthouse-agent-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-20T02:26:55.7489789Z [cluster2] I0720 02:26:03.014186       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7512118Z [cluster2] I0720 02:26:03.015514       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.7516210Z [cluster2] I0720 02:26:03.085475       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7520155Z [cluster2] I0720 02:26:03.093590       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.7523459Z [cluster2] I0720 02:26:03.240814       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7538473Z [cluster2] I0720 02:26:03.401841       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7541558Z [cluster2] I0720 02:26:03.408835       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7544779Z [cluster2] I0720 02:26:03.459958       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7547902Z [cluster2] I0720 02:26:03.478786       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7551615Z [cluster2] E0720 02:26:03.519051       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7569501Z [cluster2] I0720 02:26:03.519101       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7571555Z [cluster2] I0720 02:26:03.519132       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7573094Z [cluster2] I0720 02:26:03.519142       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.7575312Z [cluster2] I0720 02:26:03.556343       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7577063Z [cluster2] I0720 02:26:03.556384       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7578539Z [cluster2] I0720 02:26:03.556394       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.7581066Z [cluster2] I0720 02:26:03.597263       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7584621Z [cluster2] I0720 02:26:03.651870       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7623185Z [cluster2] I0720 02:26:03.675516       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7626860Z [cluster2] I0720 02:26:04.037768       1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-20T02:26:55.7630829Z [cluster2] E0720 02:26:04.061588       1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists"
2021-07-20T02:26:55.7635380Z [cluster2] E0720 02:26:04.061641       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-20T02:26:55.7639223Z [cluster2] I0720 02:26:04.072334       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7642563Z [cluster2] I0720 02:26:04.074450       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7646311Z [cluster2] I0720 02:26:04.093179       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.7649974Z [cluster2] I0720 02:26:04.169859       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7653671Z [cluster2] I0720 02:26:04.206706       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.7657320Z [cluster2] I0720 02:26:04.315033       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7660873Z [cluster2] I0720 02:26:04.324088       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7690916Z [cluster2] I0720 02:26:04.573293       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7694278Z [cluster2] I0720 02:26:04.718488       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7697774Z [cluster2] I0720 02:26:04.991557       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7701892Z [cluster2] E0720 02:26:05.038490       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7705139Z [cluster2] I0720 02:26:05.038543       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7706893Z [cluster2] I0720 02:26:05.038572       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7708352Z [cluster2] I0720 02:26:05.038582       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.7711311Z [cluster2] I0720 02:26:05.168898       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7715457Z [cluster2] I0720 02:26:05.169174       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7719158Z [cluster2] I0720 02:26:05.246297       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7722505Z [cluster2] I0720 02:26:05.305617       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7725871Z [cluster2] I0720 02:26:05.504579       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7729364Z [cluster2] I0720 02:26:05.592330       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7733021Z [cluster2] I0720 02:26:05.592631       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7736793Z [cluster2] I0720 02:26:05.655333       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.7740438Z [cluster2] I0720 02:26:05.669879       1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7785232Z [cluster2] I0720 02:26:05.669918       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.2.217.106\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n"
2021-07-20T02:26:55.7789352Z [cluster2] I0720 02:26:05.699188       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7792904Z [cluster2] I0720 02:26:05.723086       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.7797019Z [cluster2] I0720 02:26:05.747575       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7801308Z [cluster2] I0720 02:26:05.813585       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7804953Z [cluster2] I0720 02:26:05.935053       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7808337Z [cluster2] I0720 02:26:05.971566       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7811551Z [cluster2] I0720 02:26:06.151811       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7814632Z [cluster2] I0720 02:26:06.163718       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7818290Z [cluster2] I0720 02:26:06.163822       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.2.217.106\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n"
2021-07-20T02:26:55.7821789Z [cluster2] I0720 02:26:06.223090       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7825346Z [cluster2] I0720 02:26:06.619237       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.7829104Z [cluster2] I0720 02:26:06.659069       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7832615Z [cluster2] I0720 02:26:07.060694       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7835666Z [cluster2] I0720 02:26:07.063670       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7884329Z [cluster2] I0720 02:26:07.063708       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.2.217.106\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n"
2021-07-20T02:26:55.7888266Z [cluster2] I0720 02:26:18.652401       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7889885Z [cluster2] I0720 02:26:18.652446       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7891241Z [cluster2] I0720 02:26:18.652468       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.7893716Z [cluster2] I0720 02:26:18.718816       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7896858Z [cluster2] I0720 02:26:18.808643       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7900100Z [cluster2] I0720 02:26:19.216314       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7903476Z [cluster2] I0720 02:26:19.254163       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7906890Z [cluster2] I0720 02:26:19.291042       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7908532Z [cluster2] I0720 02:26:19.291078       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7909991Z [cluster2] I0720 02:26:19.291088       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.7911942Z [cluster2] I0720 02:26:19.312283       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7913553Z [cluster2] I0720 02:26:19.312329       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7914885Z [cluster2] I0720 02:26:19.312343       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.7917287Z [cluster2] I0720 02:26:19.345344       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7920363Z [cluster2] I0720 02:26:19.350124       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7923465Z [cluster2] I0720 02:26:19.365202       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7961845Z [cluster2] I0720 02:26:19.365368       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.7965456Z [cluster2] I0720 02:26:19.771522       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7969284Z [cluster2] I0720 02:26:19.771955       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.7972626Z [cluster2] I0720 02:26:19.783891       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7975854Z [cluster2] I0720 02:26:19.794401       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7979019Z [cluster2] I0720 02:26:19.798610       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.7982946Z [cluster2] I0720 02:26:19.807289       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.7987225Z [cluster2] E0720 02:26:19.832016       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7990530Z [cluster2] I0720 02:26:19.832126       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7992149Z [cluster2] I0720 02:26:19.832194       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7993500Z [cluster2] I0720 02:26:19.832224       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.7995386Z [cluster2] I0720 02:26:19.833402       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.7997219Z [cluster2] I0720 02:26:19.833439       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.7998694Z [cluster2] I0720 02:26:19.833450       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8001620Z [cluster2] I0720 02:26:19.833878       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8005217Z [cluster2] I0720 02:26:19.844316       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8044702Z [cluster2] I0720 02:26:19.860898       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8047553Z [cluster2] I0720 02:26:19.865175       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8050285Z [cluster2] I0720 02:26:19.873610       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8053120Z [cluster2] I0720 02:26:20.236118       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8056143Z [cluster2] I0720 02:26:20.239369       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.8059403Z [cluster2] I0720 02:26:20.244667       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8062463Z [cluster2] I0720 02:26:20.268964       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8065243Z [cluster2] I0720 02:26:20.275511       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8067911Z [cluster2] I0720 02:26:20.277626       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8071133Z [cluster2] I0720 02:26:20.290580       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8074595Z [cluster2] I0720 02:26:20.647229       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8077863Z [cluster2] I0720 02:26:20.653636       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8082298Z [cluster2] I0720 02:26:20.653786       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.2.217.106\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n"
2021-07-20T02:26:55.8085995Z [cluster2] I0720 02:26:21.592932       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8087613Z [cluster2] I0720 02:26:21.593009       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8123561Z [cluster2] I0720 02:26:21.593029       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8126544Z [cluster2] I0720 02:26:21.615309       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8130040Z [cluster2] I0720 02:26:21.644290       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8133228Z [cluster2] I0720 02:26:21.705239       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8136408Z [cluster2] I0720 02:26:21.711054       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.8140324Z [cluster2] I0720 02:26:21.717800       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8143923Z [cluster2] I0720 02:26:22.052072       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8147031Z [cluster2] I0720 02:26:22.059363       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8149776Z [cluster2] I0720 02:26:22.069635       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8151394Z [cluster2] I0720 02:26:22.069867       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8152743Z [cluster2] I0720 02:26:22.069967       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8154644Z [cluster2] I0720 02:26:22.070285       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8156336Z [cluster2] I0720 02:26:22.070405       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8157675Z [cluster2] I0720 02:26:22.070592       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8160077Z [cluster2] I0720 02:26:22.078314       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8163403Z [cluster2] I0720 02:26:22.080421       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8166768Z [cluster2] I0720 02:26:22.087579       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8170200Z [cluster2] I0720 02:26:22.099204       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8173678Z [cluster2] I0720 02:26:22.120128       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8177432Z [cluster2] I0720 02:26:22.129812       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.8181486Z [cluster2] I0720 02:26:22.133596       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8188798Z [cluster2] I0720 02:26:22.488613       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8192361Z [cluster2] I0720 02:26:22.491375       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8195998Z [cluster2] I0720 02:26:22.500142       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8199359Z [cluster2] I0720 02:26:22.503434       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8202832Z [cluster2] I0720 02:26:22.535106       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8207990Z [cluster2] I0720 02:26:22.536596       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8213402Z [cluster2] I0720 02:26:22.536641       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.2.217.106\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n"
2021-07-20T02:26:55.8217623Z [cluster2] I0720 02:26:22.614023       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8221447Z [cluster2] I0720 02:26:22.620605       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.8226543Z [cluster2] I0720 02:26:22.627774       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8230426Z [cluster2] I0720 02:26:23.029083       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8233899Z [cluster2] I0720 02:26:23.032939       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:55.8250018Z [cluster2] I0720 02:26:23.035376       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8254072Z [cluster2] I0720 02:26:23.437148       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8257189Z [cluster2] I0720 02:26:23.438932       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8261287Z [cluster2] I0720 02:26:23.438969       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.2.217.106\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n\n"
2021-07-20T02:26:55.8268765Z [cluster2] I0720 02:26:24.502929       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8270582Z [cluster2] I0720 02:26:24.503085       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8271955Z [cluster2] I0720 02:26:24.503163       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8274695Z [cluster2] I0720 02:26:24.508426       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8278072Z [cluster2] I0720 02:26:24.510976       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8281426Z [cluster2] I0720 02:26:24.912307       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8284749Z [cluster2] I0720 02:26:24.915319       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8287558Z [cluster2] I0720 02:26:24.921475       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8289304Z [cluster2] I0720 02:26:24.921507       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8290762Z [cluster2] I0720 02:26:24.921517       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8292789Z [cluster2] I0720 02:26:24.921875       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8294606Z [cluster2] I0720 02:26:24.921920       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8296058Z [cluster2] I0720 02:26:24.921934       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8298664Z [cluster2] I0720 02:26:24.925711       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8301975Z [cluster2] I0720 02:26:24.926688       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8305708Z [cluster2] I0720 02:26:24.928749       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8309140Z [cluster2] I0720 02:26:24.933472       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8312576Z [cluster2] I0720 02:26:25.330686       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8316548Z [cluster2] I0720 02:26:25.333441       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8319977Z [cluster2] I0720 02:26:25.334944       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8323324Z [cluster2] I0720 02:26:25.338147       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8326153Z [cluster2] I0720 02:26:29.522702       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8331915Z [cluster2] I0720 02:26:29.522765       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8333385Z [cluster2] I0720 02:26:29.522780       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8336465Z [cluster2] I0720 02:26:29.530098       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8339930Z [cluster2] I0720 02:26:29.533560       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8346214Z [cluster2] I0720 02:26:29.935597       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8363882Z [cluster2] I0720 02:26:29.938695       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8366993Z [cluster2] I0720 02:26:29.944036       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8368746Z [cluster2] I0720 02:26:29.944198       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8370119Z [cluster2] I0720 02:26:29.944270       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8371783Z [cluster2] I0720 02:26:29.945073       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8373172Z [cluster2] I0720 02:26:29.945224       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8374492Z [cluster2] I0720 02:26:29.945302       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8378275Z [cluster2] I0720 02:26:29.949170       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8381790Z [cluster2] I0720 02:26:29.949801       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8386560Z [cluster2] I0720 02:26:29.951695       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8389977Z [cluster2] I0720 02:26:29.956090       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8393153Z [cluster2] I0720 02:26:30.353940       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8395793Z [cluster2] I0720 02:26:30.369887       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8398499Z [cluster2] I0720 02:26:30.379107       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8402030Z [cluster2] I0720 02:26:30.382622       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8404562Z [cluster2] I0720 02:26:34.545666       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8405978Z [cluster2] I0720 02:26:34.545723       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8410103Z [cluster2] I0720 02:26:34.545734       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8412765Z [cluster2] I0720 02:26:34.553828       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8415905Z [cluster2] I0720 02:26:34.559630       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8419786Z [cluster2] I0720 02:26:34.961698       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8426335Z [cluster2] I0720 02:26:34.965390       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8429358Z [cluster2] I0720 02:26:34.972972       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8431699Z [cluster2] I0720 02:26:34.972992       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8433448Z [cluster2] I0720 02:26:34.973009       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8434884Z [cluster2] I0720 02:26:34.973020       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8436346Z [cluster2] I0720 02:26:34.973045       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8437778Z [cluster2] I0720 02:26:34.973055       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8440350Z [cluster2] I0720 02:26:34.978752       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8443662Z [cluster2] I0720 02:26:34.981594       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8446716Z [cluster2] I0720 02:26:34.998969       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8450885Z [cluster2] I0720 02:26:35.003122       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8454090Z [cluster2] I0720 02:26:35.383444       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8457249Z [cluster2] I0720 02:26:35.387272       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8459928Z [cluster2] I0720 02:26:35.405047       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8462790Z [cluster2] I0720 02:26:35.409002       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8465091Z [cluster2] I0720 02:26:39.557639       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8466565Z [cluster2] I0720 02:26:39.557694       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8467739Z [cluster2] I0720 02:26:39.557705       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8469830Z [cluster2] I0720 02:26:39.569195       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8472519Z [cluster2] I0720 02:26:39.793681       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8475235Z [cluster2] I0720 02:26:40.195647       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8478540Z [cluster2] I0720 02:26:40.198425       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8481358Z [cluster2] I0720 02:26:40.203696       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8483082Z [cluster2] I0720 02:26:40.203736       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8484539Z [cluster2] I0720 02:26:40.203747       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8489393Z [cluster2] I0720 02:26:40.208085       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8491459Z [cluster2] I0720 02:26:40.208117       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8493323Z [cluster2] I0720 02:26:40.208127       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8501065Z [cluster2] I0720 02:26:40.212250       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8504578Z [cluster2] I0720 02:26:40.213951       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8507714Z [cluster2] I0720 02:26:40.221675       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8511618Z [cluster2] I0720 02:26:40.222050       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8514919Z [cluster2] I0720 02:26:40.623534       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8518041Z [cluster2] I0720 02:26:40.624102       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8522145Z [cluster2] I0720 02:26:40.627397       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8525324Z [cluster2] I0720 02:26:40.627833       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8527952Z [cluster2] I0720 02:26:44.584529       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8529579Z [cluster2] I0720 02:26:44.584576       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8531115Z [cluster2] I0720 02:26:44.584586       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8533540Z [cluster2] I0720 02:26:44.590014       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8537002Z [cluster2] I0720 02:26:44.595780       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8540399Z [cluster2] I0720 02:26:44.997208       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8544207Z [cluster2] I0720 02:26:45.001861       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8547479Z [cluster2] I0720 02:26:45.007503       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8550064Z [cluster2] I0720 02:26:45.007535       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8551712Z [cluster2] I0720 02:26:45.007545       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8554070Z [cluster2] I0720 02:26:45.013102       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8556077Z [cluster2] I0720 02:26:45.013134       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8557834Z [cluster2] I0720 02:26:45.013144       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8560671Z [cluster2] I0720 02:26:45.019404       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8563756Z [cluster2] I0720 02:26:45.021210       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8567496Z [cluster2] I0720 02:26:45.035027       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8571338Z [cluster2] I0720 02:26:45.035461       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8576076Z [cluster2] I0720 02:26:45.437275       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8579986Z [cluster2] I0720 02:26:45.437876       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8583669Z [cluster2] I0720 02:26:45.448396       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8587093Z [cluster2] I0720 02:26:45.457511       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8590345Z [cluster2] I0720 02:26:49.620734       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8592208Z [cluster2] I0720 02:26:49.620780       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8593871Z [cluster2] I0720 02:26:49.620791       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8596681Z [cluster2] I0720 02:26:49.624837       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8600173Z [cluster2] I0720 02:26:49.631748       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8603533Z [cluster2] I0720 02:26:50.033908       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8610661Z [cluster2] I0720 02:26:50.037796       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8613491Z [cluster2] I0720 02:26:50.045098       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8615132Z [cluster2] I0720 02:26:50.045145       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8616546Z [cluster2] I0720 02:26:50.045155       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8619173Z [cluster2] I0720 02:26:50.045534       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8620794Z [cluster2] I0720 02:26:50.045558       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8624620Z [cluster2] I0720 02:26:50.045569       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8627250Z [cluster2] I0720 02:26:50.054593       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8630340Z [cluster2] I0720 02:26:50.054900       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8637218Z [cluster2] I0720 02:26:50.060073       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8642010Z [cluster2] I0720 02:26:50.066771       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8645467Z [cluster2] I0720 02:26:50.461264       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8648770Z [cluster2] I0720 02:26:50.464001       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8651852Z [cluster2] I0720 02:26:50.468260       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:55.8654921Z [cluster2] I0720 02:26:50.475558       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8657536Z [cluster2] I0720 02:26:54.636431       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:55.8659230Z [cluster2] I0720 02:26:54.636477       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:55.8660583Z [cluster2] I0720 02:26:54.636487       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:55.8663431Z [cluster2] I0720 02:26:54.646486       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:55.8666578Z [cluster2] I0720 02:26:54.650726       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:55.8669683Z [cluster2] I0720 02:26:55.052890       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.0428894Z [cluster2] I0720 02:26:55.055984       1 helpe                  "running": {
2021-07-20T02:26:56.0430241Z [cluster1]                         "startedAt": "2021-07-20T02:25:37Z"
2021-07-20T02:26:56.0430762Z [cluster1]                     }
2021-07-20T02:26:56.0431175Z [cluster1]                 }
2021-07-20T02:26:56.0431569Z [cluster1]             }
2021-07-20T02:26:56.0432047Z [cluster1]         ],
2021-07-20T02:26:56.0432424Z [cluster1]         "hostIP": "172.18.0.6",
2021-07-20T02:26:56.0432866Z [cluster1]         "phase": "Running",
2021-07-20T02:26:56.0434469Z [cluster1]         "podIP": "10.1.128.2",
2021-07-20T02:26:56.0434891Z [cluster1]         "podIPs": [
2021-07-20T02:26:56.0435274Z [cluster1]             {
2021-07-20T02:26:56.0435656Z [cluster1]                 "ip": "10.1.128.2"
2021-07-20T02:26:56.0436033Z [cluster1]             }
2021-07-20T02:26:56.0436367Z [cluster1]         ],
2021-07-20T02:26:56.0436800Z [cluster1]         "qosClass": "BestEffort",
2021-07-20T02:26:56.0437483Z [cluster1]         "startTime": "2021-07-20T02:25:29Z"
2021-07-20T02:26:56.0437904Z [cluster1]     }
2021-07-20T02:26:56.0438232Z [cluster1] }
2021-07-20T02:26:56.0439765Z [36m[submariner-operator]$ [cluster1] kubectl get pod submariner-operator-56f895dd55-8jpwf --namespace=submariner-operator -o jsonpath={.status.phase}[0m
2021-07-20T02:26:56.0441194Z [36m[submariner-operator]$ [cluster1] grep Running[0m
2021-07-20T02:26:56.0442866Z [36m[submariner-operator]$ [cluster1] kubectl get pod submariner-operator-56f895dd55-8jpwf --namespace=submariner-operator -o jsonpath={.status.phase}[0m
2021-07-20T02:26:56.0445370Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-56f895dd55-8jpwf --namespace=submariner-operator -o jsonpath={.status.phase}[0m
2021-07-20T02:26:56.0446755Z [cluster1] Running
2021-07-20T02:26:56.0448178Z [36m[submariner-operator]$ [cluster1] kubectl logs submariner-operator-56f895dd55-8jpwf --namespace=submariner-operator[0m
2021-07-20T02:26:56.0450269Z [36m[submariner-operator]$ [cluster1] kubectl logs submariner-operator-56f895dd55-8jpwf --namespace=submariner-operator[0m
2021-07-20T02:26:56.0452512Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 logs submariner-operator-56f895dd55-8jpwf --namespace=submariner-operator[0m
2021-07-20T02:26:56.0454265Z [cluster1] I0720 02:25:37.619379       1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-20T02:26:56.0454942Z [cluster1] I0720 02:25:37.619429       1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-20T02:26:56.0455904Z [cluster1] I0720 02:25:37.619437       1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-20T02:26:56.0457083Z [cluster1] I0720 02:25:37.619448       1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-20T02:26:56.0457972Z [cluster1] I0720 02:25:37.619590       1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-20T02:26:56.0458907Z [cluster1] I0720 02:25:38.026416       1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."
2021-07-20T02:26:56.0459828Z [cluster1] I0720 02:25:38.026596       1 leader.go:123] leader "msg"="Continuing as the leader."
2021-07-20T02:26:56.0461114Z [cluster1] I0720 02:25:38.430804       1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen"  "addr"="0.0.0.0:8383"
2021-07-20T02:26:56.0462114Z [cluster1] I0720 02:25:38.431278       1 main.go:129] cmd "msg"="Registering Components."
2021-07-20T02:26:56.0463172Z [cluster1] I0720 02:25:38.431501       1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-20T02:26:56.0464216Z [cluster1] I0720 02:25:41.009550       1 main.go:182] cmd "msg"="Could not create ServiceMonitor object"  "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.0465917Z [cluster1] I0720 02:25:41.009584       1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects"  "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.0466960Z [cluster1] I0720 02:25:41.009757       1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-20T02:26:56.0467984Z [cluster1] I0720 02:25:41.010023       1 internal.go:406] controller-runtime/manager "msg"="starting metrics server"  "path"="/metrics"
2021-07-20T02:26:56.0472525Z [cluster1] I0720 02:25:41.010622       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-20T02:26:56.0509873Z [cluster1] I0720 02:25:41.010817       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-20T02:26:56.0517021Z [cluster1] I0720 02:25:41.010947       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-20T02:26:56.0522118Z [cluster1] I0720 02:25:41.011057       1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-20T02:26:56.0526208Z [cluster1] I0720 02:25:41.011157       1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-20T02:26:56.0528687Z [cluster1] I0720 02:25:41.111633       1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.0530924Z [cluster1] I0720 02:25:41.111846       1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-20T02:26:56.0533320Z [cluster1] I0720 02:25:41.111730       1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-20T02:26:56.0537343Z [cluster1] I0720 02:25:41.116046       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-20T02:26:56.0541752Z [cluster1] I0720 02:25:41.116160       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-20T02:26:56.0580652Z [cluster1] I0720 02:25:41.117001       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-20T02:26:56.0584125Z [cluster1] I0720 02:25:41.212998       1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-20T02:26:56.0587538Z [cluster1] I0720 02:25:41.217344       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-20T02:26:56.0590300Z [cluster1] I0720 02:25:41.219193       1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-20T02:26:56.0592374Z [cluster1] I0720 02:25:41.220372       1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-20T02:26:56.0595109Z [cluster1] E0720 02:25:41.289576       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.0597437Z [cluster1] I0720 02:25:41.317619       1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-20T02:26:56.0599024Z [cluster1] I0720 02:25:41.317676       1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers"  "worker count"=1
2021-07-20T02:26:56.0601007Z [cluster1] I0720 02:25:41.320198       1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers"  "worker count"=1
2021-07-20T02:26:56.0603115Z [cluster1] I0720 02:25:41.320675       1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-20T02:26:56.0606060Z [cluster1] E0720 02:25:41.352960       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.0608920Z [cluster1] I0720 02:25:41.393371       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0611231Z [cluster1] I0720 02:25:41.393545       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0614204Z [cluster1] E0720 02:25:41.444910       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.0616425Z [cluster1] I0720 02:25:41.515834       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-20T02:26:56.0618233Z [cluster1] I0720 02:25:41.515871       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-20T02:26:56.0619765Z [cluster1] I0720 02:25:41.515887       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.0621222Z [cluster1] I0720 02:25:41.515897       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.0662274Z [cluster1] I0720 02:25:41.521079       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-20T02:26:56.0664784Z [cluster1] I0720 02:25:41.521109       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-20T02:26:56.0666461Z [cluster1] I0720 02:25:41.521120       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.0667916Z [cluster1] I0720 02:25:41.521131       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.0670467Z [cluster1] I0720 02:25:41.524856       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.0674238Z [cluster1] E0720 02:25:41.572601       1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-20T02:26:56.0677405Z [cluster1] I0720 02:25:41.572678       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0679271Z [cluster1] I0720 02:25:41.572797       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.0680848Z [cluster1] I0720 02:25:41.572839       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.0683420Z [cluster1] I0720 02:25:41.612417       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.0686794Z [cluster1] E0720 02:25:41.616552       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.0689968Z [cluster1] I0720 02:25:41.617600       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.0693589Z [cluster1] E0720 02:25:41.617766       1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: Service \"submariner-gateway-metrics\" not found" "name"="submariner" "namespace"="submariner-operator"
2021-07-20T02:26:56.0696623Z [cluster1] I0720 02:25:41.617844       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0698218Z [cluster1] I0720 02:25:41.617907       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.0699607Z [cluster1] I0720 02:25:41.617946       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.0701755Z [cluster1] I0720 02:25:41.631299       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.0738768Z [cluster1] I0720 02:25:41.636047       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.0741743Z [cluster1] I0720 02:25:41.641906       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.0744685Z [cluster1] E0720 02:25:41.865633       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.0747563Z [cluster1] E0720 02:25:42.008535       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.0750386Z [cluster1] I0720 02:25:42.037313       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.0753202Z [cluster1] I0720 02:25:42.043902       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.0755841Z [cluster1] I0720 02:25:42.048242       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.0758324Z [cluster1] I0720 02:25:42.068043       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0760622Z [cluster1] I0720 02:25:42.068480       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0763539Z [cluster1] E0720 02:25:42.068970       1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-routeagent: daemonsets.apps \"submariner-routeagent\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-20T02:26:56.0766651Z [cluster1] I0720 02:25:42.069020       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0768260Z [cluster1] I0720 02:25:42.069044       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.0769608Z [cluster1] I0720 02:25:42.069054       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.0771913Z [cluster1] I0720 02:25:42.069662       1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-20T02:26:56.0774999Z [cluster1] I0720 02:25:42.122379       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.0778348Z [cluster1] I0720 02:25:42.122733       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.0782183Z [cluster1] E0720 02:25:42.166649       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-20T02:26:56.0785543Z [cluster1] I0720 02:25:42.174508       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0787623Z [cluster1] I0720 02:25:42.283781       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0789088Z [cluster1] I0720 02:25:42.283819       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.0790252Z [cluster1] I0720 02:25:42.283828       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.0792803Z [cluster1] I0720 02:25:42.305229       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.0796313Z [cluster1] I0720 02:25:42.350116       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.0799734Z [cluster1] I0720 02:25:42.391417       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.0823346Z [cluster1] I0720 02:25:42.394443       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.0827091Z [cluster1] I0720 02:25:42.468328       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.0831872Z [cluster1] E0720 02:25:42.524408       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: services \"submariner-lighthouse-agent-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-20T02:26:56.0836429Z [cluster1] I0720 02:25:42.534457       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0839626Z [cluster1] I0720 02:25:42.590434       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.0843294Z [cluster1] I0720 02:25:42.635656       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.0847023Z [cluster1] E0720 02:25:42.736632       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.0850438Z [cluster1] I0720 02:25:42.765420       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.0853824Z [cluster1] I0720 02:25:42.792242       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.0857450Z [cluster1] E0720 02:25:42.811219       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0860345Z [cluster1] I0720 02:25:42.811266       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0862024Z [cluster1] I0720 02:25:42.811307       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.0910490Z [cluster1] I0720 02:25:42.811318       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.0913566Z [cluster1] I0720 02:25:42.818492       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.0916994Z [cluster1] I0720 02:25:42.916489       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.0920298Z [cluster1] I0720 02:25:42.932011       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.0923619Z [cluster1] I0720 02:25:42.968899       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.0927621Z [cluster1] I0720 02:25:42.985412       1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-20T02:26:56.0931292Z [cluster1] I0720 02:25:42.985753       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.0934135Z [cluster1] I0720 02:25:43.001895       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.0935868Z [cluster1] I0720 02:25:43.002053       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.0937314Z [cluster1] I0720 02:25:43.002070       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.0940205Z [cluster1] I0720 02:25:43.017961       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.0973637Z [cluster1] I0720 02:25:43.079939       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.0977642Z [cluster1] I0720 02:25:43.125311       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.0981400Z [cluster1] I0720 02:25:43.180378       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.0986769Z [cluster1] I0720 02:25:43.180621       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.0990779Z [cluster1] I0720 02:25:43.374719       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.0994430Z [cluster1] I0720 02:25:43.424209       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.0998053Z [cluster1] I0720 02:25:43.537595       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.1002139Z [cluster1] I0720 02:25:43.573907       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1005659Z [cluster1] I0720 02:25:43.586914       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1008358Z [cluster1] I0720 02:25:43.620093       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1012974Z [cluster1] E0720 02:25:43.626555       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1016231Z [cluster1] I0720 02:25:43.626619       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1017982Z [cluster1] I0720 02:25:43.626661       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1019418Z [cluster1] I0720 02:25:43.626670       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1022496Z [cluster1] I0720 02:25:43.626483       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1026505Z [cluster1] I0720 02:25:43.776526       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1029820Z [cluster1] I0720 02:25:44.031465       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1034411Z [cluster1] I0720 02:25:44.037969       1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1038331Z [cluster1] I0720 02:25:44.037998       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.1.232.25\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n"
2021-07-20T02:26:56.1041974Z [cluster1] I0720 02:25:44.038419       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1045066Z [cluster1] I0720 02:25:44.287141       1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1050018Z [cluster1] I0720 02:25:44.287259       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.1.232.25\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n"
2021-07-20T02:26:56.1054040Z [cluster1] I0720 02:25:44.298506       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1056856Z [cluster1] I0720 02:25:44.382455       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1061020Z [cluster1] I0720 02:25:44.382497       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.1.232.25\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n"
2021-07-20T02:26:56.1065297Z [cluster1] I0720 02:25:44.390165       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1068737Z [cluster1] E0720 02:25:44.390420       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.1072297Z [cluster1] I0720 02:25:44.391587       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.1090134Z [cluster1] I0720 02:25:44.524166       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1093635Z [cluster1] I0720 02:25:44.804563       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1096326Z [cluster1] I0720 02:25:44.845016       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1099940Z [cluster1] I0720 02:25:44.926905       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1103532Z [cluster1] I0720 02:25:44.940220       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.1110346Z [cluster1] I0720 02:25:45.017337       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1115741Z [cluster1] E0720 02:25:45.234508       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.1119317Z [cluster1] I0720 02:25:45.423339       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1122614Z [cluster1] I0720 02:25:45.432073       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1127056Z [cluster1] I0720 02:25:45.432130       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.1.232.25\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n"
2021-07-20T02:26:56.1140063Z [cluster1] I0720 02:25:45.486356       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1151324Z [cluster1] I0720 02:25:45.537930       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.1161265Z [cluster1] I0720 02:25:45.741527       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1165364Z [cluster1] I0720 02:25:46.142770       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1168863Z [cluster1] I0720 02:25:46.145574       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.1173342Z [cluster1] I0720 02:25:46.151029       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1176895Z [cluster1] I0720 02:25:46.553089       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1180111Z [cluster1] I0720 02:25:46.840973       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1194801Z [cluster1] I0720 02:25:46.841033       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.1.232.25\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n"
2021-07-20T02:26:56.1198024Z [cluster1] I0720 02:25:46.891223       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1200797Z [cluster1] I0720 02:25:47.027443       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.1204006Z [cluster1] I0720 02:25:47.180285       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1207847Z [cluster1] E0720 02:25:47.295787       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.1211114Z [cluster1] I0720 02:25:47.582049       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1214597Z [cluster1] I0720 02:25:47.646744       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.1218758Z [cluster1] I0720 02:25:47.693520       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1223619Z [cluster1] I0720 02:25:48.104532       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1226921Z [cluster1] I0720 02:25:48.167248       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1231257Z [cluster1] I0720 02:25:48.167317       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.1.232.25\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n"
2021-07-20T02:26:56.1235271Z [cluster1] E0720 02:25:50.038468       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.1238843Z [cluster1] E0720 02:25:55.397280       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.1242420Z [cluster1] I0720 02:25:58.828618       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1244030Z [cluster1] I0720 02:25:58.828657       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1245875Z [cluster1] I0720 02:25:58.828665       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1248465Z [cluster1] I0720 02:25:59.085120       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1304874Z [cluster1] I0720 02:25:59.141403       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1308297Z [cluster1] I0720 02:25:59.542836       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1311376Z [cluster1] I0720 02:25:59.623357       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1314004Z [cluster1] I0720 02:25:59.643096       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1315621Z [cluster1] I0720 02:25:59.643136       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1317165Z [cluster1] I0720 02:25:59.643147       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1319207Z [cluster1] I0720 02:25:59.654033       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1320946Z [cluster1] I0720 02:25:59.654563       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1322383Z [cluster1] I0720 02:25:59.655186       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1325119Z [cluster1] I0720 02:25:59.674178       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1328648Z [cluster1] I0720 02:25:59.702592       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1332008Z [cluster1] I0720 02:25:59.780585       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1335430Z [cluster1] I0720 02:25:59.786718       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1338760Z [cluster1] I0720 02:26:00.185982       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1341853Z [cluster1] I0720 02:26:00.191419       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1345738Z [cluster1] I0720 02:26:00.197481       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1348910Z [cluster1] I0720 02:26:00.201803       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1383462Z [cluster1] I0720 02:26:00.211265       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1385123Z [cluster1] I0720 02:26:00.211350       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1386481Z [cluster1] I0720 02:26:00.211377       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1389268Z [cluster1] I0720 02:26:00.226328       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1393042Z [cluster1] E0720 02:26:00.230594       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1396188Z [cluster1] I0720 02:26:00.230689       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1397923Z [cluster1] I0720 02:26:00.231393       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1399526Z [cluster1] I0720 02:26:00.231432       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1402119Z [cluster1] I0720 02:26:00.238046       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1404837Z [cluster1] I0720 02:26:00.241178       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1407605Z [cluster1] I0720 02:26:00.270366       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1410501Z [cluster1] I0720 02:26:00.648000       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1413558Z [cluster1] I0720 02:26:00.662560       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1416254Z [cluster1] I0720 02:26:00.698128       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1417867Z [cluster1] I0720 02:26:00.698235       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1419390Z [cluster1] I0720 02:26:00.698309       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1421947Z [cluster1] I0720 02:26:00.742645       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1425368Z [cluster1] I0720 02:26:00.809896       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1428724Z [cluster1] I0720 02:26:00.835066       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1432138Z [cluster1] I0720 02:26:00.843763       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1476294Z [cluster1] E0720 02:26:00.903993       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1479446Z [cluster1] I0720 02:26:00.904039       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1481441Z [cluster1] I0720 02:26:00.904073       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1482900Z [cluster1] I0720 02:26:00.904083       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1485482Z [cluster1] I0720 02:26:00.938010       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1488958Z [cluster1] I0720 02:26:00.967868       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1492070Z [cluster1] I0720 02:26:01.279884       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1495139Z [cluster1] I0720 02:26:01.286521       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1498662Z [cluster1] E0720 02:26:01.299860       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1501193Z [cluster1] I0720 02:26:01.299902       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1502716Z [cluster1] I0720 02:26:01.299936       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1503885Z [cluster1] I0720 02:26:01.299949       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1506379Z [cluster1] I0720 02:26:01.314624       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1509513Z [cluster1] I0720 02:26:01.339035       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1512601Z [cluster1] I0720 02:26:01.369378       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1516089Z [cluster1] I0720 02:26:01.373437       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1519186Z [cluster1] I0720 02:26:01.620021       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1547226Z [cluster1] I0720 02:26:01.648292       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.1551412Z [cluster1] I0720 02:26:01.668606       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1555099Z [cluster1] I0720 02:26:01.741761       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1558768Z [cluster1] I0720 02:26:01.755227       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1562014Z [cluster1] I0720 02:26:02.089961       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1565499Z [cluster1] I0720 02:26:02.102773       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.1569349Z [cluster1] I0720 02:26:02.158094       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1572291Z [cluster1] I0720 02:26:02.218612       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1573894Z [cluster1] I0720 02:26:02.218663       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1575237Z [cluster1] I0720 02:26:02.218673       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1577597Z [cluster1] I0720 02:26:02.272321       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1580305Z [cluster1] I0720 02:26:02.285799       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1597364Z [cluster1] I0720 02:26:02.575142       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1600244Z [cluster1] I0720 02:26:02.603321       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1604770Z [cluster1] I0720 02:26:02.603357       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.1.232.25\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n\n"
2021-07-20T02:26:56.1608997Z [cluster1] I0720 02:26:02.687964       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1612308Z [cluster1] I0720 02:26:02.714658       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1615132Z [cluster1] I0720 02:26:02.817967       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1616872Z [cluster1] I0720 02:26:02.818007       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1618397Z [cluster1] I0720 02:26:02.818017       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1620466Z [cluster1] I0720 02:26:02.819054       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1622310Z [cluster1] I0720 02:26:02.819087       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1636194Z [cluster1] I0720 02:26:02.819096       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1639037Z [cluster1] I0720 02:26:02.855505       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1642513Z [cluster1] I0720 02:26:02.857749       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1645886Z [cluster1] I0720 02:26:02.894599       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1649353Z [cluster1] I0720 02:26:02.897092       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1652682Z [cluster1] I0720 02:26:03.296534       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1659493Z [cluster1] I0720 02:26:03.301686       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1662713Z [cluster1] I0720 02:26:03.383490       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1665832Z [cluster1] I0720 02:26:03.412871       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1668978Z [cluster1] I0720 02:26:04.917764       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1670601Z [cluster1] I0720 02:26:04.917815       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1671930Z [cluster1] I0720 02:26:04.917825       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1674200Z [cluster1] I0720 02:26:04.921110       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1677015Z [cluster1] I0720 02:26:04.949814       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1680084Z [cluster1] I0720 02:26:05.352983       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1682866Z [cluster1] I0720 02:26:05.357206       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1686373Z [cluster1] I0720 02:26:05.375207       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1688804Z [cluster1] I0720 02:26:05.379999       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1691564Z [cluster1] I0720 02:26:05.380098       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1693999Z [cluster1] I0720 02:26:05.380564       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1695744Z [cluster1] I0720 02:26:05.380776       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1697174Z [cluster1] I0720 02:26:05.380861       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1699792Z [cluster1] I0720 02:26:05.397136       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1703773Z [cluster1] I0720 02:26:05.397922       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1707205Z [cluster1] I0720 02:26:05.838816       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1710620Z [cluster1] I0720 02:26:05.838904       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1713972Z [cluster1] I0720 02:26:06.241142       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1718768Z [cluster1] I0720 02:26:06.245511       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1722179Z [cluster1] I0720 02:26:06.637134       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1725948Z [cluster1] I0720 02:26:06.639433       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1729799Z [cluster1] E0720 02:26:06.690858       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1733632Z [cluster1] I0720 02:26:06.692134       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1735387Z [cluster1] I0720 02:26:06.692173       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1736840Z [cluster1] I0720 02:26:06.692565       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1738915Z [cluster1] I0720 02:26:06.693447       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1740647Z [cluster1] I0720 02:26:06.693479       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1742097Z [cluster1] I0720 02:26:06.693494       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1744790Z [cluster1] I0720 02:26:06.735403       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1748766Z [cluster1] I0720 02:26:06.735484       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1752188Z [cluster1] I0720 02:26:06.788977       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1756977Z [cluster1] I0720 02:26:06.826633       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1760534Z [cluster1] E0720 02:26:06.864626       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.1763938Z [cluster1] I0720 02:26:07.190691       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1767365Z [cluster1] I0720 02:26:07.196274       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1770567Z [cluster1] I0720 02:26:07.228310       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1773642Z [cluster1] I0720 02:26:07.239122       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1776248Z [cluster1] I0720 02:26:07.247194       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1777851Z [cluster1] I0720 02:26:07.247303       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1779195Z [cluster1] I0720 02:26:07.266077       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1781569Z [cluster1] I0720 02:26:07.269170       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1785106Z [cluster1] I0720 02:26:07.273916       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1788036Z [cluster1] I0720 02:26:07.682997       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1790906Z [cluster1] I0720 02:26:07.685226       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1795664Z [cluster1] I0720 02:26:07.701154       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.1799616Z [cluster1] I0720 02:26:07.702272       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1803687Z [cluster1] I0720 02:26:07.748411       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1808962Z [cluster1] I0720 02:26:08.150082       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1812010Z [cluster1] I0720 02:26:08.156141       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-20T02:26:56.1815399Z [cluster1] I0720 02:26:08.160963       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1825744Z [cluster1] I0720 02:26:08.563146       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1830637Z [cluster1] I0720 02:26:08.565396       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1848471Z [cluster1] I0720 02:26:08.565578       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.1.232.25\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n\n\n"
2021-07-20T02:26:56.1851650Z [cluster1] I0720 02:26:25.041249       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1853259Z [cluster1] I0720 02:26:25.041294       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1854609Z [cluster1] I0720 02:26:25.041305       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1857000Z [cluster1] I0720 02:26:25.047647       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1860496Z [cluster1] I0720 02:26:25.050295       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1864152Z [cluster1] I0720 02:26:25.451529       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1867386Z [cluster1] I0720 02:26:25.454607       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1870006Z [cluster1] I0720 02:26:25.465858       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1871631Z [cluster1] I0720 02:26:25.466079       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1872954Z [cluster1] I0720 02:26:25.466333       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1874850Z [cluster1] I0720 02:26:25.466968       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1876539Z [cluster1] I0720 02:26:25.468049       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1877852Z [cluster1] I0720 02:26:25.468170       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1879951Z [cluster1] I0720 02:26:25.472122       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1883078Z [cluster1] I0720 02:26:25.473723       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1885861Z [cluster1] I0720 02:26:25.477414       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1888633Z [cluster1] I0720 02:26:25.478133       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1891338Z [cluster1] I0720 02:26:25.878636       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1894268Z [cluster1] I0720 02:26:25.881672       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1897038Z [cluster1] I0720 02:26:25.881728       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1900345Z [cluster1] I0720 02:26:25.887998       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1904047Z [cluster1] E0720 02:26:27.390640       1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-20T02:26:56.1906758Z [cluster1] I0720 02:26:30.055128       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1908376Z [cluster1] I0720 02:26:30.055176       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1909722Z [cluster1] I0720 02:26:30.055188       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1918677Z [cluster1] I0720 02:26:30.061061       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1922382Z [cluster1] I0720 02:26:30.065049       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1925917Z [cluster1] I0720 02:26:30.466770       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.1929240Z [cluster1] I0720 02:26:30.471291       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1932034Z [cluster1] I0720 02:26:30.479587       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1933779Z [cluster1] I0720 02:26:30.479744       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1935219Z [cluster1] I0720 02:26:30.479768       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1937240Z [cluster1] I0720 02:26:30.486843       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.1938832Z [cluster1] I0720 02:26:30.487002       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.1939995Z [cluster1] I0720 02:26:30.487026       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.1942049Z [cluster1] I0720 02:26:30.492600       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1989537Z [cluster1] I0720 02:26:30.495720       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1992716Z [cluster1] I0720 02:26:30.517231       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.1995666Z [cluster1] I0720 02:26:30.527951       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.1998365Z [cluster1] I0720 02:26:30.898023       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2001042Z [cluster1] I0720 02:26:30.901747       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2003879Z [cluster1] I0720 02:26:30.929709       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2006649Z [cluster1] I0720 02:26:30.933771       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2008911Z [cluster1] I0720 02:26:35.081118       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2010323Z [cluster1] I0720 02:26:35.081676       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2011493Z [cluster1] I0720 02:26:35.081844       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2013648Z [cluster1] I0720 02:26:35.088641       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2016868Z [cluster1] I0720 02:26:35.092024       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2019966Z [cluster1] I0720 02:26:35.493865       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2044505Z [cluster1] I0720 02:26:35.498937       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2046997Z [cluster1] I0720 02:26:35.509006       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2048570Z [cluster1] I0720 02:26:35.509055       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2049750Z [cluster1] I0720 02:26:35.509069       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2051423Z [cluster1] I0720 02:26:35.509870       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2052815Z [cluster1] I0720 02:26:35.509901       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2053981Z [cluster1] I0720 02:26:35.509911       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2056416Z [cluster1] I0720 02:26:35.512491       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2059459Z [cluster1] I0720 02:26:35.516117       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2062802Z [cluster1] I0720 02:26:35.520226       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2065979Z [cluster1] I0720 02:26:35.541653       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2069058Z [cluster1] I0720 02:26:35.922491       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2072324Z [cluster1] I0720 02:26:35.925574       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2075559Z [cluster1] I0720 02:26:35.943618       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2078632Z [cluster1] I0720 02:26:35.946724       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2081435Z [cluster1] I0720 02:26:40.093969       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2083244Z [cluster1] I0720 02:26:40.094033       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2084586Z [cluster1] I0720 02:26:40.094044       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2087233Z [cluster1] I0720 02:26:40.106399       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2090365Z [cluster1] I0720 02:26:40.116268       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2093476Z [cluster1] I0720 02:26:40.517907       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2096156Z [cluster1] I0720 02:26:40.520387       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2098434Z [cluster1] I0720 02:26:40.527175       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2099829Z [cluster1] I0720 02:26:40.527216       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2101053Z [cluster1] I0720 02:26:40.527227       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2141211Z [cluster1] I0720 02:26:40.529223       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2143270Z [cluster1] I0720 02:26:40.529251       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2144725Z [cluster1] I0720 02:26:40.529261       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2147441Z [cluster1] I0720 02:26:40.540621       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2150743Z [cluster1] I0720 02:26:40.550786       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2153871Z [cluster1] I0720 02:26:40.555025       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2157042Z [cluster1] I0720 02:26:40.555831       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2160125Z [cluster1] I0720 02:26:40.957246       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2163730Z [cluster1] I0720 02:26:40.960562       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2166422Z [cluster1] I0720 02:26:40.963358       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2169145Z [cluster1] I0720 02:26:40.964005       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2171655Z [cluster1] I0720 02:26:45.106976       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2173272Z [cluster1] I0720 02:26:45.107037       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2174611Z [cluster1] I0720 02:26:45.107046       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2176967Z [cluster1] I0720 02:26:45.119428       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2180171Z [cluster1] I0720 02:26:45.139065       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2213469Z [cluster1] I0720 02:26:45.541171       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2216725Z [cluster1] I0720 02:26:45.545746       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2219331Z [cluster1] I0720 02:26:45.556046       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2220956Z [cluster1] I0720 02:26:45.556146       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2222341Z [cluster1] I0720 02:26:45.556291       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2224808Z [cluster1] I0720 02:26:45.571273       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2227386Z [cluster1] I0720 02:26:45.572246       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2229237Z [cluster1] I0720 02:26:45.572362       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2230653Z [cluster1] I0720 02:26:45.572382       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2233353Z [cluster1] I0720 02:26:45.581369       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2236747Z [cluster1] I0720 02:26:45.594260       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2240132Z [cluster1] I0720 02:26:45.629129       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2243620Z [cluster1] I0720 02:26:45.998337       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2246767Z [cluster1] I0720 02:26:46.031086       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2249625Z [cluster1] I0720 02:26:46.059081       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2252435Z [cluster1] I0720 02:26:46.059798       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2254710Z [cluster1] I0720 02:26:50.124010       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2256095Z [cluster1] I0720 02:26:50.124059       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2257583Z [cluster1] I0720 02:26:50.124069       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2259952Z [cluster1] I0720 02:26:50.131518       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2263751Z [cluster1] I0720 02:26:50.136052       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2266916Z [cluster1] I0720 02:26:50.537186       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2270259Z [cluster1] I0720 02:26:50.542139       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2273589Z [cluster1] I0720 02:26:50.551547       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2275158Z [cluster1] I0720 02:26:50.551718       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2276330Z [cluster1] I0720 02:26:50.551738       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2278010Z [cluster1] I0720 02:26:50.552136       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2279647Z [cluster1] I0720 02:26:50.552361       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2280888Z [cluster1] I0720 02:26:50.552378       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2282971Z [cluster1] I0720 02:26:50.558522       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2286254Z [cluster1] I0720 02:26:50.563132       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2289073Z [cluster1] I0720 02:26:50.579900       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2292120Z [cluster1] I0720 02:26:50.583915       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2294818Z [cluster1] I0720 02:26:50.965328       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2297496Z [cluster1] I0720 02:26:50.968729       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2300182Z [cluster1] I0720 02:26:50.984934       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2303284Z [cluster1] I0720 02:26:50.987997       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2305963Z [cluster1] I0720 02:26:55.137133       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2307383Z [cluster1] I0720 02:26:55.137181       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2308537Z [cluster1] I0720 02:26:55.137192       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2312175Z [cluster1] I0720 02:26:55.150867       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2314912Z [cluster1] I0720 02:26:55.153530       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2317610Z [cluster1] I0720 02:26:55.556517       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2320281Z [cluster1] I0720 02:26:55.559232       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2322861Z [cluster1] I0720 02:26:55.566253       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2324276Z [cluster1] I0720 02:26:55.566430       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2325430Z [cluster1] I0720 02:26:55.566497       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2328014Z [cluster1] I0720 02:26:55.567183       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2329623Z [cluster1] I0720 02:26:55.567333       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2331186Z [cluster1] I0720 02:26:55.567401       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-20T02:26:56.2333775Z [cluster1] I0720 02:26:55.578588       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2337696Z [cluster1] I0720 02:26:55.580244       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2341811Z [cluster1] I0720 02:26:55.591563       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2346151Z [cluster1] I0720 02:26:55.605061       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2350128Z [cluster1] I0720 02:26:55.993044       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2356079Z [cluster1] I0720 02:26:55.996971       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2359689Z [cluster1] I0720 02:26:56.006173       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2363778Z [cluster1] I0720 02:26:56.014736       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespars.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2367150Z [cluster2] I0720 02:26:55.061462       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2368891Z [cluster2] I0720 02:26:55.061891       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2370356Z [cluster2] I0720 02:26:55.062017       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:56.2372406Z [cluster2] I0720 02:26:55.063597       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-20T02:26:56.2374224Z [cluster2] I0720 02:26:55.063810       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-20T02:26:56.2375669Z [cluster2] I0720 02:26:55.063999       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-20T02:26:56.2378264Z [cluster2] I0720 02:26:55.064932       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2381573Z [cluster2] I0720 02:26:55.068016       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2385611Z [cluster2] I0720 02:26:55.073727       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2389046Z [cluster2] I0720 02:26:55.087335       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-20T02:26:56.2392408Z [cluster2] I0720 02:26:55.475008       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2395717Z [cluster2] I0720 02:26:55.477750       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2398983Z [cluster2] I0720 02:26:55.488445       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-20T02:26:56.2402120Z [cluster2] I0720 02:26:55.491331       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:56.2404061Z [36m[submariner-operator]$ [cluster2] verify_subm_cr[0m
2021-07-20T02:26:56.2405014Z [36m[submariner-operator]$ [cluster2] verify_subm_cr[0m
2021-07-20T02:26:56.2406772Z [36m[submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator[0m
2021-07-20T02:26:56.2408075Z [36m[submariner-operator]$ [cluster2] grep submariner[0m
2021-07-20T02:26:56.2409398Z [36m[submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator[0m
2021-07-20T02:26:56.2411446Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner --namespace=submariner-operator[0m
2021-07-20T02:26:56.2412585Z [cluster2] submariner   69s
2021-07-20T02:26:56.2413649Z [36m[submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json[0m
2021-07-20T02:26:56.5812751Z [36m[submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-20T02:26:56.5814303Z [36m[submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-20T02:26:56.5815814Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-20T02:26:56.5817410Z [36m[submariner-operator]$ [cluster2] tee /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:56.5818064Z [cluster2] {
2021-07-20T02:26:56.5818564Z [cluster2]     "apiVersion": "submariner.io/v1alpha1",
2021-07-20T02:26:56.5819124Z [cluster2]     "kind": "Submariner",
2021-07-20T02:26:56.5819554Z [cluster2]     "metadata": {
2021-07-20T02:26:56.5820229Z [cluster2]         "creationTimestamp": "2021-07-20T02:25:47Z",
2021-07-20T02:26:56.5820748Z [cluster2]         "generation": 1,
2021-07-20T02:26:56.5821217Z [cluster2]         "name": "submariner",
2021-07-20T02:26:56.5822171Z [cluster2]         "namespace": "submariner-operator",
2021-07-20T02:26:56.5823402Z [cluster2]         "resourceVersion": "2140",
2021-07-20T02:26:56.5824606Z [cluster2]         "selfLink": "/apis/submariner.io/v1alpha1/namespaces/submariner-operator/submariners/submariner",
2021-07-20T02:26:56.5826097Z [cluster2]         "uid": "139b4f4b-5cad-4076-a420-000b48baba25"
2021-07-20T02:26:56.5826846Z [cluster2]     },
2021-07-20T02:26:56.5827275Z [cluster2]     "spec": {
2021-07-20T02:26:56.5827763Z [cluster2]         "broker": "k8s",
2021-07-20T02:26:56.5828389Z [cluster2]         "brokerK8sApiServer": "172.18.0.4:6443",
2021-07-20T02:26:56.6011919Z [cluster2]         "brokerK8sApiServerToken": "***",
2021-07-20T02:26:56.6516462Z [cluster2]         "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=",
2021-07-20T02:26:56.6997817Z [cluster2]         "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-20T02:26:56.6998834Z [cluster2]         "cableDriver": "libreswan",
2021-07-20T02:26:56.6999496Z [cluster2]         "ceIPSecDebug": false,
2021-07-20T02:26:56.7000145Z [cluster2]         "ceIPSecIKEPort": 500,
2021-07-20T02:26:56.7000823Z [cluster2]         "ceIPSecNATTPort": 4500,
2021-07-20T02:26:56.7002748Z [cluster2]         "ceIPSecPSK": "RxKqGCxyc6/0hWrNf9qeaSCnys+VhG5BNpkVtfXDj+mujGbyv5zlvTp2/mnlxtXH",
2021-07-20T02:26:56.7004119Z [cluster2]         "clusterCIDR": "",
2021-07-20T02:26:56.7004710Z [cluster2]         "clusterID": "cluster2",
2021-07-20T02:26:56.7005312Z [cluster2]         "colorCodes": "blue",
2021-07-20T02:26:56.7005988Z [cluster2]         "connectionHealthCheck": {
2021-07-20T02:26:56.7006675Z [cluster2]             "enabled": true,
2021-07-20T02:26:56.7007434Z [cluster2]             "intervalSeconds": 1,
2021-07-20T02:26:56.7008116Z [cluster2]             "maxPacketLossCount": 5
2021-07-20T02:26:56.7008690Z [cluster2]         },
2021-07-20T02:26:56.7009152Z [cluster2]         "debug": false,
2021-07-20T02:26:56.7010101Z [cluster2]         "namespace": "submariner-operator",
2021-07-20T02:26:56.7010831Z [cluster2]         "natEnabled": false,
2021-07-20T02:26:56.7011443Z [cluster2]         "repository": "localhost:5000",
2021-07-20T02:26:56.7012311Z [cluster2]         "serviceCIDR": "",
2021-07-20T02:26:56.7013027Z [cluster2]         "serviceDiscoveryEnabled": true,
2021-07-20T02:26:56.7013753Z [cluster2]         "version": "local"
2021-07-20T02:26:56.7014324Z [cluster2]     },
2021-07-20T02:26:56.7014740Z [cluster2]     "status": {
2021-07-20T02:26:56.7015222Z [cluster2]         "clusterCIDR": "10.2.0.0/16",
2021-07-20T02:26:56.7015969Z [cluster2]         "clusterID": "cluster2",
2021-07-20T02:26:56.7016558Z [cluster2]         "colorCodes": "blue",
2021-07-20T02:26:56.7017165Z [cluster2]         "deploymentInfo": {},
2021-07-20T02:26:56.7017881Z [cluster2]         "gatewayDaemonSetStatus": {
2021-07-20T02:26:56.7018682Z [cluster2]             "lastResourceVersion": "1923",
2021-07-20T02:26:56.7019545Z [cluster2]             "mismatchedContainerImages": false,
2021-07-20T02:26:56.7020442Z [cluster2]             "nonReadyContainerStates": [],
2021-07-20T02:26:56.7021118Z [cluster2]             "status": {
2021-07-20T02:26:56.7021772Z [cluster2]                 "currentNumberScheduled": 1,
2021-07-20T02:26:56.7022890Z [cluster2]                 "desiredNumberScheduled": 1,
2021-07-20T02:26:56.7023714Z [cluster2]                 "numberAvailable": 1,
2021-07-20T02:26:56.7024410Z [cluster2]                 "numberMisscheduled": 0,
2021-07-20T02:26:56.7025050Z [cluster2]                 "numberReady": 1,
2021-07-20T02:26:56.7025706Z [cluster2]                 "observedGeneration": 1,
2021-07-20T02:26:56.7026505Z [cluster2]                 "updatedNumberScheduled": 1
2021-07-20T02:26:56.7027130Z [cluster2]             }
2021-07-20T02:26:56.7027641Z [cluster2]         },
2021-07-20T02:26:56.7028061Z [cluster2]         "gateways": [
2021-07-20T02:26:56.7028882Z [cluster2]             {
2021-07-20T02:26:56.7029342Z [cluster2]                 "connections": [
2021-07-20T02:26:56.7029821Z [cluster2]                     {
2021-07-20T02:26:56.7030283Z [cluster2]                         "endpoint": {
2021-07-20T02:26:56.7030934Z [cluster2]                             "backend": "libreswan",
2021-07-20T02:26:56.7031511Z [cluster2]                             "backend_config": {
2021-07-20T02:26:56.7032418Z [cluster2]                                 "natt-discovery-port": "4490",
2021-07-20T02:26:56.7033319Z [cluster2]                                 "preferred-server": "false"
2021-07-20T02:26:56.7033906Z [cluster2]                             },
2021-07-20T02:26:56.7035097Z [cluster2]                             "cable_name": "submariner-cable-cluster1-172-18-0-6",
2021-07-20T02:26:56.7036041Z [cluster2]                             "cluster_id": "cluster1",
2021-07-20T02:26:56.7036809Z [cluster2]                             "healthCheckIP": "10.1.128.0",
2021-07-20T02:26:56.7037677Z [cluster2]                             "hostname": "cluster1-worker",
2021-07-20T02:26:56.7038314Z [cluster2]                             "nat_enabled": false,
2021-07-20T02:26:56.7038876Z [cluster2]                             "private_ip": "172.18.0.6",
2021-07-20T02:26:56.7039410Z [cluster2]                             "public_ip": "52.251.49.70",
2021-07-20T02:26:56.7039927Z [cluster2]                             "subnets": [
2021-07-20T02:26:56.7040397Z [cluster2]                                 "100.1.0.0/16",
2021-07-20T02:26:56.7040863Z [cluster2]                                 "10.1.0.0/16"
2021-07-20T02:26:56.7041291Z [cluster2]                             ]
2021-07-20T02:26:56.7041724Z [cluster2]                         },
2021-07-20T02:26:56.7042209Z [cluster2]                         "latencyRTT": {
2021-07-20T02:26:56.7042919Z [cluster2]                             "average": "144.015µs",
2021-07-20T02:26:56.7043593Z [cluster2]                             "last": "116.708µs",
2021-07-20T02:26:56.7044226Z [cluster2]                             "max": "295.319µs",
2021-07-20T02:26:56.7044869Z [cluster2]                             "min": "93.406µs",
2021-07-20T02:26:56.7045515Z [cluster2]                             "stdDev": "41.524µs"
2021-07-20T02:26:56.7046093Z [cluster2]                         },
2021-07-20T02:26:56.7046880Z [cluster2]                         "status": "connected",
2021-07-20T02:26:56.7047659Z [cluster2]                         "statusMessage": "",
2021-07-20T02:26:56.7048224Z [cluster2]                         "usingIP": "172.18.0.6"
2021-07-20T02:26:56.7048677Z [cluster2]                     }
2021-07-20T02:26:56.7049096Z [cluster2]                 ],
2021-07-20T02:26:56.7049577Z [cluster2]                 "haStatus": "active",
2021-07-20T02:26:56.7050144Z [cluster2]                 "localEndpoint": {
2021-07-20T02:26:56.7050708Z [cluster2]                     "backend": "libreswan",
2021-07-20T02:26:56.7051269Z [cluster2]                     "backend_config": {
2021-07-20T02:26:56.7052103Z [cluster2]                         "natt-discovery-port": "4490",
2021-07-20T02:26:56.7052971Z [cluster2]                         "preferred-server": "false"
2021-07-20T02:26:56.7053521Z [cluster2]                     },
2021-07-20T02:26:56.7054554Z [cluster2]                     "cable_name": "submariner-cable-cluster2-172-18-0-7",
2021-07-20T02:26:56.7055472Z [cluster2]                     "cluster_id": "cluster2",
2021-07-20T02:26:56.7056055Z [cluster2]                     "healthCheckIP": "10.2.0.2",
2021-07-20T02:26:56.7056868Z [cluster2]                     "hostname": "cluster2-worker",
2021-07-20T02:26:56.7057489Z [cluster2]                     "nat_enabled": false,
2021-07-20T02:26:56.7058040Z [cluster2]                     "private_ip": "172.18.0.7",
2021-07-20T02:26:56.7058550Z [cluster2]                     "public_ip": "52.251.49.70",
2021-07-20T02:26:56.7059056Z [cluster2]                     "subnets": [
2021-07-20T02:26:56.7059506Z [cluster2]                         "100.2.0.0/16",
2021-07-20T02:26:56.9696634Z [cluster2]                         "10.2.0.0/16"
2021-07-20T02:26:56.9697221Z [cluster2]                     ]
2021-07-20T02:26:56.9697626Z [cluster2]                 },
2021-07-20T02:26:56.9698157Z [cluster2]                 "statusFailure": "",
2021-07-20T02:26:56.9699310Z [cluster2]                 "version": "devel-1441a80"
2021-07-20T02:26:56.9699824Z [cluster2]             }
2021-07-20T02:26:56.9700209Z [cluster2]         ],
2021-07-20T02:26:56.9700830Z [cluster2]         "globalnetDaemonSetStatus": {
2021-07-20T02:26:56.9701678Z [cluster2]             "mismatchedContainerImages": false
2021-07-20T02:26:56.9702327Z [cluster2]         },
2021-07-20T02:26:56.9703554Z [cluster2]         "loadBalancerStatus": {},
2021-07-20T02:26:56.9704177Z [cluster2]         "natEnabled": false,
2021-07-20T02:26:56.9704989Z [cluster2]         "networkPlugin": "weave-net",
2021-07-20T02:26:56.9705761Z [cluster2]         "routeAgentDaemonSetStatus": {
2021-07-20T02:26:56.9706545Z [cluster2]             "lastResourceVersion": "1965",
2021-07-20T02:26:56.9707335Z [cluster2]             "mismatchedContainerImages": false,
2021-07-20T02:26:56.9708190Z [cluster2]             "nonReadyContainerStates": [],
2021-07-20T02:26:56.9709026Z [cluster2]             "status": {
2021-07-20T02:26:56.9709700Z [cluster2]                 "currentNumberScheduled": 3,
2021-07-20T02:26:56.9710532Z [cluster2]                 "desiredNumberScheduled": 3,
2021-07-20T02:26:56.9711284Z [cluster2]                 "numberAvailable": 3,
2021-07-20T02:26:56.9711967Z [cluster2]                 "numberMisscheduled": 0,
2021-07-20T02:26:56.9712714Z [cluster2]                 "numberReady": 3,
2021-07-20T02:26:56.9713384Z [cluster2]                 "observedGeneration": 1,
2021-07-20T02:26:56.9714163Z [cluster2]                 "updatedNumberScheduled": 3
2021-07-20T02:26:56.9714802Z [cluster2]             }
2021-07-20T02:26:56.9715220Z [cluster2]         },
2021-07-20T02:26:56.9715733Z [cluster2]         "serviceCIDR": "100.2.0.0/16"
2021-07-20T02:26:56.9716226Z [cluster2]     }
2021-07-20T02:26:56.9716640Z [cluster2] }
2021-07-20T02:26:56.9717800Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator[0m
2021-07-20T02:26:56.9719601Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator[0m
2021-07-20T02:26:56.9721280Z [36m[submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:56.9722871Z [36m[submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1[0m
2021-07-20T02:26:56.9724311Z [36m[submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1[0m
2021-07-20T02:26:56.9725802Z [36m[submariner-operator]$ [cluster2] jq -r -M .apiVersion /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:56.9727192Z [36m[submariner-operator]$ [cluster2] validate_equals .kind Submariner[0m
2021-07-20T02:26:56.9728392Z [36m[submariner-operator]$ [cluster2] validate_equals .kind Submariner[0m
2021-07-20T02:26:56.9729733Z [36m[submariner-operator]$ [cluster2] jq -r -M .kind /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:56.9731139Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name submariner[0m
2021-07-20T02:26:56.9732484Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.name submariner[0m
2021-07-20T02:26:56.9734082Z [36m[submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:56.9735643Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.4:6443[0m
2021-07-20T02:26:56.9737184Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.4:6443[0m
2021-07-20T02:26:56.9738880Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:56.9932265Z [36m[submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-20T02:26:57.0417775Z [36m[submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-20T02:26:57.0420101Z [36m[submariner-operator]$ [cluster1] verify_subm_cr[0m
2021-07-20T02:26:57.0421133Z [36m[submariner-operator]$ [cluster1] verify_subm_cr[0m
2021-07-20T02:26:57.0422677Z [36m[submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator[0m
2021-07-20T02:26:57.0423981Z [36m[submariner-operator]$ [cluster1] grep submariner[0m
2021-07-20T02:26:57.0425428Z [36m[submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator[0m
2021-07-20T02:26:57.0427356Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner --namespace=submariner-operator[0m
2021-07-20T02:26:57.0428436Z [cluster1] submariner   75s
2021-07-20T02:26:57.0429538Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json[0m
2021-07-20T02:26:57.0431172Z [36m[submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-20T02:26:57.0432726Z [36m[submariner-operator]$ [cluster1] tee /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:57.0434311Z [36m[submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-20T02:26:57.0436188Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-20T02:26:57.0437170Z [cluster1] {
2021-07-20T02:26:57.0437735Z [cluster1]     "apiVersion": "submariner.io/v1alpha1",
2021-07-20T02:26:57.0440820Z [cluster1]     "kind": "Submariner",
2021-07-20T02:26:57.0441456Z [cluster1]     "metadata": {
2021-07-20T02:26:57.0442398Z [cluster1]         "creationTimestamp": "2021-07-20T02:25:41Z",
2021-07-20T02:26:57.0443166Z [cluster1]         "generation": 1,
2021-07-20T02:26:57.0443739Z [cluster1]         "name": "submariner",
2021-07-20T02:26:57.0444618Z [cluster1]         "namespace": "submariner-operator",
2021-07-20T02:26:57.0445381Z [cluster1]         "resourceVersion": "2289",
2021-07-20T02:26:57.0446852Z [cluster1]         "selfLink": "/apis/submariner.io/v1alpha1/namespaces/submariner-operator/submariners/submariner",
2021-07-20T02:26:57.0448158Z [cluster1]         "uid": "99de4265-3852-4027-8fd6-1532ace8992e"
2021-07-20T02:26:57.0448819Z [cluster1]     },
2021-07-20T02:26:57.0449269Z [cluster1]     "spec": {
2021-07-20T02:26:57.0449748Z [cluster1]         "broker": "k8s",
2021-07-20T02:26:57.0450399Z [cluster1]         "brokerK8sApiServer": "172.18.0.4:6443",
2021-07-20T02:26:57.0654435Z [cluster1]         "brokerK8sApiServerToken": "***",
2021-07-20T02:26:57.1143213Z [cluster1]         "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=",
2021-07-20T02:26:57.1641695Z [cluster1]         "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-20T02:26:57.1642671Z [cluster1]         "cableDriver": "libreswan",
2021-07-20T02:26:57.1643288Z [cluster1]         "ceIPSecDebug": false,
2021-07-20T02:26:57.1643968Z [cluster1]         "ceIPSecIKEPort": 500,
2021-07-20T02:26:57.1644482Z [cluster1]         "ceIPSecNATTPort": 4500,
2021-07-20T02:26:57.1645549Z [cluster1]         "ceIPSecPSK": "RxKqGCxyc6/0hWrNf9qeaSCnys+VhG5BNpkVtfXDj+mujGbyv5zlvTp2/mnlxtXH",
2021-07-20T02:26:57.1646879Z [cluster1]         "clusterCIDR": "",
2021-07-20T02:26:57.1647364Z [cluster1]         "clusterID": "cluster1",
2021-07-20T02:26:57.1647857Z [cluster1]         "colorCodes": "blue",
2021-07-20T02:26:57.1648602Z [cluster1]         "connectionHealthCheck": {
2021-07-20T02:26:57.1650406Z [cluster1]             "enabled": true,
2021-07-20T02:26:57.1651019Z [cluster1]             "intervalSeconds": 1,
2021-07-20T02:26:57.1651602Z [cluster1]             "maxPacketLossCount": 5
2021-07-20T02:26:57.1652067Z [cluster1]         },
2021-07-20T02:26:57.1652458Z [cluster1]         "debug": false,
2021-07-20T02:26:57.1653254Z [cluster1]         "namespace": "submariner-operator",
2021-07-20T02:26:57.1653845Z [cluster1]         "natEnabled": false,
2021-07-20T02:26:57.1654359Z [cluster1]         "repository": "localhost:5000",
2021-07-20T02:26:57.1654846Z [cluster1]         "serviceCIDR": "",
2021-07-20T02:26:57.1655444Z [cluster1]         "serviceDiscoveryEnabled": true,
2021-07-20T02:26:57.1656018Z [cluster1]         "version": "local"
2021-07-20T02:26:57.1656414Z [cluster1]     },
2021-07-20T02:26:57.1656764Z [cluster1]     "status": {
2021-07-20T02:26:57.1657197Z [cluster1]         "clusterCIDR": "10.1.0.0/16",
2021-07-20T02:26:57.1657898Z [cluster1]         "clusterID": "cluster1",
2021-07-20T02:26:57.1658634Z [cluster1]         "colorCodes": "blue",
2021-07-20T02:26:57.1659225Z [cluster1]         "deploymentInfo": {},
2021-07-20T02:26:57.1659953Z [cluster1]         "gatewayDaemonSetStatus": {
2021-07-20T02:26:57.1660965Z [cluster1]             "lastResourceVersion": "1954",
2021-07-20T02:26:57.1661821Z [cluster1]             "mismatchedContainerImages": false,
2021-07-20T02:26:57.1662852Z [cluster1]             "nonReadyContainerStates": [],
2021-07-20T02:26:57.1663522Z [cluster1]             "status": {
2021-07-20T02:26:57.1664198Z [cluster1]                 "currentNumberScheduled": 1,
2021-07-20T02:26:57.1665025Z [cluster1]                 "desiredNumberScheduled": 1,
2021-07-20T02:26:57.1665784Z [cluster1]                 "numberAvailable": 1,
2021-07-20T02:26:57.1666468Z [cluster1]                 "numberMisscheduled": 0,
2021-07-20T02:26:57.1667127Z [cluster1]                 "numberReady": 1,
2021-07-20T02:26:57.1667787Z [cluster1]                 "observedGeneration": 1,
2021-07-20T02:26:57.1668560Z [cluster1]                 "updatedNumberScheduled": 1
2021-07-20T02:26:57.1669203Z [cluster1]             }
2021-07-20T02:26:57.1669620Z [cluster1]         },
2021-07-20T02:26:57.1670194Z [cluster1]         "gateways": [
2021-07-20T02:26:57.1670623Z [cluster1]             {
2021-07-20T02:26:57.1671200Z [cluster1]                 "connections": [
2021-07-20T02:26:57.1671601Z [cluster1]                     {
2021-07-20T02:26:57.1672014Z [cluster1]                         "endpoint": {
2021-07-20T02:26:57.1672484Z [cluster1]                             "backend": "libreswan",
2021-07-20T02:26:57.1672981Z [cluster1]                             "backend_config": {
2021-07-20T02:26:57.1673728Z [cluster1]                                 "natt-discovery-port": "4490",
2021-07-20T02:26:57.1674511Z [cluster1]                                 "preferred-server": "false"
2021-07-20T02:26:57.1675021Z [cluster1]                             },
2021-07-20T02:26:57.1675921Z [cluster1]                             "cable_name": "submariner-cable-cluster2-172-18-0-7",
2021-07-20T02:26:57.1678581Z [cluster1]                             "cluster_id": "cluster2",
2021-07-20T02:26:57.1679125Z [cluster1]                             "healthCheckIP": "10.2.0.2",
2021-07-20T02:26:57.1679970Z [cluster1]                             "hostname": "cluster2-worker",
2021-07-20T02:26:57.1680519Z [cluster1]                             "nat_enabled": false,
2021-07-20T02:26:57.1681012Z [cluster1]                             "private_ip": "172.18.0.7",
2021-07-20T02:26:57.1681665Z [cluster1]                             "public_ip": "52.251.49.70",
2021-07-20T02:26:57.1682362Z [cluster1]                             "subnets": [
2021-07-20T02:26:57.1683004Z [cluster1]                                 "100.2.0.0/16",
2021-07-20T02:26:57.1683459Z [cluster1]                                 "10.2.0.0/16"
2021-07-20T02:26:57.1683906Z [cluster1]                             ]
2021-07-20T02:26:57.1684317Z [cluster1]                         },
2021-07-20T02:26:57.1684802Z [cluster1]                         "latencyRTT": {
2021-07-20T02:26:57.1685817Z [cluster1]                             "average": "246.506µs",
2021-07-20T02:26:57.1686550Z [cluster1]                             "last": "130.909µs",
2021-07-20T02:26:57.1687086Z [cluster1]                             "max": "2.383349ms",
2021-07-20T02:26:57.1687764Z [cluster1]                             "min": "130.909µs",
2021-07-20T02:26:57.1688940Z [cluster1]                             "stdDev": "374.322µs"
2021-07-20T02:26:57.1689457Z [cluster1]                         },
2021-07-20T02:26:57.1690004Z [cluster1]                         "status": "connected",
2021-07-20T02:26:57.1690634Z [cluster1]                         "statusMessage": "",
2021-07-20T02:26:57.1691449Z [cluster1]                         "usingIP": "172.18.0.7"
2021-07-20T02:26:57.1692094Z [cluster1]                     }
2021-07-20T02:26:57.1692547Z [cluster1]                 ],
2021-07-20T02:26:57.1693051Z [cluster1]                 "haStatus": "active",
2021-07-20T02:26:57.1693657Z [cluster1]                 "localEndpoint": {
2021-07-20T02:26:57.1694277Z [cluster1]                     "backend": "libreswan",
2021-07-20T02:26:57.1751106Z [cluster1]        L3NlY3JldC5uYW1lIjoic3VibWFyaW5lci1rOHMtYnJva2VyLWNsaWVudC10b2tlbi1ncWRzZyIsImt1YmVybmV0ZXMuaW8vc2VydmljZWFjY291bnQvc2VydmljZS1hY2NvdW50Lm5hbWUiOiJzdWJtYXJpbmVyLWs4cy1icm9rZXItY2xpZW50Iiwia3ViZXJuZXRlcy5pby9zZXJ2aWNlYWNjb3VudC9zZXJ2aWNlLWFjY291bnQudWlkIjoiYWIwYWVlNDItYzJlZS00MjU3LWIzNmYtODFmOTIxN2NmNGFlIiwic3ViIjoic3lzdGVtOnNlcnZpY2VhY2NvdW50OnN1Ym1hcmluZXItazhzLWJyb2tlcjpzdWJtYXJpbmVyLWs4cy1icm9rZXItY2xpZW50In0.D2ZjRQ6tjYxe3CJGOJsJOO_JNQK5TMIlfieZEXSNvTlNPrytKrxyMehScpGXCcl8uBEI-L69fqbns2A1ZLGuC-j76tLWRjxs1kLCvhZbgFpPZmbs4v5jU0x8WP8eoLsshHhRK5lgOg5Y0ND0AeuFBoS7jo-9vgzYeP12uGUjt6CNAyGi4wtX__PmB8lEYUp_uI2pdjX3EBBPlfcHa0z9sIRj00pOtHeODdsit8Nhm-o3fOrZDQTR-Fw2t11_EkN8WSKNNZdngLfn9psQEA00gFoxTNBqLjePUCzXtPJCYf6EtdX62fHxFEXWow_B7EtZ_xGOuU30P0rRMUx9QleF6w[0m
2021-07-20T02:26:57.1808194Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:57.2459188Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-20T02:26:57.3592515Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-20T02:26:57.4145223Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:57.4147158Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker[0m
2021-07-20T02:26:57.4149493Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker[0m
2021-07-20T02:26:57.4151030Z [36m             "backend_config": {
2021-07-20T02:26:57.4151794Z [cluster1]                         "natt-discovery-port": "4490",
2021-07-20T02:26:57.4152722Z [cluster1]                         "preferred-server": "false"
2021-07-20T02:26:57.4153217Z [cluster1]                     },
2021-07-20T02:26:57.4154110Z [cluster1]                     "cable_name": "submariner-cable-cluster1-172-18-0-6",
2021-07-20T02:26:57.4154914Z [cluster1]                     "cluster_id": "cluster1",
2021-07-20T02:26:57.4155429Z [cluster1]                     "healthCheckIP": "10.1.128.0",
2021-07-20T02:26:57.4156382Z [cluster1]                     "hostname": "cluster1-worker",
2021-07-20T02:26:57.4157097Z [cluster1]                     "nat_enabled": false,
2021-07-20T02:26:57.4157563Z [cluster1]                     "private_ip": "172.18.0.6",
2021-07-20T02:26:57.4158033Z [cluster1]                     "public_ip": "52.251.49.70",
2021-07-20T02:26:57.4158456Z [cluster1]                     "subnets": [
2021-07-20T02:26:57.4158870Z [cluster1]                         "100.1.0.0/16",
2021-07-20T02:26:57.4159250Z [cluster1]                         "10.1.0.0/16"
2021-07-20T02:26:57.4159627Z [cluster1]                     ]
2021-07-20T02:26:57.4159974Z [cluster1]                 },
2021-07-20T02:26:57.4160414Z [cluster1]                 "statusFailure": "",
2021-07-20T02:26:57.4161098Z [cluster1]                 "version": "devel-1441a80"
2021-07-20T02:26:57.4161522Z [cluster1]             }
2021-07-20T02:26:57.4161872Z [cluster1]         ],
2021-07-20T02:26:57.4162392Z [cluster1]         "globalnetDaemonSetStatus": {
2021-07-20T02:26:57.4163146Z [cluster1]             "mismatchedContainerImages": false
2021-07-20T02:26:57.4163695Z [cluster1]         },
2021-07-20T02:26:57.4164155Z [cluster1]         "loadBalancerStatus": {},
2021-07-20T02:26:57.4164679Z [cluster1]         "natEnabled": false,
2021-07-20T02:26:57.4165349Z [cluster1]         "networkPlugin": "weave-net",
2021-07-20T02:26:57.4166004Z [cluster1]         "routeAgentDaemonSetStatus": {
2021-07-20T02:26:57.4166683Z [cluster1]             "lastResourceVersion": "2018",
2021-07-20T02:26:57.4167382Z [cluster1]             "mismatchedContainerImages": false,
2021-07-20T02:26:57.4168111Z [cluster1]             "nonReadyContainerStates": [],
2021-07-20T02:26:57.4168778Z [cluster1]             "status": {
2021-07-20T02:26:57.4169316Z [cluster1]                 "currentNumberScheduled": 3,
2021-07-20T02:26:57.4170004Z [cluster1]                 "desiredNumberScheduled": 3,
2021-07-20T02:26:57.4170604Z [cluster1]                 "numberAvailable": 3,
2021-07-20T02:26:57.4171171Z [cluster1]                 "numberMisscheduled": 0,
2021-07-20T02:26:57.4171692Z [cluster1]                 "numberReady": 3,
2021-07-20T02:26:57.4172226Z [cluster1]                 "observedGeneration": 1,
2021-07-20T02:26:57.4172860Z [cluster1]                 "updatedNumberScheduled": 3
2021-07-20T02:26:57.4173381Z [cluster1]             }
2021-07-20T02:26:57.4173730Z [cluster1]         },
2021-07-20T02:26:57.4174137Z [cluster1]         "serviceCIDR": "100.1.0.0/16"
2021-07-20T02:26:57.4174543Z [cluster1]     }
2021-07-20T02:26:57.4174867Z [cluster1] }
2021-07-20T02:26:57.4175817Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator[0m
2021-07-20T02:26:57.4177149Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator[0m
2021-07-20T02:26:57.4178837Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:57.4180317Z [36m[submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1[0m
2021-07-20T02:26:57.4181642Z [36m[submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1[0m
2021-07-20T02:26:57.4183146Z [36m[submariner-operator]$ [cluster1] jq -r -M .apiVersion /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:57.4184517Z [36m[submariner-operator]$ [cluster1] validate_equals .kind Submariner[0m
2021-07-20T02:26:57.4185637Z [36m[submariner-operator]$ [cluster1] validate_equals .kind Submariner[0m
2021-07-20T02:26:57.4186855Z [36m[submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:57.4188162Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name submariner[0m
2021-07-20T02:26:57.4189394Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.name submariner[0m
2021-07-20T02:26:57.4190715Z [36m[submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:57.4192000Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.4:6443[0m
2021-07-20T02:26:57.4193412Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.4:6443[0m
2021-07-20T02:26:57.4195216Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:57.4333971Z [36m[submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-20T02:26:57.4477169Z [36m[submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-20T02:26:57.4478998Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:57.4986689Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-20T02:26:58.1027612Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-20T02:26:58.1576238Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1578227Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker[0m
2021-07-20T02:26:58.1580260Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker[0m
2021-07-20T02:26:58.1582300Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1584547Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false[0m
2021-07-20T02:26:58.1585955Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false[0m
2021-07-20T02:26:58.1587396Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1588811Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500[0m
2021-07-20T02:26:58.1590365Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500[0m
2021-07-20T02:26:58.1591941Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1594059Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500[0m
2021-07-20T02:26:58.1595618Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500[0m
2021-07-20T02:26:58.1597213Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1598803Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000[0m
2021-07-20T02:26:58.1600175Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000[0m
2021-07-20T02:26:58.1601683Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.repository /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1603109Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.version local[0m
2021-07-20T02:26:58.1605086Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.version local[0m
2021-07-20T02:26:58.1606721Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.version /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1608686Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.broker k8s[0m
2021-07-20T02:26:58.1609909Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.broker k8s[0m
2021-07-20T02:26:58.1611296Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.broker /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1612888Z [36m[submariner-operator]$ [cluster1] jq -r .spec.clusterID /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1613938Z [cluster1] Generated cluster id: cluster1
2021-07-20T02:26:58.1615486Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue[0m
2021-07-20T02:26:58.1616857Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue[0m
2021-07-20T02:26:58.1618343Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.colorCodes /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1619781Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.debug false[0m
2021-07-20T02:26:58.1620987Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.debug false[0m
2021-07-20T02:26:58.1622485Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.debug /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1624049Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator[0m
2021-07-20T02:26:58.1626190Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator[0m
2021-07-20T02:26:58.1627838Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.namespace /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1629289Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false[0m
2021-07-20T02:26:58.1630605Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false[0m
2021-07-20T02:26:58.1632075Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.natEnabled /tmp/submariner.cluster1.json[0m
2021-07-20T02:26:58.1633482Z [36m[submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries[0m
2021-07-20T02:26:58.1634662Z [36m[submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries[0m
2021-07-20T02:26:58.1635835Z [36m[submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_[0m
2021-07-20T02:26:58.1637444Z [36m[submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_[0m
2021-07-20T02:26:58.1638532Z [36m[submariner-operator]$ [cluster1] iteration=1[0m
2021-07-20T02:26:58.1852247Z [36m[submariner-operator]$ [cluster1] verify_subm_cr_sta[submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1854121Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false[0m
2021-07-20T02:26:58.1855507Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false[0m
2021-07-20T02:26:58.1856991Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1858429Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500[0m
2021-07-20T02:26:58.1859789Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500[0m
2021-07-20T02:26:58.1861500Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1863535Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500[0m
2021-07-20T02:26:58.1864971Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500[0m
2021-07-20T02:26:58.1866561Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1868146Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000[0m
2021-07-20T02:26:58.1869696Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000[0m
2021-07-20T02:26:58.1871325Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.repository /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1872652Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.version local[0m
2021-07-20T02:26:58.1873792Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.version local[0m
2021-07-20T02:26:58.1875109Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.version /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1876382Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.broker k8s[0m
2021-07-20T02:26:58.1877510Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.broker k8s[0m
2021-07-20T02:26:58.1878798Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.broker /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1880248Z [36m[submariner-operator]$ [cluster2] jq -r .spec.clusterID /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1881215Z [cluster2] Generated cluster id: cluster2
2021-07-20T02:26:58.1882216Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue[0m
2021-07-20T02:26:58.1883432Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue[0m
2021-07-20T02:26:58.1884788Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.colorCodes /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1886110Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.debug false[0m
2021-07-20T02:26:58.1887354Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.debug false[0m
2021-07-20T02:26:58.1888823Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.debug /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1890272Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator[0m
2021-07-20T02:26:58.1891702Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator[0m
2021-07-20T02:26:58.1893180Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.namespace /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1894534Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false[0m
2021-07-20T02:26:58.1895980Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false[0m
2021-07-20T02:26:58.1897550Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.natEnabled /tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1898936Z [36m[submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries[0m
2021-07-20T02:26:58.1900123Z [36m[submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries[0m
2021-07-20T02:26:58.1901291Z [36m[submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_[0m
2021-07-20T02:26:58.1914002Z [36m[submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_[0m
2021-07-20T02:26:58.1915291Z [36m[submariner-operator]$ [cluster2] iteration=1[0m
2021-07-20T02:26:58.1916197Z [36m[submariner-operator]$ [cluster2] wait 8555[0m
2021-07-20T02:26:58.1917356Z [36m[submariner-operator]$ [cluster2] verify_subm_cr_status_[0m
2021-07-20T02:26:58.1918413Z [36m[submariner-operator]$ [cluster2] verify_subm_cr_status_[0m
2021-07-20T02:26:58.1919481Z [36m[submariner-operator]$ [cluster2] verify_subm_cr_status[0m
2021-07-20T02:26:58.1920527Z [36m[submariner-operator]$ [cluster2] verify_subm_cr_status[0m
2021-07-20T02:26:58.1921795Z [36m[submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json[0m
2021-07-20T02:26:58.1922759Z [cluster2] [36m[0m
2021-07-20T02:26:58.1923336Z [cluster2] [36m[0m
2021-07-20T02:26:58.1924684Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-20T02:26:58.1926473Z [36m[submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16[0m
2021-07-20T02:26:58.1927850Z [36m[submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16[0m
2021-07-20T02:27:00.3441967Z [36m[submariner-operator]$ [cluster2] jq -r -M .status_[0m
2021-07-20T02:27:00.3443102Z [36m[submariner-operator]$ [cluster1] wait 8590[0m
2021-07-20T02:27:00.3444066Z [36m[submariner-operator]$ [cluster1] verify_subm_cr_status_[0m
2021-07-20T02:27:00.3445057Z [36m[submariner-operator]$ [cluster1] verify_subm_cr_status[0m
2021-07-20T02:27:00.3446032Z [36m[submariner-operator]$ [cluster1] verify_subm_cr_status[0m
2021-07-20T02:27:00.3447397Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json[0m
2021-07-20T02:27:00.3448373Z [cluster1] [36m[0m
2021-07-20T02:27:00.3448937Z [cluster1] [36m[0m
2021-07-20T02:27:00.3450271Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json[0m
2021-07-20T02:27:00.3451929Z [36m[submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16[0m
2021-07-20T02:27:00.3453311Z [36m[submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16[0m
2021-07-20T02:27:00.3454838Z [36m[submariner-operator]$ [cluster1] jq -r -M .status.serviceCIDR /tmp/submariner.cluster1.json[0m
2021-07-20T02:27:00.3456546Z [36m[submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16[0m
2021-07-20T02:27:00.3457897Z [36m[submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16[0m
2021-07-20T02:27:00.3459523Z [36m[submariner-operator]$ [cluster1] jq -r -M .status.clusterCIDR /tmp/submariner.cluster1.json[0m
2021-07-20T02:27:00.3461105Z [36m[submariner-operator]$ [cluster1] return 0[0m
2021-07-20T02:27:00.3462050Z [36m[submariner-operator]$ [cluster1] return 0[0m
2021-07-20T02:27:00.3463324Z [36m[submariner-operator]$ [cluster1] verify_subm_gateway_deployment[0m
2021-07-20T02:27:00.3464506Z [36m[submariner-operator]$ [cluster1] verify_subm_gateway_deployment[0m
2021-07-20T02:27:00.3465921Z [36m[submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway[0m
2021-07-20T02:27:00.3467537Z [36m[submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway[0m
2021-07-20T02:27:00.3469017Z [36m[submariner-operator]$ [cluster1] daemonset_app=submariner-gateway[0m
2021-07-20T02:27:00.3470343Z [36m[submariner-operator]$ [cluster1] daemonset_name=submariner-gateway[0m
2021-07-20T02:27:00.3471693Z [36m[submariner-operator]$ [cluster1] with_retries 60 daemonset_created[0m
2021-07-20T02:27:00.3472897Z [36m[submariner-operator]$ [cluster1] with_retries 60 daemonset_created[0m
2021-07-20T02:27:00.3473977Z [36m[submariner-operator]$ [cluster1] iteration=1[0m
2021-07-20T02:27:00.3475027Z [36m[submariner-operator]$ [cluster1] daemonset_created[0m
2021-07-20T02:27:00.3476087Z [36m[submariner-operator]$ [cluster1] daemonset_created[0m
2021-07-20T02:27:00.3476883Z [cluster1] [36m[0m
2021-07-20T02:27:00.3477637Z [36m[submariner-operator]$ [cluster1] wait 8663[0m
2021-07-20T02:27:00.3478579Z [36m[submariner-operator]$ [cluster1] return 0[0m
2021-07-20T02:27:00.3479686Z [36m[submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed[0m
2021-07-20T02:27:00.3480900Z [36m[submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed[0m
2021-07-20T02:27:00.3481995Z [36m[submariner-operator]$ [cluster1] iteration=1[0m
2021-07-20T02:27:00.3482948Z [36m[submariner-operator]$ [cluster1] wait 8698[0m
2021-07-20T02:27:00.3483964Z [36m[submariner-operator]$ [cluster1] daemonset_deployed[0m
2021-07-20T02:27:00.3485043Z [36m[submariner-operator]$ [cluster1] daemonset_deployed[0m
2021-07-20T02:27:00.3486729Z [36m[submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}[0m
2021-07-20T02:27:00.3488910Z [36m[submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}[0m
2021-07-20T02:27:00.3491339Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}[0m
2021-07-20T02:27:00.3493496Z [36m[submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}[0m
2021-07-20T02:27:00.3495315Z [36m[submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}[0m
2021-07-20T02:27:00.3497303Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}[0m
2021-07-20T02:27:00.3498793Z [36m[submariner-operator]$ [cluster1] return 0[0m
2021-07-20T02:27:00.3499821Z [36m[submariner-operator]$ [cluster1] verify_subm_gateway_pod[0m
2021-07-20T02:27:00.3500917Z [36m[submariner-operator]$ [cluster1] verify_subm_gateway_pod[0m
2021-07-20T02:27:00.3507619Z [36m[submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator[0m
2021-07-20T02:27:00.3510283Z [36m[submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator[0m
2021-07-20T02:27:00.3512666Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator[0m
2021-07-20T02:27:00.4922503Z [cluster1] pod/submariner-gateway-5479b condition mtus.serviceCIDR /tmp/submariner.cluster2.json[0m
2021-07-20T02:27:00.4924620Z [36m[submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16[0m
2021-07-20T02:27:00.4925989Z [36m[submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16[0m
2021-07-20T02:27:00.4927530Z [36m[submariner-operator]$ [cluster2] jq -r -M .status.clusterCIDR /tmp/submariner.cluster2.json[0m
2021-07-20T02:27:00.4928845Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-20T02:27:00.4929790Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-20T02:27:00.4930882Z [36m[submariner-operator]$ [cluster2] verify_subm_gateway_deployment[0m
2021-07-20T02:27:00.4932063Z [36m[submariner-operator]$ [cluster2] verify_subm_gateway_deployment[0m
2021-07-20T02:27:00.4933485Z [36m[submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway[0m
2021-07-20T02:27:00.4935092Z [36m[submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway[0m
2021-07-20T02:27:00.4936558Z [36m[submariner-operator]$ [cluster2] daemonset_app=submariner-gateway[0m
2021-07-20T02:27:00.4937894Z [36m[submariner-operator]$ [cluster2] daemonset_name=submariner-gateway[0m
2021-07-20T02:27:00.4939147Z [36m[submariner-operator]$ [cluster2] with_retries 60 daemonset_created[0m
2021-07-20T02:27:00.4940349Z [36m[submariner-operator]$ [cluster2] with_retries 60 daemonset_created[0m
2021-07-20T02:27:00.4941424Z [36m[submariner-operator]$ [cluster2] iteration=1[0m
2021-07-20T02:27:00.4942709Z [36m[submariner-operator]$ [cluster2] wait 8625[0m
2021-07-20T02:27:00.4943661Z [36m[submariner-operator]$ [cluster2] daemonset_created[0m
2021-07-20T02:27:00.4944858Z [36m[submariner-operator]$ [cluster2] daemonset_created[0m
2021-07-20T02:27:00.4945657Z [cluster2] [36m[0m
2021-07-20T02:27:00.4946512Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-20T02:27:00.4947618Z [36m[submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed[0m
2021-07-20T02:27:00.4948823Z [36m[submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed[0m
2021-07-20T02:27:00.4949923Z [36m[submariner-operator]$ [cluster2] iteration=1[0m
2021-07-20T02:27:00.4950903Z [36m[submariner-operator]$ [cluster2] wait 8676[0m
2021-07-20T02:27:00.4951927Z [36m[submariner-operator]$ [cluster2] daemonset_deployed[0m
2021-07-20T02:27:00.4953005Z [36m[submariner-operator]$ [cluster2] daemonset_deployed[0m
2021-07-20T02:27:00.4954826Z [36m[submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}[0m
2021-07-20T02:27:00.4957049Z [36m[submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}[0m
2021-07-20T02:27:00.4959362Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}[0m
2021-07-20T02:27:00.4961485Z [36m[submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}[0m
2021-07-20T02:27:00.4963336Z [36m[submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}[0m
2021-07-20T02:27:00.4965312Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}[0m
2021-07-20T02:27:00.4966794Z [36m[submariner-operator]$ [cluster2] return 0[0m
2021-07-20T02:27:00.4967823Z [36m[submariner-operator]$ [cluster2] verify_subm_gateway_pod[0m
2021-07-20T02:27:00.4968919Z [36m[submariner-operator]$ [cluster2] verify_subm_gateway_pod[0m
2021-07-20T02:27:00.4970567Z [36m[submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator[0m
2021-07-20T02:27:00.4972690Z [36m[submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator[0m
2021-07-20T02:27:00.4975080Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator[0m
2021-07-20T02:27:00.4976765Z [cluster2] pod/submariner-gateway-kx5st condition met
2021-07-20T02:27:00.4978371Z [36m[submariner-operator]$ [cluster2] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')[0m
2021-07-20T02:27:00.4980405Z [36m[submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:27:00.4982577Z [36m[submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:27:00.4984801Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:27:00.9513942Z [36m[submariner-operator]$ [cluster2] json_file=/tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:00.9515961Z [36m[submariner-operator]$ [cluster2] kubectl get pod submariner-gateway-kx5st --namespace=submariner-operator -o json[0m
2021-07-20T02:27:00.9517826Z [36m[submariner-operator]$ [cluster2] kubectl get pod submariner-gateway-kx5st --namespace=submariner-operator -o json[0m
2021-07-20T02:27:00.9519863Z [36m[submariner-operator]$ [cluster2] tee /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:00.9521959Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-gateway-kx5st --namespace=submariner-operator -o json[0m
2021-07-20T02:27:00.9523152Z [cluster2] {
2021-07-20T02:27:00.9523630Z [cluster2]     "apiVersion": "v1",
2021-07-20T02:27:00.9524161Z [cluster2]     "kind": "Pod",
2021-07-20T02:27:00.9524657Z [cluster2]     "metadata": {
2021-07-20T02:27:00.9525474Z [cluster2]         "creationTimestamp": "2021-07-20T02:26:01Z",
2021-07-20T02:27:00.9526480Z [cluster2]         "generateName": "submariner-gateway-",
2021-07-20T02:27:00.9527155Z [cluster2]         "labels": {
2021-07-20T02:27:00.9527926Z [cluster2]             "app": "submariner-gateway",
2021-07-20T02:27:00.9528935Z [cluster2]             "controller-revision-hash": "6c84df9f5d",
2021-07-20T02:27:00.9530199Z [cluster2]             "gateway.submariner.io/node": "cluster2-worker",
2021-07-20T02:27:00.9531357Z [cluster2]             "gateway.submariner.io/status": "active",
2021-07-20T02:27:00.9532350Z [cluster2]             "pod-template-generation": "1"
2021-07-20T02:27:00.9532944Z [cluster2]         },
2021-07-20T02:27:00.9533699Z [cluster2]         "name": "submariner-gateway-kx5st",
2021-07-20T02:27:00.9534661Z [cluster2]         "namespace": "submariner-operator",
2021-07-20T02:27:00.9535345Z [cluster2]         "ownerReferences": [
2021-07-20T02:27:00.9535995Z [cluster2]             {
2021-07-20T02:27:00.9536477Z [cluster2]                 "apiVersion": "apps/v1",
2021-07-20T02:27:00.9537136Z [cluster2]                 "blockOwnerDeletion": true,
2021-07-20T02:27:00.9537752Z [cluster2]                 "controller": true,
2021-07-20T02:27:00.9538298Z [cluster2]                 "kind": "DaemonSet",
2021-07-20T02:27:00.9539075Z [cluster2]                 "name": "submariner-gateway",
2021-07-20T02:27:00.9539997Z [cluster2]                 "uid": "83bacb40-637d-4c20-8532-4925919bc89b"
2021-07-20T02:27:00.9540580Z [cluster2]             }
2021-07-20T02:27:00.9540969Z [cluster2]         ],
2021-07-20T02:27:00.9541479Z [cluster2]         "resourceVersion": "1948",
2021-07-20T02:27:00.9542831Z [cluster2]         "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-gateway-kx5st",
2021-07-20T02:27:00.9544072Z [cluster2]         "uid": "44a520f3-3729-40a7-bcc6-f46dcc3ab2cb"
2021-07-20T02:27:00.9544632Z [cluster2]     },
2021-07-20T02:27:00.9545044Z [cluster2]     "spec": {
2021-07-20T02:27:00.9545487Z [cluster2]         "affinity": {
2021-07-20T02:27:00.9546114Z [cluster2]             "nodeAffinity": {
2021-07-20T02:27:00.9547218Z [cluster2]                 "requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-20T02:27:00.9548397Z [cluster2]                     "nodeSelectorTerms": [
2021-07-20T02:27:00.9548949Z [cluster2]                         {
2021-07-20T02:27:00.9549427Z [cluster2]                             "matchFields": [
2021-07-20T02:27:00.9549927Z [cluster2]                                 {
2021-07-20T02:27:00.9550457Z [cluster2]                                     "key": "metadata.name",
2021-07-20T02:27:00.9551048Z [cluster2]                                     "operator": "In",
2021-07-20T02:27:00.9551558Z [cluster2]                                     "values": [
2021-07-20T02:27:00.9552496Z [cluster2]                                         "cluster2-worker"
2021-07-20T02:27:00.9553068Z [cluster2]                                     ]
2021-07-20T02:27:00.9553644Z [cluster2]                                 }
2021-07-20T02:27:00.9554079Z [cluster2]                             ]
2021-07-20T02:27:00.9554486Z [cluster2]                         }
2021-07-20T02:27:00.9554900Z [cluster2]                     ]
2021-07-20T02:27:00.9555291Z [cluster2]                 }
2021-07-20T02:27:00.9555691Z [cluster2]             },
2021-07-20T02:27:00.9556361Z [cluster2]             "podAntiAffinity": {
2021-07-20T02:27:00.9557591Z [cluster2]                 "requiredDuringSchedulingIgnoredDuringExecution": [
2021-07-20T02:27:00.9558711Z [cluster2]                     {
2021-07-20T02:27:00.9559254Z [cluster2]                         "labelSelector": {
2021-07-20T02:27:00.9559857Z [cluster2]                             "matchLabels": {
2021-07-20T02:27:00.9560739Z [cluster2]                                 "app": "submariner-gateway"
2021-07-20T02:27:00.9561363Z [cluster2]                             }
2021-07-20T02:27:00.9561804Z [cluster2]                         },
2021-07-20T02:27:00.9562462Z [cluster2]                         "topologyKey": "kubernetes.io/hostname"
2021-07-20T02:27:00.9563097Z [cluster2]                     }
2021-07-20T02:27:00.9563534Z [cluster2]                 ]
2021-07-20T02:27:00.9563954Z [cluster2]             }
2021-07-20T02:27:00.9564376Z [cluster2]         },
2021-07-20T02:27:00.9564845Z [cluster2]         "containers": [
2021-07-20T02:27:00.9565326Z [cluster2]             {
2021-07-20T02:27:00.9565778Z [cluster2]                 "command": [
2021-07-20T02:27:00.9566426Z [cluster2]                     "submariner.sh"
2021-07-20T02:27:00.9566960Z [cluster2]                 ],
2021-07-20T02:27:00.9567404Z [cluster2]                 "env": [
2021-07-20T02:27:00.9567867Z [cluster2]                     {
2021-07-20T02:27:00.9568437Z [cluster2]                         "name": "SUBMARINER_NAMESPACE",
2021-07-20T02:27:00.9569391Z [cluster2]                         "value": "submariner-operator"
2021-07-20T02:27:00.9570005Z [cluster2]                     },
2021-07-20T02:27:00.9570450Z [cluster2]                     {
2021-07-20T02:27:00.9571032Z [cluster2]                         "name": "SUBMARINER_CLUSTERCIDR",
2021-07-20T02:27:00.9571664Z [cluster2]                         "value": "10.2.0.0/16"
2021-07-20T02:27:00.9572134Z [cluster2]                     },
2021-07-20T02:27:00.9572580Z [cluster2]                     {
2021-07-20T02:27:00.9573169Z [cluster2]                         "name": "SUBMARINER_SERVICECIDR",
2021-07-20T02:27:00.9573910Z [cluster2]                         "value": "100.2.0.0/16"
2021-07-20T02:27:00.9574384Z [cluster2]                     },
2021-07-20T02:27:00.9574830Z [cluster2]                     {
2021-07-20T02:27:00.9575392Z [cluster2]                         "name": "SUBMARINER_GLOBALCIDR"
2021-07-20T02:27:00.9575970Z [cluster2]                     },
2021-07-20T02:27:00.9576398Z [cluster2]                     {
2021-07-20T02:27:00.9576972Z [cluster2]                         "name": "SUBMARINER_CLUSTERID",
2021-07-20T02:27:00.9577602Z [cluster2]                         "value": "cluster2"
2021-07-20T02:27:00.9578201Z [cluster2]                     },
2021-07-20T02:27:00.9578645Z [cluster2]                     {
2021-07-20T02:27:00.9579207Z [cluster2]                         "name": "SUBMARINER_COLORCODES",
2021-07-20T02:27:00.9579832Z [cluster2]                         "value": "blue"
2021-07-20T02:27:00.9580311Z [cluster2]                     },
2021-07-20T02:27:00.9580762Z [cluster2]                     {
2021-07-20T02:27:00.9581303Z [cluster2]                         "name": "SUBMARINER_DEBUG",
2021-07-20T02:27:00.9581898Z [cluster2]                         "value": "false"
2021-07-20T02:27:00.9582513Z [cluster2]                     },
2021-07-20T02:27:00.9582964Z [cluster2]                     {
2021-07-20T02:27:00.9583550Z [cluster2]                         "name": "SUBMARINER_NATENABLED",
2021-07-20T02:27:00.9584168Z [cluster2]                         "value": "false"
2021-07-20T02:27:00.9584669Z [cluster2]                     },
2021-07-20T02:27:00.9585101Z [cluster2]                     {
2021-07-20T02:27:00.9585662Z [cluster2]                         "name": "SUBMARINER_BROKER",
2021-07-20T02:27:00.9586238Z [cluster2]                         "value": "k8s"
2021-07-20T02:27:00.9586723Z [cluster2]                     },
2021-07-20T02:27:00.9587155Z [cluster2]                     {
2021-07-20T02:27:00.9587743Z [cluster2]                         "name": "SUBMARINER_CABLEDRIVER",
2021-07-20T02:27:00.9588396Z [cluster2]                         "value": "libreswan"
2021-07-20T02:27:00.9588919Z [cluster2]                     },
2021-07-20T02:27:00.9589362Z [cluster2]                     {
2021-07-20T02:27:00.9589910Z [cluster2]                         "name": "BROKER_K8S_APISERVER",
2021-07-20T02:27:00.9590517Z [cluster2]                         "value": "172.18.0.4:6443"
2021-07-20T02:27:00.9590992Z [cluster2]                     },
2021-07-20T02:27:00.9591428Z [cluster2]                     {
2021-07-20T02:27:00.9592036Z [cluster2]                         "name": "BROKER_K8S_APISERVERTOKEN",
2021-07-20T02:27:00.9828090Z [cluster2]                         "value": "***"
2021-07-20T02:27:00.9828653Z [cluster2]                     },
2021-07-20T02:27:00.9829077Z [cluster2]                     {
2021-07-20T02:27:00.9829649Z [cluster2]                         "name": "BROKER_K8S_REMOTENAMESPACE",
2021-07-20T02:27:00.9831388Z [cluster2]                         "value": "submariner-k8s-broker"
2021-07-20T02:27:00.9832025Z [cluster2]                     },
2021-07-20T02:27:00.9832689Z [cluster2]                     {
2021-07-20T02:27:00.9833211Z [cluster2]                         "name": "BROKER_K8S_CA",
2021-07-20T02:27:01.0587555Z [cluster2]                         "value": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo="
2021-07-20T02:27:01.1400403Z [cluster2]                     },
2021-07-20T02:27:01.1400896Z [cluster2]                     {
2021-07-20T02:27:01.1401442Z [cluster2]                         "name": "CE_IPSEC_PSK",
2021-07-20T02:27:01.1402691Z [cluster2]                         "value": "RxKqGCxyc6/0hWrNf9qeaSCnys+VhG5BNpkVtfXDj+mujGbyv5zlvTp2/mnlxtXH"
2021-07-20T02:27:01.1403858Z [cluster2]                     },
2021-07-20T02:27:01.1404308Z [cluster2]                     {
2021-07-20T02:27:01.1404867Z [cluster2]                         "name": "CE_IPSEC_DEBUG",
2021-07-20T02:27:01.1405531Z [cluster2]                         "value": "false"
2021-07-20T02:27:01.1405981Z [cluster2]                     },
2021-07-20T02:27:01.1406393Z [cluster2]                     {
2021-07-20T02:27:01.1407006Z [cluster2]                         "name": "SUBMARINER_HEALTHCHECKENABLED",
2021-07-20T02:27:01.1407648Z [cluster2]                         "value": "true"
2021-07-20T02:27:01.1408108Z [cluster2]                     },
2021-07-20T02:27:01.1408516Z [cluster2]                     {
2021-07-20T02:27:01.1409132Z [cluster2]                         "name": "SUBMARINER_HEALTHCHECKINTERVAL",
2021-07-20T02:27:01.1409763Z [cluster2]                         "value": "1"
2021-07-20T02:27:01.1410203Z [cluster2]                     },
2021-07-20T02:27:01.1410604Z [cluster2]                     {
2021-07-20T02:27:01.1411358Z [cluster2]                         "name": "SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT",
2021-07-20T02:27:01.1412131Z [cluster2]                         "value": "5"
2021-07-20T02:27:01.1412572Z [cluster2]                     },
2021-07-20T02:27:01.1412979Z [cluster2]                     {
2021-07-20T02:27:01.1413438Z [cluster2]                         "name": "NODE_NAME",
2021-07-20T02:27:01.1413962Z [cluster2]                         "valueFrom": {
2021-07-20T02:27:01.1414462Z [cluster2]                             "fieldRef": {
2021-07-20T02:27:01.1415006Z [cluster2]                                 "apiVersion": "v1",
2021-07-20T02:27:01.1415625Z [cluster2]                                 "fieldPath": "spec.nodeName"
2021-07-20T02:27:01.1416188Z [cluster2]                             }
2021-07-20T02:27:01.1416595Z [cluster2]                         }
2021-07-20T02:27:01.1417008Z [cluster2]                     },
2021-07-20T02:27:01.1417405Z [cluster2]                     {
2021-07-20T02:27:01.1417878Z [cluster2]                         "name": "POD_NAME",
2021-07-20T02:27:01.1418682Z [cluster2]                         "valueFrom": {
2021-07-20T02:27:01.1419198Z [cluster2]                             "fieldRef": {
2021-07-20T02:27:01.1419744Z [cluster2]                                 "apiVersion": "v1",
2021-07-20T02:27:01.1420362Z [cluster2]                                 "fieldPath": "metadata.name"
2021-07-20T02:27:01.1420916Z [cluster2]                             }
2021-07-20T02:27:01.1421326Z [cluster2]                         }
2021-07-20T02:27:01.1421740Z [cluster2]                     },
2021-07-20T02:27:01.1422141Z [cluster2]                     {
2021-07-20T02:27:01.1422764Z [cluster2]                         "name": "CE_IPSEC_IKEPORT",
2021-07-20T02:27:01.1423296Z [cluster2]                         "value": "500"
2021-07-20T02:27:01.1423723Z [cluster2]                     },
2021-07-20T02:27:01.1424135Z [cluster2]                     {
2021-07-20T02:27:01.1424627Z [cluster2]                         "name": "CE_IPSEC_NATTPORT",
2021-07-20T02:27:01.1425166Z [cluster2]                         "value": "4500"
2021-07-20T02:27:01.1425596Z [cluster2]                     },
2021-07-20T02:27:01.1426014Z [cluster2]                     {
2021-07-20T02:27:01.1426563Z [cluster2]                         "name": "CE_IPSEC_PREFERREDSERVER",
2021-07-20T02:27:01.1427175Z [cluster2]                         "value": "false"
2021-07-20T02:27:01.1427621Z [cluster2]                     },
2021-07-20T02:27:01.1428036Z [cluster2]                     {
2021-07-20T02:27:01.1428559Z [cluster2]                         "name": "CE_IPSEC_FORCEENCAPS",
2021-07-20T02:27:01.1429211Z [cluster2]                         "value": "false"
2021-07-20T02:27:01.1429674Z [cluster2]                     }
2021-07-20T02:27:01.1430065Z [cluster2]                 ],
2021-07-20T02:27:01.1431344Z [cluster2]                 "image": "localhost:5000/submariner-gateway:local",
2021-07-20T02:27:01.1432101Z [cluster2]                 "imagePullPolicy": "Always",
2021-07-20T02:27:01.1432960Z [cluster2]                 "name": "submariner-gateway",
2021-07-20T02:27:01.1433533Z [cluster2]                 "ports": [
2021-07-20T02:27:01.1433970Z [cluster2]                     {
2021-07-20T02:27:01.1434459Z [cluster2]                         "containerPort": 4500,
2021-07-20T02:27:01.1435013Z [cluster2]                         "hostPort": 4500,
2021-07-20T02:27:01.1435866Z [cluster2]                         "name": "cable-encaps",
2021-07-20T02:27:01.1436431Z [cluster2]                         "protocol": "UDP"
2021-07-20T02:27:01.1436905Z [cluster2]                     },
2021-07-20T02:27:01.1437308Z [cluster2]                     {
2021-07-20T02:27:01.1437813Z [cluster2]                         "containerPort": 4490,
2021-07-20T02:27:01.1438351Z [cluster2]                         "hostPort": 4490,
2021-07-20T02:27:01.1439097Z [cluster2]                         "name": "natt-discovery",
2021-07-20T02:27:01.1439669Z [cluster2]                         "protocol": "UDP"
2021-07-20T02:27:01.1440137Z [cluster2]                     }
2021-07-20T02:27:01.1440547Z [cluster2]                 ],
2021-07-20T02:27:01.1440995Z [cluster2]                 "resources": {},
2021-07-20T02:27:01.1441556Z [cluster2]                 "securityContext": {
2021-07-20T02:27:01.1442284Z [cluster2]                     "allowPrivilegeEscalation": true,
2021-07-20T02:27:01.1442997Z [cluster2]                     "capabilities": {
2021-07-20T02:27:01.1443485Z [cluster2]                         "add": [
2021-07-20T02:27:01.1443958Z [cluster2]                             "net_admin"
2021-07-20T02:27:01.1444400Z [cluster2]                         ],
2021-07-20T02:27:01.1444843Z [cluster2]                         "drop": [
2021-07-20T02:27:01.1445279Z [cluster2]                             "all"
2021-07-20T02:27:01.1445710Z [cluster2]                         ]
2021-07-20T02:27:01.1446125Z [cluster2]                     },
2021-07-20T02:27:01.1446603Z [cluster2]                     "privileged": true,
2021-07-20T02:27:01.1447299Z [cluster2]                     "readOnlyRootFilesystem": false,
2021-07-20T02:27:01.1448091Z [cluster2]                     "runAsNonRoot": false
2021-07-20T02:27:01.1448595Z [cluster2]                 },
2021-07-20T02:27:01.1449481Z [cluster2]                 "terminationMessagePath": "/dev/termination-log",
2021-07-20T02:27:01.1450435Z [cluster2]                 "terminationMessagePolicy": "File",
2021-07-20T02:27:01.1451132Z [cluster2]                 "volumeMounts": [
2021-07-20T02:27:01.1451612Z [cluster2]                     {
2021-07-20T02:27:01.1452119Z [cluster2]                         "mountPath": "/etc/ipsec.d",
2021-07-20T02:27:01.1452692Z [cluster2]                         "name": "ipsecd"
2021-07-20T02:27:01.1453159Z [cluster2]                     },
2021-07-20T02:27:01.1453643Z [cluster2]                     {
2021-07-20T02:27:01.1454106Z [cluster2]                         "mountPath": "/var/lib/ipsec/nss",
2021-07-20T02:27:01.1454610Z [cluster2]                         "name": "ipsecnss"
2021-07-20T02:27:01.1455027Z [cluster2]                     },
2021-07-20T02:27:01.1455379Z [cluster2]                     {
2021-07-20T02:27:01.1455982Z [cluster2]                         "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-20T02:27:01.1457000Z [cluster2]                         "name": "submariner-gateway-token-fzp5k",
2021-07-20T02:27:01.1457692Z [cluster2]                         "readOnly": true
2021-07-20T02:27:01.1458306Z [cluster2]                     }
2021-07-20T02:27:01.1458697Z [cluster2]                 ]
2021-07-20T02:27:01.1459181Z [cluster2]             }
2021-07-20T02:27:01.1459562Z [cluster2]         ],
2021-07-20T02:27:01.1460079Z [cluster2]         "dnsPolicy": "ClusterFirst",
2021-07-20T02:27:01.1460734Z [cluster2]         "enableServiceLinks": true,
2021-07-20T02:27:01.1461362Z [cluster2]         "hostNetwork": true,
2021-07-20T02:27:01.1462126Z [cluster2]         "nodeName": "cluster2-worker",
2021-07-20T02:27:01.1462904Z [cluster2]         "nodeSelector": {
2021-07-20T02:27:01.1463499Z [cluster2]             "submariner.io/gateway": "true"
2021-07-20T02:27:01.1464030Z [cluster2]         },
2021-07-20T02:27:01.1464467Z [cluster2]         "priority": 0,
2021-07-20T02:27:01.1464999Z [cluster2]         "restartPolicy": "Always",
2021-07-20T02:27:01.1465877Z [cluster2]         "schedulerName": "default-scheduler",
2021-07-20T02:27:01.1466558Z [cluster2]         "securityContext": {},
2021-07-20T02:27:01.1467429Z [cluster2]         "serviceAccount": "submariner-gateway",
2021-07-20T02:27:01.1468453Z [cluster2]         "serviceAccountName": "submariner-gateway",
2021-07-20T02:27:01.1469407Z [cluster2]         "terminationGracePeriodSeconds": 1,
2021-07-20T02:27:01.1470166Z [cluster2]         "tolerations": [
2021-07-20T02:27:01.1470566Z [cluster2]             {
2021-07-20T02:27:01.1470969Z [cluster2]                 "operator": "Exists"
2021-07-20T02:27:01.1471382Z [cluster2]             },
2021-07-20T02:27:01.1471732Z [cluster2]             {
2021-07-20T02:27:01.1472146Z [cluster2]                 "effect": "NoExecute",
2021-07-20T02:27:01.1472883Z [cluster2]                 "key": "node.kubernetes.io/not-ready",
2021-07-20T02:27:01.1473449Z [cluster2]                 "operator": "Exists"
2021-07-20T02:27:01.1473858Z [cluster2]             },
2021-07-20T02:27:01.1474198Z [cluster2]             {
2021-07-20T02:27:01.1474626Z [cluster2]                 "effect": "NoExecute",
2021-07-20T02:27:01.1475217Z [cluster2]                 "key": "node.kubernetes.io/unreachable",
2021-07-20T02:27:01.1475808Z [cluster2]                 "operator": "Exists"
2021-07-20T02:27:01.1476210Z [cluster2]             },
2021-07-20T02:27:01.1476558Z [cluster2]             {
2021-07-20T02:27:01.1476991Z [cluster2]                 "effect": "NoSchedule",
2021-07-20T02:27:01.1477751Z [cluster2]                 "key": "node.kubernetes.io/disk-pressure",
2021-07-20T02:27:01.1478363Z [cluster2]                 "operator": "Exists"
2021-07-20T02:27:01.1478759Z [cluster2]             },
2021-07-20T02:27:01.1479109Z [cluster2]             {
2021-07-20T02:27:01.1479838Z [cluster2]                 "effect": "NoSchedule",
2021-07-20T02:27:01.1480765Z [cluster2]                 "key": "node.kubernetes.io/memory-pressure",
2021-07-20T02:27:01.1481467Z [cluster2]                 "operator": "Exists"
2021-07-20T02:27:01.1482048Z [cluster2]             },
2021-07-20T02:27:01.1482683Z [cluster2]             {
2021-07-20T02:27:01.1483372Z [cluster2]                 "effect": "NoSchedule",
2021-07-20T02:27:01.1484360Z [cluster2]                 "key": "node.kubernetes.io/pid-pressure",
2021-07-20T02:27:01.1485298Z [cluster2]                 "operator": "Exists"
2021-07-20T02:27:01.1485906Z [cluster2]             },
2021-07-20T02:27:01.1486366Z [cluster2]             {
2021-07-20T02:27:01.1486984Z [cluster2]                 "effect": "NoSchedule",
2021-07-20T02:27:01.1487783Z [cluster2]                 "key": "node.kubernetes.io/unschedulable",
2021-07-20T02:27:01.1488634Z [cluster2]                 "operator": "Exists"
2021-07-20T02:27:01.1489165Z [cluster2]             },
2021-07-20T02:27:01.1489690Z [cluster2]             {
2021-07-20T02:27:01.1490247Z [cluster2]                 "effect": "NoSchedule",
2021-07-20T02:27:01.1491698Z [cluster2]                 "key": "node.kubernetes.io/network-unavailable",
2021-07-20T02:27:01.1492569Z [cluster2]                 "operator": "Exists"
2021-07-20T02:27:01.1493174Z [cluster2]             }
2021-07-20T02:27:01.1493684Z [cluster2]         ],
2021-07-20T02:27:01.1494174Z [cluster2]         "volumes": [
2021-07-20T02:27:01.1494724Z [cluster2]             {
2021-07-20T02:27:01.1495378Z [cluster2]                 "emptyDir": {},
2021-07-20T02:27:01.1496023Z [cluster2]                 "name": "ipsecd"
2021-07-20T02:27:01.1496537Z [cluster2]             },
2021-07-20T02:27:01.1497122Z [cluster2]             {
2021-07-20T02:27:01.1497640Z [cluster2]                 "emptyDir": {},
2021-07-20T02:27:01.1498301Z [cluster2]                 "name": "ipsecnss"
2021-07-20T02:27:01.1498841Z [cluster2]             },
2021-07-20T02:27:01.1499362Z [cluster2]             {
2021-07-20T02:27:01.1500596Z [cluster2]                 "name": "submariner-gateway-token-fzp5k",
2021-07-20T02:27:01.1501433Z [cluster2]                 "secret": {
2021-07-20T02:27:01.1502104Z [cluster2]                     "defaultMode": 420,
2021-07-20T02:27:01.1545734Z [cluster2]                     "secretName": "submariner-gateway-token-fzp5k"
2021-07-20T02:27:01.1546697Z [cluster2]                 }
2021-07-20T02:27:01.1547222Z [cluster2]             }
2021-07-20T02:27:01.1547699Z [cluster2]         ]
2021-07-20T02:27:01.1548258Z [cluster2]     },
2021-07-20T02:27:01.1548735Z [cluster2]     "status": {
2021-07-20T02:27:01.1549342Z [cluster2]         "conditions": [
2021-07-20T02:27:01.1550005Z [cluster2]             {
2021-07-20T02:27:01.1550764Z [cluster2]                 "lastProbeTime": null,
2021-07-20T02:27:01.1562046Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:26:01Z",
2021-07-20T02:27:01.1562744Z [cluster2]                 "status": "True",
2021-07-20T02:27:01.1563312Z [cluster2]                 "type": "Initialized"
2021-07-20T02:27:01.1563805Z [cluster2]             },
2021-07-20T02:27:01.1564195Z [cluster2]             {
2021-07-20T02:27:01.1564706Z [cluster2]                 "lastProbeTime": null,
2021-07-20T02:27:01.1565692Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:26:18Z",
2021-07-20T02:27:01.1566313Z [cluster2]                 "status": "True",
2021-07-20T02:27:01.1566802Z [cluster2]                 "type": "Ready"
2021-07-20T02:27:01.1567257Z [cluster2]             },
2021-07-20T02:27:01.1567644Z [cluster2]             {
2021-07-20T02:27:01.1568151Z [cluster2]                 "lastProbeTime": null,
2021-07-20T02:27:01.1568992Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:26:18Z",
2021-07-20T02:27:01.1569610Z [cluster2]                 "status": "True",
2021-07-20T02:27:01.1570189Z [cluster2]                 "type": "ContainersReady"
2021-07-20T02:27:01.1570700Z [cluster2]             },
2021-07-20T02:27:01.1571289Z [cluster2]             {
2021-07-20T02:27:01.1571790Z [cluster2]                 "lastProbeTime": null,
2021-07-20T02:27:01.1572648Z [cluster2]                 "lastTransitionTime": "2021-07-20T02:26:01Z",
2021-07-20T02:27:01.1573245Z [cluster2]                 "status": "True",
2021-07-20T02:27:01.1573799Z [cluster2]                 "type": "PodScheduled"
2021-07-20T02:27:01.1574285Z [cluster2]             }
2021-07-20T02:27:01.1574681Z [cluster2]         ],
2021-07-20T02:27:01.1575184Z [cluster2]         "containerStatuses": [
2021-07-20T02:27:01.1575704Z [cluster2]             {
2021-07-20T02:27:01.1577395Z [cluster2]                 "containerID": "containerd://0c5beb89b4c2129842a20b67b2f52e5dc88e65d955d770731a2a2d4c3a2aa58c",
2021-07-20T02:27:01.1579449Z [cluster2]                 "image": "localhost:5000/submariner-gateway:local",
2021-07-20T02:27:01.1581045Z [cluster2]                 "imageID": "localhost:5000/submariner-gateway@sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895",
2021-07-20T02:27:01.1582196Z [cluster2]                 "lastState": {},
2021-07-20T02:27:01.1583132Z [cluster2]                 "name": "submariner-gateway",
2021-07-20T02:27:01.1583739Z [cluster2]                 "ready": true,
2021-07-20T02:27:01.1584247Z [cluster2]                 "restartCount": 0,
2021-07-20T02:27:01.1584779Z [cluster2]                 "started": true,
2021-07-20T02:27:01.1585240Z [cluster2]                 "state": {
2021-07-20T02:27:01.1585708Z [cluster2]                     "running": {
2021-07-20T02:27:01.1586516Z [cluster2]                         "startedAt": "2021-07-20T02:26:18Z"
2021-07-20T02:27:01.1587009Z [cluster2]                     }
2021-07-20T02:27:01.1587407Z [cluster2]                 }
2021-07-20T02:27:01.1587811Z [cluster2]             }
2021-07-20T02:27:01.1588192Z [cluster2]         ],
2021-07-20T02:27:01.1588723Z [cluster2]         "hostIP": "172.18.0.7",
2021-07-20T02:27:01.1589149Z [cluster2]         "phase": "Running",
2021-07-20T02:27:01.1589591Z [cluster2]         "podIP": "172.18.0.7",
2021-07-20T02:27:01.1590002Z [cluster2]         "podIPs": [
2021-07-20T02:27:01.1590366Z [cluster2]             {
2021-07-20T02:27:01.1590741Z [cluster2]                 "ip": "172.18.0.7"
2021-07-20T02:27:01.1591312Z [cluster2]             }
2021-07-20T02:27:01.1591707Z [cluster2]         ],
2021-07-20T02:27:01.1592514Z [cluster2]         "qosClass": "BestEffort",
2021-07-20T02:27:01.1593326Z [cluster2]         "startTime": "2021-07-20T02:26:01Z"
2021-07-20T02:27:01.1593822Z [cluster2]     }
2021-07-20T02:27:01.1594235Z [cluster2] }
2021-07-20T02:27:01.1595399Z [36m[submariner-operator]$ [cluster2] validate_pod_container_equals image localhost:5000/submariner-gateway:local[0m
2021-07-20T02:27:01.1597098Z [36m[submariner-operator]$ [cluster2] validate_pod_container_equals image localhost:5000/submariner-gateway:local[0m
2021-07-20T02:27:01.1598825Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.containers[].image localhost:5000/submariner-gateway:local[0m
2021-07-20T02:27:01.1600705Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.containers[]..spec.containers[].image localhost:5000/submariner-gateway:local[0m
2021-07-20T02:27:01.1602777Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].image /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.1604824Z [36m[submariner-operator]$ [cluster2] validate_pod_container_has securityContext.capabilities.add net_admin[0m
2021-07-20T02:27:01.1606758Z [36m[submariner-operator]$ [cluster2] validate_pod_container_has securityContext.capabilities.add net_admin[0m
2021-07-20T02:27:01.1609109Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].securityContext.capabilities.add /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.1611463Z [36m[submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.allowPrivilegeEscalation true[0m
2021-07-20T02:27:01.1613669Z [36m[submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.allowPrivilegeEscalation true[0m
2021-07-20T02:27:01.1615838Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.containers[].securityContext.allowPrivilegeEscalation true[0m
2021-07-20T02:27:01.3198902Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.containers[]..spec.containers[].securityContext.allowPrivilegeEscalation true[0m
2021-07-20T02:27:01.3201885Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].securityContext.allowPrivilegeEscalation /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.3204398Z [36m[submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.privileged true[0m
2021-07-20T02:27:01.3206161Z [36m[submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.privileged true[0m
2021-07-20T02:27:01.3208030Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.containers[].securityContext.privileged true[0m
2021-07-20T02:27:01.3210597Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.containers[]..spec.containers[].securityContext.privileged true[0m
2021-07-20T02:27:01.3213053Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].securityContext.privileged /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.3225418Z [36m[submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.readOnlyRootFilesystem false[0m
2021-07-20T02:27:01.3227923Z [36m[submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.readOnlyRootFilesystem false[0m
2021-07-20T02:27:01.3230417Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.containers[].securityContext.readOnlyRootFilesystem false[0m
2021-07-20T02:27:01.3232855Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.containers[]..spec.containers[].securityContext.readOnlyRootFilesystem false[0m
2021-07-20T02:27:01.3235706Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].securityContext.readOnlyRootFilesystem /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.3238161Z [36m[submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.runAsNonRoot false[0m
2021-07-20T02:27:01.3239987Z [36m[submariner-operator]$ [cluster2] validate_pod_container_equals securityContext.runAsNonRoot false[0m
2021-07-20T02:27:01.3304594Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.containers[].securityContext.runAsNonRoot false[0m
2021-07-20T02:27:01.3306354Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.containers[]..spec.containers[].securityContext.runAsNonRoot false[0m
2021-07-20T02:27:01.3308366Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].securityContext.runAsNonRoot /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.3310187Z [36m[submariner-operator]$ [cluster2] validate_pod_container_has command submariner.sh[0m
2021-07-20T02:27:01.3311710Z [36m[submariner-operator]$ [cluster2] validate_pod_container_has command submariner.sh[0m
2021-07-20T02:27:01.3313514Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].command /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.3315685Z [36m[submariner-operator]$ [cluster2] jq -r .spec.containers[].env /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.3316854Z [cluster2] [
2021-07-20T02:27:01.3317255Z [cluster2]   {
2021-07-20T02:27:01.3317806Z [cluster2]     "name": "SUBMARINER_NAMESPACE",
2021-07-20T02:27:01.3318681Z [cluster2]     "value": "submariner-operator"
2021-07-20T02:27:01.3319281Z [cluster2]   },
2021-07-20T02:27:01.3319679Z [cluster2]   {
2021-07-20T02:27:01.3320239Z [cluster2]     "name": "SUBMARINER_CLUSTERCIDR",
2021-07-20T02:27:01.3320819Z [cluster2]     "value": "10.2.0.0/16"
2021-07-20T02:27:01.3321273Z [cluster2]   },
2021-07-20T02:27:01.3321673Z [cluster2]   {
2021-07-20T02:27:01.3322223Z [cluster2]     "name": "SUBMARINER_SERVICECIDR",
2021-07-20T02:27:01.3322803Z [cluster2]     "value": "100.2.0.0/16"
2021-07-20T02:27:01.3323441Z [cluster2]   },
2021-07-20T02:27:01.3323847Z [cluster2]   {
2021-07-20T02:27:01.3324396Z [cluster2]     "name": "SUBMARINER_GLOBALCIDR"
2021-07-20T02:27:01.3324940Z [cluster2]   },
2021-07-20T02:27:01.3325338Z [cluster2]   {
2021-07-20T02:27:01.3325876Z [cluster2]     "name": "SUBMARINER_CLUSTERID",
2021-07-20T02:27:01.3326467Z [cluster2]     "value": "cluster2"
2021-07-20T02:27:01.3326952Z [cluster2]   },
2021-07-20T02:27:01.3327349Z [cluster2]   {
2021-07-20T02:27:01.3327897Z [cluster2]     "name": "SUBMARINER_COLORCODES",
2021-07-20T02:27:01.3328473Z [cluster2]     "value": "blue"
2021-07-20T02:27:01.3328937Z [cluster2]   },
2021-07-20T02:27:01.3329334Z [cluster2]   {
2021-07-20T02:27:01.3329846Z [cluster2]     "name": "SUBMARINER_DEBUG",
2021-07-20T02:27:01.3330393Z [cluster2]     "value": "false"
2021-07-20T02:27:01.3365351Z [cluster2]   },
2021-07-20T02:27:01.3365803Z [cluster2]   {
2021-07-20T02:27:01.3366329Z [cluster2]     "name": "SUBMARINER_NATENABLED",
2021-07-20T02:27:01.3366912Z [cluster2]     "value": "false"
2021-07-20T02:27:01.3367334Z [cluster2]   },
2021-07-20T02:27:01.3367718Z [cluster2]   {
2021-07-20T02:27:01.3368187Z [cluster2]     "name": "SUBMARINER_BROKER",
2021-07-20T02:27:01.3368703Z [cluster2]     "value": "k8s"
2021-07-20T02:27:01.3369111Z [cluster2]   },
2021-07-20T02:27:01.3369491Z [cluster2]   {
2021-07-20T02:27:01.3369991Z [cluster2]     "name": "SUBMARINER_CABLEDRIVER",
2021-07-20T02:27:01.3370580Z [cluster2]     "value": "libreswan"
2021-07-20T02:27:01.3371194Z [cluster2]   },
2021-07-20T02:27:01.3371577Z [cluster2]   {
2021-07-20T02:27:01.3372054Z [cluster2]     "name": "BROKER_K8S_APISERVER",
2021-07-20T02:27:01.3372585Z [cluster2]     "value": "172.18.0.4:6443"
2021-07-20T02:27:01.3372993Z [cluster2]   },
2021-07-20T02:27:01.3373379Z [cluster2]   {
2021-07-20T02:27:01.3373903Z [cluster2]     "name": "BROKER_K8S_APISERVERTOKEN",
2021-07-20T02:27:01.3531917Z [cluster2]     "value": "***"
2021-07-20T02:27:01.3532454Z [cluster2]   },
2021-07-20T02:27:01.3532876Z [cluster2]   {
2021-07-20T02:27:01.3533469Z [cluster2]     "name": "BROKER_K8S_REMOTENAMESPACE",
2021-07-20T02:27:01.3535947Z [cluster2]     "value": "submariner-k8s-broker"
2021-07-20T02:27:01.3536754Z [cluster2]   },
2021-07-20T02:27:01.3537161Z [cluster2]   {
2021-07-20T02:27:01.3537652Z [cluster2]     "name": "BROKER_K8S_CA",
2021-07-20T02:27:01.4054948Z [cluster2]     "value": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo="
2021-07-20T02:27:01.4599467Z [cluster2]   },
2021-07-20T02:27:01.4599940Z [cluster2]   {
2021-07-20T02:27:01.4600931Z [cluster2]     "name": "CE_IPSEC_PSK",
2021-07-20T02:27:01.4602317Z [cluster2]     "value": "RxKqGCxyc6/0hWrNf9qeaSCnys+VhG5BNpkVtfXDj+mujGbyv5zlvTp2/mnlxtXH"
2021-07-20T02:27:01.4603743Z [cluster2]   },
2021-07-20T02:27:01.4604268Z [cluster2]   {
2021-07-20T02:27:01.4604732Z [cluster2]     "name": "CE_IPSEC_DEBUG",
2021-07-20T02:27:01.4605230Z [cluster2]     "value": "false"
2021-07-20T02:27:01.4605665Z [cluster2]   },
2021-07-20T02:27:01.4606036Z [cluster2]   {
2021-07-20T02:27:01.4606616Z [cluster2]     "name": "SUBMARINER_HEALTHCHECKENABLED",
2021-07-20T02:27:01.4607225Z [cluster2]     "value": "true"
2021-07-20T02:27:01.4607653Z [cluster2]   },
2021-07-20T02:27:01.4608046Z [cluster2]   {
2021-07-20T02:27:01.4608622Z [cluster2]     "name": "SUBMARINER_HEALTHCHECKINTERVAL",
2021-07-20T02:27:01.4609237Z [cluster2]     "value": "1"
2021-07-20T02:27:01.4609635Z [cluster2]   },
2021-07-20T02:27:01.4610020Z [cluster2]   {
2021-07-20T02:27:01.4610734Z [cluster2]     "name": "SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT",
2021-07-20T02:27:01.4611483Z [cluster2]     "value": "5"
2021-07-20T02:27:01.4611881Z [cluster2]   },
2021-07-20T02:27:01.4612266Z [cluster2]   {
2021-07-20T02:27:01.4612686Z [cluster2]     "name": "NODE_NAME",
2021-07-20T02:27:01.4613174Z [cluster2]     "valueFrom": {
2021-07-20T02:27:01.4613638Z [cluster2]       "fieldRef": {
2021-07-20T02:27:01.4614141Z [cluster2]         "apiVersion": "v1",
2021-07-20T02:27:01.4614733Z [cluster2]         "fieldPath": "spec.nodeName"
2021-07-20T02:27:01.4615239Z [cluster2]       }
2021-07-20T02:27:01.4615631Z [cluster2]     }
2021-07-20T02:27:01.4615998Z [cluster2]   },
2021-07-20T02:27:01.4616385Z [cluster2]   {
2021-07-20T02:27:01.4616908Z [cluster2]     "name": "POD_NAME",
2021-07-20T02:27:01.4617394Z [cluster2]     "valueFrom": {
2021-07-20T02:27:01.4617860Z [cluster2]       "fieldRef": {
2021-07-20T02:27:01.4618364Z [cluster2]         "apiVersion": "v1",
2021-07-20T02:27:01.4621439Z [cluster2]         "fieldPath": "metadata.name"
2021-07-20T02:27:01.4622159Z [cluster2]       }
2021-07-20T02:27:01.4622714Z [cluster2]     }
2021-07-20T02:27:01.4623106Z [cluster2]   },
2021-07-20T02:27:01.4623475Z [cluster2]   {
2021-07-20T02:27:01.4623963Z [cluster2]     "name": "CE_IPSEC_IKEPORT",
2021-07-20T02:27:01.4624468Z [cluster2]     "value": "500"
2021-07-20T02:27:01.4624870Z [cluster2]   },
2021-07-20T02:27:01.4625254Z [cluster2]   {
2021-07-20T02:27:01.4625712Z [cluster2]     "name": "CE_IPSEC_NATTPORT",
2021-07-20T02:27:01.4626211Z [cluster2]     "value": "4500"
2021-07-20T02:27:01.4626805Z [cluster2]   },
2021-07-20T02:27:01.4627214Z [cluster2]   {
2021-07-20T02:27:01.4627767Z [cluster2]     "name": "CE_IPSEC_PREFERREDSERVER",
2021-07-20T02:27:01.4628394Z [cluster2]     "value": "false"
2021-07-20T02:27:01.4628844Z [cluster2]   },
2021-07-20T02:27:01.4629253Z [cluster2]   {
2021-07-20T02:27:01.4634935Z [cluster2]     "name": "CE_IPSEC_FORCEENCAPS",
2021-07-20T02:27:01.4635787Z [cluster2]     "value": "false"
2021-07-20T02:27:01.4636396Z [cluster2]   }
2021-07-20T02:27:01.4636823Z [cluster2] ]
2021-07-20T02:27:01.4639655Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_NAMESPACE submariner-operator[0m
2021-07-20T02:27:01.4641184Z [36m[submariner-operaet
2021-07-20T02:27:01.4643090Z [36m[submariner-operator]$ [cluster1] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')[0m
2021-07-20T02:27:01.4651202Z [36m[submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:27:01.4653930Z [36m[submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:27:01.4657183Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:27:01.4659340Z [36m[submariner-operator]$ [cluster1] json_file=/tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:01.4661508Z [36m[submariner-operator]$ [cluster1] kubectl get pod submariner-gateway-5479b --namespace=submariner-operator -o json[0m
2021-07-20T02:27:01.4663526Z [36m[submariner-operator]$ [cluster1] tee /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:01.4665465Z [36m[submariner-operator]$ [cluster1] kubectl get pod submariner-gateway-5479b --namespace=submariner-operator -o json[0m
2021-07-20T02:27:01.4668003Z [36m[submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-gateway-5479b --namespace=submariner-operator -o json[0m
2021-07-20T02:27:01.4669104Z [cluster1] {
2021-07-20T02:27:01.4669562Z [cluster1]     "apiVersion": "v1",
2021-07-20T02:27:01.4670039Z [cluster1]     "kind": "Pod",
2021-07-20T02:27:01.4670504Z [cluster1]     "metadata": {
2021-07-20T02:27:01.4671256Z [cluster1]         "creationTimestamp": "2021-07-20T02:25:41Z",
2021-07-20T02:27:01.4672179Z [cluster1]         "generateName": "submariner-gateway-",
2021-07-20T02:27:01.4672822Z [cluster1]         "labels": {
2021-07-20T02:27:01.4673533Z [cluster1]             "app": "submariner-gateway",
2021-07-20T02:27:01.4674670Z [cluster1]             "controller-revision-hash": "8bcd6fb9b",
2021-07-20T02:27:01.4675815Z [cluster1]             "gateway.submariner.io/node": "cluster1-worker",
2021-07-20T02:27:01.4677000Z [cluster1]             "gateway.submariner.io/status": "active",
2021-07-20T02:27:01.4678437Z [cluster1]             "pod-template-generation": "1"
2021-07-20T02:27:01.4679079Z [cluster1]         },
2021-07-20T02:27:01.4680046Z [cluster1]         "name": "submariner-gateway-5479b",
2021-07-20T02:27:01.4681075Z [cluster1]         "namespace": "submariner-operator",
2021-07-20T02:27:01.4681825Z [cluster1]         "ownerReferences": [
2021-07-20T02:27:01.4682355Z [cluster1]             {
2021-07-20T02:27:01.4682889Z [cluster1]                 "apiVersion": "apps/v1",
2021-07-20T02:27:01.4683575Z [cluster1]                 "blockOwnerDeletion": true,
2021-07-20T02:27:01.4684259Z [cluster1]                 "controller": true,
2021-07-20T02:27:01.4684843Z [cluster1]                 "kind": "DaemonSet",
2021-07-20T02:27:01.4685981Z [cluster1]                 "name": "submariner-gateway",
2021-07-20T02:27:01.4687145Z [cluster1]                 "uid": "4625c38d-0414-4036-977c-b26146f87c5a"
2021-07-20T02:27:01.4687880Z [cluster1]             }
2021-07-20T02:27:01.4688318Z [cluster1]         ],
2021-07-20T02:27:01.4689024Z [cluster1]         "resourceVersion": "1987",
2021-07-20T02:27:01.4690743Z [cluster1]         "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-gateway-5479b",
2021-07-20T02:27:01.4692095Z [cluster1]         "uid": "e5237569-7f97-4cbb-89ee-89b71a7eeb3b"
2021-07-20T02:27:01.4692991Z [cluster1]     },
2021-07-20T02:27:01.4693554Z [cluster1]     "spec": {
2021-07-20T02:27:01.4693958Z [cluster1]         "affinity": {
2021-07-20T02:27:01.4694522Z [cluster1]             "nodeAffinity": {
2021-07-20T02:27:01.4696194Z [cluster1]                 "requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-20T02:27:01.4697538Z [cluster1]                     "nodeSelectorTerms": [
2021-07-20T02:27:01.4698022Z [cluster1]                         {
2021-07-20T02:27:01.4698445Z [cluster1]                             "matchFields": [
2021-07-20T02:27:01.4698916Z [cluster1]                                 {
2021-07-20T02:27:01.4700314Z [cluster1]                                     "key": "metadata.name",
2021-07-20T02:27:01.4701028Z [cluster1]                                     "operator": "In",
2021-07-20T02:27:01.4703084Z [cluster1]                                     "values": [
2021-07-20T02:27:01.4703973Z [cluster1]                                         "cluster1-worker"
2021-07-20T02:27:01.4704518Z [cluster1]                                     ]
2021-07-20T02:27:01.4704946Z [cluster1]                                 }
2021-07-20T02:27:01.4705382Z [cluster1]                             ]
2021-07-20T02:27:01.4705793Z [cluster1]                         }
2021-07-20T02:27:01.4706212Z [cluster1]                     ]
2021-07-20T02:27:01.4706780Z [cluster1]                 }
2021-07-20T02:27:01.4707180Z [cluster1]             },
2021-07-20T02:27:01.4708318Z [cluster1]             "podAntiAffinity": {
2021-07-20T02:27:01.4709662Z [cluster1]                 "requiredDuringSchedulingIgnoredDuringExecution": [
2021-07-20T02:27:01.4710800Z [cluster1]                     {
2021-07-20T02:27:01.4711339Z [cluster1]                         "labelSelector": {
2021-07-20T02:27:01.4711960Z [cluster1]                             "matchLabels": {
2021-07-20T02:27:01.4712901Z [cluster1]                                 "app": "submariner-gateway"
2021-07-20T02:27:01.4713526Z [cluster1]                             }
2021-07-20T02:27:01.4713973Z [cluster1]                         },
2021-07-20T02:27:01.4715133Z [cluster1]                         "topologyKey": "kubernetes.io/hostname"
2021-07-20T02:27:01.4715955Z [cluster1]                     }
2021-07-20T02:27:01.4716384Z [cluster1]                 ]
2021-07-20T02:27:01.4716821Z [cluster1]             }
2021-07-20T02:27:01.4717241Z [cluster1]         },
2021-07-20T02:27:01.4717725Z [cluster1]         "containers": [
2021-07-20T02:27:01.4718196Z [cluster1]             {
2021-07-20T02:27:01.4718666Z [cluster1]                 "command": [
2021-07-20T02:27:01.4719211Z [cluster1]                     "submariner.sh"
2021-07-20T02:27:01.4719734Z [cluster1]                 ],
2021-07-20T02:27:01.4720184Z [cluster1]                 "env": [
2021-07-20T02:27:01.4721236Z [cluster1]                     {
2021-07-20T02:27:01.4722115Z [cluster1]                         "name": "SUBMARINER_NAMESPACE",
2021-07-20T02:27:01.4723140Z [cluster1]                         "value": "submariner-operator"
2021-07-20T02:27:01.4723772Z [cluster1]                     },
2021-07-20T02:27:01.4724204Z [cluster1]                     {
2021-07-20T02:27:01.4724795Z [cluster1]                         "name": "SUBMARINER_CLUSTERCIDR",
2021-07-20T02:27:01.4725416Z [cluster1]                         "value": "10.1.0.0/16"
2021-07-20T02:27:01.4725909Z [cluster1]                     },
2021-07-20T02:27:01.4726346Z [cluster1]                     {
2021-07-20T02:27:01.4726939Z [cluster1]                         "name": "SUBMARINER_SERVICECIDR",
2021-07-20T02:27:01.4727557Z [cluster1]                         "value": "100.1.0.0/16"
2021-07-20T02:27:01.4728044Z [cluster1]                     },
2021-07-20T02:27:01.4728492Z [cluster1]                     {
2021-07-20T02:27:01.4729057Z [cluster1]                         "name": "SUBMARINER_GLOBALCIDR"
2021-07-20T02:27:01.4729638Z [cluster1]                     },
2021-07-20T02:27:01.4730065Z [cluster1]                     {
2021-07-20T02:27:01.4730643Z [cluster1]                         "name": "SUBMARINER_CLUSTERID",
2021-07-20T02:27:01.4731269Z [cluster1]                         "value": "cluster1"
2021-07-20T02:27:01.4732224Z [cluster1]                     },
2021-07-20T02:27:01.4732676Z [cluster1]                     {
2021-07-20T02:27:01.4733422Z [cluster1]                         "name": "SUBMARINER_COLORCODES",
2021-07-20T02:27:01.4734038Z [cluster1]                         "value": "blue"
2021-07-20T02:27:01.4734534Z [cluster1]                     },
2021-07-20T02:27:01.4734983Z [cluster1]                     {
2021-07-20T02:27:01.4735519Z [cluster1]                         "name": "SUBMARINER_DEBUG",
2021-07-20T02:27:01.4736115Z [cluster1]                         "value": "false"
2021-07-20T02:27:01.4736606Z [cluster1]                     },
2021-07-20T02:27:01.4737048Z [cluster1]                     {
2021-07-20T02:27:01.4737621Z [cluster1]                         "name": "SUBMARINER_NATENABLED",
2021-07-20T02:27:01.4738256Z [cluster1]                         "value": "false"
2021-07-20T02:27:01.4739150Z [cluster1]                     },
2021-07-20T02:27:01.4739624Z [cluster1]                     {
2021-07-20T02:27:01.4740837Z [cluster1]                         "name": "SUBMARINER_BROKER",
2021-07-20T02:27:01.4741460Z [cluster1]                         "value": "k8s"
2021-07-20T02:27:01.4742060Z [cluster1]                     },
2021-07-20T02:27:01.4742588Z [cluster1]                     {
2021-07-20T02:27:01.4743182Z [cluster1]                         "name": "SUBMARINER_CABLEDRIVER",
2021-07-20T02:27:01.4743842Z [cluster1]                         "value": "libreswan"
2021-07-20T02:27:01.4744373Z [cluster1]                     },
2021-07-20T02:27:01.4744803Z [cluster1]                     {
2021-07-20T02:27:01.4745367Z [cluster1]                         "name": "BROKER_K8S_APISERVER",
2021-07-20T02:27:01.4746075Z [cluster1]                         "value": "172.18.0.4:6443"
2021-07-20T02:27:01.4746532Z [cluster1]                     },
2021-07-20T02:27:01.4746949Z [cluster1]                     {
2021-07-20T02:27:01.4747498Z [cluster1]                         "name": "BROKER_K8S_APISERVERTOKEN",
2021-07-20T02:27:01.4891553Z [cluster1]                         "value": "***"
2021-07-20T02:27:01.4892002Z [cluster1]                     },
2021-07-20T02:27:01.4892382Z [cluster1]                     {
2021-07-20T02:27:01.4892889Z [cluster1]                         "name": "BROKER_K8S_REMOTENAMESPACE",
2021-07-20T02:27:01.4893869Z [cluster1]                         "value": "submariner-k8s-broker"
2021-07-20T02:27:01.4894400Z [cluster1]                     },
2021-07-20T02:27:01.4894752Z [cluster1]                     {
2021-07-20T02:27:01.4895180Z [cluster1]                         "name": "BROKER_K8S_CA",
2021-07-20T02:27:01.5393487Z [cluster1]                         "value": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo="
2021-07-20T02:27:01.5893945Z [cluster1]                     },
2021-07-20T02:27:01.5894437Z [cluster1]                     {
2021-07-20T02:27:01.5894987Z [cluster1]                         "name": "CE_IPSEC_PSK",
2021-07-20T02:27:01.5896240Z [cluster1]                         "value": "RxKqGCxyc6/0hWrNf9qeaSCnys+VhG5BNpkVtfXDj+mujGbyv5zlvTp2/mnlxtXH"
2021-07-20T02:27:01.5897395Z [cluster1]                     },
2021-07-20T02:27:01.5897847Z [cluster1]                     {
2021-07-20T02:27:01.5898380Z [cluster1]                         "name": "CE_IPSEC_DEBUG",
2021-07-20T02:27:01.5898950Z [cluster1]                         "value": "false"
2021-07-20T02:27:01.5899483Z [cluster1]                     },
2021-07-20T02:27:01.5899925Z [cluster1]                     {
2021-07-20T02:27:01.5900689Z [cluster1]                         "name": "SUBMARINER_HEALTHCHECKENABLED",
2021-07-20T02:27:01.5901502Z [cluster1]                         "value": "true"
2021-07-20T02:27:01.5901998Z [cluster1]                     },
2021-07-20T02:27:01.5902614Z [cluster1]                     {
2021-07-20T02:27:01.5903293Z [cluster1]                         "name": "SUBMARINER_HEALTHCHECKINTERVAL",
2021-07-20T02:27:01.5904210Z [cluster1]                         "value": "1"
2021-07-20T02:27:01.5904786Z [cluster1]                     },
2021-07-20T02:27:01.5905203Z [cluster1]                     {
2021-07-20T02:27:01.5905947Z [cluster1]                         "name": "SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT",
2021-07-20T02:27:01.5906741Z [cluster1]                         "value": "5"
2021-07-20T02:27:01.5907169Z [cluster1]                     },
2021-07-20T02:27:01.5907583Z [cluster1]                     {
2021-07-20T02:27:01.5908048Z [cluster1]                         "name": "NODE_NAME",
2021-07-20T02:27:01.5908578Z [cluster1]                         "valueFrom": {
2021-07-20T02:27:01.5909085Z [cluster1]                             "fieldRef": {
2021-07-20T02:27:01.5909636Z [cluster1]                                 "apiVersion": "v1",
2021-07-20T02:27:01.5910266Z [cluster1]                                 "fieldPath": "spec.nodeName"
2021-07-20T02:27:01.5910819Z [cluster1]                             }
2021-07-20T02:27:01.5911246Z [cluster1]                         }
2021-07-20T02:27:01.5911653Z [cluster1]                     },
2021-07-20T02:27:01.5912066Z [cluster1]                     {
2021-07-20T02:27:01.5912529Z [cluster1]                         "name": "POD_NAME",
2021-07-20T02:27:01.5913052Z [cluster1]                         "valueFrom": {
2021-07-20T02:27:01.5913555Z [cluster1]                             "fieldRef": {
2021-07-20T02:27:01.5914102Z [cluster1]                                 "apiVersion": "v1",
2021-07-20T02:27:01.5914801Z [cluster1]                                 "fieldPath": "metadata.name"
2021-07-20T02:27:01.5915360Z [cluster1]                             }
2021-07-20T02:27:01.5915782Z [cluster1]                         }
2021-07-20T02:27:01.5916186Z [cluster1]                     },
2021-07-20T02:27:01.5916600Z [cluster1]                     {
2021-07-20T02:27:01.5917096Z [cluster1]                         "name": "CE_IPSEC_IKEPORT",
2021-07-20T02:27:01.5917637Z [cluster1]                         "value": "500"
2021-07-20T02:27:01.5918066Z [cluster1]                     },
2021-07-20T02:27:01.5918480Z [cluster1]                     {
2021-07-20T02:27:01.5918975Z [cluster1]                         "name": "CE_IPSEC_NATTPORT",
2021-07-20T02:27:01.5919511Z [cluster1]                         "value": "4500"
2021-07-20T02:27:01.5919941Z [cluster1]                     },
2021-07-20T02:27:01.5920351Z [cluster1]                     {
2021-07-20T02:27:01.5920914Z [cluster1]                         "name": "CE_IPSEC_PREFERREDSERVER",
2021-07-20T02:27:01.5921513Z [cluster1]                         "value": "false"
2021-07-20T02:27:01.5921976Z [cluster1]                     },
2021-07-20T02:27:01.5922376Z [cluster1]                     {
2021-07-20T02:27:01.5922905Z [cluster1]                         "name": "CE_IPSEC_FORCEENCAPS",
2021-07-20T02:27:01.5923793Z [cluster1]                         "value": "false"
2021-07-20T02:27:01.5924288Z [cluster1]                     }
2021-07-20T02:27:01.5924842Z [cluster1]                 ],
2021-07-20T02:27:01.5926980Z [cluster1]                 "image": "localhost:5000/submariner-gateway:local",
2021-07-20T02:27:01.5927982Z [cluster1]                 "imagePullPolicy": "Always",
2021-07-20T02:27:01.5928934Z [cluster1]                 "name": "submariner-gateway",
2021-07-20T02:27:01.5929567Z [cluster1]                 "ports": [
2021-07-20T02:27:01.5930026Z [cluster1]                     {
2021-07-20T02:27:01.5930574Z [cluster1]                         "containerPort": 4500,
2021-07-20T02:27:01.5931169Z [cluster1]                         "hostPort": 4500,
2021-07-20T02:27:01.5931958Z [cluster1]                         "name": "cable-encaps",
2021-07-20T02:27:01.5932566Z [cluster1]                         "protocol": "UDP"
2021-07-20T02:27:01.5933081Z [cluster1]                     },
2021-07-20T02:27:01.5933511Z [cluster1]                     {
2021-07-20T02:27:01.5934055Z [cluster1]                         "containerPort": 4490,
2021-07-20T02:27:01.5934770Z [cluster1]                         "hostPort": 4490,
2021-07-20T02:27:01.5935566Z [cluster1]                         "name": "natt-discovery",
2021-07-20T02:27:01.5936195Z [cluster1]                         "protocol": "UDP"
2021-07-20T02:27:01.5936800Z [cluster1]                     }
2021-07-20T02:27:01.5937214Z [cluster1]                 ],
2021-07-20T02:27:01.5937662Z [cluster1]                 "resources": {},
2021-07-20T02:27:01.5938229Z [cluster1]                 "securityContext": {
2021-07-20T02:27:01.5938970Z [cluster1]                     "allowPrivilegeEscalation": true,
2021-07-20T02:27:01.5939687Z [cluster1]                     "capabilities": {
2021-07-20T02:27:01.5940178Z [cluster1]                         "add": [
2021-07-20T02:27:01.5940651Z [cluster1]                             "net_admin"
2021-07-20T02:27:01.5941111Z [cluster1]                         ],
2021-07-20T02:27:01.5941545Z [cluster1]                         "drop": [
2021-07-20T02:27:01.5941999Z [cluster1]                             "all"
2021-07-20T02:27:01.5942509Z [cluster1]                         ]
2021-07-20T02:27:01.5942934Z [cluster1]                     },
2021-07-20T02:27:01.5943590Z [cluster1]                     "privileged": true,
2021-07-20T02:27:01.5944350Z [cluster1]                     "readOnlyRootFilesystem": false,
2021-07-20T02:27:01.5945102Z [cluster1]                     "runAsNonRoot": false
2021-07-20T02:27:01.5945640Z [cluster1]                 },
2021-07-20T02:27:01.5946593Z [cluster1]                 "terminationMessagePath": "/dev/termination-log",
2021-07-20T02:27:01.5947709Z [cluster1]                 "terminationMessagePolicy": "File",
2021-07-20T02:27:01.5948479Z [cluster1]                 "volumeMounts": [
2021-07-20T02:27:01.5948985Z [cluster1]                     {
2021-07-20T02:27:01.5949547Z [cluster1]                         "mountPath": "/etc/ipsec.d",
2021-07-20T02:27:01.5950148Z [cluster1]                         "name": "ipsecd"
2021-07-20T02:27:01.5963263Z [cluster1]                     },
2021-07-20T02:27:01.5963755Z [cluster1]                     {
2021-07-20T02:27:01.5964343Z [cluster1]                         "mountPath": "/var/lib/ipsec/nss",
2021-07-20T02:27:01.5965090Z [cluster1]                         "name": "ipsecnss"
2021-07-20T02:27:01.5965578Z [cluster1]                     },
2021-07-20T02:27:01.5965995Z [cluster1]                     {
2021-07-20T02:27:01.5966674Z [cluster1]                         "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-20T02:27:01.5968078Z [cluster1]                         "name": "submariner-gateway-token-zp7xd",
2021-07-20T02:27:01.5968869Z [cluster1]                         "readOnly": true
2021-07-20T02:27:01.5969347Z [cluster1]                     }
2021-07-20T02:27:01.5969744Z [cluster1]                 ]
2021-07-20T02:27:01.5970151Z [cluster1]             }
2021-07-20T02:27:01.5970539Z [cluster1]         ],
2021-07-20T02:27:01.5971065Z [cluster1]         "dnsPolicy": "ClusterFirst",
2021-07-20T02:27:01.5971736Z [cluster1]         "enableServiceLinks": true,
2021-07-20T02:27:01.5972371Z [cluster1]         "hostNetwork": true,
2021-07-20T02:27:01.5973152Z [cluster1]         "nodeName": "cluster1-worker",
2021-07-20T02:27:01.5973753Z [cluster1]         "nodeSelector": {
2021-07-20T02:27:01.5974360Z [cluster1]             "submariner.io/gateway": "true"
2021-07-20T02:27:01.5974869Z [cluster1]         },
2021-07-20T02:27:01.5975304Z [cluster1]         "priority": 0,
2021-07-20T02:27:01.5975838Z [cluster1]         "restartPolicy": "Always",
2021-07-20T02:27:01.5976718Z [cluster1]         "schedulerName": "default-scheduler",
2021-07-20T02:27:01.5977405Z [cluster1]         "securityContext": {},
2021-07-20T02:27:01.5978278Z [cluster1]         "serviceAccount": "submariner-gateway",
2021-07-20T02:27:01.5979538Z [cluster1]         "serviceAccountName": "submariner-gateway",
2021-07-20T02:27:01.5980567Z [cluster1]         "terminationGracePeriodSeconds": 1,
2021-07-20T02:27:01.5981375Z [cluster1]         "tolerations": [
2021-07-20T02:27:01.5982025Z [cluster1]             {
2021-07-20T02:27:01.5982743Z [cluster1]                 "operator": "Exists"
2021-07-20T02:27:01.5983245Z [cluster1]             },
2021-07-20T02:27:01.5983680Z [cluster1]             {
2021-07-20T02:27:01.5984196Z [cluster1]                 "effect": "NoExecute",
2021-07-20T02:27:01.5985145Z [cluster1]                 "key": "node.kubernetes.io/not-ready",
2021-07-20T02:27:01.5985848Z [cluster1]                 "operator": "Exists"
2021-07-20T02:27:01.5986354Z [cluster1]             },
2021-07-20T02:27:01.5986782Z [cluster1]             {
2021-07-20T02:27:01.5987312Z [cluster1]                 "effect": "NoExecute",
2021-07-20T02:27:01.5988056Z [cluster1]                 "key": "node.kubernetes.io/unreachable",
2021-07-20T02:27:01.5988775Z [cluster1]                 "operator": "Exists"
2021-07-20T02:27:01.5989283Z [cluster1]             },
2021-07-20T02:27:01.5989700Z [cluster1]             {
2021-07-20T02:27:01.5990233Z [cluster1]                 "effect": "NoSchedule",
2021-07-20T02:27:01.5991185Z [cluster1]                 "key": "node.kubernetes.io/disk-pressure",
2021-07-20T02:27:01.5991939Z [cluster1]                 "operator": "Exists"
2021-07-20T02:27:01.5992513Z [cluster1]             },
2021-07-20T02:27:01.5998445Z [cluster1]             {
2021-07-20T02:27:01.5999317Z [cluster1]                 "effect": "NoSchedule",
2021-07-20T02:27:01.6000604Z [cluster1]                 "key": "node.kubernetes.io/memory-pressure",
2021-07-20T02:27:01.6001390Z [cluster1]                 "operator": "Exists"
2021-07-20T02:27:01.6002056Z [cluster1]             },
2021-07-20T02:27:01.6002987Z [cluster1]             {
2021-07-20T02:27:01.6003682Z [cluster1]                 "effect": "NoSchedule",
2021-07-20T02:27:01.6004710Z [cluster1]                 "key": "node.kubernetes.io/pid-pressure",
2021-07-20T02:27:01.6005448Z [cluster1]                 "operator": "Exists"
2021-07-20T02:27:01.6005955Z [cluster1]             },
2021-07-20T02:27:01.6006371Z [cluster1]             {
2021-07-20T02:27:01.6006919Z [cluster1]                 "effect": "NoSchedule",
2021-07-20T02:27:01.6007852Z [cluster1]                 "key": "node.kubernetes.io/unschedulable",
2021-07-20T02:27:01.6008586Z [cluster1]                 "operator": "Exists"
2021-07-20T02:27:01.6009097Z [cluster1]             },
2021-07-20T02:27:01.6009515Z [cluster1]             {
2021-07-20T02:27:01.6010051Z [cluster1]                 "effect": "NoSchedule",
2021-07-20T02:27:01.6011068Z [cluster1]                 "key": "node.kubernetes.io/network-unavailable",
2021-07-20T02:27:01.6011897Z [cluster1]                 "operator": "Exists"
2021-07-20T02:27:01.6012408Z [cluster1]             }
2021-07-20T02:27:01.6012823Z [cluster1]         ],
2021-07-20T02:27:01.6013825Z [cluster1]         "volumes": [
2021-07-20T02:27:01.6014443Z [cluster1]             {
2021-07-20T02:27:01.6014951Z [cluster1]                 "emptyDir": {},
2021-07-20T02:27:01.6015487Z [cluster1]                 "name": "ipsecd"
2021-07-20T02:27:01.6015976Z [cluster1]             },
2021-07-20T02:27:01.6016399Z [cluster1]             {
2021-07-20T02:27:01.6016886Z [cluster1]                 "emptyDir": {},
2021-07-20T02:27:01.6017429Z [cluster1]                 "name": "ipsecnss"
2021-07-20T02:27:01.6017929Z [cluster1]             },
2021-07-20T02:27:01.6018358Z [cluster1]             {
2021-07-20T02:27:01.6019349Z [cluster1]                 "name": "submariner-gateway-token-zp7xd",
2021-07-20T02:27:01.6020161Z [cluster1]                 "secret": {
2021-07-20T02:27:01.6020701Z [cluster1]                     "defaultMode": 420,
2021-07-20T02:27:01.6022135Z [cluster1]                     "secretName": "submariner-gateway-token-zp7xd"
2021-07-20T02:27:01.6022972Z [cluster1]                 }
2021-07-20T02:27:01.6023384Z [cluster1]             }
2021-07-20T02:27:01.6023768Z [cluster1]         ]
2021-07-20T02:27:01.6024550Z [cluster1]     },
2021-07-20T02:27:01.6024965Z [cluster1]     "status": {
2021-07-20T02:27:01.6025591Z [cluster1]         "conditions": [
2021-07-20T02:27:01.6026525Z [cluster1]             {
2021-07-20T02:27:01.6027697Z [cluster1]                 "lastProbeTime": null,
2021-07-20T02:27:01.6028640Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:41Z",
2021-07-20T02:27:01.6029809Z [cluster1]                 "status": "True",
2021-07-20T02:27:01.6030505Z [cluster1]                 "type": "Initialized"
2021-07-20T02:27:01.6030982Z [cluster1]             },
2021-07-20T02:27:01.6031386Z [cluster1]             {
2021-07-20T02:27:01.6031878Z [cluster1]                 "lastProbeTime": null,
2021-07-20T02:27:01.6032854Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:58Z",
2021-07-20T02:27:01.6033578Z [cluster1]                 "status": "True",
2021-07-20T02:27:01.6034349Z [cluster1]                 "type": "Ready"
2021-07-20T02:27:01.6034910Z [cluster1]             },
2021-07-20T02:27:01.6035332Z [cluster1]             {
2021-07-20T02:27:01.6035835Z [cluster1]                 "lastProbeTime": null,
2021-07-20T02:27:01.6036706Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:58Z",
2021-07-20T02:27:01.6037331Z [cluster1]                 "status": "True",
2021-07-20T02:27:01.6038103Z [cluster1]                 "type": "ContainersReady"
2021-07-20T02:27:01.6038671Z [cluster1]             },
2021-07-20T02:27:01.6039091Z [cluster1]             {
2021-07-20T02:27:01.6039974Z [cluster1]                 "lastProbeTime": null,
2021-07-20T02:27:01.6040918Z [cluster1]                 "lastTransitionTime": "2021-07-20T02:25:41Z",
2021-07-20T02:27:01.6041716Z [cluster1]                 "status": "True",
2021-07-20T02:27:01.6042304Z [cluster1]                 "type": "PodScheduled"
2021-07-20T02:27:01.6042848Z [cluster1]             }
2021-07-20T02:27:01.6043276Z [cluster1]         ],
2021-07-20T02:27:01.6043816Z [cluster1]         "containerStatuses": [
2021-07-20T02:27:01.6044376Z [cluster1]             {
2021-07-20T02:27:01.6046258Z [cluster1]                 "containerID": "containerd://a0ae52cbb01f08fc30a766ac4740767593bc59934ce1f93ed101ed9b8efb00b1",
2021-07-20T02:27:01.6048574Z [cluster1]                 "image": "localhost:5000/submariner-gateway:local",
2021-07-20T02:27:01.6050675Z [cluster1]                 "imageID": "localhost:5000/submariner-gateway@sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895",
2021-07-20T02:27:01.6051957Z [cluster1]                 "lastState": {},
2021-07-20T02:27:01.6052834Z [cluster1]                 "name": "submariner-gateway",
2021-07-20T02:27:01.6053469Z [cluster1]                 "ready": true,
2021-07-20T02:27:01.6054039Z [cluster1]                 "restartCount": 0,
2021-07-20T02:27:01.6054597Z [cluster1]                 "started": true,
2021-07-20T02:27:01.6055118Z [cluster1]                 "state": {
2021-07-20T02:27:01.6055605Z [cluster1]                     "running": {
2021-07-20T02:27:01.6056364Z [cluster1]                         "startedAt": "2021-07-20T02:25:58Z"
2021-07-20T02:27:01.6056880Z [cluster1]                     }
2021-07-20T02:27:01.6057329Z [cluster1]                 }
2021-07-20T02:27:01.6057767Z [cluster1]             }
2021-07-20T02:27:01.6058181Z [cluster1]         ],
2021-07-20T02:27:01.6058652Z [cluster1]         "hostIP": "172.18.0.6",
2021-07-20T02:27:01.6059175Z [cluster1]         "phase": "Running",
2021-07-20T02:27:01.6059708Z [cluster1]         "podIP": "172.18.0.6",
2021-07-20T02:27:01.6060197Z [cluster1]         "podIPs": [
2021-07-20T02:27:01.6060656Z [cluster1]             {
2021-07-20T02:27:01.6061101Z [cluster1]                 "ip": "172.18.0.6"
2021-07-20T02:27:01.6061560Z [cluster1]             }
2021-07-20T02:27:01.6061971Z [cluster1]         ],
2021-07-20T02:27:01.6062626Z [cluster1]         "qosClass": "BestEffort",
2021-07-20T02:27:01.6064083Z [cluster1]         "startTime": "2021-07-20T02:25:41Z"
2021-07-20T02:27:01.6064777Z [cluster1]     }
2021-07-20T02:27:01.6065197Z [cluster1] }
2021-07-20T02:27:01.6066392Z [36m[submariner-operator]$ [cluster1] validate_pod_container_equals image localhost:5000/submariner-gateway:local[0m
2021-07-20T02:27:01.6068227Z [36m[submariner-operator]$ [cluster1] validate_pod_container_equals image localhost:5000/submariner-gateway:local[0m
2021-07-20T02:27:01.6069961Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.containers[].image localhost:5000/submariner-gateway:local[0m
2021-07-20T02:27:01.6071851Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.containers[]..spec.containers[].image localhost:5000/submariner-gateway:local[0m
2021-07-20T02:27:01.7881612Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].image /tmp/submariner-gatewator]$ [cluster2] validate_pod_container_env SUBMARINER_NAMESPACE submariner-operator[0m
2021-07-20T02:27:01.7884215Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_NAMESPACE").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.7886209Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_SERVICECIDR 100.2.0.0/16[0m
2021-07-20T02:27:01.7887880Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_SERVICECIDR 100.2.0.0/16[0m
2021-07-20T02:27:01.7889924Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_SERVICECIDR").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.7891919Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_CLUSTERCIDR 10.2.0.0/16[0m
2021-07-20T02:27:01.7893473Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_CLUSTERCIDR 10.2.0.0/16[0m
2021-07-20T02:27:01.7895722Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_CLUSTERCIDR").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.7897692Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_COLORCODES blue[0m
2021-07-20T02:27:01.7899125Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_COLORCODES blue[0m
2021-07-20T02:27:01.7901153Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_COLORCODES").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.7903307Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_DEBUG false[0m
2021-07-20T02:27:01.7904664Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_DEBUG false[0m
2021-07-20T02:27:01.7906633Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_DEBUG").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.7908570Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_NATENABLED false[0m
2021-07-20T02:27:01.7909989Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_NATENABLED false[0m
2021-07-20T02:27:01.7912027Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_NATENABLED").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.7913941Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_BROKER k8s[0m
2021-07-20T02:27:01.7915288Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env SUBMARINER_BROKER k8s[0m
2021-07-20T02:27:01.7917239Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_BROKER").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.7919152Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env BROKER_K8S_APISERVER 172.18.0.4:6443[0m
2021-07-20T02:27:01.7920542Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env BROKER_K8S_APISERVER 172.18.0.4:6443[0m
2021-07-20T02:27:01.7922506Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="BROKER_K8S_APISERVER").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.7924754Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env BROKER_K8S_REMOTENAMESPACE submariner-k8s-broker[0m
2021-07-20T02:27:01.7926710Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env BROKER_K8S_REMOTENAMESPACE submariner-k8s-broker[0m
2021-07-20T02:27:01.7928943Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="BROKER_K8S_REMOTENAMESPACE").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:01.8454388Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env BROKER_K8S_CA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQy-5479b.cluster1.json[0m
2021-07-20T02:27:01.8701203Z [36m[submariner-operator]$ [cluster1] validate_pod_container_has securityContext.capabilities.add net_admin[0m
2021-07-20T02:27:01.8703756Z [36m[submariner-operator]$ [cluster1] validate_pod_container_has securityContext.capabilities.add net_admin[0m
2021-07-20T02:27:01.8706175Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].securityContext.capabilities.add /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:01.8713006Z [36m[submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.allowPrivilegeEscalation true[0m
2021-07-20T02:27:01.8716063Z [36m[submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.allowPrivilegeEscalation true[0m
2021-07-20T02:27:01.8726217Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.containers[].securityContext.allowPrivilegeEscalation true[0m
2021-07-20T02:27:01.8729703Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.containers[]..spec.containers[].securityContext.allowPrivilegeEscalation true[0m
2021-07-20T02:27:01.8733756Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].securityContext.allowPrivilegeEscalation /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:01.8737119Z [36m[submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.privileged true[0m
2021-07-20T02:27:01.8740598Z [36m[submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.privileged true[0m
2021-07-20T02:27:01.8746629Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.containers[].securityContext.privileged true[0m
2021-07-20T02:27:01.8749314Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.containers[]..spec.containers[].securityContext.privileged true[0m
2021-07-20T02:27:01.8753461Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].securityContext.privileged /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:01.8757603Z [36m[submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.readOnlyRootFilesystem false[0m
2021-07-20T02:27:01.8761296Z [36m[submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.readOnlyRootFilesystem false[0m
2021-07-20T02:27:01.8786484Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.containers[].securityContext.readOnlyRootFilesystem false[0m
2021-07-20T02:27:01.8789167Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.containers[]..spec.containers[].securityContext.readOnlyRootFilesystem false[0m
2021-07-20T02:27:01.8792233Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].securityContext.readOnlyRootFilesystem /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:01.8795060Z [36m[submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.runAsNonRoot false[0m
2021-07-20T02:27:01.8797201Z [36m[submariner-operator]$ [cluster1] validate_pod_container_equals securityContext.runAsNonRoot false[0m
2021-07-20T02:27:01.8799655Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.containers[].securityContext.runAsNonRoot false[0m
2021-07-20T02:27:01.8802551Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.containers[]..spec.containers[].securityContext.runAsNonRoot false[0m
2021-07-20T02:27:01.8808712Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].securityContext.runAsNonRoot /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:01.8811048Z [36m[submariner-operator]$ [cluster1] validate_pod_container_has command submariner.sh[0m
2021-07-20T02:27:01.8813042Z [36m[submariner-operator]$ [cluster1] validate_pod_container_has command submariner.sh[0m
2021-07-20T02:27:01.8814940Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].command /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:01.8817963Z [36m[submariner-operator]$ [cluster1] jq -r .spec.containers[].env /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:01.8819714Z [cluster1] [
2021-07-20T02:27:01.8820315Z [cluster1]   {
2021-07-20T02:27:01.8821175Z [cluster1]     "name": "SUBMARINER_NAMESPACE",
2021-07-20T02:27:01.8824379Z [cluster1]     "value": "submariner-operator"
2021-07-20T02:27:01.8825151Z [cluster1]   },
2021-07-20T02:27:01.8825552Z [cluster1]   {
2021-07-20T02:27:01.8826268Z [cluster1]     "name": "SUBMARINER_CLUSTERCIDR",
2021-07-20T02:27:01.8827040Z [cluster1]     "value": "10.1.0.0/16"
2021-07-20T02:27:01.8827685Z [cluster1]   },
2021-07-20T02:27:01.8828272Z [cluster1]   {
2021-07-20T02:27:01.8828788Z [cluster1]     "name": "SUBMARINER_SERVICECIDR",
2021-07-20T02:27:01.8829559Z [cluster1]     "value": "100.1.0.0/16"
2021-07-20T02:27:01.8830177Z [cluster1]   },
2021-07-20T02:27:01.8830776Z [cluster1]   {
2021-07-20T02:27:01.8831468Z [cluster1]     "name": "SUBMARINER_GLOBALCIDR"
2021-07-20T02:27:01.8831989Z [cluster1]   },
2021-07-20T02:27:01.8832567Z [cluster1]   {
2021-07-20T02:27:01.8833285Z [cluster1]     "name": "SUBMARINER_CLUSTERID",
2021-07-20T02:27:01.8834062Z [cluster1]     "value": "cluster1"
2021-07-20T02:27:01.8834701Z [cluster1]   },
2021-07-20T02:27:01.8835094Z [cluster1]   {
2021-07-20T02:27:01.8835806Z [cluster1]     "name": "SUBMARINER_COLORCODES",
2021-07-20T02:27:01.8837120Z [cluster1]     "value": "blue"
2021-07-20T02:27:01.8839023Z [cluster1]   },
2021-07-20T02:27:01.8839916Z [cluster1]   {
2021-07-20T02:27:01.8840399Z [cluster1]     "name": "SUBMARINER_DEBUG",
2021-07-20T02:27:01.8842653Z [cluster1]     "value": "false"
2021-07-20T02:27:01.8843084Z [cluster1]   },
2021-07-20T02:27:01.8843467Z [cluster1]   {
2021-07-20T02:27:01.8843978Z [cluster1]     "name": "SUBMARINER_NATENABLED",
2021-07-20T02:27:01.8844536Z [cluster1]     "value": "false"
2021-07-20T02:27:01.8844969Z [cluster1]   },
2021-07-20T02:27:01.8845336Z [cluster1]   {
2021-07-20T02:27:01.8845817Z [cluster1]     "name": "SUBMARINER_BROKER",
2021-07-20T02:27:01.8846319Z [cluster1]     "value": "k8s"
2021-07-20T02:27:01.8846740Z [cluster1]   },
2021-07-20T02:27:01.8847105Z [cluster1]   {
2021-07-20T02:27:01.8847618Z [cluster1]     "name": "SUBMARINER_CABLEDRIVER",
2021-07-20T02:27:01.8848192Z [cluster1]     "value": "libreswan"
2021-07-20T02:27:01.8848659Z [cluster1]   },
2021-07-20T02:27:01.8849028Z [cluster1]   {
2021-07-20T02:27:01.8849517Z [cluster1]     "name": "BROKER_K8S_APISERVER",
2021-07-20T02:27:01.8871122Z [cluster1]     "value": "172.18.0.4:6443"
2021-07-20T02:27:01.8871604Z [cluster1]   },
2021-07-20T02:27:01.8872011Z [cluster1]   {
2021-07-20T02:27:01.8887677Z [cluster1]     "name": "BROKER_K8S_APISERVERTOKEN",
2021-07-20T02:27:01.9089066Z [cluster1]     "value": "***"
2021-07-20T02:27:01.9090080Z [cluster1]   },
2021-07-20T02:27:01.9090680Z [cluster1]   {
2021-07-20T02:27:01.9091409Z [cluster1]     "name": "BROKER_K8S_REMOTENAMESPACE",
2021-07-20T02:27:01.9092865Z [cluster1]     "value": "submariner-k8s-broker"
2021-07-20T02:27:01.9093619Z [cluster1]   },
2021-07-20T02:27:01.9094056Z [cluster1]   {
2021-07-20T02:27:01.9094845Z [cluster1]     "name": "BROKER_K8S_CA",
2021-07-20T02:27:01.9671559Z [cluster1]     "value": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo="
2021-07-20T02:27:02.0230244Z [cluster1]   },
2021-07-20T02:27:02.0230703Z [cluster1]   {
2021-07-20T02:27:02.0231830Z [cluster1]     "name": "CE_IPSEC_PSK",
2021-07-20T02:27:02.0233264Z [cluster1]     "value": "RxKqGCxyc6/0hWrNf9qeaSCnys+VhG5BNpkVtfXDj+mujGbyv5zlvTp2/mnlxtXH"
2021-07-20T02:27:02.0235519Z [cluster1]   },
2021-07-20T02:27:02.0235965Z [cluster1]   {
2021-07-20T02:27:02.0236451Z [cluster1]     "name": "CE_IPSEC_DEBUG",
2021-07-20T02:27:02.0237006Z [cluster1]     "value": "false"
2021-07-20T02:27:02.0237459Z [cluster1]   },
2021-07-20T02:27:02.0237876Z [cluster1]   {
2021-07-20T02:27:02.0238490Z [cluster1]     "name": "SUBMARINER_HEALTHCHECKENABLED",
2021-07-20T02:27:02.0239160Z [cluster1]     "value": "true"
2021-07-20T02:27:02.0239623Z [cluster1]   },
2021-07-20T02:27:02.0240033Z [cluster1]   {
2021-07-20T02:27:02.0241103Z [cluster1]     "name": "SUBMARINER_HEALTHCHECKINTERVAL",
2021-07-20T02:27:02.0241941Z [cluster1]     "value": "1"
2021-07-20T02:27:02.0242388Z [cluster1]   },
2021-07-20T02:27:02.0242784Z [cluster1]   {
2021-07-20T02:27:02.0243569Z [cluster1]     "name": "SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT",
2021-07-20T02:27:02.0244361Z [cluster1]     "value": "5"
2021-07-20T02:27:02.0244804Z [cluster1]   },
2021-07-20T02:27:02.0245211Z [cluster1]   {
2021-07-20T02:27:02.0245685Z [cluster1]     "name": "NODE_NAME",
2021-07-20T02:27:02.0246198Z [cluster1]     "valueFrom": {
2021-07-20T02:27:02.0246722Z [cluster1]       "fieldRef": {
2021-07-20T02:27:02.0247247Z [cluster1]         "apiVersion": "v1",
2021-07-20T02:27:02.0247881Z [cluster1]         "fieldPath": "spec.nodeName"
2021-07-20T02:27:02.0248426Z [cluster1]       }
2021-07-20T02:27:02.0248841Z [cluster1]     }
2021-07-20T02:27:02.0249239Z [cluster1]   },
2021-07-20T02:27:02.0249655Z [cluster1]   {
2021-07-20T02:27:02.0250124Z [cluster1]     "name": "POD_NAME",
2021-07-20T02:27:02.1737451Z [cluster1]     "vVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-20T02:27:02.2360239Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env BROKER_K8S_CA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-20T02:27:02.2879360Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="BROKER_K8S_CA").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:02.2881338Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env CE_IPSEC_DEBUG false[0m
2021-07-20T02:27:02.2883261Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env CE_IPSEC_DEBUG false[0m
2021-07-20T02:27:02.2885078Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="CE_IPSEC_DEBUG").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:02.2887456Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env CE_IPSEC_IKEPORT 500[0m
2021-07-20T02:27:02.2888896Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env CE_IPSEC_IKEPORT 500[0m
2021-07-20T02:27:02.2890466Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="CE_IPSEC_IKEPORT").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:02.2892827Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env CE_IPSEC_NATTPORT 4500[0m
2021-07-20T02:27:02.2894146Z [36m[submariner-operator]$ [cluster2] validate_pod_container_env CE_IPSEC_NATTPORT 4500[0m
2021-07-20T02:27:02.2895737Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.containers[].env[] | select(.name=="CE_IPSEC_NATTPORT").value /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:02.2897395Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.serviceAccount submariner-gateway[0m
2021-07-20T02:27:02.2899064Z [36m[submariner-operator]$ [cluster2] validate_equals .spec.serviceAccount submariner-gateway[0m
2021-07-20T02:27:02.2900874Z [36m[submariner-operator]$ [cluster2] jq -r -M .spec.serviceAccount /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:02.2903056Z [36m[submariner-operator]$ [cluster2] validate_equals .status.phase Running[0m
2021-07-20T02:27:02.2904273Z [36m[submariner-operator]$ [cluster2] validate_equals .status.phase Running[0m
2021-07-20T02:27:02.2906328Z [36m[submariner-operator]$ [cluster2] jq -r -M .status.phase /tmp/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:02.2908071Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator[0m
2021-07-20T02:27:02.2909874Z [36m[submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator[0m
2021-07-20T02:27:02.3610745Z [36m[submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmpalueFrom": {
2021-07-20T02:27:02.3611588Z [cluster1]       "fieldRef": {
2021-07-20T02:27:02.3612099Z [cluster1]         "apiVersion": "v1",
2021-07-20T02:27:02.3612678Z [cluster1]         "fieldPath": "metadata.name"
2021-07-20T02:27:02.3613200Z [cluster1]       }
2021-07-20T02:27:02.3613580Z [cluster1]     }
2021-07-20T02:27:02.3613997Z [cluster1]   },
2021-07-20T02:27:02.3614363Z [cluster1]   {
2021-07-20T02:27:02.3614836Z [cluster1]     "name": "CE_IPSEC_IKEPORT",
2021-07-20T02:27:02.3615414Z [cluster1]     "value": "500"
2021-07-20T02:27:02.3615779Z [cluster1]   },
2021-07-20T02:27:02.3616103Z [cluster1]   {
2021-07-20T02:27:02.3616517Z [cluster1]     "name": "CE_IPSEC_NATTPORT",
2021-07-20T02:27:02.3616958Z [cluster1]     "value": "4500"
2021-07-20T02:27:02.3617304Z [cluster1]   },
2021-07-20T02:27:02.3617645Z [cluster1]   {
2021-07-20T02:27:02.3618095Z [cluster1]     "name": "CE_IPSEC_PREFERREDSERVER",
2021-07-20T02:27:02.3618598Z [cluster1]     "value": "false"
2021-07-20T02:27:02.3618963Z [cluster1]   },
2021-07-20T02:27:02.3619297Z [cluster1]   {
2021-07-20T02:27:02.3619715Z [cluster1]     "name": "CE_IPSEC_FORCEENCAPS",
2021-07-20T02:27:02.3620182Z [cluster1]     "value": "false"
2021-07-20T02:27:02.3620547Z [cluster1]   }
2021-07-20T02:27:02.3620879Z [cluster1] ]
2021-07-20T02:27:02.3621843Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_NAMESPACE submariner-operator[0m
2021-07-20T02:27:02.3623808Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_NAMESPACE submariner-operator[0m
2021-07-20T02:27:02.3625807Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_NAMESPACE").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:02.3627733Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_SERVICECIDR 100.1.0.0/16[0m
2021-07-20T02:27:02.3629081Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_SERVICECIDR 100.1.0.0/16[0m
2021-07-20T02:27:02.3630944Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_SERVICECIDR").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:02.3632767Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_CLUSTERCIDR 10.1.0.0/16[0m
2021-07-20T02:27:02.3634112Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_CLUSTERCIDR 10.1.0.0/16[0m
2021-07-20T02:27:02.3636019Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_CLUSTERCIDR").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:02.3637597Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_COLORCODES blue[0m
2021-07-20T02:27:02.3638739Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_COLORCODES blue[0m
2021-07-20T02:27:02.3640366Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_COLORCODES").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:02.3641907Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_DEBUG false[0m
2021-07-20T02:27:02.3643002Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_DEBUG false[0m
2021-07-20T02:27:02.3644572Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_DEBUG").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:02.3646191Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_NATENABLED false[0m
2021-07-20T02:27:02.3647357Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_NATENABLED false[0m
2021-07-20T02:27:02.3649256Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_NATENABLED").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:02.3651280Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_BROKER k8s[0m
2021-07-20T02:27:02.3652646Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env SUBMARINER_BROKER k8s[0m
2021-07-20T02:27:02.3654675Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="SUBMARINER_BROKER").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:02.3656605Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env BROKER_K8S_APISERVER 172.18.0.4:6443[0m
2021-07-20T02:27:02.3657996Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env BROKER_K8S_APISERVER 172.18.0.4:6443[0m
2021-07-20T02:27:02.3659943Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="BROKER_K8S_APISERVER").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:02.3662144Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env BROKER_K8S_REMOTENAMESPACE submariner-k8s-broker[0m
2021-07-20T02:27:02.3663953Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env BROKER_K8S_REMOTENAMESPACE submariner-k8s-broker[0m
2021-07-20T02:27:02.3666024Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="BROKER_K8S_REMOTENAMESPACE").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:02.6271094Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env BROKER_K8S_CA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-20T02:27:02.7560296Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env BROKER_K8S_CA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=[0m
2021-07-20T02:27:02.8020540Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="BROKER_K8S_CA").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:02.8022648Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env CE_IPSEC_DEBUG false[0m
2021-07-20T02:27:02.8024012Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env CE_IPSEC_DEBUG false[0m
2021-07-20T02:27:02.8025926Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="CE_IPSEC_DEBUG").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:02.8027754Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env CE_IPSEC_IKEPORT 500[0m
2021-07-20T02:27:02.8029102Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env CE_IPSEC_IKEPORT 500[0m
2021-07-20T02:27:02.8031015Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="CE_IPSEC_IKEPORT").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:02.8032854Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env CE_IPSEC_NATTPORT 4500[0m
2021-07-20T02:27:02.8034460Z [36m[submariner-operator]$ [cluster1] validate_pod_container_env CE_IPSEC_NATTPORT 4500[0m
2021-07-20T02:27:02.8036384Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.containers[].env[] | select(.name=="CE_IPSEC_NATTPORT").value /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:03.0988392Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.serviceAccount submariner-gateway/submariner-gateway-kx5st.cluster2.json[0m
2021-07-20T02:27:03.0990082Z [36m[submariner-operator]$ [cluster2] verify_subm_gateway_container[0m
2021-07-20T02:27:03.0991036Z [36m[submariner-operator]$ [cluster2] verify_subm_gateway_container[0m
2021-07-20T02:27:03.0992414Z [36m[submariner-operator]$ [cluster2] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')[0m
2021-07-20T02:27:03.0994192Z [36m[submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:27:03.0996016Z [36m[submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:27:03.0997925Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}[0m
2021-07-20T02:27:03.0999540Z [36m[submariner-operator]$ [cluster2] env_file=/tmp/submariner-gateway-kx5st.env[0m
2021-07-20T02:27:03.1000973Z [36m[submariner-operator]$ [cluster2] kubectl exec submariner-gateway-kx5st --namespace=submariner-operator -- env[0m
2021-07-20T02:27:03.1002366Z [36m[submariner-operator]$ [cluster2] tee /tmp/submariner-gateway-kx5st.env[0m
2021-07-20T02:27:03.1004155Z [36m[submariner-operator]$ [cluster2] kubectl exec submariner-gateway-kx5st --namespace=submariner-operator -- env[0m
2021-07-20T02:27:03.1006090Z [36m[submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec submariner-gateway-kx5st --namespace=submariner-operator -- env[0m
2021-07-20T02:27:03.1007379Z [cluster2] PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2021-07-20T02:27:03.1008201Z [cluster2] HOSTNAME=cluster2-worker
2021-07-20T02:27:03.1008794Z [cluster2] DISTTAG=f33container
2021-07-20T02:27:03.1009257Z [cluster2] FGC=f33
2021-07-20T02:27:03.1009670Z [cluster2] FBR=f33
2021-07-20T02:27:03.1010444Z [cluster2] SUBMARINER_CLUSTERID=cluster2
2021-07-20T02:27:03.1011033Z [cluster2] SUBMARINER_DEBUG=false
2021-07-20T02:27:03.1011582Z [cluster2] SUBMARINER_BROKER=k8s
2021-07-20T02:27:03.1012178Z [cluster2] SUBMARINER_CABLEDRIVER=libreswan
2021-07-20T02:27:03.1013166Z [cluster2] BROKER_K8S_REMOTENAMESPACE=submariner-k8s-broker
2021-07-20T02:27:03.1014495Z [cluster2] CE_IPSEC_PSK=RxKqGCxyc6/0hWrNf9qeaSCnys+VhG5BNpkVtfXDj+mujGbyv5zlvTp2/mnlxtXH
2021-07-20T02:27:03.1015827Z [cluster2] NODE_NAME=cluster2-worker
2021-07-20T02:27:03.1016764Z [cluster2] SUBMARINER_NAMESPACE=submariner-operator
2021-07-20T02:27:03.1017402Z [cluster2] SUBMARINER_SERVICECIDR=100.2.0.0/16
2021-07-20T02:27:03.1018311Z [cluster2] POD_NAME=submariner-gateway-kx5st
2021-07-20T02:27:03.1019052Z [cluster2] CE_IPSEC_PREFERREDSERVER=false
2021-07-20T02:27:03.1019686Z [cluster2] SUBMARINER_COLORCODES=blue
2021-07-20T02:27:03.1020257Z [cluster2] BROKER_K8S_APISERVER=172.18.0.4:6443
2021-07-20T02:27:03.1237528Z [cluster2] BROKER_K8S_APISERVERTOKEN=***
2021-07-20T02:27:03.1922490Z [cluster2] BROKER_K8S_CA=LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-20T02:27:03.2412933Z [cluster2] CE_IPSEC_DEBUG=false
2021-07-20T02:27:03.2413761Z [cluster2] SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT=5
2021-07-20T02:27:03.2415075Z [cluster2] CE_IPSEC_IKEPORT=500
2021-07-20T02:27:03.2415623Z [cluster2] CE_IPSEC_FORCEENCAPS=false
2021-07-20T02:27:03.2416237Z [cluster2] SUBMARINER_CLUSTERCIDR=10.2.0.0/16
2021-07-20T02:27:03.2416818Z [cluster2] SUBMARINER_GLOBALCIDR=
2021-07-20T02:27:03.2417612Z [cluster2] SUBMARINER_NATENABLED=false
2021-07-20T02:27:03.2418282Z [cluster2] SUBMARINER_HEALTHCHECKENABLED=true
2021-07-20T02:27:03.2419240Z [cluster2] SUBMARINER_HEALTHCHECKINTERVAL=1
2021-07-20T02:27:03.2419912Z [cluster2] CE_IPSEC_NATTPORT=4500
2021-07-20T02:27:03.2420532Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8383_TCP=tcp://100.2.182.9:8383
2021-07-20T02:27:03.2421229Z [cluster2] SUBMARINER_GATEWAY_METRICS_PORT_8080_TCP_ADDR=100.2.207.244
2021-07-20T02:27:03.2421923Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_PORT=tcp://100.2.110.44:8082
2021-07-20T02:27:03.2422726Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT=tcp://100.2.182.9:8383
2021-07-20T02:27:03.2423430Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_PORT_9153_TCP_PORT=9153
2021-07-20T02:27:03.2424090Z [cluster2] KUBERNETES_PORT_443_TCP=tcp://100.2.0.1:443
2021-07-20T02:27:03.2425014Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_PORT=tcp://100.2.208.42:9153
2021-07-20T02:27:03.2425778Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_PORT_9153_TCP_ADDR=100.2.208.42
2021-07-20T02:27:03.2426505Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_PORT=udp://100.2.217.106:53
2021-07-20T02:27:03.2427486Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_PORT_9153_TCP_PROTO=tcp
2021-07-20T02:27:03.2428204Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_SERVICE_PORT=8082
2021-07-20T02:27:03.2428897Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_SERVICE_PORT_METRICS=8082
2021-07-20T02:27:03.2429619Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_PORT_8082_TCP_PROTO=tcp
2021-07-20T02:27:03.2430233Z [cluster2] KUBERNETES_SERVICE_PORT_HTTPS=443
2021-07-20T02:27:03.2430869Z [cluster2] SUBMARINER_GATEWAY_METRICS_PORT=tcp://100.2.207.244:8080
2021-07-20T02:27:03.2431563Z [cluster2] SUBMARINER_OPERATOR_METRICS_SERVICE_PORT_CR_METRICS=8686
2021-07-20T02:27:03.2432216Z [cluster2] SUBMARINER_GATEWAY_METRICS_SERVICE_PORT=8080
2021-07-20T02:27:03.2432849Z [cluster2] SUBMARINER_GATEWAY_METRICS_PORT_8080_TCP_PROTO=tcp
2021-07-20T02:27:03.2433686Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_SERVICE_HOST=100.2.110.44
2021-07-20T02:27:03.2435508Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_PORT_8082_TCP_ADDR=100.2.110.44
2021-07-20T02:27:03.2436450Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_PORT_53_UDP_ADDR=100.2.217.106
2021-07-20T02:27:03.2437257Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_SERVICE_PORT_METRICS=9153
2021-07-20T02:27:03.2438108Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_PORT_53_UDP=udp://100.2.217.106:53
2021-07-20T02:27:03.2438907Z [cluster2] SUBMARINER_OPERATOR_METRICS_SERVICE_HOST=100.2.182.9
2021-07-20T02:27:03.2439671Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_PORT_8082_TCP_PORT=8082
2021-07-20T02:27:03.2440565Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_SERVICE_HOST=100.2.217.106
2021-07-20T02:27:03.2441414Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_PORT_9153_TCP=tcp://100.2.208.42:9153
2021-07-20T02:27:03.2442159Z [cluster2] KUBERNETES_PORT_443_TCP_PORT=443
2021-07-20T02:27:03.2442875Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8686_TCP=tcp://100.2.182.9:8686
2021-07-20T02:27:03.2443708Z [cluster2] SUBMARINER_GATEWAY_METRICS_PORT_8080_TCP=tcp://100.2.207.244:8080
2021-07-20T02:27:03.2444529Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_SERVICE_PORT_UDP=53
2021-07-20T02:27:03.2445229Z [cluster2] KUBERNETES_PORT=tcp://100.2.0.1:443
2021-07-20T02:27:03.2445928Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8383_TCP_ADDR=100.2.182.9
2021-07-20T02:27:03.2446757Z [cluster2] SUBMARINER_LIGHTHOUSE_AGENT_METRICS_PORT_8082_TCP=tcp://100.2.110.44:8082
2021-07-20T02:27:03.2447502Z [cluster2] KUBERNETES_PORT_443_TCP_ADDR=100.2.0.1
2021-07-20T02:27:03.2448163Z [cluster2] SUBMARINER_GATEWAY_METRICS_PORT_8080_TCP_PORT=8080
2021-07-20T02:27:03.2448878Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_SERVICE_PORT=53
2021-07-20T02:27:03.2449631Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_PORT_53_UDP_PROTO=udp
2021-07-20T02:27:03.2450406Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_SERVICE_HOST=100.2.208.42
2021-07-20T02:27:03.2451106Z [cluster2] KUBERNETES_SERVICE_HOST=100.2.0.1
2021-07-20T02:27:03.2451766Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8686_TCP_PROTO=tcp
2021-07-20T02:27:03.2452873Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8686_TCP_PORT=8686
2021-07-20T02:27:03.2453657Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8686_TCP_ADDR=100.2.182.9
2021-07-20T02:27:03.2454428Z [cluster2] SUBMARINER_GATEWAY_METRICS_SERVICE_HOST=100.2.207.244
2021-07-20T02:27:03.2455229Z [cluster2] SUBMARINER_GATEWAY_METRICS_SERVICE_PORT_METRICS=8080
2021-07-20T02:27:03.2456058Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_METRICS_SERVICE_PORT=9153
2021-07-20T02:27:03.2456818Z [cluster2] KUBERNETES_PORT_443_TCP_PROTO=tcp
2021-07-20T02:27:03.2457671Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8383_TCP_PROTO=tcp
2021-07-20T02:27:03.2458517Z [cluster2] SUBMARINER_OPERATOR_METRICS_PORT_8383_TCP_PORT=8383
2021-07-20T02:27:03.2459246Z [cluster2] SUBMARINER_LIGHTHOUSE_COREDNS_PORT_53_UDP_PORT=53
2021-07-20T02:27:03.2459886Z [cluster2] KUBERNETES_SERVICE_PORT=443
2021-07-20T02:27:03.2460584Z [cluster2] SUBMARINER_OPERATOR_METRICS_SERVICE_PORT_HTTP_METRICS=8383
2021-07-20T02:27:03.2462308Z [cluster2] SUBMARINER_OPERATOR_METRICS_SERVICE_PORT=8383
2021-07-20T02:27:03.2463138Z [cluster2] HOME=/root
2021-07-20T02:27:03.2464746Z [36m[submariner-operator]$ [cluster2] grep BROKER_K8S_APISERVER=172.18.0.4:6443 /tmp/submariner-gateway-kx5st.env[0m
2021-07-20T02:27:03.2465766Z [cluster2] BROKER_K8S_APISERVER=172.18.0.4:6443
2021-07-20T02:27:03.2467152Z [36m[submariner-operator]$ [cluster2] grep SUBMARINER_NAMESPACE=submariner-operator /tmp/submariner-gateway-kx5st.env[0m
2021-07-20T02:27:03.2468568Z [cluster2] SUBMARINER_NAMESPACE=submariner-operator
2021-07-20T02:27:03.2469909Z [36m[submariner-operator]$ [cluster2] grep SUBMARINER_BROKER=k8s /tmp/submariner-gateway-kx5st.env[0m
2021-07-20T02:27:03.2470905Z [cluster2] SUBMARINER_BROKER=k8s
2021-07-20T02:27:03.2989115Z [36m[submariner-operator]$ [cluster2] grep BROKER_K8S_CA=LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo= /tmp/submariner-gateway-kx5st.env[0m
2021-07-20T02:27:03.3975744Z [cluster2] BROKER_K8S_CA=LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lNREF5TVRnMU9Wb1hEVE14TURjeE9EQXlNVGcxT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHg0CmkxblNVU1g4dWRLWXZmUGRydWFwc0c1eDI0YUpYbVVvUW1WbWZNd1crUXZVUkovejA4VzlNMFhMdXdpdGN1UmsKckU0Um5Zc2szM2RIa2ptRHpiRGxxdEcvVzJoSGpBeWhqWjR3UC9hQkFlWThCeEdySzhHUXNHUDd5aVNsNW4xMwpDODdkMzRTMFUzY0hxdC9rRzZTaHhZUWJRakc0cDVwdm9pRHpJU2h3N0pZdVNJZ001L0tMMjJvZm0xcUZOd1lHCmF4M0lYTjZDQmYzcUliSFJIUE5jWnFmWHJWRllBQ0lnS1Jkb29kYkpwKzhRcG5NUGNWL1V5cVVOam1DejZ6YmUKeWVMQjd0dGljb3N2akFUTXNMQWFpenI2QUtmU1loTHovaVhzV1VLUzI0ZTg0UnRDQmgxZWVpNnp0UUZRMytPbgpVUkw1TTZDeEEwdzN5RGllUU1FQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFJVkFPektSK05oVzcwQzNmRjFtSjZFcFF1Z2MKMkpBSHZMNnN5VUZWbzNmUGZUbitNLzhJZW04ck5WVmtvak5VL1IzQWl2c2U0SVFWY0lSYXZ6eGZwRGliaGJReApXUy9aQUVFQUZsM1dPS3FqbjVkTTJHRG9hV1FNdmsyWW5MMGlmR2ZqcUJ3NDNGRllvMGRNWlA4YklwV1FoSXdnCkNOa211OWU0WFpmSE4vRjRaY0plMGpGNFVBU2JxaWVxaUtDYlZyczZKdkRTQ2l1OVlSdG8yTGhwSEpTMzZGUGQKUVVmK0htTFgva3ZrZ1NaK2hMTS9lK1hjeG1uTmd3bUxtbmRGWHIvdlRTcnI3OE04UityLzFZS3pGTjJUMnhZOAoyVXE3eU5Ga01KeExpcFFFR0xKTXBSd2J6KzNCQTNIL1BFc3pNODdPbG5oRStNMld5c1U0a2dnZXRVZz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=
2021-07-20T02:27:03.4611904Z [36m[submariner-operator]$ [cluster2] grep CE_IPSEC_DEBUG=false /tmp/submariner-gateway-kx5st.env[0m
2021-07-20T02:27:03.4612976Z [cluster2] CE_IPSEC_DEBUG=false
2021-07-20T02:27:03.4614291Z [36m[submariner-operator]$ [cluster2] grep SUBMARINER_DEBUG=false /tmp/submariner-gateway-kx5st.env[0m
2021-07-20T02:27:03.4615378Z [cluster2] SUBMARINER_DEBUG=false
2021-07-20T02:27:03.4617194Z [36m[submariner-operator]$ [cluster2] grep BROKER_K8S_REMOTENAMESPACE=submariner-k8s-broker /tmp/submariner-gateway-kx5st.env[0m
2021-07-20T02:27:03.9372370Z [cluster2] BROKER_K8S_R[0m
2021-07-20T02:27:03.9374111Z [36m[submariner-operator]$ [cluster1] validate_equals .spec.serviceAccount submariner-gateway[0m
2021-07-20T02:27:03.9376374Z [36m[submariner-operator]$ [cluster1] jq -r -M .spec.serviceAccount /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:03.9379066Z [36m[submariner-operator]$ [cluster1] validate_equals .status.phase Running[0m
2021-07-20T02:27:03.9380647Z [36m[submariner-operator]$ [cluster1] validate_equals .status.phase Running[0m
2021-07-20T02:27:03.9382326Z [36m[submariner-operator]$ [cluster1] jq -r -M .status.phase /tmp/submariner-gateway-5479b.cluster1.json[0m
2021-07-20T02:27:03.9384322Z [36m[submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator[0m
2021-07-20T02:27:03.9385963Z [36m[submariner-o