Skip to content

Instantly share code, notes, and snippets.

@h9ing

h9ing/get source config retry Secret

Created July 18, 2024 09:48
Show Gist options
  • Save h9ing/b70a7325a1f1053a52965c51032b3083 to your computer and use it in GitHub Desktop.
Save h9ing/b70a7325a1f1053a52965c51032b3083 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
get source config retry
2024-07-18T09:25:27.459387+0000 | opal_client.policy_store.opa_client | INFO | Authentication mode for policy store: PolicyStoreAuth.NONE
2024-07-18T09:25:27.459734+0000 | opal_client.callbacks.register | INFO | Callbacks register loaded
2024-07-18T09:25:27.461601+0000 | opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'FastApiRpcFetchProvider' found at: <class 'opal_common.fetcher.providers.fastapi_rpc_fetch_provider.FastApiRpcFetchProvider'>
2024-07-18T09:25:27.461719+0000 | opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'HttpFetchProvider' found at: <class 'opal_common.fetcher.providers.http_fetch_provider.HttpFetchProvider'>
2024-07-18T09:25:27.461855+0000 | opal_common.fetcher.fetcher_register | INFO | Fetcher Register loaded
2024-07-18T09:25:27.462128+0000 | opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'FastApiRpcFetchProvider' found at: <class 'opal_common.fetcher.providers.fastapi_rpc_fetch_provider.FastApiRpcFetchProvider'>
2024-07-18T09:25:27.462234+0000 | opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'HttpFetchProvider' found at: <class 'opal_common.fetcher.providers.http_fetch_provider.HttpFetchProvider'>
2024-07-18T09:25:27.462355+0000 | opal_common.fetcher.fetcher_register | INFO | Fetcher Register loaded
2024-07-18T09:25:27.462682+0000 | opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'FastApiRpcFetchProvider' found at: <class 'opal_common.fetcher.providers.fastapi_rpc_fetch_provider.FastApiRpcFetchProvider'>
2024-07-18T09:25:27.462786+0000 | opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'HttpFetchProvider' found at: <class 'opal_common.fetcher.providers.http_fetch_provider.HttpFetchProvider'>
2024-07-18T09:25:27.462896+0000 | opal_common.fetcher.fetcher_register | INFO | Fetcher Register loaded
2024-07-18T09:25:27.463131+0000 | opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'FastApiRpcFetchProvider' found at: <class 'opal_common.fetcher.providers.fastapi_rpc_fetch_provider.FastApiRpcFetchProvider'>
2024-07-18T09:25:27.463232+0000 | opal_common.fetcher.fetcher_register | INFO | Loading FetcherProvider 'HttpFetchProvider' found at: <class 'opal_common.fetcher.providers.http_fetch_provider.HttpFetchProvider'>
2024-07-18T09:25:27.463340+0000 | opal_common.fetcher.fetcher_register | INFO | Fetcher Register loaded
2024-07-18T09:25:27.463481+0000 | opal_client.client | INFO | API authentication disabled (public encryption key was not provided)
2024-07-18T09:25:27.475021+0000 | opal_client.data.updater | INFO | Launching data updater
2024-07-18T09:25:27.475256+0000 | opal_client.policy.updater | INFO | Launching policy updater
2024-07-18T09:25:27.475475+0000 | opal_client.data.updater | INFO | Subscribing to topics: ['test-topic']
2024-07-18T09:25:27.475727+0000 | opal_client.policy.updater | INFO | Subscribing to topics: ['policy:.']
2024-07-18T09:25:27.475973+0000 | fastapi_websocket_pubsub.pub_sub_client | INFO | Trying to connect to Pub/Sub server - ws://opal-server.opal.svc.cluster.local/ws
2024-07-18T09:25:27.476259+0000 | fastapi_websocket_rpc.websocket_rpc_c...| INFO | Trying server - ws://opal-server.opal.svc.cluster.local/ws
2024-07-18T09:25:27.477659+0000 | fastapi_websocket_pubsub.pub_sub_client | INFO | Trying to connect to Pub/Sub server - ws://opal-server.opal.svc.cluster.local/ws
2024-07-18T09:25:27.477921+0000 | fastapi_websocket_rpc.websocket_rpc_c...| INFO | Trying server - ws://opal-server.opal.svc.cluster.local/ws
2024-07-18T09:25:27.556871+0000 | opal_client.policy.updater | INFO | Connected to server
2024-07-18T09:25:27.557062+0000 | opal_client.policy.updater | INFO | Refetching policy code (full bundle)
2024-07-18T09:25:27.557323+0000 | opal_client.policy.fetcher | INFO | Fetching policy bundle from http://opal-server.opal.svc.cluster.local/policy
2024-07-18T09:25:27.558320+0000 | fastapi_websocket_pubsub.pub_sub_client | INFO | Connected to PubSub server ws://opal-server.opal.svc.cluster.local/ws
2024-07-18T09:25:27.558520+0000 | opal_client.data.updater | INFO | Connected to server
2024-07-18T09:25:27.558601+0000 | opal_client.data.updater | INFO | Performing data configuration, reason: Initial load
2024-07-18T09:25:27.558844+0000 | opal_client.data.updater | INFO | Getting data-sources configuration from 'http://opal-server.opal.svc.cluster.local/data/config'
2024-07-18T09:25:27.577018+0000 | opal_client.policy.fetcher | INFO | Fetched valid bundle, id: a5d59c5b94753e09bb2edeadd63e368295d26a2d
2024-07-18T09:25:27.578039+0000 | opal_client.policy.updater | INFO | Got policy bundle with 2 rego files, 0 data files, commit hash: 'a5d59c5b94753e09bb2edeadd63e368295d26a2d'
2024-07-18T09:30:27.954249+0000 | opal_client.data.updater |ERROR | Failed to load data sources config
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/usr/local/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
exitcode = _main(fd, parent_sentinel)
│ │ └ 4
│ └ 7
└ <function _main at 0x7f1e4299e440>
File "/usr/local/lib/python3.10/multiprocessing/spawn.py", line 129, in _main
return self._bootstrap(parent_sentinel)
│ │ └ 4
│ └ <function BaseProcess._bootstrap at 0x7f1e42b55990>
└ <SpawnProcess name='SpawnProcess-1' parent=7 started>
File "/usr/local/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap
self.run()
│ └ <function BaseProcess.run at 0x7f1e42b55000>
└ <SpawnProcess name='SpawnProcess-1' parent=7 started>
File "/usr/local/lib/python3.10/multiprocessing/process.py", line 108, in run
self._target(*self._args, **self._kwargs)
│ │ │ │ │ └ {'config': <uvicorn.config.Config object at 0x7f1e42c771c0>, 'target': <bound method Server.run of <uvicorn.server.Server obj...
│ │ │ │ └ <SpawnProcess name='SpawnProcess-1' parent=7 started>
│ │ │ └ ()
│ │ └ <SpawnProcess name='SpawnProcess-1' parent=7 started>
│ └ <function subprocess_started at 0x7f1e41e679a0>
└ <SpawnProcess name='SpawnProcess-1' parent=7 started>
File "/usr/local/lib/python3.10/site-packages/uvicorn/_subprocess.py", line 80, in subprocess_started
target(sockets=sockets)
│ └ [<socket.socket fd=3, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('127.0.0.1', 7000)>]
└ <bound method Server.run of <uvicorn.server.Server object at 0x7f1e42c770d0>>
File "/usr/local/lib/python3.10/site-packages/uvicorn/server.py", line 65, in run
return asyncio.run(self.serve(sockets=sockets))
│ │ │ │ └ [<socket.socket fd=3, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('127.0.0.1', 7000)>]
│ │ │ └ <function Server.serve at 0x7f1e41e66ef0>
│ │ └ <uvicorn.server.Server object at 0x7f1e42c770d0>
│ └ <function run at 0x7f1e426e1990>
└ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
File "/usr/local/lib/python3.10/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
│ │ └ <coroutine object Server.serve at 0x7f1e41bb2dc0>
│ └ <method 'run_until_complete' of 'uvloop.loop.Loop' objects>
└ <uvloop.Loop running=True closed=False debug=False>
File "/usr/local/lib/python3.10/site-packages/opal_client-0.7.7-py3.10.egg/opal_client/data/updater.py", line 247, in on_connect
await self.get_base_policy_data()
│ └ <function DataUpdater.get_base_policy_data at 0x7f1e3eeebbe0>
└ <opal_client.data.updater.DataUpdater object at 0x7f1e3edddea0>
File "/usr/local/lib/python3.10/site-packages/opal_client-0.7.7-py3.10.egg/opal_client/data/updater.py", line 208, in get_base_policy_data
sources_config = await self.get_policy_data_config(url=config_url)
│ │ └ None
│ └ <function DataUpdater.get_policy_data_config at 0x7f1e3eeebb50>
└ <opal_client.data.updater.DataUpdater object at 0x7f1e3edddea0>
> File "/usr/local/lib/python3.10/site-packages/opal_client-0.7.7-py3.10.egg/opal_client/data/updater.py", line 182, in get_policy_data_config
response = await session.get(url, **self._ssl_context_kwargs)
│ │ │ │ └ {}
│ │ │ └ <opal_client.data.updater.DataUpdater object at 0x7f1e3edddea0>
│ │ └ 'http://opal-server.opal.svc.cluster.local/data/config'
│ └ <function ClientSession.get at 0x7f1e412b7370>
└ <aiohttp.client.ClientSession object at 0x7f1e3ccbc610>
File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 608, in _request
await resp.start(conn)
│ │ └ Connection<ConnectionKey(host='10.31.98.114', port=22, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_headers_has...
│ └ <function ClientResponse.start at 0x7f1e414e6f80>
└ <ClientResponse(http://opal-server.opal.svc.cluster.local/v1/opal/source?token=eyxxxxxxxxxxxxxx...
File "/usr/local/lib/python3.10/site-packages/aiohttp/client_reqrep.py", line 971, in start
with self._timer:
│ └ <aiohttp.helpers.TimerContext object at 0x7f1e3ccbcfa0>
└ <ClientResponse(http://opal-server.opal.svc.cluster.local/v1/opal/source?token=eyxxxxxxxxxxxxxx...
File "/usr/local/lib/python3.10/site-packages/aiohttp/helpers.py", line 735, in __exit__
raise asyncio.TimeoutError from None
│ └ <class 'asyncio.exceptions.TimeoutError'>
└ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
asyncio.exceptions.TimeoutError
2024-07-18T09:30:29.968699+0000 | fastapi_websocket_rpc.websocket_rpc_c...| INFO | Connection was terminated.
2024-07-18T09:30:29.968906+0000 | fastapi_websocket_rpc.websocket_rpc_c...| INFO | Closing RPC client
2024-07-18T09:30:29.969224+0000 | fastapi_websocket_rpc.websocket_rpc_c...|ERROR | RPC Error
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/usr/local/lib/python3.10/multiprocessing/spawn.py", line 116, in spawn_main
exitcode = _main(fd, parent_sentinel)
│ │ └ 4
│ └ 7
└ <function _main at 0x7f1e4299e440>
File "/usr/local/lib/python3.10/multiprocessing/spawn.py", line 129, in _main
return self._bootstrap(parent_sentinel)
│ │ └ 4
│ └ <function BaseProcess._bootstrap at 0x7f1e42b55990>
└ <SpawnProcess name='SpawnProcess-1' parent=7 started>
File "/usr/local/lib/python3.10/multiprocessing/process.py", line 314, in _bootstrap
self.run()
│ └ <function BaseProcess.run at 0x7f1e42b55000>
└ <SpawnProcess name='SpawnProcess-1' parent=7 started>
File "/usr/local/lib/python3.10/multiprocessing/process.py", line 108, in run
self._target(*self._args, **self._kwargs)
│ │ │ │ │ └ {'config': <uvicorn.config.Config object at 0x7f1e42c771c0>, 'target': <bound method Server.run of <uvicorn.server.Server obj...
│ │ │ │ └ <SpawnProcess name='SpawnProcess-1' parent=7 started>
│ │ │ └ ()
│ │ └ <SpawnProcess name='SpawnProcess-1' parent=7 started>
│ └ <function subprocess_started at 0x7f1e41e679a0>
└ <SpawnProcess name='SpawnProcess-1' parent=7 started>
File "/usr/local/lib/python3.10/site-packages/uvicorn/_subprocess.py", line 80, in subprocess_started
target(sockets=sockets)
│ └ [<socket.socket fd=3, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('127.0.0.1', 7000)>]
└ <bound method Server.run of <uvicorn.server.Server object at 0x7f1e42c770d0>>
File "/usr/local/lib/python3.10/site-packages/uvicorn/server.py", line 65, in run
return asyncio.run(self.serve(sockets=sockets))
│ │ │ │ └ [<socket.socket fd=3, family=AddressFamily.AF_INET, type=SocketKind.SOCK_STREAM, proto=0, laddr=('127.0.0.1', 7000)>]
│ │ │ └ <function Server.serve at 0x7f1e41e66ef0>
│ │ └ <uvicorn.server.Server object at 0x7f1e42c770d0>
│ └ <function run at 0x7f1e426e1990>
└ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
File "/usr/local/lib/python3.10/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
│ │ └ <coroutine object Server.serve at 0x7f1e41bb2dc0>
│ └ <method 'run_until_complete' of 'uvloop.loop.Loop' objects>
└ <uvloop.Loop running=True closed=False debug=False>
File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_pubsub/pub_sub_client.py", line 198, in run
async with client:
└ <fastapi_websocket_rpc.websocket_rpc_client.WebSocketRpcClient object at 0x7f1e3ee61ed0>
File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/websocket_rpc_client.py", line 167, in __aenter__
return await retry(**self.retry_config)(self.__connect__)()
│ │ │ │ └ <function WebSocketRpcClient.__connect__ at 0x7f1e3f2a3d90>
│ │ │ └ <fastapi_websocket_rpc.websocket_rpc_client.WebSocketRpcClient object at 0x7f1e3ee61ed0>
│ │ └ {'wait': <tenacity.wait.wait_random_exponential object at 0x7f1e3f2777f0>, 'retry': <tenacity.retry.retry_if_exception object...
│ └ <fastapi_websocket_rpc.websocket_rpc_client.WebSocketRpcClient object at 0x7f1e3ee61ed0>
└ <function retry at 0x7f1e40a1a950>
File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 142, in async_wrapped
return await fn(*args, **kwargs)
│ │ └ {}
│ └ ()
└ <function WebSocketRpcClient.__connect__ at 0x7f1e3ee7c5e0>
File "/usr/local/lib/python3.10/site-packages/tenacity/_asyncio.py", line 61, in __call__
result = await fn(*args, **kwargs)
│ │ └ {}
│ └ ()
└ <bound method WebSocketRpcClient.__connect__ of <fastapi_websocket_rpc.websocket_rpc_client.WebSocketRpcClient object at 0x7f...
> File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/websocket_rpc_client.py", line 130, in __connect__
await self.channel.on_connect()
│ │ └ <function RpcChannel.on_connect at 0x7f1e3f2a2e60>
│ └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f1e3ee620e0>
└ <fastapi_websocket_rpc.websocket_rpc_client.WebSocketRpcClient object at 0x7f1e3ee61ed0>
File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/rpc_channel.py", line 291, in on_connect
await self.on_handler_event(self._connect_handlers, self)
│ │ │ │ └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f1e3ee620e0>
│ │ │ └ [<bound method PubSubClient._primary_on_connect of <fastapi_websocket_pubsub.pub_sub_client.PubSubClient object at 0x7f1e3ee6...
│ │ └ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f1e3ee620e0>
│ └ <function RpcChannel.on_handler_event at 0x7f1e3f2a2dd0>
└ <fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f1e3ee620e0>
File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_rpc/rpc_channel.py", line 280, in on_handler_event
await asyncio.gather(*(callback(*args, **kwargs) for callback in handlers))
│ │ │ │ └ [<bound method PubSubClient._primary_on_connect of <fastapi_websocket_pubsub.pub_sub_client.PubSubClient object at 0x7f1e3ee6...
│ │ │ └ {}
│ │ └ (<fastapi_websocket_rpc.rpc_channel.RpcChannel object at 0x7f1e3ee620e0>,)
│ └ <function gather at 0x7f1e41e98790>
└ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
File "/usr/local/lib/python3.10/site-packages/fastapi_websocket_pubsub/pub_sub_client.py", line 248, in _primary_on_connect
await asyncio.gather(
│ └ <function gather at 0x7f1e41e98790>
└ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
File "/usr/local/lib/python3.10/site-packages/opal_client-0.7.7-py3.10.egg/opal_client/data/updater.py", line 247, in on_connect
await self.get_base_policy_data()
│ └ <function DataUpdater.get_base_policy_data at 0x7f1e3eeebbe0>
└ <opal_client.data.updater.DataUpdater object at 0x7f1e3edddea0>
File "/usr/local/lib/python3.10/site-packages/opal_client-0.7.7-py3.10.egg/opal_client/data/updater.py", line 208, in get_base_policy_data
sources_config = await self.get_policy_data_config(url=config_url)
│ │ └ None
│ └ <function DataUpdater.get_policy_data_config at 0x7f1e3eeebb50>
└ <opal_client.data.updater.DataUpdater object at 0x7f1e3edddea0>
File "/usr/local/lib/python3.10/site-packages/opal_client-0.7.7-py3.10.egg/opal_client/data/updater.py", line 182, in get_policy_data_config
response = await session.get(url, **self._ssl_context_kwargs)
│ │ │ │ └ {}
│ │ │ └ <opal_client.data.updater.DataUpdater object at 0x7f1e3edddea0>
│ │ └ 'http://opal-server.opal.svc.cluster.local/data/config'
│ └ <function ClientSession.get at 0x7f1e412b7370>
└ <aiohttp.client.ClientSession object at 0x7f1e3ccbc610>
File "/usr/local/lib/python3.10/site-packages/aiohttp/client.py", line 608, in _request
await resp.start(conn)
│ │ └ Connection<ConnectionKey(host='10.31.98.114', port=22, is_ssl=False, ssl=True, proxy=None, proxy_auth=None, proxy_headers_has...
│ └ <function ClientResponse.start at 0x7f1e414e6f80>
└ <ClientResponse(http://opal-server.opal.svc.cluster.local/v1/opal/source?token=eyxxxxxxxxxxxxxx...
File "/usr/local/lib/python3.10/site-packages/aiohttp/client_reqrep.py", line 971, in start
with self._timer:
│ └ <aiohttp.helpers.TimerContext object at 0x7f1e3ccbcfa0>
└ <ClientResponse(http://opal-server.opal.svc.cluster.local/v1/opal/source?token=eyxxxxxxxxxxxxxx...
File "/usr/local/lib/python3.10/site-packages/aiohttp/helpers.py", line 735, in __exit__
raise asyncio.TimeoutError from None
│ └ <class 'asyncio.exceptions.TimeoutError'>
└ <module 'asyncio' from '/usr/local/lib/python3.10/asyncio/__init__.py'>
asyncio.exceptions.TimeoutError
2024-07-18T09:30:30.955005+0000 | fastapi_websocket_rpc.websocket_rpc_c...| INFO | Trying server - ws://opal-server.opal.svc.cluster.local/ws
2024-07-18T09:30:31.005750+0000 | opal_client.data.updater | INFO | Connected to server
2024-07-18T09:30:31.005920+0000 | opal_client.data.updater | INFO | Performing data configuration, reason: Initial load
2024-07-18T09:30:31.006118+0000 | opal_client.data.updater | INFO | Getting data-sources configuration from 'http://opal-server.opal.svc.cluster.local/data/config'
2024-07-18T09:32:03.494934+0000 | opal_client.data.updater | INFO | Triggering data update with id: 483bfa3529964a7ea2b3794a22a010e7
2024-07-18T09:32:03.495224+0000 | opal_client.data.updater | INFO | Fetching policy data
2024-07-18T09:32:03.495380+0000 | opal_client.data.fetcher | INFO | Fetching data from url: http://policy-data-server/v1/opal/policyData
2024-07-18T09:32:03.496595+0000 | fastapi_websocket_pubsub.pub_sub_client | INFO | Connected to PubSub server ws://opal-server.opal.svc.cluster.local/ws
2024-07-18T09:32:04.852597+0000 | opal_client.data.updater | INFO | Saving fetched data to policy-store: source url='http://policy-data-server/v1/opal/policyData', destination path='/'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment