Created
November 19, 2024 11:59
-
-
Save snowch/1b401dcb5fc4320ee33fce60c4bc28c0 to your computer and use it in GitHub Desktop.
mount-s3 log
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
2024-11-19T11:57:48.454616Z DEBUG awscrt::libcrypto_resolve: searching process and loaded modules | |
2024-11-19T11:57:48.454649Z DEBUG awscrt::libcrypto_resolve: found static aws-lc HMAC symbols | |
2024-11-19T11:57:48.454653Z DEBUG awscrt::libcrypto_resolve: found static aws-lc libcrypto 1.1.1 EVP_MD symbols | |
2024-11-19T11:57:48.454670Z DEBUG awscrt::libcrypto_resolve: Compiled with libcrypto AWS-LC 1.36.1, linked to libcrypto AWS-LC 1.36.1 | |
2024-11-19T11:57:48.454679Z INFO awscrt::tls-handler: static: Initializing TLS using s2n. | |
2024-11-19T11:57:48.454964Z DEBUG awscrt::tls-handler: ctx: Based on OS, we detected the default PKI path as /etc/ssl/certs, and ca file as /etc/ssl/certs/ca-certificates.crt | |
2024-11-19T11:57:48.455002Z INFO awscrt::event-loop: id=0x55b812b32a30: Initializing edge-triggered epoll | |
2024-11-19T11:57:48.455010Z INFO awscrt::event-loop: id=0x55b812b32a30: Using eventfd for cross-thread notifications. | |
2024-11-19T11:57:48.455016Z INFO awscrt::event-loop: id=0x55b812b32a30: Starting event-loop thread. | |
2024-11-19T11:57:48.455065Z INFO awscrt::event-loop: id=0x55b812b27100: Initializing edge-triggered epoll | |
2024-11-19T11:57:48.455074Z INFO awscrt::event-loop: id=0x55b812b27100: Using eventfd for cross-thread notifications. | |
2024-11-19T11:57:48.455078Z INFO awscrt::event-loop: id=0x55b812b27100: Starting event-loop thread. | |
2024-11-19T11:57:48.455122Z INFO awscrt::event-loop: id=0x55b812b450e0: Initializing edge-triggered epoll | |
2024-11-19T11:57:48.455127Z INFO awscrt::event-loop: id=0x55b812b450e0: Using eventfd for cross-thread notifications. | |
2024-11-19T11:57:48.455131Z INFO awscrt::event-loop: id=0x55b812b450e0: Starting event-loop thread. | |
2024-11-19T11:57:48.455127Z INFO awscrt::event-loop: id=0x55b812b32a30: main loop started | |
2024-11-19T11:57:48.455151Z INFO awscrt::event-loop: id=0x55b812b32a30: default timeout 100000, and max events to process per tick 100 | |
2024-11-19T11:57:48.455154Z INFO awscrt::event-loop: id=0x55b812b3bb70: Initializing edge-triggered epoll | |
2024-11-19T11:57:48.455159Z INFO awscrt::event-loop: id=0x55b812b3bb70: Using eventfd for cross-thread notifications. | |
2024-11-19T11:57:48.455164Z INFO awscrt::event-loop: id=0x55b812b3bb70: Starting event-loop thread. | |
2024-11-19T11:57:48.455177Z INFO awscrt::event-loop: id=0x55b812b27100: main loop started | |
2024-11-19T11:57:48.455198Z INFO awscrt::dns: id=0x55b812b38280: Initializing default host resolver with 8 max host entries. | |
2024-11-19T11:57:48.455199Z INFO awscrt::event-loop: id=0x55b812b27100: default timeout 100000, and max events to process per tick 100 | |
2024-11-19T11:57:48.455202Z INFO awscrt::channel-bootstrap: id=0x55b812b23550: Initializing client bootstrap with event-loop group 0x55b812b22510 | |
2024-11-19T11:57:48.455198Z INFO awscrt::event-loop: id=0x55b812b450e0: main loop started | |
2024-11-19T11:57:48.455220Z INFO awscrt::event-loop: id=0x55b812b450e0: default timeout 100000, and max events to process per tick 100 | |
2024-11-19T11:57:48.455232Z INFO awscrt::event-loop: id=0x55b812b3bb70: main loop started | |
2024-11-19T11:57:48.455252Z INFO awscrt::event-loop: id=0x55b812b3bb70: default timeout 100000, and max events to process per tick 100 | |
2024-11-19T11:57:48.455258Z DEBUG awscrt::channel-bootstrap: id=0x55b812b23550: acquiring bootstrap reference | |
2024-11-19T11:57:48.455262Z INFO awscrt::connection-manager: id=0x55b812b3c5f0: Successfully created | |
2024-11-19T11:57:48.455266Z INFO awscrt::exp-backoff-strategy: id=0x55b812b3c8d0: Initializing exponential backoff retry strategy with scale factor: 0 jitter mode: 0 and max retries 1 | |
2024-11-19T11:57:48.455269Z DEBUG awscrt::channel-bootstrap: id=0x55b812b23550: releasing bootstrap reference | |
2024-11-19T11:57:48.455276Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3c8d0: Initializing retry token 0x55b812b3f7a0 | |
2024-11-19T11:57:48.455295Z DEBUG awscrt::Unknown: (id=0x55b812b43950) IMDS client's token is invalid and is now updating. | |
2024-11-19T11:57:48.455305Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3c8d0: Vending retry_token 0x55b812b3f7a0 | |
2024-11-19T11:57:48.455316Z DEBUG awscrt::Unknown: id=0x55b812b43950: IMDS Client successfully acquired retry token. | |
2024-11-19T11:57:48.455321Z DEBUG awscrt::connection-manager: id=0x55b812b3c5f0: Acquire connection | |
2024-11-19T11:57:48.455325Z DEBUG awscrt::connection-manager: id=0x55b812b3c5f0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=0, open_connection_count=0, ref_count=1 | |
2024-11-19T11:57:48.455330Z INFO awscrt::connection-manager: id=0x55b812b3c5f0: Requesting 1 new connections from http | |
2024-11-19T11:57:48.455334Z DEBUG awscrt::channel-bootstrap: id=0x55b812b23550: acquiring bootstrap reference | |
2024-11-19T11:57:48.455338Z DEBUG awscrt::dns: id=0x55b812b38280: Host resolution requested for 169.254.169.254 | |
2024-11-19T11:57:48.455341Z DEBUG awscrt::dns: id=0x55b812b38280: No cached entries found for 169.254.169.254 starting new resolver thread. | |
2024-11-19T11:57:48.455406Z DEBUG awscrt::dns: static: resolving host 169.254.169.254 | |
2024-11-19T11:57:48.455437Z DEBUG awscrt::dns: static: resolved record: 169.254.169.254 | |
2024-11-19T11:57:48.455445Z DEBUG awscrt::dns: static, resolving host 169.254.169.254 successful, returned 1 addresses | |
2024-11-19T11:57:48.455449Z DEBUG awscrt::dns: static: new address resolved 169.254.169.254 for host 169.254.169.254 caching | |
2024-11-19T11:57:48.455454Z DEBUG awscrt::dns: static, invoking resolution callback for host 169.254.169.254 with 1 addresses | |
2024-11-19T11:57:48.455491Z DEBUG awscrt::socket: id=0x7feed4000f20 fd=16: initializing with domain 0 and type 0 | |
2024-11-19T11:57:48.455497Z DEBUG awscrt::socket: id=0x7feed4000f20 fd=16: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
2024-11-19T11:57:48.455501Z DEBUG awscrt::socket: id=0x7feed4000f20 fd=16: beginning connect. | |
2024-11-19T11:57:48.455506Z DEBUG awscrt::socket: id=0x7feed4000f20 fd=16: connecting to endpoint 169.254.169.254:80. | |
2024-11-19T11:57:48.470408Z DEBUG awscrt::socket: id=0x7feed4000f20 fd=16: connection failure | |
2024-11-19T11:57:48.470433Z DEBUG awscrt::channel-bootstrap: id=0x55b812b23550: client connection on socket 0x7feed4000f20 completed with error 1049. | |
2024-11-19T11:57:48.470438Z DEBUG awscrt::channel-bootstrap: id=0x55b812b23550: recording bad address 169.254.169.254. | |
2024-11-19T11:57:48.470441Z INFO awscrt::dns: id=0x55b812b38280: recording failure for record 169.254.169.254 for 169.254.169.254, moving to bad list | |
2024-11-19T11:57:48.470449Z DEBUG awscrt::dns: static: purging address 169.254.169.254 for host 169.254.169.254 from the cache due to cache eviction or shutdown | |
2024-11-19T11:57:48.470453Z DEBUG awscrt::socket: id=0x7feed4000f20 fd=16: closing | |
2024-11-19T11:57:48.470474Z ERROR awscrt::channel-bootstrap: id=0x55b812b23550: Connection failed with error_code 1049. | |
2024-11-19T11:57:48.470478Z ERROR awscrt::http-connection: static: Client connection failed with error 1049 (AWS_IO_SOCKET_NO_ROUTE_TO_HOST). | |
2024-11-19T11:57:48.470482Z WARN awscrt::connection-manager: id=0x55b812b3c5f0: Failed to obtain new connection from http layer, error 1049(socket connect failure, no route to host.) | |
2024-11-19T11:57:48.470485Z DEBUG awscrt::connection-manager: id=0x55b812b3c5f0: Failing excess connection acquisition with error code 1049 | |
2024-11-19T11:57:48.470489Z DEBUG awscrt::connection-manager: id=0x55b812b3c5f0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=0, ref_count=1 | |
2024-11-19T11:57:48.470499Z WARN awscrt::connection-manager: id=0x55b812b3c5f0: Failed to complete connection acquisition with error_code 1049(socket connect failure, no route to host.) | |
2024-11-19T11:57:48.470503Z WARN awscrt::Unknown: id=0x55b812b43950: IMDS Client failed to acquire a connection, error code 1049(socket connect failure, no route to host.) | |
2024-11-19T11:57:48.470514Z DEBUG awscrt::Unknown: (id=0x55b812b43950) IMDS client failed to fetch token for requester 0x55b812b42460, fall back to v1 for the same requester. Received response status code: 0 | |
2024-11-19T11:57:48.470518Z DEBUG awscrt::Unknown: (id=0x55b812b43950) IMDS client failed to fetch token, fallback to v1. requester 0x55b812b33b70. | |
2024-11-19T11:57:48.470523Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3c8d0: Initializing retry token 0x7feed4001f10 | |
2024-11-19T11:57:48.470538Z ERROR awscrt::Unknown: (id=0x55b812b43950) IMDS client failed to update the token from IMDS. | |
2024-11-19T11:57:48.470544Z DEBUG awscrt::channel-bootstrap: id=0x55b812b23550: releasing bootstrap reference | |
2024-11-19T11:57:48.470567Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3c8d0: Vending retry_token 0x7feed4001f10 | |
2024-11-19T11:57:48.470583Z DEBUG awscrt::Unknown: id=0x55b812b43950: IMDS Client successfully acquired retry token. | |
2024-11-19T11:57:48.470592Z DEBUG awscrt::connection-manager: id=0x55b812b3c5f0: Acquire connection | |
2024-11-19T11:57:48.470597Z DEBUG awscrt::connection-manager: id=0x55b812b3c5f0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=0, open_connection_count=0, ref_count=1 | |
2024-11-19T11:57:48.470603Z INFO awscrt::connection-manager: id=0x55b812b3c5f0: Requesting 1 new connections from http | |
2024-11-19T11:57:48.470609Z DEBUG awscrt::channel-bootstrap: id=0x55b812b23550: acquiring bootstrap reference | |
2024-11-19T11:57:48.470612Z DEBUG awscrt::dns: id=0x55b812b38280: Host resolution requested for 169.254.169.254 | |
2024-11-19T11:57:48.570728Z DEBUG awscrt::dns: static: resolving host 169.254.169.254 | |
2024-11-19T11:57:48.570772Z DEBUG awscrt::dns: static: resolved record: 169.254.169.254 | |
2024-11-19T11:57:48.570776Z DEBUG awscrt::dns: static, resolving host 169.254.169.254 successful, returned 1 addresses | |
2024-11-19T11:57:48.570784Z INFO awscrt::dns: static: promoting spotty record 169.254.169.254 for 169.254.169.254 back to good list | |
2024-11-19T11:57:48.570787Z DEBUG awscrt::dns: static: purging address 169.254.169.254 for host 169.254.169.254 from the cache due to cache eviction or shutdown | |
2024-11-19T11:57:48.570790Z DEBUG awscrt::dns: static, invoking resolution callback for host 169.254.169.254 with 1 addresses | |
2024-11-19T11:57:48.570880Z DEBUG awscrt::socket: id=0x7feed0000f20 fd=16: initializing with domain 0 and type 0 | |
2024-11-19T11:57:48.570905Z DEBUG awscrt::socket: id=0x7feed0000f20 fd=16: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
2024-11-19T11:57:48.570912Z DEBUG awscrt::socket: id=0x7feed0000f20 fd=16: beginning connect. | |
2024-11-19T11:57:48.570916Z DEBUG awscrt::socket: id=0x7feed0000f20 fd=16: connecting to endpoint 169.254.169.254:80. | |
2024-11-19T11:57:48.588928Z DEBUG awscrt::socket: id=0x7feed0000f20 fd=16: connection failure | |
2024-11-19T11:57:48.588967Z DEBUG awscrt::channel-bootstrap: id=0x55b812b23550: client connection on socket 0x7feed0000f20 completed with error 1049. | |
2024-11-19T11:57:48.588972Z DEBUG awscrt::channel-bootstrap: id=0x55b812b23550: recording bad address 169.254.169.254. | |
2024-11-19T11:57:48.588975Z INFO awscrt::dns: id=0x55b812b38280: recording failure for record 169.254.169.254 for 169.254.169.254, moving to bad list | |
2024-11-19T11:57:48.588985Z DEBUG awscrt::dns: static: purging address 169.254.169.254 for host 169.254.169.254 from the cache due to cache eviction or shutdown | |
2024-11-19T11:57:48.588989Z DEBUG awscrt::socket: id=0x7feed0000f20 fd=16: closing | |
2024-11-19T11:57:48.589018Z ERROR awscrt::channel-bootstrap: id=0x55b812b23550: Connection failed with error_code 1049. | |
2024-11-19T11:57:48.589023Z ERROR awscrt::http-connection: static: Client connection failed with error 1049 (AWS_IO_SOCKET_NO_ROUTE_TO_HOST). | |
2024-11-19T11:57:48.589039Z WARN awscrt::connection-manager: id=0x55b812b3c5f0: Failed to obtain new connection from http layer, error 1049(socket connect failure, no route to host.) | |
2024-11-19T11:57:48.589042Z DEBUG awscrt::connection-manager: id=0x55b812b3c5f0: Failing excess connection acquisition with error code 1049 | |
2024-11-19T11:57:48.589047Z DEBUG awscrt::connection-manager: id=0x55b812b3c5f0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=0, ref_count=1 | |
2024-11-19T11:57:48.589061Z WARN awscrt::connection-manager: id=0x55b812b3c5f0: Failed to complete connection acquisition with error_code 1049(socket connect failure, no route to host.) | |
2024-11-19T11:57:48.589064Z WARN awscrt::Unknown: id=0x55b812b43950: IMDS Client failed to acquire a connection, error code 1049(socket connect failure, no route to host.) | |
2024-11-19T11:57:48.589085Z DEBUG awscrt::channel-bootstrap: id=0x55b812b23550: releasing bootstrap reference | |
2024-11-19T11:57:48.589136Z INFO awscrt::connection-manager: id=0x55b812b3c5f0: release | |
2024-11-19T11:57:48.589163Z INFO awscrt::connection-manager: id=0x55b812b3c5f0: ref count now zero, starting shut down process | |
2024-11-19T11:57:48.589167Z INFO awscrt::connection-manager: id=0x55b812b3c5f0: manager release, failing 0 pending acquisitions | |
2024-11-19T11:57:48.589171Z DEBUG awscrt::connection-manager: id=0x55b812b3c5f0: snapshot - state=2, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=0, ref_count=0 | |
2024-11-19T11:57:48.589176Z INFO awscrt::connection-manager: id=0x55b812b3c5f0: Destroying self | |
2024-11-19T11:57:48.589179Z DEBUG awscrt::channel-bootstrap: id=0x55b812b23550: releasing bootstrap reference | |
2024-11-19T11:57:48.589182Z DEBUG awscrt::channel-bootstrap: id=0x55b812b23550: bootstrap destroying | |
2024-11-19T11:57:48.589209Z WARN mountpoint_s3::cli: failed to detect network throughput. Using 10 gbps as throughput. Use --maximum-throughput-gbps CLI flag to configure a target throughput appropriate for the instance. Detection failed due to: failed to get instance type: IMDS query failed: Unknown CRT error | |
2024-11-19T11:57:48.589221Z DEBUG awscrt::dns: static: Either no requests have been made for an address for 169.254.169.254 for the duration of the ttl, or this thread is being forcibly shutdown. Killing thread. | |
2024-11-19T11:57:48.589238Z DEBUG awscrt::dns: static: purging address 169.254.169.254 for host 169.254.169.254 from the cache due to cache eviction or shutdown | |
2024-11-19T11:57:48.589281Z INFO awscrt::event-loop: id=0x55b812b40800: Initializing edge-triggered epoll | |
2024-11-19T11:57:48.589289Z INFO awscrt::event-loop: id=0x55b812b40800: Using eventfd for cross-thread notifications. | |
2024-11-19T11:57:48.589295Z INFO awscrt::event-loop: id=0x55b812b40800: Starting event-loop thread. | |
2024-11-19T11:57:48.589346Z INFO awscrt::event-loop: id=0x55b812b46620: Initializing edge-triggered epoll | |
2024-11-19T11:57:48.589352Z INFO awscrt::event-loop: id=0x55b812b46620: Using eventfd for cross-thread notifications. | |
2024-11-19T11:57:48.589355Z INFO awscrt::event-loop: id=0x55b812b46620: Starting event-loop thread. | |
2024-11-19T11:57:48.589354Z INFO awscrt::event-loop: id=0x55b812b3bb70: Destroying event_loop | |
2024-11-19T11:57:48.589371Z INFO awscrt::event-loop: id=0x55b812b3bb70: Stopping event-loop thread. | |
2024-11-19T11:57:48.589382Z INFO awscrt::event-loop: id=0x55b812b40800: main loop started | |
2024-11-19T11:57:48.589391Z INFO awscrt::event-loop: id=0x55b812b40800: default timeout 100000, and max events to process per tick 100 | |
2024-11-19T11:57:48.589414Z INFO awscrt::event-loop: id=0x55b812b4da70: Initializing edge-triggered epoll | |
2024-11-19T11:57:48.589421Z INFO awscrt::event-loop: id=0x55b812b4da70: Using eventfd for cross-thread notifications. | |
2024-11-19T11:57:48.589418Z DEBUG awscrt::event-loop: id=0x55b812b3bb70: exiting main loop | |
2024-11-19T11:57:48.589434Z INFO awscrt::event-loop: id=0x55b812b4da70: Starting event-loop thread. | |
2024-11-19T11:57:48.589464Z INFO awscrt::event-loop: id=0x55b812b46620: main loop started | |
2024-11-19T11:57:48.589486Z INFO awscrt::event-loop: id=0x55b812b46620: default timeout 100000, and max events to process per tick 100 | |
2024-11-19T11:57:48.589488Z INFO awscrt::event-loop: id=0x55b812b450e0: Destroying event_loop | |
2024-11-19T11:57:48.589492Z INFO awscrt::event-loop: id=0x55b812b450e0: Stopping event-loop thread. | |
2024-11-19T11:57:48.589491Z INFO awscrt::event-loop: id=0x55b812b3bb70: Initializing edge-triggered epoll | |
2024-11-19T11:57:48.589499Z INFO awscrt::event-loop: id=0x55b812b3bb70: Using eventfd for cross-thread notifications. | |
2024-11-19T11:57:48.589503Z INFO awscrt::event-loop: id=0x55b812b3bb70: Starting event-loop thread. | |
2024-11-19T11:57:48.589531Z INFO awscrt::dns: id=0x55b812b4f120: Initializing default host resolver with 8 max host entries. | |
2024-11-19T11:57:48.589536Z INFO awscrt::channel-bootstrap: id=0x55b812b38280: Initializing client bootstrap with event-loop group 0x55b812b3c820 | |
2024-11-19T11:57:48.589534Z DEBUG awscrt::event-loop: id=0x55b812b450e0: exiting main loop | |
2024-11-19T11:57:48.589542Z INFO awscrt::standard-retry-strategy: static: creating new standard retry strategy | |
2024-11-19T11:57:48.589544Z INFO awscrt::event-loop: id=0x55b812b4da70: main loop started | |
2024-11-19T11:57:48.589550Z INFO awscrt::standard-retry-strategy: id=0x55b812b7c580: creating backing exponential backoff strategy with max_retries of 9 | |
2024-11-19T11:57:48.589564Z INFO awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing exponential backoff retry strategy with scale factor: 500 jitter mode: 2 and max retries 9 | |
2024-11-19T11:57:48.589567Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: maximum bucket capacity set to 500 | |
2024-11-19T11:57:48.589568Z INFO awscrt::event-loop: id=0x55b812b4da70: default timeout 100000, and max events to process per tick 100 | |
2024-11-19T11:57:48.589572Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230): TLS context not provided, initializing a new one for credentials provider. | |
2024-11-19T11:57:48.589581Z INFO awscrt::event-loop: id=0x55b812b27100: Destroying event_loop | |
2024-11-19T11:57:48.589584Z INFO awscrt::event-loop: id=0x55b812b27100: Stopping event-loop thread. | |
2024-11-19T11:57:48.589596Z INFO awscrt::event-loop: id=0x55b812b3bb70: main loop started | |
2024-11-19T11:57:48.589603Z DEBUG awscrt::event-loop: id=0x55b812b27100: exiting main loop | |
2024-11-19T11:57:48.589609Z INFO awscrt::event-loop: id=0x55b812b3bb70: default timeout 100000, and max events to process per tick 100 | |
2024-11-19T11:57:48.589634Z INFO awscrt::event-loop: id=0x55b812b32a30: Destroying event_loop | |
2024-11-19T11:57:48.589638Z INFO awscrt::event-loop: id=0x55b812b32a30: Stopping event-loop thread. | |
2024-11-19T11:57:48.589661Z DEBUG awscrt::event-loop: id=0x55b812b32a30: exiting main loop | |
2024-11-19T11:57:48.595282Z DEBUG awscrt::AWSProfile: Creating profile collection from file at "/home/jovyan/.aws/config" | |
2024-11-19T11:57:48.595311Z ERROR awscrt::common-io: static: Failed to open file. path:'/home/jovyan/.aws/config' mode:'rb' errno:2 aws-error:44(AWS_ERROR_FILE_INVALID_PATH) | |
2024-11-19T11:57:48.595315Z DEBUG awscrt::AWSProfile: Failed to read file at "/home/jovyan/.aws/config" | |
2024-11-19T11:57:48.595319Z DEBUG awscrt::AWSProfile: Creating profile collection from file at "/home/jovyan/.aws/credentials" | |
2024-11-19T11:57:48.595326Z ERROR awscrt::common-io: static: Failed to open file. path:'/home/jovyan/.aws/credentials' mode:'rb' errno:2 aws-error:44(AWS_ERROR_FILE_INVALID_PATH) | |
2024-11-19T11:57:48.595329Z DEBUG awscrt::AWSProfile: Failed to read file at "/home/jovyan/.aws/credentials" | |
2024-11-19T11:57:48.595332Z ERROR awscrt::AuthCredentialsProvider: static: Profile credentials parser could not load or parse a credentials or config file. | |
2024-11-19T11:57:48.595346Z DEBUG awscrt::AWSProfile: Creating profile collection from file at "/home/jovyan/.aws/config" | |
2024-11-19T11:57:48.595351Z ERROR awscrt::common-io: static: Failed to open file. path:'/home/jovyan/.aws/config' mode:'rb' errno:2 aws-error:44(AWS_ERROR_FILE_INVALID_PATH) | |
2024-11-19T11:57:48.595353Z DEBUG awscrt::AWSProfile: Failed to read file at "/home/jovyan/.aws/config" | |
2024-11-19T11:57:48.595356Z ERROR awscrt::AuthCredentialsProvider: Failed to build config profile collection from file at (/home/jovyan/.aws/config) : Invalid file path. | |
2024-11-19T11:57:48.595360Z INFO awscrt::AuthCredentialsProvider: ECS provider: Unable to initialize from environment because AWS_CONTAINER_CREDENTIALS_FULL_URI and AWS_CONTAINER_CREDENTIALS_RELATIVE_URI are not set. | |
2024-11-19T11:57:48.595363Z INFO awscrt::AuthCredentialsProvider: default chain: IMDS credentials provider will be used to retrieve credentials | |
2024-11-19T11:57:48.595368Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: acquiring bootstrap reference | |
2024-11-19T11:57:48.595371Z INFO awscrt::connection-manager: id=0x55b812ca2e60: Successfully created | |
2024-11-19T11:57:48.595375Z INFO awscrt::exp-backoff-strategy: id=0x55b812ca30c0: Initializing exponential backoff retry strategy with scale factor: 0 jitter mode: 0 and max retries 1 | |
2024-11-19T11:57:48.596273Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: acquiring bootstrap reference | |
2024-11-19T11:57:48.601491Z INFO awscrt::event-loop: id=0x55b812c6de50: Initializing edge-triggered epoll | |
2024-11-19T11:57:48.601507Z INFO awscrt::event-loop: id=0x55b812c6de50: Using eventfd for cross-thread notifications. | |
2024-11-19T11:57:48.601513Z INFO awscrt::event-loop: id=0x55b812c6de50: Starting event-loop thread. | |
2024-11-19T11:57:48.601569Z INFO awscrt::event-loop: id=0x55b812c6a1d0: Initializing edge-triggered epoll | |
2024-11-19T11:57:48.601574Z INFO awscrt::event-loop: id=0x55b812c6a1d0: Using eventfd for cross-thread notifications. | |
2024-11-19T11:57:48.601578Z INFO awscrt::event-loop: id=0x55b812c6a1d0: Starting event-loop thread. | |
2024-11-19T11:57:48.601592Z INFO awscrt::event-loop: id=0x55b812c6de50: main loop started | |
2024-11-19T11:57:48.601598Z INFO awscrt::event-loop: id=0x55b812c697d0: Initializing edge-triggered epoll | |
2024-11-19T11:57:48.601609Z INFO awscrt::event-loop: id=0x55b812c697d0: Using eventfd for cross-thread notifications. | |
2024-11-19T11:57:48.601612Z INFO awscrt::event-loop: id=0x55b812c6de50: default timeout 100000, and max events to process per tick 100 | |
2024-11-19T11:57:48.601612Z INFO awscrt::event-loop: id=0x55b812c697d0: Starting event-loop thread. | |
2024-11-19T11:57:48.601633Z INFO awscrt::event-loop: id=0x55b812c689d0: Initializing edge-triggered epoll | |
2024-11-19T11:57:48.601629Z INFO awscrt::event-loop: id=0x55b812c6a1d0: main loop started | |
2024-11-19T11:57:48.601640Z INFO awscrt::event-loop: id=0x55b812c689d0: Using eventfd for cross-thread notifications. | |
2024-11-19T11:57:48.601649Z INFO awscrt::event-loop: id=0x55b812c689d0: Starting event-loop thread. | |
2024-11-19T11:57:48.601652Z INFO awscrt::event-loop: id=0x55b812c6a1d0: default timeout 100000, and max events to process per tick 100 | |
2024-11-19T11:57:48.601664Z INFO awscrt::event-loop: id=0x55b812c697d0: main loop started | |
2024-11-19T11:57:48.601689Z INFO awscrt::event-loop: id=0x55b812c697d0: default timeout 100000, and max events to process per tick 100 | |
2024-11-19T11:57:48.601690Z INFO awscrt::event-loop: id=0x55b812c689d0: main loop started | |
2024-11-19T11:57:48.601709Z INFO awscrt::event-loop: id=0x55b812c689d0: default timeout 100000, and max events to process per tick 100 | |
2024-11-19T11:57:48.603215Z INFO awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:48.603233Z DEBUG awscrt::S3MetaRequest: id=0x55b812d87370 Created new Default Meta Request. operation=ListObjectsV2 | |
2024-11-19T11:57:48.603244Z DEBUG awscrt::dns: id=0x55b812b4f120: Host resolution requested for 172.200.202.2 | |
2024-11-19T11:57:48.603248Z DEBUG awscrt::dns: id=0x55b812b4f120: No cached entries found for 172.200.202.2 starting new resolver thread. | |
2024-11-19T11:57:48.603323Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: acquiring bootstrap reference | |
2024-11-19T11:57:48.603328Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Successfully created | |
2024-11-19T11:57:48.603331Z DEBUG awscrt::S3Endpoint: id=0x55b812ca5890: Created connection manager 0x55b812d93fc0 for endpoint | |
2024-11-19T11:57:48.603344Z INFO awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x55b812d87370 | |
2024-11-19T11:57:48.603368Z DEBUG awscrt::dns: static: resolving host 172.200.202.2 | |
2024-11-19T11:57:48.603391Z DEBUG awscrt::dns: static: resolved record: 172.200.202.2 | |
2024-11-19T11:57:48.603395Z DEBUG awscrt::dns: static, resolving host 172.200.202.2 successful, returned 1 addresses | |
2024-11-19T11:57:48.603401Z DEBUG awscrt::dns: static: new address resolved 172.200.202.2 for host 172.200.202.2 caching | |
2024-11-19T11:57:48.603405Z DEBUG awscrt::dns: static, invoking resolution callback for host 172.200.202.2 with 1 addresses | |
2024-11-19T11:57:48.603404Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:48.603422Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:48.603425Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:48.603432Z DEBUG awscrt::S3MetaRequest: id=0x55b812d87370: Meta Request Default created request 0x7feec80020c0 | |
2024-11-19T11:57:48.603445Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:48.603449Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:48.603476Z DEBUG awscrt::S3MetaRequest: id=0x55b812d87370: Meta Request prepared request 0x7feec80020c0 | |
2024-11-19T11:57:48.603553Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:48.603560Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider has expired credentials. Requerying. | |
2024-11-19T11:57:48.603565Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812ca3060) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:48.603571Z INFO awscrt::AuthCredentialsProvider: id=0x55b812b33b70: Loaded credentials from environment variables | |
2024-11-19T11:57:48.603577Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812ca3060) Credentials provider chain callback terminating on index 1, with valid credentials and error code 0 | |
2024-11-19T11:57:48.603582Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider next refresh time set to 160280701911593 | |
2024-11-19T11:57:48.603586Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider succesfully sourced credentials on refresh | |
2024-11-19T11:57:48.603590Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider notifying pending queries of new credentials | |
2024-11-19T11:57:48.603594Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:48.603634Z INFO awscrt::AuthSigning: (id=0x7feed0000bf0) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/ | |
delimiter=&list-type=2&max-keys=0&prefix= | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115748Z | |
x-amz-optional-object-attributes:RestoreStatus | |
accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:48.603648Z INFO awscrt::AuthSigning: (id=0x7feed0000bf0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115748Z | |
20241119/VAST/s3/aws4_request | |
4d8a9e1c716ddca1b06ba3393aee90d6ca9bf284fd5ce011888256703708cba4 | |
2024-11-19T11:57:48.603671Z INFO awscrt::AuthSigning: (id=0x7feed0000bf0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=329bd0116a0bfff69bc42e9be9b50dcf1dce0b506716888bdf5d01f37f158ee4 | |
2024-11-19T11:57:48.603694Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:48.603698Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:48.603700Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:48.603703Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:48.603708Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:48.603711Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket for partition_id 172.200.202.2:80 does not exist, attempting to create one | |
2024-11-19T11:57:48.603715Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 created | |
2024-11-19T11:57:48.603718Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec80026a0 | |
2024-11-19T11:57:48.603731Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:48.603746Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec80026a0 | |
2024-11-19T11:57:48.603753Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8000f20 and nested token 0x7feec80026a0 | |
2024-11-19T11:57:48.603757Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:48.603762Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=0, open_connection_count=0, ref_count=1 | |
2024-11-19T11:57:48.603766Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Requesting 1 new connections from http | |
2024-11-19T11:57:48.603772Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: acquiring bootstrap reference | |
2024-11-19T11:57:48.603775Z DEBUG awscrt::dns: id=0x55b812b4f120: Host resolution requested for 172.200.202.2 | |
2024-11-19T11:57:48.603778Z DEBUG awscrt::dns: id=0x55b812b4f120: cached entries found for 172.200.202.2 returning to caller. | |
2024-11-19T11:57:48.603799Z DEBUG awscrt::socket: id=0x7feeb80019e0 fd=24: initializing with domain 0 and type 0 | |
2024-11-19T11:57:48.603803Z DEBUG awscrt::socket: id=0x7feeb80019e0 fd=24: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
2024-11-19T11:57:48.603808Z DEBUG awscrt::socket: id=0x7feeb80019e0 fd=24: beginning connect. | |
2024-11-19T11:57:48.603812Z DEBUG awscrt::socket: id=0x7feeb80019e0 fd=24: connecting to endpoint 172.200.202.2:80. | |
2024-11-19T11:57:48.604119Z INFO awscrt::socket: id=0x7feeb80019e0 fd=24: connection success | |
2024-11-19T11:57:48.604132Z DEBUG awscrt::socket: id=0x7feeb80019e0 fd=24: assigning to event loop 0x55b812b3bb70 | |
2024-11-19T11:57:48.604139Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: client connection on socket 0x7feeb80019e0 completed with error 0. | |
2024-11-19T11:57:48.604142Z DEBUG awscrt::channel: id=0x7feeb8002040: Beginning creation and setup of new channel. | |
2024-11-19T11:57:48.604145Z DEBUG awscrt::channel: id=0x7feeb8002040: setup complete, notifying caller. | |
2024-11-19T11:57:48.604149Z DEBUG awscrt::channel: id=0x7feeb8002040: no message pool is currently stored in the event-loop local storage, adding 0x7feeb8001c70 with max message size 16384, message count 4, with 4 small blocks of 128 bytes. | |
2024-11-19T11:57:48.604159Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feeb8002040 setup succeeded: bootstrapping. | |
2024-11-19T11:57:48.604163Z DEBUG awscrt::socket-handler: id=0x7feeb8001850: Socket handler created with max_read_size of 16384 | |
2024-11-19T11:57:48.604178Z INFO awscrt::http-connection: id=0x7feeb8012e20: HTTP/1.1 client connection established. | |
2024-11-19T11:57:48.604181Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Received new connection (id=0x7feeb8012e20) from http layer | |
2024-11-19T11:57:48.604184Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feeb8012e20) | |
2024-11-19T11:57:48.604188Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:48.604190Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feeb8012e20 | |
2024-11-19T11:57:48.604200Z DEBUG awscrt::http-stream: id=0x7feeb80133c0: Created client request on connection=0x7feeb8012e20: GET /csnow-bucket/?list-type=2&delimiter=&max-keys=0&prefix= HTTP/1.1 | |
2024-11-19T11:57:48.606244Z DEBUG awscrt::http-stream: id=0x7feeb80133c0: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:48.606261Z DEBUG awscrt::S3MetaRequest: id=0x55b812d87370: Request 0x7feec80020c0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:48.606265Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8000f20: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:48.606285Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feeb8012e20) | |
2024-11-19T11:57:48.606289Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:48.606313Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:48.606327Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:48.606329Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:48.606333Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:48.606337Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:48.606359Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:48.606362Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:48.606372Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:48.606376Z DEBUG awscrt::S3MetaRequest: id=0x55b812d87370 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:48.606411Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:48.606415Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:48.606421Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:48.606421Z DEBUG awscrt::S3MetaRequest: id=0x55b812d87370 Cleaning up meta request | |
2024-11-19T11:57:48.606423Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:48.606428Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:48.606431Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:48.606434Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:49.604211Z DEBUG awscrt::channel: id=0x7feeb8002040: channel throughput - 290000 bytes per second | |
2024-11-19T11:57:49.604276Z DEBUG awscrt::dns: static: resolving host 172.200.202.2 | |
2024-11-19T11:57:49.604286Z DEBUG awscrt::dns: static: resolved record: 172.200.202.2 | |
2024-11-19T11:57:49.604290Z DEBUG awscrt::dns: static, resolving host 172.200.202.2 successful, returned 1 addresses | |
2024-11-19T11:57:50.604313Z DEBUG awscrt::channel: id=0x7feeb8002040: channel throughput - 0 bytes per second | |
2024-11-19T11:57:50.604453Z DEBUG awscrt::dns: static: resolving host 172.200.202.2 | |
2024-11-19T11:57:50.604464Z DEBUG awscrt::dns: static: resolved record: 172.200.202.2 | |
2024-11-19T11:57:50.604467Z DEBUG awscrt::dns: static, resolving host 172.200.202.2 successful, returned 1 addresses | |
2024-11-19T11:57:50.932688Z INFO lookup{req=6 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:50.932725Z DEBUG lookup{req=6 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee84005670 Created new Default Meta Request. operation=HeadObject | |
2024-11-19T11:57:50.932743Z INFO lookup{req=6 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee84005670 | |
2024-11-19T11:57:50.932781Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.932801Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.932805Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.932813Z DEBUG awscrt::S3MetaRequest: id=0x7fee84005670: Meta Request Default created request 0x7feec8004580 | |
2024-11-19T11:57:50.932819Z INFO lookup{req=6 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:50.932826Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.932826Z DEBUG lookup{req=6 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee84007350 Created new Default Meta Request. operation=ListObjectsV2 | |
2024-11-19T11:57:50.932831Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.932832Z INFO lookup{req=6 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee84007350 | |
2024-11-19T11:57:50.932845Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.932850Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.932852Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.932856Z DEBUG awscrt::S3MetaRequest: id=0x7fee84007350: Meta Request Default created request 0x7feec8004850 | |
2024-11-19T11:57:50.932868Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.932871Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.932872Z DEBUG awscrt::S3MetaRequest: id=0x7fee84005670: Meta Request prepared request 0x7feec8004580 | |
2024-11-19T11:57:50.932899Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.932906Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.932909Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.932907Z DEBUG awscrt::S3MetaRequest: id=0x7fee84007350: Meta Request prepared request 0x7feec8004850 | |
2024-11-19T11:57:50.932929Z INFO awscrt::AuthSigning: (id=0x7feed40015c0) Signing successfully built canonical request for algorithm SigV4, with contents | |
HEAD | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115750Z | |
accept;content-length;host;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:50.932934Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.932935Z INFO awscrt::AuthSigning: (id=0x7feed40015c0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
d10536ddadb29294f22e83a0a573153a031b7c93362969d6209022af2cdc3068 | |
2024-11-19T11:57:50.932939Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.932943Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.932951Z INFO awscrt::AuthSigning: (id=0x7feed40015c0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=ccd6dfcc3b1f7fb39c2c984d15a4b56618364b63e0746492bd901cfe5a5aa305 | |
2024-11-19T11:57:50.932966Z INFO awscrt::AuthSigning: (id=0x7feed8000bf0) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/ | |
delimiter=%2F&list-type=2&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115750Z | |
x-amz-optional-object-attributes:RestoreStatus | |
accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:50.932969Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.932978Z INFO awscrt::AuthSigning: (id=0x7feed8000bf0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
7fb02e5672c0513bdfc9260b68f9a2769503e271a05db5776ee155346793234f | |
2024-11-19T11:57:50.933024Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.933029Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.933032Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.933033Z INFO awscrt::AuthSigning: (id=0x7feed8000bf0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=00885bac40094a92db77a1ca54a61e92d0975ee2058ef18fa1b0f2a9bd322a48 | |
2024-11-19T11:57:50.933037Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.933041Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.933045Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8004c20 | |
2024-11-19T11:57:50.933051Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.933056Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8004c20 | |
2024-11-19T11:57:50.933060Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8004bc0 and nested token 0x7feec8004c20 | |
2024-11-19T11:57:50.933063Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.933068Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feeb8012e20) | |
2024-11-19T11:57:50.933072Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.933090Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.933093Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.933096Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.933099Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.933102Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.933104Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.933107Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec80050f0 | |
2024-11-19T11:57:50.933116Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.933120Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feeb8012e20 | |
2024-11-19T11:57:50.933135Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec80050f0 | |
2024-11-19T11:57:50.933147Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8005090 and nested token 0x7feec80050f0 | |
2024-11-19T11:57:50.933152Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.933154Z DEBUG awscrt::http-stream: id=0x7feeb80149f0: Created client request on connection=0x7feeb8012e20: HEAD /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:50.933157Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.933163Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Requesting 1 new connections from http | |
2024-11-19T11:57:50.933170Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: acquiring bootstrap reference | |
2024-11-19T11:57:50.933175Z DEBUG awscrt::dns: id=0x55b812b4f120: Host resolution requested for 172.200.202.2 | |
2024-11-19T11:57:50.933180Z DEBUG awscrt::dns: id=0x55b812b4f120: cached entries found for 172.200.202.2 returning to caller. | |
2024-11-19T11:57:50.933200Z DEBUG awscrt::socket: id=0x7feec40019e0 fd=0: initializing with domain 0 and type 0 | |
2024-11-19T11:57:50.933204Z DEBUG awscrt::socket: id=0x7feec40019e0 fd=0: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
2024-11-19T11:57:50.933209Z DEBUG awscrt::socket: id=0x7feec40019e0 fd=0: beginning connect. | |
2024-11-19T11:57:50.933212Z DEBUG awscrt::socket: id=0x7feec40019e0 fd=0: connecting to endpoint 172.200.202.2:80. | |
2024-11-19T11:57:50.933430Z INFO awscrt::socket: id=0x7feec40019e0 fd=0: connection success | |
2024-11-19T11:57:50.933438Z DEBUG awscrt::socket: id=0x7feec40019e0 fd=0: assigning to event loop 0x55b812b46620 | |
2024-11-19T11:57:50.933444Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: client connection on socket 0x7feec40019e0 completed with error 0. | |
2024-11-19T11:57:50.933447Z DEBUG awscrt::channel: id=0x7feec4002040: Beginning creation and setup of new channel. | |
2024-11-19T11:57:50.933451Z DEBUG awscrt::channel: id=0x7feec4002040: setup complete, notifying caller. | |
2024-11-19T11:57:50.933454Z DEBUG awscrt::channel: id=0x7feec4002040: no message pool is currently stored in the event-loop local storage, adding 0x7feec4001c70 with max message size 16384, message count 4, with 4 small blocks of 128 bytes. | |
2024-11-19T11:57:50.933464Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feec4002040 setup succeeded: bootstrapping. | |
2024-11-19T11:57:50.933467Z DEBUG awscrt::socket-handler: id=0x7feec4001850: Socket handler created with max_read_size of 16384 | |
2024-11-19T11:57:50.933475Z INFO awscrt::http-connection: id=0x7feec4012e20: HTTP/1.1 client connection established. | |
2024-11-19T11:57:50.933478Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Received new connection (id=0x7feec4012e20) from http layer | |
2024-11-19T11:57:50.933481Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec4012e20) | |
2024-11-19T11:57:50.933485Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
2024-11-19T11:57:50.933488Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec4012e20 | |
2024-11-19T11:57:50.933496Z DEBUG awscrt::http-stream: id=0x7feec40133c0: Created client request on connection=0x7feec4012e20: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
2024-11-19T11:57:50.934233Z DEBUG awscrt::http-stream: id=0x7feeb80149f0: Client request complete, response status: 404 (Not Found). | |
2024-11-19T11:57:50.934248Z DEBUG awscrt::S3MetaRequest: id=0x7fee84005670: Request 0x7feec8004580 finished with error code 14343 (aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request) and response status 404 | |
2024-11-19T11:57:50.934256Z ERROR awscrt::S3MetaRequest: id=0x7fee84005670 Meta request cannot recover from error 14343 (Invalid response status from request). (request=0x7feec8004580, response status=404) | |
2024-11-19T11:57:50.934278Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feeb8012e20) | |
2024-11-19T11:57:50.934285Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
2024-11-19T11:57:50.934289Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Releasing connection (id=0x7feeb8012e20) | |
2024-11-19T11:57:50.934294Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.934300Z INFO awscrt::http-connection: id=0x7feeb8012e20: Shutting down connection with error code 0 (AWS_ERROR_SUCCESS). | |
2024-11-19T11:57:50.934307Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.934309Z DEBUG awscrt::channel: id=0x7feeb8002040: Channel shutdown is already pending, not scheduling another. | |
2024-11-19T11:57:50.934310Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.934315Z DEBUG awscrt::channel: id=0x7feeb8002040: beginning shutdown process | |
2024-11-19T11:57:50.934317Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.934320Z DEBUG awscrt::channel: id=0x7feeb8002040: handler 0x7feeb8001850 shutdown in read dir completed. | |
2024-11-19T11:57:50.934322Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.934325Z DEBUG awscrt::channel: id=0x7feeb8002040: handler 0x7feeb8012e28 shutdown in read dir completed. | |
2024-11-19T11:57:50.934328Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.934331Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.934331Z DEBUG awscrt::channel: id=0x7feeb8002040: handler 0x7feeb8012e28 shutdown in write dir completed. | |
2024-11-19T11:57:50.934333Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.934337Z DEBUG awscrt::socket: id=0x7feeb80019e0 fd=24: closing | |
2024-11-19T11:57:50.934341Z DEBUG awscrt::S3MetaRequest: id=0x7fee84005670 Meta request finished with error code 14343 (Invalid response status from request) | |
2024-11-19T11:57:50.934385Z DEBUG awscrt::channel: id=0x7feeb8002040: handler 0x7feeb8001850 shutdown in write dir completed. | |
2024-11-19T11:57:50.934392Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feeb8002040 shutdown with error 0. | |
2024-11-19T11:57:50.934396Z INFO awscrt::http-connection: 0x7feeb8012e20: Client shutdown completed with error 0 (AWS_ERROR_SUCCESS). | |
2024-11-19T11:57:50.934401Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: shutdown received for connection (id=0x7feeb8012e20) | |
2024-11-19T11:57:50.934414Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.934418Z DEBUG awscrt::channel: id=0x7feeb8002040: destroying channel. | |
2024-11-19T11:57:50.934423Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.934425Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: releasing bootstrap reference | |
2024-11-19T11:57:50.934430Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.934431Z DEBUG lookup{req=6 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee84005670 Cleaning up meta request | |
2024-11-19T11:57:50.934435Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.934440Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.934442Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.934445Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.934448Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.935356Z DEBUG awscrt::http-stream: id=0x7feec40133c0: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:50.936907Z DEBUG awscrt::S3MetaRequest: id=0x7fee84007350: Request 0x7feec8004850 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:50.936914Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8005090: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:50.936933Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec4012e20) | |
2024-11-19T11:57:50.936938Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.936954Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.936964Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.936967Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.936971Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.936974Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.936997Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.937000Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.937003Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.937016Z DEBUG awscrt::S3MetaRequest: id=0x7fee84007350 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:50.937045Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.937049Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.937074Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.937077Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.937080Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.937076Z DEBUG lookup{req=6 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee84007350 Cleaning up meta request | |
2024-11-19T11:57:50.937082Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.937095Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.937331Z INFO lookup{req=8 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:50.937342Z DEBUG lookup{req=8 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee880054a0 Created new Default Meta Request. operation=HeadObject | |
2024-11-19T11:57:50.937349Z INFO lookup{req=8 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee880054a0 | |
2024-11-19T11:57:50.937410Z INFO lookup{req=8 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:50.937417Z DEBUG lookup{req=8 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee88007180 Created new Default Meta Request. operation=ListObjectsV2 | |
2024-11-19T11:57:50.937420Z INFO lookup{req=8 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee88007180 | |
2024-11-19T11:57:50.937432Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.937435Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.937438Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.937441Z DEBUG awscrt::S3MetaRequest: id=0x7fee88007180: Meta Request Default created request 0x7feec8002c70 | |
2024-11-19T11:57:50.937453Z DEBUG awscrt::S3MetaRequest: id=0x7fee880054a0: Meta Request Default created request 0x7feec8002db0 | |
2024-11-19T11:57:50.937461Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.937466Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.937476Z DEBUG awscrt::S3MetaRequest: id=0x7fee880054a0: Meta Request prepared request 0x7feec8002db0 | |
2024-11-19T11:57:50.937487Z DEBUG awscrt::S3MetaRequest: id=0x7fee88007180: Meta Request prepared request 0x7feec8002c70 | |
2024-11-19T11:57:50.937495Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.937507Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.937508Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.937510Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.937513Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.937517Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.937526Z INFO awscrt::AuthSigning: (id=0x7feed80013b0) Signing successfully built canonical request for algorithm SigV4, with contents | |
HEAD | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115750Z | |
accept;content-length;host;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:50.937530Z INFO awscrt::AuthSigning: (id=0x7feed80013b0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
d10536ddadb29294f22e83a0a573153a031b7c93362969d6209022af2cdc3068 | |
2024-11-19T11:57:50.937540Z INFO awscrt::AuthSigning: (id=0x7feed80013b0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=ccd6dfcc3b1f7fb39c2c984d15a4b56618364b63e0746492bd901cfe5a5aa305 | |
2024-11-19T11:57:50.937538Z INFO awscrt::AuthSigning: (id=0x7feed0000bf0) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/ | |
delimiter=%2F&list-type=2&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115750Z | |
x-amz-optional-object-attributes:RestoreStatus | |
accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:50.937545Z INFO awscrt::AuthSigning: (id=0x7feed0000bf0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
7fb02e5672c0513bdfc9260b68f9a2769503e271a05db5776ee155346793234f | |
2024-11-19T11:57:50.937556Z INFO awscrt::AuthSigning: (id=0x7feed0000bf0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=00885bac40094a92db77a1ca54a61e92d0975ee2058ef18fa1b0f2a9bd322a48 | |
2024-11-19T11:57:50.937557Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.937561Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.937563Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.937566Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.937570Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.937573Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.937576Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8002fd0 | |
2024-11-19T11:57:50.937590Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.937593Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.937595Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8003160 | |
2024-11-19T11:57:50.937599Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8002fd0 | |
2024-11-19T11:57:50.937604Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8005090 and nested token 0x7feec8002fd0 | |
2024-11-19T11:57:50.937605Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.937607Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.937610Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec4012e20) | |
2024-11-19T11:57:50.937613Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.937616Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec4012e20 | |
2024-11-19T11:57:50.937623Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8003160 | |
2024-11-19T11:57:50.937627Z DEBUG awscrt::http-stream: id=0x7feec4014d00: Created client request on connection=0x7feec4012e20: HEAD /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:50.937636Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec80030d0 and nested token 0x7feec8003160 | |
2024-11-19T11:57:50.937642Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.937648Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.937654Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Requesting 1 new connections from http | |
2024-11-19T11:57:50.937659Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: acquiring bootstrap reference | |
2024-11-19T11:57:50.937662Z DEBUG awscrt::dns: id=0x55b812b4f120: Host resolution requested for 172.200.202.2 | |
2024-11-19T11:57:50.937666Z DEBUG awscrt::dns: id=0x55b812b4f120: cached entries found for 172.200.202.2 returning to caller. | |
2024-11-19T11:57:50.937684Z DEBUG awscrt::socket: id=0x7feec00019e0 fd=1: initializing with domain 0 and type 0 | |
2024-11-19T11:57:50.937688Z DEBUG awscrt::socket: id=0x7feec00019e0 fd=1: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
2024-11-19T11:57:50.937701Z DEBUG awscrt::socket: id=0x7feec00019e0 fd=1: beginning connect. | |
2024-11-19T11:57:50.937705Z DEBUG awscrt::socket: id=0x7feec00019e0 fd=1: connecting to endpoint 172.200.202.2:80. | |
2024-11-19T11:57:50.937899Z INFO awscrt::socket: id=0x7feec00019e0 fd=1: connection success | |
2024-11-19T11:57:50.937918Z DEBUG awscrt::socket: id=0x7feec00019e0 fd=1: assigning to event loop 0x55b812b40800 | |
2024-11-19T11:57:50.937932Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: client connection on socket 0x7feec00019e0 completed with error 0. | |
2024-11-19T11:57:50.937937Z DEBUG awscrt::channel: id=0x7feec0002040: Beginning creation and setup of new channel. | |
2024-11-19T11:57:50.937947Z DEBUG awscrt::channel: id=0x7feec0002040: setup complete, notifying caller. | |
2024-11-19T11:57:50.937951Z DEBUG awscrt::channel: id=0x7feec0002040: no message pool is currently stored in the event-loop local storage, adding 0x7feec0001c70 with max message size 16384, message count 4, with 4 small blocks of 128 bytes. | |
2024-11-19T11:57:50.937963Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feec0002040 setup succeeded: bootstrapping. | |
2024-11-19T11:57:50.937966Z DEBUG awscrt::socket-handler: id=0x7feec0001850: Socket handler created with max_read_size of 16384 | |
2024-11-19T11:57:50.937974Z INFO awscrt::http-connection: id=0x7feec0012e20: HTTP/1.1 client connection established. | |
2024-11-19T11:57:50.937977Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Received new connection (id=0x7feec0012e20) from http layer | |
2024-11-19T11:57:50.937980Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec0012e20) | |
2024-11-19T11:57:50.937983Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
2024-11-19T11:57:50.937986Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec0012e20 | |
2024-11-19T11:57:50.938006Z DEBUG awscrt::http-stream: id=0x7feec00133c0: Created client request on connection=0x7feec0012e20: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
2024-11-19T11:57:50.939153Z DEBUG awscrt::http-stream: id=0x7feec4014d00: Client request complete, response status: 404 (Not Found). | |
2024-11-19T11:57:50.939166Z DEBUG awscrt::S3MetaRequest: id=0x7fee880054a0: Request 0x7feec8002db0 finished with error code 14343 (aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request) and response status 404 | |
2024-11-19T11:57:50.939169Z ERROR awscrt::S3MetaRequest: id=0x7fee880054a0 Meta request cannot recover from error 14343 (Invalid response status from request). (request=0x7feec8002db0, response status=404) | |
2024-11-19T11:57:50.939188Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec4012e20) | |
2024-11-19T11:57:50.939192Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
2024-11-19T11:57:50.939194Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Releasing connection (id=0x7feec4012e20) | |
2024-11-19T11:57:50.939200Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.939202Z INFO awscrt::http-connection: id=0x7feec4012e20: Shutting down connection with error code 0 (AWS_ERROR_SUCCESS). | |
2024-11-19T11:57:50.939207Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.939208Z DEBUG awscrt::channel: id=0x7feec4002040: Channel shutdown is already pending, not scheduling another. | |
2024-11-19T11:57:50.939210Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.939212Z DEBUG awscrt::channel: id=0x7feec4002040: beginning shutdown process | |
2024-11-19T11:57:50.939214Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.939216Z DEBUG awscrt::channel: id=0x7feec4002040: handler 0x7feec4001850 shutdown in read dir completed. | |
2024-11-19T11:57:50.939219Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.939219Z DEBUG awscrt::channel: id=0x7feec4002040: handler 0x7feec4012e28 shutdown in read dir completed. | |
2024-11-19T11:57:50.939229Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.939230Z DEBUG awscrt::channel: id=0x7feec4002040: handler 0x7feec4012e28 shutdown in write dir completed. | |
2024-11-19T11:57:50.939232Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.939234Z DEBUG awscrt::socket: id=0x7feec40019e0 fd=0: closing | |
2024-11-19T11:57:50.939235Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.939241Z DEBUG awscrt::S3MetaRequest: id=0x7fee880054a0 Meta request finished with error code 14343 (Invalid response status from request) | |
2024-11-19T11:57:50.939258Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.939261Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.939271Z DEBUG lookup{req=8 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee880054a0 Cleaning up meta request | |
2024-11-19T11:57:50.939282Z DEBUG awscrt::channel: id=0x7feec4002040: handler 0x7feec4001850 shutdown in write dir completed. | |
2024-11-19T11:57:50.939283Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.939287Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feec4002040 shutdown with error 0. | |
2024-11-19T11:57:50.939288Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.939291Z INFO awscrt::http-connection: 0x7feec4012e20: Client shutdown completed with error 0 (AWS_ERROR_SUCCESS). | |
2024-11-19T11:57:50.939292Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.939294Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: shutdown received for connection (id=0x7feec4012e20) | |
2024-11-19T11:57:50.939295Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.939298Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.939299Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.939301Z DEBUG awscrt::channel: id=0x7feec4002040: destroying channel. | |
2024-11-19T11:57:50.939306Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: releasing bootstrap reference | |
2024-11-19T11:57:50.939424Z DEBUG awscrt::http-stream: id=0x7feec00133c0: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:50.939440Z DEBUG awscrt::S3MetaRequest: id=0x7fee88007180: Request 0x7feec8002c70 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:50.939444Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec80030d0: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:50.939460Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec0012e20) | |
2024-11-19T11:57:50.939461Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.939470Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.939470Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.939475Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.939478Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.939481Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.939485Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.939488Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.939490Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.939492Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.939495Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.939514Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.939517Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.939519Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.939522Z DEBUG awscrt::S3MetaRequest: id=0x7fee88007180 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:50.939531Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.939534Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.939541Z DEBUG lookup{req=8 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee88007180 Cleaning up meta request | |
2024-11-19T11:57:50.939616Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.939620Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.939622Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.939625Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.939628Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.939774Z INFO mknod{req=12 parent=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:50.939783Z DEBUG mknod{req=12 parent=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8800a2c0 Created new Default Meta Request. operation=HeadObject | |
2024-11-19T11:57:50.939795Z INFO mknod{req=12 parent=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee8800a2c0 | |
2024-11-19T11:57:50.939861Z INFO mknod{req=12 parent=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:50.939871Z DEBUG mknod{req=12 parent=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8800af40 Created new Default Meta Request. operation=ListObjectsV2 | |
2024-11-19T11:57:50.939875Z INFO mknod{req=12 parent=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee8800af40 | |
2024-11-19T11:57:50.939887Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.939890Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.939892Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.939896Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800af40: Meta Request Default created request 0x7feec80032c0 | |
2024-11-19T11:57:50.939908Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800a2c0: Meta Request Default created request 0x7feec8003400 | |
2024-11-19T11:57:50.939917Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.939920Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.939935Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800a2c0: Meta Request prepared request 0x7feec8003400 | |
2024-11-19T11:57:50.939937Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800af40: Meta Request prepared request 0x7feec80032c0 | |
2024-11-19T11:57:50.939946Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.939951Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.939954Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.939961Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.939965Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.939967Z INFO awscrt::AuthSigning: (id=0x7feed4001400) Signing successfully built canonical request for algorithm SigV4, with contents | |
HEAD | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115750Z | |
accept;content-length;host;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:50.939968Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.939971Z INFO awscrt::AuthSigning: (id=0x7feed4001400) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
d10536ddadb29294f22e83a0a573153a031b7c93362969d6209022af2cdc3068 | |
2024-11-19T11:57:50.939982Z INFO awscrt::AuthSigning: (id=0x7feed4001400) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=ccd6dfcc3b1f7fb39c2c984d15a4b56618364b63e0746492bd901cfe5a5aa305 | |
2024-11-19T11:57:50.939989Z INFO awscrt::AuthSigning: (id=0x7feecc0016f0) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/ | |
delimiter=%2F&list-type=2&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115750Z | |
x-amz-optional-object-attributes:RestoreStatus | |
accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:50.939997Z INFO awscrt::AuthSigning: (id=0x7feecc0016f0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
7fb02e5672c0513bdfc9260b68f9a2769503e271a05db5776ee155346793234f | |
2024-11-19T11:57:50.940006Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.940008Z INFO awscrt::AuthSigning: (id=0x7feecc0016f0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=00885bac40094a92db77a1ca54a61e92d0975ee2058ef18fa1b0f2a9bd322a48 | |
2024-11-19T11:57:50.940009Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.940012Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.940016Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.940019Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.940022Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.940025Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8003620 | |
2024-11-19T11:57:50.940035Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.940039Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.940042Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.940043Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8003620 | |
2024-11-19T11:57:50.940044Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.940048Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec80030d0 and nested token 0x7feec8003620 | |
2024-11-19T11:57:50.940049Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.940052Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.940053Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.940055Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec0012e20) | |
2024-11-19T11:57:50.940056Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.940059Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.940060Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8003720 | |
2024-11-19T11:57:50.940067Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec0012e20 | |
2024-11-19T11:57:50.940070Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.940076Z DEBUG awscrt::http-stream: id=0x7feec0014d00: Created client request on connection=0x7feec0012e20: HEAD /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:50.940103Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8003720 | |
2024-11-19T11:57:50.940106Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8005090 and nested token 0x7feec8003720 | |
2024-11-19T11:57:50.940109Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.940112Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.940115Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Requesting 1 new connections from http | |
2024-11-19T11:57:50.940120Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: acquiring bootstrap reference | |
2024-11-19T11:57:50.940123Z DEBUG awscrt::dns: id=0x55b812b4f120: Host resolution requested for 172.200.202.2 | |
2024-11-19T11:57:50.940132Z DEBUG awscrt::dns: id=0x55b812b4f120: cached entries found for 172.200.202.2 returning to caller. | |
2024-11-19T11:57:50.940159Z DEBUG awscrt::socket: id=0x7feec40019e0 fd=0: initializing with domain 0 and type 0 | |
2024-11-19T11:57:50.940164Z DEBUG awscrt::socket: id=0x7feec40019e0 fd=0: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
2024-11-19T11:57:50.940168Z DEBUG awscrt::socket: id=0x7feec40019e0 fd=0: beginning connect. | |
2024-11-19T11:57:50.940171Z DEBUG awscrt::socket: id=0x7feec40019e0 fd=0: connecting to endpoint 172.200.202.2:80. | |
2024-11-19T11:57:50.940404Z INFO awscrt::socket: id=0x7feec40019e0 fd=0: connection success | |
2024-11-19T11:57:50.940412Z DEBUG awscrt::socket: id=0x7feec40019e0 fd=0: assigning to event loop 0x55b812b46620 | |
2024-11-19T11:57:50.940415Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: client connection on socket 0x7feec40019e0 completed with error 0. | |
2024-11-19T11:57:50.940423Z DEBUG awscrt::channel: id=0x7feec4015ed0: Beginning creation and setup of new channel. | |
2024-11-19T11:57:50.940426Z DEBUG awscrt::channel: id=0x7feec4015ed0: setup complete, notifying caller. | |
2024-11-19T11:57:50.940429Z DEBUG awscrt::channel: id=0x7feec4015ed0: message pool 0x7feec4001c70 found in event-loop local storage: using it. | |
2024-11-19T11:57:50.940432Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feec4015ed0 setup succeeded: bootstrapping. | |
2024-11-19T11:57:50.940435Z DEBUG awscrt::socket-handler: id=0x7feec00156d0: Socket handler created with max_read_size of 16384 | |
2024-11-19T11:57:50.940441Z INFO awscrt::http-connection: id=0x7feec40162c0: HTTP/1.1 client connection established. | |
2024-11-19T11:57:50.940443Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Received new connection (id=0x7feec40162c0) from http layer | |
2024-11-19T11:57:50.940446Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec40162c0) | |
2024-11-19T11:57:50.940454Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
2024-11-19T11:57:50.940457Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec40162c0 | |
2024-11-19T11:57:50.940465Z DEBUG awscrt::http-stream: id=0x7feec4016760: Created client request on connection=0x7feec40162c0: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
2024-11-19T11:57:50.941042Z DEBUG awscrt::http-stream: id=0x7feec0014d00: Client request complete, response status: 404 (Not Found). | |
2024-11-19T11:57:50.941047Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800a2c0: Request 0x7feec8003400 finished with error code 14343 (aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request) and response status 404 | |
2024-11-19T11:57:50.941051Z ERROR awscrt::S3MetaRequest: id=0x7fee8800a2c0 Meta request cannot recover from error 14343 (Invalid response status from request). (request=0x7feec8003400, response status=404) | |
2024-11-19T11:57:50.941066Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec0012e20) | |
2024-11-19T11:57:50.941069Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
2024-11-19T11:57:50.941069Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.941072Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Releasing connection (id=0x7feec0012e20) | |
2024-11-19T11:57:50.941074Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.941077Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.941080Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.941083Z INFO awscrt::http-connection: id=0x7feec0012e20: Shutting down connection with error code 0 (AWS_ERROR_SUCCESS). | |
2024-11-19T11:57:50.941084Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.941086Z DEBUG awscrt::channel: id=0x7feec0002040: Channel shutdown is already pending, not scheduling another. | |
2024-11-19T11:57:50.941089Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.941089Z DEBUG awscrt::channel: id=0x7feec0002040: beginning shutdown process | |
2024-11-19T11:57:50.941093Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.941094Z DEBUG awscrt::channel: id=0x7feec0002040: handler 0x7feec0001850 shutdown in read dir completed. | |
2024-11-19T11:57:50.941096Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.941098Z DEBUG awscrt::channel: id=0x7feec0002040: handler 0x7feec0012e28 shutdown in read dir completed. | |
2024-11-19T11:57:50.941101Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800a2c0 Meta request finished with error code 14343 (Invalid response status from request) | |
2024-11-19T11:57:50.941101Z DEBUG awscrt::channel: id=0x7feec0002040: handler 0x7feec0012e28 shutdown in write dir completed. | |
2024-11-19T11:57:50.941106Z DEBUG awscrt::socket: id=0x7feec00019e0 fd=1: closing | |
2024-11-19T11:57:50.941115Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.941137Z DEBUG awscrt::channel: id=0x7feec0002040: handler 0x7feec0001850 shutdown in write dir completed. | |
2024-11-19T11:57:50.941139Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.941142Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feec0002040 shutdown with error 0. | |
2024-11-19T11:57:50.941145Z INFO awscrt::http-connection: 0x7feec0012e20: Client shutdown completed with error 0 (AWS_ERROR_SUCCESS). | |
2024-11-19T11:57:50.941148Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: shutdown received for connection (id=0x7feec0012e20) | |
2024-11-19T11:57:50.941149Z DEBUG mknod{req=12 parent=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8800a2c0 Cleaning up meta request | |
2024-11-19T11:57:50.941151Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.941155Z DEBUG awscrt::channel: id=0x7feec0002040: destroying channel. | |
2024-11-19T11:57:50.941159Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: releasing bootstrap reference | |
2024-11-19T11:57:50.941160Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.941163Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.941165Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.941168Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.941171Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.941344Z DEBUG awscrt::http-stream: id=0x7feec4016760: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:50.941356Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800af40: Request 0x7feec80032c0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:50.941360Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8005090: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:50.941378Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec40162c0) | |
2024-11-19T11:57:50.941381Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.941382Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.941388Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.941391Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.941394Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.941397Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.941423Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.941426Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.941428Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.941432Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800af40 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:50.941443Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.941446Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.941454Z DEBUG mknod{req=12 parent=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8800af40 Cleaning up meta request | |
2024-11-19T11:57:50.941531Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.941534Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.941537Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.941539Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.941543Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.941664Z INFO open{req=14 ino=2 pid=404662 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:50.941679Z DEBUG open{req=14 ino=2 pid=404662 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8400c830 Created new Default Meta Request. operation=HeadObject | |
2024-11-19T11:57:50.941689Z INFO open{req=14 ino=2 pid=404662 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee8400c830 | |
2024-11-19T11:57:50.941695Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.941699Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.941702Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.941705Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400c830: Meta Request Default created request 0x7feec8003820 | |
2024-11-19T11:57:50.941715Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.941718Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.941727Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400c830: Meta Request prepared request 0x7feec8003820 | |
2024-11-19T11:57:50.941738Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.941742Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.941745Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.941754Z INFO open{req=14 ino=2 pid=404662 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:50.941762Z INFO awscrt::AuthSigning: (id=0x7feed00015c0) Signing successfully built canonical request for algorithm SigV4, with contents | |
HEAD | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115750Z | |
accept;content-length;host;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:50.941762Z DEBUG open{req=14 ino=2 pid=404662 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8400d450 Created new Default Meta Request. operation=ListObjectsV2 | |
2024-11-19T11:57:50.941766Z INFO awscrt::AuthSigning: (id=0x7feed00015c0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
d10536ddadb29294f22e83a0a573153a031b7c93362969d6209022af2cdc3068 | |
2024-11-19T11:57:50.941782Z INFO open{req=14 ino=2 pid=404662 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee8400d450 | |
2024-11-19T11:57:50.941786Z INFO awscrt::AuthSigning: (id=0x7feed00015c0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=ccd6dfcc3b1f7fb39c2c984d15a4b56618364b63e0746492bd901cfe5a5aa305 | |
2024-11-19T11:57:50.941787Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.941792Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.941794Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.941798Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400d450: Meta Request Default created request 0x7feec80039d0 | |
2024-11-19T11:57:50.941806Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.941810Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.941814Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.941816Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.941819Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.941821Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.941825Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.941828Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.941831Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8003b10 | |
2024-11-19T11:57:50.941833Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400d450: Meta Request prepared request 0x7feec80039d0 | |
2024-11-19T11:57:50.941843Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.941848Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8003b10 | |
2024-11-19T11:57:50.941855Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8005090 and nested token 0x7feec8003b10 | |
2024-11-19T11:57:50.941858Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.941859Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.941861Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec40162c0) | |
2024-11-19T11:57:50.941864Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.941865Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.941867Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.941882Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec40162c0 | |
2024-11-19T11:57:50.941885Z INFO awscrt::AuthSigning: (id=0x7feed8000bf0) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/ | |
delimiter=%2F&list-type=2&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115750Z | |
x-amz-optional-object-attributes:RestoreStatus | |
accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:50.941889Z INFO awscrt::AuthSigning: (id=0x7feed8000bf0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
7fb02e5672c0513bdfc9260b68f9a2769503e271a05db5776ee155346793234f | |
2024-11-19T11:57:50.941891Z DEBUG awscrt::http-stream: id=0x7feec4017400: Created client request on connection=0x7feec40162c0: HEAD /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:50.941899Z INFO awscrt::AuthSigning: (id=0x7feed8000bf0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=00885bac40094a92db77a1ca54a61e92d0975ee2058ef18fa1b0f2a9bd322a48 | |
2024-11-19T11:57:50.941917Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.941923Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.941926Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.941931Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.941936Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.941940Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.941943Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8003c40 | |
2024-11-19T11:57:50.941950Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.941961Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8003c40 | |
2024-11-19T11:57:50.941965Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec80030d0 and nested token 0x7feec8003c40 | |
2024-11-19T11:57:50.941970Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.941976Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.941979Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Requesting 1 new connections from http | |
2024-11-19T11:57:50.941985Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: acquiring bootstrap reference | |
2024-11-19T11:57:50.941988Z DEBUG awscrt::dns: id=0x55b812b4f120: Host resolution requested for 172.200.202.2 | |
2024-11-19T11:57:50.941991Z DEBUG awscrt::dns: id=0x55b812b4f120: cached entries found for 172.200.202.2 returning to caller. | |
2024-11-19T11:57:50.942016Z DEBUG awscrt::socket: id=0x7feec4017760 fd=1: initializing with domain 0 and type 0 | |
2024-11-19T11:57:50.942022Z DEBUG awscrt::socket: id=0x7feec4017760 fd=1: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
2024-11-19T11:57:50.942026Z DEBUG awscrt::socket: id=0x7feec4017760 fd=1: beginning connect. | |
2024-11-19T11:57:50.942029Z DEBUG awscrt::socket: id=0x7feec4017760 fd=1: connecting to endpoint 172.200.202.2:80. | |
2024-11-19T11:57:50.942144Z INFO awscrt::socket: id=0x7feec4017760 fd=1: connection success | |
2024-11-19T11:57:50.942150Z DEBUG awscrt::socket: id=0x7feec4017760 fd=1: assigning to event loop 0x55b812b46620 | |
2024-11-19T11:57:50.942154Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: client connection on socket 0x7feec4017760 completed with error 0. | |
2024-11-19T11:57:50.942157Z DEBUG awscrt::channel: id=0x7feec4017ab0: Beginning creation and setup of new channel. | |
2024-11-19T11:57:50.942160Z DEBUG awscrt::channel: id=0x7feec4017ab0: setup complete, notifying caller. | |
2024-11-19T11:57:50.942162Z DEBUG awscrt::channel: id=0x7feec4017ab0: message pool 0x7feec4001c70 found in event-loop local storage: using it. | |
2024-11-19T11:57:50.942165Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feec4017ab0 setup succeeded: bootstrapping. | |
2024-11-19T11:57:50.942168Z DEBUG awscrt::socket-handler: id=0x7feec8004170: Socket handler created with max_read_size of 16384 | |
2024-11-19T11:57:50.942177Z INFO awscrt::http-connection: id=0x7feec4017f50: HTTP/1.1 client connection established. | |
2024-11-19T11:57:50.942180Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Received new connection (id=0x7feec4017f50) from http layer | |
2024-11-19T11:57:50.942183Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec4017f50) | |
2024-11-19T11:57:50.942186Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
2024-11-19T11:57:50.942189Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec4017f50 | |
2024-11-19T11:57:50.942195Z DEBUG awscrt::http-stream: id=0x7feec4018300: Created client request on connection=0x7feec4017f50: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
2024-11-19T11:57:50.943292Z DEBUG awscrt::http-stream: id=0x7feec4018300: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:50.943307Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400d450: Request 0x7feec80039d0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:50.943316Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec80030d0: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:50.943336Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec4017f50) | |
2024-11-19T11:57:50.943338Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.943340Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=2, ref_count=1 | |
2024-11-19T11:57:50.943343Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.943346Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.943350Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.943353Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.943358Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.943361Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.943363Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.943366Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.943369Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.943373Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.943383Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.943385Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.943389Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400d450 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:50.943418Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.943422Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.943444Z DEBUG awscrt::http-stream: id=0x7feec4017400: Client request complete, response status: 404 (Not Found). | |
2024-11-19T11:57:50.943445Z DEBUG open{req=14 ino=2 pid=404662 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8400d450 Cleaning up meta request | |
2024-11-19T11:57:50.943448Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.943448Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400c830: Request 0x7feec8003820 finished with error code 14343 (aws-c-s3: AWS_ERROR_S3_INVALID_RESPONSE_STATUS, Invalid response status from request) and response status 404 | |
2024-11-19T11:57:50.943456Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.943458Z ERROR awscrt::S3MetaRequest: id=0x7fee8400c830 Meta request cannot recover from error 14343 (Invalid response status from request). (request=0x7feec8003820, response status=404) | |
2024-11-19T11:57:50.943464Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.943478Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec40162c0) | |
2024-11-19T11:57:50.943482Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=2, ref_count=1 | |
2024-11-19T11:57:50.943484Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.943485Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Releasing connection (id=0x7feec40162c0) | |
2024-11-19T11:57:50.943488Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.943493Z INFO awscrt::http-connection: id=0x7feec40162c0: Shutting down connection with error code 0 (AWS_ERROR_SUCCESS). | |
2024-11-19T11:57:50.943493Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.943496Z DEBUG awscrt::channel: id=0x7feec4015ed0: Channel shutdown is already pending, not scheduling another. | |
2024-11-19T11:57:50.943497Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.943499Z DEBUG awscrt::channel: id=0x7feec4015ed0: beginning shutdown process | |
2024-11-19T11:57:50.943500Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.943503Z DEBUG awscrt::channel: id=0x7feec4015ed0: handler 0x7feec00156d0 shutdown in read dir completed. | |
2024-11-19T11:57:50.943506Z DEBUG awscrt::channel: id=0x7feec4015ed0: handler 0x7feec40162c8 shutdown in read dir completed. | |
2024-11-19T11:57:50.943506Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400c830 Meta request finished with error code 14343 (Invalid response status from request) | |
2024-11-19T11:57:50.943510Z DEBUG awscrt::channel: id=0x7feec4015ed0: handler 0x7feec40162c8 shutdown in write dir completed. | |
2024-11-19T11:57:50.943513Z DEBUG awscrt::socket: id=0x7feec40019e0 fd=0: closing | |
2024-11-19T11:57:50.943523Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.943527Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.943529Z DEBUG open{req=14 ino=2 pid=404662 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8400c830 Cleaning up meta request | |
2024-11-19T11:57:50.943531Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.943535Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.943537Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.943540Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.943543Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.943551Z DEBUG awscrt::channel: id=0x7feec4015ed0: handler 0x7feec00156d0 shutdown in write dir completed. | |
2024-11-19T11:57:50.943556Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feec4015ed0 shutdown with error 0. | |
2024-11-19T11:57:50.943559Z INFO awscrt::http-connection: 0x7feec40162c0: Client shutdown completed with error 0 (AWS_ERROR_SUCCESS). | |
2024-11-19T11:57:50.943562Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: shutdown received for connection (id=0x7feec40162c0) | |
2024-11-19T11:57:50.943565Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.943568Z DEBUG awscrt::channel: id=0x7feec4015ed0: destroying channel. | |
2024-11-19T11:57:50.943572Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: releasing bootstrap reference | |
2024-11-19T11:57:50.943633Z INFO open{req=14 ino=2 pid=404662 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:50.943643Z DEBUG open{req=14 ino=2 pid=404662 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8400dc80 Created new Auto-Ranged Put Meta Request. | |
2024-11-19T11:57:50.943653Z INFO open{req=14 ino=2 pid=404662 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee8400dc80 | |
2024-11-19T11:57:50.943658Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.943661Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.943664Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.943672Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.943676Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.943696Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Prepared request 0x7feec800ab70 for part 0 | |
2024-11-19T11:57:50.943708Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.943711Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.943714Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.943729Z INFO awscrt::AuthSigning: (id=0x7feecc000f20) Signing successfully built canonical request for algorithm SigV4, with contents | |
POST | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
uploads= | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-checksum-algorithm:CRC32C | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115750Z | |
accept;content-length;host;x-amz-checksum-algorithm;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:50.943732Z INFO awscrt::AuthSigning: (id=0x7feecc000f20) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
28c63a72f4f09abcb726d48e9291d0c68d3eb3de691f0d8b82d45b3f25afe663 | |
2024-11-19T11:57:50.943742Z INFO awscrt::AuthSigning: (id=0x7feecc000f20) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-checksum-algorithm;x-amz-content-sha256;x-amz-date, Signature=b8eb0e4a4f3483c06cbe012b5e01554af5968ab3d003490c4287d79faa1caece | |
2024-11-19T11:57:50.943763Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.943767Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.943770Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.943772Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.943776Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.943779Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.943782Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec800acb0 | |
2024-11-19T11:57:50.943794Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.943816Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec800acb0 | |
2024-11-19T11:57:50.943832Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8003260 and nested token 0x7feec800acb0 | |
2024-11-19T11:57:50.943836Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.943840Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec4017f50) | |
2024-11-19T11:57:50.943844Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.943849Z WARN getxattr{req=16 ino=2 name="security.capability"}: mountpoint_s3::fuse: getxattr failed: operation not supported by Mountpoint | |
2024-11-19T11:57:50.943864Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec4017f50 | |
2024-11-19T11:57:50.943874Z DEBUG awscrt::http-stream: id=0x7feec4019870: Created client request on connection=0x7feec4017f50: POST /csnow-bucket/yellow_tripdata_2024-01.parquet?uploads HTTP/1.1 | |
2024-11-19T11:57:50.948690Z DEBUG awscrt::http-stream: id=0x7feec4019870: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:50.948708Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Request 0x7feec800ab70 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:50.948713Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8003260: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:50.948739Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec4017f50) | |
2024-11-19T11:57:50.948744Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.948760Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.948772Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.948775Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.948791Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.948795Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.948800Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.948803Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.948805Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.948899Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.948905Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.959966Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.959980Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.959983Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.959990Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Returning request 0x7feec800acb0 for part 1 | |
2024-11-19T11:57:50.960002Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.960006Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.960029Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.960032Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.960030Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80 UploadPart for Multi-part Upload, with ID:14108766089287131162 | |
2024-11-19T11:57:50.960035Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.960045Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.960048Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.960056Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Prepared request 0x7feec800acb0 for part 1 | |
2024-11-19T11:57:50.960069Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.960072Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.960075Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.960102Z INFO awscrt::AuthSigning: (id=0x7feecc001060) Signing successfully built canonical request for algorithm SigV4, with contents | |
PUT | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
partNumber=1&uploadId=14108766089287131162 | |
accept:application/xml | |
content-encoding:aws-chunked | |
content-length:8388655 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
x-amz-date:20241119T115750Z | |
x-amz-decoded-content-length:8388608 | |
x-amz-trailer:x-amz-checksum-crc32c | |
accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer | |
STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
2024-11-19T11:57:50.960113Z INFO awscrt::AuthSigning: (id=0x7feecc001060) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
39e5831670bd3f60648b405d49084dbe37dd350229d41bf6f5c837e4ca532db2 | |
2024-11-19T11:57:50.960126Z INFO awscrt::AuthSigning: (id=0x7feecc001060) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer, Signature=ba525d88820ade425bf6bbe3346dbce3941535c3e28dfcfade05e8a97707c8ad | |
2024-11-19T11:57:50.960143Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.960147Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.960149Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.960152Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.960157Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.960161Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.960164Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec800adf0 | |
2024-11-19T11:57:50.960181Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.960200Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec800adf0 | |
2024-11-19T11:57:50.960215Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8003260 and nested token 0x7feec800adf0 | |
2024-11-19T11:57:50.960220Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.960224Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec4017f50) | |
2024-11-19T11:57:50.960228Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.960264Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec4017f50 | |
2024-11-19T11:57:50.960287Z DEBUG awscrt::http-stream: id=0x7feec401a450: Created client request on connection=0x7feec4017f50: PUT /csnow-bucket/yellow_tripdata_2024-01.parquet?partNumber=1&uploadId=14108766089287131162 HTTP/1.1 | |
2024-11-19T11:57:50.970996Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.971009Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.971012Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.971018Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Returning request 0x7feec800aef0 for part 2 | |
2024-11-19T11:57:50.971034Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.971038Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.971067Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.971070Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.971068Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80 UploadPart for Multi-part Upload, with ID:14108766089287131162 | |
2024-11-19T11:57:50.971072Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.971083Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.971087Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.971094Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Prepared request 0x7feec800aef0 for part 2 | |
2024-11-19T11:57:50.971109Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.971114Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.971117Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.971140Z INFO awscrt::AuthSigning: (id=0x7feecc0015e0) Signing successfully built canonical request for algorithm SigV4, with contents | |
PUT | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
partNumber=2&uploadId=14108766089287131162 | |
accept:application/xml | |
content-encoding:aws-chunked | |
content-length:8388655 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
x-amz-date:20241119T115750Z | |
x-amz-decoded-content-length:8388608 | |
x-amz-trailer:x-amz-checksum-crc32c | |
accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer | |
STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
2024-11-19T11:57:50.971143Z INFO awscrt::AuthSigning: (id=0x7feecc0015e0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
6a2ae4444ba089cd97b20b6de1c3b984873d2c6b932782e9d2882d9937ee509d | |
2024-11-19T11:57:50.971155Z INFO awscrt::AuthSigning: (id=0x7feecc0015e0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer, Signature=3b5764dbbedeee6510b7aa83573d5a4ef61839dd7cf3977203a8646ac2aa26a9 | |
2024-11-19T11:57:50.971169Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.971173Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.971175Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.971178Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.971183Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.971190Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.971193Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec800b030 | |
2024-11-19T11:57:50.971206Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.971222Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec800b030 | |
2024-11-19T11:57:50.971234Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8005090 and nested token 0x7feec800b030 | |
2024-11-19T11:57:50.971238Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.971244Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=1, open_connection_count=1, ref_count=1 | |
2024-11-19T11:57:50.971247Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Requesting 1 new connections from http | |
2024-11-19T11:57:50.971255Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: acquiring bootstrap reference | |
2024-11-19T11:57:50.971258Z DEBUG awscrt::dns: id=0x55b812b4f120: Host resolution requested for 172.200.202.2 | |
2024-11-19T11:57:50.971263Z DEBUG awscrt::dns: id=0x55b812b4f120: cached entries found for 172.200.202.2 returning to caller. | |
2024-11-19T11:57:50.971299Z DEBUG awscrt::socket: id=0x7feec800b130 fd=0: initializing with domain 0 and type 0 | |
2024-11-19T11:57:50.971305Z DEBUG awscrt::socket: id=0x7feec800b130 fd=0: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
2024-11-19T11:57:50.971310Z DEBUG awscrt::socket: id=0x7feec800b130 fd=0: beginning connect. | |
2024-11-19T11:57:50.971314Z DEBUG awscrt::socket: id=0x7feec800b130 fd=0: connecting to endpoint 172.200.202.2:80. | |
2024-11-19T11:57:50.971587Z INFO awscrt::socket: id=0x7feec800b130 fd=0: connection success | |
2024-11-19T11:57:50.971597Z DEBUG awscrt::socket: id=0x7feec800b130 fd=0: assigning to event loop 0x55b812b4da70 | |
2024-11-19T11:57:50.971602Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: client connection on socket 0x7feec800b130 completed with error 0. | |
2024-11-19T11:57:50.971605Z DEBUG awscrt::channel: id=0x7feec800b3f0: Beginning creation and setup of new channel. | |
2024-11-19T11:57:50.971608Z DEBUG awscrt::channel: id=0x7feec800b3f0: setup complete, notifying caller. | |
2024-11-19T11:57:50.971612Z DEBUG awscrt::channel: id=0x7feec800b3f0: no message pool is currently stored in the event-loop local storage, adding 0x7feec8002ba0 with max message size 16384, message count 4, with 4 small blocks of 128 bytes. | |
2024-11-19T11:57:50.971623Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feec800b3f0 setup succeeded: bootstrapping. | |
2024-11-19T11:57:50.971627Z DEBUG awscrt::socket-handler: id=0x7feec401ab60: Socket handler created with max_read_size of 16384 | |
2024-11-19T11:57:50.971634Z INFO awscrt::http-connection: id=0x7feec801bac0: HTTP/1.1 client connection established. | |
2024-11-19T11:57:50.971638Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Received new connection (id=0x7feec801bac0) from http layer | |
2024-11-19T11:57:50.971641Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:50.971645Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
2024-11-19T11:57:50.971648Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:50.971664Z DEBUG awscrt::http-stream: id=0x7feec801bf30: Created client request on connection=0x7feec801bac0: PUT /csnow-bucket/yellow_tripdata_2024-01.parquet?partNumber=2&uploadId=14108766089287131162 HTTP/1.1 | |
2024-11-19T11:57:50.984480Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.984500Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.984503Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.984511Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Returning request 0x7feec801c720 for part 3 | |
2024-11-19T11:57:50.984521Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.984526Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):3/3 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.984551Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.984554Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.984552Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80 UploadPart for Multi-part Upload, with ID:14108766089287131162 | |
2024-11-19T11:57:50.984557Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.984568Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.984572Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):3/3 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.984578Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Prepared request 0x7feec801c720 for part 3 | |
2024-11-19T11:57:50.984592Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.984595Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.984598Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.984622Z INFO awscrt::AuthSigning: (id=0x7feecc000ea0) Signing successfully built canonical request for algorithm SigV4, with contents | |
PUT | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
partNumber=3&uploadId=14108766089287131162 | |
accept:application/xml | |
content-encoding:aws-chunked | |
content-length:8388655 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
x-amz-date:20241119T115750Z | |
x-amz-decoded-content-length:8388608 | |
x-amz-trailer:x-amz-checksum-crc32c | |
accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer | |
STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
2024-11-19T11:57:50.984629Z INFO awscrt::AuthSigning: (id=0x7feecc000ea0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
d50d8e21dbca72ee7df1fccf1f902e05c19c0c74d5c61183b4889d3c03f14b0a | |
2024-11-19T11:57:50.984641Z INFO awscrt::AuthSigning: (id=0x7feecc000ea0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer, Signature=e966ae8b1af544b7a4d39cfcfefb2b5231f55ef3ffc3e611fb1b667d428d291b | |
2024-11-19T11:57:50.984663Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.984666Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.984669Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.984671Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.984677Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.984680Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.984684Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec801caa0 | |
2024-11-19T11:57:50.984697Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):3/3 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/3/0/3 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.984725Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec801caa0 | |
2024-11-19T11:57:50.984739Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec801bde0 and nested token 0x7feec801caa0 | |
2024-11-19T11:57:50.984745Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.984749Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=1, pending_settings_count=0, pending_connect_count=1, vended_connection_count=2, open_connection_count=2, ref_count=1 | |
2024-11-19T11:57:50.984753Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Requesting 1 new connections from http | |
2024-11-19T11:57:50.984760Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: acquiring bootstrap reference | |
2024-11-19T11:57:50.984763Z DEBUG awscrt::dns: id=0x55b812b4f120: Host resolution requested for 172.200.202.2 | |
2024-11-19T11:57:50.984768Z DEBUG awscrt::dns: id=0x55b812b4f120: cached entries found for 172.200.202.2 returning to caller. | |
2024-11-19T11:57:50.984834Z DEBUG awscrt::socket: id=0x7feec00019e0 fd=2: initializing with domain 0 and type 0 | |
2024-11-19T11:57:50.984854Z DEBUG awscrt::socket: id=0x7feec00019e0 fd=2: setting socket options to: keep-alive 0, keep idle 0, keep-alive interval 0, keep-alive probe count 0. | |
2024-11-19T11:57:50.984862Z DEBUG awscrt::socket: id=0x7feec00019e0 fd=2: beginning connect. | |
2024-11-19T11:57:50.984866Z DEBUG awscrt::socket: id=0x7feec00019e0 fd=2: connecting to endpoint 172.200.202.2:80. | |
2024-11-19T11:57:50.985203Z INFO awscrt::socket: id=0x7feec00019e0 fd=2: connection success | |
2024-11-19T11:57:50.985214Z DEBUG awscrt::socket: id=0x7feec00019e0 fd=2: assigning to event loop 0x55b812b40800 | |
2024-11-19T11:57:50.985218Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: client connection on socket 0x7feec00019e0 completed with error 0. | |
2024-11-19T11:57:50.985222Z DEBUG awscrt::channel: id=0x7feec00164f0: Beginning creation and setup of new channel. | |
2024-11-19T11:57:50.985225Z DEBUG awscrt::channel: id=0x7feec00164f0: setup complete, notifying caller. | |
2024-11-19T11:57:50.985229Z DEBUG awscrt::channel: id=0x7feec00164f0: message pool 0x7feec0001c70 found in event-loop local storage: using it. | |
2024-11-19T11:57:50.985231Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feec00164f0 setup succeeded: bootstrapping. | |
2024-11-19T11:57:50.985235Z DEBUG awscrt::socket-handler: id=0x7feec401ae60: Socket handler created with max_read_size of 16384 | |
2024-11-19T11:57:50.985255Z INFO awscrt::http-connection: id=0x7feec00168e0: HTTP/1.1 client connection established. | |
2024-11-19T11:57:50.985258Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Received new connection (id=0x7feec00168e0) from http layer | |
2024-11-19T11:57:50.985262Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec00168e0) | |
2024-11-19T11:57:50.985266Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=3, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:50.985269Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec00168e0 | |
2024-11-19T11:57:50.985285Z DEBUG awscrt::http-stream: id=0x7feec0016c90: Created client request on connection=0x7feec00168e0: PUT /csnow-bucket/yellow_tripdata_2024-01.parquet?partNumber=3&uploadId=14108766089287131162 HTTP/1.1 | |
2024-11-19T11:57:50.994870Z DEBUG awscrt::http-stream: id=0x7feec801bf30: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:50.994935Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Request 0x7feec800aef0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:50.994945Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8005090: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:50.994951Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: 1 parts have completed. | |
2024-11-19T11:57:50.994963Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:50.994968Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:50.994980Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.994983Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.994985Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.994991Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.994994Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.995022Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.995025Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.995027Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.995030Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.995033Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.995666Z DEBUG awscrt::http-stream: id=0x7feec401a450: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:50.995692Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Request 0x7feec800acb0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:50.995705Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8003260: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:50.995718Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: 2 parts have completed. | |
2024-11-19T11:57:50.995722Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.995725Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.995727Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec4017f50) | |
2024-11-19T11:57:50.995728Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.995732Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.995731Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:50.995735Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.995747Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.995750Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.995752Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.995755Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.995758Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.996019Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.996022Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.996024Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.996027Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Returning request 0x7feec801d2c0 for part 4 | |
2024-11-19T11:57:50.996034Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.996037Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.996056Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.996056Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80 UploadPart for Multi-part Upload, with ID:14108766089287131162 | |
2024-11-19T11:57:50.996059Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.996067Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.996070Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.996073Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.996075Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Prepared request 0x7feec801d2c0 for part 4 | |
2024-11-19T11:57:50.996096Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:50.996101Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:50.996103Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:50.996128Z INFO awscrt::AuthSigning: (id=0x7feecc0048d0) Signing successfully built canonical request for algorithm SigV4, with contents | |
PUT | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
partNumber=4&uploadId=14108766089287131162 | |
accept:application/xml | |
content-encoding:aws-chunked | |
content-length:8388655 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
x-amz-date:20241119T115750Z | |
x-amz-decoded-content-length:8388608 | |
x-amz-trailer:x-amz-checksum-crc32c | |
accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer | |
STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
2024-11-19T11:57:50.996131Z INFO awscrt::AuthSigning: (id=0x7feecc0048d0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115750Z | |
20241119/VAST/s3/aws4_request | |
f12faf6658edf318b5b7e617eaf0db6d07c5ab86d4f4bac2d5785438150781b0 | |
2024-11-19T11:57:50.996142Z INFO awscrt::AuthSigning: (id=0x7feecc0048d0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer, Signature=25bffec20ebacb8eb7131e7050b19e40dbe7148aa6793e3fd1dcccce29bbbf6e | |
2024-11-19T11:57:50.996156Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:50.996160Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:50.996162Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:50.996165Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:50.996168Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:50.996171Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:50.996174Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec800adf0 | |
2024-11-19T11:57:50.996186Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:50.996206Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec800adf0 | |
2024-11-19T11:57:50.996221Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8003260 and nested token 0x7feec800adf0 | |
2024-11-19T11:57:50.996226Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:50.996229Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec4017f50) | |
2024-11-19T11:57:50.996233Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:50.996263Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec4017f50 | |
2024-11-19T11:57:50.996275Z DEBUG awscrt::http-stream: id=0x7feec401b020: Created client request on connection=0x7feec4017f50: PUT /csnow-bucket/yellow_tripdata_2024-01.parquet?partNumber=4&uploadId=14108766089287131162 HTTP/1.1 | |
2024-11-19T11:57:51.004418Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.004437Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.004440Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.004447Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Returning request 0x7feec801d400 for part 5 | |
2024-11-19T11:57:51.004457Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.004461Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):3/3 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.004479Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.004482Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.004479Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80 UploadPart for Multi-part Upload, with ID:14108766089287131162 | |
2024-11-19T11:57:51.004485Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.004495Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.004501Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):3/3 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.004505Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Prepared request 0x7feec801d400 for part 5 | |
2024-11-19T11:57:51.004522Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.004527Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.004535Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.004560Z INFO awscrt::AuthSigning: (id=0x7feecc0016f0) Signing successfully built canonical request for algorithm SigV4, with contents | |
PUT | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
partNumber=5&uploadId=14108766089287131162 | |
accept:application/xml | |
content-encoding:aws-chunked | |
content-length:8388655 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
x-amz-date:20241119T115751Z | |
x-amz-decoded-content-length:8388608 | |
x-amz-trailer:x-amz-checksum-crc32c | |
accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer | |
STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
2024-11-19T11:57:51.004564Z INFO awscrt::AuthSigning: (id=0x7feecc0016f0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
5609f27c1508fd833e59e63e9d7245657036e66503ab59eee3b52cafe10db702 | |
2024-11-19T11:57:51.004576Z INFO awscrt::AuthSigning: (id=0x7feecc0016f0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer, Signature=f9dd2ea1bbe85c152c0c7f52d23646ce6b9be17845bd0cc65d72e1b5d6b671c5 | |
2024-11-19T11:57:51.004601Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.004605Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.004607Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.004610Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.004615Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.004618Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.004622Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec801d5b0 | |
2024-11-19T11:57:51.004629Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):3/3 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/3/0/3 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.004632Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec801d5b0 | |
2024-11-19T11:57:51.004636Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8005090 and nested token 0x7feec801d5b0 | |
2024-11-19T11:57:51.004639Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.004642Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:51.004647Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=3, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.004650Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:51.004661Z DEBUG awscrt::http-stream: id=0x7feec801d910: Created client request on connection=0x7feec801bac0: PUT /csnow-bucket/yellow_tripdata_2024-01.parquet?partNumber=5&uploadId=14108766089287131162 HTTP/1.1 | |
2024-11-19T11:57:51.010115Z DEBUG awscrt::http-stream: id=0x7feec0016c90: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.010137Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Request 0x7feec801c720 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.010142Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec801bde0: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.010150Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: 3 parts have completed. | |
2024-11-19T11:57:51.010160Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec00168e0) | |
2024-11-19T11:57:51.010161Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.010165Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.010178Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.010188Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.010195Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.010199Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.010208Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.010211Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.010213Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.010216Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.010219Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.012570Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.012582Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.012585Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.012590Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Returning request 0x7feec801dc90 for part 6 | |
2024-11-19T11:57:51.012602Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.012606Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):3/3 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.012620Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80 UploadPart for Multi-part Upload, with ID:14108766089287131162 | |
2024-11-19T11:57:51.012623Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.012632Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.012635Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.012637Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.012640Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):3/3 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.012640Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Prepared request 0x7feec801dc90 for part 6 | |
2024-11-19T11:57:51.012654Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.012658Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.012661Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.012691Z INFO awscrt::AuthSigning: (id=0x7feecc00b680) Signing successfully built canonical request for algorithm SigV4, with contents | |
PUT | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
partNumber=6&uploadId=14108766089287131162 | |
accept:application/xml | |
content-encoding:aws-chunked | |
content-length:8018648 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
x-amz-date:20241119T115751Z | |
x-amz-decoded-content-length:8018601 | |
x-amz-trailer:x-amz-checksum-crc32c | |
accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer | |
STREAMING-UNSIGNED-PAYLOAD-TRAILER | |
2024-11-19T11:57:51.012700Z INFO awscrt::AuthSigning: (id=0x7feecc00b680) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
88c5c3b54aba8b40346d017d5f2fba42fde8137d10989f63e970c1fd1f4f623c | |
2024-11-19T11:57:51.012711Z INFO awscrt::AuthSigning: (id=0x7feecc00b680) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-encoding;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-decoded-content-length;x-amz-trailer, Signature=44330d9d8ee4485ee2c36710deb32fad7ec867a69cf1ea415581c422a17371a4 | |
2024-11-19T11:57:51.012720Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.012724Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.012726Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.012729Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.012734Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.012737Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.012741Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec801ddd0 | |
2024-11-19T11:57:51.012754Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):3/3 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/3/0/3 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.012773Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec801ddd0 | |
2024-11-19T11:57:51.012785Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec801bde0 and nested token 0x7feec801ddd0 | |
2024-11-19T11:57:51.012790Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.012793Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec00168e0) | |
2024-11-19T11:57:51.012797Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=3, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.012801Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec00168e0 | |
2024-11-19T11:57:51.012812Z DEBUG awscrt::http-stream: id=0x7feec00179a0: Created client request on connection=0x7feec00168e0: PUT /csnow-bucket/yellow_tripdata_2024-01.parquet?partNumber=6&uploadId=14108766089287131162 HTTP/1.1 | |
2024-11-19T11:57:51.014091Z DEBUG awscrt::http-stream: id=0x7feec401b020: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.014108Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Request 0x7feec801d2c0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.014120Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8003260: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.014132Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: 4 parts have completed. | |
2024-11-19T11:57:51.014141Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.014143Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec4017f50) | |
2024-11-19T11:57:51.014147Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.014150Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.014150Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.014155Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.014159Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.014163Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.014166Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.014168Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.014171Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.014174Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.014192Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.014195Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.014198Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.014200Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.014204Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/2/0/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.023077Z DEBUG awscrt::http-stream: id=0x7feec801d910: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.023095Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Request 0x7feec801d400 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.023108Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8005090: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.023113Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: 5 parts have completed. | |
2024-11-19T11:57:51.023126Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:51.023131Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.023148Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.023151Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.023154Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.023158Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.023162Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.023168Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.023171Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.023173Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.023176Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.023179Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.028939Z DEBUG awscrt::http-stream: id=0x7feec00179a0: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.028958Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Request 0x7feec801dc90 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.028962Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec801bde0: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.028976Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: 6 parts have completed. | |
2024-11-19T11:57:51.028986Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec00168e0) | |
2024-11-19T11:57:51.028991Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.028999Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.029009Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.029012Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.029018Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.029022Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.029033Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.029035Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.029038Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.029047Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.029050Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.029623Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Prepared request 0x7feec801e120 for part 0 | |
2024-11-19T11:57:51.029654Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.029660Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.029667Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.029689Z INFO awscrt::AuthSigning: (id=0x7feecc0016f0) Signing successfully built canonical request for algorithm SigV4, with contents | |
POST | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
uploadId=14108766089287131162 | |
accept:application/xml | |
content-length:1123 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
accept;content-length;host;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.029693Z INFO awscrt::AuthSigning: (id=0x7feecc0016f0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
5a111a1cbeaba7f426608ae2f02fc99bf5f0542879a5d179097082e01fce248a | |
2024-11-19T11:57:51.029715Z INFO awscrt::AuthSigning: (id=0x7feecc0016f0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=3a4773d10177a545de5b0bab733f1a435552f2a0536e483a6e9d5dbe2c4e56cf | |
2024-11-19T11:57:51.029759Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.029787Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.029791Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.029798Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.029803Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.029807Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.029810Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec801e260 | |
2024-11-19T11:57:51.029826Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/1/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.029878Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec801e260 | |
2024-11-19T11:57:51.029893Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec801bde0 and nested token 0x7feec801e260 | |
2024-11-19T11:57:51.029898Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.029901Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec00168e0) | |
2024-11-19T11:57:51.029905Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.029926Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec00168e0 | |
2024-11-19T11:57:51.029942Z DEBUG awscrt::http-stream: id=0x7feec0017ee0: Created client request on connection=0x7feec00168e0: POST /csnow-bucket/yellow_tripdata_2024-01.parquet?uploadId=14108766089287131162 HTTP/1.1 | |
2024-11-19T11:57:51.039142Z DEBUG awscrt::http-stream: id=0x7feec0017ee0: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.039159Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80: Request 0x7feec801e120 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.039163Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec801bde0: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.039186Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec00168e0) | |
2024-11-19T11:57:51.039191Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.039201Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.039215Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.039218Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.039224Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.039228Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.039244Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.039247Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.039250Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.039254Z DEBUG awscrt::S3MetaRequest: id=0x7fee8400dc80 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:51.039314Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.039319Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.039360Z DEBUG flush{req=782 ino=2 fh=1 pid=404662 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8400dc80 Cleaning up meta request | |
2024-11-19T11:57:51.039369Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.039378Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.039383Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.039387Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.039391Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.178348Z INFO lookup{req=788 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:51.178383Z DEBUG lookup{req=788 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8800dc60 Created new Default Meta Request. operation=HeadObject | |
2024-11-19T11:57:51.178406Z INFO lookup{req=788 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee8800dc60 | |
2024-11-19T11:57:51.178460Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.178482Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.178486Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.178487Z INFO lookup{req=788 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:51.178493Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800dc60: Meta Request Default created request 0x7feec8023e20 | |
2024-11-19T11:57:51.178494Z DEBUG lookup{req=788 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8800e700 Created new Default Meta Request. operation=ListObjectsV2 | |
2024-11-19T11:57:51.178499Z INFO lookup{req=788 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee8800e700 | |
2024-11-19T11:57:51.178523Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800dc60: Meta Request prepared request 0x7feec8023e20 | |
2024-11-19T11:57:51.178542Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.178547Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.178550Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.178571Z INFO awscrt::AuthSigning: (id=0x7feed8000b70) Signing successfully built canonical request for algorithm SigV4, with contents | |
HEAD | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
accept;content-length;host;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.178575Z INFO awscrt::AuthSigning: (id=0x7feed8000b70) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
3c762f085c5c74d17c79880e2f6d67bccaabe7b4bc5f35829e71a32784d37870 | |
2024-11-19T11:57:51.178587Z INFO awscrt::AuthSigning: (id=0x7feed8000b70) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=2955cee172ccf4ca4a01a9d5887f847f786aa2affe08e2d6707616cdf81103c5 | |
2024-11-19T11:57:51.178597Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.178602Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.178607Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.178619Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.178621Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.178625Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800e700: Meta Request Default created request 0x7feec8023f60 | |
2024-11-19T11:57:51.178638Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.178642Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.178646Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.178650Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec801c600 | |
2024-11-19T11:57:51.178663Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.178669Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800e700: Meta Request prepared request 0x7feec8023f60 | |
2024-11-19T11:57:51.178690Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec801c600 | |
2024-11-19T11:57:51.178695Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.178707Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec801bde0 and nested token 0x7feec801c600 | |
2024-11-19T11:57:51.178707Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.178712Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.178712Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.178718Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec00168e0) | |
2024-11-19T11:57:51.178723Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.178739Z INFO awscrt::AuthSigning: (id=0x7feed0000bf0) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/ | |
delimiter=%2F&list-type=2&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
x-amz-optional-object-attributes:RestoreStatus | |
accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.178743Z INFO awscrt::AuthSigning: (id=0x7feed0000bf0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
1780434215d70976bb3cdf88ca392da717a36f5091f4befe5e4695f01c1b2e8f | |
2024-11-19T11:57:51.178749Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec00168e0 | |
2024-11-19T11:57:51.178754Z INFO awscrt::AuthSigning: (id=0x7feed0000bf0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=842faaba8cc26eaa5b6e644b77fd925dcf2b8e7a7a5a4188d8e4c14b474a9cde | |
2024-11-19T11:57:51.178763Z DEBUG awscrt::http-stream: id=0x7feec0018670: Created client request on connection=0x7feec00168e0: HEAD /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:51.178792Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.178799Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.178803Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.178808Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.178812Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.178815Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.178817Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec80240a0 | |
2024-11-19T11:57:51.178822Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.178826Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec80240a0 | |
2024-11-19T11:57:51.178829Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8003260 and nested token 0x7feec80240a0 | |
2024-11-19T11:57:51.178832Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.178835Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:51.178839Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.178843Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:51.178852Z DEBUG awscrt::http-stream: id=0x7feec8024310: Created client request on connection=0x7feec801bac0: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
2024-11-19T11:57:51.179846Z DEBUG awscrt::http-stream: id=0x7feec0018670: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.179853Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800dc60: Request 0x7feec8023e20 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.179857Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec801bde0: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.179881Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec00168e0) | |
2024-11-19T11:57:51.179885Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.179911Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.179919Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.179922Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.179927Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800dc60 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:51.179953Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.179957Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.179989Z DEBUG lookup{req=788 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8800dc60 Cleaning up meta request | |
2024-11-19T11:57:51.179994Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.180002Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.180004Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.180007Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.180010Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.180323Z DEBUG awscrt::http-stream: id=0x7feec8024310: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.180335Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800e700: Request 0x7feec8023f60 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.180340Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8003260: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.180354Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:51.180358Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.180364Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.180366Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.180369Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.180372Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.180375Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.180395Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.180398Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.180400Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.180403Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800e700 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:51.180419Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.180422Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.180434Z DEBUG lookup{req=788 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8800e700 Cleaning up meta request | |
2024-11-19T11:57:51.180436Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.180442Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.180444Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.180447Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.180450Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.184545Z INFO lookup{req=792 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:51.184566Z DEBUG lookup{req=792 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8800ec20 Created new Default Meta Request. operation=HeadObject | |
2024-11-19T11:57:51.184579Z INFO lookup{req=792 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee8800ec20 | |
2024-11-19T11:57:51.184592Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.184598Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.184601Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.184605Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800ec20: Meta Request Default created request 0x7feec8024da0 | |
2024-11-19T11:57:51.184616Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.184626Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.184638Z INFO lookup{req=792 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:51.184644Z DEBUG lookup{req=792 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8800f680 Created new Default Meta Request. operation=ListObjectsV2 | |
2024-11-19T11:57:51.184653Z INFO lookup{req=792 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee8800f680 | |
2024-11-19T11:57:51.184657Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800ec20: Meta Request prepared request 0x7feec8024da0 | |
2024-11-19T11:57:51.184661Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.184673Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.184676Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.184685Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.184686Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800f680: Meta Request Default created request 0x7feec8024ee0 | |
2024-11-19T11:57:51.184689Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.184696Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.184699Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.184700Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.184715Z INFO awscrt::AuthSigning: (id=0x7feed4001530) Signing successfully built canonical request for algorithm SigV4, with contents | |
HEAD | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
accept;content-length;host;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.184719Z INFO awscrt::AuthSigning: (id=0x7feed4001530) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
3c762f085c5c74d17c79880e2f6d67bccaabe7b4bc5f35829e71a32784d37870 | |
2024-11-19T11:57:51.184723Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800f680: Meta Request prepared request 0x7feec8024ee0 | |
2024-11-19T11:57:51.184729Z INFO awscrt::AuthSigning: (id=0x7feed4001530) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=2955cee172ccf4ca4a01a9d5887f847f786aa2affe08e2d6707616cdf81103c5 | |
2024-11-19T11:57:51.184751Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.184754Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.184755Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.184758Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.184759Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.184761Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.184765Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.184768Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.184771Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.184774Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8025020 | |
2024-11-19T11:57:51.184779Z INFO awscrt::AuthSigning: (id=0x7feed00015c0) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/ | |
delimiter=%2F&list-type=2&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
x-amz-optional-object-attributes:RestoreStatus | |
accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.184788Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.184792Z INFO awscrt::AuthSigning: (id=0x7feed00015c0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
1780434215d70976bb3cdf88ca392da717a36f5091f4befe5e4695f01c1b2e8f | |
2024-11-19T11:57:51.184811Z INFO awscrt::AuthSigning: (id=0x7feed00015c0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=842faaba8cc26eaa5b6e644b77fd925dcf2b8e7a7a5a4188d8e4c14b474a9cde | |
2024-11-19T11:57:51.184825Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8025020 | |
2024-11-19T11:57:51.184831Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.184833Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec801cba0 and nested token 0x7feec8025020 | |
2024-11-19T11:57:51.184835Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.184837Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.184838Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.184840Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:51.184842Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.184844Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.184845Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.184849Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.184851Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8025120 | |
2024-11-19T11:57:51.184861Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.184866Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:51.184873Z DEBUG awscrt::http-stream: id=0x7feec8025220: Created client request on connection=0x7feec801bac0: HEAD /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:51.184875Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8025120 | |
2024-11-19T11:57:51.184883Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec801cec0 and nested token 0x7feec8025120 | |
2024-11-19T11:57:51.184887Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.184890Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec00168e0) | |
2024-11-19T11:57:51.184894Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.184911Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec00168e0 | |
2024-11-19T11:57:51.184928Z DEBUG awscrt::http-stream: id=0x7feec0018c70: Created client request on connection=0x7feec00168e0: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
2024-11-19T11:57:51.185860Z DEBUG awscrt::http-stream: id=0x7feec0018c70: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.185870Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800f680: Request 0x7feec8024ee0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.185873Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec801cec0: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.185889Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec00168e0) | |
2024-11-19T11:57:51.185892Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.185895Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.185902Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.185904Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.185908Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.185912Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.185916Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.185918Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.185921Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.185924Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800f680 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:51.185941Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.185945Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.185971Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.185974Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.185976Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.185972Z DEBUG lookup{req=792 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8800f680 Cleaning up meta request | |
2024-11-19T11:57:51.185979Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.185991Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.186235Z DEBUG awscrt::http-stream: id=0x7feec8025220: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.186244Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800ec20: Request 0x7feec8024da0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.186248Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec801cba0: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.186266Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:51.186272Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.186279Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.186282Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.186285Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.186288Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.186291Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.186310Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.186313Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.186315Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.186318Z DEBUG awscrt::S3MetaRequest: id=0x7fee8800ec20 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:51.186333Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.186336Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.186356Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.186355Z DEBUG lookup{req=792 ino=1 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8800ec20 Cleaning up meta request | |
2024-11-19T11:57:51.186359Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.186366Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.186368Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.186371Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.186537Z INFO open{req=796 ino=4 pid=404664 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:51.186564Z DEBUG open{req=796 ino=4 pid=404664 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee84019f50 Created new Default Meta Request. operation=HeadObject | |
2024-11-19T11:57:51.186577Z INFO open{req=796 ino=4 pid=404664 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee84019f50 | |
2024-11-19T11:57:51.186582Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.186589Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.186591Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.186594Z DEBUG awscrt::S3MetaRequest: id=0x7fee84019f50: Meta Request Default created request 0x7feec8025900 | |
2024-11-19T11:57:51.186602Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.186606Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.186652Z INFO open{req=796 ino=4 pid=404664 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:51.186659Z DEBUG open{req=796 ino=4 pid=404664 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8401aa70 Created new Default Meta Request. operation=ListObjectsV2 | |
2024-11-19T11:57:51.186669Z INFO open{req=796 ino=4 pid=404664 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee8401aa70 | |
2024-11-19T11:57:51.186673Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.186677Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.186679Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.186682Z DEBUG awscrt::S3MetaRequest: id=0x7fee8401aa70: Meta Request Default created request 0x7feec8025a40 | |
2024-11-19T11:57:51.186688Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.186692Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.186691Z DEBUG awscrt::S3MetaRequest: id=0x7fee84019f50: Meta Request prepared request 0x7feec8025900 | |
2024-11-19T11:57:51.186703Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.186704Z DEBUG awscrt::S3MetaRequest: id=0x7fee8401aa70: Meta Request prepared request 0x7feec8025a40 | |
2024-11-19T11:57:51.186707Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.186716Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.186726Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.186730Z INFO awscrt::AuthSigning: (id=0x7feecc000ea0) Signing successfully built canonical request for algorithm SigV4, with contents | |
HEAD | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
accept;content-length;host;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.186731Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.186734Z INFO awscrt::AuthSigning: (id=0x7feecc000ea0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
3c762f085c5c74d17c79880e2f6d67bccaabe7b4bc5f35829e71a32784d37870 | |
2024-11-19T11:57:51.186735Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.186751Z INFO awscrt::AuthSigning: (id=0x7feecc000ea0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=2955cee172ccf4ca4a01a9d5887f847f786aa2affe08e2d6707616cdf81103c5 | |
2024-11-19T11:57:51.186759Z INFO awscrt::AuthSigning: (id=0x7feed4001530) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/ | |
delimiter=%2F&list-type=2&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
x-amz-optional-object-attributes:RestoreStatus | |
accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.186764Z INFO awscrt::AuthSigning: (id=0x7feed4001530) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
1780434215d70976bb3cdf88ca392da717a36f5091f4befe5e4695f01c1b2e8f | |
2024-11-19T11:57:51.186765Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.186769Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.186771Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.186774Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.186777Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.186777Z INFO awscrt::AuthSigning: (id=0x7feed4001530) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=842faaba8cc26eaa5b6e644b77fd925dcf2b8e7a7a5a4188d8e4c14b474a9cde | |
2024-11-19T11:57:51.186780Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.186784Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8025b80 | |
2024-11-19T11:57:51.186789Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.186792Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8025b80 | |
2024-11-19T11:57:51.186795Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec801cba0 and nested token 0x7feec8025b80 | |
2024-11-19T11:57:51.186798Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.186801Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:51.186804Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.186810Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:51.186824Z DEBUG awscrt::http-stream: id=0x7feec8025d40: Created client request on connection=0x7feec801bac0: HEAD /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:51.186828Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.186831Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.186833Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.186836Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.186839Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.186841Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.186844Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8025ff0 | |
2024-11-19T11:57:51.186854Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.186860Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8025ff0 | |
2024-11-19T11:57:51.186864Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec801cec0 and nested token 0x7feec8025ff0 | |
2024-11-19T11:57:51.186867Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.186869Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec00168e0) | |
2024-11-19T11:57:51.186873Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.186875Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec00168e0 | |
2024-11-19T11:57:51.186882Z DEBUG awscrt::http-stream: id=0x7feec0019550: Created client request on connection=0x7feec00168e0: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
2024-11-19T11:57:51.187934Z DEBUG awscrt::http-stream: id=0x7feec0019550: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.187943Z DEBUG awscrt::S3MetaRequest: id=0x7fee8401aa70: Request 0x7feec8025a40 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.187948Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec801cec0: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.187964Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec00168e0) | |
2024-11-19T11:57:51.187965Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.187968Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.187972Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.187979Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.187983Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.187986Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.187991Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.187993Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.187995Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.187999Z DEBUG awscrt::S3MetaRequest: id=0x7fee8401aa70 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:51.188015Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.188019Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.188023Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.188027Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.188027Z DEBUG open{req=796 ino=4 pid=404664 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee8401aa70 Cleaning up meta request | |
2024-11-19T11:57:51.188031Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.188036Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.188041Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.188184Z DEBUG awscrt::http-stream: id=0x7feec8025d40: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.188188Z DEBUG awscrt::S3MetaRequest: id=0x7fee84019f50: Request 0x7feec8025900 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.188191Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec801cba0: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.188205Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:51.188208Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.188213Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.188216Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.188219Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.188222Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.188225Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.188234Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.188237Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.188239Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.188242Z DEBUG awscrt::S3MetaRequest: id=0x7fee84019f50 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:51.188256Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.188260Z DEBUG open{req=796 ino=4 pid=404664 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee84019f50 Cleaning up meta request | |
2024-11-19T11:57:51.188262Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.188270Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.188273Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.188275Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.188278Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.188281Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.188345Z WARN ioctl{req=798 ino=4 fh=2 cmd=21505}: mountpoint_s3::fuse: ioctl failed: operation not supported by Mountpoint | |
2024-11-19T11:57:51.188540Z INFO awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:51.188551Z DEBUG awscrt::S3MetaRequest: id=0x7feec001c1a0 Created new Auto-Ranged Get Meta Request. | |
2024-11-19T11:57:51.188561Z INFO awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7feec001c1a0 | |
2024-11-19T11:57:51.188567Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.188570Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.188573Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.188576Z INFO awscrt::S3MetaRequest: id=0x7feec001c1a0: Doing a 'GET_OBJECT_WITH_RANGE' to discover the size of the object and get the first part | |
2024-11-19T11:57:51.188578Z INFO awscrt::S3MetaRequest: id=0x7feec001c1a0: Doing a ranged get to discover the size of the object and get the first part | |
2024-11-19T11:57:51.188582Z DEBUG awscrt::S3MetaRequest: id=0x7feec001c1a0: Returning request 0x7feec8026510 for part 1 of 0 | |
2024-11-19T11:57:51.188590Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.188593Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.188601Z DEBUG awscrt::S3MetaRequest: id=0x7feec001c1a0: Created request 0x7feec8026510 for part 1 part sized 1 | |
2024-11-19T11:57:51.188626Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.188630Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.188633Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.188644Z INFO awscrt::AuthSigning: (id=0x7feecc00b8f0) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:*/* | |
host:172.200.202.2:80 | |
if-match:"6a99d301a12435c672b69144ca37216a-6" | |
range:bytes=0-1179647 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
accept;host;if-match;range;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.188648Z INFO awscrt::AuthSigning: (id=0x7feecc00b8f0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
75a2f337b3dc2fe691ba38f96a6d6a636338374008801e30bbd00c7fd5f4cf4a | |
2024-11-19T11:57:51.188658Z INFO awscrt::AuthSigning: (id=0x7feecc00b8f0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;host;if-match;range;x-amz-content-sha256;x-amz-date, Signature=304a6ceb0f0c3e0d666a7c1f93ec33c7420c537e5cefa6dbc74029a2d448fd61 | |
2024-11-19T11:57:51.188672Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.188675Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.188678Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.188681Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.188684Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.188687Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.188689Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec80266c0 | |
2024-11-19T11:57:51.188694Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):1/0/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.188698Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec80266c0 | |
2024-11-19T11:57:51.188700Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec801cba0 and nested token 0x7feec80266c0 | |
2024-11-19T11:57:51.188703Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.188706Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:51.188709Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.188712Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:51.188719Z DEBUG awscrt::http-stream: id=0x7feec8026880: Created client request on connection=0x7feec801bac0: GET /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:51.194522Z DEBUG awscrt::http-stream: id=0x7feec8026880: Client request complete, response status: 206 (Partial Content). | |
2024-11-19T11:57:51.194541Z DEBUG awscrt::S3MetaRequest: id=0x7feec001c1a0: Request 0x7feec8026510 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 206 | |
2024-11-19T11:57:51.194544Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec801cba0: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.194562Z DEBUG awscrt::S3MetaRequest: id=0x7feec001c1a0: 1 out of 1 parts have completed. | |
2024-11-19T11:57:51.194566Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:51.194569Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.194575Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.194577Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.194580Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.194584Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.194588Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.195295Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.195302Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.195305Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.195309Z DEBUG awscrt::S3MetaRequest: id=0x7feec001c1a0 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:51.195357Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.195363Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.195392Z DEBUG awscrt::S3MetaRequest: id=0x7feec001c1a0 Cleaning up meta request | |
2024-11-19T11:57:51.195396Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.195409Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.195412Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.195416Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.195421Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.196473Z INFO awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:51.196486Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800 Created new Auto-Ranged Get Meta Request. | |
2024-11-19T11:57:51.196497Z INFO awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7feec401d800 | |
2024-11-19T11:57:51.196524Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.196538Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.196543Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.196548Z INFO awscrt::S3MetaRequest: id=0x7feec401d800: Doing a 'GET_OBJECT_WITH_RANGE' to discover the size of the object and get the first part | |
2024-11-19T11:57:51.196552Z INFO awscrt::S3MetaRequest: id=0x7feec401d800: Doing a ranged get to discover the size of the object and get the first part | |
2024-11-19T11:57:51.196558Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Returning request 0x7feec80299f0 for part 1 of 0 | |
2024-11-19T11:57:51.196572Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.196577Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.196587Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Created request 0x7feec80299f0 for part 1 part sized 1 | |
2024-11-19T11:57:51.196605Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.196608Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.196611Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.196627Z INFO awscrt::AuthSigning: (id=0x7feecc000f20) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:*/* | |
host:172.200.202.2:80 | |
if-match:"6a99d301a12435c672b69144ca37216a-6" | |
range:bytes=1179648-9568255 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
accept;host;if-match;range;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.196631Z INFO awscrt::AuthSigning: (id=0x7feecc000f20) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
df9a339c91d9bf0e66213e0efeba6b1f2df3960604f902467aac564de9d12645 | |
2024-11-19T11:57:51.196641Z INFO awscrt::AuthSigning: (id=0x7feecc000f20) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;host;if-match;range;x-amz-content-sha256;x-amz-date, Signature=6ceacfb67819d8ceee987fccfcd4c98f8ab8bbee89bc58437b2acf3a282ec471 | |
2024-11-19T11:57:51.196661Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.196667Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.196671Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.196674Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.196679Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.196682Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.196685Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8029b30 | |
2024-11-19T11:57:51.196697Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):1/0/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.196715Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8029b30 | |
2024-11-19T11:57:51.196729Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8003260 and nested token 0x7feec8029b30 | |
2024-11-19T11:57:51.196733Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.196736Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:51.196740Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.196757Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:51.196766Z DEBUG awscrt::http-stream: id=0x7feec8029c30: Created client request on connection=0x7feec801bac0: GET /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:51.209644Z DEBUG awscrt::http-stream: id=0x7feec8029c30: Client request complete, response status: 206 (Partial Content). | |
2024-11-19T11:57:51.209674Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Request 0x7feec80299f0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 206 | |
2024-11-19T11:57:51.209681Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8003260: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.209704Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: 1 out of 6 parts have completed. | |
2024-11-19T11:57:51.209708Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:51.209713Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.209720Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.209723Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.209726Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.209731Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Download paused because read window is zero. You must increment to window to continue. | |
2024-11-19T11:57:51.209734Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.209738Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.214230Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.214235Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.214238Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.214241Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.214244Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.215233Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.215240Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.215242Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.215247Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Returning request 0x7feec8029fd0 for part 2 of 6 | |
2024-11-19T11:57:51.215256Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Download paused because read window is zero. You must increment to window to continue. | |
2024-11-19T11:57:51.215259Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.215263Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.215291Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Created request 0x7feec8029fd0 for part 2 part sized 1 | |
2024-11-19T11:57:51.215318Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.215322Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.215325Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.215344Z INFO awscrt::AuthSigning: (id=0x7feec801cda0) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:*/* | |
host:172.200.202.2:80 | |
if-match:"6a99d301a12435c672b69144ca37216a-6" | |
range:bytes=9568256-17956863 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
accept;host;if-match;range;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.215348Z INFO awscrt::AuthSigning: (id=0x7feec801cda0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
bf56e6ed3ea8e0d8938f487ca3e0dd18c63a8f8eff4108b90395a38f1abbfcb9 | |
2024-11-19T11:57:51.215360Z INFO awscrt::AuthSigning: (id=0x7feec801cda0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;host;if-match;range;x-amz-content-sha256;x-amz-date, Signature=b65dbf79d9f6b80fa304583d964d0ec90d33cbeba5bb2085d6db26eaf6cfbe67 | |
2024-11-19T11:57:51.215378Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.215381Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.215384Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.215386Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.215391Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.215394Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.215397Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec802a180 | |
2024-11-19T11:57:51.215410Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):1/0/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.215436Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec802a180 | |
2024-11-19T11:57:51.215451Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8003260 and nested token 0x7feec802a180 | |
2024-11-19T11:57:51.215456Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.215459Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:51.215463Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.215482Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:51.215493Z DEBUG awscrt::http-stream: id=0x7feec802a2e0: Created client request on connection=0x7feec801bac0: GET /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:51.227943Z DEBUG awscrt::http-stream: id=0x7feec802a2e0: Client request complete, response status: 206 (Partial Content). | |
2024-11-19T11:57:51.227970Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Request 0x7feec8029fd0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 206 | |
2024-11-19T11:57:51.227976Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8003260: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.227992Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: 2 out of 6 parts have completed. | |
2024-11-19T11:57:51.227996Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:51.228001Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.228008Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.228012Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.228014Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.228021Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.228024Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.232765Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.232782Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.232785Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.232790Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.232795Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.236232Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.236255Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.236260Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.236271Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Returning request 0x7feec802a180 for part 3 of 6 | |
2024-11-19T11:57:51.236287Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Download paused because read window is zero. You must increment to window to continue. | |
2024-11-19T11:57:51.236292Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.236298Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.236322Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Created request 0x7feec802a180 for part 3 part sized 1 | |
2024-11-19T11:57:51.236354Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.236358Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.236362Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.236384Z INFO awscrt::AuthSigning: (id=0x7feecc000ea0) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:*/* | |
host:172.200.202.2:80 | |
if-match:"6a99d301a12435c672b69144ca37216a-6" | |
range:bytes=17956864-26345471 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
accept;host;if-match;range;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.236388Z INFO awscrt::AuthSigning: (id=0x7feecc000ea0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
781269d58e66d7456d013efcf7213a2f936e99d2d0c307d230ccc48600eb86f9 | |
2024-11-19T11:57:51.236401Z INFO awscrt::AuthSigning: (id=0x7feecc000ea0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;host;if-match;range;x-amz-content-sha256;x-amz-date, Signature=6502aff7a80be7985de7c392b6d9ef7214dcfecaecff598bc25cabe014c6ab54 | |
2024-11-19T11:57:51.236435Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.236444Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.236448Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.236454Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.236462Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.236467Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.236473Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec802a2c0 | |
2024-11-19T11:57:51.236491Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):1/0/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.236499Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec802a2c0 | |
2024-11-19T11:57:51.236518Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8003260 and nested token 0x7feec802a2c0 | |
2024-11-19T11:57:51.236522Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.236526Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:51.236531Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.236558Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:51.236575Z DEBUG awscrt::http-stream: id=0x7feec802a420: Created client request on connection=0x7feec801bac0: GET /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:51.250619Z DEBUG awscrt::http-stream: id=0x7feec802a420: Client request complete, response status: 206 (Partial Content). | |
2024-11-19T11:57:51.250647Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Request 0x7feec802a180 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 206 | |
2024-11-19T11:57:51.250654Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8003260: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.250669Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: 3 out of 6 parts have completed. | |
2024-11-19T11:57:51.250674Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:51.250678Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.250686Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.250689Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.250692Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.250698Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.250702Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.255408Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.255425Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.255428Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.255434Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.255439Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.257084Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.257113Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.257118Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.257126Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Returning request 0x7feec802a2c0 for part 4 of 6 | |
2024-11-19T11:57:51.257140Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Download paused because read window is zero. You must increment to window to continue. | |
2024-11-19T11:57:51.257145Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.257150Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.257176Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Created request 0x7feec802a2c0 for part 4 part sized 1 | |
2024-11-19T11:57:51.257212Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.257218Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.257222Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.257250Z INFO awscrt::AuthSigning: (id=0x7feecc0048d0) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:*/* | |
host:172.200.202.2:80 | |
if-match:"6a99d301a12435c672b69144ca37216a-6" | |
range:bytes=26345472-34734079 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
accept;host;if-match;range;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.257256Z INFO awscrt::AuthSigning: (id=0x7feecc0048d0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
3ccb46e9f348ec02adb889248fdf4e56a43bce602669eefbb9c6336ac3818dc3 | |
2024-11-19T11:57:51.257271Z INFO awscrt::AuthSigning: (id=0x7feecc0048d0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;host;if-match;range;x-amz-content-sha256;x-amz-date, Signature=e80073906cabc3a11adc52ded104713c65045c6a6461913d91fd253595d1d2d6 | |
2024-11-19T11:57:51.257315Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.257323Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.257325Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.257329Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.257334Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.257339Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.257342Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec802a400 | |
2024-11-19T11:57:51.257356Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):1/0/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.257383Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec802a400 | |
2024-11-19T11:57:51.257408Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8003260 and nested token 0x7feec802a400 | |
2024-11-19T11:57:51.257412Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.257417Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:51.257421Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.257440Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:51.257452Z DEBUG awscrt::http-stream: id=0x7feec802a560: Created client request on connection=0x7feec801bac0: GET /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:51.269850Z DEBUG awscrt::http-stream: id=0x7feec802a560: Client request complete, response status: 206 (Partial Content). | |
2024-11-19T11:57:51.269878Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Request 0x7feec802a2c0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 206 | |
2024-11-19T11:57:51.269885Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8003260: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.269900Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: 4 out of 6 parts have completed. | |
2024-11-19T11:57:51.269905Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:51.269910Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.269917Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.269921Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.269923Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.269929Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.269935Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.274720Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.274740Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.274744Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.274750Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.274754Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.278623Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.278647Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.278676Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.278687Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Returning request 0x7feec802a400 for part 5 of 6 | |
2024-11-19T11:57:51.278703Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Download paused because read window is zero. You must increment to window to continue. | |
2024-11-19T11:57:51.278708Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.278714Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.278747Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Created request 0x7feec802a400 for part 5 part sized 1 | |
2024-11-19T11:57:51.278774Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.278779Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.278781Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.278808Z INFO awscrt::AuthSigning: (id=0x7feecc000f20) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:*/* | |
host:172.200.202.2:80 | |
if-match:"6a99d301a12435c672b69144ca37216a-6" | |
range:bytes=34734080-43122687 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
accept;host;if-match;range;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.278812Z INFO awscrt::AuthSigning: (id=0x7feecc000f20) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
622f61180c75aa6b92576add8577213f48cd47eb713286165f976f9fd6871794 | |
2024-11-19T11:57:51.278823Z INFO awscrt::AuthSigning: (id=0x7feecc000f20) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;host;if-match;range;x-amz-content-sha256;x-amz-date, Signature=c7ce3f108df52ba5aaf0a69ee758503efe17100ca7eedb26360f7f3f5f416b02 | |
2024-11-19T11:57:51.278853Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.278863Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.278867Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.278873Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.278880Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.278885Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.278891Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec802a540 | |
2024-11-19T11:57:51.278908Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):1/0/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.278926Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec802a540 | |
2024-11-19T11:57:51.278943Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8003260 and nested token 0x7feec802a540 | |
2024-11-19T11:57:51.278957Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.278961Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:51.278965Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.278989Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:51.279006Z DEBUG awscrt::http-stream: id=0x7feec802a6a0: Created client request on connection=0x7feec801bac0: GET /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:51.290014Z DEBUG awscrt::http-stream: id=0x7feec802a6a0: Client request complete, response status: 206 (Partial Content). | |
2024-11-19T11:57:51.290044Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Request 0x7feec802a400 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 206 | |
2024-11-19T11:57:51.290053Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8003260: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.290071Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: 5 out of 6 parts have completed. | |
2024-11-19T11:57:51.290076Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:51.290081Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.290089Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.290093Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.290095Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.290101Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.290105Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.291385Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.291389Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.291391Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.291394Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.291398Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.299470Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.299490Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.299493Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.299501Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Returning request 0x7feec802a400 for part 6 of 6 | |
2024-11-19T11:57:51.299533Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.299538Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.299559Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Created request 0x7feec802a400 for part 6 part sized 1 | |
2024-11-19T11:57:51.299584Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.299588Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.299591Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.299610Z INFO awscrt::AuthSigning: (id=0x7feecc00c820) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:*/* | |
host:172.200.202.2:80 | |
if-match:"6a99d301a12435c672b69144ca37216a-6" | |
range:bytes=43122688-49961922 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
accept;host;if-match;range;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.299614Z INFO awscrt::AuthSigning: (id=0x7feecc00c820) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
aaae9ddf32bbfdd1577f9cfb5f8d3f2a51c73866b733afa8442813fb586a96e9 | |
2024-11-19T11:57:51.299625Z INFO awscrt::AuthSigning: (id=0x7feecc00c820) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;host;if-match;range;x-amz-content-sha256;x-amz-date, Signature=45ed875710749a11c976d7b481916b719d584cd9206bc38a1c7180758fcd32bb | |
2024-11-19T11:57:51.299642Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.299645Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.299648Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.299651Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.299656Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.299660Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.299664Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec802a540 | |
2024-11-19T11:57:51.299677Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):1/0/0/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.299708Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec802a540 | |
2024-11-19T11:57:51.299724Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8003260 and nested token 0x7feec802a540 | |
2024-11-19T11:57:51.299729Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.299732Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:51.299737Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.299763Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:51.299774Z DEBUG awscrt::http-stream: id=0x7feec802a6a0: Created client request on connection=0x7feec801bac0: GET /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:51.318202Z DEBUG awscrt::http-stream: id=0x7feec802a6a0: Client request complete, response status: 206 (Partial Content). | |
2024-11-19T11:57:51.318228Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: Request 0x7feec802a400 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 206 | |
2024-11-19T11:57:51.318234Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8003260: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.318248Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800: 6 out of 6 parts have completed. | |
2024-11-19T11:57:51.318253Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:51.318258Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.318265Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.318268Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.318271Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.318277Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.318281Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:1 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.319427Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.319437Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.319440Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.319445Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:51.319507Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.319511Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.320147Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.320152Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.320149Z DEBUG awscrt::S3MetaRequest: id=0x7feec401d800 Cleaning up meta request | |
2024-11-19T11:57:51.320154Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.320172Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.320183Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.335193Z INFO getattr{req=1568 ino=4 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:51.335227Z DEBUG getattr{req=1568 ino=4 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee880101d0 Created new Default Meta Request. operation=HeadObject | |
2024-11-19T11:57:51.335245Z INFO getattr{req=1568 ino=4 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee880101d0 | |
2024-11-19T11:57:51.335271Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.335288Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.335292Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.335298Z DEBUG awscrt::S3MetaRequest: id=0x7fee880101d0: Meta Request Default created request 0x7feec802a6a0 | |
2024-11-19T11:57:51.335310Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.335312Z INFO getattr{req=1568 ino=4 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10 Initiating making of meta request | |
2024-11-19T11:57:51.335314Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.335319Z DEBUG getattr{req=1568 ino=4 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee880156c0 Created new Default Meta Request. operation=ListObjectsV2 | |
2024-11-19T11:57:51.335328Z INFO getattr{req=1568 ino=4 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3Client: id=0x55b812c27c10: Created meta request 0x7fee880156c0 | |
2024-11-19T11:57:51.335334Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.335337Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.335340Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.335343Z DEBUG awscrt::S3MetaRequest: id=0x7fee880156c0: Meta Request Default created request 0x7feec802a7e0 | |
2024-11-19T11:57:51.335347Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.335351Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:2 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.335353Z DEBUG awscrt::S3MetaRequest: id=0x7fee880101d0: Meta Request prepared request 0x7feec802a6a0 | |
2024-11-19T11:57:51.335379Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.335383Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.335386Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.335406Z INFO awscrt::AuthSigning: (id=0x7feecc000ea0) Signing successfully built canonical request for algorithm SigV4, with contents | |
HEAD | |
/csnow-bucket/yellow_tripdata_2024-01.parquet | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
accept;content-length;host;x-amz-content-sha256;x-amz-date | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.335421Z INFO awscrt::AuthSigning: (id=0x7feecc000ea0) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
3c762f085c5c74d17c79880e2f6d67bccaabe7b4bc5f35829e71a32784d37870 | |
2024-11-19T11:57:51.335432Z INFO awscrt::AuthSigning: (id=0x7feecc000ea0) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date, Signature=2955cee172ccf4ca4a01a9d5887f847f786aa2affe08e2d6707616cdf81103c5 | |
2024-11-19T11:57:51.335450Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.335453Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.335454Z DEBUG awscrt::S3MetaRequest: id=0x7fee880156c0: Meta Request prepared request 0x7feec802a7e0 | |
2024-11-19T11:57:51.335456Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.335459Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.335460Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Credentials provider chain get credentials dispatch | |
2024-11-19T11:57:51.335464Z DEBUG awscrt::AuthCredentialsProvider: (id=0x55b812c83b70) Cached credentials provider successfully sourced from cache | |
2024-11-19T11:57:51.335464Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.335467Z INFO awscrt::AuthCredentialsProvider: (id=0x55b812b7c230) Default chain credentials provider successfully sourced credentials | |
2024-11-19T11:57:51.335469Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.335473Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8028df0 | |
2024-11-19T11:57:51.335481Z INFO awscrt::AuthSigning: (id=0x7feecc00c820) Signing successfully built canonical request for algorithm SigV4, with contents | |
GET | |
/csnow-bucket/ | |
delimiter=%2F&list-type=2&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F | |
accept:application/xml | |
content-length:0 | |
host:172.200.202.2:80 | |
x-amz-content-sha256:UNSIGNED-PAYLOAD | |
x-amz-date:20241119T115751Z | |
x-amz-optional-object-attributes:RestoreStatus | |
accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes | |
UNSIGNED-PAYLOAD | |
2024-11-19T11:57:51.335485Z INFO awscrt::AuthSigning: (id=0x7feecc00c820) Signing successfully built string-to-sign via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 | |
20241119T115751Z | |
20241119/VAST/s3/aws4_request | |
1780434215d70976bb3cdf88ca392da717a36f5091f4befe5e4695f01c1b2e8f | |
2024-11-19T11:57:51.335486Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:1 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.335494Z INFO awscrt::AuthSigning: (id=0x7feecc00c820) Http request successfully built final authorization value via algorithm SigV4, with contents | |
AWS4-HMAC-SHA256 Credential=O6UZCRYPS9OPWUD1DYF8/20241119/VAST/s3/aws4_request, SignedHeaders=accept;content-length;host;x-amz-content-sha256;x-amz-date;x-amz-optional-object-attributes, Signature=842faaba8cc26eaa5b6e644b77fd925dcf2b8e7a7a5a4188d8e4c14b474a9cde | |
2024-11-19T11:57:51.335508Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.335513Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8028df0 | |
2024-11-19T11:57:51.335519Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.335530Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.335530Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec8003260 and nested token 0x7feec8028df0 | |
2024-11-19T11:57:51.335533Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.335536Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.335536Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: attempting to acquire retry token for partition_id 172.200.202.2:80 | |
2024-11-19T11:57:51.335540Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec801bac0) | |
2024-11-19T11:57:51.335540Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: bucket 0x7feec80025b0 for partition_id 172.200.202.2:80 found | |
2024-11-19T11:57:51.335545Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Initializing retry token 0x7feec8028ef0 | |
2024-11-19T11:57:51.335546Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.335549Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):2/2 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/2/2 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.335553Z DEBUG awscrt::exp-backoff-strategy: id=0x55b812b3e410: Vending retry_token 0x7feec8028ef0 | |
2024-11-19T11:57:51.335557Z DEBUG awscrt::standard-retry-strategy: id=0x55b812b7c580: token acquired callback invoked with error Success. with token 0x7feec802aa70 and nested token 0x7feec8028ef0 | |
2024-11-19T11:57:51.335560Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Acquire connection | |
2024-11-19T11:57:51.335563Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Grabbing pooled connection (0x7feec00168e0) | |
2024-11-19T11:57:51.335567Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=1, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=2, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.335578Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec801bac0 | |
2024-11-19T11:57:51.335587Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: Successfully completed connection acquisition with connection id=0x7feec00168e0 | |
2024-11-19T11:57:51.335588Z DEBUG awscrt::http-stream: id=0x7feec8029110: Created client request on connection=0x7feec801bac0: HEAD /csnow-bucket/yellow_tripdata_2024-01.parquet HTTP/1.1 | |
2024-11-19T11:57:51.335603Z DEBUG awscrt::http-stream: id=0x7feec001cb60: Created client request on connection=0x7feec00168e0: GET /csnow-bucket/?list-type=2&delimiter=%2F&max-keys=1&prefix=yellow_tripdata_2024-01.parquet%2F HTTP/1.1 | |
2024-11-19T11:57:51.336725Z DEBUG awscrt::http-stream: id=0x7feec8029110: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.336731Z DEBUG awscrt::S3MetaRequest: id=0x7fee880101d0: Request 0x7feec802a6a0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.336734Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec8003260: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.336757Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:51.336761Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=2, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=1, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.336766Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.336769Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.336771Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.336775Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.336778Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.336791Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.336794Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.336797Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.336800Z DEBUG awscrt::S3MetaRequest: id=0x7fee880101d0 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:51.336821Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.336825Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.336846Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.336844Z DEBUG getattr{req=1568 ino=4 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee880101d0 Cleaning up meta request | |
2024-11-19T11:57:51.336849Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.336856Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.336859Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.336862Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):1/1 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/1/1 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.336907Z DEBUG awscrt::http-stream: id=0x7feec001cb60: Client request complete, response status: 200 (OK). | |
2024-11-19T11:57:51.336921Z DEBUG awscrt::S3MetaRequest: id=0x7fee880156c0: Request 0x7feec802a7e0 finished with error code 0 (aws-c-common: AWS_ERROR_SUCCESS, Success.) and response status 200 | |
2024-11-19T11:57:51.336925Z DEBUG awscrt::standard-retry-strategy: token_id=0x7feec802aa70: partition=172.200.202.2:80: recording successful operation and adding 1 units of capacity back to the bucket. | |
2024-11-19T11:57:51.336943Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.336944Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: User releasing connection (id=0x7feec00168e0) | |
2024-11-19T11:57:51.336949Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=1, idle_connection_count=3, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=1 | |
2024-11-19T11:57:51.336946Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.336961Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.336964Z DEBUG awscrt::S3MetaRequest: id=0x7fee880156c0 Meta request finished with error code 0 (Success.) | |
2024-11-19T11:57:51.336978Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.336982Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.336985Z DEBUG getattr{req=1568 ino=4 name="yellow_tripdata_2024-01.parquet"}: awscrt::S3MetaRequest: id=0x7fee880156c0 Cleaning up meta request | |
2024-11-19T11:57:51.336986Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:51.336991Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:51.336994Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:51.336996Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:51.336999Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):1/1 | |
2024-11-19T11:57:51.604676Z DEBUG awscrt::dns: static: resolving host 172.200.202.2 | |
2024-11-19T11:57:51.604719Z DEBUG awscrt::dns: static: resolved record: 172.200.202.2 | |
2024-11-19T11:57:51.604724Z DEBUG awscrt::dns: static, resolving host 172.200.202.2 successful, returned 1 addresses | |
2024-11-19T11:57:51.942456Z DEBUG awscrt::channel: id=0x7feec4017ab0: channel throughput - 599333878 bytes per second | |
2024-11-19T11:57:51.971707Z DEBUG awscrt::channel: id=0x7feec800b3f0: channel throughput - 1186690484 bytes per second | |
2024-11-19T11:57:51.985660Z DEBUG awscrt::channel: id=0x7feec00164f0: channel throughput - 746140837 bytes per second | |
2024-11-19T11:57:52.604946Z DEBUG awscrt::dns: static: resolving host 172.200.202.2 | |
2024-11-19T11:57:52.604993Z DEBUG awscrt::dns: static: resolved record: 172.200.202.2 | |
2024-11-19T11:57:52.604998Z DEBUG awscrt::dns: static, resolving host 172.200.202.2 successful, returned 1 addresses | |
2024-11-19T11:57:52.942571Z DEBUG awscrt::channel: id=0x7feec4017ab0: channel throughput - 0 bytes per second | |
2024-11-19T11:57:52.971805Z DEBUG awscrt::channel: id=0x7feec800b3f0: channel throughput - 0 bytes per second | |
2024-11-19T11:57:52.985761Z DEBUG awscrt::channel: id=0x7feec00164f0: channel throughput - 0 bytes per second | |
2024-11-19T11:57:53.605199Z DEBUG awscrt::dns: static: resolving host 172.200.202.2 | |
2024-11-19T11:57:53.605250Z DEBUG awscrt::dns: static: resolved record: 172.200.202.2 | |
2024-11-19T11:57:53.605257Z DEBUG awscrt::dns: static, resolving host 172.200.202.2 successful, returned 1 addresses | |
2024-11-19T11:57:53.605934Z INFO awscrt::connection-manager: id=0x55b812d93fc0: release | |
2024-11-19T11:57:53.605962Z INFO awscrt::connection-manager: id=0x55b812d93fc0: ref count now zero, starting shut down process | |
2024-11-19T11:57:53.605967Z INFO awscrt::connection-manager: id=0x55b812d93fc0: manager release, failing 0 pending acquisitions | |
2024-11-19T11:57:53.605973Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=2, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=3, ref_count=0 | |
2024-11-19T11:57:53.605988Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Releasing connection (id=0x7feec00168e0) | |
2024-11-19T11:57:53.606006Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Releasing connection (id=0x7feec801bac0) | |
2024-11-19T11:57:53.606011Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Releasing connection (id=0x7feec4017f50) | |
2024-11-19T11:57:53.606026Z DEBUG awscrt::channel: id=0x7feec800b3f0: beginning shutdown process | |
2024-11-19T11:57:53.606025Z DEBUG awscrt::channel: id=0x7feec00164f0: beginning shutdown process | |
2024-11-19T11:57:53.606030Z DEBUG awscrt::channel: id=0x7feec800b3f0: handler 0x7feec401ab60 shutdown in read dir completed. | |
2024-11-19T11:57:53.606034Z DEBUG awscrt::channel: id=0x7feec800b3f0: handler 0x7feec801bac8 shutdown in read dir completed. | |
2024-11-19T11:57:53.606035Z DEBUG awscrt::channel: id=0x7feec00164f0: handler 0x7feec401ae60 shutdown in read dir completed. | |
2024-11-19T11:57:53.606038Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:53.606040Z DEBUG awscrt::channel: id=0x7feec00164f0: handler 0x7feec00168e8 shutdown in read dir completed. | |
2024-11-19T11:57:53.606042Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:53.606046Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:53.606048Z DEBUG awscrt::channel: id=0x7feec00164f0: handler 0x7feec00168e8 shutdown in write dir completed. | |
2024-11-19T11:57:53.606049Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:53.606053Z DEBUG awscrt::socket: id=0x7feec00019e0 fd=2: closing | |
2024-11-19T11:57:53.606054Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):0/1 | |
2024-11-19T11:57:53.606060Z DEBUG awscrt::channel: id=0x7feec800b3f0: handler 0x7feec801bac8 shutdown in write dir completed. | |
2024-11-19T11:57:53.606057Z DEBUG awscrt::channel: id=0x7feec4017ab0: beginning shutdown process | |
2024-11-19T11:57:53.606063Z DEBUG awscrt::socket: id=0x7feec800b130 fd=0: closing | |
2024-11-19T11:57:53.606075Z DEBUG awscrt::channel: id=0x7feec4017ab0: handler 0x7feec8004170 shutdown in read dir completed. | |
2024-11-19T11:57:53.606080Z DEBUG awscrt::channel: id=0x7feec4017ab0: handler 0x7feec4017f58 shutdown in read dir completed. | |
2024-11-19T11:57:53.606084Z DEBUG awscrt::channel: id=0x7feec4017ab0: handler 0x7feec4017f58 shutdown in write dir completed. | |
2024-11-19T11:57:53.606087Z DEBUG awscrt::socket: id=0x7feec4017760 fd=1: closing | |
2024-11-19T11:57:53.606165Z DEBUG awscrt::channel: id=0x7feec4017ab0: handler 0x7feec8004170 shutdown in write dir completed. | |
2024-11-19T11:57:53.606166Z DEBUG awscrt::channel: id=0x7feec800b3f0: handler 0x7feec401ab60 shutdown in write dir completed. | |
2024-11-19T11:57:53.606170Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feec4017ab0 shutdown with error 0. | |
2024-11-19T11:57:53.606172Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feec800b3f0 shutdown with error 0. | |
2024-11-19T11:57:53.606175Z INFO awscrt::http-connection: 0x7feec4017f50: Client shutdown completed with error 0 (AWS_ERROR_SUCCESS). | |
2024-11-19T11:57:53.606176Z INFO awscrt::http-connection: 0x7feec801bac0: Client shutdown completed with error 0 (AWS_ERROR_SUCCESS). | |
2024-11-19T11:57:53.606179Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: shutdown received for connection (id=0x7feec4017f50) | |
2024-11-19T11:57:53.606180Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: shutdown received for connection (id=0x7feec801bac0) | |
2024-11-19T11:57:53.606180Z DEBUG awscrt::channel: id=0x7feec00164f0: handler 0x7feec401ae60 shutdown in write dir completed. | |
2024-11-19T11:57:53.606182Z INFO awscrt::connection-manager: id=0x55b812d93fc0: manager release, failing 0 pending acquisitions | |
2024-11-19T11:57:53.606194Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: channel 0x7feec00164f0 shutdown with error 0. | |
2024-11-19T11:57:53.606200Z INFO awscrt::http-connection: 0x7feec00168e0: Client shutdown completed with error 0 (AWS_ERROR_SUCCESS). | |
2024-11-19T11:57:53.606200Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=2, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=2, ref_count=0 | |
2024-11-19T11:57:53.606204Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: shutdown received for connection (id=0x7feec00168e0) | |
2024-11-19T11:57:53.606206Z DEBUG awscrt::channel: id=0x7feec4017ab0: destroying channel. | |
2024-11-19T11:57:53.606206Z INFO awscrt::connection-manager: id=0x55b812d93fc0: manager release, failing 0 pending acquisitions | |
2024-11-19T11:57:53.606214Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: releasing bootstrap reference | |
2024-11-19T11:57:53.606217Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=2, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=1, ref_count=0 | |
2024-11-19T11:57:53.606221Z DEBUG awscrt::channel: id=0x7feec800b3f0: destroying channel. | |
2024-11-19T11:57:53.606222Z INFO awscrt::connection-manager: id=0x55b812d93fc0: manager release, failing 0 pending acquisitions | |
2024-11-19T11:57:53.606226Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: releasing bootstrap reference | |
2024-11-19T11:57:53.606229Z DEBUG awscrt::connection-manager: id=0x55b812d93fc0: snapshot - state=2, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=0, ref_count=0 | |
2024-11-19T11:57:53.606235Z INFO awscrt::connection-manager: id=0x55b812d93fc0: Destroying self | |
2024-11-19T11:57:53.606240Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: releasing bootstrap reference | |
2024-11-19T11:57:53.606254Z DEBUG awscrt::channel: id=0x7feec00164f0: destroying channel. | |
2024-11-19T11:57:53.606260Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:53.606261Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: releasing bootstrap reference | |
2024-11-19T11:57:53.606264Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:53.606267Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:53.606269Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:53.606273Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):0/0 | |
2024-11-19T11:57:54.605462Z DEBUG awscrt::dns: static: resolving host 172.200.202.2 | |
2024-11-19T11:57:54.605510Z DEBUG awscrt::dns: static: resolved record: 172.200.202.2 | |
2024-11-19T11:57:54.605515Z DEBUG awscrt::dns: static, resolving host 172.200.202.2 successful, returned 1 addresses | |
2024-11-19T11:57:55.605724Z DEBUG awscrt::dns: static: resolving host 172.200.202.2 | |
2024-11-19T11:57:55.605800Z DEBUG awscrt::dns: static: resolved record: 172.200.202.2 | |
2024-11-19T11:57:55.605809Z DEBUG awscrt::dns: static, resolving host 172.200.202.2 successful, returned 1 addresses | |
2024-11-19T11:57:56.429321Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Client starting destruction. | |
2024-11-19T11:57:56.429410Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: releasing bootstrap reference | |
2024-11-19T11:57:56.429431Z INFO awscrt::event-loop: id=0x55b812c689d0: Destroying event_loop | |
2024-11-19T11:57:56.429461Z INFO awscrt::event-loop: id=0x55b812c689d0: Stopping event-loop thread. | |
2024-11-19T11:57:56.429517Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:56.429528Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:56.429531Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:56.429534Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:56.429538Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):0/0 | |
2024-11-19T11:57:56.429542Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Client shutdown progress: starting_destroy_executing=0 body_streaming_elg_allocated=1 process_work_task_scheduled=1 process_work_task_in_progress=0 num_endpoints_allocated=0 s3express_provider_active=0 finish_destroy=0 | |
2024-11-19T11:57:56.429546Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:56.429548Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:56.429551Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:56.429553Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:56.429556Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):0/0 | |
2024-11-19T11:57:56.429559Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Client shutdown progress: starting_destroy_executing=0 body_streaming_elg_allocated=1 process_work_task_scheduled=0 process_work_task_in_progress=0 num_endpoints_allocated=0 s3express_provider_active=0 finish_destroy=0 | |
2024-11-19T11:57:56.429596Z DEBUG awscrt::event-loop: id=0x55b812c689d0: exiting main loop | |
2024-11-19T11:57:56.431029Z INFO awscrt::event-loop: id=0x55b812c697d0: Destroying event_loop | |
2024-11-19T11:57:56.431048Z INFO awscrt::event-loop: id=0x55b812c697d0: Stopping event-loop thread. | |
2024-11-19T11:57:56.431115Z DEBUG awscrt::event-loop: id=0x55b812c697d0: exiting main loop | |
2024-11-19T11:57:56.431281Z INFO awscrt::event-loop: id=0x55b812c6a1d0: Destroying event_loop | |
2024-11-19T11:57:56.431291Z INFO awscrt::event-loop: id=0x55b812c6a1d0: Stopping event-loop thread. | |
2024-11-19T11:57:56.431358Z DEBUG awscrt::event-loop: id=0x55b812c6a1d0: exiting main loop | |
2024-11-19T11:57:56.431452Z INFO awscrt::event-loop: id=0x55b812c6de50: Destroying event_loop | |
2024-11-19T11:57:56.431456Z INFO awscrt::event-loop: id=0x55b812c6de50: Stopping event-loop thread. | |
2024-11-19T11:57:56.431524Z DEBUG awscrt::event-loop: id=0x55b812c6de50: exiting main loop | |
2024-11-19T11:57:56.431696Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Client body streaming ELG shutdown. | |
2024-11-19T11:57:56.431813Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Moving relevant synced_data into threaded_data. | |
2024-11-19T11:57:56.431836Z DEBUG awscrt::S3Client: id=0x55b812c27c10 s_s3_client_process_work_default - Processing any new meta requests. | |
2024-11-19T11:57:56.431844Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating meta requests. | |
2024-11-19T11:57:56.431885Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Updating connections, assigning requests where possible. | |
2024-11-19T11:57:56.431897Z INFO awscrt::S3ClientStats: id=0x55b812c27c10 Requests-in-flight(approx/exact):0/0 Requests-preparing:0 Requests-queued:0 Requests-network(get/put/default/total):0/0/0/0 Requests-streaming-waiting:0 Requests-streaming-response:0 Endpoints(in-table/allocated):0/0 | |
2024-11-19T11:57:56.431902Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Client shutdown progress: starting_destroy_executing=0 body_streaming_elg_allocated=0 process_work_task_scheduled=0 process_work_task_in_progress=0 num_endpoints_allocated=0 s3express_provider_active=0 finish_destroy=1 | |
2024-11-19T11:57:56.431907Z DEBUG awscrt::S3Client: id=0x55b812c27c10 Client finishing destruction. | |
2024-11-19T11:57:56.432962Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: releasing bootstrap reference | |
2024-11-19T11:57:56.432977Z INFO awscrt::connection-manager: id=0x55b812ca2e60: release | |
2024-11-19T11:57:56.432980Z INFO awscrt::connection-manager: id=0x55b812ca2e60: ref count now zero, starting shut down process | |
2024-11-19T11:57:56.432983Z INFO awscrt::connection-manager: id=0x55b812ca2e60: manager release, failing 0 pending acquisitions | |
2024-11-19T11:57:56.432989Z DEBUG awscrt::connection-manager: id=0x55b812ca2e60: snapshot - state=2, idle_connection_count=0, pending_acquire_count=0, pending_settings_count=0, pending_connect_count=0, vended_connection_count=0, open_connection_count=0, ref_count=0 | |
2024-11-19T11:57:56.432992Z INFO awscrt::connection-manager: id=0x55b812ca2e60: Destroying self | |
2024-11-19T11:57:56.432995Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: releasing bootstrap reference | |
2024-11-19T11:57:56.432998Z DEBUG awscrt::channel-bootstrap: id=0x55b812b38280: bootstrap destroying | |
2024-11-19T11:57:56.433087Z DEBUG awscrt::dns: static: Either no requests have been made for an address for 172.200.202.2 for the duration of the ttl, or this thread is being forcibly shutdown. Killing thread. | |
2024-11-19T11:57:56.433110Z DEBUG awscrt::dns: static: purging address 172.200.202.2 for host 172.200.202.2 from the cache due to cache eviction or shutdown |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment