Skip to content

Instantly share code, notes, and snippets.

Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@TomAugspurger
TomAugspurger / ids.txt
Created October 23, 2023 15:36
Variable query times
S2A_MSIL2A_20210101T000751_R130_T48CWA_20210101T155441
S2A_MSIL2A_20210101T000751_R130_T48CWU_20210605T150149
S2A_MSIL2A_20210101T000751_R130_T50CMC_20210101T155143
S2A_MSIL2A_20210101T000751_R130_T49CDP_20210101T155258
S2A_MSIL2A_20210101T000751_R130_T49CDR_20210101T155234
S2A_MSIL2A_20210101T000751_R130_T49CES_20210101T155247
S2A_MSIL2A_20210101T000751_R130_T48CWV_20210101T155203
S2A_MSIL2A_20210101T000751_R130_T50CMB_20210606T092654
S2A_MSIL2A_20210101T000751_R130_T50CNT_20210101T154951
S2A_MSIL2A_20210101T000751_R130_T49CEP_20210101T155010
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
import dask.dataframe as dd
import adlfs
import geopandas
import dask_geopandas
import pyarrow.fs
import pyproj
import json
import dask.distributed
from typing import Dict, Any, Union, Optional
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
{
"count": 263463,
"keys": {
"type": {
"type": "distinct",
"count_with": 263463,
"count_without": 0,
"values": [
{
"type": "string",
/srv/conda/envs/notebook/lib/python3.10/site-packages/distributed/cli/dask_worker.py:264: FutureWarning: dask-worker is deprecated and will be removed in a future release use `dask worker` instead
warnings.warn(
2023-03-20 15:14:43,852 - distributed.nanny - INFO - Start Nanny at: 'tls://10.244.10.11:33815'
2023-03-20 15:14:46,216 - distributed.worker - INFO - Start worker at: tls://10.244.10.11:46721
2023-03-20 15:14:46,216 - distributed.worker - INFO - Listening to: tls://10.244.10.11:46721
2023-03-20 15:14:46,216 - distributed.worker - INFO - Worker name: dask-worker-351d74e2f7f644beb571a17408e81902-8z6lj
2023-03-20 15:14:46,216 - distributed.worker - INFO - dashboard at: 10.244.10.11:8787
2023-03-20 15:14:46,216 - distributed.worker - INFO - Waiting to connect to: tls://dask-351d74e2f7f644beb571a17408e81902.staging:8786
2023-03-20 15:14:46,216 - distributed.worker - INFO - -------------------------------------------------
2023-03-20 15:14:46,216 - d
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.