Skip to content

Instantly share code, notes, and snippets.

@dvu4

dvu4/filter_file_by_date_with_dbutils.md

Last active June 22, 2023 20:59
Show Gist options
  • Save dvu4/105501828556c71256e3269f4fb576d0 to your computer and use it in GitHub Desktop.
Save dvu4/105501828556c71256e3269f4fb576d0 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
filter_file_by_date_with_dbutils.md

List all files in container ds-tmartch-output in storage account prodfixdseus2tmartchsa01

path = "abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation"
dbutils.fs.ls(path)

The result looks like this

Out[268]: [FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet/', name='customer_extension_canyon_parquet/', size=0, modificationTime=1661827401000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220829_214355.txt', name='customer_extension_canyon_parquet20220829_214355.txt', size=9, modificationTime=1661827446000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220830_113625.txt', name='customer_extension_canyon_parquet20220830_113625.txt', size=9, modificationTime=1661877397000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220831_115140.txt', name='customer_extension_canyon_parquet20220831_115140.txt', size=9, modificationTime=1661964721000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220831_115642.txt', name='customer_extension_canyon_parquet20220831_115642.txt', size=9, modificationTime=1661965017000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220831_153139.txt', name='customer_extension_canyon_parquet20220831_153139.txt', size=9, modificationTime=1661977910000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220831_164334.txt', name='customer_extension_canyon_parquet20220831_164334.txt', size=9, modificationTime=1661982232000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220902_121512.txt', name='customer_extension_canyon_parquet20220902_121512.txt', size=9, modificationTime=1662138926000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220909_155636.txt', name='customer_extension_canyon_parquet20220909_155636.txt', size=9, modificationTime=1662757021000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220909_161250.txt', name='customer_extension_canyon_parquet20220909_161250.txt', size=9, modificationTime=1662757996000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220912_111947.txt', name='customer_extension_canyon_parquet20220912_111947.txt', size=9, modificationTime=1662999611000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220916_121433.txt', name='customer_extension_canyon_parquet20220916_121433.txt', size=9, modificationTime=1663348496000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220923_121436.txt', name='customer_extension_canyon_parquet20220923_121436.txt', size=9, modificationTime=1663953314000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20220930_121635.txt', name='customer_extension_canyon_parquet20220930_121635.txt', size=9, modificationTime=1664558223000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20221007_121039.txt', name='customer_extension_canyon_parquet20221007_121039.txt', size=9, modificationTime=1665162666000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20221014_121338.txt', name='customer_extension_canyon_parquet20221014_121338.txt', size=9, modificationTime=1665767678000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_canyon_parquet20221021_122311.txt', name='customer_extension_canyon_parquet20221021_122311.txt', size=9, modificationTime=1666373041000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet/', name='customer_extension_kona_parquet/', size=0, modificationTime=1661827281000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220829_214158.txt', name='customer_extension_kona_parquet20220829_214158.txt', size=9, modificationTime=1661827332000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220830_113352.txt', name='customer_extension_kona_parquet20220830_113352.txt', size=9, modificationTime=1661877245000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220831_114935.txt', name='customer_extension_kona_parquet20220831_114935.txt', size=9, modificationTime=1661964589000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220831_152348.txt', name='customer_extension_kona_parquet20220831_152348.txt', size=9, modificationTime=1661977442000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220831_153010.txt', name='customer_extension_kona_parquet20220831_153010.txt', size=9, modificationTime=1661977821000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220831_164104.txt', name='customer_extension_kona_parquet20220831_164104.txt', size=9, modificationTime=1661982080000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220902_121254.txt', name='customer_extension_kona_parquet20220902_121254.txt', size=9, modificationTime=1662138792000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220909_155340.txt', name='customer_extension_kona_parquet20220909_155340.txt', size=9, modificationTime=1662756847000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220909_160954.txt', name='customer_extension_kona_parquet20220909_160954.txt', size=9, modificationTime=1662757821000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220912_111655.txt', name='customer_extension_kona_parquet20220912_111655.txt', size=9, modificationTime=1662999441000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220916_121140.txt', name='customer_extension_kona_parquet20220916_121140.txt', size=9, modificationTime=1663348326000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220923_120957.txt', name='customer_extension_kona_parquet20220923_120957.txt', size=9, modificationTime=1663953044000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20220930_121320.txt', name='customer_extension_kona_parquet20220930_121320.txt', size=9, modificationTime=1664558026000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20221007_120716.txt', name='customer_extension_kona_parquet20221007_120716.txt', size=9, modificationTime=1665162466000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20221014_120819.txt', name='customer_extension_kona_parquet20221014_120819.txt', size=9, modificationTime=1665767349000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/customer_extension_kona_parquet20221021_121633.txt', name='customer_extension_kona_parquet20221021_121633.txt', size=9, modificationTime=1666372686000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/diabetes_fy23_q1_audience_holdout.csv', name='diabetes_fy23_q1_audience_holdout.csv', size=39220242, modificationTime=1665107674000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/dig_coupon_acq_model_20221007_154844.csv', name='dig_coupon_acq_model_20221007_154844.csv', size=873850748, modificationTime=1665175777000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet/', name='fos_rx_seg_lookup_table_canyon_parquet/', size=0, modificationTime=1661827442000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220829_214405.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220829_214405.txt', size=3, modificationTime=1661827446000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220830_082409.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220830_082409.txt', size=3, modificationTime=1661865849000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220831_082743.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220831_082743.txt', size=3, modificationTime=1661952463000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220901_082532.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220901_082532.txt', size=3, modificationTime=1662038732000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220902_074119.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220902_074119.txt', size=3, modificationTime=1662122479000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220902_082333.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220902_082333.txt', size=3, modificationTime=1662125014000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220902_110301.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220902_110301.txt', size=3, modificationTime=1662134581000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220902_124553.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220902_124553.txt', size=3, modificationTime=1662140753000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220902_182056.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220902_182056.txt', size=3, modificationTime=1662160856000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220903_082738.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220903_082738.txt', size=3, modificationTime=1662211658000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220903_142427.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220903_142427.txt', size=3, modificationTime=1662233067000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220904_082813.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220904_082813.txt', size=3, modificationTime=1662298094000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220904_120907.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220904_120907.txt', size=3, modificationTime=1662311348000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220905_082755.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220905_082755.txt', size=3, modificationTime=1662384475000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220906_083114.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220906_083114.txt', size=3, modificationTime=1662471075000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220907_082841.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220907_082841.txt', size=3, modificationTime=1662557321000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220909_203954.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220909_203954.txt', size=3, modificationTime=1662773995000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220910_082423.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220910_082423.txt', size=3, modificationTime=1662816264000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220911_082541.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220911_082541.txt', size=3, modificationTime=1662902741000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220912_082919.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220912_082919.txt', size=3, modificationTime=1662989359000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220913_082353.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220913_082353.txt', size=3, modificationTime=1663075433000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220914_082533.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220914_082533.txt', size=3, modificationTime=1663161933000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220915_082457.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220915_082457.txt', size=3, modificationTime=1663248298000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220916_082831.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220916_082831.txt', size=3, modificationTime=1663334911000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220917_082822.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220917_082822.txt', size=3, modificationTime=1663421303000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220918_082917.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220918_082917.txt', size=3, modificationTime=1663507758000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220919_082526.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220919_082526.txt', size=3, modificationTime=1663593926000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220920_082801.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220920_082801.txt', size=3, modificationTime=1663680482000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220921_083254.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220921_083254.txt', size=3, modificationTime=1663767178000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220922_082913.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220922_082913.txt', size=3, modificationTime=1663853355000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220923_082435.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220923_082435.txt', size=3, modificationTime=1663939475000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220924_082844.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220924_082844.txt', size=3, modificationTime=1664026124000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220925_082736.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220925_082736.txt', size=3, modificationTime=1664112456000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220926_082852.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220926_082852.txt', size=3, modificationTime=1664198933000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220927_082456.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220927_082456.txt', size=3, modificationTime=1664285097000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220928_082457.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220928_082457.txt', size=3, modificationTime=1664371497000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220929_083602.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220929_083602.txt', size=3, modificationTime=1664458563000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20220930_082552.txt', name='fos_rx_seg_lookup_table_canyon_parquet20220930_082552.txt', size=3, modificationTime=1664544353000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221001_082756.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221001_082756.txt', size=3, modificationTime=1664630876000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221002_082807.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221002_082807.txt', size=3, modificationTime=1664717287000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221003_082837.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221003_082837.txt', size=3, modificationTime=1664803717000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221004_082902.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221004_082902.txt', size=3, modificationTime=1664890143000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221005_082526.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221005_082526.txt', size=3, modificationTime=1664976327000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221006_083213.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221006_083213.txt', size=3, modificationTime=1665063137000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221007_082632.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221007_082632.txt', size=3, modificationTime=1665149195000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221008_082805.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221008_082805.txt', size=3, modificationTime=1665235685000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221009_082827.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221009_082827.txt', size=3, modificationTime=1665322108000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221010_082747.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221010_082747.txt', size=3, modificationTime=1665408467000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221011_082945.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221011_082945.txt', size=3, modificationTime=1665494987000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221012_082818.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221012_082818.txt', size=3, modificationTime=1665581298000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221013_082814.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221013_082814.txt', size=3, modificationTime=1665667694000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221014_082521.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221014_082521.txt', size=3, modificationTime=1665753922000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221015_082717.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221015_082717.txt', size=3, modificationTime=1665840437000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221016_082729.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221016_082729.txt', size=3, modificationTime=1665926850000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221017_082742.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221017_082742.txt', size=3, modificationTime=1666013263000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221018_082358.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221018_082358.txt', size=3, modificationTime=1666099439000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221019_082718.txt', name='fos_rx_seg_lookup_table_canyon_parquet20221019_082718.txt', size=3, modificationTime=1666186038000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/fos_rx_seg_lookup_table_canyon_parquet20221020_082825.txt', name='fos_rx_seg_looku

*** WARNING: max output size exceeded, skipping output. ***

martch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230126_131411.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230126_131411.csv', size=276453047, modificationTime=1674760550000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230126_131411.ok', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230126_131411.ok', size=7, modificationTime=1674760560000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230221_154428.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230221_154428.csv', size=252462531, modificationTime=1677015989000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230222_193604.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230222_193604.csv', size=250989547, modificationTime=1677116296000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230303_093844.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230303_093844.csv', size=246535460, modificationTime=1677858075000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230303_093844.ok', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230303_093844.ok', size=7, modificationTime=1677858105000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230320_221855.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230320_221855.csv', size=239894227, modificationTime=1679368824000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230331_140525.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230331_140525.csv', size=236979012, modificationTime=1680289621000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230425_161918.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230425_161918.csv', size=74, modificationTime=1682457593000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230426_002910.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230426_002910.csv', size=227910927, modificationTime=1682487048000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230519_165050.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230519_165050.csv', size=222154745, modificationTime=1684533156000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230616_162434.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230616_162434.csv', size=214375205, modificationTime=1686950789000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230621_160431.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230621_160431.csv', size=213321612, modificationTime=1687381567000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230622_150824.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_20230622_150824.csv', size=213116173, modificationTime=1687464625000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_20230126_131411.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_20230126_131411.csv', size=36746407, modificationTime=1674760642000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_20230126_131411.ok', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_20230126_131411.ok', size=7, modificationTime=1674760658000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_20230303_093844.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_20230303_093844.csv', size=34079843, modificationTime=1677858196000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_20230303_093844.ok', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_20230303_093844.ok', size=7, modificationTime=1677858223000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_nonemailable_20230126_131411.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_nonemailable_20230126_131411.csv', size=19538825, modificationTime=1674760731000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_nonemailable_20230126_131411.ok', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_nonemailable_20230126_131411.ok', size=6, modificationTime=1674760744000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_nonemailable_20230303_093844.csv', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_nonemailable_20230303_093844.csv', size=18288383, modificationTime=1677858310000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_nonemailable_20230303_093844.ok', name='rx_lifecycle_fy23_acquisition_A29_imm_norx_mw_nonemailable_20230303_093844.ok', size=6, modificationTime=1677858334000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecyle_fy23_do_not_give_offer_audience.csv', name='rx_lifecyle_fy23_do_not_give_offer_audience.csv', size=472002446, modificationTime=1666383675000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet/', name='rx_models_canyon_parquet/', size=0, modificationTime=1661827536000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20220829_214552.txt', name='rx_models_canyon_parquet20220829_214552.txt', size=9, modificationTime=1661827564000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20220830_113852.txt', name='rx_models_canyon_parquet20220830_113852.txt', size=9, modificationTime=1661877545000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20220831_115905.txt', name='rx_models_canyon_parquet20220831_115905.txt', size=9, modificationTime=1661965157000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20220831_153329.txt', name='rx_models_canyon_parquet20220831_153329.txt', size=9, modificationTime=1661978019000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20220831_164623.txt', name='rx_models_canyon_parquet20220831_164623.txt', size=9, modificationTime=1661982396000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20220902_121744.txt', name='rx_models_canyon_parquet20220902_121744.txt', size=9, modificationTime=1662139077000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20220909_160018.txt', name='rx_models_canyon_parquet20220909_160018.txt', size=9, modificationTime=1662757242000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20220909_161727.txt', name='rx_models_canyon_parquet20220909_161727.txt', size=9, modificationTime=1662758276000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20220912_112325.txt', name='rx_models_canyon_parquet20220912_112325.txt', size=9, modificationTime=1662999827000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20220916_121814.txt', name='rx_models_canyon_parquet20220916_121814.txt', size=9, modificationTime=1663348730000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20220923_122059.txt', name='rx_models_canyon_parquet20220923_122059.txt', size=9, modificationTime=1663953705000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20220930_122020.txt', name='rx_models_canyon_parquet20220930_122020.txt', size=9, modificationTime=1664558443000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20221007_121446.txt', name='rx_models_canyon_parquet20221007_121446.txt', size=9, modificationTime=1665162922000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20221014_122330.txt', name='rx_models_canyon_parquet20221014_122330.txt', size=9, modificationTime=1665768349000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_models_canyon_parquet20221021_122941.txt', name='rx_models_canyon_parquet20221021_122941.txt', size=9, modificationTime=1666373417000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet/', name='rx_seg_table_canyon_parquet/', size=0, modificationTime=1661827212000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220829_214013.txt', name='rx_seg_table_canyon_parquet20220829_214013.txt', size=8, modificationTime=1661827214000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220829_220046.txt', name='rx_seg_table_canyon_parquet20220829_220046.txt', size=8, modificationTime=1661828446000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220830_070941.txt', name='rx_seg_table_canyon_parquet20220830_070941.txt', size=8, modificationTime=1661861382000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220831_070925.txt', name='rx_seg_table_canyon_parquet20220831_070925.txt', size=8, modificationTime=1661947766000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220901_071316.txt', name='rx_seg_table_canyon_parquet20220901_071316.txt', size=8, modificationTime=1662034403000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220901_174403.txt', name='rx_seg_table_canyon_parquet20220901_174403.txt', size=9, modificationTime=1662072244000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220902_071127.txt', name='rx_seg_table_canyon_parquet20220902_071127.txt', size=9, modificationTime=1662120687000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220903_071641.txt', name='rx_seg_table_canyon_parquet20220903_071641.txt', size=9, modificationTime=1662207401000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220903_114214.txt', name='rx_seg_table_canyon_parquet20220903_114214.txt', size=9, modificationTime=1662223335000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220904_071151.txt', name='rx_seg_table_canyon_parquet20220904_071151.txt', size=9, modificationTime=1662293512000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220905_072048.txt', name='rx_seg_table_canyon_parquet20220905_072048.txt', size=9, modificationTime=1662380449000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220906_071406.txt', name='rx_seg_table_canyon_parquet20220906_071406.txt', size=9, modificationTime=1662466447000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220907_071506.txt', name='rx_seg_table_canyon_parquet20220907_071506.txt', size=9, modificationTime=1662552906000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220907_101037.txt', name='rx_seg_table_canyon_parquet20220907_101037.txt', size=8, modificationTime=1662563438000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220908_065737.txt', name='rx_seg_table_canyon_parquet20220908_065737.txt', size=8, modificationTime=1662638266000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220908_124925.txt', name='rx_seg_table_canyon_parquet20220908_124925.txt', size=8, modificationTime=1662659366000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220908_222441.txt', name='rx_seg_table_canyon_parquet20220908_222441.txt', size=8, modificationTime=1662693884000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220909_071651.txt', name='rx_seg_table_canyon_parquet20220909_071651.txt', size=8, modificationTime=1662725817000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220909_162051.txt', name='rx_seg_table_canyon_parquet20220909_162051.txt', size=8, modificationTime=1662758452000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220909_204136.txt', name='rx_seg_table_canyon_parquet20220909_204136.txt', size=8, modificationTime=1662774097000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220910_070456.txt', name='rx_seg_table_canyon_parquet20220910_070456.txt', size=8, modificationTime=1662811501000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220911_070952.txt', name='rx_seg_table_canyon_parquet20220911_070952.txt', size=8, modificationTime=1662898194000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220912_070949.txt', name='rx_seg_table_canyon_parquet20220912_070949.txt', size=8, modificationTime=1662984599000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220913_070956.txt', name='rx_seg_table_canyon_parquet20220913_070956.txt', size=8, modificationTime=1663070998000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220914_070422.txt', name='rx_seg_table_canyon_parquet20220914_070422.txt', size=8, modificationTime=1663157070000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220915_070819.txt', name='rx_seg_table_canyon_parquet20220915_070819.txt', size=8, modificationTime=1663243709000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220916_071103.txt', name='rx_seg_table_canyon_parquet20220916_071103.txt', size=8, modificationTime=1663330287000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220917_070546.txt', name='rx_seg_table_canyon_parquet20220917_070546.txt', size=8, modificationTime=1663416347000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220918_065811.txt', name='rx_seg_table_canyon_parquet20220918_065811.txt', size=8, modificationTime=1663502293000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220919_070040.txt', name='rx_seg_table_canyon_parquet20220919_070040.txt', size=8, modificationTime=1663588841000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220920_071128.txt', name='rx_seg_table_canyon_parquet20220920_071128.txt', size=8, modificationTime=1663675892000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220921_071027.txt', name='rx_seg_table_canyon_parquet20220921_071027.txt', size=8, modificationTime=1663762260000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220922_071134.txt', name='rx_seg_table_canyon_parquet20220922_071134.txt', size=8, modificationTime=1663848709000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220923_065810.txt', name='rx_seg_table_canyon_parquet20220923_065810.txt', size=8, modificationTime=1663934291000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220924_070910.txt', name='rx_seg_table_canyon_parquet20220924_070910.txt', size=8, modificationTime=1664021356000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220925_070947.txt', name='rx_seg_table_canyon_parquet20220925_070947.txt', size=8, modificationTime=1664107789000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220926_070934.txt', name='rx_seg_table_canyon_parquet20220926_070934.txt', size=8, modificationTime=1664194181000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220927_070442.txt', name='rx_seg_table_canyon_parquet20220927_070442.txt', size=8, modificationTime=1664280287000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220928_070455.txt', name='rx_seg_table_canyon_parquet20220928_070455.txt', size=8, modificationTime=1664366695000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220929_071104.txt', name='rx_seg_table_canyon_parquet20220929_071104.txt', size=8, modificationTime=1664453482000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20220930_070738.txt', name='rx_seg_table_canyon_parquet20220930_070738.txt', size=8, modificationTime=1664539674000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221001_070222.txt', name='rx_seg_table_canyon_parquet20221001_070222.txt', size=8, modificationTime=1664625767000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221002_070040.txt', name='rx_seg_table_canyon_parquet20221002_070040.txt', size=8, modificationTime=1664712044000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221003_070300.txt', name='rx_seg_table_canyon_parquet20221003_070300.txt', size=8, modificationTime=1664798581000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221004_070922.txt', name='rx_seg_table_canyon_parquet20221004_070922.txt', size=8, modificationTime=1664885366000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221005_070507.txt', name='rx_seg_table_canyon_parquet20221005_070507.txt', size=8, modificationTime=1664971512000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221006_071258.txt', name='rx_seg_table_canyon_parquet20221006_071258.txt', size=8, modificationTime=1665058386000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221007_070156.txt', name='rx_seg_table_canyon_parquet20221007_070156.txt', size=8, modificationTime=1665144117000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221008_070302.txt', name='rx_seg_table_canyon_parquet20221008_070302.txt', size=8, modificationTime=1665230591000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221009_070407.txt', name='rx_seg_table_canyon_parquet20221009_070407.txt', size=8, modificationTime=1665317051000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221010_070528.txt', name='rx_seg_table_canyon_parquet20221010_070528.txt', size=8, modificationTime=1665403529000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221011_070747.txt', name='rx_seg_table_canyon_parquet20221011_070747.txt', size=8, modificationTime=1665490104000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221022_070323.txt', name='rx_seg_table_canyon_parquet20221022_070323.txt', size=8, modificationTime=1666440214000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221023_065945.txt', name='rx_seg_table_canyon_parquet20221023_065945.txt', size=8, modificationTime=1666526393000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_seg_table_canyon_parquet20221024_065953.txt', name='rx_seg_table_canyon_parquet20221024_065953.txt', size=8, modificationTime=1666612803000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/store_seg_table_canyon_parquet/', name='store_seg_table_canyon_parquet/', size=0, modificationTime=1666805990000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/store_seg_table_canyon_parquet20221026_123951.txt', name='store_seg_table_canyon_parquet20221026_123951.txt', size=1, modificationTime=1666805992000),
 FileInfo(path='abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/workarounds_202210/', name='workarounds_202210/', size=0, modificationTime=1664719424000)]

We can create a function to filter all csv files that contains a string param and created date of the file is equal to date

The created date of file in dbutls.fs is field modificationTime, so we can convert it to datetime format, then filter the date

import time

def filter_csv_file_by_date(path, param, date):
    list_of_files = dbutils.fs.ls(path)
    list_of_files = [
        (file.path,  time.strftime("%Y-%m-%d", time.localtime(file.modificationTime/ 1000))) for file in list_of_files 
        if param in file.name and file.name.endswith("csv")
    ] #"%Y-%m-%d %H:%M:%S"

    # lastest_file = max(list_of_files, key=lambda x: x[1])
    # list_of_files.sort(key = lambda x: x[1])
    # list_of_files = sorted(list_of_files, key = lambda x: x[1])
    list_of_files = list(map(lambda x: x, filter(lambda x: x[1] == date , list_of_files)))
    return list_of_files

Let's choose file created on 2023-06-21

rx_acquisition_list = filter_csv_file_by_date(path, "rx_lifecycle_fy23_acquisition_A", "2023-06-21")
rx_acquisition_list

The output:

Out[267]: [('abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A23_rx_react_20230621_155854.csv',
  '2023-06-21'),
 ('abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A25_my_rx_acq_eps_20230621_160105.csv',
  '2023-06-21'),
 ('abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A27_new2rtl_20230621_160233.csv',
  '2023-06-21'),
 ('abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230621_160431.csv',
  '2023-06-21')]

Let's choose file created on 2023-06-22

rx_acquisition_list = filter_csv_file_by_date(path, "rx_lifecycle_fy23_acquisition_A", "2023-06-22") 
rx_acquisition_list

The output:

Out[269]: [('abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A23_rx_react_20230622_150132.csv',
  '2023-06-22'),
 ('abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A25_my_rx_acq_eps_20230622_150348.csv',
  '2023-06-22'),
 ('abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A27_new2rtl_20230622_150530.csv',
  '2023-06-22'),
 ('abfss://ds-tmartch-output@prodfixdseus2tmartchsa01.dfs.core.windows.net/acc-activation/rx_lifecycle_fy23_acquisition_A29_imm_norx_20230622_150824.csv',
  '2023-06-22')]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment