Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import os | |
| import io | |
| import pandas | |
| from zipfile import ZipFile | |
| convs={'WheelsOff': str, 'WheelsOn': str, 'CancellationCode': str, 'Div1Airport': str, 'Div1TailNum': str, 'Div2Airport': str, 'Div2TailNum': str, 'Div3Airport': str} | |
| files = os.listdir("/var/data/csv") | |
| for file in files: |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| 005_10 | |
| sys:1: DtypeWarning: Columns (37) have mixed types.Specify dtype option on import or set low_memory=False. | |
| Traceback (most recent call last): | |
| File "<stdin>", line 8, in <module> | |
| File "/usr/local/anaconda3/envs/to-arrow/lib/python3.7/site-packages/pandas/util/_decorators.py", line 199, in wrapper | |
| return func(*args, **kwargs) | |
| File "/usr/local/anaconda3/envs/to-arrow/lib/python3.7/site-packages/pandas/core/frame.py", line 2463, in to_parquet | |
| **kwargs, | |
| File "/usr/local/anaconda3/envs/to-arrow/lib/python3.7/site-packages/pandas/io/parquet.py", line 397, in to_parquet | |
| **kwargs, |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import os | |
| import pandas | |
| from zipfile import ZipFile | |
| files = os.listdir("/var/data/csv") | |
| for file in files: | |
| if file[-4:] == '.zip': | |
| yyyy_mm = file[-10:-4] | |
| print(yyyy_mm) |