Skip to content

Instantly share code, notes, and snippets.

@agiudiceandrea

agiudiceandrea/parquet_test.txt Secret

Created August 1, 2022 09:05
Show Gist options
  • Star 0 You must be signed in to star a gist
  • Fork 0 You must be signed in to fork a gist
  • Save agiudiceandrea/87baa9e4c60ff5e4f3e1a1da6f31802b to your computer and use it in GitHub Desktop.
Save agiudiceandrea/87baa9e4c60ff5e4f3e1a1da6f31802b to your computer and use it in GitHub Desktop.
Download ZIP
Raw
parquet_test.txt
C:\OSGeo4W_V2_4>type run.bat
set CPL_DEBUG=ON
ogrinfo -so test.parquet test
for %%c in (SNAPPY GZIP ZSTD BROTLI) do (
if exist out_%%c.parquet del out_%%c.parquet
ogr2ogr -lco COMPRESSION=%%c out_%%c.parquet test.parquet
ogrinfo -fid 0 out_%%c.parquet out_%%c
)
dir *.parquet
C:\OSGeo4W_V2_4>run.bat
C:\OSGeo4W_V2_4>set CPL_DEBUG=ON
C:\OSGeo4W_V2_4>ogrinfo -so test.parquet test
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_ECW_JP2ECW.dll using GDALRegister_ECW_JP2ECW.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_GEOR.dll using GDALRegister_GEOR.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_HDF5.dll using GDALRegister_HDF5.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_MrSID.dll using GDALRegister_MrSID.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_TileDB.dll using GDALRegister_TileDB.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_OCI.dll using RegisterOGROCI.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_SOSI.dll using RegisterOGRSOSI.
PARQUET: geo = {"version": "0.1.0", "primary_column": "geometry", "columns": {"geometry": {"crs": "GEOGCRS[\"WGS 84\",ENSEMBLE[\"World Geodetic System 1984 ensemble\",MEMBER[\"World Geodetic System 1984 (Transit)\"],MEMBER[\"World Geodetic System 1984 (G730)\"],MEMBER[\"World Geodetic System 1984 (G873)\"],MEMBER[\"World Geodetic System 1984 (G1150)\"],MEMBER[\"World Geodetic System 1984 (G1674)\"],MEMBER[\"World Geodetic System 1984 (G1762)\"],MEMBER[\"World Geodetic System 1984 (G2139)\"],ELLIPSOID[\"WGS 84\",6378137,298.257223563],ENSEMBLEACCURACY[2.0]],CS[ellipsoidal,2],AXIS[\"geodetic latitude (Lat)\",north],AXIS[\"geodetic longitude (Lon)\",east],UNIT[\"degree\",0.0174532925199433],USAGE[SCOPE[\"Horizontal component of 3D system.\"],AREA[\"World.\"],BBOX[-90,-180,90,180]],ID[\"EPSG\",4326]]", "bbox": [0, 2, 4, 2], "encoding": "WKB"}}}
GDAL: GDALOpen(test.parquet, this=000001DBDEA66350) succeeds as Parquet.
INFO: Open of `test.parquet'
using driver `Parquet' successful.
Layer name: test
Geometry: Point
Feature Count: 5
Extent: (0.000000, 2.000000) - (4.000000, 2.000000)
Layer SRS WKT:
GEOGCRS["WGS 84",
ENSEMBLE["World Geodetic System 1984 ensemble",
MEMBER["World Geodetic System 1984 (Transit)"],
MEMBER["World Geodetic System 1984 (G730)"],
MEMBER["World Geodetic System 1984 (G873)"],
MEMBER["World Geodetic System 1984 (G1150)"],
MEMBER["World Geodetic System 1984 (G1674)"],
MEMBER["World Geodetic System 1984 (G1762)"],
MEMBER["World Geodetic System 1984 (G2139)"],
ELLIPSOID["WGS 84",6378137,298.257223563,
LENGTHUNIT["metre",1]],
ENSEMBLEACCURACY[2.0]],
PRIMEM["Greenwich",0,
ANGLEUNIT["degree",0.0174532925199433]],
CS[ellipsoidal,2],
AXIS["geodetic latitude (Lat)",north,
ORDER[1],
ANGLEUNIT["degree",0.0174532925199433]],
AXIS["geodetic longitude (Lon)",east,
ORDER[2],
ANGLEUNIT["degree",0.0174532925199433]],
USAGE[
SCOPE["Horizontal component of 3D system."],
AREA["World."],
BBOX[-90,-180,90,180]],
ID["EPSG",4326]]
Data axis to CRS axis mapping: 2,1
Geometry Column = geometry
boolean: Integer(Boolean) (0.0)
uint8: Integer (0.0)
int8: Integer (0.0)
uint16: Integer (0.0)
int16: Integer(Int16) (0.0)
uint32: Integer64 (0.0)
int32: Integer (0.0)
uint64: Real (0.0)
int64: Integer64 (0.0)
float32: Real(Float32) (0.0)
float64: Real (0.0)
string: String (0.0)
large_string: String (0.0)
timestamp_ms_gmt: DateTime (0.0)
timestamp_ms_gmt_plus_2: DateTime (0.0)
timestamp_ms_gmt_minus_0215: DateTime (0.0)
timestamp_s_no_tz: DateTime (0.0)
time32_s: Time (0.0)
time32_ms: Time (0.0)
time64_us: Integer64 (0.0)
time64_ns: Integer64 (0.0)
date32: Date (0.0)
date64: Date (0.0)
binary: Binary (0.0)
large_binary: Binary (0.0)
fixed_size_binary: Binary (2.0)
decimal128: Real (7.3)
decimal256: Real (7.3)
list_boolean: IntegerList(Boolean) (0.0)
list_uint8: IntegerList (0.0)
list_int8: IntegerList (0.0)
list_uint16: IntegerList (0.0)
list_int16: IntegerList (0.0)
list_uint32: Integer64List (0.0)
list_int32: IntegerList (0.0)
list_uint64: RealList (0.0)
list_int64: Integer64List (0.0)
list_float32: RealList(Float32) (0.0)
list_float64: RealList (0.0)
list_string: StringList (0.0)
fixed_size_list_boolean: IntegerList(Boolean) (0.0)
fixed_size_list_uint8: IntegerList (0.0)
fixed_size_list_int8: IntegerList (0.0)
fixed_size_list_uint16: IntegerList (0.0)
fixed_size_list_int16: IntegerList (0.0)
fixed_size_list_uint32: Integer64List (0.0)
fixed_size_list_int32: IntegerList (0.0)
fixed_size_list_uint64: RealList (0.0)
fixed_size_list_int64: Integer64List (0.0)
fixed_size_list_float32: RealList(Float32) (0.0)
fixed_size_list_float64: RealList (0.0)
fixed_size_list_string: StringList (0.0)
struct_field.a: Integer64 (0.0)
struct_field.b: Real (0.0)
struct_field.c.d: String (0.0)
struct_field.c.f: String (0.0)
struct_field.h: Integer64List (0.0)
struct_field.i: Integer64 (0.0)
map_boolean: String(JSON) (0.0)
map_uint8: String(JSON) (0.0)
map_int8: String(JSON) (0.0)
map_uint16: String(JSON) (0.0)
map_int16: String(JSON) (0.0)
map_uint32: String(JSON) (0.0)
map_int32: String(JSON) (0.0)
map_uint64: String(JSON) (0.0)
map_int64: String(JSON) (0.0)
map_float32: String(JSON) (0.0)
map_float64: String(JSON) (0.0)
map_string: String(JSON) (0.0)
dict: Integer (0.0), domain name=dictDomain
ARROW: Memory pool: bytes_allocated = 0
ARROW: Memory pool: max_memory = 640
GDAL: GDALClose(test.parquet, this=000001DBDEA66350)
GDAL: In GDALDestroy - unloading GDAL shared library.
C:\OSGeo4W_V2_4>for %c in (SNAPPY GZIP ZSTD BROTLI) do (
if exist out_%c.parquet del out_%c.parquet
ogr2ogr -lco COMPRESSION=%c out_%c.parquet test.parquet
ogrinfo -fid 0 out_%c.parquet out_%c
)
C:\OSGeo4W_V2_4>(
if exist out_SNAPPY.parquet del out_SNAPPY.parquet
ogr2ogr -lco COMPRESSION=SNAPPY out_SNAPPY.parquet test.parquet
ogrinfo -fid 0 out_SNAPPY.parquet out_SNAPPY
)
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_ECW_JP2ECW.dll using GDALRegister_ECW_JP2ECW.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_GEOR.dll using GDALRegister_GEOR.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_HDF5.dll using GDALRegister_HDF5.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_MrSID.dll using GDALRegister_MrSID.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_TileDB.dll using GDALRegister_TileDB.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_OCI.dll using RegisterOGROCI.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_SOSI.dll using RegisterOGRSOSI.
PARQUET: geo = {"version": "0.1.0", "primary_column": "geometry", "columns": {"geometry": {"crs": "GEOGCRS[\"WGS 84\",ENSEMBLE[\"World Geodetic System 1984 ensemble\",MEMBER[\"World Geodetic System 1984 (Transit)\"],MEMBER[\"World Geodetic System 1984 (G730)\"],MEMBER[\"World Geodetic System 1984 (G873)\"],MEMBER[\"World Geodetic System 1984 (G1150)\"],MEMBER[\"World Geodetic System 1984 (G1674)\"],MEMBER[\"World Geodetic System 1984 (G1762)\"],MEMBER[\"World Geodetic System 1984 (G2139)\"],ELLIPSOID[\"WGS 84\",6378137,298.257223563],ENSEMBLEACCURACY[2.0]],CS[ellipsoidal,2],AXIS[\"geodetic latitude (Lat)\",north],AXIS[\"geodetic longitude (Lon)\",east],UNIT[\"degree\",0.0174532925199433],USAGE[SCOPE[\"Horizontal component of 3D system.\"],AREA[\"World.\"],BBOX[-90,-180,90,180]],ID[\"EPSG\",4326]]", "bbox": [0, 2, 4, 2], "encoding": "WKB"}}}
GDAL: GDALOpen(test.parquet, this=00000154D0BB5D50) succeeds as Parquet.
GDAL: Using Parquet driver
GDAL: GDALDriver::Create(Parquet,out_SNAPPY.parquet,0,0,0,Unknown,0000000000000000)
GDALVectorTranslate: 5 features written in layer 'test'
ARROW: Memory pool: bytes_allocated = 14144
ARROW: Memory pool: max_memory = 35584
GDAL: GDALClose(test.parquet, this=00000154D0BB5D50)
ARROW: Memory pool (writer layer): bytes_allocated = 128
ARROW: Memory pool (writer layer): max_memory = 36160
GDAL: GDALClose(out_SNAPPY.parquet, this=00000154D3596520)
GDAL: In GDALDestroy - unloading GDAL shared library.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_ECW_JP2ECW.dll using GDALRegister_ECW_JP2ECW.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_GEOR.dll using GDALRegister_GEOR.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_HDF5.dll using GDALRegister_HDF5.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_MrSID.dll using GDALRegister_MrSID.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_TileDB.dll using GDALRegister_TileDB.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_OCI.dll using RegisterOGROCI.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_SOSI.dll using RegisterOGRSOSI.
PARQUET: geo = {"version":"0.4.0","primary_column":"geometry","columns":{"geometry":{"encoding":"WKB","bbox":[0.0,2.0,4.0,2.0],"orientation":"counterclockwise","geometry_type":"Point"}}}
PARQUET: gdal:schema = {"columns":{"boolean":{"type":"Integer","subtype":"Boolean"},"uint8":{"type":"Integer"},"int8":{"type":"Integer"},"uint16":{"type":"Integer"},"int16":{"type":"Integer","subtype":"Int16"},"uint32":{"type":"Integer64"},"int32":{"type":"Integer"},"uint64":{"type":"Real"},"int64":{"type":"Integer64"},"float32":{"type":"Real","subtype":"Float32"},"float64":{"type":"Real"},"string":{"type":"String"},"large_string":{"type":"String"},"timestamp_ms_gmt":{"type":"DateTime"},"timestamp_ms_gmt_plus_2":{"type":"DateTime"},"timestamp_ms_gmt_minus_0215":{"type":"DateTime"},"timestamp_s_no_tz":{"type":"DateTime"},"time32_s":{"type":"Time"},"time32_ms":{"type":"Time"},"time64_us":{"type":"Integer64"},"time64_ns":{"type":"Integer64"},"date32":{"type":"Date"},"date64":{"type":"Date"},"binary":{"type":"Binary"},"large_binary":{"type":"Binary"},"fixed_size_binary":{"type":"Binary","width":2},"decimal128":{"type":"Real","width":7,"precision":3},"decimal256":{"type":"Real","width":7,"precision":3},"list_boolean":{"type":"IntegerList","subtype":"Boolean"},"list_uint8":{"type":"IntegerList"},"list_int8":{"type":"IntegerList"},"list_uint16":{"type":"IntegerList"},"list_int16":{"type":"IntegerList"},"list_uint32":{"type":"Integer64List"},"list_int32":{"type":"IntegerList"},"list_uint64":{"type":"RealList"},"list_int64":{"type":"Integer64List"},"list_float32":{"type":"RealList","subtype":"Float32"},"list_float64":{"type":"RealList"},"list_string":{"type":"StringList"},"fixed_size_list_boolean":{"type":"IntegerList","subtype":"Boolean"},"fixed_size_list_uint8":{"type":"IntegerList"},"fixed_size_list_int8":{"type":"IntegerList"},"fixed_size_list_uint16":{"type":"IntegerList"},"fixed_size_list_int16":{"type":"IntegerList"},"fixed_size_list_uint32":{"type":"Integer64List"},"fixed_size_list_int32":{"type":"IntegerList"},"fixed_size_list_uint64":{"type":"RealList"},"fixed_size_list_int64":{"type":"Integer64List"},"fixed_size_list_float32":{"type":"RealList","subtype":"Float32"},"fixed_size_list_float64":{"type":"RealList"},"fixed_size_list_string":{"type":"StringList"},"struct_field.a":{"type":"Integer64"},"struct_field.b":{"type":"Real"},"struct_field.c.d":{"type":"String"},"struct_field.c.f":{"type":"String"},"struct_field.h":{"type":"Integer64List"},"struct_field.i":{"type":"Integer64"},"map_boolean":{"type":"String","subtype":"JSON"},"map_uint8":{"type":"String","subtype":"JSON"},"map_int8":{"type":"String","subtype":"JSON"},"map_uint16":{"type":"String","subtype":"JSON"},"map_int16":{"type":"String","subtype":"JSON"},"map_uint32":{"type":"String","subtype":"JSON"},"map_int32":{"type":"String","subtype":"JSON"},"map_uint64":{"type":"String","subtype":"JSON"},"map_int64":{"type":"String","subtype":"JSON"},"map_float32":{"type":"String","subtype":"JSON"},"map_float64":{"type":"String","subtype":"JSON"},"map_string":{"type":"String","subtype":"JSON"},"dict":{"type":"Integer"}}}
GDAL: GDALOpen(out_SNAPPY.parquet, this=000001D3B5FE9A20) succeeds as Parquet.
INFO: Open of `out_SNAPPY.parquet'
using driver `Parquet' successful.
Layer name: out_SNAPPY
Geometry: Point
Feature Count: 5
Extent: (0.000000, 2.000000) - (4.000000, 2.000000)
Layer SRS WKT:
GEOGCRS["WGS 84",
ENSEMBLE["World Geodetic System 1984 ensemble",
MEMBER["World Geodetic System 1984 (Transit)"],
MEMBER["World Geodetic System 1984 (G730)"],
MEMBER["World Geodetic System 1984 (G873)"],
MEMBER["World Geodetic System 1984 (G1150)"],
MEMBER["World Geodetic System 1984 (G1674)"],
MEMBER["World Geodetic System 1984 (G1762)"],
MEMBER["World Geodetic System 1984 (G2139)"],
ELLIPSOID["WGS 84",6378137,298.257223563,
LENGTHUNIT["metre",1]],
ENSEMBLEACCURACY[2.0]],
PRIMEM["Greenwich",0,
ANGLEUNIT["degree",0.0174532925199433]],
CS[ellipsoidal,2],
AXIS["geodetic latitude (Lat)",north,
ORDER[1],
ANGLEUNIT["degree",0.0174532925199433]],
AXIS["geodetic longitude (Lon)",east,
ORDER[2],
ANGLEUNIT["degree",0.0174532925199433]],
USAGE[
SCOPE["Horizontal component of 3D system."],
AREA["World."],
BBOX[-90,-180,90,180]],
ID["EPSG",4326]]
Data axis to CRS axis mapping: 2,1
Geometry Column = geometry
boolean: Integer(Boolean) (0.0)
uint8: Integer (0.0)
int8: Integer (0.0)
uint16: Integer (0.0)
int16: Integer(Int16) (0.0)
uint32: Integer64 (0.0)
int32: Integer (0.0)
uint64: Real (0.0)
int64: Integer64 (0.0)
float32: Real(Float32) (0.0)
float64: Real (0.0)
string: String (0.0)
large_string: String (0.0)
timestamp_ms_gmt: DateTime (0.0)
timestamp_ms_gmt_plus_2: DateTime (0.0)
timestamp_ms_gmt_minus_0215: DateTime (0.0)
timestamp_s_no_tz: DateTime (0.0)
time32_s: Time (0.0)
time32_ms: Time (0.0)
time64_us: Integer64 (0.0)
time64_ns: Integer64 (0.0)
date32: Date (0.0)
date64: Date (0.0)
binary: Binary (0.0)
large_binary: Binary (0.0)
fixed_size_binary: Binary (2.0)
decimal128: Real (7.3)
decimal256: Real (7.3)
list_boolean: IntegerList(Boolean) (0.0)
list_uint8: IntegerList (0.0)
list_int8: IntegerList (0.0)
list_uint16: IntegerList (0.0)
list_int16: IntegerList (0.0)
list_uint32: Integer64List (0.0)
list_int32: IntegerList (0.0)
list_uint64: RealList (0.0)
list_int64: Integer64List (0.0)
list_float32: RealList(Float32) (0.0)
list_float64: RealList (0.0)
list_string: StringList (0.0)
fixed_size_list_boolean: IntegerList(Boolean) (0.0)
fixed_size_list_uint8: IntegerList (0.0)
fixed_size_list_int8: IntegerList (0.0)
fixed_size_list_uint16: IntegerList (0.0)
fixed_size_list_int16: IntegerList (0.0)
fixed_size_list_uint32: Integer64List (0.0)
fixed_size_list_int32: IntegerList (0.0)
fixed_size_list_uint64: RealList (0.0)
fixed_size_list_int64: Integer64List (0.0)
fixed_size_list_float32: RealList(Float32) (0.0)
fixed_size_list_float64: RealList (0.0)
fixed_size_list_string: StringList (0.0)
struct_field.a: Integer64 (0.0)
struct_field.b: Real (0.0)
struct_field.c.d: String (0.0)
struct_field.c.f: String (0.0)
struct_field.h: Integer64List (0.0)
struct_field.i: Integer64 (0.0)
map_boolean: String(JSON) (0.0)
map_uint8: String(JSON) (0.0)
map_int8: String(JSON) (0.0)
map_uint16: String(JSON) (0.0)
map_int16: String(JSON) (0.0)
map_uint32: String(JSON) (0.0)
map_int32: String(JSON) (0.0)
map_uint64: String(JSON) (0.0)
map_int64: String(JSON) (0.0)
map_float32: String(JSON) (0.0)
map_float64: String(JSON) (0.0)
map_string: String(JSON) (0.0)
dict: Integer (0.0), domain name=dictDomain
C:\OSGeo4W_V2_4>(
if exist out_GZIP.parquet del out_GZIP.parquet
ogr2ogr -lco COMPRESSION=GZIP out_GZIP.parquet test.parquet
ogrinfo -fid 0 out_GZIP.parquet out_GZIP
)
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_ECW_JP2ECW.dll using GDALRegister_ECW_JP2ECW.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_GEOR.dll using GDALRegister_GEOR.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_HDF5.dll using GDALRegister_HDF5.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_MrSID.dll using GDALRegister_MrSID.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_TileDB.dll using GDALRegister_TileDB.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_OCI.dll using RegisterOGROCI.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_SOSI.dll using RegisterOGRSOSI.
PARQUET: geo = {"version": "0.1.0", "primary_column": "geometry", "columns": {"geometry": {"crs": "GEOGCRS[\"WGS 84\",ENSEMBLE[\"World Geodetic System 1984 ensemble\",MEMBER[\"World Geodetic System 1984 (Transit)\"],MEMBER[\"World Geodetic System 1984 (G730)\"],MEMBER[\"World Geodetic System 1984 (G873)\"],MEMBER[\"World Geodetic System 1984 (G1150)\"],MEMBER[\"World Geodetic System 1984 (G1674)\"],MEMBER[\"World Geodetic System 1984 (G1762)\"],MEMBER[\"World Geodetic System 1984 (G2139)\"],ELLIPSOID[\"WGS 84\",6378137,298.257223563],ENSEMBLEACCURACY[2.0]],CS[ellipsoidal,2],AXIS[\"geodetic latitude (Lat)\",north],AXIS[\"geodetic longitude (Lon)\",east],UNIT[\"degree\",0.0174532925199433],USAGE[SCOPE[\"Horizontal component of 3D system.\"],AREA[\"World.\"],BBOX[-90,-180,90,180]],ID[\"EPSG\",4326]]", "bbox": [0, 2, 4, 2], "encoding": "WKB"}}}
GDAL: GDALOpen(test.parquet, this=000001EB348F4060) succeeds as Parquet.
GDAL: Using Parquet driver
GDAL: GDALDriver::Create(Parquet,out_GZIP.parquet,0,0,0,Unknown,0000000000000000)
GDALVectorTranslate: 5 features written in layer 'test'
ARROW: Memory pool: bytes_allocated = 14144
ARROW: Memory pool: max_memory = 35584
GDAL: GDALClose(test.parquet, this=000001EB348F4060)
ARROW: Memory pool (writer layer): bytes_allocated = 128
ARROW: Memory pool (writer layer): max_memory = 36160
GDAL: GDALClose(out_GZIP.parquet, this=000001EB36EBA390)
GDAL: In GDALDestroy - unloading GDAL shared library.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_ECW_JP2ECW.dll using GDALRegister_ECW_JP2ECW.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_GEOR.dll using GDALRegister_GEOR.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_HDF5.dll using GDALRegister_HDF5.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_MrSID.dll using GDALRegister_MrSID.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_TileDB.dll using GDALRegister_TileDB.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_OCI.dll using RegisterOGROCI.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_SOSI.dll using RegisterOGRSOSI.
PARQUET: geo = {"version":"0.4.0","primary_column":"geometry","columns":{"geometry":{"encoding":"WKB","bbox":[0.0,2.0,4.0,2.0],"orientation":"counterclockwise","geometry_type":"Point"}}}
PARQUET: gdal:schema = {"columns":{"boolean":{"type":"Integer","subtype":"Boolean"},"uint8":{"type":"Integer"},"int8":{"type":"Integer"},"uint16":{"type":"Integer"},"int16":{"type":"Integer","subtype":"Int16"},"uint32":{"type":"Integer64"},"int32":{"type":"Integer"},"uint64":{"type":"Real"},"int64":{"type":"Integer64"},"float32":{"type":"Real","subtype":"Float32"},"float64":{"type":"Real"},"string":{"type":"String"},"large_string":{"type":"String"},"timestamp_ms_gmt":{"type":"DateTime"},"timestamp_ms_gmt_plus_2":{"type":"DateTime"},"timestamp_ms_gmt_minus_0215":{"type":"DateTime"},"timestamp_s_no_tz":{"type":"DateTime"},"time32_s":{"type":"Time"},"time32_ms":{"type":"Time"},"time64_us":{"type":"Integer64"},"time64_ns":{"type":"Integer64"},"date32":{"type":"Date"},"date64":{"type":"Date"},"binary":{"type":"Binary"},"large_binary":{"type":"Binary"},"fixed_size_binary":{"type":"Binary","width":2},"decimal128":{"type":"Real","width":7,"precision":3},"decimal256":{"type":"Real","width":7,"precision":3},"list_boolean":{"type":"IntegerList","subtype":"Boolean"},"list_uint8":{"type":"IntegerList"},"list_int8":{"type":"IntegerList"},"list_uint16":{"type":"IntegerList"},"list_int16":{"type":"IntegerList"},"list_uint32":{"type":"Integer64List"},"list_int32":{"type":"IntegerList"},"list_uint64":{"type":"RealList"},"list_int64":{"type":"Integer64List"},"list_float32":{"type":"RealList","subtype":"Float32"},"list_float64":{"type":"RealList"},"list_string":{"type":"StringList"},"fixed_size_list_boolean":{"type":"IntegerList","subtype":"Boolean"},"fixed_size_list_uint8":{"type":"IntegerList"},"fixed_size_list_int8":{"type":"IntegerList"},"fixed_size_list_uint16":{"type":"IntegerList"},"fixed_size_list_int16":{"type":"IntegerList"},"fixed_size_list_uint32":{"type":"Integer64List"},"fixed_size_list_int32":{"type":"IntegerList"},"fixed_size_list_uint64":{"type":"RealList"},"fixed_size_list_int64":{"type":"Integer64List"},"fixed_size_list_float32":{"type":"RealList","subtype":"Float32"},"fixed_size_list_float64":{"type":"RealList"},"fixed_size_list_string":{"type":"StringList"},"struct_field.a":{"type":"Integer64"},"struct_field.b":{"type":"Real"},"struct_field.c.d":{"type":"String"},"struct_field.c.f":{"type":"String"},"struct_field.h":{"type":"Integer64List"},"struct_field.i":{"type":"Integer64"},"map_boolean":{"type":"String","subtype":"JSON"},"map_uint8":{"type":"String","subtype":"JSON"},"map_int8":{"type":"String","subtype":"JSON"},"map_uint16":{"type":"String","subtype":"JSON"},"map_int16":{"type":"String","subtype":"JSON"},"map_uint32":{"type":"String","subtype":"JSON"},"map_int32":{"type":"String","subtype":"JSON"},"map_uint64":{"type":"String","subtype":"JSON"},"map_int64":{"type":"String","subtype":"JSON"},"map_float32":{"type":"String","subtype":"JSON"},"map_float64":{"type":"String","subtype":"JSON"},"map_string":{"type":"String","subtype":"JSON"},"dict":{"type":"Integer"}}}
GDAL: GDALOpen(out_GZIP.parquet, this=0000021CCA63FD40) succeeds as Parquet.
INFO: Open of `out_GZIP.parquet'
using driver `Parquet' successful.
Layer name: out_GZIP
Geometry: Point
Feature Count: 5
Extent: (0.000000, 2.000000) - (4.000000, 2.000000)
Layer SRS WKT:
GEOGCRS["WGS 84",
ENSEMBLE["World Geodetic System 1984 ensemble",
MEMBER["World Geodetic System 1984 (Transit)"],
MEMBER["World Geodetic System 1984 (G730)"],
MEMBER["World Geodetic System 1984 (G873)"],
MEMBER["World Geodetic System 1984 (G1150)"],
MEMBER["World Geodetic System 1984 (G1674)"],
MEMBER["World Geodetic System 1984 (G1762)"],
MEMBER["World Geodetic System 1984 (G2139)"],
ELLIPSOID["WGS 84",6378137,298.257223563,
LENGTHUNIT["metre",1]],
ENSEMBLEACCURACY[2.0]],
PRIMEM["Greenwich",0,
ANGLEUNIT["degree",0.0174532925199433]],
CS[ellipsoidal,2],
AXIS["geodetic latitude (Lat)",north,
ORDER[1],
ANGLEUNIT["degree",0.0174532925199433]],
AXIS["geodetic longitude (Lon)",east,
ORDER[2],
ANGLEUNIT["degree",0.0174532925199433]],
USAGE[
SCOPE["Horizontal component of 3D system."],
AREA["World."],
BBOX[-90,-180,90,180]],
ID["EPSG",4326]]
Data axis to CRS axis mapping: 2,1
Geometry Column = geometry
boolean: Integer(Boolean) (0.0)
uint8: Integer (0.0)
int8: Integer (0.0)
uint16: Integer (0.0)
int16: Integer(Int16) (0.0)
uint32: Integer64 (0.0)
int32: Integer (0.0)
uint64: Real (0.0)
int64: Integer64 (0.0)
float32: Real(Float32) (0.0)
float64: Real (0.0)
string: String (0.0)
large_string: String (0.0)
timestamp_ms_gmt: DateTime (0.0)
timestamp_ms_gmt_plus_2: DateTime (0.0)
timestamp_ms_gmt_minus_0215: DateTime (0.0)
timestamp_s_no_tz: DateTime (0.0)
time32_s: Time (0.0)
time32_ms: Time (0.0)
time64_us: Integer64 (0.0)
time64_ns: Integer64 (0.0)
date32: Date (0.0)
date64: Date (0.0)
binary: Binary (0.0)
large_binary: Binary (0.0)
fixed_size_binary: Binary (2.0)
decimal128: Real (7.3)
decimal256: Real (7.3)
list_boolean: IntegerList(Boolean) (0.0)
list_uint8: IntegerList (0.0)
list_int8: IntegerList (0.0)
list_uint16: IntegerList (0.0)
list_int16: IntegerList (0.0)
list_uint32: Integer64List (0.0)
list_int32: IntegerList (0.0)
list_uint64: RealList (0.0)
list_int64: Integer64List (0.0)
list_float32: RealList(Float32) (0.0)
list_float64: RealList (0.0)
list_string: StringList (0.0)
fixed_size_list_boolean: IntegerList(Boolean) (0.0)
fixed_size_list_uint8: IntegerList (0.0)
fixed_size_list_int8: IntegerList (0.0)
fixed_size_list_uint16: IntegerList (0.0)
fixed_size_list_int16: IntegerList (0.0)
fixed_size_list_uint32: Integer64List (0.0)
fixed_size_list_int32: IntegerList (0.0)
fixed_size_list_uint64: RealList (0.0)
fixed_size_list_int64: Integer64List (0.0)
fixed_size_list_float32: RealList(Float32) (0.0)
fixed_size_list_float64: RealList (0.0)
fixed_size_list_string: StringList (0.0)
struct_field.a: Integer64 (0.0)
struct_field.b: Real (0.0)
struct_field.c.d: String (0.0)
struct_field.c.f: String (0.0)
struct_field.h: Integer64List (0.0)
struct_field.i: Integer64 (0.0)
map_boolean: String(JSON) (0.0)
map_uint8: String(JSON) (0.0)
map_int8: String(JSON) (0.0)
map_uint16: String(JSON) (0.0)
map_int16: String(JSON) (0.0)
map_uint32: String(JSON) (0.0)
map_int32: String(JSON) (0.0)
map_uint64: String(JSON) (0.0)
map_int64: String(JSON) (0.0)
map_float32: String(JSON) (0.0)
map_float64: String(JSON) (0.0)
map_string: String(JSON) (0.0)
dict: Integer (0.0), domain name=dictDomain
OGRFeature(out_GZIP):0
boolean (Integer(Boolean)) = 1
uint8 (Integer) = 1
int8 (Integer) = -2
uint16 (Integer) = 1
int16 (Integer(Int16)) = -20000
uint32 (Integer64) = 1
int32 (Integer) = -2000000000
uint64 (Real) = 1
int64 (Integer64) = -200000000000
float32 (Real(Float32)) = 1.5
float64 (Real) = 1.5
string (String) = abcd
large_string (String) = abcd
timestamp_ms_gmt (DateTime) = 2019/01/01 14:00:00+00
timestamp_ms_gmt_plus_2 (DateTime) = 2019/01/01 14:00:00+02
timestamp_ms_gmt_minus_0215 (DateTime) = 2019/01/01 14:00:00-0215
timestamp_s_no_tz (DateTime) = 2019/01/01 14:00:00
time32_s (Time) = 01:02:03
time32_ms (Time) = 01:02:03.456
time64_us (Integer64) = 3723000000
time64_ns (Integer64) = 3723000000456
date32 (Date) = 1970/01/02
date64 (Date) = 1970/01/02
binary (Binary) = 0001
large_binary (Binary) = 0001
fixed_size_binary (Binary) = 0001
decimal128 (Real) = 1234.567
decimal256 (Real) = 1234.567
list_boolean (IntegerList(Boolean)) = (0:)
list_uint8 (IntegerList) = (0:)
list_int8 (IntegerList) = (0:)
list_uint16 (IntegerList) = (0:)
list_int16 (IntegerList) = (0:)
list_uint32 (Integer64List) = (0:)
list_int32 (IntegerList) = (0:)
list_uint64 (RealList) = (0:)
list_int64 (Integer64List) = (0:)
list_float32 (RealList(Float32)) = (0:)
list_float64 (RealList) = (0:)
list_string (StringList) = (0:)
fixed_size_list_boolean (IntegerList(Boolean)) = (2:1,0)
fixed_size_list_uint8 (IntegerList) = (2:0,1)
fixed_size_list_int8 (IntegerList) = (2:0,1)
fixed_size_list_uint16 (IntegerList) = (2:0,1)
fixed_size_list_int16 (IntegerList) = (2:0,1)
fixed_size_list_uint32 (Integer64List) = (2:0,1)
fixed_size_list_int32 (IntegerList) = (2:0,1)
fixed_size_list_uint64 (RealList) = (2:0,1)
fixed_size_list_int64 (Integer64List) = (2:0,1)
fixed_size_list_float32 (RealList(Float32)) = (2:0.0,nan)
fixed_size_list_float64 (RealList) = (2:0,nan)
fixed_size_list_string (StringList) = (2:a,b)
struct_field.a (Integer64) = 1
struct_field.b (Real) = 2.5
struct_field.c.d (String) = e
struct_field.c.f (String) = g
struct_field.h (Integer64List) = (2:5,6)
struct_field.i (Integer64) = 3
map_boolean (String(JSON)) = {"x":null,"y":true}
map_uint8 (String(JSON)) = {"x":1,"y":null}
map_int8 (String(JSON)) = {"x":1,"y":null}
map_uint16 (String(JSON)) = {"x":1,"y":null}
map_int16 (String(JSON)) = {"x":1,"y":null}
map_uint32 (String(JSON)) = {"x":4000000000,"y":null}
map_int32 (String(JSON)) = {"x":2000000000,"y":null}
map_uint64 (String(JSON)) = {"x":4000000000000.0,"y":null}
map_int64 (String(JSON)) = {"x":-2000000000000,"y":null}
map_float32 (String(JSON)) = {"x":1.5,"y":null}
map_float64 (String(JSON)) = {"x":1.5,"y":null}
map_string (String(JSON)) = {"x":"x_val","y":null}
dict (Integer) = 0
POINT (0 2)
ARROW: Memory pool: bytes_allocated = 128
ARROW: Memory pool: max_memory = 29952
GDAL: GDALClose(out_GZIP.parquet, this=0000021CCA63FD40)
GDAL: In GDALDestroy - unloading GDAL shared library.
C:\OSGeo4W_V2_4>(
if exist out_ZSTD.parquet del out_ZSTD.parquet
ogr2ogr -lco COMPRESSION=ZSTD out_ZSTD.parquet test.parquet
ogrinfo -fid 0 out_ZSTD.parquet out_ZSTD
)
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_ECW_JP2ECW.dll using GDALRegister_ECW_JP2ECW.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_GEOR.dll using GDALRegister_GEOR.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_HDF5.dll using GDALRegister_HDF5.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_MrSID.dll using GDALRegister_MrSID.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_TileDB.dll using GDALRegister_TileDB.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_OCI.dll using RegisterOGROCI.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_SOSI.dll using RegisterOGRSOSI.
PARQUET: geo = {"version": "0.1.0", "primary_column": "geometry", "columns": {"geometry": {"crs": "GEOGCRS[\"WGS 84\",ENSEMBLE[\"World Geodetic System 1984 ensemble\",MEMBER[\"World Geodetic System 1984 (Transit)\"],MEMBER[\"World Geodetic System 1984 (G730)\"],MEMBER[\"World Geodetic System 1984 (G873)\"],MEMBER[\"World Geodetic System 1984 (G1150)\"],MEMBER[\"World Geodetic System 1984 (G1674)\"],MEMBER[\"World Geodetic System 1984 (G1762)\"],MEMBER[\"World Geodetic System 1984 (G2139)\"],ELLIPSOID[\"WGS 84\",6378137,298.257223563],ENSEMBLEACCURACY[2.0]],CS[ellipsoidal,2],AXIS[\"geodetic latitude (Lat)\",north],AXIS[\"geodetic longitude (Lon)\",east],UNIT[\"degree\",0.0174532925199433],USAGE[SCOPE[\"Horizontal component of 3D system.\"],AREA[\"World.\"],BBOX[-90,-180,90,180]],ID[\"EPSG\",4326]]", "bbox": [0, 2, 4, 2], "encoding": "WKB"}}}
GDAL: GDALOpen(test.parquet, this=000001C319FCBE20) succeeds as Parquet.
GDAL: Using Parquet driver
GDAL: GDALDriver::Create(Parquet,out_ZSTD.parquet,0,0,0,Unknown,0000000000000000)
GDALVectorTranslate: 5 features written in layer 'test'
ARROW: Memory pool: bytes_allocated = 14144
ARROW: Memory pool: max_memory = 35584
GDAL: GDALClose(test.parquet, this=000001C319FCBE20)
ARROW: Memory pool (writer layer): bytes_allocated = 128
ARROW: Memory pool (writer layer): max_memory = 36160
GDAL: GDALClose(out_ZSTD.parquet, this=000001C31BC49FF0)
GDAL: In GDALDestroy - unloading GDAL shared library.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_ECW_JP2ECW.dll using GDALRegister_ECW_JP2ECW.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_GEOR.dll using GDALRegister_GEOR.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_HDF5.dll using GDALRegister_HDF5.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_MrSID.dll using GDALRegister_MrSID.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_TileDB.dll using GDALRegister_TileDB.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_OCI.dll using RegisterOGROCI.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_SOSI.dll using RegisterOGRSOSI.
PARQUET: geo = {"version":"0.4.0","primary_column":"geometry","columns":{"geometry":{"encoding":"WKB","bbox":[0.0,2.0,4.0,2.0],"orientation":"counterclockwise","geometry_type":"Point"}}}
PARQUET: gdal:schema = {"columns":{"boolean":{"type":"Integer","subtype":"Boolean"},"uint8":{"type":"Integer"},"int8":{"type":"Integer"},"uint16":{"type":"Integer"},"int16":{"type":"Integer","subtype":"Int16"},"uint32":{"type":"Integer64"},"int32":{"type":"Integer"},"uint64":{"type":"Real"},"int64":{"type":"Integer64"},"float32":{"type":"Real","subtype":"Float32"},"float64":{"type":"Real"},"string":{"type":"String"},"large_string":{"type":"String"},"timestamp_ms_gmt":{"type":"DateTime"},"timestamp_ms_gmt_plus_2":{"type":"DateTime"},"timestamp_ms_gmt_minus_0215":{"type":"DateTime"},"timestamp_s_no_tz":{"type":"DateTime"},"time32_s":{"type":"Time"},"time32_ms":{"type":"Time"},"time64_us":{"type":"Integer64"},"time64_ns":{"type":"Integer64"},"date32":{"type":"Date"},"date64":{"type":"Date"},"binary":{"type":"Binary"},"large_binary":{"type":"Binary"},"fixed_size_binary":{"type":"Binary","width":2},"decimal128":{"type":"Real","width":7,"precision":3},"decimal256":{"type":"Real","width":7,"precision":3},"list_boolean":{"type":"IntegerList","subtype":"Boolean"},"list_uint8":{"type":"IntegerList"},"list_int8":{"type":"IntegerList"},"list_uint16":{"type":"IntegerList"},"list_int16":{"type":"IntegerList"},"list_uint32":{"type":"Integer64List"},"list_int32":{"type":"IntegerList"},"list_uint64":{"type":"RealList"},"list_int64":{"type":"Integer64List"},"list_float32":{"type":"RealList","subtype":"Float32"},"list_float64":{"type":"RealList"},"list_string":{"type":"StringList"},"fixed_size_list_boolean":{"type":"IntegerList","subtype":"Boolean"},"fixed_size_list_uint8":{"type":"IntegerList"},"fixed_size_list_int8":{"type":"IntegerList"},"fixed_size_list_uint16":{"type":"IntegerList"},"fixed_size_list_int16":{"type":"IntegerList"},"fixed_size_list_uint32":{"type":"Integer64List"},"fixed_size_list_int32":{"type":"IntegerList"},"fixed_size_list_uint64":{"type":"RealList"},"fixed_size_list_int64":{"type":"Integer64List"},"fixed_size_list_float32":{"type":"RealList","subtype":"Float32"},"fixed_size_list_float64":{"type":"RealList"},"fixed_size_list_string":{"type":"StringList"},"struct_field.a":{"type":"Integer64"},"struct_field.b":{"type":"Real"},"struct_field.c.d":{"type":"String"},"struct_field.c.f":{"type":"String"},"struct_field.h":{"type":"Integer64List"},"struct_field.i":{"type":"Integer64"},"map_boolean":{"type":"String","subtype":"JSON"},"map_uint8":{"type":"String","subtype":"JSON"},"map_int8":{"type":"String","subtype":"JSON"},"map_uint16":{"type":"String","subtype":"JSON"},"map_int16":{"type":"String","subtype":"JSON"},"map_uint32":{"type":"String","subtype":"JSON"},"map_int32":{"type":"String","subtype":"JSON"},"map_uint64":{"type":"String","subtype":"JSON"},"map_int64":{"type":"String","subtype":"JSON"},"map_float32":{"type":"String","subtype":"JSON"},"map_float64":{"type":"String","subtype":"JSON"},"map_string":{"type":"String","subtype":"JSON"},"dict":{"type":"Integer"}}}
GDAL: GDALOpen(out_ZSTD.parquet, this=00000218A82A4280) succeeds as Parquet.
INFO: Open of `out_ZSTD.parquet'
using driver `Parquet' successful.
Layer name: out_ZSTD
Geometry: Point
Feature Count: 5
Extent: (0.000000, 2.000000) - (4.000000, 2.000000)
Layer SRS WKT:
GEOGCRS["WGS 84",
ENSEMBLE["World Geodetic System 1984 ensemble",
MEMBER["World Geodetic System 1984 (Transit)"],
MEMBER["World Geodetic System 1984 (G730)"],
MEMBER["World Geodetic System 1984 (G873)"],
MEMBER["World Geodetic System 1984 (G1150)"],
MEMBER["World Geodetic System 1984 (G1674)"],
MEMBER["World Geodetic System 1984 (G1762)"],
MEMBER["World Geodetic System 1984 (G2139)"],
ELLIPSOID["WGS 84",6378137,298.257223563,
LENGTHUNIT["metre",1]],
ENSEMBLEACCURACY[2.0]],
PRIMEM["Greenwich",0,
ANGLEUNIT["degree",0.0174532925199433]],
CS[ellipsoidal,2],
AXIS["geodetic latitude (Lat)",north,
ORDER[1],
ANGLEUNIT["degree",0.0174532925199433]],
AXIS["geodetic longitude (Lon)",east,
ORDER[2],
ANGLEUNIT["degree",0.0174532925199433]],
USAGE[
SCOPE["Horizontal component of 3D system."],
AREA["World."],
BBOX[-90,-180,90,180]],
ID["EPSG",4326]]
Data axis to CRS axis mapping: 2,1
Geometry Column = geometry
boolean: Integer(Boolean) (0.0)
uint8: Integer (0.0)
int8: Integer (0.0)
uint16: Integer (0.0)
int16: Integer(Int16) (0.0)
uint32: Integer64 (0.0)
int32: Integer (0.0)
uint64: Real (0.0)
int64: Integer64 (0.0)
float32: Real(Float32) (0.0)
float64: Real (0.0)
string: String (0.0)
large_string: String (0.0)
timestamp_ms_gmt: DateTime (0.0)
timestamp_ms_gmt_plus_2: DateTime (0.0)
timestamp_ms_gmt_minus_0215: DateTime (0.0)
timestamp_s_no_tz: DateTime (0.0)
time32_s: Time (0.0)
time32_ms: Time (0.0)
time64_us: Integer64 (0.0)
time64_ns: Integer64 (0.0)
date32: Date (0.0)
date64: Date (0.0)
binary: Binary (0.0)
large_binary: Binary (0.0)
fixed_size_binary: Binary (2.0)
decimal128: Real (7.3)
decimal256: Real (7.3)
list_boolean: IntegerList(Boolean) (0.0)
list_uint8: IntegerList (0.0)
list_int8: IntegerList (0.0)
list_uint16: IntegerList (0.0)
list_int16: IntegerList (0.0)
list_uint32: Integer64List (0.0)
list_int32: IntegerList (0.0)
list_uint64: RealList (0.0)
list_int64: Integer64List (0.0)
list_float32: RealList(Float32) (0.0)
list_float64: RealList (0.0)
list_string: StringList (0.0)
fixed_size_list_boolean: IntegerList(Boolean) (0.0)
fixed_size_list_uint8: IntegerList (0.0)
fixed_size_list_int8: IntegerList (0.0)
fixed_size_list_uint16: IntegerList (0.0)
fixed_size_list_int16: IntegerList (0.0)
fixed_size_list_uint32: Integer64List (0.0)
fixed_size_list_int32: IntegerList (0.0)
fixed_size_list_uint64: RealList (0.0)
fixed_size_list_int64: Integer64List (0.0)
fixed_size_list_float32: RealList(Float32) (0.0)
fixed_size_list_float64: RealList (0.0)
fixed_size_list_string: StringList (0.0)
struct_field.a: Integer64 (0.0)
struct_field.b: Real (0.0)
struct_field.c.d: String (0.0)
struct_field.c.f: String (0.0)
struct_field.h: Integer64List (0.0)
struct_field.i: Integer64 (0.0)
map_boolean: String(JSON) (0.0)
map_uint8: String(JSON) (0.0)
map_int8: String(JSON) (0.0)
map_uint16: String(JSON) (0.0)
map_int16: String(JSON) (0.0)
map_uint32: String(JSON) (0.0)
map_int32: String(JSON) (0.0)
map_uint64: String(JSON) (0.0)
map_int64: String(JSON) (0.0)
map_float32: String(JSON) (0.0)
map_float64: String(JSON) (0.0)
map_string: String(JSON) (0.0)
dict: Integer (0.0), domain name=dictDomain
OGRFeature(out_ZSTD):0
boolean (Integer(Boolean)) = 1
uint8 (Integer) = 1
int8 (Integer) = -2
uint16 (Integer) = 1
int16 (Integer(Int16)) = -20000
uint32 (Integer64) = 1
int32 (Integer) = -2000000000
uint64 (Real) = 1
int64 (Integer64) = -200000000000
float32 (Real(Float32)) = 1.5
float64 (Real) = 1.5
string (String) = abcd
large_string (String) = abcd
timestamp_ms_gmt (DateTime) = 2019/01/01 14:00:00+00
timestamp_ms_gmt_plus_2 (DateTime) = 2019/01/01 14:00:00+02
timestamp_ms_gmt_minus_0215 (DateTime) = 2019/01/01 14:00:00-0215
timestamp_s_no_tz (DateTime) = 2019/01/01 14:00:00
time32_s (Time) = 01:02:03
time32_ms (Time) = 01:02:03.456
time64_us (Integer64) = 3723000000
time64_ns (Integer64) = 3723000000456
date32 (Date) = 1970/01/02
date64 (Date) = 1970/01/02
binary (Binary) = 0001
large_binary (Binary) = 0001
fixed_size_binary (Binary) = 0001
decimal128 (Real) = 1234.567
decimal256 (Real) = 1234.567
list_boolean (IntegerList(Boolean)) = (0:)
list_uint8 (IntegerList) = (0:)
list_int8 (IntegerList) = (0:)
list_uint16 (IntegerList) = (0:)
list_int16 (IntegerList) = (0:)
list_uint32 (Integer64List) = (0:)
list_int32 (IntegerList) = (0:)
list_uint64 (RealList) = (0:)
list_int64 (Integer64List) = (0:)
list_float32 (RealList(Float32)) = (0:)
list_float64 (RealList) = (0:)
list_string (StringList) = (0:)
fixed_size_list_boolean (IntegerList(Boolean)) = (2:1,0)
fixed_size_list_uint8 (IntegerList) = (2:0,1)
fixed_size_list_int8 (IntegerList) = (2:0,1)
fixed_size_list_uint16 (IntegerList) = (2:0,1)
fixed_size_list_int16 (IntegerList) = (2:0,1)
fixed_size_list_uint32 (Integer64List) = (2:0,1)
fixed_size_list_int32 (IntegerList) = (2:0,1)
fixed_size_list_uint64 (RealList) = (2:0,1)
fixed_size_list_int64 (Integer64List) = (2:0,1)
fixed_size_list_float32 (RealList(Float32)) = (2:0.0,nan)
fixed_size_list_float64 (RealList) = (2:0,nan)
fixed_size_list_string (StringList) = (2:a,b)
struct_field.a (Integer64) = 1
struct_field.b (Real) = 2.5
struct_field.c.d (String) = e
struct_field.c.f (String) = g
struct_field.h (Integer64List) = (2:5,6)
struct_field.i (Integer64) = 3
map_boolean (String(JSON)) = {"x":null,"y":true}
map_uint8 (String(JSON)) = {"x":1,"y":null}
map_int8 (String(JSON)) = {"x":1,"y":null}
map_uint16 (String(JSON)) = {"x":1,"y":null}
map_int16 (String(JSON)) = {"x":1,"y":null}
map_uint32 (String(JSON)) = {"x":4000000000,"y":null}
map_int32 (String(JSON)) = {"x":2000000000,"y":null}
map_uint64 (String(JSON)) = {"x":4000000000000.0,"y":null}
map_int64 (String(JSON)) = {"x":-2000000000000,"y":null}
map_float32 (String(JSON)) = {"x":1.5,"y":null}
map_float64 (String(JSON)) = {"x":1.5,"y":null}
map_string (String(JSON)) = {"x":"x_val","y":null}
dict (Integer) = 0
POINT (0 2)
ARROW: Memory pool: bytes_allocated = 128
ARROW: Memory pool: max_memory = 29952
GDAL: GDALClose(out_ZSTD.parquet, this=00000218A82A4280)
GDAL: In GDALDestroy - unloading GDAL shared library.
C:\OSGeo4W_V2_4>(
if exist out_BROTLI.parquet del out_BROTLI.parquet
ogr2ogr -lco COMPRESSION=BROTLI out_BROTLI.parquet test.parquet
ogrinfo -fid 0 out_BROTLI.parquet out_BROTLI
)
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_ECW_JP2ECW.dll using GDALRegister_ECW_JP2ECW.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_GEOR.dll using GDALRegister_GEOR.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_HDF5.dll using GDALRegister_HDF5.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_MrSID.dll using GDALRegister_MrSID.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_TileDB.dll using GDALRegister_TileDB.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_OCI.dll using RegisterOGROCI.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_SOSI.dll using RegisterOGRSOSI.
PARQUET: geo = {"version": "0.1.0", "primary_column": "geometry", "columns": {"geometry": {"crs": "GEOGCRS[\"WGS 84\",ENSEMBLE[\"World Geodetic System 1984 ensemble\",MEMBER[\"World Geodetic System 1984 (Transit)\"],MEMBER[\"World Geodetic System 1984 (G730)\"],MEMBER[\"World Geodetic System 1984 (G873)\"],MEMBER[\"World Geodetic System 1984 (G1150)\"],MEMBER[\"World Geodetic System 1984 (G1674)\"],MEMBER[\"World Geodetic System 1984 (G1762)\"],MEMBER[\"World Geodetic System 1984 (G2139)\"],ELLIPSOID[\"WGS 84\",6378137,298.257223563],ENSEMBLEACCURACY[2.0]],CS[ellipsoidal,2],AXIS[\"geodetic latitude (Lat)\",north],AXIS[\"geodetic longitude (Lon)\",east],UNIT[\"degree\",0.0174532925199433],USAGE[SCOPE[\"Horizontal component of 3D system.\"],AREA[\"World.\"],BBOX[-90,-180,90,180]],ID[\"EPSG\",4326]]", "bbox": [0, 2, 4, 2], "encoding": "WKB"}}}
GDAL: GDALOpen(test.parquet, this=0000027B01879480) succeeds as Parquet.
GDAL: Using Parquet driver
GDAL: GDALDriver::Create(Parquet,out_BROTLI.parquet,0,0,0,Unknown,0000000000000000)
GDALVectorTranslate: 5 features written in layer 'test'
ARROW: Memory pool: bytes_allocated = 14144
ARROW: Memory pool: max_memory = 35584
GDAL: GDALClose(test.parquet, this=0000027B01879480)
ARROW: Memory pool (writer layer): bytes_allocated = 128
ARROW: Memory pool (writer layer): max_memory = 36160
GDAL: GDALClose(out_BROTLI.parquet, this=0000027B0436E320)
GDAL: In GDALDestroy - unloading GDAL shared library.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_ECW_JP2ECW.dll using GDALRegister_ECW_JP2ECW.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_GEOR.dll using GDALRegister_GEOR.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_HDF5.dll using GDALRegister_HDF5.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_MrSID.dll using GDALRegister_MrSID.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\gdal_TileDB.dll using GDALRegister_TileDB.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_OCI.dll using RegisterOGROCI.
GDAL: Auto register C:\OSFB9F~1\apps\gdal\lib\gdalplugins\ogr_SOSI.dll using RegisterOGRSOSI.
PARQUET: geo = {"version":"0.4.0","primary_column":"geometry","columns":{"geometry":{"encoding":"WKB","bbox":[0.0,2.0,4.0,2.0],"orientation":"counterclockwise","geometry_type":"Point"}}}
PARQUET: gdal:schema = {"columns":{"boolean":{"type":"Integer","subtype":"Boolean"},"uint8":{"type":"Integer"},"int8":{"type":"Integer"},"uint16":{"type":"Integer"},"int16":{"type":"Integer","subtype":"Int16"},"uint32":{"type":"Integer64"},"int32":{"type":"Integer"},"uint64":{"type":"Real"},"int64":{"type":"Integer64"},"float32":{"type":"Real","subtype":"Float32"},"float64":{"type":"Real"},"string":{"type":"String"},"large_string":{"type":"String"},"timestamp_ms_gmt":{"type":"DateTime"},"timestamp_ms_gmt_plus_2":{"type":"DateTime"},"timestamp_ms_gmt_minus_0215":{"type":"DateTime"},"timestamp_s_no_tz":{"type":"DateTime"},"time32_s":{"type":"Time"},"time32_ms":{"type":"Time"},"time64_us":{"type":"Integer64"},"time64_ns":{"type":"Integer64"},"date32":{"type":"Date"},"date64":{"type":"Date"},"binary":{"type":"Binary"},"large_binary":{"type":"Binary"},"fixed_size_binary":{"type":"Binary","width":2},"decimal128":{"type":"Real","width":7,"precision":3},"decimal256":{"type":"Real","width":7,"precision":3},"list_boolean":{"type":"IntegerList","subtype":"Boolean"},"list_uint8":{"type":"IntegerList"},"list_int8":{"type":"IntegerList"},"list_uint16":{"type":"IntegerList"},"list_int16":{"type":"IntegerList"},"list_uint32":{"type":"Integer64List"},"list_int32":{"type":"IntegerList"},"list_uint64":{"type":"RealList"},"list_int64":{"type":"Integer64List"},"list_float32":{"type":"RealList","subtype":"Float32"},"list_float64":{"type":"RealList"},"list_string":{"type":"StringList"},"fixed_size_list_boolean":{"type":"IntegerList","subtype":"Boolean"},"fixed_size_list_uint8":{"type":"IntegerList"},"fixed_size_list_int8":{"type":"IntegerList"},"fixed_size_list_uint16":{"type":"IntegerList"},"fixed_size_list_int16":{"type":"IntegerList"},"fixed_size_list_uint32":{"type":"Integer64List"},"fixed_size_list_int32":{"type":"IntegerList"},"fixed_size_list_uint64":{"type":"RealList"},"fixed_size_list_int64":{"type":"Integer64List"},"fixed_size_list_float32":{"type":"RealList","subtype":"Float32"},"fixed_size_list_float64":{"type":"RealList"},"fixed_size_list_string":{"type":"StringList"},"struct_field.a":{"type":"Integer64"},"struct_field.b":{"type":"Real"},"struct_field.c.d":{"type":"String"},"struct_field.c.f":{"type":"String"},"struct_field.h":{"type":"Integer64List"},"struct_field.i":{"type":"Integer64"},"map_boolean":{"type":"String","subtype":"JSON"},"map_uint8":{"type":"String","subtype":"JSON"},"map_int8":{"type":"String","subtype":"JSON"},"map_uint16":{"type":"String","subtype":"JSON"},"map_int16":{"type":"String","subtype":"JSON"},"map_uint32":{"type":"String","subtype":"JSON"},"map_int32":{"type":"String","subtype":"JSON"},"map_uint64":{"type":"String","subtype":"JSON"},"map_int64":{"type":"String","subtype":"JSON"},"map_float32":{"type":"String","subtype":"JSON"},"map_float64":{"type":"String","subtype":"JSON"},"map_string":{"type":"String","subtype":"JSON"},"dict":{"type":"Integer"}}}
GDAL: GDALOpen(out_BROTLI.parquet, this=000002605A220440) succeeds as Parquet.
INFO: Open of `out_BROTLI.parquet'
using driver `Parquet' successful.
Layer name: out_BROTLI
Geometry: Point
Feature Count: 5
Extent: (0.000000, 2.000000) - (4.000000, 2.000000)
Layer SRS WKT:
GEOGCRS["WGS 84",
ENSEMBLE["World Geodetic System 1984 ensemble",
MEMBER["World Geodetic System 1984 (Transit)"],
MEMBER["World Geodetic System 1984 (G730)"],
MEMBER["World Geodetic System 1984 (G873)"],
MEMBER["World Geodetic System 1984 (G1150)"],
MEMBER["World Geodetic System 1984 (G1674)"],
MEMBER["World Geodetic System 1984 (G1762)"],
MEMBER["World Geodetic System 1984 (G2139)"],
ELLIPSOID["WGS 84",6378137,298.257223563,
LENGTHUNIT["metre",1]],
ENSEMBLEACCURACY[2.0]],
PRIMEM["Greenwich",0,
ANGLEUNIT["degree",0.0174532925199433]],
CS[ellipsoidal,2],
AXIS["geodetic latitude (Lat)",north,
ORDER[1],
ANGLEUNIT["degree",0.0174532925199433]],
AXIS["geodetic longitude (Lon)",east,
ORDER[2],
ANGLEUNIT["degree",0.0174532925199433]],
USAGE[
SCOPE["Horizontal component of 3D system."],
AREA["World."],
BBOX[-90,-180,90,180]],
ID["EPSG",4326]]
Data axis to CRS axis mapping: 2,1
Geometry Column = geometry
boolean: Integer(Boolean) (0.0)
uint8: Integer (0.0)
int8: Integer (0.0)
uint16: Integer (0.0)
int16: Integer(Int16) (0.0)
uint32: Integer64 (0.0)
int32: Integer (0.0)
uint64: Real (0.0)
int64: Integer64 (0.0)
float32: Real(Float32) (0.0)
float64: Real (0.0)
string: String (0.0)
large_string: String (0.0)
timestamp_ms_gmt: DateTime (0.0)
timestamp_ms_gmt_plus_2: DateTime (0.0)
timestamp_ms_gmt_minus_0215: DateTime (0.0)
timestamp_s_no_tz: DateTime (0.0)
time32_s: Time (0.0)
time32_ms: Time (0.0)
time64_us: Integer64 (0.0)
time64_ns: Integer64 (0.0)
date32: Date (0.0)
date64: Date (0.0)
binary: Binary (0.0)
large_binary: Binary (0.0)
fixed_size_binary: Binary (2.0)
decimal128: Real (7.3)
decimal256: Real (7.3)
list_boolean: IntegerList(Boolean) (0.0)
list_uint8: IntegerList (0.0)
list_int8: IntegerList (0.0)
list_uint16: IntegerList (0.0)
list_int16: IntegerList (0.0)
list_uint32: Integer64List (0.0)
list_int32: IntegerList (0.0)
list_uint64: RealList (0.0)
list_int64: Integer64List (0.0)
list_float32: RealList(Float32) (0.0)
list_float64: RealList (0.0)
list_string: StringList (0.0)
fixed_size_list_boolean: IntegerList(Boolean) (0.0)
fixed_size_list_uint8: IntegerList (0.0)
fixed_size_list_int8: IntegerList (0.0)
fixed_size_list_uint16: IntegerList (0.0)
fixed_size_list_int16: IntegerList (0.0)
fixed_size_list_uint32: Integer64List (0.0)
fixed_size_list_int32: IntegerList (0.0)
fixed_size_list_uint64: RealList (0.0)
fixed_size_list_int64: Integer64List (0.0)
fixed_size_list_float32: RealList(Float32) (0.0)
fixed_size_list_float64: RealList (0.0)
fixed_size_list_string: StringList (0.0)
struct_field.a: Integer64 (0.0)
struct_field.b: Real (0.0)
struct_field.c.d: String (0.0)
struct_field.c.f: String (0.0)
struct_field.h: Integer64List (0.0)
struct_field.i: Integer64 (0.0)
map_boolean: String(JSON) (0.0)
map_uint8: String(JSON) (0.0)
map_int8: String(JSON) (0.0)
map_uint16: String(JSON) (0.0)
map_int16: String(JSON) (0.0)
map_uint32: String(JSON) (0.0)
map_int32: String(JSON) (0.0)
map_uint64: String(JSON) (0.0)
map_int64: String(JSON) (0.0)
map_float32: String(JSON) (0.0)
map_float64: String(JSON) (0.0)
map_string: String(JSON) (0.0)
dict: Integer (0.0), domain name=dictDomain
OGRFeature(out_BROTLI):0
boolean (Integer(Boolean)) = 1
uint8 (Integer) = 1
int8 (Integer) = -2
uint16 (Integer) = 1
int16 (Integer(Int16)) = -20000
uint32 (Integer64) = 1
int32 (Integer) = -2000000000
uint64 (Real) = 1
int64 (Integer64) = -200000000000
float32 (Real(Float32)) = 1.5
float64 (Real) = 1.5
string (String) = abcd
large_string (String) = abcd
timestamp_ms_gmt (DateTime) = 2019/01/01 14:00:00+00
timestamp_ms_gmt_plus_2 (DateTime) = 2019/01/01 14:00:00+02
timestamp_ms_gmt_minus_0215 (DateTime) = 2019/01/01 14:00:00-0215
timestamp_s_no_tz (DateTime) = 2019/01/01 14:00:00
time32_s (Time) = 01:02:03
time32_ms (Time) = 01:02:03.456
time64_us (Integer64) = 3723000000
time64_ns (Integer64) = 3723000000456
date32 (Date) = 1970/01/02
date64 (Date) = 1970/01/02
binary (Binary) = 0001
large_binary (Binary) = 0001
fixed_size_binary (Binary) = 0001
decimal128 (Real) = 1234.567
decimal256 (Real) = 1234.567
list_boolean (IntegerList(Boolean)) = (0:)
list_uint8 (IntegerList) = (0:)
list_int8 (IntegerList) = (0:)
list_uint16 (IntegerList) = (0:)
list_int16 (IntegerList) = (0:)
list_uint32 (Integer64List) = (0:)
list_int32 (IntegerList) = (0:)
list_uint64 (RealList) = (0:)
list_int64 (Integer64List) = (0:)
list_float32 (RealList(Float32)) = (0:)
list_float64 (RealList) = (0:)
list_string (StringList) = (0:)
fixed_size_list_boolean (IntegerList(Boolean)) = (2:1,0)
fixed_size_list_uint8 (IntegerList) = (2:0,1)
fixed_size_list_int8 (IntegerList) = (2:0,1)
fixed_size_list_uint16 (IntegerList) = (2:0,1)
fixed_size_list_int16 (IntegerList) = (2:0,1)
fixed_size_list_uint32 (Integer64List) = (2:0,1)
fixed_size_list_int32 (IntegerList) = (2:0,1)
fixed_size_list_uint64 (RealList) = (2:0,1)
fixed_size_list_int64 (Integer64List) = (2:0,1)
fixed_size_list_float32 (RealList(Float32)) = (2:0.0,nan)
fixed_size_list_float64 (RealList) = (2:0,nan)
fixed_size_list_string (StringList) = (2:a,b)
struct_field.a (Integer64) = 1
struct_field.b (Real) = 2.5
struct_field.c.d (String) = e
struct_field.c.f (String) = g
struct_field.h (Integer64List) = (2:5,6)
struct_field.i (Integer64) = 3
map_boolean (String(JSON)) = {"x":null,"y":true}
map_uint8 (String(JSON)) = {"x":1,"y":null}
map_int8 (String(JSON)) = {"x":1,"y":null}
map_uint16 (String(JSON)) = {"x":1,"y":null}
map_int16 (String(JSON)) = {"x":1,"y":null}
map_uint32 (String(JSON)) = {"x":4000000000,"y":null}
map_int32 (String(JSON)) = {"x":2000000000,"y":null}
map_uint64 (String(JSON)) = {"x":4000000000000.0,"y":null}
map_int64 (String(JSON)) = {"x":-2000000000000,"y":null}
map_float32 (String(JSON)) = {"x":1.5,"y":null}
map_float64 (String(JSON)) = {"x":1.5,"y":null}
map_string (String(JSON)) = {"x":"x_val","y":null}
dict (Integer) = 0
POINT (0 2)
ARROW: Memory pool: bytes_allocated = 128
ARROW: Memory pool: max_memory = 29952
GDAL: GDALClose(out_BROTLI.parquet, this=000002605A220440)
GDAL: In GDALDestroy - unloading GDAL shared library.
C:\OSGeo4W_V2_4>dir *.parquet
Il volume nell'unità C è Acer
Numero di serie del volume: A69E-472F
Directory di C:\OSGeo4W_V2_4
01/08/2022 10:39 37.888 out_BROTLI.parquet
01/08/2022 10:39 39.955 out_GZIP.parquet
01/08/2022 10:39 37.921 out_SNAPPY.parquet
01/08/2022 10:39 38.893 out_ZSTD.parquet
23/07/2022 07:51 57.756 test.parquet
5 File 212.413 byte
0 Directory 622.232.276.992 byte disponibili
C:\OSGeo4W_V2_4>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment