Skip to content

Instantly share code, notes, and snippets.

View palmerj's full-sized avatar

Jeremy Palmer palmerj

  • Toitū The Whenua Land Information New Zealand
  • Wellington, New Zealand
View GitHub Profile
@palmerj
palmerj / gist:3139358
Created July 18, 2012 22:27
qgis master ldd output
ldd ./Dev/qgis/install-master/bin/qgis
linux-vdso.so.1 => (0x00007fff42d01000)
libqwt-qt4.so.5 => /usr/lib/libqwt-qt4.so.5 (0x00007fd85d745000)
libQtSql.so.4 => /usr/lib/libQtSql.so.4 (0x00007fd85d507000)
libQtWebKit.so.4 => /usr/lib/libQtWebKit.so.4 (0x00007fd85bda4000)
libgdal.so.1 => /usr/local/lib/libgdal.so.1 (0x00007fd85ac90000)
libqgis_core.so.1.9.0 => /home/jpalmer/Dev/qgis/install-master/lib/libqgis_core.so.1.9.0 (0x00007fd85a5ee000)
libqgis_gui.so.1.9.0 => /home/jpalmer/Dev/qgis/install-master/lib/libqgis_gui.so.1.9.0 (0x00007fd85a0be000)
libqgis_analysis.so.1.9.0 => /home/jpalmer/Dev/qgis/install-master/lib/libqgis_analysis.so.1.9.0 (0x00007fd859e21000)
libpq.so.5 => /usr/lib/libpq.so.5 (0x00007fd859bf5000)
@palmerj
palmerj / gist:6219582
Last active December 21, 2015 00:19
qgis filegdb bt
#0 0x00007fffeab51502 in FileGDBAPI::Geodatabase::IsSetup() const ()
from /opt/FileGDB_API/lib/libFileGDBAPI.so
#1 0x00007fffeab518c3 in FileGDBAPI::Geodatabase::GetQueryName(std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> > const&, std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> >&) const
() from /opt/FileGDB_API/lib/libFileGDBAPI.so
#2 0x00007ffff51e6782 in FGdbLayer::Initialize(FGdbDataSource*, FileGDBAPI::Table*, std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> >, std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> >) () from /usr/local/lib/libgdal.so.1
#3 0x00007ffff51dac6e in FGdbDataSource::OpenFGDBTables(std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> > const&, std::vector<std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> >, std::allocator<std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> > >
tippecanoe -P -X -f -o primary_parcels_2.mbtiles --merge-polygons-as-needed --no-polygon-splitting ../nz_primary_parcels.json
For layer 0, using name "nz_primary_parcels"
../nz_primary_parcels.json:331904: Found ] at top level
../nz_primary_parcels.json:276182: Reached EOF without all containers being closed
In JSON object {"type":"FeatureCollection","crs":{"type":"name","properties":{"name":"urn:ogc:def:crs:EPSG::4167"}},"features":[]}
2494590 features, 306984651 bytes of geometry, 8 bytes of separate metadata, 0 bytes of string pool
tile 5/31/20 size is 800930 with detail 12, >500000
Going to try merging the densest 43.82% of the features to make it fit
tile 5/31/19 size is 970782 with detail 12, >500000
Going to try merging the densest 53.65% of the features to make it fit
@palmerj
palmerj / error.log
Created November 5, 2017 02:46
error.log
[4464/4581] cd /tmp/qgis3-dev-20171105-58465-16mcu7o/build/python/plugins/db_manager/db_plugins/spatialite && /usr/local/bin/pyrcc5 -name /tmp/qgis3-dev-20171105-58465-16mcu7o/build/python/plugins/db_manager/db_plugins/spatialite/resources_rc.py -o /tmp/qgis3-dev-20171105-58465-16mcu7o/build/python/plugins/db_manager/db_plugins/spatialite/resources_rc.py /tmp/qgis3-dev-20171105-58465-16mcu7o/python/plugins/db_manager/db_plugins/spatialite/resources.qrc
FAILED: python/plugins/db_manager/db_plugins/spatialite/resources_rc.py
cd /tmp/qgis3-dev-20171105-58465-16mcu7o/build/python/plugins/db_manager/db_plugins/spatialite && /usr/local/bin/pyrcc5 -name /tmp/qgis3-dev-20171105-58465-16mcu7o/build/python/plugins/db_manager/db_plugins/spatialite/resources_rc.py -o /tmp/qgis3-dev-20171105-58465-16mcu7o/build/python/plugins/db_manager/db_plugins/spatialite/resources_rc.py /tmp/qgis3-dev-20171105-58465-16mcu7o/python/plugins/db_manager/db_plugins/spatialite/resources.qrc
PyQt5 resource compiler
pyrcc5: Unknown option: '-
@palmerj
palmerj / get_centroid.bash
Last active December 20, 2017 04:47
OGR Create JSON centroid for labelling
ogr2ogr -f GeoJSON labels.json WFS:"https://data.linz.govt.nz/services;key=$LDS_API_KEY/wfs/layer-51572" -dialect sqlite -sql 'SELECT id, lease_name AS name, ST_Centroid(geometry) from "data.linz.govt.nz:layer-51572"' -lco COORDINATE_PRECISION=4 -t_srs "EPSG:4326"
@palmerj
palmerj / date_ranges.sql
Last active January 28, 2018 00:32
SQLite3 - Generate date time ranges using SQL recursive query
DROP TABLE IF EXISTS date_ranges;
CREATE TEMP TABLE date_ranges (start_datetime DATETIME);
WITH RECURSIVE
date_ranges(start_datetime) AS (
VALUES('2011-05-01 00:00:00')
UNION ALL
SELECT datetime(start_datetime, '+1 month')
FROM date_ranges WHERE start_datetime < datetime('now', '-1 month')
)
@palmerj
palmerj / TileMatrixSet.xml
Created February 5, 2018 00:08
Geoserver WMTS capabilities TileMatrix for NZTM2000
<TileMatrixSet>
<ows:Identifier>NZTM2000</ows:Identifier>
<ows:SupportedCRS>urn:ogc:def:crs:EPSG::2193</ows:SupportedCRS>
<TileMatrix>
<ows:Identifier>0</ows:Identifier>
<ScaleDenominator>3.2000000000000004E7</ScaleDenominator>
<TopLeftCorner>-1000000.0 1.226204E7</TopLeftCorner>
<TileWidth>256</TileWidth>
<TileHeight>256</TileHeight>
<MatrixWidth>2</MatrixWidth>
@palmerj
palmerj / gdal2_env.sh
Last active February 18, 2018 19:31
Python Environment setup for brew GDAL2 on MacOSX with GDAL framework installed as well (i.e no brew link)
export PATH="$(brew --prefix)/opt/python/libexec/bin:$(brew --prefix)/opt/gdal2/bin:$(brew --prefix)/opt/gdal2-python/bin:$PATH"
export PYTHONPATH=$(brew --prefix)/lib/python2.7/site-packages:$(brew --prefix)/opt/gdal2-python/lib/python2.7/site-packages/:$PYTHONPATH
@palmerj
palmerj / parcels.vrt
Created February 18, 2018 23:35
GDAL mbtiles vector tile VRT
<OGRVRTDataSource>
<Metadata domain="IMAGE_STRUCTURE">
<MDI key="INTERLEAVE">PIXEL</MDI>
</Metadata>
<Metadata>
<MDI key="name">parcels</MDI>
<MDI key="format">pbf</MDI>
<MDI key="center">174.6325388,-36.9883061,0</MDI>
<MDI key="ZOOM_LEVEL">14</MDI>
<MDI key="bounds">174.1821636,-37.3637475,175.0829141,-36.6128647</MDI>
@palmerj
palmerj / mvt_qgis.md
Last active February 20, 2018 02:03
View Vector Tiles in QGIS using GDAL/OGR 2.3

Create mapbox vectors using OGR

Get NZ parcels data over Auckland region in SHP: https://data.linz.govt.nz/x/CLzEZU

Generate vector tiles

ogr2ogr -f MBTILES parcels.mbtiles nz-primary-parcels.shp -dsco MAXZOOM=14