Skip to content

Instantly share code, notes, and snippets.

View palmerj's full-sized avatar

Jeremy Palmer palmerj

  • Toitū The Whenua Land Information New Zealand
  • Wellington, New Zealand
View GitHub Profile
@palmerj
palmerj / gist:3139358
Created July 18, 2012 22:27
qgis master ldd output
ldd ./Dev/qgis/install-master/bin/qgis
linux-vdso.so.1 => (0x00007fff42d01000)
libqwt-qt4.so.5 => /usr/lib/libqwt-qt4.so.5 (0x00007fd85d745000)
libQtSql.so.4 => /usr/lib/libQtSql.so.4 (0x00007fd85d507000)
libQtWebKit.so.4 => /usr/lib/libQtWebKit.so.4 (0x00007fd85bda4000)
libgdal.so.1 => /usr/local/lib/libgdal.so.1 (0x00007fd85ac90000)
libqgis_core.so.1.9.0 => /home/jpalmer/Dev/qgis/install-master/lib/libqgis_core.so.1.9.0 (0x00007fd85a5ee000)
libqgis_gui.so.1.9.0 => /home/jpalmer/Dev/qgis/install-master/lib/libqgis_gui.so.1.9.0 (0x00007fd85a0be000)
libqgis_analysis.so.1.9.0 => /home/jpalmer/Dev/qgis/install-master/lib/libqgis_analysis.so.1.9.0 (0x00007fd859e21000)
libpq.so.5 => /usr/lib/libpq.so.5 (0x00007fd859bf5000)
@palmerj
palmerj / gist:6219582
Last active December 21, 2015 00:19
qgis filegdb bt
#0 0x00007fffeab51502 in FileGDBAPI::Geodatabase::IsSetup() const ()
from /opt/FileGDB_API/lib/libFileGDBAPI.so
#1 0x00007fffeab518c3 in FileGDBAPI::Geodatabase::GetQueryName(std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> > const&, std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> >&) const
() from /opt/FileGDB_API/lib/libFileGDBAPI.so
#2 0x00007ffff51e6782 in FGdbLayer::Initialize(FGdbDataSource*, FileGDBAPI::Table*, std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> >, std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> >) () from /usr/local/lib/libgdal.so.1
#3 0x00007ffff51dac6e in FGdbDataSource::OpenFGDBTables(std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> > const&, std::vector<std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> >, std::allocator<std::basic_string<wchar_t, std::char_traits<wchar_t>, std::allocator<wchar_t> > >
tippecanoe -P -X -f -o primary_parcels_2.mbtiles --merge-polygons-as-needed --no-polygon-splitting ../nz_primary_parcels.json
For layer 0, using name "nz_primary_parcels"
../nz_primary_parcels.json:331904: Found ] at top level
../nz_primary_parcels.json:276182: Reached EOF without all containers being closed
In JSON object {"type":"FeatureCollection","crs":{"type":"name","properties":{"name":"urn:ogc:def:crs:EPSG::4167"}},"features":[]}
2494590 features, 306984651 bytes of geometry, 8 bytes of separate metadata, 0 bytes of string pool
tile 5/31/20 size is 800930 with detail 12, >500000
Going to try merging the densest 43.82% of the features to make it fit
tile 5/31/19 size is 970782 with detail 12, >500000
Going to try merging the densest 53.65% of the features to make it fit
@palmerj
palmerj / error.log
Created November 5, 2017 02:46
error.log
[4464/4581] cd /tmp/qgis3-dev-20171105-58465-16mcu7o/build/python/plugins/db_manager/db_plugins/spatialite && /usr/local/bin/pyrcc5 -name /tmp/qgis3-dev-20171105-58465-16mcu7o/build/python/plugins/db_manager/db_plugins/spatialite/resources_rc.py -o /tmp/qgis3-dev-20171105-58465-16mcu7o/build/python/plugins/db_manager/db_plugins/spatialite/resources_rc.py /tmp/qgis3-dev-20171105-58465-16mcu7o/python/plugins/db_manager/db_plugins/spatialite/resources.qrc
FAILED: python/plugins/db_manager/db_plugins/spatialite/resources_rc.py
cd /tmp/qgis3-dev-20171105-58465-16mcu7o/build/python/plugins/db_manager/db_plugins/spatialite && /usr/local/bin/pyrcc5 -name /tmp/qgis3-dev-20171105-58465-16mcu7o/build/python/plugins/db_manager/db_plugins/spatialite/resources_rc.py -o /tmp/qgis3-dev-20171105-58465-16mcu7o/build/python/plugins/db_manager/db_plugins/spatialite/resources_rc.py /tmp/qgis3-dev-20171105-58465-16mcu7o/python/plugins/db_manager/db_plugins/spatialite/resources.qrc
PyQt5 resource compiler
pyrcc5: Unknown option: '-
@palmerj
palmerj / get_centroid.bash
Last active December 20, 2017 04:47
OGR Create JSON centroid for labelling
ogr2ogr -f GeoJSON labels.json WFS:"https://data.linz.govt.nz/services;key=$LDS_API_KEY/wfs/layer-51572" -dialect sqlite -sql 'SELECT id, lease_name AS name, ST_Centroid(geometry) from "data.linz.govt.nz:layer-51572"' -lco COORDINATE_PRECISION=4 -t_srs "EPSG:4326"
@palmerj
palmerj / gdal2_env.sh
Last active February 18, 2018 19:31
Python Environment setup for brew GDAL2 on MacOSX with GDAL framework installed as well (i.e no brew link)
export PATH="$(brew --prefix)/opt/python/libexec/bin:$(brew --prefix)/opt/gdal2/bin:$(brew --prefix)/opt/gdal2-python/bin:$PATH"
export PYTHONPATH=$(brew --prefix)/lib/python2.7/site-packages:$(brew --prefix)/opt/gdal2-python/lib/python2.7/site-packages/:$PYTHONPATH
@palmerj
palmerj / libecwj2-3.3.patch
Created January 21, 2018 23:23
Patch to support building the libecwj2 library on MacOSX based on https://trac.osgeo.org/gdal/attachment/wiki/ECW/libecwj2-3.3.patch
diff --git a/Source/C/NCSEcw/NCSJP2/NCSJPCResolution.cpp b/Source/C/NCSEcw/NCSJP2/NCSJPCResolution.cpp
index 12a0cce..8747b24 100644
--- a/Source/C/NCSEcw/NCSJP2/NCSJPCResolution.cpp
+++ b/Source/C/NCSEcw/NCSJP2/NCSJPCResolution.cpp
@@ -1773,10 +1773,10 @@ bool CNCSJPCResolution::SD_2D_OUTPUT4(ContextID nCtx,
//Step0-1 == 2State.
//
- UINT32 n = 0;
+ INT32 n = 0;
@palmerj
palmerj / date_ranges.sql
Last active January 28, 2018 00:32
SQLite3 - Generate date time ranges using SQL recursive query
DROP TABLE IF EXISTS date_ranges;
CREATE TEMP TABLE date_ranges (start_datetime DATETIME);
WITH RECURSIVE
date_ranges(start_datetime) AS (
VALUES('2011-05-01 00:00:00')
UNION ALL
SELECT datetime(start_datetime, '+1 month')
FROM date_ranges WHERE start_datetime < datetime('now', '-1 month')
)
@palmerj
palmerj / histogram.sql
Created January 28, 2018 04:28
SQLite3 - Generate histogram using date ranges and ASCII bar
-- On MacOSX installed SQLite3 to get log function support
-- brew reinstall sqlite3 --with-functions
SELECT load_extension('/usr/local/opt/sqlite/lib/libsqlitefunctions');
SELECT
DR.start_datetime as date,
COUNT(*) AS total,
replace(substr(quote(zeroblob((log(COUNT(*)) + 1) / 2)), 3, log(COUNT(*))), '0', '*') AS bar
FROM
@palmerj
palmerj / gist:e293b443def642431f05775aa4d7f640
Last active July 25, 2022 15:45
One liner to get AWS S3 IP address ranges for ap-southeast-2 (Sydney)
curl https://ip-ranges.amazonaws.com/ip-ranges.json | jq '.prefixes' | jq 'map(select(.region=="ap-southeast-2"))' | jq 'map(select(.service=="S3"))' | jq 'map(.ip_prefix)'