nishadhka

import fiona 
import geopandas as gpd

# Enable fiona driver
gpd.io.file.fiona.drvsupport.supported_drivers['KML'] = 'rw'

# Read file
df = gpd.read_file(path, driver='KML')

# Write file

nishadhka

nishadhka

1. based on this to convert the pbf into paraquet file
2. The library, https://github.com/adrianulbona/osm-parquetizer to convert the osm.pbf file into three paraquet files

java -jar target/osm-parquetizer-1.0.1-SNAPSHOT.jar ../test1/romania-latest.osm.pbf

1. The Python pyspark code to read the paraquete file and make subset on extent and save the shape file
2. Using the docker for https://hub.docker.com/r/airpollutionstudyindia/matplotlib and executing the code in the contianer

from pyspark.sql import SparkSession
from pyspark.sql.functions import col,explode

nishadhka

Handy vim commands

1. To save :w
2. to quit :q
3. to start nerdtree :NERDTREE
4. to move in nerdtree :ctrl+w
5. to close a file :ctrl+w+q
6. to select multple lines :v
7. to cut :d
8. to copy :y

nishadhka

"Source https://github.com/j1z0/vim-config/blob/master/vimrc
"vundle
set nocompatible
filetype off

set rtp+=~/.vim/bundle/Vundle.vim
call vundle#begin()

Plugin 'VundleVim/Vundle.vim'
"git interface

nishadhka

nishadhka

import numpy as np
import fiona
from shapely import geometry
import ee
ee.Initialize()
from gee_library import *
from rasterio.features import shapes
import geopandas as gp
import ntpath
import glob

nishadhka

nishadhka

import requests
import json

oauth_url = 'http://sample_ushahidinstance/platform/oauth/token'

oauth_d = {
  "grant_type": "password",
  "scope": "apikeys posts country_codes media forms api tags savedsearches sets users stats layers config messages notifications webhooks contacts roles permissions csv tos dataproviders",
  "client_id": "ushahidiui",
  "client_secret": "35e7f0bca957836d05ca0492211b0ac707671261",

nishadhka

Machine learning libraries of Python in Docker

The docker tar.gz'd is 2.4 GB in size, download from here

background and installed libraries in the docker

• to set up the new ubuntu docker image, it is 124MB in size,

  sudo docker search ubuntu
  sudo docker pull ubuntu