catawbasam catawbasam
catawbasam
/ ndjson2sqlite
Created
September 4, 2021 17:28
load ndjson into a pandas dataframe then save to sqlite
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| """load ndjson into a Pandas dataframe. then save to sqlite. """ | |
| import json | |
| import pandas as pd | |
| #load | |
| path = 'data.ndjson' | |
| with open(path,'rt', encoding='utf-8') as f: | |
| lines = f.readlines() | |
| print('# lines', len(lines)) |
catawbasam
/ juliadb_logo.svg
Created
November 4, 2015 11:56
A logo for juliadb. This image is made available under the MIT license.
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "metadata": { | |
| "language": "Julia", | |
| "name": "" | |
| }, | |
| "nbformat": 3, | |
| "nbformat_minor": 0, | |
| "worksheets": [ | |
| { | |
| "cells": [ |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "metadata": { | |
| "language": "Julia", | |
| "name": "", | |
| "signature": "sha256:e80d1a82f7cdd977679c61b2cbabab28b09bb50363bbf45c783529686408d275" | |
| }, | |
| "nbformat": 3, | |
| "nbformat_minor": 0, | |
| "worksheets": [ | |
| { |
catawbasam
/ bench_islower
Last active
August 29, 2015 14:05
Julia islower(Char) and islower(String) benchmarks: Base, utf8proc, PCRE
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "metadata": { | |
| "language": "Julia", | |
| "name": "", | |
| "signature": "sha256:679974b4916c36603648466accbc9c2838242618d92c33c0fcb81297a9e11a79" | |
| }, | |
| "nbformat": 3, | |
| "nbformat_minor": 0, | |
| "worksheets": [ | |
| { |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "metadata": { | |
| "language": "Julia", | |
| "name": "", | |
| "signature": "sha256:e4991cde234b104b1f7077d9c0d16d41f1d359e58c1c2f3900573a7b513d4566" | |
| }, | |
| "nbformat": 3, | |
| "nbformat_minor": 0, | |
| "worksheets": [ | |
| { |
catawbasam
/ abstractarray_anon_pre
Created
June 18, 2014 19:09
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "metadata": { | |
| "language": "Julia", | |
| "name": "", | |
| "signature": "sha256:6fe564fd5807e59cc459bd6bedc3dd57d1c56c392f17ce2401e0ba3677d8161a" | |
| }, | |
| "nbformat": 3, | |
| "nbformat_minor": 0, | |
| "worksheets": [ | |
| { |
catawbasam
/ gist:99043bb74519378428fd
Last active
August 29, 2015 14:02
Julia SubString: isvalid ind2chr chr2ind
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "metadata": { | |
| "language": "Julia", | |
| "name": "", | |
| "signature": "sha256:64712e134a63248c7287bc1cf7858ccd7adc08a2821cce960ef95b28f51ce2e2" | |
| }, | |
| "nbformat": 3, | |
| "nbformat_minor": 0, | |
| "worksheets": [ | |
| { |
catawbasam
/ DataFrames.jl push!
Created
June 10, 2014 11:29
draft of push!(df::DataFrame, iterable)
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "metadata": { | |
| "language": "Julia", | |
| "name": "", | |
| "signature": "sha256:7fe5fda6897de221effe8497f91c4705de9d01b5396e52caecc256d571986d30" | |
| }, | |
| "nbformat": 3, | |
| "nbformat_minor": 0, | |
| "worksheets": [ | |
| { |
catawbasam
/ lineread_mmap.ipynb
Created
April 2, 2014 15:18
Faster, memory-efficient line-oriented text processing in Julia using mmap array
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
NewerOlder