Skip to content

Instantly share code, notes, and snippets.

@catawbasam
catawbasam / ndjson2sqlite
Created September 4, 2021 17:28
load ndjson into a pandas dataframe then save to sqlite
View ndjson2sqlite
"""load ndjson into a Pandas dataframe. then save to sqlite. """
import json
import pandas as pd
#load
path = 'data.ndjson'
with open(path,'rt', encoding='utf-8') as f:
lines = f.readlines()
print('# lines', len(lines))
@catawbasam
catawbasam / juliadb_logo.svg
Created November 4, 2015 11:56
A logo for juliadb. This image is made available under the MIT license.
View juliadb_logo.svg
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@catawbasam
catawbasam / gist:81b7a15f6de004540eaa
Last active August 29, 2015 14:20
Julia24.ipynb
View gist:81b7a15f6de004540eaa
{
"metadata": {
"language": "Julia",
"name": ""
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
"cells": [
@catawbasam
catawbasam / gist:3ab68615b4c78a5a49b1
Created August 20, 2014 23:07
Julia Char predicates draft
View gist:3ab68615b4c78a5a49b1
{
"metadata": {
"language": "Julia",
"name": "",
"signature": "sha256:e80d1a82f7cdd977679c61b2cbabab28b09bb50363bbf45c783529686408d275"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
@catawbasam
catawbasam / bench_islower
Last active August 29, 2015 14:05
Julia islower(Char) and islower(String) benchmarks: Base, utf8proc, PCRE
View bench_islower
{
"metadata": {
"language": "Julia",
"name": "",
"signature": "sha256:679974b4916c36603648466accbc9c2838242618d92c33c0fcb81297a9e11a79"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
@catawbasam
catawbasam / gist:e1768937952565213561
Created June 18, 2014 19:27
abstract_anonymous_after
View gist:e1768937952565213561
{
"metadata": {
"language": "Julia",
"name": "",
"signature": "sha256:e4991cde234b104b1f7077d9c0d16d41f1d359e58c1c2f3900573a7b513d4566"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
View abstractarray_anon_pre
{
"metadata": {
"language": "Julia",
"name": "",
"signature": "sha256:6fe564fd5807e59cc459bd6bedc3dd57d1c56c392f17ce2401e0ba3677d8161a"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
@catawbasam
catawbasam / gist:99043bb74519378428fd
Last active August 29, 2015 14:02
Julia SubString: isvalid ind2chr chr2ind
View gist:99043bb74519378428fd
{
"metadata": {
"language": "Julia",
"name": "",
"signature": "sha256:64712e134a63248c7287bc1cf7858ccd7adc08a2821cce960ef95b28f51ce2e2"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
@catawbasam
catawbasam / DataFrames.jl push!
Created June 10, 2014 11:29
draft of push!(df::DataFrame, iterable)
View DataFrames.jl push!
{
"metadata": {
"language": "Julia",
"name": "",
"signature": "sha256:7fe5fda6897de221effe8497f91c4705de9d01b5396e52caecc256d571986d30"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
@catawbasam
catawbasam / lineread_mmap.ipynb
Created April 2, 2014 15:18
Faster, memory-efficient line-oriented text processing in Julia using mmap array
View lineread_mmap.ipynb
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.