Skip to content

Instantly share code, notes, and snippets.

@catawbasam
catawbasam / ndjson2sqlite
Created September 4, 2021 17:28
load ndjson into a pandas dataframe then save to sqlite
"""load ndjson into a Pandas dataframe. then save to sqlite. """
import json
import pandas as pd
#load
path = 'data.ndjson'
with open(path,'rt', encoding='utf-8') as f:
lines = f.readlines()
print('# lines', len(lines))
@catawbasam
catawbasam / juliadb_logo.svg
Created November 4, 2015 11:56
A logo for juliadb. This image is made available under the MIT license.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
@catawbasam
catawbasam / gist:81b7a15f6de004540eaa
Last active August 29, 2015 14:20
Julia24.ipynb
{
"metadata": {
"language": "Julia",
"name": ""
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
"cells": [
@catawbasam
catawbasam / gist:3ab68615b4c78a5a49b1
Created August 20, 2014 23:07
Julia Char predicates draft
{
"metadata": {
"language": "Julia",
"name": "",
"signature": "sha256:e80d1a82f7cdd977679c61b2cbabab28b09bb50363bbf45c783529686408d275"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
@catawbasam
catawbasam / bench_islower
Last active August 29, 2015 14:05
Julia islower(Char) and islower(String) benchmarks: Base, utf8proc, PCRE
{
"metadata": {
"language": "Julia",
"name": "",
"signature": "sha256:679974b4916c36603648466accbc9c2838242618d92c33c0fcb81297a9e11a79"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
@catawbasam
catawbasam / gist:e1768937952565213561
Created June 18, 2014 19:27
abstract_anonymous_after
{
"metadata": {
"language": "Julia",
"name": "",
"signature": "sha256:e4991cde234b104b1f7077d9c0d16d41f1d359e58c1c2f3900573a7b513d4566"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
{
"metadata": {
"language": "Julia",
"name": "",
"signature": "sha256:6fe564fd5807e59cc459bd6bedc3dd57d1c56c392f17ce2401e0ba3677d8161a"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
@catawbasam
catawbasam / gist:99043bb74519378428fd
Last active August 29, 2015 14:02
Julia SubString: isvalid ind2chr chr2ind
{
"metadata": {
"language": "Julia",
"name": "",
"signature": "sha256:64712e134a63248c7287bc1cf7858ccd7adc08a2821cce960ef95b28f51ce2e2"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
@catawbasam
catawbasam / DataFrames.jl push!
Created June 10, 2014 11:29
draft of push!(df::DataFrame, iterable)
{
"metadata": {
"language": "Julia",
"name": "",
"signature": "sha256:7fe5fda6897de221effe8497f91c4705de9d01b5396e52caecc256d571986d30"
},
"nbformat": 3,
"nbformat_minor": 0,
"worksheets": [
{
@catawbasam
catawbasam / lineread_mmap.ipynb
Created April 2, 2014 15:18
Faster, memory-efficient line-oriented text processing in Julia using mmap array
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.