Skip to content

Instantly share code, notes, and snippets.

View d33bs's full-sized avatar
🪴
Software gardening...

Dave Bunten d33bs

🪴
Software gardening...
View GitHub Profile
import pandas as pd
import numpy as np
import pyarrow as pa
import pyarrow.parquet as pq
import os
# Constants for the table dimensions and chunk size
n_rows = 10000
n_cols = 5000
chunk_size = 1000
SELECT
image.Image_TableNumber,
image.Metadata_ImageNumber,
image.Metadata_Plate,
image.Metadata_Well,
image.Image_Metadata_Site,
image.Image_Metadata_Row,
cytoplasm.* EXCLUDE (Metadata_ImageNumber),
cells.* EXCLUDE (Metadata_ImageNumber),
nuclei.* EXCLUDE (Metadata_ImageNumber)