Skip to content

Instantly share code, notes, and snippets.

Avatar

Mark Needham mneedham

View GitHub Profile
View Query.java
///usr/bin/env jbang "$0" "$@" ; exit $?
//DEPS org.apache.pinot:pinot-jdbc-client:0.8.0
//DEPS com.github.freva:ascii-table:1.2.0
// jbang Query.java "select * from customers limit 5"
// export JDBC_URL="jdbc:pinot://localhost:9000"
import static java.lang.System.*;
import java.sql.*;
import java.util.*;
View event.txt
event: message
id: [{"topic":"eqiad.mediawiki.recentchange","partition":0,"timestamp":1635935095001},{"topic":"codfw.mediawiki.recentchange","partition":0,"offset":-1}]
data: {"$schema":"/mediawiki/recentchange/1.0.0","meta":{"uri":"https://pl.wikipedia.org/wiki/Kategoria:Infoboksy_%E2%80%93_brakuj%C4%85ce_parametry_%E2%80%93_Jednostka_administracyjna_infobox","request_id":"45eb5803-f73b-410c-a640-c76c5d86d91f","id":"5a7ee8b2-fead-4d54-b6fc-4bb433a08e51","dt":"2021-11-03T10:24:55Z","domain":"pl.wikipedia.org","stream":"mediawiki.recentchange","topic":"eqiad.mediawiki.recentchange","partition":0,"offset":3410637559},"id":119002871,"type":"categorize","namespace":14,"title":"Kategoria:Infoboksy – brakujące parametry – Jednostka administracyjna infobox","comment":"usunięto [[:Sukhaura]] z kategorii","timestamp":1635935095,"user":"MalarzBOT","bot":true,"server_url":"https://pl.wikipedia.org","server_name":"pl.wikipedia.org","server_script_path":"/w","wiki":"plwiki","parsedcomment":"usunięto <a href=\"/wiki/Sukh
@mneedham
mneedham / app.py
Last active Jul 20, 2021
Streamlit/Pinot - dynamic selection of metric and time range
View app.py
import streamlit as st
from pinotdb import connect
import pandas as pd
import time
st.title("GitHub Events")
broker_port = 8000
conn = connect(host='localhost', port=broker_port, path='/query/sql', scheme='http')
@mneedham
mneedham / app.py
Last active Jul 20, 2021
Pinot queries rendered in Streamlit
View app.py
import streamlit as st
from pinotdb import connect
import pandas as pd
st.title("GitHub Events")
broker_port = 8000
conn = connect(host='localhost', port=broker_port, path='/query/sql', scheme='http')
query = f"""
@mneedham
mneedham / app.py
Created Jul 20, 2021
Streamlit app
View app.py
import streamlit as st
st.title("GitHub Events")
st.write("Welcome to our first Streamlit app")
@mneedham
mneedham / app.py
Last active Jul 20, 2021
Basic Pinot query rendered in Streamlit
View app.py
import streamlit as st
from pinotdb import connect
import pandas as pd
st.title("GitHub Events")
broker_port = 8000
conn = connect(host='localhost', port=broker_port, path='/query/sql', scheme='http')
query = f"""
@mneedham
mneedham / docker-compose.yml
Created Jul 19, 2021
Apache Pinot GitHubEventsQuickStart
View docker-compose.yml
version: '3'
services:
pinot:
image: apachepinot/pinot:0.7.1
command: "GitHubEventsQuickStart -personalAccessToken ${GITHUB_TOKEN}"
container_name: "pinot-github-events-quick-start"
ports:
- "9000:9000"
- "8000:8000"
View bumpme
Mon May 17 14:35:19 UTC 2021
@mneedham
mneedham / docker-compose.yml
Created Mar 5, 2020
GraphConnect 2020 - APOC Training
View docker-compose.yml
version: '3.7'
services:
neo4j:
image: neo4j:4.0.0-enterprise
container_name: "gc2020-apoc"
volumes:
- ./plugins:/plugins
- ./data:/data
- ./import:/import
@mneedham
mneedham / blog_domain.py
Last active Jan 29, 2022
Altair - Setting a custom date domain for the x axis
View blog_domain.py
# Code for https://markhneedham.com/blog/2020/01/14/altair-range-values-dates-axis/ blog post
import altair as alt
import pandas as pd
import datetime
df = pd.DataFrame( [
{"position": 40, "date": datetime.date(2019,9,5)},
{"position": 31, "date": datetime.date(2019,9,12)},
{"position": 19, "date": datetime.date(2019,9,19)},