Skip to content

Instantly share code, notes, and snippets.

View flash1293's full-sized avatar
🐿️
workin' on stuff

Joe Reuter flash1293

🐿️
workin' on stuff
View GitHub Profile
@flash1293
flash1293 / certified_connectors.sh
Created January 26, 2024 16:38
airbyte-lib connector migration
#!/bin/bash
certified_connectors=()
# Loop through all source-* folders
for dir in airbyte-integrations/connectors/source-*; do
if [ -d "$dir" ]; then
# Convert folder name to snake_case
snake_cased_name=$(echo "$(basename "$dir")" | sed 's/-/_/g')
@flash1293
flash1293 / mermaid.chart
Last active January 9, 2024 17:02
airbyte-lib cache / sync result digram
---
title: airbyte_lib
---
classDiagram
VenvExecutor <|-- Executor
PathExecutor <|-- Executor
class Executor{
+execute(args: List[str]) IO[str]
+ensure_installation()
+ConnectorMetadata connector
@flash1293
flash1293 / convert.sh
Last active January 12, 2024 11:19
airbyte-lib converter script
#!/bin/bash
# Install github cli: brew install gh
# Check if an argument was provided
if [ -z "$1" ]; then
echo "Please provide a folder name."
exit 1
fi
This file has been truncated, but you can view the full file.
{"url":"https://d3v-airbyte.zendesk.com/api/v2/tickets/129.json","id":129,"external_id":null,"via":{"channel":"api","source":{"from":{},"to":{},"rel":null}},"created_at":"2022-07-18T15:54:21Z","updated_at":"2022-07-18T17:01:22Z","type":null,"subject":"Billing Error on Latest Invoice","raw_subject":"Billing Error on Latest Invoice","description":"My latest invoice (#4567) generated through QuickBill has charges for Premium Support, which I didn't opt for. Need a corrected invoice ASAP.","priority":null,"status":"new","recipient":null,"requester_id":360786799676,"submitter_id":360786799676,"assignee_id":null,"organization_id":360033549136,"group_id":null,"collaborator_ids":[],"follower_ids":[],"email_cc_ids":[],"forum_topic_id":null,"problem_id":null,"has_incidents":false,"is_public":true,"due_at":null,"tags":[],"custom_fields":[],"satisfaction_rating":{"score":"offered"},"sharing_agreement_ids":[],"custom_status_id":4044356,"fields":[],"followup_ids":[],"ticket_form_id":360000084116,"brand_id":360000358316,"al
col1 col2
Does alwaysyyy usexxxmain separators yyyfirst xxx
This file has been truncated, but you can view the full file.
{"type": "RECORD", "record": {"stream": "example_stream", "data": { "title": " a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a a
@flash1293
flash1293 / manifest.yaml
Created August 15, 2023 14:00
Created with UI, failing validation
version: 0.50.2
type: DeclarativeSource
check:
type: CheckStream
stream_names:
- pokemon listX
streams:
- type: DeclarativeStream
name: pokemon listX
primary_key: []
@flash1293
flash1293 / manifest.json
Created July 19, 2023 13:16
Slack App manifest for connector development help bot
{
"display_information": {
"name": "Connector Development Helper Bot",
"description": "Helpful bot to answer questions around connector development",
"background_color": "#303133"
},
"features": {
"bot_user": {
"display_name": "Airbyte Connector Dev Help",
"always_online": false
We can make this file beautiful and searchable if this error is corrected: Unclosed quoted field in line 5.
id,paragraph,title,url,modified_date
1,"Software Engineering is a systematic approach to the development, operation, maintenance, and retirement of software. The software engineering process is one that is complicated, but with discipline, education, and guidance, successful software can be created.","Introduction to Software Engineering","https://www.example.com/intro-to-software-engineering","2023-06-25"
2,"Agile software development refers to software development methodologies centered round the idea of iterative development, where requirements and solutions evolve through collaboration.","Agile Development Explained","https://www.example.com/agile-development-explained","2023-06-26"
3,"DevOps is a set of practices that combines software development and IT operations. It aims to shorten the systems development life cycle and provide continuous delivery with high software quality.","Understanding DevOps","https://www.example.com/understanding-devops","2023-06-26"
4,"Object-oriented programming (OOP) is a pr
@flash1293
flash1293 / exchange_rates_tutorial.yaml
Created June 20, 2023 11:00
Working state without transformation
version: 0.40.5
type: DeclarativeSource
check:
type: CheckStream
stream_names:
- Rates
streams:
- type: DeclarativeStream
name: Rates
primary_key: []