You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Instantly share code, notes, and snippets.
Gordo Lowrey
gordol
seasoned architect, strategist, leader, and mentor with over 20 years of experience in software engineering, distributed systems, and enterprise architecture
This document proposes the adoption of a process to document the architectural decisions made during the software development process. ADRs aim to provide clarity, rationale, and context for important architectural decisions.
This document outlines a proposed process for documenting proposals, discussing ideas, and making decisions in a structured, transparent, and collaborative manner.
Architecture provides the foundation for aligning technical solutions with business goals, managing complexity and enabling efficient data processing, while ensuring that systems remain secure, performant, and adaptable to future needs. This document seeks to define architecture as a discipline, developing a culture where architectural thinking is embedded in daily practice. Architecture is not the sole responsibility of architects, but a shared discipline that drives consistency, scalability, and long-term success. By instilling architectural principles, all teams will create an ecosystem that is efficient, maintainable, and aligned with business objectives.
This document attempts to establish an Architect Engagement Process. The goal is to ensure structured, efficient, and scalable communication between the architect and various teams (product, engineering, data science, etc). This process outlines the primary architecture concerns, and defines how and when teams should engage for architectural consultation.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Corrupt data landing in s3 via aws_s3.query_export_to_s3 extension
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
-- When using aws_s3.query_export_to_s3, on Aurora Postgres, version 11, data is reliably and predictably corrupted at certain positions of the payloads that land in s3.
-- It seems that when data falls over a certain byte length, it is reset and resent mid-stream to s3.
-- We have been able to reproduce this positively, as well as reproduce a negative as well; ensuring that data falls at powers of 2 on even byte lengths seems to prevent this issue from occurring.
-- As the length of data increases, as does the frequency of the corruption. For small data sets, it may never surface.
-- You will see upon running this SQL that it occurs once in 100,000 records with 128+9 byte length records, twice for 256+9, and 4 times for 512+9, and so-on, where each record looks like {"A":""}\n where \n is a new line control character, amounting to 9 extra bytes on top of the value in the JSON objects.
Example code that flattens an arbitrarily nested array of integers into a flat array of integers.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
A simple little module to complete the prime number challenge. Includes 4 tests. This variant is using NumPy. To run the tests, run: `python -m unittest prime-challenge-numpy`
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters