Tagged

Tag: data engineering

Data

Data Observability Needs Product Thinking

Standard observability caught 78% of structural failures but only 11% of semantic failures. The undetected semantic failures caused 19x more business impact.

Data

SEC Filing Processing as Data Engineering Microcosm

Processing 47,000 SEC EDGAR filings revealed every core data engineering challenge in miniature: schema evolution, semi-structured extraction, and source-of-truth design.

Data

SQL Will Outlive Every Tool That Tried to Replace It

SQL has survived 5 decades and at least 12 replacement movements. Every alternative either adopted SQL semantics, built a SQL interface, or faded into niche…

Data

Python’s Gravity Well: Language Choice Shapes Architecture

Python is present in 92% of data pipeline codebases, creating path dependencies that constrain infrastructure for years. Its gravity well requires strategic, not revolutionary, escape.

Data

Designing Data Pipelines for Machine Consumers

AI agents consume more analytical data than humans at 3 of 5 organizations I work with. Machine consumers require fundamentally different quality contracts.

Data

The Modern Data Stack Died. Here Is What Replaced It

The modular Modern Data Stack collapsed under integration tax. The replacement is vertical integration with open escape hatches.

Data

Data Contracts Are API Contracts With Better Marketing

Data contracts are API contracts applied to data interfaces. Teams with service-oriented design experience can implement them in under two weeks.