Search results
12 resultsPrivacy-First Data Design — PII Handling Patterns
Tokenisation, pseudonymisation, encryption at rest, and right-to-deletion workflows.
Secrets Management for Data Platforms
HashiCorp Vault, AWS Secrets Manager, and patterns for rotating credentials safely.
Designing a Data Lake on AWS S3
Folder structure, naming conventions, lifecycle policies, and access patterns.
Container Registry Management and Image Lifecycle
Tagging conventions, vulnerability scanning, retention policies, and registry options.
Infrastructure as Code for Data Platforms with Terraform
Managing cloud data infrastructure reproducibly with Terraform.
Feature Stores — Bridging Data Engineering and ML
What a feature store is, online vs offline stores, and when to build vs buy.
Amazon Redshift — Architecture and Query Optimization
Distribution styles, sort keys, VACUUM, ANALYZE, and WLM tuning.
Orchestrating Pipelines with Apache Airflow
DAGs, operators, scheduling, and production best practices for Airflow.
API Gateway — Responsibilities and Implementation Patterns
Authentication, rate limiting, routing, request aggregation, and when not to use a gateway.
OAuth 2.0 and OIDC — Implementing Secure Third-Party Auth
Authorization code flow, PKCE, scopes, and integrating with identity providers.
Message Queue Patterns — SQS, RabbitMQ, and Dead Letter Queues
Fan-out, work queues, priority queues, and poison message handling.
Serverless Architecture — When Functions Work and When They Don't
Cold starts, event-driven patterns, cost model, and the right use cases.