Search results
14 resultsObservability — Logs, Metrics, and Traces
Implementing the three pillars with OpenTelemetry and making them actionable.
Apache Kafka — Core Concepts and When to Use It
Topics, partitions, consumer groups, and the use cases where Kafka excels.
Microservices Communication — Sync vs Async Patterns
REST, gRPC, message queues, and choosing the right pattern for each interaction.
Designing a Reliable Webhook System
Delivery guarantees, signature verification, retry logic, and consumer best practices.
Change Data Capture (CDC) — Debezium and Log-Based CDC
How CDC works, why it beats polling, and how to implement it with Debezium.
Data Contracts — Formalising Agreements Between Producers and Consumers
Schema, SLAs, semantics, and how to enforce data contracts in practice.
Building a Data Catalog with DataHub
Ingestion, metadata, search, and making your catalog actually useful.
Message Queue Patterns — SQS, RabbitMQ, and Dead Letter Queues
Fan-out, work queues, priority queues, and poison message handling.
Data Mesh — Principles and Practical Implementation
Domain ownership, data products, self-serve infrastructure, and federated governance.
Schema Registry and Avro for Kafka Data Contracts
Why schema management matters for streaming pipelines and how to implement it.
API Testing Strategy — Unit, Integration, Contract, and E2E
Building a test pyramid that catches real bugs without slowing delivery.
Monitoring and Alerting for Data Pipelines
What to monitor, SLIs/SLOs for data, and building effective alerting.
Event-Driven Data Architecture Patterns
Event sourcing, CQRS, outbox pattern, and when event-driven beats request/response.
Secrets Management for Data Platforms
HashiCorp Vault, AWS Secrets Manager, and patterns for rotating credentials safely.