Sign in Subscribe

Topic

System Design

A collection of 26 issues

Build your own Redis (2/5) - Redis Persistence

Following the previous post, now, we will talk about redis persistence. While primarily known as an in-memory database, Redis offers a sophisticated durability model through two complementary strategies: RDB snapshots and AOF logs. Let's dive deep into how these work, implementing our own RDB parser along the way.

Build your own Redis (1/5) - Redis Serialization Protocol and Concurrency Model

Redis represents a masterclass in systems design, particularly in how it balances performance with architectural elegance. Through implementing a Redis-compatible server via the CodeCrafters challenge, we'll deconstruct two fundamental architectural decisions that shape Redis's behavior: its wire protocol (RESP) and its event-driven concurrency model. If you&

Building a Database From Scratch: Understanding LSM Trees and Storage Engines (Part 1)

Learn core database concepts by implementing a Python key-value store with crash recovery and efficient writes. In this tutorial, we'll build a simple but functional database from scratch with Python. Through this hands-on project, we'll explore core database concepts like Write-Ahead Logging (WAL), Sorted String Tables

Concurrency Programming in Python: Thread vs. Process

Concurrency is a vital aspect of modern programming, allowing applications to perform multiple tasks simultaneously, thus improving efficiency and responsiveness. In Python, developers often face the choice between using threads or processes to achieve concurrency. This blog explores the differences between these two concurrency models, how they interact with Python&

Stability Patterns in Distributed Systems

In the complex world of distributed systems and microservices, ensuring system stability and reliability is paramount. Stability patterns provide a set of strategies to maintain the robustness of a system under varying conditions. This post will explore essential stability patterns, their principles, and practical examples of implementing them in distributed

Designing APIs for Microservices

In the world of microservices, APIs are the backbone that enables communication and data exchange between different services. Designing robust, scalable, and maintainable APIs is crucial for the success of any microservices architecture. In this post, we'll explore the best practices for designing microservices APIs, covering key aspects

ETL, ELT and Reverse ETL

In the world of data engineering, three acronyms frequently surface: ETL, ELT, and Reverse ETL. Each represents a different approach to data processing, catering to specific needs and scenarios. In this post, we'll break down these concepts, exploring their workflows, benefits, and use cases. What is ETL? ETL

The Evolution of Data Platform Architectures

In the ever-evolving landscape of data management, selecting the right data platform architecture is crucial for any organization aiming to leverage data as a strategic asset. Understanding the historical context and the evolution of various data architectures can help businesses identify the best fit for their specific needs. This post

Event-Driven Architecture

Event-driven architecture (EDA) is an architectural paradigm that promotes the production, detection, consumption, and reaction to events. In the context of microservices, EDA offers several benefits, including improved scalability, loose coupling, and enhanced system resilience. This post will explore the principles and benefits of EDA, delve into patterns like Event

Ensuring Atomicity in Distributed Systems: Managing Transactions Across Microservices

In a relational database, a transaction is a series of operations that must be executed in a way that guarantees ACID properties: Atomicity, Consistency, Isolation, and Durability. Atomicity, the 'A' in ACID, ensures that all operations within a transaction are completed; otherwise, none of them are. This guarantees