Redis Data Structures: A Pythonic Interface for Distributed Data Structures
Introducing redis-data-structures - A Python library providing high-level, Redis-backed data structures with a clean, Pythonic interface.
Topic
System Design
A collection of 27 issues
Build your own Redis (2/5) - Redis Persistence
Following the previous post, now, we will talk about redis persistence. While primarily known as an in-memory database, Redis offers a sophisticated durability model through two complementary strategies: RDB snapshots and AOF logs. Let's dive deep into how these work, implementing our own RDB parser along the way.
Build your own Redis (1/5) - Redis Serialization Protocol and Concurrency Model
Redis represents a masterclass in systems design, particularly in how it balances performance with architectural elegance. Through implementing a Redis-compatible server via the CodeCrafters challenge, we'll deconstruct two fundamental architectural decisions that shape Redis's behavior: its wire protocol (RESP) and its event-driven concurrency model.
If you&
Building a Database From Scratch: Understanding LSM Trees and Storage Engines (Part 1)
Learn core database concepts by implementing a Python key-value store with crash recovery and efficient writes.
In this tutorial, we'll build a simple but functional database from scratch with Python. Through this hands-on project, we'll explore core database concepts like Write-Ahead Logging (WAL), Sorted String Tables
Concurrency Programming in Python: Thread vs. Process
Concurrency is a vital aspect of modern programming, allowing applications to perform multiple tasks simultaneously, thus improving efficiency and responsiveness. In Python, developers often face the choice between using threads or processes to achieve concurrency. This blog explores the differences between these two concurrency models, how they interact with Python&
Stability Patterns in Distributed Systems
In the complex world of distributed systems and microservices, ensuring system stability and reliability is paramount. Stability patterns provide a set of strategies to maintain the robustness of a system under varying conditions. This post will explore essential stability patterns, their principles, and practical examples of implementing them in distributed
Designing APIs for Microservices
In the world of microservices, APIs are the backbone that enables communication and data exchange between different services. Designing robust, scalable, and maintainable APIs is crucial for the success of any microservices architecture. In this post, we'll explore the best practices for designing microservices APIs, covering key aspects
ETL, ELT and Reverse ETL
In the world of data engineering, three acronyms frequently surface: ETL, ELT, and Reverse ETL. Each represents a different approach to data processing, catering to specific needs and scenarios. In this post, we'll break down these concepts, exploring their workflows, benefits, and use cases.
What is ETL?
ETL
The Evolution of Data Platform Architectures
In the ever-evolving landscape of data management, selecting the right data platform architecture is crucial for any organization aiming to leverage data as a strategic asset. Understanding the historical context and the evolution of various data architectures can help businesses identify the best fit for their specific needs. This post
Event-Driven Architecture
Event-driven architecture (EDA) is an architectural paradigm that promotes the production, detection, consumption, and reaction to events. In the context of microservices, EDA offers several benefits, including improved scalability, loose coupling, and enhanced system resilience. This post will explore the principles and benefits of EDA, delve into patterns like Event