Distributed Systems

A technical walkthrough of the transformer attention block, the parallelism strategies used to distribute it (DP, TP, CP, PP), mixture-of-experts dispatch and combine, and the collective communication primitives and cost models underneath all of it.

A reliable-UDP proxy and Chandy-Lamport based snapshotting system for checkpointing and restoring live, distributed containerized applications.

Most FL strategies that claim to improve on FedAvg do not actually improve on FedAvg. Not on real hardware. Not under real conditions.

We introduce Flotilla, a flexible and lightweight FL platform designed for real-world edge environments, offering modular strategy …

In this poster, we introduce Flotilla, a modular, model-agnostic Federated Learning (FL) framework that supports synchronous …

In this poster, we explore a mechanism to detect obstacles within a distance ’d’ ahead of a visually impaired person (VIP) …

An overview of Google Spanner’s architecture, distributed transactions, and the TrueTime API, based on the paper by Corbett et al.

An overview of the Google File System (GFS), its architecture, design decisions, and the assumptions behind it, based on the paper by Ghemawat et al.

An in-depth look at VMware Fault Tolerance (FT) and how it achieves transparent failover for virtual machines using deterministic replay, based on the paper by Scales, Nelson, and Venkitachalam.