A Distributed Object Store built on Conventional File System

This is an emulation of a distributed store system built on Zoned Namespace SSDs. The system guarantees strong consistency and fault tolerant.

Abstract

FilelogKV is a distributed object storage system built on top of conventional file systems. It provides strong consistency and fault tolerance. It is an emulation of a distributed KV storage system which assumes the underlying storage devices are Zoned Namespace SSDs, whereby a “Zone Append” write semantic is used instead of conventional SSDs that depend on a flash translation layer. This project is suspended; currently works fine with below features:

  • Accept PUT/GET/DELETE requests; functions as a conventional KV storage system.
  • Failure tolerant as long as one gateway and one storage node are alive.
  • Strong consistency: aggressive crash recovery assuming the recovery manager does not fail during recovery.
  • Gateway nodes are scalable.

Available at GitHub.