Project Overview

    The UPStore project aims to provide a universal peer-to-peer storage for immutable data on network overlays. Beyond a simple storage system, UPStore provides a series of storage services to support other applications running over it. Furthermore, UPStore is designed to be an open architecture, in which the algorithm components can be extended or replaced by third-party components. Eventually, UPStore will be deployed on a large amount of nodes, and become a running storage infrastructure for other applications, so that it is not necessary for other decentralized systems to implement and deploy such a storage layer.

    The UPStore is a high available and reliable store built over highly unavailable and unreliable nodes. Therefore, the most significant challenge is how to place and maintain the redundant data to mask transient and permanent failures in system. We first conduct a thorough measurement and analysis of the dynamic natures in a peer-to-peer system for the design of effective and efficient mechanisms, and then present our system mechanisms according to our novel analysis models.

    The target environments of UPStore include both machine-room peers and wide-area peers. Now we are developing our first version, which will be running on a cluster of peers in machine room. This first version is designed to support an application, named CDAL (Chinese Digital Assets Library), which currently has a large amount of data, over 6.7T.

Support/Funding

    We gratefully acknowledge funding for UPStore from National Grand Fundamental Research 973 program of China under Grant No.2004CB318204. UPStore was also supported by National Natural Science Foundation of China under Grant No.90412008.