Repair Pipelining for Erasure-Coded Storage
Refereed conference paper presented and published in conference proceedings


Times Cited
Web of Science2WOS source URL (as at 16/08/2018) Click here for the latest count

Other information
AbstractWe propose repair pipelining, a technique that speeds up the repair performance in general erasure-coded storage. By pipelining the repair of failed data in small-size units across storage nodes, repair pipelining reduces the repair time to approximately the same as the normal read time to the same amount of data in homogeneous environments. We further extend repair pipelining for heterogeneous environments. We implement a repair pipelining prototype called ECPipe and integrate it as a middleware system into two open-source distributed storage systems HDFS and QFS. Experiments on a local testbed and Amazon EC2 show that repair pipelining significantly improves the performance of both degraded reads and full-node recovery over existing repair techniques.
All Author(s) ListRunhui Li, Xiaolu Li, Patrick P. C. Lee, Qun Huang
Name of ConferenceUSENIX Annual Technical Conference (USENIX ATC)
Start Date of Conference12/07/2017
End Date of Conference14/07/2017
Place of ConferenceSanta Clara, CA
Country/Region of ConferenceUnited States of America
Proceedings TitleProceedings of the 2017 USENIX Annual Technical Conference (USENIX ATC 2017)
Year2017
Pages567 - 579
ISBN978-1-931971-38-6
LanguagesEnglish-United States

Last updated on 2018-17-08 at 04:54