Erasure Correction of Scalar Codes in the Presence of Stragglers

2018 IEEE International Symposium on Information Theory (ISIT)(2018)

引用 6|浏览39
暂无评分
摘要
Recent advances in coding for distributed storage systems have reignited the interest in scalar codes over extension fields. In parallel, the rise of large-scale distributed systems has motivated the study of computing in the presence of stragglers, i.e., servers that are slow to respond or unavailable. This paper addresses storage systems that employ linear codes over extension fields. A common task in such systems is the reconstruction of the entire dataset using sequential symbol transmissions from multiple servers, which are received concurrently at a central data collector. However, a key bottleneck in the reconstruction process is the possible presence of stragglers, which may result in excessive latency. To mitigate the straggler effect, the reconstruction should be possible given any sufficiently large set of sequentially received symbols, regardless of their source. In what follows, an algebraic framework for this scenario is given, and a number of explicit constructions are provided. Our main result is a construction that uses a recursive composition of generalized Reed-Solomon codes over smaller fields. In addition, we show links of this problem to Gabidulin codes and to universally decodable matrices.
更多
查看译文
关键词
Gabidulin codes,erasure correction,scalar codes,distributed storage systems,large-scale distributed systems,linear codes,sequential symbol transmissions,central data collector,straggler effect,sequentially received symbols,generalized Reed-Solomon codes,universally decodable matrices
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要