Efficient data method and system in distributed storage system

Robert Cypher,Sean Quinlan, Steven Robert Schirripa,Lidor Carmi, Christian Eric Schrock

user-5edf3a5a4c775e09d87cc848(2020)

引用 17|浏览43
暂无评分
摘要
The present invention provides a method and a system for distributing data in a distributed storage system. The method comprises the following steps of: receiving a file on data processing hardware; dividing the file received by the data processing hardware into blocks, wherein the blocks are data blocks and non-data blocks; grouping the blocks into a group by the data processing hardware; determining, by data processing hardware, a distribution of blocks of a group among storage devices of a distributed storage system based on a maintenance hierarchy of the distributed storage system, the maintenance hierarchy comprising hierarchical maintenance levels and maintenance domains, each maintenance domain having an active state or an inactive state, each storage device being associated with atleast one maintenance domain; and distributing group blocks to the storage devices by the data processing hardware according to the determined distribution, the group blocks being distributed among the plurality of maintenance domains to maintain an ability to reconstruct the blocks of the group while the maintenance domains are inactive.
更多
查看译文
关键词
Distributed data store,Data processing,Distributed computing,Computer science,Division (mathematics),Hierarchy,Active state
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要