Research on the Consistency of FITS Data in the Process of Distributed Real-time Storage

In the process of a distributed high-speed real-time storage of data from a large solar telescope, inconsistency occurs between FITS header, a kind of meta-data, and FITS data files, which causes applications unable to retrieve correct FITS data files when applying the index information built on the meta-data. In this paper, models of consistency between the above-mentioned two types of data are studied during high-speed data storage; and the mechanism and solutions are summarized to achieve consistency for real-time data storage. A two-phase commit protocol (2PC) is proposed to ensure consistency, and 2PC algorithm implementation in high-speed data storage is given. The present study on different applications of data storage, with its unique research process and methods, can serve as references to other fields of scientific study.