Shi Yue, Wang Feng, Li Pengcheng, Liu Yingbo. The Study of the Data Storage and Retrieval for the Massive Data of MUSER Based on Cassandra[J]. Astronomical Techniques and Instruments, 2018, 15(3): 361-368.
Citation: Shi Yue, Wang Feng, Li Pengcheng, Liu Yingbo. The Study of the Data Storage and Retrieval for the Massive Data of MUSER Based on Cassandra[J]. Astronomical Techniques and Instruments, 2018, 15(3): 361-368.

The Study of the Data Storage and Retrieval for the Massive Data of MUSER Based on Cassandra

  • Mingantu Ultrawide Spectral Radioheliograph produces massive observational data every day. When the data is stored and managed by traditional relational database, problems appear, such as high latency in reading and writing, limited expansion capacity in performance and storage, and weak usability. In order to solve the problems, in this paper, researches on the application of MUSER data storage based on NoSQL has been carried out. First of all, we thoroughly analyze the characteristics of MUSER data, the requirement of storage and relating problems in detail. Secondly, the MUSER data model is given as well as the MUSER column non-relational data model. The metadata and data are synchronized in NoSQL based on Cassandra. The MUSER massive astronomical data storage management system (MBDMS) is realized based on Cassandra. The experiment validates the efficiency, expansibility and feasibility of data storage and retrieval of the system. As a result, MBDMS can well meet MUSER data management needs, is an effective program to solve the current MUSER data storage problem.
  • loading

Catalog

    Turn off MathJax
    Article Contents

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return