Data Organization Method of Space Astronomical Satellite Based on Heterogeneous Database

With the increase of the space astronomical satellite data volume, data applications have gradually played an important role. Data applications such as research on space astronomical targets, payload status monitoring, spatial target analysis, detection plan assistance formulation, detection process visualization, etc., all require the processing and analysis of multi-source massive data such as detection target information, satellite platform parameters, and payload parameters. In order to realize the rapid extraction of characteristic data, this paper proposes a new method of data organization for space detection satellites. The method extractes massive characteristic parameters from data files, and establishes the association of observation time, spatial location and characteristic parameters, so as to realize multi-source data organization under a unified time and space frame. Then, using the heterogeneous storage method of the combination of SQL database and No-SQL database, a characteristic parameter storage management system of 10 billion or even 100 billion is designed. The method in this paper is applied to the space science satellite big data application platform system. The experimental results of using HXMT (hard X-ray modulation telescope) satellite data show that the system can nicely meet the requirements of obtaining data according to time and space conditions; compared with relational database data organization method, the data retrieval efficiency under the same query mode is significantly improved; and with the increase of data storage capacity, the system has stable expansion capabilities.