Automatic Deployment Method of Astronomical Application Software Based on Container Technology
-
Graphical Abstract
-
Abstract
The Square Kilometer Array(SKA) is under construction. And each sub-work package will also enter the critical design evaluation phase. The cloud-based and container-based technologies are the platform technologies that SKA Scientific Data Processor (SDP) may adopt in the future. This paper is aimed at the rapid deployment, operation and measurement requirements of astronomical application software faced by SDP ultra-large-scale massive data processing. It fully considers the complex operation environment of astronomical application software and the difficulty in deploying ultra-large-scale computing clusters in cloud computing environment. For this reason, a general automatic deployment method for astronomical application using Docker technology is systematically studied and presented. The paper takes SAGECaL, a calibration software commonly used for visibility function as an example. Firstly, the characteristics of SAGECaL and the difficulties in distributed deployment are analyzed. The automatic deployment method of SAGECaL distributed cluster based on Docker container technology is given. The experimental results show that the automatic deployment method proposed in this paper greatly improves the deployment efficiency of SAGECaL distributed cluster, and meets the needs of the project team to undertake the deployment and switching of the basic platform required for SKA-SDP related testing. At the same time, this work also provides useful ideas for the rapid deployment and implementation of other astronomical software in the cloud.
-
-