A Study on Automatic Management of Compute Nodes Based on OpenStack for Observatory

Shao Cen; Deng Hui; Wang Feng; Wei Shoulin; Mei Ying; Shi Congming; Liang Bo; Dai Wei; Liu Cuiyin

Astronomical Research and Technology > 2017 > 14(2): 243-250.

Shao Cen, Deng Hui, Wang Feng, Wei Shoulin, Mei Ying, Shi Congming, Liang Bo, Dai Wei, Liu Cuiyin. A Study on Automatic Management of Compute Nodes Based on OpenStack for Observatory[J]. Astronomical Research and Technology, 2017, 14(2): 243-250.

Citation:

PDF (2398 KB)

A Study on Automatic Management of Compute Nodes Based on OpenStack for Observatory

1. Key Laboratory of Applications of Computer Technologies of the Yunnan Province, University of Science and Technology of Kunming, Kunming 650500, China;
2. Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, China

More Information

Received Date: June 20, 2016
Revised Date: July 11, 2016
Available Online: November 20, 2023

Graphical Abstract

Abstract

Abstract

Astronomical data processing is a very important part of astronomical research. With the rapid growth of function and observation capability of the new generation of telescopes, building a high performance real-time computing platform in observing sites and handling the data quickly have become a trend. Based on the real-time data processing system construction requirement of MUSER, this paper has systematically studied the implementation method based upon OpenStack local cloud and automation management pattern. We propose a strategy which can open or close compute nodes automatically and the experiments are carried out. Experiments show that this pattern can meet the needs of astronomical data processing completely and it is more efficient than other traditional data processing methods of static computing resources allocation. At the same time, it can efficiently save our energy bills and reduce the observing costs. This pattern has certain value for reference to build a high-performance computing platform for observatories in the future.
- Astronomical data processing,
- OpenStack,
- Automatic management

FullText(HTML)

References (10)

References

[1]	卫守林, 石聪明, 高姣姣, 等. Vantage Pro气象站实时数据采集与在MUSER中的应用研究[J]. 天文研究与技术, 2016, 13(1): 117-123. Wei Shoulin, Shi Congming, Gao Jiaojiao, et al. A study on the real-time collection of the Vantage Pro weather station and the application in the MUSER[J]. Astronomical Research & Technology, 2016, 13(1): 117-123.
[2]	周鑫磊, 王威, 王锋, 等. 基于QT的MUSER观测数据多屏图形化实时显示的设计与实现[J]. 天文研究与技术, 2015, 12(4): 503-509. Zhou Xinlei, Wang Wei, Wang Feng, et al. Design and implementation of a multi-monitor display system based on the QT for NAOC MUSER observations[J]. Astronomical Research & Technology, 2015, 12(4): 503-509.
[3]	颜毅华, 张坚, 陈志军, 等. 关于太阳厘米-分米波段频谱日像仪研究进展[J]. 天文研究与技术——国家天文台台刊, 2006, 3(2): 91-98. Yan Yihua, Zhang Jian, Chen Zhijun, et al. Progress on Chinese solar radioheliograph in cm-dm wavebands[J]. Astronomical Research & Technology——Publications of National Astronomical Observatories of China, 2006, 3(2): 91-98.
[4]	Liu Yingbo, Wang Feng, Deng Hui, et al. Low-cost high performance distributed data storage for multi-channel observations[J]. New Astronomy, 2015, 40: 78-86.
[5]	Rosado T, Bernardino J. An overview of openstack architecture[C]//Proceedings of the 18th International Database Engineering & Applications Symposium. 2014: 366-367.
[6]	Beernaert L, Matos M, Vilaca R, et al. Automatic elasticity in OpenStack[C]//Proceedings of the Workshop on Secure and Dependable Middleware for Cloud Monitoring and Management. 2012: 1-6.
[7]	Hu Bin, Yu Hong. Research of scheduling strategy on OpenStack[C]//Proceedings of the 2013 International Conference on Cloud Computing and Big Data. 2013: 191-196.
[8]	Zhang Y, Krishnan R, Sandhu R. Secure information and resource sharing in cloud infrastructure as a service[C]//Proceedings of the 2014 ACM Workshop on Information Sharing & Collaborative Security. 2014: 81-90.
[9]	Wang F, Mei Y, Deng H, et al. Distributed data-processing pipeline for mingantu ultrawide spectral radioheliograph[J]. Publications of the Astronomical Society of the Pacific, 2015, 127(950): 383-396.
[10]	梁宇, 杨海波, 李鸿彬, 等. 基于OpenStack资源监控系统[J]. 计算机系统应用, 2014, 29(4): 44-47. Liang Yu, Yang Haibo, Li Hongbin, et al. Resource monitoring system based on OpenStack[J]. Computer Systems & Applications, 2014, 29(4): 44-47.