A Study on Automatic Management of Compute Nodes Based on OpenStack for Observatory

Shao Cen; Deng Hui; Wang Feng; Wei Shoulin; Mei Ying; Shi Congming; Liang Bo; Dai Wei; Liu Cuiyin

Astronomical Research and Technology > 2017 > 14(2): 243-250.

Shao Cen, Deng Hui, Wang Feng, Wei Shoulin, Mei Ying, Shi Congming, Liang Bo, Dai Wei, Liu Cuiyin. A Study on Automatic Management of Compute Nodes Based on OpenStack for Observatory[J]. Astronomical Research and Technology, 2017, 14(2): 243-250.

Citation:

PDF (2398 KB)

A Study on Automatic Management of Compute Nodes Based on OpenStack for Observatory

1. Key Laboratory of Applications of Computer Technologies of the Yunnan Province, University of Science and Technology of Kunming, Kunming 650500, China;
2. Yunnan Observatories, Chinese Academy of Sciences, Kunming 650011, China

More Information

Received Date: June 20, 2016
Revised Date: July 11, 2016
Available Online: November 20, 2023

Graphical Abstract

Abstract

Abstract

Astronomical data processing is a very important part of astronomical research. With the rapid growth of function and observation capability of the new generation of telescopes, building a high performance real-time computing platform in observing sites and handling the data quickly have become a trend. Based on the real-time data processing system construction requirement of MUSER, this paper has systematically studied the implementation method based upon OpenStack local cloud and automation management pattern. We propose a strategy which can open or close compute nodes automatically and the experiments are carried out. Experiments show that this pattern can meet the needs of astronomical data processing completely and it is more efficient than other traditional data processing methods of static computing resources allocation. At the same time, it can efficiently save our energy bills and reduce the observing costs. This pattern has certain value for reference to build a high-performance computing platform for observatories in the future.
- Astronomical data processing,
- OpenStack,
- Automatic management

FullText(HTML)

References (10)

References

[1]	卫守林, 石聪明, 高姣姣, 等. Vantage Pro气象站实时数据采集与在MUSER中的应用研究[J]. 天文研究与技术, 2016, 13(1): 117-123. Wei Shoulin, Shi Congming, Gao Jiaojiao, et al. A study on the real-time collection of the Vantage Pro weather station and the application in the MUSER[J]. Astronomical Research & Technology, 2016, 13(1): 117-123.
[2]	周鑫磊, 王威, 王锋, 等. 基于QT的MUSER观测数据多屏图形化实时显示的设计与实现[J]. 天文研究与技术, 2015, 12(4): 503-509. Zhou Xinlei, Wang Wei, Wang Feng, et al. Design and implementation of a multi-monitor display system based on the QT for NAOC MUSER observations[J]. Astronomical Research & Technology, 2015, 12(4): 503-509.
[3]	颜毅华, 张坚, 陈志军, 等. 关于太阳厘米-分米波段频谱日像仪研究进展[J]. 天文研究与技术——国家天文台台刊, 2006, 3(2): 91-98. Yan Yihua, Zhang Jian, Chen Zhijun, et al. Progress on Chinese solar radioheliograph in cm-dm wavebands[J]. Astronomical Research & Technology——Publications of National Astronomical Observatories of China, 2006, 3(2): 91-98.
[4]	Liu Yingbo, Wang Feng, Deng Hui, et al. Low-cost high performance distributed data storage for multi-channel observations[J]. New Astronomy, 2015, 40: 78-86.
[5]	Rosado T, Bernardino J. An overview of openstack architecture[C]//Proceedings of the 18th International Database Engineering & Applications Symposium. 2014: 366-367.
[6]	Beernaert L, Matos M, Vilaca R, et al. Automatic elasticity in OpenStack[C]//Proceedings of the Workshop on Secure and Dependable Middleware for Cloud Monitoring and Management. 2012: 1-6.
[7]	Hu Bin, Yu Hong. Research of scheduling strategy on OpenStack[C]//Proceedings of the 2013 International Conference on Cloud Computing and Big Data. 2013: 191-196.
[8]	Zhang Y, Krishnan R, Sandhu R. Secure information and resource sharing in cloud infrastructure as a service[C]//Proceedings of the 2014 ACM Workshop on Information Sharing & Collaborative Security. 2014: 81-90.
[9]	Wang F, Mei Y, Deng H, et al. Distributed data-processing pipeline for mingantu ultrawide spectral radioheliograph[J]. Publications of the Astronomical Society of the Pacific, 2015, 127(950): 383-396.
[10]	梁宇, 杨海波, 李鸿彬, 等. 基于OpenStack资源监控系统[J]. 计算机系统应用, 2014, 29(4): 44-47. Liang Yu, Yang Haibo, Li Hongbin, et al. Resource monitoring system based on OpenStack[J]. Computer Systems & Applications, 2014, 29(4): 44-47.

Articles Related

[1]	Fu Xiachuan, Wu Chao, Huang Maohai, Zhang Mo, Lu Xiaomeng. Research and Implementation of Transient Quick Response and Automatic Observation System [J]. Astronomical Research and Technology, 2017, 14(4): 452-460.
[2]	Zhong Shoubo, Han Bo, Zhang Yanxia, Zhao Yongheng, He Boliang. Design and Implementation of a Software Tool Package for Managing Massive Astronomical Data [J]. Astronomical Research and Technology, 2015, 12(4): 510-517.
[3]	Zhang Jie, Huang Maohai. A Study of the Method for Software-Development Management of the Herschel Science Ground Segment [J]. Astronomical Research and Technology, 2015, 12(2): 212-218.
[4]	Fan Dongwei, Cui Chenzhou, Zhao Yongheng. Design and Implementation of a FITS File Manager [J]. Astronomical Research and Technology, 2011, 8(3): 306-314.
[5]	YANG Yong-hai, CHEN Dong, WANG Chuan-jun. Data Management Subsystem for the 2.4m Telescope of the Yunnan Observatory [J]. Astronomical Research and Technology, 2010, 7(2): 168-174.
[6]	ZHU Lan, ZUO Wei, LI Chun-lai. The Storage and Management of the Scientific Data for Chinese Lunar Exploration Project [J]. Astronomical Research and Technology, 2008, 5(4): 365-372.
[7]	LI Chang-hua, CUI Chen-zhou, LI Lian, ZHAO Yong-heng. Resource Information Management in Chinese Virtual Observatory [J]. Astronomical Research and Technology, 2008, 5(2): 125-130.
[8]	ZHANG Hao-jing, ZHANG Xiong, ZHENG Yong-gang, TANG Ling. IRAF Automatic Data Processing for the CCD Photometry of Blazars [J]. Astronomical Research and Technology, 2008, 5(2): 99-106.
[9]	GAO Dan, ZHANG Yan-xia, ZHAO Yong-heng. Automatization of Putting Astronomical Catalogues into Database [J]. Astronomical Research and Technology, 2007, 4(1): 53-58.
[10]	Hao Zhuliang, Jiang Shihua. Software for Microcomputer-Managed Scientific Articles [J]. Publications of the Yunnan Observatory, 1990, 0(3): 92-96.