A Lightweight Scientific Workflow System for Astronomical Data Processing

Deng Yunkun; Wang Feng; Deng Hui; Ji Kaifan

Astronomical Research and Technology > 2010 > 7(4): 338-343.

Deng Yunkun, Wang Feng, Deng Hui, Ji Kaifan. A Lightweight Scientific Workflow System for Astronomical Data Processing[J]. Astronomical Research and Technology, 2010, 7(4): 338-343.

Citation:

Deng Yunkun, Wang Feng, Deng Hui, Ji Kaifan. A Lightweight Scientific Workflow System for Astronomical Data Processing[J]. Astronomical Research and Technology, 2010, 7(4): 338-343.

Citation:

Deng Yunkun, Wang Feng, Deng Hui, Ji Kaifan. A Lightweight Scientific Workflow System for Astronomical Data Processing[J]. Astronomical Research and Technology, 2010, 7(4): 338-343.

PDF (1446 KB)

A Lightweight Scientific Workflow System for Astronomical Data Processing

1.
Key Lab of Computer Technology Application of Yunnan of the Kunming University of Science and Technology Kunming 650051, China
2.
Oxbridge College of the Kunming University of Science and Technology, Kunming 650093, China

More Information

Received Date: August 31, 2009
Revised Date: September 15, 2009
Published Date: October 14, 2010

Graphical Abstract

Abstract

Abstract

Due to the urgent requirements of massive data processing in astronomy,scientific workflow technique is being quickly adopted for distributed astronomical data processing.However,existing scientific workflow systems are over-complex and over-enormous in deployment and application so that few people can master them.In this paper we present a lightweight scientific workflow system,C-SWF,which is specially designed for astronomy.All required fundamental functions,such as task customization,data transfer,data provenance,and task re-run mechanisms,are fully implemented.In comparison to the existing scientific workflow systems,the C-SWF exhibits many unique features such as simplicity,high performance,and easy deployment,which make it meet the requirements of astronomers.
- Lightweight,
- Scientific workflow system,
- Data processing,
- Network grid

FullText(HTML)

References (12)

References

[1]	Astrogrid.Virtual Observatory Software for Astronomers[Z].http://www.astrogrid.org,2009.
[2]	Nvo.National Virtual Observatory[Z].http://www.us-vo.org,2009.
[3]	Kepler.Kepler Scientific Workflow[Z].http://www.kepler-project.org,2009.
[4]	Altintas I.Astrophysics Workflows in the Kepler System[Z].2008.
[5]	Aragon C R,Bailey S J,Poon S,et al.Sunfall:A Collaborative Visual Analytics System for Astrophysics[M].Los Alamitos,CA,USA:2007:0,219-220.
[6]	Deelman E,Singh G,Su M,et al.Pegasus:A framework for mapping complex scientific workflows onto distributed systems[J].Sci Program,2005,13(3):219-237.
[7]	Oinn T,Addis M,Ferris J,et al.Taverna:a tool for the composition and enactment of bioinformatics workflows[J].Bioinformatics,2004,20(17):3045-3054.
[8]	Taylor I,Shields M,Wang I,et al.Distributed P2P Computing within Triana:A Galaxy Visualization Test Case[C].IEEE Computer Society,2003,161.
[9]	Buyya R,Venugopal S.The Gridbus Toolkit for Service Oriented Grid and Utility Computing:An Overview and Status Report[Z].http://www.gridbus.org,2004.
[10]	崔辰州,赵永恒.中国虚拟天文台体系结构[J].天文研究与技术-国家天文台台刊,2004,1(2):140-151. Cui Chenzhou,Zhao Yongheng.Architecture of Chinese Virtual Observatory[J].Astronomical Research & Technology,2004,1(2):140-151.
[11]	杨阳,刘超,田海俊,等.VO数据访问服务客户端系统的设计与实现[J].天文研究与技术-国家天文台台刊,2008,5(3):234-240. Yang Yang,Liu Chao,Tian Haijun,et al.The Design and Implement of Client System of Virtual Observatory Data Access Service[J].Astronomical Research & Technology,2008,5(3):234-240.
[12]	Yu J,Buyya R.A taxonomy of scientific workflow systems for grid computing[J].Sigmod Rec,2005,34(3): 44-49.