A Lightweight Scientific Workflow System for Astronomical Data Processing

Due to the urgent requirements of massive data processing in astronomy,scientific workflow technique is being quickly adopted for distributed astronomical data processing.However,existing scientific workflow systems are over-complex and over-enormous in deployment and application so that few people can master them.In this paper we present a lightweight scientific workflow system,C-SWF,which is specially designed for astronomy.All required fundamental functions,such as task customization,data transfer,data provenance,and task re-run mechanisms,are fully implemented.In comparison to the existing scientific workflow systems,the C-SWF exhibits many unique features such as simplicity,high performance,and easy deployment,which make it meet the requirements of astronomers.