An AIPS-based, distributed processing method for large radio interferometric datasets

Stephen Bourke; Huib Jan van Langevelde; Karl Torstensson; Aaron Golden

doi:10.1007/s10686-012-9315-0

An AIPS-based, distributed processing method for large radio interferometric datasets

Stephen Bourke, Huib Jan van Langevelde, Karl Torstensson, Aaron Golden

Genetics

Research output: Contribution to journal › Article › peer-review

Abstract

The data output rates of modern radio interferometric telescopes make the traditional data reduction process impractical in many cases. We report on the implementation of a lightweight infrastructure, named AIPSLite, that enables the deployment of AIPS interferometric processing routines on distributed systems in an autonomous and fault tolerant manner. We discuss how this approach was used to search for sources of 6.7 GHz methanol maser emission in the Cep A region with the European VLBI Network (EVN). The field was searched out to a radius of 1.25 min^-1 at milli-arcsecond spatial resolution and 1024 frequency channels with 0.088 km s^-1 velocity resolution. The imaged data was on the order of 30 TB. Processing was performed on 128 processors of the Irish Centre for High End Computing (ICHEC) linux cluster with a run time of 42 h, and a total of 212 CPU days.

Original language	English (US)
Pages (from-to)	59-76
Number of pages	18
Journal	Experimental Astronomy
Volume	36
Issue number	1-2
DOIs	https://doi.org/10.1007/s10686-012-9315-0
State	Published - Aug 2013

Keywords

AIPS
AIPSLite
Distributed processing
Interferometry data processing
ParselTongue

ASJC Scopus subject areas

Astronomy and Astrophysics
Space and Planetary Science

Access to Document

10.1007/s10686-012-9315-0

Cite this

@article{f3e14a9c33d04d86a926a9d68cf392bc,

title = "An AIPS-based, distributed processing method for large radio interferometric datasets",

abstract = "The data output rates of modern radio interferometric telescopes make the traditional data reduction process impractical in many cases. We report on the implementation of a lightweight infrastructure, named AIPSLite, that enables the deployment of AIPS interferometric processing routines on distributed systems in an autonomous and fault tolerant manner. We discuss how this approach was used to search for sources of 6.7 GHz methanol maser emission in the Cep A region with the European VLBI Network (EVN). The field was searched out to a radius of 1.25 min-1 at milli-arcsecond spatial resolution and 1024 frequency channels with 0.088 km s-1 velocity resolution. The imaged data was on the order of 30 TB. Processing was performed on 128 processors of the Irish Centre for High End Computing (ICHEC) linux cluster with a run time of 42 h, and a total of 212 CPU days.",

keywords = "AIPS, AIPSLite, Distributed processing, Interferometry data processing, ParselTongue",

author = "Stephen Bourke and {van Langevelde}, {Huib Jan} and Karl Torstensson and Aaron Golden",

note = "Funding Information: Acknowledgements George Heald is thanked for his useful comments on the manuscript. Salvador Curiel is thanked for his continuum image of Cep A. S.B. acknowledges support by Enterprise Ireland, Science Foundation Ireland, and the Higher Education Authority. K.T. acknowledges support by the EU Framework 6 Marie Curie Early Stage Training programme under contract number MEST-CT-2005-19669 “ESTRELA”. This effort is supported by the European Community Framework Programme 7, Advanced Radio Astronomy in Europe, grant agreement no.: 227290. ParselTongue was developed in the context of the ALBUS project, which has benefited from research funding from the European Community{\textquoteright}s sixth Framework Programme under RadioNet R113CT 2003 5058187. The authors wish to acknowledge the SFI/HEA Irish Centre for High-End Computing (ICHEC) for the provision of computational facilities and support.",

year = "2013",

month = aug,

doi = "10.1007/s10686-012-9315-0",

language = "English (US)",

volume = "36",

pages = "59--76",

journal = "Experimental Astronomy",

issn = "0922-6435",

publisher = "Springer Netherlands",

number = "1-2",

}

TY - JOUR

T1 - An AIPS-based, distributed processing method for large radio interferometric datasets

AU - Bourke, Stephen

AU - van Langevelde, Huib Jan

AU - Torstensson, Karl

AU - Golden, Aaron

N1 - Funding Information: Acknowledgements George Heald is thanked for his useful comments on the manuscript. Salvador Curiel is thanked for his continuum image of Cep A. S.B. acknowledges support by Enterprise Ireland, Science Foundation Ireland, and the Higher Education Authority. K.T. acknowledges support by the EU Framework 6 Marie Curie Early Stage Training programme under contract number MEST-CT-2005-19669 “ESTRELA”. This effort is supported by the European Community Framework Programme 7, Advanced Radio Astronomy in Europe, grant agreement no.: 227290. ParselTongue was developed in the context of the ALBUS project, which has benefited from research funding from the European Community’s sixth Framework Programme under RadioNet R113CT 2003 5058187. The authors wish to acknowledge the SFI/HEA Irish Centre for High-End Computing (ICHEC) for the provision of computational facilities and support.

PY - 2013/8

Y1 - 2013/8

N2 - The data output rates of modern radio interferometric telescopes make the traditional data reduction process impractical in many cases. We report on the implementation of a lightweight infrastructure, named AIPSLite, that enables the deployment of AIPS interferometric processing routines on distributed systems in an autonomous and fault tolerant manner. We discuss how this approach was used to search for sources of 6.7 GHz methanol maser emission in the Cep A region with the European VLBI Network (EVN). The field was searched out to a radius of 1.25 min-1 at milli-arcsecond spatial resolution and 1024 frequency channels with 0.088 km s-1 velocity resolution. The imaged data was on the order of 30 TB. Processing was performed on 128 processors of the Irish Centre for High End Computing (ICHEC) linux cluster with a run time of 42 h, and a total of 212 CPU days.

AB - The data output rates of modern radio interferometric telescopes make the traditional data reduction process impractical in many cases. We report on the implementation of a lightweight infrastructure, named AIPSLite, that enables the deployment of AIPS interferometric processing routines on distributed systems in an autonomous and fault tolerant manner. We discuss how this approach was used to search for sources of 6.7 GHz methanol maser emission in the Cep A region with the European VLBI Network (EVN). The field was searched out to a radius of 1.25 min-1 at milli-arcsecond spatial resolution and 1024 frequency channels with 0.088 km s-1 velocity resolution. The imaged data was on the order of 30 TB. Processing was performed on 128 processors of the Irish Centre for High End Computing (ICHEC) linux cluster with a run time of 42 h, and a total of 212 CPU days.

KW - AIPS

KW - AIPSLite

KW - Distributed processing

KW - Interferometry data processing

KW - ParselTongue

UR - http://www.scopus.com/inward/record.url?scp=84881224688&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84881224688&partnerID=8YFLogxK

U2 - 10.1007/s10686-012-9315-0

DO - 10.1007/s10686-012-9315-0

M3 - Article

AN - SCOPUS:84881224688

SN - 0922-6435

VL - 36

SP - 59

EP - 76

JO - Experimental Astronomy

JF - Experimental Astronomy

IS - 1-2

ER -

An AIPS-based, distributed processing method for large radio interferometric datasets

Abstract

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this