← Back to rubinobservatory.org

Investigating interoperability of the LSST data management software stack with Astropy.

Jenness, Timothy
Bosch, J.; Owen, R.; Parejko, J.; Sick, J.; Swinbank, J.; de Val-Borro, M.; Dubois-Felsmann, G.; Lim, K-T.; Lupton, R.H.; Schellart, P.; Krughoff, S.; Tollerud, E.J.
Timothy Jenness ; James Bosch ; Russell Owen ; John Parejko ; Jonathan Sick, et al. " Investigating interoperability of the LSST data management software stack with Astropy ", Proc. SPIE 9913, Software and Cyberinfrastructure for Astronomy IV, 99130G (July 26, 2016); doi:10.1117/12.2231313; http://dx.doi.org/10.1117/12.2231313
Publication Date: 
Tuesday, July 26, 2016
Type: 
Conference Papers
SPIE
Citable: 
no
Category: 
SPIE Proceedings
Volume: 
9913
Abstract: 
The Large Synoptic Survey Telescope (LSST) will be an 8.4m optical survey telescope sited in Chile and capable of imaging the entire sky twice a week. The data rate of approximately 15TB per night and the requirements to both issue alerts on transient sources within 60 seconds of observing and create annual data releases means that automated data management systems and data processing pipelines are a key deliverable of the LSST construction project. The LSST data management software has been in development since 2004 and is based on a C++ core with a Python control layer. The software consists of nearly a quarter of a million lines of code covering the system from fundamental WCS and table libraries to pipeline environments and distributed process execution. The Astropy project began in 2011 as an attempt to bring together disparate open source Python projects and build a core standard infrastructure that can be used and built upon by the astronomy community. This project has been phenomenally successful in the years since it has begun and has grown to be the de facto standard for Python software in astronomy. Astropy brings with it considerable expectations from the community on how astronomy Python software should be developed and it is clear that by the time LSST is fully operational in the 2020s many of the prospective users of the LSST software stack will expect it to be fully interoperable with Astropy. In this paper we describe the overlap between the LSST science pipeline software and Astropy software and investigate areas where the LSST software provides new functionality. We also discuss the possibilities of re-engineering the LSST science pipeline software to build upon Astropy, including the option of contributing affliated packages. © (2016) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only
Publication-113
Reviewed Under: 
LSST Project Publication Policy
Bibtex reference: 
@proceeding{doi:10.1117/12.2231313, author = {Jenness, Timothy and Bosch, James and Owen, Russell and Parejko, John and Sick, Jonathan and Swinbank, John and de Val-Borro, Miguel and Dubois-Felsmann, Gregory and Lim, K.-T. and Lupton, Robert H. and Schellart, Pim and Krughoff, K. S. and Tollerud, Erik J.}, title = { Investigating interoperability of the LSST data management software stack with Astropy }, journal = {Proc. SPIE}, volume = {9913}, number = {}, pages = {99130G-99130G-13}, abstract = { The Large Synoptic Survey Telescope (LSST) will be an 8.4m optical survey telescope sited in Chile and capable of imaging the entire sky twice a week. The data rate of approximately 15TB per night and the requirements to both issue alerts on transient sources within 60 seconds of observing and create annual data releases means that automated data management systems and data processing pipelines are a key deliverable of the LSST construction project. The LSST data management software has been in development since 2004 and is based on a C++ core with a Python control layer. The software consists of nearly a quarter of a million lines of code covering the system from fundamental WCS and table libraries to pipeline environments and distributed process execution. The Astropy project began in 2011 as an attempt to bring together disparate open source Python projects and build a core standard infrastructure that can be used and built upon by the astronomy community. This project has been phenomenally successful in the years since it has begun and has grown to be the de facto standard for Python software in astronomy. Astropy brings with it considerable expectations from the community on how astronomy Python software should be developed and it is clear that by the time LSST is fully operational in the 2020s many of the prospective users of the LSST software stack will expect it to be fully interoperable with Astropy. In this paper we describe the overlap between the LSST science pipeline software and Astropy software and investigate areas where the LSST software provides new functionality. We also discuss the possibilities of re-engineering the LSST science pipeline software to build upon Astropy, including the option of contributing affliated packages. }, year = {2016}, doi = {10.1117/12.2231313}, URL = { http://dx.doi.org/10.1117/12.2231313}, eprint = {} }

Financial support for Rubin Observatory comes from the National Science Foundation (NSF) through Cooperative Agreement No. 1258333, the Department of Energy (DOE) Office of Science under Contract No. DE-AC02-76SF00515, and private funding raised by the LSST Corporation. The NSF-funded Rubin Observatory Project Office for construction was established as an operating center under management of the Association of Universities for Research in Astronomy (AURA).  The DOE-funded effort to build the Rubin Observatory LSST Camera (LSSTCam) is managed by the SLAC National Accelerator Laboratory (SLAC).
The National Science Foundation (NSF) is an independent federal agency created by Congress in 1950 to promote the progress of science. NSF supports basic research and people to create knowledge that transforms the future.
NSF and DOE will continue to support Rubin Observatory in its Operations phase. They will also provide support for scientific research with LSST data.   




Contact   |   We are Hiring

Admin Login

Back to Top