Evolution and adaptation of the VLT data flow system

Knudstrup, J.; Haggouchi, K.; Peron, M.; Quinn, Peter J.; Ballester, P.; Banse, Klaus; Canavan, Tim; Chavan, A. M.; Devillard, Nicolas; Dorigo, D.; Guirao, Carlos; Izzo, C.; Jung, Yves; Kornweibel, Nick; Mavros, Cynthia; Mekiffer, Gerhard; Modigliani, A.; Palsa, Ralf; Ricciardi, F.; Sabet, Cyrus; Sogni, F.; Vinther, J.; Wicenec, A.; Wiseman, Bruce; Zampieri, Stefano

doi:10.1117/12.460665

Cited by 4 publications

(2 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It therefore has to be embedded into the ESO Data Flow System, 8 which requires the entire system to be written in the C language using the ESO Common Pipeline (CPL 9 ) library. Like all pipelines for ESO instruments, the reduction modules are created as shared libraries with a plugin interface as used for the EsoRex and Gasgano tools.…”

Section: Boundary Conditionsmentioning

confidence: 99%

Design and capabilities of the MUSE data reduction software and pipeline

Weilbacher¹,

Streicher²,

Urrutia³

et al. 2012

SPIE Proceedings

146

View full text Add to dashboard Cite

MUSE, the Multi Unit Spectroscopic Explorer, 1 is an integral-field spectrograph under construction for the ESO VLT to see first light in 2013. It can record spectra of a 1 H ¢1 H field on the sky at a sampling of 0: HH 2¢0: HH 2, over a wavelength range from 4650 to 9300Å.The data reduction for this instrument is the process which converts raw data from the 24 CCDs into a combined datacube (with two spatial and one wavelength axis) which is corrected for instrumental and atmospheric effects. Since the instrument consists of many subunits (24 integral-field units, each slicing the light into 48 parts, i. e. 1152 regions with a total of almost 90000 spectra per exposure), this task requires many steps and is computationally expensive, in terms of processing speed, memory usage, and disk input/output.The data reduction software is designed to be mostly run as an automated pipeline and to fit into the open source environment of the ESO data flow as well as into a data management system based on AstroWISE. We describe the functionality of the pipeline, highlight details of new and unorthodox processing steps, discuss which algorithms and code could be used from other projects. Finally, we show the performance on both laboratory data as well as simulated scientific data.

show abstract

Section: Boundary Conditionsmentioning

confidence: 99%

Design and capabilities of the MUSE data reduction software and pipeline

Weilbacher¹,

Streicher²,

Urrutia³

et al. 2012

SPIE Proceedings

146

View full text Add to dashboard Cite

show abstract

“…The VLT Data Flow System has been in place since the opening of the first VLT Unit Telescope in 1998 and has been continuously evolving since then 1 . The procedure for proposal preparation in the Data Flow System 4 involves a Phase I and a Phase II proposal preparation.…”

Section: The Data Flow Conceptmentioning

confidence: 99%

VLT Interferometer Data Flow System: from observation preparation to data processing

Ballester¹,

Chavan²,

Glindemann³

et al. 2002

Observatory Operations to Optimize Scientific Return III

Self Cite

View full text Add to dashboard Cite

In this article we present the Data Flow System (DFS) for the Very Large Telescope Interferometer (VLTI). The Data Flow System is the VLT end-to-end software system for handling astronomical observations from the initial observation proposal phase through the acquisition, processing and control of the astronomical data. The Data Flow System was first installed for VLTI first fringes utilising the siderostats together with the VINCI instrument and is constantly being upgraded in phase with the VLTI commissioning. When completed the VLT Interferometer will make it possible to coherently combine up to three beams coming from the four VLT 8.2m telescopes as well as from a set of initially three 1.8m Auxiliary Telescopes, using a Delay Line tunnel and four interferometry instruments. Observations of objects with some scientific interest are already being carried out in the framework of the VLTI commissioning using siderostats and the VLT Unit Telescopes, making it possible to test tools under realistic conditions. These tools comprise observation preparation, pipeline processing and further analysis systems. Work is in progress for the commissioning of other VLTI science instruments such as MIDI and AMBER. These are planned for the second half of 2002 and first half of 2003 respectively. The DFS will be especially useful for service observing. This is expected to be an important mode of observation for the VLTI, which is required to cope with numerous observation constraints and the need for observations spread over extended periods of time.

show abstract

ESO’s new generation of exposure time calculators

Boffin,

Vinther,

Bazin

et al. 2024

Observatory Operations: Strategies, Processes, and Systems X

View full text Add to dashboard Cite

Users of astronomical observatories rely on Exposure Time Calculators (ETC) to prepare their proposals and then their observations. The ETC is therefore a crucial element in an observatory's data workflow and in particular is key to optimise the use of telescope times. This is also true for the La Silla Paranal Observatory and ESO has therefore embarked in a project to modernise its ETC, based on a python back-end and an Angular-based front-end, while also providing a programmatic interface. This ETC 2.0 has now been implemented for all the new Paranal and La Silla instruments (CRIRES, ERIS, HARPS/NIRPS, and 4MOST) and work is ongoing to implement it for MOONS. All the current ESO La Silla and Paranal instruments will also be migrated progressively, and the first one has been FORS2. The new ETC2 is based on the Instrument Packages, which should allow in the future a smooth interaction with the Phase 1 and Phase 2 observation preparation tools. Moreover, the ETC 2.0 framework has recently been upgraded and makes now use of the NgRx/Store technology in the front-end.

show abstract

Evolution and adaptation of the VLT data flow system

Cited by 4 publications

References 8 publications

Design and capabilities of the MUSE data reduction software and pipeline

Design and capabilities of the MUSE data reduction software and pipeline

VLT Interferometer Data Flow System: from observation preparation to data processing

ESO’s new generation of exposure time calculators

Contact Info

Product

Resources

About