Standardised formats and open-source analysis tools for the MAGIC telescopes data

Abe, S.; Abhir, J.; Abhishek, A.; Acciari, V. A.; Aguasca-Cabot, A.; Agudo, I.; Aniello, T.; Ansoldi, S.; Antonelli, L. A.; Arbet Engels, A.; Arcaro, C.; Artero, M.; Asano, K.; Babic, A.; Barres de Almeida, U.; Barrio, J. A.; Batkovic, I.; Bautista, A.; Baxter, J.; Becerra Gonzalez, J.; Bednarek, W.; Bernardini, E.; Bernete, J.; Berti, A.; Besenrieder, J.; Bigongiari, C.; Biland, A.; Blanch, O.; Bonnoli, G.; Bosnjak, Z.; Bronzini, E.; Burelli, I.; Busetto, G.; Campoy-Ordaz, A.; Carosi, A.; Carosi, R.; Carretero-Castrillo, M.; Castro-Tirado, A. J.; Cerasole, D.; Ceribella, G.; Chai, Y.; Cifuentes, A.; Colombo, E.; Contreras, J. L.; Cortina, J.; Covino, S.; D'Amico, G.; D'Elia, V.; Da Vela, P.; Dazzi, F.; De Angelis, A.; De Lotto, B.; de Menezes, R.; Delfino, M.; Delgado, J.; Di Pierro, F.; Di Tria, R.; Di Venere, L.; Dominis Prester, D.; Donini, A.; Dorner, D.; Doro, M.; Elsaesser, D.; Escudero, J.; Farina, L.; Fattorini, A.; Foffano, L.; Font, L.; Frose, S.; Fukami, S.; Fukazawa, Y.; Garcia Lopez, R. J.; Garczarczyk, M.; Gasparyan, S.; Gaug, M.; Giesbrecht Paiva, J. G.; Giglietto, N.; Giordano, F.; Gliwny, P.; Gradetzke, T.; Grau, R.; Green, D.; Green, J. G.; Gunther, P.; Hadasch, D.; Hahn, A.; Hassan, T.; Heckmann, L.; Herrera Llorente, J.; Hrupec, D.; Hutten, M.; Imazawa, R.; Ishio, K.; Jimenez Martinez, I.; Jormanainen, J.; Kayanoki, T.; Kerszberg, D.; Kluge, G. W.; Kobayashi, Y.; Kouch, P. M.; Kubo, H.; Kushida, J.; Lainez, M.; Lamastra, A.; Leone, F.; Lindfors, E.; Lombardi, S.; Longo, F.; Lopez-Coto, R.; Lopez-Moya, M.; Lopez-Oramas, A.; Loporchio, S.; Lorini, A.; Lyard, E.; Machado de Oliveira Fraga, B.; Majumdar, P.; Makariev, M.; Maneva, G.; Manganaro, M.; Mangano, S.; Mannheim, K.; Mariotti, M.; Martinez, M.; Martinez-Chicharro, M.; Mas-Aguilar, A.; Mazin, D.; Menchiari, S.; Mender, S.; Miceli, D.; Miener, T.; Miranda, J. M.; Mirzoyan, R.; Molero Gonzalez, M.; Molina, E.; Mondal, H. A.; Moralejo, A.; Morcuende, D.; Nakamori, T.; Nanci, C.; Neustroev, V.; Nickel, L.; Nievas Rosillo, M.; Nigro, C.; Nikolic, L.; Nishijima, K.; Njoh Ekoume, T.; Noda, K.; Nozaki, S.; Ohtani, Y.; Okumura, A.; Otero-Santos, J.; Paiano, S.; Paneque, D.; Paoletti, R.; Paredes, J. M.; Peresano, M.; Persic, M.; Pihet, M.; Pirola, G.; Podobnik, F.; Prada Moroni, P. G.; Prandini, E.; Principe, G.; Priyadarshi, C.; Rhode, W.; Ribo, M.; Rico, J.; Righi, C.; Sahakyan, N.; Saito, T.; Saturni, F. G.; Schmidt, K.; Schmuckermaier, F.; Schubert, J. L.; Schweizer, T.; Sciaccaluga, A.; Silvestri, G.; Sitarek, J.; Sliusar, V.; Sobczynska, D.; Spolon, A.; Stamerra, A.; Striskovic, J.; Strom, D.; Strzys, M.; Suda, Y.; Suutarinen, S.; Tajima, H.; Takahashi, M.; Takeishi, R.; Temnikov, P.; Terauchi, K.; Terzic, T.; Teshima, M.; Truzzi, S.; Tutone, A.; Ubach, S.; van Scherpenberg, J.; Vazquez Acosta, M.; Ventura, S.; Viale, I.; Vigorito, C. F.; Vitale, V.; Vovk, I.; Walter, R.; Will, M.; Wunderlich, C.; Yamamoto, T.; Jouvin, L.; Linhoff, L.; Linhoff, M.

doi:10.1016/j.jheap.2024.09.011

Instruments for gamma-ray astronomy at Very High Energies (E>100GeV) have traditionally derived their scientific results through proprietary data and software. Data standardisation has become a prominent issue in this field both as a requirement for the dissemination of data from the next generation of gamma-ray observatories and as an effective solution to realise public data legacies of current-generation instruments. Specifications for a standardised gamma-ray data format have been proposed as a community effort and have already been successfully adopted by several instruments. We present the first production of standardised data from the Major Atmospheric Gamma-ray Imaging Cherenkov (MAGIC) telescopes. We converted 166h of observations from different sources and validated their analysis with the open-source software Gammapy. We consider six data sets representing different scientific and technical analysis cases and compare the results obtained analysing the standardised data with open-source software against those produced with the MAGIC proprietary data and software. Aiming at a systematic production of MAGIC data in this standardised format, we also present the implementation of a database-driven pipeline automatically performing the MAGIC data reduction from the calibrated down to the standardised data level. In all the cases selected for the validation, we obtain results compatible with the MAGIC proprietary software, both for the manual and for the automatic data productions. Part of the validation data set is also made publicly available, thus representing the first large public release of MAGIC data. This effort and this first data release represent a technical milestone toward the realisation of a public MAGIC data legacy.