“…In terms of application, a direct implementation of this developing approach could be driven by a retrieval-augmented generation system for work orders to advise the maintenance team by identifying the most probable underlying root cause to a given problem, and reduce both the time to action and asset downtime while increasing the safety of the railway service (Ansaldi, S. M., Agnello, P., Pirone, A., and Vallerotonda, M. R., 2021). This enhanced troubleshooting system would equip a model that combines pre-trained parametric memory (i.e., the causality-contextualized word embedding) and non-parametric memory (i.e., a classic data retrieval-based engine) for language generation (Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-t-, Rocktäschel, T., Riedel, S., and Kiela, D., 2020).…”