The digitalization of chemical research and industry is vastly increasing the available data for developing and parametrizing kinetic models. To exploit this data, machine learning approaches are needed that autonomously learn kinetic models from large amounts of reactor data. In this paper we develop such a tool. We present a neural network architecture that embeds thermodynamic and stoichiometric prior knowledge (STeNN) for the accurate, robust and data-efficient modelling of chemical kinetics. This network architecture is used in conjunction with neural ODEs to autonomously learn kinetic models directly from reactor data. Using the example of an adiabatic steam reformer, we demonstrate that our approach accurately recovers the true kinetics from reactor data, where conventional neural networks fail. It is further shown that the proposed framework can handle large datasets and learns kinetic models from up to 1000 reactor experiments in around ten minutes. Furthermore, due to the embedded physico-chemical knowledge, our model is robust to significant noise in the data, even in the low-data regime. We anticipate that our approach, in combination with emerging big data frameworks, will greatly increase the availability of accurate kinetic models, providing a boost to model-based reactor design and control.