Particulate matter (PM) pollution is a major global concern due to its negative impact on human health. To effectively address this issue, it is crucial to have a reliable and efficient forecasting system. In this study, we propose a framework for predicting particulate matter concentrations by utilizing publicly available data from low-cost sensors and deep learning. We model the temporal variability through a novel Long Short-Term Memory Neural Network that offers a level of interpretability. The spatial dependence of particulate matter pollution in urban areas is modeled by incorporating characteristics of the urban agglomeration, namely, mean population density and mean floor area ratio. Our approach is general and scalable, as it can be applied to any type of sensor. Moreover, our framework allows for portable sensors, either mounted on vehicles or used by people. We demonstrate its effectiveness through a case study in Greece, where dense urban environments combined with low cost sensor networks is a peculiarity. Specifically, we consider Patras, a Greek port city, where the net PM pollution comes from a variety of sources, including traffic, port activity and domestic heating. Our model achieves a forecasting accuracy comparable to the resolution of the sensors and provides meaningful insights into the results.