The prediction of the uncertainty of route travel time predictions for all possible routes in an urban road network is of importance for example for logistics. Such predictions need to take the essential features of the data set as well as the underlying traffic dynamics into account. In this paper a large floating taxi data set is used in order to derive predictions of route travel time uncertainty based on link travel time uncertainty predictions. Prediction errors, that is actual travel times minus predicted travel times, are differentiated from model errors, that is measured travel times minus predicted travel times. These two errors are related, but not identical, as model errors contain measurement noise while the prediction errors do not. Detailed models for the variance of the link travel time prediction errors as well as the correlation between the model errors for different links are derived. The models are validated in depth using two different validation data sets. Estimates for the variance of prediction errors are obtained. The standardized model error distributions show a remarkable stability, such that modelling the variance appears to be sufficient for quantifying the uncertainty of the model errors. Furthermore we show that the model errors for adjacent links are highly correlated but correlations fade with increasing distance. Additionally usage of the road network plays a role with high correlation for links along common routes and low correlations for links along seldom used routes. We assume identical features for the prediction errors which is partly validated based on additional data. The paper provides a way to estimate the complete distribution of route travel time prediction errors for any given route in the street network.