This article reports on progress in the analysis of Time-Domain Optical Coherence Tomography (OCT) applied to the dimensional metrology of Through Silicon Vias (TSV, vertical interconnect accesses in silicon, enabling 3D integration in micro-electronics) and estimates the deviations from earlier, simpler models. The considered TSV structures are 1D trenches and circular holes etched into silicon with a large aspect ratio. As a prerequisite for a realistic modelling, we work with spectra obtained from reference interferograms measured at a planar substrate, which fully includes the dispersion of the OCT apparatus. Applying a rigorous modal approach, we estimate the differences to a pure ray tracing technique. Accelerating our computations, we focus on the relevant fundamental modes and apply a Fabry-Perot model as an efficient approximation. Exploiting our results, we construct and present an iterative procedure based on the minimization of a merit function, which concludes TSV heights reliably, accurately and rapidly from measured interferograms.