Local activation time (LAT) mapping of cardiac chambers is vital for targeted treatment of cardiac arrhythmias in catheter ablation procedures. Current methods require too many LAT observations for an accurate interpolation of the necessarily sparse LAT signal extracted from intracardiac electrograms (EGMs). Additionally, conventional performance metrics for LAT interpolation algorithms do not accurately measure the quality of interpolated maps. We propose, first, a novel method for spatial interpolation of the LAT signal which requires relatively few observations; second, a realistic sub-sampling protocol for LAT interpolation testing; and third, a new color-based metric for evaluation of interpolation quality that quantifies perceived differences in LAT maps. Methods: We utilize a graph signal processing framework to reformulate the irregular spatial interpolation problem into a semi-supervised learning problem on the manifold with a closed-form solution. The metric proposed uses a color difference equation and color theory to quantify visual differences in generated LAT maps. Results: We evaluate our approach on a dataset consisting of seven LAT maps from four patients obtained by the CARTO electroanatomic mapping system during premature ventricular complex (PVC) ablation procedures. Random sub-sampling and reinterpolation of the LAT observations show excellent accuracy for relatively few observations, achieving on average 6% lower error than state-of-the-art techniques for only 100 observations. Conclusion: Our study suggests that graph signal processing methods can improve LAT mapping for cardiac ablation procedures. Significance: The proposed method can reduce patient time in surgery by decreasing the number of LAT observations needed for an accurate LAT map.