Efficient, nonparametric removal of noise and recovery of probability distributions from time series using nonlinear-correlation functions: Photon and photon-counting noise

Abstract

A preceding paper [M. Dhar, J. A. Dickinson, and M. A. Berg, J. Chem. Phys. 159, 054110 (2023)] shows how to remove additive noise from an experimental time series, allowing both the equilibrium distribution of the system and its Green’s function to be recovered. The approach is based on nonlinear-correlation functions and is fully nonparametric: no initial model of the system or of the noise is needed. However, single-molecule spectroscopy often produces time series with either photon or photon-counting noise. Unlike additive noise, photon noise is signal-size correlated and quantized. Photon counting adds the potential for bias. This paper extends noise-corrected-correlation methods to these cases and tests them on synthetic datasets. Neither signal-size correlation nor quantization is a significant complication. Analysis of the sampling error yields guidelines for the data quality needed to recover the properties of a system with a given complexity. We show that bias in photon-counting data can be corrected, even at the high count rates needed to optimize the time resolution. Using all these results, we discuss the factors that limit the time resolution of single-molecule spectroscopy and the conditions that would be needed to push measurements into the submicrosecond region.