We report multipronged progress on the stochastic averaging approach to numerical analytic continuation of imaginary-time correlation functions computed by quantum Monte Carlo simulations. With the sampled spectrum parametrized as a large number of δ-functions in continuous frequency space, a calculation of the configurational entropy lends support to a simple goodness-of-fit criterion for the optimal sampling temperature. To further investigate entropic effects, we compare spectra sampled in continuous frequency with results of amplitudes sampled on a fixed frequency grid. We demonstrate equivalences between sampling and optimizing spectral functions with the maximumentropy approach, with different parametrizations corresponding to different forms of the entropy in the prior probability. These insights revise prevailing notions of the maximum-entropy method and its relationship to stochastic analytic continuation. In further developments of the sampling approach, we explore various adjustable (optimized) constraints that allow sharp low-temperature spectral features to be resolved, in particular at the lower frequency edge. The constraints, e.g., the location of the edge or the spectral weight of a quasi-particle peak, are optimized using a statistical criterion based on entropy minimization under the condition of optimal fit. We show with several examples that this method can correctly reproduce both narrow and broad quasi-particle peaks. We next introduce a parametrization for more intricate spectral functions with sharp edges, e.g., power-law singularities. We present tests with synthetic data as well as with real simulation data for the spin-1/2 Heisenberg chain, where a divergent edge of the dynamic structure factor is due to deconfined spinon excitations. Our results demonstrate that distortions of sharp edges or quasiparticle peaks, which arise with other analytic continuation methods, propagate and cause artificial spectral features also at higher energies. The constrained sampling methods overcome this problem and allow analytic continuation of spectral functions with sharp edge features at unprecedented fidelity. We present results for S = 1/2 Heisenberg 2-leg and 3-leg ladders to illustrate the ability of the methods to resolve spectral features arising from both elementary and composite excitations. Finally, we also propose how the methods developed here could be used as "pre processors" for analytic continuation by machine learning. Edge singularities and narrow quasi-particle peaks being ubiquitous in quantum many-body systems, we expect the new methods to be broadly useful and take numerical analytic continuation to a new quantitative level.