Imaging is a dominant strategy for data collection in neuroscience, yielding 3D stacks of images that can scale to petabytes of data for a single experiment. Machine learning-based algorithms from the computer vision domain can serve as a pair of virtual eyes that tirelessly processes these images to automatically construct more complete and realistic circuits. In practice, such algorithms are often too error-prone and computationally expensive to be immediately useful. Therefore we introduce a new fast and flexible learning-free automated method for sparse segmentation and 2D/3D reconstruction of brain micro-structures. Unlike supervised learning methods, our pipeline exploits structure-specific contextual clues and requires no extensive pre-training. This approach generalizes across different modalities and sample targets, including serially-sectioned scanning electron microscopy (sSEM) of genetically labeled and contrast enhanced processes, spectral confocal reflectance (SCoRe) microscopy, and high-energy synchrotron X-ray microtomography (µCT) of large tissue volumes. Experiments on newly published and novel mouse datasets demonstrate the high biological fidelity and recall of the proposed pipeline, as well as reconstructions of sufficient quality for preliminary biological study. Compared to existing supervised methods, it is both significantly faster (up to several orders of magnitude) and produces high-quality reconstructions that are robust to noise and artifacts.