Quantum imaging and microscopy profit from quantum correlations and entanglement to image objects and samples with resolution and sensitivity that goes far beyond what can be achieved through classical optics. In order to carry out these techniques, suitable detectors with specific features must be employed. This paper aims to highlight the importance of sensors based on single photon avalanche diodes (SPAD) in quantum imaging and microscopy applications, paving the way for the next-generation ideal quantum imager. After reviewing the main techniques (based on quantum physics principles) for improving the resolution and sensitivity of a sample image, the pros and cons of different sensors, such as avalanche photodiodes (APDs), and the intensified and electron-multiplying charge coupled devices (ICCDs and EMCCDs), are identified. Then the analysis mainly focuses on SPAD-based detectors, identified as the best candidates for quantum imaging, critically discussing the requirements and performance, also in relation to already existing SPAD-based architectures with specific features fitting the application. Eventually, next-generation quantum imagers should integrate together all the best architectural choices herewith presented, so as to detect photon coincidences and to perform efficient event-driven readout, also by exploiting a suitable technology and SPAD design to optimize the discussed detection performance.