Single photon detection generally consists of several stages: the photon has to interact with one or more charged particles, its excitation energy will be converted into other forms of energy, and amplification to a macroscopic signal must occur, thus leading to a "click." We focus here on the part of the detection process before amplification (which we have studied in a separate publication). We discuss how networks consisting of coupled discrete quantum states and structured continua (e.g. band gaps) provide generic models for that first part of the detection process. The input to the network is a single continuum (a continuum of single-photon states), the output is again a single continuum describing the next irreversible step. The process of a single photon entering the network, its energy propagating through that network and finally exiting into another output continuum of modes can be described by a single dimensionless complex transmission amplitude, T (ω). We discuss how to obtain from T (ω) the photo detection efficiency, how to find sets of parameters that maximize this efficiency, as well as expressions for other input-independent quantities such as the frequencydependent group delay and spectral bandwidth. We then study a variety of networks and discuss how to engineer different transmission functions T (ω) amenable to photo detection.