Under the smart engineering system (SES), there is a huge demand for evaluating the efficacy of a large-scale networked intelligent perception system (IPS). Considering the large-scale, distributed, and networked system characteristics and perception task demands, this paper proposes a conceptual system for IPS efficacy evaluation and, on this basis, designs the architecture of the efficacy evaluation system. A networked IPS model is constructed based on domain ontology, an index system is quickly established for efficacy evaluation, the evaluation methods are assembled automatically, and adaptive real-time organization strategies are generated for networked perception based on efficacy estimate. After exploring these key technologies, a prototype system is created for the service-oriented integrated efficacy evaluation platform and used to verify and integrate research results. The research provides support for the efficacy evaluation theories and methods of large-scale networked IPS.