Since the 1940s, infrared (IR) detection and imaging at wavelengths in the two atmospheric windows of 3 to 5 and 8 to 14 μm has been extensively researched. Through several generations, these detectors have undergone considerable developments and have found use in various applications in different fields including military, space science, medicine and engineering. For the most recently proposed generation, these detectors are required to achieve high-speed detection with spectral and polarization selectivity while operating at room temperature. Antenna coupled IR detectors appear to be the most promising candidate to achieve these requirements and has received substantial attention from research in recent years. This paper sets out to present a review of the antenna coupled IR detector family, to explore the main concepts behind the detectors as well as outline their critical and challenging design considerations. In this context, the design of both elements, the antenna and the sensor, will be presented individually followed by the challenging techniques in the impedance matching between both elements. Some hands-on fabrication techniques will then be explored. Finally, a discussion on the coupled IR detector is presented with the aim of providing some useful insights into promising future work.