We present a multi-octave, mid-infrared supercontinuum source spanning from 3.6 µm and extending into long-wave infrared region out to 11 µm with an exceptionally high conversion efficiency of 8.2% and output power of 39 mW. These results were enabled by intra-pulse difference frequency generation involving a femtosecond Thulium doped fiber laser, an indium fluoride fiber and a zinc germanium phosphide crystal.