A novel test‐loading device was suggested in order to study the fracture behavior of brittle materials under mixed mode I/II/III loading conditions. A version of the compact tension shear specimen was used as the test configuration. Using a three‐dimensional finite element analysis, the influence of mode mixity on the stress intensity factors, the T‐stress, and 3‐D plastic zone around the crack tip was investigated. In addition, an experimental study was performed on an epoxy polymer using the proposed setup. Finally, the fracture toughness of pure epoxy was measured under several loading conditions. The numerical and experimental results manifested that the proposed setup is able to determine a full range of mixed mode I/II/III fracture properties. At the end, the fracture envelope obtained using the practical study was compared with various three‐dimensional fracture criteria. A negligible discrepancy was concluded between the practical data and the theoretical data estimated by the maximum mean principle stress criterion.