As a traditional medicinal plant, Juglans mandshurica has been used for the treatment of cancer. Different organs of this plant showed anti-tumor activity in clinic and laboratory. Comparative identification of constituents in different plant organs is essential for investigation of the relationship between chemical constituents and pharmacological activities. For this aim, the roots, branches, and leaves of J. mandshurica were extracted with 50% v/v methanol and then subjected to ultra-high performance liquid chromatography with quadrupole time-of-flight mass spectrometry analysis conducted under low and high energy. As a result, we have to date identified 111 compounds consisting of 56 tannins, 29 flavonoids, 13 organic acids, 8 naphthalene derivatives, and 5 anthracenes. Five compounds, namely, diquercetin trihydroxy-truxinoyl-glucoside, two quercetin kaempferol dihydroxy-truxinoyl-glucosides, syringoyl-tri-galloyl-O-glucose, and dihydroxy-naphthalene syringoyl-glucoside, were tentatively identified as new compounds. Of the compounds identified, 76 were found in the root extract, 67 in the branch extract, and 37 in the leaf extract. Only six compounds including four organic acids and two tannins were found in all three extracts. We developed a rapid and sensitive ultra high performance liquid chromatography with quadrupole time-of-flight mass spectrometry approach to identify multiple constituents of complex extracts without separation and ion selection. The results presented provide useful information on further research of the bioactive compounds of J. mandshurica.