Wheat yield is not only affected by three components of yield, but also affected by plant height (PH). Identification and utilization of the quantitative trait loci (QTL) controlling these four traits is vitally important for breeding high-yielding wheat varieties. In this work, we conducted a QTL analysis using the recombinant inbred lines (RILs) derived from a cross between two winter wheat varieties of China, “Nongda981” (ND981) and “Nongda3097” (ND3097), exhibiting significant differences in spike number per unit area (SN), grain number per spike (GNS), thousand grain weight (TGW), and PH. A total of 11 environmentally stable QTL for these four traits were detected. Among them, four major and stable QTLs (QSn.cau-4B-1.1, QGns.cau-4B-1, QTgw.cau-4B-1.1, and QPh.cau-4B-1.2) explaining the highest phenotypic variance for SN, GNS, TGW, and PH, respectively, were mapped on the same genomic region of chromosome 4B and were considered a QTL cluster. The QTL cluster spanned a genetic distance of about 12.3 cM, corresponding to a physical distance of about 8.7 Mb. Then, the residual heterozygous line (RHL) was used for fine mapping of the QTL cluster. Finally, QSn.cau-4B-1.1, QGns.cau-4B-1, and QPh.cau-4B-1.2 were colocated to the physical interval of about 1.4 Mb containing 31 annotated high confidence genes. QTgw.cau-4B-1.1 was divided into two linked QTL with opposite effects. The elite NILs of the QTL cluster increased SN and PH by 55.71–74.82% and 14.73–23.54%, respectively, and increased GNS and TGW by 29.72–37.26% and 5.81–11.24% in two environments. Collectively, the QTL cluster for SN, GNS, TGW, and PH provides a theoretical basis for improving wheat yield, and the fine-mapping result will be beneficial for marker-assisted selection and candidate genes cloning.