The development of human organoid model systems has provided new avenues for patient-specific clinical care and disease modeling. However, all organoid systems are missing important cell types that, in the embryo, get incorporated into organ tissues during development. Based on the concept of how embryonic organs are assembled, we developed an organoid assembly approach starting with cells from the three primary germ layers; enteric neuroglial, mesenchymal, and epithelial precursors, all separately derived from human pluripotent stem cells. From these we generated human gastric tissue containing differentiated glands, surrounded by layers of smooth muscle containing functional enteric neurons that controlled contractions of the engineered tissue. We used this highly tractable system to identify essential roles for the enteric nervous system in the growth and regional identity of the gastric epithelium and mesenchyme and for glandular morphogenesis of the antral stomach. This approach of starting with separately-derived germ layer components was applied to building more complex fundic and esophageal tissue, suggesting this as a new paradigm for tissue engineering.