We present the case of a term-healthy neonate who developed hematemesis while being admitted at the newborn nursery. The infant was found to have gastric ulcers with duodenal eosinophils. The condition was conservatively managed and the symptoms, including ulcers, resolved with time; however, the etiology of the ulcers is still unknown.