The stromal compartment is increasingly recognized to play a role in cancer. However, its role in the transition from preinvasive to invasive disease is unknown. Most gastrointestinal tumors have clearly defined premalignant stages, and Barrett’s esophagus (BE) is an ideal research model. Supervised clustering of gene expression profiles from microdissected stroma identified a gene signature that could distinguish between BE metaplasia, dysplasia, and esophageal adenocarcinoma (EAC). EAC patients overexpressing any of the five genes (TMEPAI, JMY, TSP1, FAPα, and BCL6) identified from this stromal signature had a significantly poorer outcome. Gene ontology analysis identified a strong inflammatory component in BE disease progression, and key pathways included cytokine–cytokine receptor interactions and TGF-β. Increased protein levels of inflammatory-related genes significantly up-regulated in EAC compared with preinvasive stages were confirmed in the stroma of independent samples, and in vitro assays confirmed functional relevance of these genes. Gene set enrichment analysis of external datasets demonstrated that the stromal signature was also relevant in the preinvasive to invasive transition of the stomach, colon, and pancreas. These data implicate inflammatory pathways in the genesis of gastrointestinal tract cancers, which can affect prognosis.