Background: Identifying the early-stage colon adenocarcinoma (ECA) patients who have lower risk cancer vs. the higher risk cancer could improve disease prognosis. Our study aimed to explore whether the glandular morphological features determined by computational pathology could identify high risk cancer in ECA via H&E images digitally. Methods: 532 ECA patients retrospectively from 2 independent data centers, as well as 113 from The Cancer Genome Atlas (TCGA), were enrolled in this study. Four tissue microarrays (TMAs) were constructed across ECA hematoxylin and eosin (H&E) stained slides. 797 quantitative glandular morphometric features were extracted and 5 most prognostic features were identified using minimum redundancy maximum relevance to construct an image classifier. The image classifier was evaluated on D2/D3 = 223, D4 = 46, D5 = 113. The expression of Ki67 and serum CEA levels were scored on D3, aiming to explore the correlations between image classifier and immunohistochemistry data and serum CEA levels. The roles of clinicopathological data and ECAHBC were evaluated by univariate and multivariate analyses for prognostic value. Results: The image classifier could predict ECA recurrence (accuracy of 88.1%). ECA histomorphometric-based image classifier (ECAHBC) was an independent prognostic factor for poorer disease-specific survival [DSS, (HR = 9.65, 95% CI 2.15-43.12, P = 0.003)]. Significant correlations were observed between ECAHBC-positive patients and positivity of Ki67 labeling index (Ki67Li) and serum CEA. Conclusion: Glandular orientation and shape could predict the high risk cancer in ECA and contribute to precision oncology. Computational pathology is emerging as a viable and objective means of identifying predictive biomarkers for cancer patients.