Colon and rectal tumors, often referred to as colorectal cancer, show different gene expression patterns in studies that analyze whole tissue biopsies containing a mix of tumor and non-tumor cells. To better characterize colon and rectal tumors, we investigated the gene expression profile of organoids generated from endoscopic biopsies of rectal tumors and adjacent normal colon and rectum mucosa from therapy-naive rectal cancer patients. We also studied the effect of vitamin D on these organoid types. Gene profiling was performed by RNA-sequencing. Organoids from a normal colon and rectum had a shared gene expression profile that profoundly differed from that of rectal tumor organoids. We identified a group of genes of the biosynthetic machinery as rectal tumor organoid-specific, including those encoding the RNA polymerase II subunits POLR2H and POLR2J. The active vitamin D metabolite 1α,25-dihydroxyvitamin D3/calcitriol upregulated stemness-related genes (LGR5, LRIG1, SMOC2, and MSI1) in normal rectum organoids, while it downregulated differentiation marker genes (TFF2 and MUC2). Normal colon and rectum organoids share similar gene expression patterns and respond similarly to calcitriol. Rectal tumor organoids display distinct and heterogeneous gene expression profiles, with differences with respect to those of colon tumor organoids, and respond differently to calcitriol than normal rectum organoids.