This study explores the effect of alkali treatment at ambient (25 °C) and elevated temperatures (100 °C) on the physicochemical, structural, morphological, and thermal properties of Calamus tenuis cane fibers (CTCFs) for the first time. Our purpose is to investigate their potential use as reinforcement in polymer composites, since cane fibers are generally known for their accurate and consistent geometrical orientation. Treatment with 8% (w/v) sodium hydroxide (NaOH) is carried out at ambient temperature and at 100 °C for 4 h. Chemical analysis and Fourier transform IR spectroscopy (FTIR) indicate some removal of non-cellulosic elements from CTCFs during alkali treatment, resulting in increased surface roughness, as confirmed by using SEM micrographs. This removal of non-cellulosic elements leads to an enhancement in the density of the treated CTCFs. Untreated and treated fibers are analyzed for maximum degradation temperature, thermal stability, and kinetic activation energy (Ea) using thermogravimetric analysis (TGA). In particular, Ea was considerably diminished with treatment and temperature. X-ray diffraction (XRD) results show an improved crystallinity index (37.38% to 44.02%) and crystallite size (2.73 nm to 2.98 nm) for fibers treated with 8% NaOH at ambient temperature. In conclusion, a general benefit was achieved by treating CTCFs, though the influence of increasing temperature treatment appears controversial.