The aims of the study were to evaluate the influence of pectin isolated from fireweed (FP) on the mechanical and rheological properties of agar (A) gel, to investigate the release of phenolic compounds (PCs) and pectin from A-FP gels at simulated digestion in vitro, and to evaluate the oral processing and sensory properties of A-FP gels. The hardness of A-FP gels decreased gradually with the increase in the concentration of FP added (0.1, 0.4, and 1.6%). The hardness of A-FP1.6 gel was 41% lower than A gel. Rheological tests found A gel was a strong physical gel (storage modulus (G′) >>loss modulus (G″)), and the addition of FP up to 1.6% did not significantly change its G’. The G″ value decreased in A-FP gels compared to A gel. The release of galacturonic acid (GalA) was 3.4 ± 0.5, 0.5 ± 0.2, 2.4 ± 1.0, and 2.2 ± 0.7 mg/mL after digestion of A-FP1.6 gel in the oral in vivo phase (OP) and subsequent incubation in simulated gastric (SGF), intestinal (SIF), and colonic (SCF) fluids in vitro. The incubation medium after OP, SGF, and SIF digestion of A-FP1.6 contained 24–64 μg GAE/mL of PCs, while SCF contained 144 μg GAE/mL, supposing a predominant release of antioxidant activity from the gel in the colon. Chewing to readiness for swallowing A-FP gel required less time and fewer chews with less activity of the masseter and temporalis muscles. A-FP1.6 gel had a lower likeness score for taste and consistency and a similar score for appearance and aroma when compared with A gel. Thus, A-FP gels were weakened compared to A gel and required less time and muscle activity for oral processing. A-FP gel had antioxidant activity due to the PCs associated with pectin, while A gel had no antioxidant activity.