Agrimonia pilosa Ledeb., an important medicinal herb in traditional East Asian medicine, is primarily used to treat abdominal pain, dysentery, and hemostasis. There are ten other reported species of Agrimonia plants, including Agrimonia coreana Nakai—a naturally growing species in South Korea—and Agrimonia eupatoria Linn. Although recent studies have isolated numerous active constituents and investigated their effects, the medicinal utility of this herb is not yet fully explored. Through patch-clamp recording, a previous study reported that Agrimonia plant extracts inhibit the function of Ca2+ release-activated Ca2+ channels (CRACs). Herein, we aimed to identify and isolate the main compounds in A. coreana responsible for CRAC inhibition while assessing the anti-inflammatory effects mediated by this inhibition. We demonstrated for the first time that alphitolic acid isolated from A. coreana has a dose-dependent inhibitory effect on CRAC activity and, thus, an inhibitory effect on intracellular calcium increase. Furthermore, analysis of human CD4+ T cell proliferation via the carboxyfluorescein diacetate succinimidyl ester method revealed that alphitolic acid inhibited T cell proliferation in a concentration-dependent manner. Our findings provide a theoretical basis for the potential therapeutic use of alphitolic acid in the treatment of inflammatory diseases.