Many herbivorous insects have specific host–plant preferences, and it is unclear how these preferences evolved. Previously, we found that Bicyclus anynana larvae can learn to prefer novel food odors from eating leaves with those odors and transmit those learned preferences to the next generation. It is uncertain whether such acquired odor preferences can increase across generations of repeated odor feeding and be maintained even in the absence of odor. In this study, we fed larvae with novel banana odor‐coated leaves (odor‐fed larvae) for five consecutive generations, without selection on behavioral choices, and measured how larval innate preferences changed over time. Then, we removed the odor stimulus from a larval subgroup, while the other group continued to be odor‐fed. Our results show that larvae learned to prefer the novel odor within a generation of odor feeding and transmitted the learned preference to the next generation, as previously found. Odor‐fed larvae preferred odor significantly more compared to control larvae across five generations of repeated odor or control feeding. However, this led neither to increased odor preference, nor its stabilization. This suggests that when butterfly larvae feed on a new host, a preference for that novel food plant may develop and be transmitted to the next generation, but this preference lasts for a single generation and disappears once the odor stimulus is removed.