Trakošćan Castle, built on a rocky peak in the late 13th century, is a cultural heritage site protected as a historical entity by the Republic of Croatia. The Castle is constructed as a highly irregular masonry structure with timber or shallow masonry arches, vaults or dome floors. It was substantially renewed, upgraded and partially retrofitted from the 16th century until the year 2000. The M5.5 (VIII EMS) and M6.2 (VIII-IX EMS) earthquakes, which struck the city of Zagreb on 22 March 2020 and the Pokupsko-Petrinja area on 29 December 2020, strongly shook the Castle’s structure. Earthquake damage was observed and assessed by visual inspection accompanied by ambient vibration measurements. The slight cracks that appeared on masonry arches were found to be critically positioned, and can likely lead to the arches’ collapse if their spreading is not prevented. Ambient vibration measurements, which were compared to pre-earthquake ones, revealed the decrease in the fundamental frequencies of the Castle’s central tower unit and the second floor, thus possibly indicating the loss of structural stiffness as a consequence of the earthquake damage.