Context. Polar ring galaxies (PRGs) are composed of two kinematically distinct and nearly orthogonal components, a host galaxy (HG) and a polar ring/disk (PR). The HG usually contains an older stellar population than the PR. The suggested formation channel of PRGs is still poorly constrained. Suggested options are merger, gas accretion, tidal interaction, or a combination of both. Aims. To constrain the formation scenario of PRGs, we study the compact stellar systems (CSSs) in two PRGs at different evolutionary stages: NGC 4650A with well-defined PR, and NGC 3808 B, which is in the process of PR formation. Methods. We use archival HST/WFPC2 imaging in the F450W, F555W, or F606W and F814W filters. Extensive completeness tests, PSF-fitting techniques, and color selection criteria are used to select cluster candidates. Photometric analysis of the CSSs was performed to determine their ages and masses using stellar population models at a fixed metallicity. Results. Both PRGs contain young CSSs (<1 Gyr) with masses of up to 5 × 10 6 M , mostly located in the PR and along the tidal debris. The most massive CSSs may be progenitors of metal-rich globular clusters or ultra compact dwarf (UCD) galaxies. We identify one such young UCD candidate, NGC 3808 B-8, and measure its size of r eff = 25.23−2.01 pc. We reconstruct the star formation history of the two PRGs and find strong peaks in the star formation rate (SFR, 200 M /yr) in NGC 3808 B, while NGC 4650 A shows milder (declining) star formation (S FR < 10 M /yr). This difference may support different evolutionary paths between these PRGs. Conclusions. The spatial distribution, masses, and peak star formation epoch of the clusters in NGC 3808 suggest for a tidally triggered star formation. Incompleteness at old ages prevents us from probing the SFR at earlier epochs of NGC 4650 A, where we observe the fading tail of CSS formation. This also impedes us from testing the formation scenarios of this PRG.