A discrete group G is called rigidly symmetric if for every C * -algebra A the projective tensor product ℓ 1 (G) ⊗A is a symmetric Banach * -algebra. For such a group we show that the twisted crossed product ℓ 1 α,ω (G; A) is also a symmetric Banach * -algebra, for every twisted action (α, ω) of G in a C * -algebra A . We extend this property to other types of decay, replacing the ℓ 1 -condition. We also make the connection with certain classes of twisted kernels, used in a theory of integral operators involving group 2-cocycles. The algebra of these kernels is studied, both in intrinsic and in represented version. * 2010 Mathematics Subject Classification: Primary 47L65, Secundary 22D15, 47D34, 43A20.